Papers
Topics
Authors
Recent
Search
2000 character limit reached

PingpongDuo: Hierarchical Framework for Humanoid Table-Tennis Doubles

Updated 16 October 2026
  • PingpongDuo is a hierarchical framework designed for effective table tennis doubles with a safe coordination by focusing on attributing footage steps according to safe guides recalled by the robots
  • Key components include real-time joint team positioning, individually learned footwork and striking skills, and a racket-arm correction mechanism aimed at correcting the upcoming motion states of the robot-designed actions
  • Respect heavy accuracy racket striking collision correction when required for robot performance, significantly enhancing reliability during gaming sessions

PingpongDuo is a hierarchical framework for agile humanoid table-tennis doubles with safe team coordination. It enables two humanoid robots to strike in strict alternation while sharing a confined workspace, combining a risk-aware team-positioning planner, individually learned footwork and striking skills, transition-aware skill composition, and a racket-arm residual controller. The system is implemented on two 29-degree-of-freedom Unitree G1 humanoids and uses external motion capture for robot and ball state estimation (Jiang et al., 14 Oct 2026).

1. Problem formulation and system architecture

Humanoid table-tennis doubles imposes constraints absent from conventional singles play. The robot assigned to the kk-th incoming ball must differ from the robot assigned to the preceding ball:

hk+1≠hk.h_{k+1}\neq h_k.

Consequently, a valid return requires not only successful racket–ball contact, but also compliance with the prescribed alternating-striker order. Both humanoids share the central workspace: the current striker requires sufficient room for preparation and follow-through, while the previous striker must clear the region without compromising its own future recovery.

PingpongDuo separates the system into hierarchical layers:

  1. Ball prediction and strike planning estimate the contact state and racket command.
  2. Team-level positioning jointly selects lateral targets for both humanoids.
  3. Individual skills execute footwork, clearance, recovery, or striking.
  4. Racket-arm residual control corrects the nominal strike using simulated return feedback.
  5. A state machine enforces striking alternation and transitions among striking, clearance, waiting, preparation, and recovery.

For each robot ii, the system maintains a robot state xtix_t^i, ball state btb_t, state-machine phase ϕti\phi_t^i, and the identity hkh_k of the robot assigned to the next incoming ball. The planner is event-driven at the incoming-ball level, whereas the learned controllers operate at the low-level control frequency.

The system is evaluated in Isaac Lab with physics simulation at 200 Hz and control at 50 Hz. Hardware experiments use two Unitree G1 humanoids. Real-world state estimation relies on external motion capture rather than fully onboard perception.

2. Ball prediction and nominal striking

PingpongDuo uses an adaptive extended Kalman filter to estimate ball position and velocity. A physics model predicts flight under gravity, aerodynamic drag, and table bounces. The system then selects a contact position and contact time and computes a racket command for the designated striker.

For robot ii, the strike command is

cti,hit=(pri,⋆,vri,⋆,τti),c_t^{i,\mathrm{hit}} = \left( p_r^{i,\star}, v_r^{i,\star}, \tau_t^i \right),

where pri,⋆p_r^{i,\star} is the desired racket position at contact, hk+1≠hk.h_{k+1}\neq h_k.0 is the desired racket velocity, and hk+1≠hk.h_{k+1}\neq h_k.1 is the remaining time to contact.

The nominal striking policy is

hk+1≠hk.h_{k+1}\neq h_k.2

where hk+1≠hk.h_{k+1}\neq h_k.3 contains proprioception and recent control history, hk+1≠hk.h_{k+1}\neq h_k.4 is a selected whole-body reference-motion feature, and hk+1≠hk.h_{k+1}\neq h_k.5 is a whole-body joint-position target.

Training combines motion imitation, task rewards, stability terms, and control regularization. The task rewards encourage the racket to reach the commanded position and velocity and to align the racket-face normal with the desired strike direction near contact. The strike policy alone does not solve the doubles problem because it does not determine how the non-striker should move.

3. Joint team-positioning planner

At planning step hk+1≠hk.h_{k+1}\neq h_k.6, the team policy proposes a pair of lateral base targets:

hk+1≠hk.h_{k+1}\neq h_k.7

The planning observation contains the predicted strike command, the current base positions of both robots, and the previously accepted target pair. The robots remain within a suitable longitudinal range for striking, while the planner primarily selects lateral positions because lateral displacement governs clearance and subsequent recovery.

The two target components have distinct functions. The striker target supports the immediate return, whereas the non-striker target clears the hitting region while preserving its ability to prepare for the next turn.

The planner is trained over sequences of incoming balls using PPO-style constrained policy optimization. Its abstract objective is

hk+1≠hk.h_{k+1}\neq h_k.8

where hk+1≠hk.h_{k+1}\neq h_k.9 represents team-level task performance and ii0 measures inter-robot separation violations. The low-level controller and risk estimator remain fixed during planner training, isolating target selection from execution.

This joint formulation differs from independently positioning each robot. It permits the planner to account simultaneously for immediate striking quality, clearance, future recovery, and role alternation.

4. Learned risk filtering and role-aware safety

PingpongDuo estimates collision risk from closed-loop behavior rather than from target geometry alone. It monitors three classes of inter-robot separation:

ii1

For candidate target pair ii2, the fixed low-level controller is rolled out over an interval ii3. For body-part class ii4, the risk label is

ii5

where ii6 is the corresponding distance and ii7 is the minimum allowed separation.

An MLP ii8 predicts per-part risks:

ii9

The scalar risk used for filtering is their mean:

xtix_t^i0

If

xtix_t^i1

the proposed pair is accepted. Otherwise, the system searches for the closest admissible pair satisfying the risk constraint:

xtix_t^i2

The defining role-aware condition is

xtix_t^i3

The filter therefore preferentially preserves the striker’s target and modifies the non-striker’s target to resolve the conflict. This reflects the greater immediate sensitivity of the striker’s position: changing it can degrade racket reach, timing, or return quality, whereas the non-striker generally has more freedom to move laterally.

Target search is implemented by grid search over the admissible target set xtix_t^i4. If no safe pair exists, both robots return to predefined default targets and the next strike handoff is withheld. This fallback prioritizes safe coordination over continuation of an invalid alternating exchange.

Compared with a rule-based planner and a heuristic control-barrier-function filter, the learned-risk approach avoids contacts in cases where those baselines fail. The learned planner is also important: filtering rule-based targets improves safety, but learned target selection improves future preparation and produces longer return sequences.

5. Skill learning, transition composition, and residual striking

Footwork and human motion references

The authors collected approximately 200 human table-tennis doubles footwork clips covering strike preparation, non-striker clearance, recovery, and different lateral movement distances. The clips were retargeted to the humanoid using General Motion Retargeting and annotated with lateral displacement.

For a requested displacement xtix_t^i5, the reference motion is selected by

xtix_t^i6

where

xtix_t^i7

The footwork policy is trained with position and velocity tracking, motion imitation, stability objectives, and control regularization. During movement, target reaching is emphasized; during waiting, braking and maintenance of a ready posture are emphasized.

State-machine execution

For robot xtix_t^i8, the nominal action is

xtix_t^i9

The striking phase includes the strike and a short follow-through. After striking, the robot becomes the non-striker and clears the central region, while the teammate moves toward the next striking position. Clearance and preparation overlap rather than requiring sequential completion.

The same skills support opposite sides through mirroring of observations, commands, reference motions, and actions.

Transition-aware training

Independent policy switching can fail because the state at a transition is not a nominal standing state. A robot may retain linear or angular velocity after striking, may still be moving after clearance, or may need to strike before footwork has settled.

PingpongDuo therefore trains each skill from states generated by the other:

btb_t0

The transition datasets retain body pose, orientation, linear and angular velocity, and joint positions and velocities. Control histories are maintained across switches, and references are blended over a short transition interval.

Racket-arm residual

Fast footwork can leave the humanoid slightly misaligned or moving at contact. PingpongDuo introduces a bounded residual over the seven racket-arm joints:

btb_t1

Here btb_t2 is the estimated ball position and velocity, btb_t3 embeds the arm correction into the full action vector, btb_t4 is the residual scale, and btb_t5 is a phase-dependent gate that activates the residual near contact and removes it afterward.

The residual is trained using return feedback rather than only racket tracking error. The simulated outcome considers whether the ball is contacted, crosses the net, lands on the opponent’s table, lands accurately, and maintains adequate net clearance. Misses, low net crossings, out-of-bounds landings, unintended ball–body contacts, and excessive residual magnitude are penalized.

This objective reflects the fact that the smallest racket-position error does not necessarily yield the best return: contact orientation, racket velocity, body motion, and timing jointly determine outgoing-ball behavior.

6. Calibration, evaluation, and limitations

Real-to-sim-to-real calibration

The simulator is calibrated using real measurements of vertical drops, oblique ball–table impacts, flight trajectories, rebound heights, contact times, and post-impact velocities. The identified quantities include aerodynamic drag, table restitution, friction, speed-dependent normal restitution, and effective tangential attenuation for moving-racket contact.

The fitting procedure first estimates flight and table dynamics and then fits racket-contact parameters. This staged procedure reduces the possibility that one incorrect model component compensates for another. The calibrated simulator is subsequently randomized over ball mass, drag, table restitution, racket-contact response, observation perturbations, and actuator delays.

Evaluation protocol

The experiments use Isaac Lab with physics at 200 Hz and control at 50 Hz. Evaluations use five seeds. Planner evaluations contain 100 attempts per seed; policy evaluations use 100 balls and one clearance trial per seed; movement-and-striking refinement conditions use 100 trials.

Reported metrics include mean returns, btb_t6 for the percentage of attempts with at least btb_t7 alternating legal returns, racket-contact success btb_t8, legal-return success btb_t9, racket position and velocity errors, racket-normal error, lateral clearance-target error ϕti\phi_t^i0, and motion-reference MPJPE.

A legal return must cross the net, land on the opponent’s table, and obey the alternating-striker order.

Quantitative results

The team-planner comparison is:

Method Mean returns ϕti\phi_t^i1 ϕti\phi_t^i2 ϕti\phi_t^i3 ϕti\phi_t^i4 (cm)
Rule-based ϕti\phi_t^i5 57.4% 48.0% 38.4% 7.92
Rule + heuristic CBF ϕti\phi_t^i6 57.4% 48.0% 39.2% 7.96
Rule + learned risk ϕti\phi_t^i7 57.4% 48.0% 38.8% 7.94
RL + learned risk ϕti\phi_t^i8 64.0% 54.8% 46.6% 7.42

For composed footwork and striking, the system achieves ϕti\phi_t^i9, legal-return success hkh_k0, clearance error hkh_k1 cm, and motion-reference MPJPE of hkh_k2 mm. Without arm refinement, hkh_k3 falls to 55.2% and hkh_k4 to 44.2%, while clearance remains hkh_k5 cm. Thus the residual increases contact success by 12.2 percentage points and legal-return success by 11.4 percentage points without altering the clearance behavior.

The abstract reports a 13.2% improvement in ball-return success over the state-of-the-art baseline. In real-world experiments, the robots complete a 2.15 m clearance-and-recovery cycle in 2.4 s with a peak speed of 2.23 m/s, approximately 2 cm positioning error during clearance, and more than 10 consecutive alternating strikes.

Limitations

PingpongDuo has several stated limitations:

  • External motion capture: the real system does not yet provide fully onboard perception of the robots and ball.
  • No spin modeling: spin measurements are unavailable, and spin effects are omitted from trajectory prediction and racket–ball interaction.
  • Simulation-derived risk: the risk estimator depends on the fidelity of simulated closed-loop rollouts and their transfer to hardware.
  • Local discrete filtering: grid search over candidate target pairs does not provide a formal global safety guarantee.
  • Limited high-level strategy: the system returns incoming balls under a prescribed alternation, rather than autonomously selecting attacking or defensive tactics.
  • Safe-play interruption: when no safe target pair exists, the system falls back to default targets and withholds the next handoff.

PingpongDuo’s principal contribution is the integration of joint role-aware planning, learned closed-loop safety filtering, human-guided doubles footwork, transition-aware skill composition, and return-feedback arm refinement. These components address the coupled requirements of strict alternation, rapid clearance, collision avoidance, and accurate striking in a shared humanoid workspace.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (1)

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to PingpongDuo.