Robust and Generalized Humanoid Motion Tracking
By: Yubiao Ma , Han Yu , Jiayin Xie and more
Potential Business Impact:
Teaches robots to move without falling.
Learning a general humanoid whole-body controller is challenging because practical reference motions can exhibit noise and inconsistencies after being transferred to the robot domain, and local defects may be amplified by closed-loop execution, causing drift or failure in highly dynamic and contact-rich behaviors. We propose a dynamics-conditioned command aggregation framework that uses a causal temporal encoder to summarize recent proprioception and a multi-head cross-attention command encoder to selectively aggregate a context window based on the current dynamics. We further integrate a fall recovery curriculum with random unstable initialization and an annealed upward assistance force to improve robustness and disturbance rejection. The resulting policy requires only about 3.5 hours of motion data and supports single-stage end-to-end training without distillation. The proposed method is evaluated under diverse reference inputs and challenging motion regimes, demonstrating zero-shot transfer to unseen motions as well as robust sim-to-real transfer on a physical humanoid robot.
Similar Papers
One-shot Humanoid Whole-body Motion Learning
Robotics
Robots learn new moves from just one example.
EGM: Efficiently Learning General Motion Tracking Policy for High Dynamic Humanoid Whole-Body Control
Robotics
Robots learn to copy human movements better.
A Whole-Body Motion Imitation Framework from Human Data for Full-Size Humanoid Robot
Robotics
Robots copy human moves, staying balanced.