TRACE first injects kinematic priors into input and output projection layers and aligns nominal joint dynamics to reduce embodiment mismatch and support stable fine-tuning, then combines encoder distillation with low-rank reinforcement learning on a compact, quality-screened motion set.
Abstract
Humanoid behavior foundation models (BFMs) enable diverse whole-body control, but adapting a pretrained controller to a new embodiment remains challenging because of kinematic and dynamic mismatch. We present TRACE, a framework for efficient cross-embodiment adaptation that preserves pretrained motion representations while specializing feedback control to the target robot.TRACE first injects kinematic priors into input and output projection layers and aligns nominal joint dynamics to reduce embodiment mismatch and support stable fine-tuning. It then combines encoder distillation with low-rank reinforcement learning on a compact, quality-screened motion set, using a two-phase curriculum to establish stable tracking before refining difficult motions. We apply TRACE to transfer SONIC from Unitree G1 to Unitree H2 using 10 million motion frames and approximately eight hours of training on a single RTX PRO 6000 GPU, at less than 0.1% of the GPU-hour cost of training SONIC from scratch. The adapted controller achieves 96.08\% success on 67,953 evaluation motions under a height-scaled tracking criterion. Real-robot demonstrations span dynamic motion tracking and whole-body teleoperation, with collected demonstrations supporting downstream vision-language-action policy post-training. These results demonstrate practical reuse of a pretrained humanoid controller across robots with different body scales and dynamics.
Humanoid whole-body controllers can now track a diverse set of dynamic motions, but they are typically trained offline and then frozen, so teaching such a controller a new skill tends to erode the skills it already mastered. We study continual learning for humanoid whole-body motion, where a single controller must acqu...
Humanoid loco-manipulation of large, heavy objects demands forceful interaction across the entire body. However, such payloads shift a humanoid's center of mass and impose sustained loads across the upper body, challenging balance and command tracking. We present HULK, a whole-body control framework for forceful loco-m...
An Dang, Arturo Flores Alvarez, Yu-Ming Chen et al.· 0 citations
ViBe, a post-training framework for adapting motion trackers to perceptive control tasks, uses pre-trained visual encoders with a multi-query extractor module to learn task-relevant perceptive feedback and solves a goal-oriented Repose Cube task with a deliberately simple planner, demonstrating the efficacy of percepti...
Lokesh Krishna, S. Venkatesan, An Zhang et al.· 2 citations
Policies trained offline from teleoperated demonstrations can degrade outside their training distribution. This gap is particularly acute in long-horizon whole-body mobile manipulation, where long horizons amplify compounding errors and coordinated arm, torso, and base motion makes exhaustive demonstration coverage imp...
Wen-Si Ai, Christopher Luey, Karthik Dharmarajan et al.· 0 citations
Humanoid motion tracking provides a scalable interface for transferring kinematic human motion to whole-body robot control, but highly dynamic and contact-rich references remain difficult because underactuation and discontinuous contacts can restrict the closed-loop state distributions explored during training. Externa...
Chao-Jie Fu, Cheng-Kai Su, Lei Jiang et al.· Frontiers in Neurorobotics· 0 citations
Cross-embodiment human-to-robot motion retargeting requires transferring human motion to robot-feasible actions despite differences in kinematic structure, reachable workspace, and sensing-to-control latency. This paper proposes Cross-Embodiment Motion Retargeting (CE-MR), a lightweight Physical AI framework that combi...
S. Jang, H. Cho, Hyung-Gil Hong et al.· Actuators· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.