Skip to content

Learning Holistic Whole-Body Loco-Manipulation with a Bipedal Mobile Manipulator

Sep 2026 · arXiv.org · Vol abs/2609.18930 · 0 citations · 20 references
Computer Science

TL;DR

A unified whole-body controller trained with reinforcement learning that directly maps 6-DoF end-effector targets to coordinated actions for the bipedal base and robotic arm, providing a common end-effector interface for diverse manipulation tasks.

Abstract

Bipedal loco-manipulation enables robots to interact with objects beyond the nominal workspace of their arms by coordinating locomotion and manipulation. Realizing this capability requires a low-level whole-body controller that translates task-level manipulation goals into coordinated arm and leg motions while maintaining balance. We present a unified whole-body controller trained with reinforcement learning that directly maps 6-DoF end-effector targets to coordinated actions for the bipedal base and robotic arm. Given only an end-effector target, the learned controller autonomously coordinates reaching, postural adaptation, and stepping without explicit base-velocity or footstep commands. A reward-gating strategy regulates the trade-offs among end-effector tracking, locomotion, and balance during training, while a temporal context estimator combines windowed Transformer encoding, recurrent GRU memory, and auxiliary dynamics prediction to extract dynamics-relevant information from observation history. Real-robot experiments demonstrate that the same controller supports reaching, postural adaptation, and stepping under commands from VR teleoperation, a learned diffusion policy, and scripted trajectories, providing a common end-effector interface for diverse manipulation tasks.

View source

Similar papers

Sep 2026

ViLoMan: Learning Visual-Proprioceptive Whole-Body Loco-Manipulation Skills for Humanoid Robots

Experimental results demonstrate that a single policy enables a Unitree G1 humanoid to complete the full task using only onboard depth sensing and proprioception, while generalizing robustly across task variations and transferring effectively from simulation to reality.

Ze-Jie Tian, Rui-Bing Hou, Bin Ma et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Weave: Learning Whole-Body Dexterous Loco-Manipulation from Human-Object Interactions

Weave is presented, a unified framework for learning whole-body dexterous humanoid-object interaction from captured human demonstrations that converts captured human-object interactions into executable robot-object references through contact-aware retargeting and approach-motion completion.

Liu Cao, Xing-Ze Wu, Jing-Zhi Cui et al. · 2 citations
Preprint Oct 2026

Precise SE(3) End-Effector Tracking in Whole-Body Humanoid Control

Precise end-effector tracking during humanoid whole-body motion is challenging due to floating-base oscillations, gravity, dynamic coupling, and locomotion-induced disturbances. We propose ResGAC, a whole-body humanoid controller for precise end-effector pose tracking that combines geometric admittance control (GAC) wi...

Joohwan Seo, Xiao-Feng Guo, Jin-Kun Cao et al. · 0 citations
Preprint Sep 2026

SwingBot: Learning Whole-Body Brachiation for Humanoid Robots

Brachiation enables primates to move across overhead supports when ground paths are blocked, suggesting a complementary locomotion mode for robots operating in cluttered or hazardous environments. Bringing this capability to high-DoF humanoid robots is difficult because the controller must discover a long-horizon relea...

Yu-Jie Xiong, Peng Zhai, Tai-Wei Hou et al. · 0 citations
Preprint Sep 2026

Force-Aware Reinforcement Learning with Hybrid Sensorless Force Estimation for Wheeled-Legged Loco-Manipulation

Force-controlled loco-manipulation requires a whole-body policy to coordinate locomotion and arm motion while regulating end-effector interaction forces. This is challenging under floating-base dynamics and changing support contacts, particularly when end-effector force/torque sensing is unavailable for control. This p...

Xuanqi Zeng, Jia-Ming Wang, Tian-Lin Zhang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.