Oct 2026· Proceedings of the AAAI Symposium Series· Vol 10, pp. 885-894· 0 citations· 31 references
Computer Science
TL;DR
OIL, an Object Interaction Layer that extends the kinematic command interface of whole-body control to include desired object motion and contact, is introduced and zero-shot generalization to novel behavior combinations and sim-to-real transfer on the Digit humanoid robot is demonstrated.
Abstract
Recent progress in learned whole-body controllers for humanoid robots has enabled robust free-space motion by tracking kinematic targets such as joint or end-effector trajectories. This interface provides a useful abstraction for upstream systems, including motion capture, teleoperation, or generative models, which can specify desired motion without reasoning about forces or balance. However, this abstraction has largely been limited to robot motion, requiring task-specific controllers or retraining for object interaction. We introduce OIL, an Object Interaction Layer that extends the kinematic command interface of whole-body control to include desired object motion and contact. OIL augments a standard controller with object-centric commands and translates them into coordinated whole-body behavior while preserving locomotion and balance. This design enables a single learned policy to execute non-prehensile interactions, including pushing, pulling, two-arm pick-and-place, and locomotion-coupled transport, directly from object-level kinematic targets without task-specific retraining. In simulation, we demonstrate that object-level commands improve performance over robot-centric controllers while matching task-specific policies across variations in object properties such as mass and size. We further demonstrate zero-shot generalization to novel behavior combinations and sim-to-real transfer on the Digit humanoid robot.
Changing a humanoid robot's manipulation policy should not require retraining the controller that maintains the robot's balance. This study introduces DUET, a decoupled execution framework that enables locomotion and manipulation controllers to operate simultaneously by combining their commands only at the robot interf...
Kapalik Khanal, Biswash Khatiwada, S. Afrifa et al.· 0 citations
Humanoid motion tracking has scaled to general policies that reproduce diverse human motion, but the resulting behavior is in free-space: the tracker knows where the body should be, not how it should interact with the environment. Other work makes the object part of the objective, yet abstracts that interaction to cont...
Meng-Jie Zhao, Yu-Xin Chen, Yi-Yang Shao et al.· 0 citations
Many everyday tasks require controlling contact force as well as motion. On a humanoid, this force must often be coordinated across both hands and the whole body, and cannot be specified by kinematic trajectories alone. Therefore, we present FLORE, a framework for learning force-reactive humanoid loco-manipulation. We...
Si-Hang Li, Xiao-Feng Guo, Jin-Kun Cao et al.· 5 citations
Humanoids are increasingly capable of tracking complex whole-body motions, but physical interaction introduces a different challenge. When a robot makes contact with a person or the environment, it needs to respond to external forces while preserving the motion needed for the task. This response can vary across directi...
Humanoid controllers need the ability to yield to external forces while retaining the capacity to resume their original tasks. However, tracking objectives penalize the deviations needed for yielding, while relaxing tracking goals persistently can make task recovery harder. Existing approaches often rely on task-specif...
Hao-Yang Li, Ke-Qi Zhu, Zhan-Xiang Cao et al.· 0 citations
WACL is proposed, a hierarchical framework that describes each whole-arm contact task with three robot-agnostic representations and hands them to a quasi-static surface-contact optimizer: semantic keypoints that summarize the scene, a reference contact trajectory that specifies where and how the arm presses on the obje...
Bo-Hao Huang, Daniel Seita, Erdem Biyik· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.