Skip to content
Open access

OIL: An Object Interaction Layer for Humanoid Whole-Body Control

Oct 2026 · Proceedings of the AAAI Symposium Series · Vol 10, pp. 885-894 · 0 citations · 31 references
Computer Science

TL;DR

OIL, an Object Interaction Layer that extends the kinematic command interface of whole-body control to include desired object motion and contact, is introduced and zero-shot generalization to novel behavior combinations and sim-to-real transfer on the Digit humanoid robot is demonstrated.

Abstract

Recent progress in learned whole-body controllers for humanoid robots has enabled robust free-space motion by tracking kinematic targets such as joint or end-effector trajectories. This interface provides a useful abstraction for upstream systems, including motion capture, teleoperation, or generative models, which can specify desired motion without reasoning about forces or balance. However, this abstraction has largely been limited to robot motion, requiring task-specific controllers or retraining for object interaction. We introduce OIL, an Object Interaction Layer that extends the kinematic command interface of whole-body control to include desired object motion and contact. OIL augments a standard controller with object-centric commands and translates them into coordinated whole-body behavior while preserving locomotion and balance. This design enables a single learned policy to execute non-prehensile interactions, including pushing, pulling, two-arm pick-and-place, and locomotion-coupled transport, directly from object-level kinematic targets without task-specific retraining. In simulation, we demonstrate that object-level commands improve performance over robot-centric controllers while matching task-specific policies across variations in object properties such as mass and size. We further demonstrate zero-shot generalization to novel behavior combinations and sim-to-real transfer on the Digit humanoid robot.

Read PDF

Similar papers

Preprint Sep 2026

DUET: Decoupled Upper- and Lower-Body Execution for Task-Agnostic Humanoid Loco-Manipulation

Changing a humanoid robot's manipulation policy should not require retraining the controller that maintains the robot's balance. This study introduces DUET, a decoupled execution framework that enables locomotion and manipulation controllers to operate simultaneously by combining their commands only at the robot interf...

Kapalik Khanal, Biswash Khatiwada, S. Afrifa et al. · 0 citations
Preprint Nov 2026

Ctrl-F: Force as an Interface for Humanoid Loco-Manipulation

Humanoid motion tracking has scaled to general policies that reproduce diverse human motion, but the resulting behavior is in free-space: the tracker knows where the body should be, not how it should interact with the environment. Other work makes the object part of the objective, yet abstracts that interaction to cont...

Meng-Jie Zhao, Yu-Xin Chen, Yi-Yang Shao et al. · 0 citations
Preprint Oct 2026

Learning Force-Reactive Humanoid Loco-Manipulation

Many everyday tasks require controlling contact force as well as motion. On a humanoid, this force must often be coordinated across both hands and the whole body, and cannot be specified by kinematic trajectories alone. Therefore, we present FLORE, a framework for learning force-reactive humanoid loco-manipulation. We...

Si-Hang Li, Xiao-Feng Guo, Jin-Kun Cao et al. · 5 citations
Sep 2026

CEER2: Directional and Tunable End-Effector and Root Compliance for Humanoid Loco-Manipulation

Humanoids are increasingly capable of tracking complex whole-body motions, but physical interaction introduces a different challenge. When a robot makes contact with a person or the environment, it needs to respond to external forces while preserving the motion needed for the task. This response can vary across directi...

Xin-Yuan Luo, Chun-Yuan Yang, Bo-Yuan Chen et al. · 0 citations
Preprint Nov 2026

CompliantBot: Learning Whole-Body Compliance across Task Interfaces for Humanoid Control

Humanoid controllers need the ability to yield to external forces while retaining the capacity to resume their original tasks. However, tracking objectives penalize the deviations needed for yielding, while relaxing tracking goals persistently can make task recovery harder. Existing approaches often rely on task-specif...

Hao-Yang Li, Ke-Qi Zhu, Zhan-Xiang Cao et al. · 0 citations
#machine learning Preprint Oct 2026

Beyond the End-Effector: Learning Whole-Arm Contact Manipulation from Human Demonstrations

WACL is proposed, a hierarchical framework that describes each whole-arm contact task with three robot-agnostic representations and hands them to a quasi-static surface-contact optimizer: semantic keypoints that summarize the scene, a reference contact trajectory that specifies where and how the arm presses on the obje...

Bo-Hao Huang, Daniel Seita, Erdem Biyik · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.