Skip to content

Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation

Sep 2026 · arXiv.org · Vol abs/2609.23968 · 1 citation · 43 references
Computer Science

TL;DR

Opt2VLA is presented, a force-aware VLA framework that introduces explicit force commands at the VLA-to-control interface for humanoid whole-body manipulation and shows that explicit force conditioning enables more accurate and consistent force regulation than motion-only control, while physically grounded torque supervision from TO further improves force tracking accuracy and stability.

Abstract

Humanoid robots are expected to perform diverse human-level tasks in daily environments, many of which require precise regulation of interaction forces. While recent vision-language-action (VLA) models have shown promise for semantic planning and visuomotor control, existing humanoid systems primarily represent actions through geometric motion goals and rely on whole-body controllers focused on motion tracking, with limited explicit reasoning or control of interaction forces. This limitation is particularly relevant in contact-rich tasks, where geometrically similar motions may require different force regimes depending on the task context and where visual observations may become unreliable after contact. In this work, we present Opt2VLA, a force-aware VLA framework that introduces explicit force commands at the VLA-to-control interface for humanoid whole-body manipulation. A single multi-task VLA policy jointly predicts both geometric motion goals and continuous contact-force references, which are tracked by task-specific reinforcement learning (RL)-based whole-body controllers. To provide scalable and physically grounded supervision, we generate dynamically feasible and contact-consistent training data via whole-body trajectory optimization (TO) with explicit force references. We evaluate Opt2VLA on three contact-rich humanoid tasks and show that explicit force conditioning enables more accurate and consistent force regulation than motion-only control, while physically grounded torque supervision from TO further improves force tracking accuracy and stability. Closed-loop evaluations further demonstrate language-conditioned force modulation with Opt2VLA in simulation and on humanoid hardware.

View source

Similar papers

Preprint Sep 2026

Uni-VLaT: Whole-Body Tactile Adaptation of VLA Policies for Humanoid Loco-Manipulation

Physical contact often determines how a humanoid should respond during loco-manipulation, yet vision and proprioception alone are often insufficient to characterize physical interaction, especially when the contact region is occluded. Unlike sparse force or torque measurements at predefined regions, distributed tactile...

Zi-Hao Wang, Shu-Tong Liu, Si-Qi Zheng et al. · 0 citations
#artificial intelligence Preprint Sep 2026

FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation

The FWBC-VLA is proposed, a force-aware framework that bridges task-level VLA action generation and low-level whole-body compensation control for wheeled-legged robots and demonstrates the effectiveness of the FWBC-VLA in contact-rich loco-manipulation.

Yu-Tian Zhang, Si-Yuan Ma, Li-Wen Yang et al. · 1 citation
Preprint Sep 2026

CompVLA: A Variable Compliance Vision-Language-Action Model for Contact-rich Manipulation

Contact-rich manipulation, requiring robots to regulate not only motion but also how they yield to external forces, has emerged as the next frontier for Vision-Language-Action (VLA) models. However, existing VLAs output purely kinematic commands, degrading performance on real-world contact-rich tasks. In this paper, we...

Jongmin Kim, Junsu Ha, Che-Sang Park et al. · 1 citation
Preprint Sep 2026

TAO-Force: Unifying Force-Aware Perception and Fast-Slow Control for Contact-Rich Manipulation

TAO-Force is proposed, a force-conditioned VLA framework that combines force-aware policy learning with contact-regulated execution and introduces Force-conditioned Feature-wise Linear Modulation to inject encoded force feedback into the representations of a frozen pretrained visual-language backbone while preserving i...

Bo-Han Gan, Xuan Wen, Yong-Shen Zhao et al. · 0 citations

EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation

EgoHumanoid-V2 is presented, the first egocentric human-to-humanoid skill transfer framework for coordinated whole-body loco-manipulation, which improves end-effector pose accuracy while preserving whole-body coordination and uses robot-arm rendering and training-time image augmentation to reduce the visual embodiment...

Jin Chen, Yi-Ming Jiang, Chong-Yang Xu et al. · 2 citations
Preprint Sep 2026

CR-VLA-Force: Learning Control-aware Compliance VLA Model for Robust Contact-rich Robotic Manipulation

Integrating visuomotor policies or Vision-Language-Action (VLA) models with force/torque (F/T) perception has demonstrated significant progress in imitation learning for robotic manipulation. However, existing force-aware VLA models frequently exhibit limited capability in precise force tracking and rapid successive ad...

Zhao-Hong Mai, Chao Wang, Chao Zeng et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.