TAO-Force is proposed, a force-conditioned VLA framework that combines force-aware policy learning with contact-regulated execution and introduces Force-conditioned Feature-wise Linear Modulation to inject encoded force feedback into the representations of a frozen pretrained visual-language backbone while preserving its semantic priors.
Abstract
Vision-Language-Action (VLA) models have demonstrated strong performance across diverse robotic manipulation tasks, yet their predominantly vision-centric perception and position-controlled execution remain insufficient for contact-rich manipulation. Visual observations alone often provide limited evidence of contact onset and interaction magnitude, while position-control policies cannot respond compliantly to rapidly changing contact dynamics. To bridge both the perception and control gaps, we propose TAO-Force, a force-conditioned VLA framework that combines force-aware policy learning with contact-regulated execution. For force-aware perception, TAO-Force introduces Force-conditioned Feature-wise Linear Modulation (F-FiLM) to inject encoded force feedback into the representations of a frozen pretrained visual-language backbone while preserving its semantic priors. For responsive control, it employs a contact-gated fast-slow architecture, with a slow position-control branch tracking nominal trajectories during non-contact phases and a fast admittance-control branch regulating physical interaction during contact phases. Detailed analyses on a force-perception task and real-world evaluations across four contact-rich manipulation tasks validate the effectiveness and robustness of TAO-Force.
Integrating visuomotor policies or Vision-Language-Action (VLA) models with force/torque (F/T) perception has demonstrated significant progress in imitation learning for robotic manipulation. However, existing force-aware VLA models frequently exhibit limited capability in precise force tracking and rapid successive ad...
Zhao-Hong Mai, Chao Wang, Chao Zeng et al.· 1 citation
Integrating visuomotor policies or Vision-Language-Action (VLA) models with force/torque (F/T) perception has demonstrated significant progress in imitation learning for robotic manipulation. However, existing force-aware VLA models frequently exhibit limited capability in precise force tracking and rapid successive ad...
Zhao-Hong Mai, Chao Wang, Chao Zeng et al.· IEEE Robotics and Automation...· 0 citations
Opt2VLA is presented, a force-aware VLA framework that introduces explicit force commands at the VLA-to-control interface for humanoid whole-body manipulation and shows that explicit force conditioning enables more accurate and consistent force regulation than motion-only control, while physically grounded torque super...
Fu-Kang Liu, Yipu Chen, Jaehwi Jang et al.· arXiv.org· 1 citation
ForceDelta-VLA is presented, a correction-distillation framework that constructs an explicit force-correction target using paired predictions from a frozen teacher's force-conditioned and learned force-agnostic modes, and reduces mean peak contact force over successful trials by approximately 26% on both platforms.
Ju Dong, Yuan-You Fu, Jian Chen et al.· 1 citation
Contact-rich manipulation, requiring robots to regulate not only motion but also how they yield to external forces, has emerged as the next frontier for Vision-Language-Action (VLA) models. However, existing VLAs output purely kinematic commands, degrading performance on real-world contact-rich tasks. In this paper, we...
Jongmin Kim, Junsu Ha, Che-Sang Park et al.· 1 citation
Vision-Language-Action (VLA) models have emerged as general-purpose robotic manipulation policies. However, in dexterous hand manipulation, contact forces are typically provided as separate states or force-specific representations, making it difficult to explicitly represent the spatial correspondence between force and...
Jung-Woo Lee, Soo-Chul Lim· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.