Enabling vision-language models (VLMs) to control humanoid robots requires both reliable whole-body interfaces and knowledge of how to use the body that carries over across tasks. We present HITCH (Harness Interfaces To Command Humanoids), a harness in which perception returns the 3D position of any point the VLM selec...
Qing-Zhou Lu, Chen-Xi Liu, Xin-Ming Wang et al.· 0 citations
Egocentric videos offer an abundant source of hand-scene interactions for embodied learning, which requires recovering hands, camera, and scene consistently in a shared 3D world. Existing methods focus on either camera-frame hands or world-space hand trajectories, without jointly recovering the scene pointmaps or inter...
Ming-Zhi Pei, Zhang-Chen Ye, Ruo-Qu Chen et al.· 0 citations
Physical contact often determines how a humanoid should respond during loco-manipulation, yet vision and proprioception alone are often insufficient to characterize physical interaction, especially when the contact region is occluded. Unlike sparse force or torque measurements at predefined regions, distributed tactile...
Zi-Hao Wang, Shu-Tong Liu, Si-Qi Zheng et al.· 0 citations
This is the first real-world humanoid racket-sport system to demonstrate multi-skill human--robot rallies including highly dynamic jump returns, and is the first real-world humanoid racket-sport system to demonstrate multi-skill human--robot rallies including highly dynamic jump returns.
ROCOACH is a world-model-guided coaching framework that uses imagined failures to guide demonstration requests and expert updates, and results show that world models can serve as active coaches, turning imagined failures into targeted supervision for modular policy improvement.
Jia-Jun Liu, Yi-Fan Chen, Yi-Chao Liu et al.· arXiv.org· 1 citation
Weave is presented, a unified framework for learning whole-body dexterous humanoid-object interaction from captured human demonstrations that converts captured human-object interactions into executable robot-object references through contact-aware retargeting and approach-motion completion.
Liu Cao, Xing-Ze Wu, Jing-Zhi Cui et al.· 2 citations
It is shown that routine clinic images can be transformed into operational digital twins for task-based evaluation of embodied AI, establishing operational validity as a key principle for clinical digital twins and providing an intermediate layer between offline development and physical deployment of embodied AI in hea...
Xinyuan Wu, Jingrao Zhang, Meng-Di Xu et al.· 0 citations
Experiments in both simulation and real-world settings demonstrate that R2S-Eval produces reliable and stable policy conclusions, achieves agreement with human preferences, substantially reduces repeated hardware-operation effort, and reveals behavior-quality differences that are not captured by binary success labels.
Yi-Di Wang, Fei-Xiang Ruan, Ruo-Qu Chen et al.· 2 citations
It is argued that clinical autonomy is developing in stages from clinician‐supervised imaging and decision support to bounded robotic subtasks and workflow‐level coordination, instead of through unsupervised replacement of healthcare professionals.