Enabling vision-language models (VLMs) to control humanoid robots requires both reliable whole-body interfaces and knowledge of how to use the body that carries over across tasks. We present HITCH (Harness Interfaces To Command Humanoids), a harness in which perception returns the 3D position of any point the VLM selec...
Qing-Zhou Lu, Chen-Xi Liu, Xin-Ming Wang et al.· 0 citations
Egocentric videos offer an abundant source of hand-scene interactions for embodied learning, which requires recovering hands, camera, and scene consistently in a shared 3D world. Existing methods focus on either camera-frame hands or world-space hand trajectories, without jointly recovering the scene pointmaps or inter...
Ming-Zhi Pei, Zhang-Chen Ye, Ruo-Qu Chen et al.· 0 citations
Human videos are an abundant source of dexterous manipulation behaviors, but they lack tactile information that is crucial for contact-rich interaction. This raises a fundamental question: can robots learn deployable visual-tactile dexterous manipulation policies from human video demonstrations without robot-side data...
Ruo-Qu Chen, Fei-Xiang Ruan, Liu Cao et al.· 5 citations
Physical contact often determines how a humanoid should respond during loco-manipulation, yet vision and proprioception alone are often insufficient to characterize physical interaction, especially when the contact region is occluded. Unlike sparse force or torque measurements at predefined regions, distributed tactile...
Zi-Hao Wang, Shu-Tong Liu, Si-Qi Zheng et al.· 0 citations
CATok is proposed, a causal action tokenizer that reframes tokenization as a causally structured generative process, establishing a high-performance, scalable foundation for purely autoregressive VLA systems.
Chen-Yu Zhang, Yu-Hang Cao, D. Du et al.· arXiv.org· 0 citations
Weave is presented, a unified framework for learning whole-body dexterous humanoid-object interaction from captured human demonstrations that converts captured human-object interactions into executable robot-object references through contact-aware retargeting and approach-motion completion.
Liu Cao, Xing-Ze Wu, Jing-Zhi Cui et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.