Multimodal models and agents have emerged to enable AI systems to learn from and interact with the real world more like humans by integrating information across multiple modalities. However, enabling multimodal agents to continually acquire useful information from complex, heterogeneous multimodal data remains a signif...
Ming-Hao Guo, Qing-Yue Jiao, Xiu-Jin Liu et al.· 0 citations
This work introduces OpenViTac, a visuo-tactile manipulation benchmark for evaluating robot policies across simulation and the real world, and introduces OpenVTLA, a tactile augmentation framework that combines the best-performing representation and integration strategy.
Yi-Fan Wu, Qin Li, Nan Min et al.· 2 citations· ⚡1
Egocentric human data provides a scalable source of experience for robot learning, but varies substantially in human-robot alignment, behavioral coverage, and available supervision. Existing work shows favorable scaling with increasing human data, but it remains unclear which data properties drive downstream robot gain...
Zhihao Sun, Liu Liu, Xin-Jiang Wang et al.· arXiv.org· 3 citations
General-purpose agents can plan, use tools, and revise their behavior from feedback, but it remains unclear whether these capabilities transfer from digital environments to embodied manipulation. To investigate this question, we introduce LIBERO-Agent, an agent-native benchmark for evaluating these agents in robot mani...
HandEdit serves as a critical resource at the intersection of image editing and robotics: it advances embodiment-aware editing models while enabling scalable dexterous robotic learning from abundant human video data, paving the way for more generalizable Embodied AI.
Zhen-Jie Yang, Xingyu Jiao, Guopeng Zhong et al.· 5 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.