The diversity of robot embodiments and action spaces makes it challenging to build robot world models that generalize across different embodiments. We introduce the Latent Action-Conditioned Robot World Model (LAC-WM), which operates within a learned unified latent action space shared across diverse embodiments. This u...
Huang Huang, Sriram Yenamandra, Arjun Majumdar et al.· 0 citations
Results demonstrate that generative video rendering mitigates the visual sim-to-real gap for zero-shot policy transfer, and shows that policy performance improves with more generated videos per simulation trajectory, increasing opening-task success by 65 percentage points.
Huang Huang, Wen-Si Ai, Zi-Yu Chen et al.· 0 citations
Human videos offer a scalable source of demonstrations for dexterous robot manipulation. However, existing human-to-simulation-to-robot (Human2Sim2Robot) pipelines rely on predefined procedures that struggle to accommodate diverse object properties and interactions, particularly those involving articulated and deformab...
You-Hui Wang, Yun-Zhu Li, Fei-Fei Li et al.· 1 citation
DemoMimic (Dexterous Motion Mimic), a policy that manipulates objects by focusing on their geometry local to the contact points to improve sim-to-real consistency, yielding a single real-world policy that transfers across objects of varying shape, scale, mass, and friction wherever local contact structure is preserved.
TrAct is proposed, a world-model-based robot decision-making framework that uses visual tracks as an intermediate interface between control and prediction, enabling more accurate world modeling and stronger robot generalization.
Zhi-Hang Cao, Howard Ji, Kevin Zhang et al.· 3 citations
This work introduces ABC, a fully open-source stack for manipulation with behavior cloning, and offers a co-training recipe that produces correlated simulation and real-world evaluation, offering a reliable proxy for ablating model-design and training decisions before costly real-world evaluation.
Arthur Allshire, Himanshu Gaurav Singh, Ritvik Singh et al.· arXiv.org· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
