This work presents SkelWAM, a skeleton-guided world-action model that couples perception and control through one explicit geometric representation for single-source cross-embodiment manipulation, and introduces LIBERO-Cross10, a source-only cross-embodiment transfer benchmark covering ten tasks and ten target embodiments across four morphological groups.
Abstract
Reusing manipulation experience across robot embodiments is important for scaling robot learning and reducing repeated task-specific data collection. However, changes in embodiment alter visual appearance, action dimensionality and semantics, and the whole-body configurations that can realize the same tool pose. We present SkelWAM, a skeleton-guided world-action model that couples perception and control through one explicit geometric representation for single-source cross-embodiment manipulation. Arm centerline geometry, tool-center-point (TCP) pose, and parallel-jaw commands form a shared 25-D state. The same definition underlies canonical third-person and wrist observations and future whole-body action targets. Trained with predictive visual supervision, a video-action mixture of transformers predicts canonical skeleton action chunks, which embodiment-specific constrained decoders convert into joint or continuum-robot controls. This formulation requires no one-to-one joint correspondence and uses no target-task demonstrations or target policy updates. We introduce LIBERO-Cross10, a source-only cross-embodiment transfer benchmark covering ten tasks and ten target embodiments across four morphological groups. On this benchmark, Franka-trained SkelWAM achieves 43.3% success over 1,000 episodes, exceeding the best-performing evaluated baseline by 36.2 percentage points. We further deploy a JAKA mini2-trained policy on the Feagine A03 continuum robot for three tabletop manipulation tasks, illustrating the approach's potential for real-world cross-embodiment manipulation. Project page: http://www.liukepku.com/skelwam/index.html
Skel-WAM is introduced, a world action model that bridges differences between human and robot motion through a unified hand-skeleton motion interface, and demonstrates that a shared skeletal interface enables joint learning across human and robot data and expands robot task coverage through complementary human demonstr...
Ze-Tao Cai, Ya-Ping Li, Yi-Qun Wang et al.· arXiv.org· 1 citation
World action models (WAMs) combine robot action generation with future state prediction. Existing WAMs typically predict videos or learned visual latents, which represent interaction geometry only implicitly and may retain appearance information unrelated to control. We introduce SkeleWAM, a compact WAM that represents...
AnyWorld is proposed, a cross-embodiment world modeling framework that expands a single human interaction into diverse robot-native rollouts without paired human-robot demonstrations and enables independent recomposition of embodiment, viewpoint, and scene factors, allowing a single model to generate many robot-domain...
Cheng Chen, J. Bai, Jiacheng Wei et al.· 3 citations
This work introduces Universal Manipulation Representation (UMR), a unified action representation that enables zero-shot skill transfer from human demonstrations to heterogeneous robots and complements it with a Data-Efficient Strategy (DES) that diversifies object configurations through stage-aware point-cloud editing...
Song Liu, Lin-Ying Li, Yan-Shun Zhao et al.· arXiv.org· 0 citations
UCAG-P is introduced, a camera-centric unified action formulation that structurally aligns heterogeneous embodied datasets into a shared geometric action space, and allows a shared VLA policy to learn transferable manipulation geometry while retaining embodiment-specific controllability.
Xiaomi Embodied Intelligence Team, University of Macau Shaoqing Xu, Fang Li et al.· 0 citations
World action models (WAMs) aim to answer a coupled physical question: given a task instruction, what motion should the robot execute, and how will that motion change the surrounding world? Most existing WAMs build on pretrained video generators and represent world evolution through images or visual latents. Robotic int...
Rui-Xiang Wang, Yong-Yi Su, Wen-Lve Zhou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.