JADE is introduced, a Joint Action DEnoiser that enables the VLM and action expert to jointly refine actions and enables JADE to generate actions with fewer sampling steps, helping offset the additional cost of VLM participation.
Xi-Cheng Gong, Wen-Xuan Song, Cheng-Ze Liu et al.· 0 citations
MemSteer is introduced, which turns unlabeled user histories into question-answer (QA) supervision with supporting evidence for memory-design optimization and develops MemSteer-Opt, which combines QA-based design evaluation with evidence-guided failure diagnosis to revise memory store, retrieval, and context constructi...
Jie Huang, Cui-Ling Lan, Qi-Ze Yu et al.· 0 citations
World-Action Models inherit world knowledge from video-generative priors, and channel it into executable control signals through embodied experience. Existing systems, however, are monolithic: the generative backbone, visual representation, architecture, information flow, inference procedure, and training data are tigh...
Yu-Ran Wang, Siqiao Huang, Ming-Lei Li et al.· 38 citations· ⚡4
Precise grounding matters. It specifies which object is the target and where that object is, even in clutter and for tiny objects, and it has to be fast enough for closed-loop control. Yet vision-language-action (VLA) and world-action models (WAMs) take perception from general-purpose vision-language and video-generati...
UniWAM is introduced, a unified architecture that integrates a physical reasoner, a world generator, and an action predictor to jointly learn semantic understanding of the physical world, visual generation, and action prediction and uncovers a log-linear scaling law of unified human-robot co-training.
Wen-Xuan Song, Jia-Yi Chen, Jing-Bo Wang et al.· 6 citations· ⚡2
Precise grounding matters. It specifies which object is the target and where that object is, even in clutter and for tiny objects, and it has to be fast enough for closed-loop control. Yet vision-language-action (VLA) and world-action models (WAMs) take perception from general-purpose vision-language and video-generati...
Qi-Ze Yu, Lian-Rui Fan, Bo-Yu Chen et al.· 0 citations
AffordanceWAM is introduced, an affordance-aware generative World Action Model that represents object-centric spatiotemporal affordance through Scalar Affordance and Affordance Heatmap, within the generated future World, and supports affordance as an effective interface for both vision-language-action learning and huma...
X-AuT, a progressive framework that selects layer combinations through short behavioral probes and restores the pruned model through representation alignment, cross-scale distillation, scheduled student-policy supervision, and LoRA finetuning, is introduced.
Hao-Jun Zhang, Yi Zou, Min Chen et al.· 0 citations
LD4WAM is presented, which pairs a Latent Dynamics Model trained with semantic reconstruction and real motion alignment with a World Dynamics Action Model built as a mixture-of-transformers (MoT), which preserves full future-video generation and uses learnable queries to distill these latent dynamics from generated fut...
Zhen Shen, Jia-Qi Liang, Jasper Lu et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.