Visual world models enable robotic planning by predicting future observations, but dense latent-state propagation and sample-intensive trajectory optimization incur high inference latency and peak memory usage, limiting real-time deployment on resource-constrained platforms. Existing sparse world-model acceleration methods either rely on unguided token sparsification, which may discard planning-relevant information and restrict achievable sparsity, or introduce heavy auxiliary modules and cumbersome multi-stage training pipelines. In this work, we present Scope-WM, an efficient visual world model that scopes computation to prediction-relevant latent regions and promising action sequences. Scope-WM distills prediction relevance into a lightweight action-conditioned selector and applies full dynamics prediction only to a compact subset of selected tokens. It updates the remaining tokens using a compact summary of foreground states and their changes, allowing the background to perceive foreground dynamics without costly token-to-token interactions. During planning, Scope-WM preserves and reuses high-quality action sequences discovered during the initial MPC search, focusing subsequent search under reduced rollout budgets. The resulting pipeline requires only a one-off selector distillation followed by a single joint training stage for the sparse world model. On the challenging Push-T task, Scope-WM reduces peak GPU memory usage and planning time to $18.1\%$ and $14.3\%$ of those of dense DINO-WM, respectively, corresponding to a $6.97\times$ planning speedup, while maintaining competitive task performance. Further evaluations across five diverse visual planning tasks demonstrate the general applicability of Scope-WM. Code is available at https://github.com/ChunZheng2022/Scope-WM.
World Action Models (WAMs) have emerged as a promising alternative for embodied intelligence by jointly predicting future world states and robot actions. However, their heavy visual encoding and iterative generative inference incur substantial latency, limiting their applicability to high-frequency closed-loop control....
Zeng-Yuan Zuo, Yong-Chang Zhang, Guang-Yu Zhao et al.· 0 citations
The key insight is that future visual predictions support action generation and therefore need not preserve every visual detail required for high-fidelity video synthesis, and CF-Prune, a training-free framework for pruning future-frame tokens in pretrained WAMs, is proposed.
Baekseung Kim, Junhoo Lee, Sohyeon Hong et al.· 0 citations
Autoregressive robot video world models based on discrete visual tokens remain unreliable over long rollout horizons. Retaining the entire generated history does not necessarily improve prediction quality. We investigate a possible memory-role conflict in Full Context decoding: persistent scene information, recent visu...
Hao Wu, Tian-Yu Shao, Sheng-Ju Qian et al.· 1 citation
Copper-Policy is introduced, which learns a compact World representation with the policy rather than relying on a predefined target space and predicts future observation embeddings conditioned on task intention without reconstructing pixels through temporal joint-embedding prediction.
Ze Feng, Yi-Xu Feng, Ling-Yu Xiao et al.· arXiv.org· 1 citation
World Action Models (WAMs) combine visual dynamics modeling with action generation, but their high inference latency limits responsive robot control. Recent efforts accelerate inference by removing explicit future-video generation at test time, as in FastWAM, an approach that requires a specially tailored architectural...
Hua-Nan Liu, Ye Li, Kang-Ye Ji et al.· 0 citations
DeepJEPA is introduced, a weight-tied joint-embedding predictive world model that treats transition depth as an inner test-time scaling axis and learns when another recurrent update is worth computing for each candidate and rollout step.
Zi-Jian Jin, Yun-Bei Zhang, Yuan-Zhe Liu et al.· 1 citation
From feet to fingertips — we are teaching robots intelligent whole-body control, fine dexterity, and teamwork to complete a broad range of complex tasks.