Skip to content

Scope-WM: Scoped Computation for Efficient Visual World Models

Sep 2026 · arXiv.org · Vol abs/2609.33218 · 1 citation · 26 references
Computer Science

Abstract

Visual world models enable robotic planning by predicting future observations, but dense latent-state propagation and sample-intensive trajectory optimization incur high inference latency and peak memory usage, limiting real-time deployment on resource-constrained platforms. Existing sparse world-model acceleration methods either rely on unguided token sparsification, which may discard planning-relevant information and restrict achievable sparsity, or introduce heavy auxiliary modules and cumbersome multi-stage training pipelines. In this work, we present Scope-WM, an efficient visual world model that scopes computation to prediction-relevant latent regions and promising action sequences. Scope-WM distills prediction relevance into a lightweight action-conditioned selector and applies full dynamics prediction only to a compact subset of selected tokens. It updates the remaining tokens using a compact summary of foreground states and their changes, allowing the background to perceive foreground dynamics without costly token-to-token interactions. During planning, Scope-WM preserves and reuses high-quality action sequences discovered during the initial MPC search, focusing subsequent search under reduced rollout budgets. The resulting pipeline requires only a one-off selector distillation followed by a single joint training stage for the sparse world model. On the challenging Push-T task, Scope-WM reduces peak GPU memory usage and planning time to $18.1\%$ and $14.3\%$ of those of dense DINO-WM, respectively, corresponding to a $6.97\times$ planning speedup, while maintaining competitive task performance. Further evaluations across five diverse visual planning tasks demonstrate the general applicability of Scope-WM. Code is available at https://github.com/ChunZheng2022/Scope-WM.

View source

Similar papers

Preprint Oct 2026

MARS: Systematic Multi-Level Acceleration for World Action Models

World Action Models (WAMs) have emerged as a promising alternative for embodied intelligence by jointly predicting future world states and robot actions. However, their heavy visual encoding and iterative generative inference incur substantial latency, limiting their applicability to high-frequency closed-loop control....

Zeng-Yuan Zuo, Yong-Chang Zhang, Guang-Yu Zhao et al. · 0 citations
Preprint Oct 2026

Complementary Future Token Pruning for World Action Models

The key insight is that future visual predictions support action generation and therefore need not preserve every visual detail required for high-fidelity video synthesis, and CF-Prune, a training-free framework for pruning future-frame tokens in pretrained WAMs, is proposed.

Baekseung Kim, Junhoo Lee, Sohyeon Hong et al. · 0 citations
Preprint Oct 2026

Remembering What Matters for Long-Horizon Robotic World Models

Autoregressive robot video world models based on discrete visual tokens remain unreliable over long rollout horizons. Retaining the entire generated history does not necessarily improve prediction quality. We investigate a possible memory-role conflict in Full Context decoding: persistent scene information, recent visu...

Hao Wu, Tian-Yu Shao, Sheng-Ju Qian et al. · 1 citation

Copper-Policy: Focus on the Representation for Robust Robot Manipulation

Copper-Policy is introduced, which learns a compact World representation with the policy rather than relying on a predefined target space and predicts future observation embeddings conditioned on task intention without reconstructing pixels through temporal joint-embedding prediction.

Ze Feng, Yi-Xu Feng, Ling-Yu Xiao et al. · 1 citation
Preprint Oct 2026

RealtimeWAM: How Fast Can I Run My World Action Model?

World Action Models (WAMs) combine visual dynamics modeling with action generation, but their high inference latency limits responsive robot control. Recent efforts accelerate inference by removing explicit future-video generation at test time, as in FastWAM, an approach that requires a specially tailored architectural...

Hua-Nan Liu, Ye Li, Kang-Ye Ji et al. · 0 citations
#artificial intelligence Preprint Sep 2026

DeepJEPA: Scaling World Models from Within

DeepJEPA is introduced, a weight-tied joint-embedding predictive world model that treats transition depth as an inner test-time scaling axis and learns when another recurrent update is worth computing for each candidate and rollout step.

Zi-Jian Jin, Yun-Bei Zhang, Yuan-Zhe Liu et al. · 1 citation

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.