Skip to content
Preprint

EchoWM: Open and Enterable Omnimodal World Models

Aug 2026 · 10 citations · ⚡ 2 influential · 52 references
Computer Science

TL;DR

EchoWM is an omnimodal world model for enterable generative media that responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech, and maintains synchronized environmental sound and speech over long-horizon generation.

Abstract

We present EchoWM, an omnimodal world model for enterable generative media that responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech. We organize interaction around camera intent: in first-person scenes, it specifies observer motion, while in third-person scenes, camera--character dynamics are learned from data without view-specific controllers. Discrete commands and continuous poses are mapped to a shared metric-scale relative 6-DoF trajectory, with dataset-level calibration preserving motion magnitude across heterogeneous data. To jointly learn audio-visual generation and trajectory control, we construct a complementary data engine and adopt progressive training followed by autoregressive post-training for long-horizon generation. Extensive evaluations show that \model achieves strong trajectory following and high visual quality on public world-model benchmarks, supporting both first- and third-person interaction across varied subjects, and maintaining synchronized environmental sound and speech over long-horizon generation.

View source

Similar papers

Preprint Sep 2026

HelixWorld: A Real-time Interactive Audio-Visual World Model

World simulation is inherently multisensory, demanding synchronized visual and acoustic dynamics in real time. Yet prevailing interactive world models remain strictly silent, focusing exclusively on visual rendering and control while overlooking the acoustic dimension. We present HelixWorld, a real-time interactive aud...

Lei Ke, Jia-Hao Pan, Ze-Yue Tian et al. · 0 citations
Preprint Aug 2026

Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds

Results indicate that memory, geometric control, and rollout-aware training provide a practical foundation for generating coherent stories and continuously evolving interactive worlds.

Nan Duan, Hao-Yang Huang, Wei-Yang Jin et al. · 4 citations · ⚡1
Preprint Oct 2026

AutodidactWAM: Cross-Modal Self-Distillation from Generated Video to Robot Actions

World-action models (WAMs) such as Cosmos 3 jointly generate future video and robot actions from an observation and instruction. Adapting one such model with a lightweight LoRA fine-tune to a previously unseen robot, a Unitree G1 humanoid with five-fingered BrainCo hands, exposes a video-action asymmetry: the video ren...

S. Kurchev, Ia M. Kolomiets, Miguel Altamirano Cabrera et al. · 0 citations
Preprint Oct 2026

SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation

Language-guided panoramic video generation benefits various downstream applications, such as interactive 3D scene exploration, virtual reality experiences, and embodied agent training. Existing panoramic generators follow predefined trajectories, and interactive world models act through low-level actions in perspective...

Yun-Heng Liu, Zi-Qi Cai, Si-Qi Yang et al. · 0 citations
Preprint Oct 2026

CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight

CtrlWAM is presented, which executes perturbed actions in a simulator and pairs them with their noised visual consequences for joint WAM learning, and further extends the action interface from ego-only control to a variable number of agent streams, allowing a unified model to represent predicted or commanded futures fo...

Chensheng Peng, Wen-Hao Ding, Ran Tian et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.