Evaluating Early Multimodal Fusion in Discrete Latent World Models for Robot Navigation

M. Mondal Mohammad Nazeri Ruben Hammele S. Huber Alexandyr Card Anuj Pokhrel Daeun Song S. Pirk Xue-Su Xiao

· 0 citations · 32 references

View source

Similar papers

Preprint Aug 2026

Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution

Hydra, a discrete World Action Model that tackles this by establishing a unified latent manifold over visual states, physical poses, and control actions, outperforms state-of-the-art navigation world models in goal-directed planning, while matching or exceeding the closed-loop execution capabilities of leading reactive...

Mohammad Nazeri, Alexandyr Card, S. Huber et al. · 2 citations

Preprint Oct 2026

MARS: Systematic Multi-Level Acceleration for World Action Models

World Action Models (WAMs) have emerged as a promising alternative for embodied intelligence by jointly predicting future world states and robot actions. However, their heavy visual encoding and iterative generative inference incur substantial latency, limiting their applicability to high-frequency closed-loop control....

Zeng-Yuan Zuo, Yong-Chang Zhang, Guang-Yu Zhao et al. · 0 citations

Preprint Oct 2026

Perceive, Predict, and Plan: a Unified World Action Model for Egocentric Dexterous Manipulation

We introduce P$^{3}$-WAM, a unified world action model for egocentric dexterous manipulation that learns 3D perception, action-conditioned prediction, and goal-directed planning through three complementary modes: Perceive, which reconstructs articulated hand motion and camera trajectories from video; Predict, which gen...

Zi-Rui Wu, Chen Guo, Tian-Jian Jiang et al. · 0 citations

Preprint Sep 2026

The Planning Limits of Latent World Models

This work studies action-conditioned predictors built on five frozen self-supervised visual backbones, finding that a world model guides action selection reliably only when the goal lies within, or slightly beyond, the trajectory it imagines during planning.

A. Alrasheed, Basim Azam, Naveed Akhtar · 0 citations

Preprint Sep 2026

Continuous Actions from Discrete Minds: Latent-Aligned Planning for End-to-End Autonomous Driving

LaPla is introduced, a unified Vision-Language-Action framework featuring latent-aligned planning to seamlessly ground semantic understanding in precise motion execution to bridge the modality gap between high-dimensional semantics and the raw action space.

Ruo-Yu Yao, Yu-Sen Xie, Qing-Zhao Liu et al. · 1 citation

Preprint Sep 2026

MM-Future: Multi-Mode Joint World-Action Modeling for Autonomous Driving

MM-Future, a world-action model that generates multiple paired scene-action hypotheses and models bidirectional interaction within each pair, shows consistent improvements over both single-mode and action-only variants, validating the benefit of multi-mode joint world-action modeling.

Shuai Liu, Hechangle Gong, Hao Jiang et al. · 1 citation