Skip to content
Review Open access

Vision-and-Language Navigation: A Component-Centric Survey of Interactions, Coupling, and Deployment

Aug 2026 · Applied Sciences · 0 citations · 37 references

TL;DR

This survey revisits VLN from a component-internal perspective, viewing it as a navigation system composed of internal components such as instructions, environment representations, and embodied agents, and organizing existing work around the functions and interactions of these components.

Abstract

Vision-and-Language Navigation (VLN) is a representative task in embodied artificial intelligence, requiring agents to perceive, understand, and make navigation decisions in partially observable environments according to natural language instructions. As research has expanded from early discrete simulation benchmarks to continuous control, interactive clarification, open-vocabulary perception, and real-world robotic deployment, VLN has evolved from a path-following multimodal task into an important research area connecting language understanding, environment modeling, spatial reasoning, and embodied execution. Existing surveys mainly organize the literature by timeline, model paradigm, or benchmark, while paying less attention to the internal components of VLN systems and their functional coupling. In this survey, we revisit VLN from a component-internal perspective, viewing it as a navigation system composed of internal components such as instructions, environment representations, and embodied agents, and organizing existing work around the functions and interactions of these components. Specifically, we summarize task definitions, datasets, and evaluation settings, and review representative methods and technical progress in instruction understanding and action generation, instruction–environment alignment, and robot–environment interaction understanding. We further discuss key trends as VLN moves from closed benchmarks toward open-world and real-world deployment, including reasoning-enhanced planning, open-vocabulary and online semantic mapping, long-horizon memory and structured spatial representation, and sim-to-real transfer across platforms. We hope this survey provides a clearer component-level analytical framework for understanding the evolution of internal VLN capabilities and for informing future method design and embodied-system deployment.

Read PDF

Similar papers

#artificial intelligence Preprint Aug 2026

LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation

LightNav-0 is presented, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads, and establishes compact VLMs as a unified and transferable backbone for generalist embodied navigation.

Shao-An Wang, Ao-Cheng Luo, Fei Huang et al. · 5 citations
Conference Aug 2026

RO-VLMap: Real-Time Occupancy-Aware Visual Language Mapping for Robust Robot Navigation

Vision-and-Language Navigation (VLN) tasks require an agent to interpret natural language instructions and visual observations to navigate complex environments. Existing methods mostly construct topological or semantic maps and rely on the Large Language Model (LLM) for navigation decision-making, however, they still s...

Yuan Liu, Chuang Hu, Nan Ding · 0 citations
Jul 2026

Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigation

Results indicate that minimally sufficient world representations provide an effective foundation for robust VLN, and propose BrainNav, a navigation framework grounded in the Principle of Minimal Sufficiency.

Yi-Hao Wu, Chen-Yi Xu, Li-Qi Yan et al. · 0 citations
Review Sep 2026

Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models

For robots to operate reliably in real-world environments, they need to perceive their surroundings, act, and reason about the consequences of those actions. Rapid progress in the domains of representation learning, VLA models, and world models has significantly enhanced the capabilities of robot learning systems, enab...

Shaunak A. Mehta, Ananya Hazarika, Haochen Zhang et al. · 0 citations
Jul 2026

WCM: World-Cognition Model for Generalizable Human-Robot Interaction

The World-Cognition Model is presented, a human-centered embodied agent built on the SLAK architecture (Sensing, Logic, Action, and Knowledge) and an asynchronous runtime and introduces a human-in-the-loop teaching mode that enables users to interactively teach the robot difficult or long-horizon tasks.

Yuzhen Chen, K. Zhou · 0 citations
Jul 2026

Memory for Attention: Language-Conditioned Re-Perception with a Vision-Language-Motion Map

A persistent map's memory yields the best schedule (held-out), matching an oracle, while the memoryless VLM prior is poor, showing a persistent map's memory earns its keep not by telling the robot how to walk around a room, but by telling it what to pay attention to.

Dibyendu Ghosh · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.