Aug 2026· Applied Sciences· 0 citations· 37 references
TL;DR
This survey revisits VLN from a component-internal perspective, viewing it as a navigation system composed of internal components such as instructions, environment representations, and embodied agents, and organizing existing work around the functions and interactions of these components.
Abstract
Vision-and-Language Navigation (VLN) is a representative task in embodied artificial intelligence, requiring agents to perceive, understand, and make navigation decisions in partially observable environments according to natural language instructions. As research has expanded from early discrete simulation benchmarks to continuous control, interactive clarification, open-vocabulary perception, and real-world robotic deployment, VLN has evolved from a path-following multimodal task into an important research area connecting language understanding, environment modeling, spatial reasoning, and embodied execution. Existing surveys mainly organize the literature by timeline, model paradigm, or benchmark, while paying less attention to the internal components of VLN systems and their functional coupling. In this survey, we revisit VLN from a component-internal perspective, viewing it as a navigation system composed of internal components such as instructions, environment representations, and embodied agents, and organizing existing work around the functions and interactions of these components. Specifically, we summarize task definitions, datasets, and evaluation settings, and review representative methods and technical progress in instruction understanding and action generation, instruction–environment alignment, and robot–environment interaction understanding. We further discuss key trends as VLN moves from closed benchmarks toward open-world and real-world deployment, including reasoning-enhanced planning, open-vocabulary and online semantic mapping, long-horizon memory and structured spatial representation, and sim-to-real transfer across platforms. We hope this survey provides a clearer component-level analytical framework for understanding the evolution of internal VLN capabilities and for informing future method design and embodied-system deployment.
LightNav-0 is presented, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads, and establishes compact VLMs as a unified and transferable backbone for generalist embodied navigation.
Shao-An Wang, Ao-Cheng Luo, Fei Huang et al.· 5 citations
Vision-and-Language Navigation (VLN) tasks require an agent to interpret natural language instructions and visual observations to navigate complex environments. Existing methods mostly construct topological or semantic maps and rely on the Large Language Model (LLM) for navigation decision-making, however, they still s...
Yuan Liu, Chuang Hu, Nan Ding· International Conferences on...· 0 citations
Results indicate that minimally sufficient world representations provide an effective foundation for robust VLN, and propose BrainNav, a navigation framework grounded in the Principle of Minimal Sufficiency.
Yi-Hao Wu, Chen-Yi Xu, Li-Qi Yan et al.· arXiv.org· 0 citations
For robots to operate reliably in real-world environments, they need to perceive their surroundings, act, and reason about the consequences of those actions. Rapid progress in the domains of representation learning, VLA models, and world models has significantly enhanced the capabilities of robot learning systems, enab...
Shaunak A. Mehta, Ananya Hazarika, Haochen Zhang et al.· Trans. Mach. Learn. Res.· 0 citations
The World-Cognition Model is presented, a human-centered embodied agent built on the SLAK architecture (Sensing, Logic, Action, and Knowledge) and an asynchronous runtime and introduces a human-in-the-loop teaching mode that enables users to interactively teach the robot difficult or long-horizon tasks.
A persistent map's memory yields the best schedule (held-out), matching an oracle, while the memoryless VLM prior is poor, showing a persistent map's memory earns its keep not by telling the robot how to walk around a room, but by telling it what to pay attention to.
Dibyendu Ghosh· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.