Skip to content

NaViRrator: Robot Navigation from Human-Readable Maps through a Learned Visual Route

Sep 2026 · arXiv.org · Vol abs/2609.21316 · 1 citation
Computer Science

TL;DR

NaViRRator, a framework that translates user-specified start and goal locations on such maps into navigation instructions for a pretrained vision-and-language navigation (VLN) policy, is presented, supporting route-grounded language as a modular interface between human-readable maps and pretrained navigation policies.

Abstract

Human-readable maps provide an intuitive interface for specifying robot destinations, but connecting their schematic geometry to egocentric observations remains challenging. We present NaViRRator, a framework that translates user-specified start and goal locations on such maps into navigation instructions for a pretrained vision-and-language navigation (VLN) policy. Its core method, RouteScribe, separates route inference from verbalization by first generating an explicit route scaffold in map-image coordinates, which a pretrained vision-language model (VLM) converts into a navigation instruction. We construct the scaffold with start--goal line conditional flow matching (SGL-CFM), which deforms a straight start--goal waypoint sequence into a map-conditioned route. During execution, the VLN policy receives only the instruction and egocentric observations, while the map and scaffold remain upstream, allowing executor replacement without retraining the map-to-language modules. Real-world experiments show higher success rates and success weighted by path length (SPL) than direct map-to-instruction generation, A*-based scaffolding, and Gaussian-source conditional flow matching. Qualitative results further show clearer salient turns and better preservation of the intended maneuver sequence, supporting route-grounded language as a modular interface between human-readable maps and pretrained navigation policies.

View source

Similar papers

Conference Open access Jun 2026

Multi-Task Visual Perception Network with LLM Conditioning for Autonomous Navigation

This work proposes a user-friendly, interactive framework that eliminates the reliance on globally consistent maps and integrates visual perception with Large Language Models (LLM) to interpret user commands via text or voice.

Praveen Kumar, K. Guruprasad, Tushar Sandhan · 0 citations
Preprint Sep 2026

Navi-Agent: Unlocalized Monocular Navigation Agent

Navi-Agent is presented, a zero-shot VLN-CE agent that constructs a coordinate-free spatial state from visual observations and executed motion histories and organizes this state as a navigation topology, which enables observation-based approximate self-localization, task progress verification, and visual revisitation-b...

Wen-Yuan Xie, Meng-Yang Hong, Yong-Zhong Wang et al. · 0 citations
Conference Open access Sep 2026

FILD-Nav:Vision-and-Language Navigation with Instruction Landmark Features in Continuous Environments

FILD-Nav extracts task-relevant landmarks from instructions and incorporates landmark semantics into both waypoint prediction and topological planning, which improves waypoint relevance and enables more effective long-horizon navigation.

Chuan-Ye Hu, Lu-Lu Liu, Huai-Wei Si et al. · 0 citations
#artificial intelligence Preprint Aug 2026

LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation

LightNav-0 is presented, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads, and establishes compact VLMs as a unified and transferable backbone for generalist embodied navigation.

Shao-An Wang, Ao-Cheng Luo, Fei Huang et al. · 6 citations · ⚡1
Preprint Oct 2026

UniTrackPLA: Unified Panorama-Language-Action Model for Instruction-Guided Navigation and Dynamic Person Tracking

General-purpose embodied robots should support both navigation toward language-specified destinations and dynamic person tracking under arbitrary initial target azimuths. However, existing methods typically rely on forward-facing observations and address these tasks with separate policies, limiting omnidirectional perc...

Peng Qi, Hao-Ran Lin, Si-Zhuang Chen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.