Skip to content

RiverVLN: Phase-Grounded Temporal Vision-Language Navigation for Unmanned Surface Vehicles

Sep 2026 · arXiv.org · Vol abs/2609.23423 · 0 citations · 30 references
Computer Science

TL;DR

This work introduces RiverVLN, to its knowledge the first benchmark designed for long-horizon USV VLN under continuous riverine motion, and PGT-NAV, a phase-grounded temporal navigation framework for USVs.

Abstract

Vision-language navigation (VLN) has largely been developed for indoor and terrestrial robots, where language can often be treated as a static goal and motion is approximated by discrete or near-instantaneous actions. These assumptions break down for unmanned surface vehicles (USVs): river navigation requires continuous motion under inertia and limited maneuverability, while long-horizon instructions must be executed through sparse and visually ambiguous maritime landmarks. We introduce RiverVLN, to our knowledge the first benchmark designed for long-horizon USV VLN under continuous riverine motion, and PGT-NAV, a phase-grounded temporal navigation framework for USVs. Rather than directly mapping an entire instruction to motion, PGT-NAV converts it into an ordered sequence of visually verifiable semantic phases and maintains the active phase online through grounded visual and motion evidence. This explicit semantic progress state is fused with visual-motion history and phase-specific grounding to predict six local SE(2) pose increments. The resulting trajectory is executed in a predict-execute-re-observe loop, where the vessel executes toward W3, updates phase and grounding, and replans through a map-based safety layer. Experiments show that PGT-NAV substantially reduces recursive position and heading drift relative to GNM-style and ViNT-style baselines and achieves an average success rate of 0.79 in Unity-ROS closed-loop navigation. Unseen bridge-opening trials and real-world USV experiments further demonstrate that the phase-grounded representation transfers from controlled evaluation to physical USV deployment.

View source

Similar papers

Sep 2026

PIVOT: Physically Informed Vision-Language Off-Road Traversability for Field Robot Navigation

PIVOT is presented, demonstrating that physically grounded VLM-based terrain assessment can substantially extend autonomous navigation beyond the limitations of geometry alone, while preserving efficient geometric planning as the nominal mode.

Ao-Ran Jiao, Wen-Da Zhao, Hshmat Sahak et al. · 0 citations
Sep 2026

VLM-MPPI: Grounding Natural Language in Behaviorally Diverse Trajectories for Aerial Navigation

A hierarchical UAV navigation framework that aligns natural-language intent with dynamically feasible flight behaviors in cluttered indoor environments is presented, and a parallelized ensemble of six behavior-conditioned Model Predictive Path Integral (MPPI) planners are employed.

Hanbing Zhang, Fang-Guo Zhao, Ze-Rui Li et al. · 0 citations
Preprint Aug 2026

From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigation

This work presents an instruction-grounded semantic enhancement module that injects object-level semantics and relative spatial cues into the current observation state, and develops a relevance-aware dynamic temporal aggregation strategy that reweights the full history buffer while converting a few high-relevance frame...

Ze-Yuan Ma, Jiaxin Chen, Di Huang · 1 citation
Preprint Sep 2026

SatNav: A Scalable Benchmark for Long-Horizon UAV Vision-Language Navigation from Satellite Imagery

SatNav, a scalable, long-horizon UAV VLN benchmark built from high-resolution satellite imagery, is introduced and satellite-to-UAV transfer experiments show that satellite-trained navigation models can operate on real-flight UAV observations, showing the practical relevance of SatNav.

Jia-Jun Jiang, Chun-Liang Hua, Zi-Chun Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Air-Ground Collaborative Vision-and-Language Navigation via Shared Bird's-Eye Maps

AGC-VLN (Air-Ground Collaborative VLN), the first training-free baseline for air-ground collaborative VLN, establishes that training-free methods decompose navigation into VLM-based semantic reasoning and deterministic geometric execution, exposing a collaboration interface.

Shu-Ning Zhang, Liang Li, Yun-Heng Wang et al. · 3 citations · ⚡2
Preprint Sep 2026

Navi-Agent: Unlocalized Monocular Navigation Agent

Navi-Agent is presented, a zero-shot VLN-CE agent that constructs a coordinate-free spatial state from visual observations and executed motion histories and organizes this state as a navigation topology, which enables observation-based approximate self-localization, task progress verification, and visual revisitation-b...

Wen-Yuan Xie, Meng-Yang Hong, Yong-Zhong Wang et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.