Skip to content

LiveVLN: Reducing Stop-and-Go Loops in Vision-Language Navigation

Nov 2026 · IEEE Robotics and Automation Letters · Vol 11, pp. 13343-13350 · 0 citations · 31 references

Abstract

Recent navigation systems achieve strong benchmark results, yet real-world deployment often remains visibly stop-and-go. This bottleneck arises because the sense-inference-execution loop is still blocking: after each new observation, the controller must wait for sensing, transmission, and inference before motion can continue. Reducing action-generation cost alone therefore does not remove redundant waiting. To address this issue, we present LiveVLN, a training-free framework for more continuous embodied navigation by augmenting pretrained VLM navigators with multi-step action continuation. Instead of pausing for each full sense-and-inference round, LiveVLN overlaps execution with the processing of newly arrived observations, allowing refreshed future actions to be handed off before the current executable prefix is exhausted. This design keeps actions continuously available during motion, reducing idle waiting and enabling smoother online execution. The framework operates at runtime and can be integrated with compatible pretrained VLM navigators. Across R2R and RxR, LiveVLN preserves benchmark performance while reducing waiting time and improving action availability. In real-world deployments, it cuts average episode waiting time by up to 77.7% and shortens wall-clock episode time by 12.6% on StreamVLN and 19.6% on NaVIDA, yielding more coherent execution.

View source

Similar papers

#artificial intelligence Preprint Oct 2026

X-Fly: Learning to Reach and Stop in Full-Chunk Aerial Vision-Language Navigation

Aerial vision-language navigation (VLN) agents built on large vision-language models are expensive to query. Executing a complete predicted action chunk before replanning amortizes this cost, reducing model inference from 195 to 42 ms per executed waypoint for our policy. It also moves the states at which the policy is...

Rui-Bin Ju, Rui Cai, Min Xu et al. · 0 citations
Preprint Oct 2026

RealtimeWAM: How Fast Can I Run My World Action Model?

World Action Models (WAMs) combine visual dynamics modeling with action generation, but their high inference latency limits responsive robot control. Recent efforts accelerate inference by removing explicit future-video generation at test time, as in FastWAM, an approach that requires a specially tailored architectural...

Hua-Nan Liu, Ye Li, Kang-Ye Ji et al. · 0 citations
Preprint Sep 2026

VerNav: Verifier-First Low-Latency Vision-and-Language Navigation

VerNav, a verifier-first framework for low-latency LLM-based VLN, achieves competitive navigation performance among representative LLM-based VLN agents while reducing average decision-stage LLM latency per step by more than $10\times$ compared with autoregressive methods.

Zhi-Xin Wang, Chengzheyi Yao, Le-Yuan Liu et al. · 1 citation
Preprint Sep 2026

Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs

Vision-Language-Action (VLA) models have shown strong generalization in robotic manipulation by combining semantic knowledge from pretrained vision-language models with expressive action-generation policies. Diffusion-based action generators are particularly effective for modeling temporally coherent action chunks, but...

Yi-Heng Ji, Xing-Ru Zhou, Luis Sentis et al. · 0 citations
Preprint Oct 2026

EvoMem-VLA: State-Evolution Memory for Long-Horizon Robot Manipulation

Most vision-language-action (VLA) models rely on current observations and lose task-relevant evidence once it leaves view, limiting performance on long-horizon, memory-dependent tasks. Existing efforts incorporate compressed historical features or sparse visual keyframes. However, isolated snapshots can leave the polic...

Yu-Heng Na, Zhi-De Zhong, Jun-Jie He et al. · 0 citations
Preprint Sep 2026

ProAct-VLM: Pre-Failure Vision-Language Task Replanning with Continuous Perception Feedback

Long-horizon robotic tasks are vulnerable to unexpected environmental changes that can render planned actions ineffective or unsafe. To address this, robots must detect such changes as they occur, interpret their impact, and adjust their actions accordingly. Traditional rule-based decision-making pipelines are brittle...

Ahmed N. Ahmed, Omar Moured, Mughni Irfan Mohammed Abdul et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.