Skip to content

Enhancing Trajectory Planning with Vision-Language-Action Models and Perception Guidance

Oct 2026 · Optical Memory and Neural Networks · Vol 35, pp. S139 - S149 · 0 citations · 36 references

TL;DR

PG-VLA (Perception-Guided VLA), a planner that keeps task-specific perception and motion prediction outside the VLM while using their outputs as structured planning context, achieves strong safety-oriented performance without reinforcement fine-tuning, explicit reasoning supervision, or dedicated bird’s-eye-view (BEV) token projection modules.

View source

Similar papers

Preprint Oct 2026

HAVANA: A Hierarchical Video-Action Model for Vision-Language Navigation

Vision-Language Navigation (VLN) requires long-horizon instruction-consistent planning and short-horizon local planning in current geometry. Video-action models (VAMs) offer a promising way to learn predictive representations for navigation. However, existing VAMs jointly predict visual futures and local trajectories i...

Dongzhihan Wang, Yi Du, Chen Wang et al. · 0 citations
Preprint Oct 2026

Forward Dynamics Models

Vision-language-action (VLA) models and world action models (WAMs) have advanced robotic policy learning by building on pretrained vision-language models (VLMs) and video generative models (VGMs), respectively. Yet VLAs learn without explicit supervision from future world states, while WAMs that condition actions on pr...

Zi-Pei Ma, Jun-Zhe Jiang, Jia-Hui Zhang et al. · 0 citations
Sep 2026

H-VLA: Hierarchical Vision-Language-Action Model with Key-Action Reasoning and Motion Planning in a Unified Action Space

H-VLA is proposed, a hierarchical VLA framework that decouples high-level key-action reasoning from low-level motion generation and adopts a two-stage training strategy that emphasizes key-action reasoning during pre-training and dense motion generation during fine-tuning.

Xiong-Feng Peng, Lu Xu, Yan-Dong Wang et al. · 0 citations
Preprint Oct 2026

Evo-World: A Lightweight Vision-Language-Action Model with Future Motion Prediction via Optical-Flow Supervision

Vision-language-action (VLA) models provide a unified framework for visual understanding, language grounding, and robot control, yet anticipating how the scene will evolve beyond the current observation can provide additional information for control. Action supervision alone does not explicitly encourage such anticipat...

Zi-Le Zhong, Yu-Xin Du, Tao Lin et al. · 0 citations
Preprint Oct 2026

PLaW-VLA: Predictive Latent World Modeling for Vision-Language-Action Policies

Learning to predict how the world evolves can provide vision-language-action (VLA) policies with predictive context for long-horizon control, but its effectiveness depends on what future representation is modeled and how it conditions action generation. We introduce PLaW-VLA, which models task-relevant future states in...

Yu Liu, He-Tian Guo, Tianlv Huang et al. · 2 citations
#artificial intelligence Preprint Oct 2026

DriveWLA: Unifying Future Dynamics and Scene Semantics through World-Language-Action Modeling for Autonomous Driving

Vision-Language Models (VLMs) and world models have demonstrated strong capabilities in semantic understanding and future scene evolution for autonomous driving. However, effectively integrating both capabilities for trajectory generation remains challenging. In this work, we propose DriveWLA, a unified World-Language-...

Shu-Zheng Wang, Hao-Xuan Li, Sheng-Zhen Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.