Skip to content
Preprint

$S^3$-Nav: Structured Spatial-Semantic Decision Making for Language-Guided Robot Navigation

Oct 2026 · 0 citations · 26 references
Computer Science

TL;DR

Evaluations across multiple environments and object- and relation-goal tasks show improved closed-loop navigation reliability and reduced language-model token consumption with capacity-controlled evidence exposure under the evaluated inference configuration.

Abstract

Language-guided robot navigation under partial observability requires robots to reason over spatial-semantic evidence accumulated across observations, particularly when goals involve spatial relations between objects. This paper presents $S^3$-Nav, a structured spatial-semantic decision-making framework that integrates online mapping, persistent object--relation memory, and goal-conditioned navigation. Using RGB-D observations and SLAM, $S^3$-Nav maintains a persistent object--relation memory containing object records and confirmed relation records alongside an evolving navigation context containing exploration frontiers, without requiring a pre-existing map. A goal-conditioned evidence interface selects task-relevant evidence from this structured state and constructs a capacity-controlled decision view as part of the high-level policy input for exploration, target approach, and stopping decisions. The persistent memory remains available for subsequent reasoning and verification even when some of its records are excluded from the decision view. To ensure grounded execution, provisional policy decisions are independently validated against persistent object--relation memory and current geometric evidence before physical execution or task termination. Evaluations across multiple environments and object- and relation-goal tasks show improved closed-loop navigation reliability and reduced language-model token consumption with capacity-controlled evidence exposure under the evaluated inference configuration.

View source

Similar papers

#artificial intelligence Preprint Nov 2026

CPNav: Calibrated Vision-Language Navigation for Object-Goal Search in Unseen Environments

CPNav is introduced, a navigation framework that combines collision-aware planning with statistically calibrated VLM action scoring for map-free object-goal navigation and provides finite-sample guarantees at a user-specified risk level.

Qi-Zhao Chen, Yuan-Hong Zeng, Shoh Nishino et al. · 0 citations
Conference Open access Oct 2026

When Maps Are Incomplete: Evaluating Vision-Language-Guided Navigation Against Nav2

Real-world mobile robots may not always have access to complete or accurate prior maps. In such cases, vision-language models (VLMs), which combine visual perception with semantic reasoning, offer a promising way to interpret environmental changes and revise navigation decisions. This study develops and evaluates two V...

Brian Fitzpatrick, Noorbakhsh Amiri Golilarz, Soroush Korivand · 0 citations
Sep 2026

CoRelNav: Collaborative Relational Navigation for Multi-Robot Spatially Constrained Semantic Navigation

CoRelNav is proposed, whose core is coupling task-conditioned multi-robot exploration with candidate-driven collaborative verification, which reduces redundant search and enables relation hypotheses to be resolved from distributed partial evidence that independent exploration or isolated-view verification can leave amb...

Jin-Yu He, Zi-Hao Mao, Hao-Nan Jin et al. · 0 citations
Sep 2026

Spatial and Semantic Reasoning for LLM-Driven Robot Navigation via MCP

This work proposes a non-invasive framework that connects LLM reasoning with ROS-based navigation through a navigation-oriented representation layer, exposed through the Model Context Protocol as standardized, reusable tools so that any MCP-compatible LLM can access them without robot-specific wrappers.

Jungsoo Lee, Jaegyun Park, Wansoo Kim · 0 citations
Preprint Oct 2026

OntoPlan: An Ontology-Grounded Scene Representation and Agentic Framework for Scalable Robot Task Planning

Large language model (LLM)-based robot task planning is promising for open-ended instruction following, but degrades on long-horizon tasks in large environments. When spatial information is conveyed to the LLM through text, the model can fail to capture spatial context, and token cost grows with environment size. Gener...

Hyeongwoo Nam, Woongje Cho, Juwon Kim et al. · 0 citations
Preprint Oct 2026

Natural-Language to Nav2: Operational Policies for Costmap-Based Navigation

Autonomous mobile robots support material transport in warehouses and industrial facilities, where navigation must adapt to changing operating conditions. Sensor observations reveal physical obstacles, but do not by themselves specify temporary access rules, route preferences, or exceptions known to operators. This pap...

Jiyeong Chae, Hyunkyo Seo, Heonjae Lee et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.