Skip to content
Open access

LSTP-Nav: Lightweight Spatiotemporal Policy for Map-Free Multi-Agent Navigation With LiDAR

Aug 2024 · IEEE Transactions on Automation Science and Engineering · Vol 23, pp. 14837-14851 · 0 citations · 52 references
Computer Science Engineering

TL;DR

This paper proposes LSTP-Nav, a lightweight, decentralized navigation framework built on LSTP-Net that maps stacked 2D LiDAR observations, goal information, and velocity feedback directly to action and introduces an HS reward to provide smooth, heading-aware safety feedback, and develops PhysReplay-SimLab to improve training effectiveness through local replay of near-failure interactions.

Abstract

Safe map-free multi-robot navigation requires robots to make real-time decisions from partial and noisy local observations in dynamic, unstructured environments. Existing approaches often depend on prior maps, computationally intensive perception pipelines, or carefully tuned interaction models, which limit their robustness on resource-constrained platforms. This paper proposes LSTP-Nav, a lightweight, decentralized navigation framework built on LSTP-Net that maps stacked 2D LiDAR observations, goal information, and velocity feedback directly to action. LSTP-Net combines GRU-based temporal modeling with attention to extract interaction-critical spatiotemporal cues at low computational cost. We further introduce an HS reward to provide smooth, heading-aware safety feedback, and develop PhysReplay-SimLab to improve training effectiveness through local replay of near-failure interactions. Extensive simulation and real-world experiments show that LSTP-Nav outperforms representative baselines, achieving 98.6%–100.0% success in single-robot settings and 97.8%–99.0% success in 10-robot settings with 5–35 obstacles. The policy also remains robust to LiDAR degradation, nonconvex layouts, random seeds, and large-scale density tests, while achieving over 40 Hz onboard inference on a Raspberry Pi 3 Model B with zero-shot sim-to-real transfer. Overall, LSTP-Nav provides a practical, deployable solution for real-time, map-free multi-agent navigation on computationally constrained mobile robots. Note to Practitioners—This study addresses a pressing practical need in large-scale site inspection and outdoor search-and-rescue: enabling mobile robots with limited onboard computation to navigate safely and efficiently in complex, previously unseen environments without relying on pre-built maps. In real deployments, robots must make decisions from partial and noisy sensor observations while interacting with moving objects (e.g., pedestrians or teammates), and conventional map-based pipelines or computationally heavy planners can become unreliable or infeasible. To tackle these constraints, we propose a lightweight spatiotemporal navigation policy that directly converts raw LiDAR observations into motion commands, combining temporal memory with attention to focus computation on interaction-critical cues. In addition, a heading-stability objective and a physics-based replay-assisted training workflow improve behavior smoothness and reduce failure cases such as oscillation, collisions, and getting trapped in cluttered areas. Extensive simulation and real-world tests show that the proposed approach improves navigation success and safety over representative baselines while maintaining real-time performance on CPU-only platforms, making it suitable for practical deployment on resource-constrained robots in dynamic, unstructured environments.

Read PDF

Similar papers

Nov 2026

3D LiDAR Driven Reinforcement Learning With Safety Intervention for Mapless Navigation

Autonomous navigation in real-world public service, industrial inspection, and emergency response often faces frequent changes in nominally static scene structures, which can quickly invalidate pre-built global maps and naturally lead to a mapless navigation setting. We propose an end-to-end 3D LiDAR based navigation f...

Yue Zhai, Yan-Zi Miao · 0 citations
Open access Sep 2026

ACR-Nav: Localization-Free Corridor Navigation via Action-Conditioned Scalar-Range Evolution

ACR-Nav is introduced, an action-conditioned range navigation framework that converts scalar-range evolution into closed-loop progress information and can support goal-directed, segment-level navigation within locally straight corridor passages without exposing robot pose or target bearing to the policy.

Qiguang Shen, Zhao-Yue Wang, Yi-Fei Feng et al. · 0 citations
Preprint Aug 2026

Unified Planning-Learning Framework for Robust UUV Navigation Under Partial Observability

This paper presents an observation-only autonomy framework for Unmanned Underwater Vehicles (UUVs) navigation in dynamic underwater environments that integrates persistent occupancy mapping, global clearance-aware planning, and risk-aware local control. The proposed pipeline constructs occupancy maps solely from onboar...

M. E. Deowan, Eleni Kelasidi · 0 citations
Open access Aug 2026

SkyAgent: A lightweight LLM-driven reinforcement learning framework for adaptive cooperative path planning of two UAVs

This work provides a feasible technical pathway and reproducible evaluation benchmark for the collaborative deployment of lightweight LLM planner, sub-goal guidance, sensor observations, cooperative reward, and reward shaping components and quantifies the indispensability of the LLM planner.

Yuting Cao, Zheng Zhao, Jiekai Wu et al. · 0 citations

EA-SAC: ENERGY-AWARE: reinforcement learning for ski-steer local navigation

Energy-efficient local navigation on skid-steer mobile robots (SSMRs) in dense environments is constrained by a structural trade-off: the low-curvature, low-power manoeuvres that minimise locomotion energy conflict with the high-curvature, high-yaw-rate corrections required to weave through dense obstacle fields withou...

Octavio Eduardo Aguila Rigordi · 0 citations
Preprint Aug 2026

Diffusion Policies for Short-Horizon Planning in Robot Crowd Navigation

Planning Diffusion Policy Optimization is proposed, an offline-to-online reinforcement-learning framework that uses a diffusion policy to generate short-horizon action chunks for crowd navigation and obtains an improved success rate over strong baselines and ablations demonstrate that action chunks are especially impor...

Wen-Dong Li, J. Garcke · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.