Skip to content

3D LiDAR Driven Reinforcement Learning With Safety Intervention for Mapless Navigation

Nov 2026 · IEEE Robotics and Automation Letters · Vol 11, pp. 12504-12511 · 0 citations · 34 references

Abstract

Autonomous navigation in real-world public service, industrial inspection, and emergency response often faces frequent changes in nominally static scene structures, which can quickly invalidate pre-built global maps and naturally lead to a mapless navigation setting. We propose an end-to-end 3D LiDAR based navigation framework that directly maps raw point clouds and relative goal cues to discrete actions. First, an importance gaze point cloud representation (IGPR) converts unordered sparse scans into a compact two-channel image representation via view-region enhancement and an adaptive reciprocal factor, improving sensitivity to decision critical geometry. Second, a geometry-driven dense reward is designed from raw point cloud structure and goal relative states to accelerate reinforcement learning and mitigate local-optimum behaviors. Third, a raw point- cloud driven Gaussian Control Barrier Functions (RPGC) safety controller performs minimal intervention when unsafe proximity is detected, improving deployment robustness without overriding the learned policy. Extensive simulations across diverse obstacle styles and time varying layouts demonstrate consistently high success rates and stable path efficiency. Real world experiments with novel obstacle geometries not encountered in simulation further validate direct sim-to-real transfer of the learned policy without additional real-world training.

View source

Similar papers

Aug 2024

LSTP-Nav: Lightweight Spatiotemporal Policy for Map-Free Multi-Agent Navigation With LiDAR

This paper proposes LSTP-Nav, a lightweight, decentralized navigation framework built on LSTP-Net that maps stacked 2D LiDAR observations, goal information, and velocity feedback directly to action and introduces an HS reward to provide smooth, heading-aware safety feedback, and develops PhysReplay-SimLab to improve tr...

Xingrong Diao, Zhi-Qiang Sun, Jian-Wei Peng et al. · 0 citations
Open access Sep 2026

Depth-driven UAV obstacle avoidance with teacher-guided exploration in cluttered environments

Obstacle avoidance in cluttered environments presents a significant challenge, as it requires rapid perception and decision-making in partially observable three-dimensional space, particularly for unmanned aerial vehicles (UAVs) operating with constrained onboard vision. Compared with traditional map-based approaches,...

Zi-Yin Meng, Jin-Biao Dong, Chuan-Gang Zhao · 0 citations
Open access Sep 2026

PV-STAM: Velocity-Aware Attention for Mapless Deep Reinforcement Learning Navigation in Dynamic Environments

Mapless deep reinforcement learning (DRL) navigation in dynamic indoor environments is difficult under single-frame 2D LiDAR, which reports where an obstacle is but not whether it is approaching. We introduce the Positional-Velocity Spatio-Temporal Attention Module (PV-STAM), a compact perception block (19,968 trainabl...

Anas Mahyoub Naji Saeed Alqadhi, Munef El Muhammed, M. A. M. S. Bajhaw et al. · 0 citations
Open access Sep 2026

ACR-Nav: Localization-Free Corridor Navigation via Action-Conditioned Scalar-Range Evolution

Mapless navigation often removes global maps while retaining localization-derived goal vectors or bearings. We study a stricter setting in which a mobile robot observes only local LiDAR, scalar goal range, and short histories of executed actions; neither pose nor goal direction is provided to the policy. We introduce A...

Qiguang Shen, Zhao-Yue Wang, Yi-Fei Feng et al. · 0 citations
Open access Sep 2026

PR-Nav: Potential-Shaped Reinforcement Learning with Physics-Modulated Manifolds for Agile Autonomous Navigation

High-speed autonomous navigation of micro aerial vehicles (MAVs) is essential for inspection tasks in restricted spaces (e.g., dense industrial facilities or narrow corridors), where reliable spatial perception and stable flight control are required. However, existing deep reinforcement learning-based navigation method...

Ge-Dan Qin, Tian-Long Wang, Heng Zhong et al. · 0 citations
Preprint Aug 2026

CORAL: Curriculum-Optimized Reward Adaptation for LiDAR-Based Goal-Directed Urban Driving

Reinforcement learning is promising for autonomous urban driving, but long-horizon goal-directed navigation asks a policy to acquire several competing behaviors at once--reaching a distant goal, tracking a route, avoiding obstacles, obeying signals--and a fixed objective gives no order in which to learn them. This pape...

Anisa Saleem, Duksu Kim · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.