Skip to content

Multi-Modal Radio-Vision SLAM for ISAC: Prototype Design, Experimental Validation, and Beam-Management Applications

2026 · IEEE Transactions on Wireless Communications · Vol 25, pp. 22734-22748 · 0 citations · 41 references

Abstract

Radio-based simultaneous localization and mapping (radio-SLAM) offers a promising solution for user equipment (UE) localization and radio feature map construction without external positioning infrastructure, with its feasibility already demonstrated through integrated sensing and communication (ISAC) prototypes. However, the performance of radio-SLAM is constrained by the sensing capability of wireless devices and irregular UE motion, necessitating the fusion of multi-modal sensors to harness complementary advantages in multi-modal SLAM. Critically, existing multi-modal SLAM methods are underdeveloped and do not leverage SLAM outputs for communication enhancement, nor have they been demonstrated in prototypes. To address these challenges, we propose a multi-modal SLAM framework integrated with SLAM-aided beam management, fusing radio measurements, inertial measurement unit (IMU) data, and stereo camera images to enhance localization robustness and mapping accuracy in both line-of-sight (LoS) and non-line-of-sight (NLoS) scenarios under varying lighting conditions. The resulting localization and mapping information facilitates beam tracking and blockage prediction. We further develop an ISAC prototype system capable of collecting synchronized multi-modal data in dynamic scenarios. Experiments demonstrate that the proposed SLAM achieves decimeter-level UE localization and radio map construction under both bright and low-light conditions. The beam management module enables precise beam alignment with an average beam direction angular error of 0.0403 rad and blockage prediction with an average detection rate of 84.33% across LoS and NLoS paths. The collected dataset and implementation are publicly released to support reproducible research in multi-modal ISAC.

View source

Similar papers

Sep 2026

DR-TC-SLAM: a dynamic-interference-aware tightly coupled visual-LiDAR-inertial SLAM framework

Experiments on KITTI, M2DGR, and custom UAV datasets show that the proposed framework improves global trajectory accuracy and mapping consistency in the tested dynamic-interference scenarios, and results indicate that aggressive dynamic feature removal may weaken short-term constraints in loop-free sequences.

Meng Tian, Shu-Fan He, Zheng-Cheng Dong et al. · 0 citations
Review Open access Sep 2026

LiDAR-Based SLAM: A Review of Algorithmic Modules and LiDAR-Inertial Integration Architectures

This review presents an architecture-centered synthesis of LiDAR-based SLAM, covering LiDAR-only and LiDAR-inertial systems through a dual-axis, architecture-centered taxonomy, and highlights the field’s progression toward continuous-time estimation, semantic scene understanding, adaptive map representations, neural im...

E. Muhammed, A. Shaker · 1 citation
Conference Aug 2026

LDF-SLAM: lightweight decoupled architecture-based robust localization for UAVs in indoor constrained environments

This work contributes a new feature processing paradigm and a fusion constraint design strategy for robust pose estimation under weak-texture degradation in Three Dimensional (3D) imaging and embedded vision applications.

Xia Xiao, Chang Liu, Hao Chen et al. · 0 citations
Conference Open access Aug 2026

Single-Base-Station NLoS Outdoor Localization via Sequential Radio-Map Matching

Experimental results show that sequential observations can effectively reduce localization ambiguity, and that the final accuracy depends strongly on radio-map fidelity and trajectory sampling design.

Jia-Jie Xu, Yi-Fan Guo, Xiu-Cheng Wang et al. · 0 citations
Review Open access 2026

Vehicle Localization in V2X-Enabled Environments: A Survey on Challenges, Enabling Technologies, and New Perspectives

The paper categorises localisation technologies into four broad groups: memory-dependent, adaptive learning-based, stateless and hybrid localisation technologies, and highlights the strengths and weaknesses of each approach, emphasising the need for data fusion methods to balance cost, accuracy, and robustness in auton...

Jerry James, Naveen Gupta, Ravi Kadlimatti · 0 citations
Aug 2026

ICF-SLAM: Instance-guided loop closure and asynchronous historical correction for filter-based LiDAR–inertial SLAM

Simultaneous localisation and mapping (SLAM) is a key technology for mobile robots and autonomous systems to obtain real-time pose information and environmental spatial structure, and its measurement accuracy directly affects localisation reliability and map consistency in large-scale scenarios. However, in environment...

Yuzong Lin, Xu-Zhao Yang, Yuxuan Guo et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.