Oct 2026· PLoS ONE· Vol 21, pp. e0361401 - e0361401· 0 citations· 48 references
Medicine
TL;DR
Infrared signal purification and spatial alignment module applies learnable high-pass filtering and gated residual fusion to refine infrared responses, followed by visible-guided offset prediction and differentiable resampling to alleviate local cross-modal spatial discrepancies.
Abstract
Nighttime unmanned aerial vehicle object detection is challenged by degraded visible-light textures, cluttered infrared thermal responses, and local spatial discrepancies between infrared and visible images. To address these issues, we propose IV-PAFNet, an infrared-visible purification, alignment, and fusion network designed for object detection in nighttime and low-visibility conditions. IV-PAFNet consists of two primary components. The infrared signal purification and spatial alignment module applies learnable high-pass filtering and gated residual fusion to refine infrared responses, followed by visible-guided offset prediction and differentiable resampling to alleviate local cross-modal spatial discrepancies. The multi-scale fusion attention enhancement module performs channel-wise modality recalibration and spatial reliability weighting at multiple feature-pyramid levels, allowing the network to adapt the contribution of each modality to local imaging conditions. In the training-based DroneVehicle and generalization-based Camera-vehicle1 datasets, IV-PAFNet achieves 62.81% mAP@0.5:0.95 and 51.4% mAP@0.5:0.95, respectively. Additional controlled experiments investigate the distinct roles of infrared purification, visible-guided alignment, channel recalibration, and spatial reliability modeling, while statistical and computational analyses characterize run-to-run variation and inference cost. The code is available at https://github.com/iv-pafnet/IV-PAFNet.
Infrared–visible fusion is increasingly used to improve object detection robustness in uncrewed aerial vehicle (UAV) remote sensing. However, real-world UAV imagery is often affected by co-occurring degradations, such as blur, rain, snow, fog, strong illumination, and electromagnetic interference. These disturbances ma...
Kai-Peng Wang, Guang-Lin He, Zong-Ze Li et al.· IEEE Journal of Selected Top...· 0 citations
Visible-infrared (RGB-IR) object detection equips uncrewed aerial vehicles (UAVs) with robust, around-the-clock perception capabilities. However, practical deployments are frequently constrained by weak spatial misalignment between heterogeneous sensors. This issue degrades the object detection accuracy of UAVs, for wh...
Bo-Yu Zhang, Chao-Yang Niu, Wan-Jie Lu et al.· IEEE Journal of Selected Top...· 0 citations
Results show that bidirectional alignment can improve paired RGB–infrared UAV detection while preserving sensor-specific outputs and real-time throughput on the evaluated platform.
Xing-Yu Lu, Min-Wei Zhao, Ming Tian et al.· Applied Sciences· 0 citations
Space debris poses an increasing threat to the safety of spacecraft because reliable perception under complex illumination remains challenging for autonomous on-orbit operations. Existing visible-light methods are highly susceptible to low-light degradation, whereas infrared images preserve thermal information but...
Yong-Qing Yang, Da-Lei Yao, Fan Bu et al.· Frontiers in Astronomy and S...· 0 citations
Object detection in complex lighting and harsh environments significantly benefits from the synergistic deployment of visible and infrared spectra. However, most existing dual-modality methods follow a two-stage pipeline termed ‘fusion-then-detection’, inevitably entailing substantial model complexity and intensive com...
Chao Zeng, Hao Zhao, Ju Zhou· Measurement science and tech...· 0 citations
The visible-infrared object detection in uncrewed aerial vehicle (UAV) remote sensing remains challenging due to small object feature degradation, complex-background interference, modality heterogeneity, and the high computational cost of existing fusion methods. To address these issues, this study proposes a multimoda...
Ding-Xin Tang, Wen-Qing Yang, J. Xuan· IEEE Transactions on Geoscie...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.