Skip to content
Open access

IV-PAFNet: Infrared-visible cross-modal alignment and fusion network for nighttime UAV object detection

Oct 2026 · PLoS ONE · Vol 21, pp. e0361401 - e0361401 · 0 citations · 48 references
Medicine

TL;DR

Infrared signal purification and spatial alignment module applies learnable high-pass filtering and gated residual fusion to refine infrared responses, followed by visible-guided offset prediction and differentiable resampling to alleviate local cross-modal spatial discrepancies.

Abstract

Nighttime unmanned aerial vehicle object detection is challenged by degraded visible-light textures, cluttered infrared thermal responses, and local spatial discrepancies between infrared and visible images. To address these issues, we propose IV-PAFNet, an infrared-visible purification, alignment, and fusion network designed for object detection in nighttime and low-visibility conditions. IV-PAFNet consists of two primary components. The infrared signal purification and spatial alignment module applies learnable high-pass filtering and gated residual fusion to refine infrared responses, followed by visible-guided offset prediction and differentiable resampling to alleviate local cross-modal spatial discrepancies. The multi-scale fusion attention enhancement module performs channel-wise modality recalibration and spatial reliability weighting at multiple feature-pyramid levels, allowing the network to adapt the contribution of each modality to local imaging conditions. In the training-based DroneVehicle and generalization-based Camera-vehicle1 datasets, IV-PAFNet achieves 62.81% mAP@0.5:0.95 and 51.4% mAP@0.5:0.95, respectively. Additional controlled experiments investigate the distinct roles of infrared purification, visible-guided alignment, channel recalibration, and spatial reliability modeling, while statistical and computational analyses characterize run-to-run variation and inference cost. The code is available at https://github.com/iv-pafnet/IV-PAFNet.

Read PDF

Similar papers

Open access 2026

FDBGF-Net: Frequency-Decoupled Bidirectional Gated Fusion for Infrared–Visible Object Detection Under Degradation in UAV Imagery

Infrared–visible fusion is increasingly used to improve object detection robustness in uncrewed aerial vehicle (UAV) remote sensing. However, real-world UAV imagery is often affected by co-occurring degradations, such as blur, rain, snow, fog, strong illumination, and electromagnetic interference. These disturbances ma...

Kai-Peng Wang, Guang-Lin He, Zong-Ze Li et al. · 0 citations
Open access 2026

SCAF-Net: Sparse Cross-Modal Adaptive Fusion Network for RGB-IR UAV Object Detection

Visible-infrared (RGB-IR) object detection equips uncrewed aerial vehicles (UAVs) with robust, around-the-clock perception capabilities. However, practical deployments are frequently constrained by weak spatial misalignment between heterogeneous sensors. This issue degrades the object detection accuracy of UAVs, for wh...

Bo-Yu Zhang, Chao-Yang Niu, Wan-Jie Lu et al. · 0 citations
Open access Oct 2026

Infrared-visible space debris perception and detection with light-boosting convolution and cross-modal attention fusion

Space debris poses an increasing threat to the safety of spacecraft because reliable perception under complex illumination remains challenging for autonomous on-orbit operations. Existing visible-light methods are highly susceptible to low-light degradation, whereas infrared images preserve thermal information but...

Yong-Qing Yang, Da-Lei Yao, Fan Bu et al. · 0 citations
Open access Sep 2026

ICG-VIMOD: infrared-characteristic-guided visible-infrared multi-modal object detection network

Object detection in complex lighting and harsh environments significantly benefits from the synergistic deployment of visible and infrared spectra. However, most existing dual-modality methods follow a two-stage pipeline termed ‘fusion-then-detection’, inevitably entailing substantial model complexity and intensive com...

Chao Zeng, Hao Zhao, Ju Zhou · 0 citations
Open access 2026

Gated Cross-Modal Fusion and Feature Reconstruction for Visible-Infrared Remote Sensing Object Detection

The visible-infrared object detection in uncrewed aerial vehicle (UAV) remote sensing remains challenging due to small object feature degradation, complex-background interference, modality heterogeneity, and the high computational cost of existing fusion methods. To address these issues, this study proposes a multimoda...

Ding-Xin Tang, Wen-Qing Yang, J. Xuan · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.