Significance-Preserving Progressive Network for Infrared and Visible Image Fusion

Abstract

Fusing infrared and visible images can effectively compensate for the inherent limitations of each modality in different scenes, resulting in fused images that contain richer information. However, existing methods often struggle to balance global dependency modeling with local detail preservation and to effectively coordinate heterogeneous local and global features during fusion. To address these issues, this paper proposes a Significance-Preserving Progressive Fusion Network (SiPFusion). First, a progressive feature extraction framework was designed, which hierarchically extracts multi-scale local features using CNNs and then models long-range dependencies across scales via a Transformer-based global module. To adaptively integrate local-global complementary features, a significance-preserving fusion module was designed to obtain significance attention maps with a spatial selection mechanism, enabling dynamic fusion of multi-source features. Furthermore, we propose a significance similarity loss function that leverages intermediate feature guidance to enhance structural consistency and preserve salient-region information in the fused image. Extensive experiments on the MSRS, RoadScene, and TNO datasets demonstrate that SiPFusion achieves competitive visual quality and strong overall quantitative performance against 15 state-of-the-art fusion methods, obtaining leading results on most evaluated metrics.