2026· IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing· Vol 19, pp. 26380-26396· 0 citations· 61 references
TL;DR
A robust cross-modal matching framework driven by a novel dense Tukey-weighted gradient histogram (DTGH) descriptor and a structural saliency weight (SSW) that consistently outperforms both representative hand-crafted baselines and advanced deep learning models, while circumventing the domain shift bottlenecks inherent in data-driven approaches.
Abstract
Optical-to-SAR image registration is a fundamental prerequisite for multisource remote sensing applications, yet it remains challenging due to severe nonlinear radiometric differences, complex speckle noise, and structural blurring. Existing area-based matching methods often impose uniform spatial weighting. This uniformity makes them highly susceptible to mismatches in textureless or noise-dominated regions. To address this issue, we propose a robust cross-modal matching framework driven by a novel dense Tukey-weighted gradient histogram (DTGH) descriptor and a structural saliency weight (SSW). Specifically, DTGH employs directional soft assignment and spatial aggregation via a 2-D Tukey window to extract modality-invariant geometric structures. This approach effectively mitigates quantization boundary artifacts and prevents feature blurring. Furthermore, the SSW introduces a spatial confidence measure derived from local variance statistics. It adaptively shifts the matching focus toward highly reliable structures while suppressing the interference of homogeneous areas. Crucially, the SSW serves as a lightweight, plug-and-play module that can be seamlessly integrated to enhance existing multimodal registration pipelines. Comprehensive evaluations across patch-level, full-image, and large-scale scenarios demonstrate that the proposed method achieves state-of-the-art accuracy and reliability. It consistently outperforms both representative hand-crafted baselines and advanced deep learning models, while circumventing the domain shift bottlenecks inherent in data-driven approaches. Consequently, this training-free framework exhibits exceptional cross-domain generalization and high computational efficiency in CPU-only environments.
To address challenges in multimodal registration of synthetic aperture radar and optical images—including nonlinear radiation differences, multiplicative speckle noise, and large geometric rotations—we propose a robust registration method based on a local orientation scale contour (LOSC) descriptor. First, an orientati...
Ji-Wei Fan, Shi-Zhen Liu, Zhi Zheng et al.· IEEE Journal of Selected Top...· 0 citations
Nonlinear radiometric distortion, orientation reversal, and image rotation considerably affect multimodal image matching performance in remote sensing. Furthermore, existing multimodal image matching algorithms are highly complex and inefficient. We addressed these issues by developing a reliable matching method consid...
Li Xue, Ye-Hua Sheng, Shu-Wen Yang et al.· IEEE Journal of Selected Top...· 0 citations
Multimodal remote sensing image matching is challenged by nonlinear radiometric differences, geometric deformation, sensor noise, and weak cross-modal feature repeatability. We present an edge-aware coarse-to-fine Transformer network. A Feature Enhancement Transformer (FET) performs linear self- and cross-attention, wh...
Ping Liu, Bo Xu, Da-Peng Zheng et al.· 2026 2nd International Confe...· 0 citations
Synthetic aperture radar (SAR) imaging is unaffected by illumination and cloud cover, but its characteristic speckle texture makes visible-to-SAR cross-modal generation difficult. Existing methods mostly constrain the result at the pixel level, so the spectral distribution and speckle statistics of generated images can...
Xiu-Yuan Xia, Lin-Yan Li, Yi Wang et al.· IEEE Access· 0 citations
Traditional image registration methods rely on handcrafted feature extraction and matching strategies, which are inherently subjective and fail to fully exploit data-driven mechanisms. To address these limitations, we propose a novel dual-channel network for optical and synthetic aperture radar image registration. Our...
Wan-Nan Zhang, Dan Wang· AIP Advances· 0 citations
This paper proposes a robust feature-based matching framework that reduces reliance on intensity information while enhancing structural representation and demonstrates that MIHOG can provide dense and reliable correspondences under complex cross-modal radiometric and geometric variations.