Skip to content
Open access

Robust Optical-to-SAR Image Registration via Dense Tukey-Weighted Gradient Histogram and Structural Saliency Weight

2026 · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · Vol 19, pp. 26380-26396 · 0 citations · 61 references

TL;DR

A robust cross-modal matching framework driven by a novel dense Tukey-weighted gradient histogram (DTGH) descriptor and a structural saliency weight (SSW) that consistently outperforms both representative hand-crafted baselines and advanced deep learning models, while circumventing the domain shift bottlenecks inherent in data-driven approaches.

Abstract

Optical-to-SAR image registration is a fundamental prerequisite for multisource remote sensing applications, yet it remains challenging due to severe nonlinear radiometric differences, complex speckle noise, and structural blurring. Existing area-based matching methods often impose uniform spatial weighting. This uniformity makes them highly susceptible to mismatches in textureless or noise-dominated regions. To address this issue, we propose a robust cross-modal matching framework driven by a novel dense Tukey-weighted gradient histogram (DTGH) descriptor and a structural saliency weight (SSW). Specifically, DTGH employs directional soft assignment and spatial aggregation via a 2-D Tukey window to extract modality-invariant geometric structures. This approach effectively mitigates quantization boundary artifacts and prevents feature blurring. Furthermore, the SSW introduces a spatial confidence measure derived from local variance statistics. It adaptively shifts the matching focus toward highly reliable structures while suppressing the interference of homogeneous areas. Crucially, the SSW serves as a lightweight, plug-and-play module that can be seamlessly integrated to enhance existing multimodal registration pipelines. Comprehensive evaluations across patch-level, full-image, and large-scale scenarios demonstrate that the proposed method achieves state-of-the-art accuracy and reliability. It consistently outperforms both representative hand-crafted baselines and advanced deep learning models, while circumventing the domain shift bottlenecks inherent in data-driven approaches. Consequently, this training-free framework exhibits exceptional cross-domain generalization and high computational efficiency in CPU-only environments.

Read PDF

Similar papers

Open access 2026

LOSC: Optical-SAR Image Registration Based on Local Oriented Scale Contour Feature Descriptor

To address challenges in multimodal registration of synthetic aperture radar and optical images—including nonlinear radiation differences, multiplicative speckle noise, and large geometric rotations—we propose a robust registration method based on a local orientation scale contour (LOSC) descriptor. First, an orientati...

Ji-Wei Fan, Shi-Zhen Liu, Zhi Zheng et al. · 0 citations
Open access 2026

Multimodal Remote Sensing Image Matching Considering Structural Saliency

Nonlinear radiometric distortion, orientation reversal, and image rotation considerably affect multimodal image matching performance in remote sensing. Furthermore, existing multimodal image matching algorithms are highly complex and inefficient. We addressed these issues by developing a reliable matching method consid...

Li Xue, Ye-Hua Sheng, Shu-Wen Yang et al. · 0 citations
Conference Aug 2026

Noise-Robust Multimodal Remote Sensing Image Matching Network with Edge-Aware Attention Fusion

Multimodal remote sensing image matching is challenged by nonlinear radiometric differences, geometric deformation, sensor noise, and weak cross-modal feature repeatability. We present an edge-aware coarse-to-fine Transformer network. A Feature Enhancement Transformer (FET) performs linear self- and cross-attention, wh...

Ping Liu, Bo Xu, Da-Peng Zheng et al. · 0 citations
Open access 2026

Frequency-Aware Visible-to-SAR Cross-Modal Image Generation

Synthetic aperture radar (SAR) imaging is unaffected by illumination and cloud cover, but its characteristic speckle texture makes visible-to-SAR cross-modal generation difficult. Existing methods mostly constrain the result at the pixel level, so the spectral distribution and speckle statistics of generated images can...

Xiu-Yuan Xia, Lin-Yan Li, Yi Wang et al. · 0 citations
Open access Oct 2026

Registration between SAR and optical images based on dual-channel network

Traditional image registration methods rely on handcrafted feature extraction and matching strategies, which are inherently subjective and fail to fully exploit data-driven mechanisms. To address these limitations, we propose a novel dual-channel network for optical and synthetic aperture radar image registration. Our...

Wan-Nan Zhang, Dan Wang · 0 citations
Open access Aug 2026

Structure-Based Feature Representation for Robust Multi-Modal Image Matching

This paper proposes a robust feature-based matching framework that reduces reliance on intensity information while enhancing structural representation and demonstrates that MIHOG can provide dense and reliable correspondences under complex cross-modal radiometric and geometric variations.

Yameng Hong, Chengcai Leng, Zhao Pei · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.