This work proposes a novel Asymmetric Dual-text Guided Network (ADGNet), comprising an image-agnostic abstract target prompt and an image-specific detailed background prompt, and introduces an Asymmetric Dual-Branch Interaction module to separately guide visual features with their respective text priors, protecting targets from noise while suppressing background clutter.
Abstract
InfRared Small Target Detection (IRSTD) is a challenging task. Relying solely on pixel-level information, vision-only methods struggle to distinguish targets from clutter. Current multimodal methods typically describe both targets and backgrounds with a single textual prompt. Such an approach lacks dedicated regional guidance and ignores infrared semantic asymmetry. Consequently, it provides insufficient background suppression information and introduces severe feature optimization conflicts, overwhelming small targets with noise. To address these issues, we propose a novel Asymmetric Dual-text Guided Network (ADGNet). Specifically, accounting for the infrared semantic asymmetry, we first design the Asymmetric Dual-text Prompt (ADP), comprising an image-agnostic abstract target prompt and an image-specific detailed background prompt. To leverage these prompts, we introduce an Asymmetric Dual-Branch Interaction (ADBI) module to separately guide visual features with their respective text priors, protecting targets from noise while suppressing background clutter. Subsequently, we introduce an Adaptive Feature Aggregation (AFA) module to dynamically fuse features from the two branches. Furthermore, we construct a multimodal Asymmetric Image-Text Infrared (AITIR) dataset by providing asymmetric text annotations for three public datasets (IRSTD-1K, NUDT-SIRST, and SIRST). Extensive experiments demonstrate that ADGNet outperforms 21 state-of-the-art (SOTA) methods. Code is available at https://github.com/iLearn-Lab/MM26-ADGNet.
InfRared Small Target Detection (IRSTD) is a prominent and challenging task in computer vision. In recent years, text-guided methods have significantly improved detection performance. However, they still suffer from two key limitations. First, a single text description simultaneously modeling both background and target...
Chenglong Yu, Ming-Zhu Xu, Jing Wang et al.· 0 citations
A novel Vision-Language Guided Infrared Detection Network (VLGNet), which introduces auxiliary textual semantics to enhance feature representation for infrared small target detection and exhibits strong robustness in complex and low-contrast scenarios, validating the effectiveness of integrating vision-language informa...
Zhi-Wei Jiang, Jing-Cheng Shi, Jing-Han Yan et al.· Global Intelligent Industry...· 0 citations
Infrared small target detection (ISTD) is an important research direction in image processing. However, existing methods are limited by severe background noise propagation and target degradation in high-level semantic features. To address these limitations, this paper proposes a plug-and-play physics-informed cascaded...
Jing-Jing Liu, Yi Han, Xianchao Xiu et al.· 0 citations
In infrared small target detection (IRSTD), data-driven methods typically utilize a single-scale image as input, complicating the suppression of background clutter during early encoding. While multi-input methods alleviate this issue, their independent encoding of inputs often fails to suppress undesirable representati...
Shen Deng, Shao-Qiu Xiao· IEEE Transactions on Aerospa...· 0 citations
Infrared small target detection (IRSTD) plays a vital role in remote sensing and automated early-warning infrastructure. However, its performance is deeply constrained by the dim nature of targets and complex background clutter. Although convolutional neural networks (CNNs) have driven advancements in this field, they...
Zhen Huang, Da-Wei Ren, Yan Zhang et al.· IEEE Journal of Selected Top...· 0 citations
Infrared small target detection (IRSTD) is difficult because true targets are sparse and weak, whereas cloud edges, sea clutter, building structures, and sensor noise can produce compact target-like responses. This letter proposes CDMS-Net, which combines context-stable and detail-sensitive predictions through a bounde...
Xi-Jun Wu, Wen-Ding Xiang, Fan Yang· IEEE Geoscience and Remote S...· 0 citations
Known for his clear and elegant writing style, Bertsekas shaped fields from control and optimization to large-scale computation and artificial intelligence.