Skip to content
Preprint

MODAL: Multi-Modal Object Re-ID via Model-Driven Sparse Decoupling and Text-Image Differential Filtering

Aug 2026 · 0 citations · 70 references
Computer Science Engineering

TL;DR

MODAL is a novel multi-modal object re-identification framework, grounded in coupled sparse coding theory and differential suppression principles, that achieves state-of-the-art performance with superior transparency.

Abstract

Multi-modal object re-identification (Re-ID) aims to facilitate cross-camera object retrieval in complex environments by leveraging complementary information from visual (e.g., RGB, NIR, TIR) and textual modalities. However, existing approaches often lack principled feature disentanglement and coherent multi-modal integration, leading to entangled representations that introduce cross-modal conflicts, obscure discriminative cues, and suffer distribution shift under modality-missing conditions. To tackle these challenges, we propose MODAL, a novel multi-modal object re-identification framework, grounded in coupled sparse coding theory and differential suppression principles. A core component of MODAL is a Multi-modal Feature Sparse Decoupling module, developed in a model-driven deep unrolling manner based on multi-modal coupled sparse coding. It explicitly decomposes multi-modal features into uni-modal specific, bi-modal and tri-modal shared representations, thereby achieving more transparent and effective feature disentanglement. Benefiting from the principled feature disentanglement, MODAL naturally mitigates performance degradation in incomplete-modality scenarios via a Modality-Aware Subspace Activation that selectively activates only the consistently shared subspaces. Moreover, we propose a Text-Image Differential Filtering module that leverages coarse-grained textual semantics to adaptively suppress task-irrelevant responses in the decoupled visual representations, thereby enhancing discriminative information. Extensive experiments on four datasets demonstrate that MODAL achieves state-of-the-art performance with superior transparency.

View source

Similar papers

Open access Sep 2026

SFTINet: Spatial–Frequency Token Interaction for Multi-Modal Object Re-ID

By seamlessly integrating spatial–frequency interaction with token-level masking, SFTINet effectively suppresses background interference while preserving cross-modal complementary information.

Lin Qi, Tian-Cun Guo, Yan-Fei Dong et al. · 0 citations
Aug 2026

Diff-MM: Exploring Pre-Trained Text-to-Image Generation Models for Unified Multi-Modal Object Tracking.

A unified multi-modal tracker Diff-MM is proposed by exploiting the multi-modal understanding capability of the pre-trained text-to-image generation model by harnessing the extensive prior knowledge in the generation model to achieve a unified tracker with uniform parameters for RGB-N/D/T/E tracking.

Shi-Yu Xuan, Ze-Chao Li, Jin-Hui Tang et al. · 0 citations
Preprint Oct 2026

TRIM-ReID: Duplication-Aware Token Reduction and Modality-Aligned Interaction for Multi-Modal Object Re-Identification

Multi-modal object re-identification exploits complementary RGB, near-infrared (NIR), and thermal-infrared (TIR) observations to retrieve target objects. However, existing methods commonly employ visual encoders optimized for global image-text alignment and select tokens using learned importance scores. Such designs fa...

Wan-Ke Xia, Rui Zhu, Xing-Guo Xu et al. · 0 citations
Open access 2026

TriMFB: A Tri-Feature Fusion Framework Integrating Modality-Specific and Cross-Modal Representations for Fine-Grained Fake News Detection

The rapid spread of multimodal misinformation on social media platforms has strengthened the need for effective fake news detection systems. While recent multimodal approaches integrate textual and visual information, most existing studies formulate the task as binary classification, thereby failing to fully exploit th...

Idza Aisara Norabid, Masita Jalil, Noor Ashikin Abd Rahim · 0 citations
Preprint Sep 2026

Incentive Noise and Structural Prior Infusion for Multi-modal Object Re-Identification

This work proposes a novel framework centered on Positive-Incentive Noise and structured prompt modulation that harnesses task-aware {\pi}-noise, sampled from a distribution conditioned on both visual and text inputs, to perturb global tokens and enable semantics-guided cross-modal compensation.

Wei-Xiang Zhou, Yu-Hao Wang, Xing-Guo Xu et al. · 0 citations
Conference Oct 2026

CMSP: a cross-modal similarity preservation method to improve CLIP performance

As a fundamental task in multimedia information retrieval, cross-modal image-text retrieval connects heterogeneous visual and linguistic modalities to support bi-directional image and text search by creating semantic correlations. While foundational models represented by CLIP provide high-quality baseline features and...

Min Lin, Shu-Hua Zhu, Jia-Hao Zhang · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.