Skip to content
Preprint

Robust Incomplete Multimodal Sentiment Analysis via Iterative Proxy Correction

Aug 2026 · 0 citations · 23 references
Computer Science

TL;DR

The proposed iterative proxy correction framework for robust incomplete MSA constructs a language-oriented proxy from non-language modalities and progressively refines it under multimodal context through gated residual correction, allowing the model to balance proxy-based compensation and trustworthy linguistic evidence.

Abstract

Multimodal sentiment analysis aims to infer affective states by integrating language, visual, and acoustic cues. However, real-world multimodal inputs are often incomplete or corrupted, which can weaken cross-modal complementarity and introduce misleading information into downstream fusion. Existing proxy-based methods for incomplete MSA commonly rely on one-shot proxy construction to compensate for degraded language information, but the generated proxy may be coarse or unreliable at initialization. Prematurely injecting such a proxy into multimodal reasoning can propagate initial errors and compromise sentiment prediction. To address this limitation, we propose an iterative proxy correction framework for robust incomplete MSA. Our method constructs a language-oriented proxy from non-language modalities and progressively refines it under multimodal context through gated residual correction. The corrected proxy is then adaptively fused with the observed language representation according to an estimated language reliability score, allowing the model to balance proxy-based compensation and trustworthy linguistic evidence. In addition, we introduce a stage-wise latent correction objective that uses the complete language representation as a training-time semantic anchor to stabilize the proxy refinement trajectory. Extensive experiments on MOSI, MOSEI, and SIMS under diverse missing-modality settings demonstrate that the proposed framework consistently outperforms competitive baselines and achieves robust sentiment prediction under incomplete inputs.

View source

Similar papers

#machine learning Preprint Sep 2026

Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysis

This work introduces an adaptive variational information bottleneck to model modality-wise uncertainty and perform quality-aware information compression, thereby suppressing redundant noise in unreliable modalities and designs a reliability-aware cross-sample enhancement strategy that retrieves high-confidence, semanti...

Meng-Hua Jiang, Hao-Kai Gao, Xian-Gui Kang et al. · 0 citations
Open access Sep 2026

Register-augmented attention and self-calibrated fusion for robust multimodal sentiment analysis

Results indicate that combining register-based representation stabilization with quality-aware fusion provides an effective solution for robust multimodal sentiment analysis, and RegCal-Net achieves competitive performance across multiple evaluation metrics, particularly improving fine-grained sentiment classification...

Bin Xu, Wei-Yang Wang, Ao Ding · 0 citations
#small language model Preprint Aug 2026

Multi-Granularity Sentiment Integration for LLM-Based Multimodal Sentiment Analysis

MGSI first encodes audio and visual streams at short-, medium-, and long-range temporal scales, preserving both local variations and global affective trends, and applies polarity- and intensity-aware enhancement to better handle ambiguous and near-neutral samples.

Shanshan Lin, Yuesheng Wu, Chao Chen et al. · 0 citations
Sep 2026

Reliability-aware disentangled adaptive network for multimodal sentiment analysis

A novel reliability-aware disentangled adaptive network that consists of three components, dynamically modulating per-modality contributions by information quality to mitigate misleading effects of unreliable modalities is proposed.

Jia-Hao Xu, Xue-Feng Zhao, Li Jia et al. · 0 citations
Conference 2026

Hierarchical Global-Local Interaction and Refinement for Multimodal Sentiment Analysis

A Modality Dropout strategy is first introduced at the input stage to alleviate over-reliance on a sin-gle modality and improve robustness and the proposed Hierarchical Global-Local Interaction and Refinement framework for Multimodal Sentiment Analysis (HGLIR) is proposed.

yuanyuan zhou · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.