Skip to content

Dual-path fusion network for multimodal sentiment analysis under uncertain missing modalities

Sep 2026 · International Journal of Machine Learning and Cybernetics · Vol 17 · 0 citations · 48 references

TL;DR

A Variational Autoencoder-Based Multi-Granularity Missing-Aware Dual-Path Fusion Network (VMMD) with contrastive learning-driven Cross-Path Semantic Consistency Constraint (CSCC), which mitigates semantic representation inconsistency caused by granularity heterogeneity between supplementary information and proxy features, thereby enhancing sentiment polarity prediction under missing-modality conditions.

View source

Similar papers

#machine learning Preprint Sep 2026

Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysis

This work introduces an adaptive variational information bottleneck to model modality-wise uncertainty and perform quality-aware information compression, thereby suppressing redundant noise in unreliable modalities and designs a reliability-aware cross-sample enhancement strategy that retrieves high-confidence, semanti...

Meng-Hua Jiang, Hao-Kai Gao, Xian-Gui Kang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Robust Multimodal Sentiment Analysis with Incomplete Modalities via Semantic-aware Completeness based Reconstruction

A new completeness estimation approach is introduced that quantifies the degree of sentiment-relevant information preserved in incomplete data to guide the reconstruction of missing semantics and enables more accurate semantic reconstruction, leading to more precise sentiment prediction.

Han-Jun Choi, Byunggill Joe, Saim Shin et al. · 0 citations
Sep 2026

A hierarchical multistage semantic fusion framework for multimodal sentiment analysis

Multimodal sentiment analysis aims to improve cross-modal fusion to understand sentiment better. Most existing methods rely on single-stage fusion or local cross-modal interactions, making it difficult to fully capture relationships among modalities, thereby limiting their sentiment representation capabilities and...

Guang-Yu Mu, Jia-Xiu Dai, Yuan-Yuan Yue et al. · 0 citations
Aug 2026

Aspect-guided dual-branch fusion network for multimodal aspect-based sentiment analysis

An Aspect-guided dual-branch fusion network (ADFN) to enhance sentiment prediction by incorporating external knowledge and integrating coarse and fine information is proposed, which incorporates syntactic dependency information to complement and enrich the textual semantic representations.

Bin Song, Wenjing Liu, Zhi Liang et al. · 0 citations
Open access 2026

A Bidirectional Cross-Modal Attention Framework for Multimodal Sentiment Analysis

Multimodal sentiment analysis on social media data presents unique challenges due to label noise, modality conflicts, and class imbalance inherent in annotated image-text datasets. The proposed work presents CLIP-CrossFusion Net, a novel multimodal sentiment analysis framework that integrates the Contrastive Language-I...

B. Harish, C. Roopa, M. S. Kendagannaswamy et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.