Skip to content
Open access

TriMFB: A Tri-Feature Fusion Framework Integrating Modality-Specific and Cross-Modal Representations for Fine-Grained Fake News Detection

2026 · International Journal of Advanced Computer Science and Applications · 0 citations · 41 references

Abstract

The rapid spread of multimodal misinformation on social media platforms has strengthened the need for effective fake news detection systems. While recent multimodal approaches integrate textual and visual information, most existing studies formulate the task as binary classification, thereby failing to fully exploit the rich label structures available in fine-grained datasets. Moreover, conventional fusion strategies such as simple concatenation often fail to capture complex cross-modal interactions. To address these limitations, this study proposes TriMFB, an attention-enhanced Multimodal Factorized Bilinear (MFB)-based early fusion framework for fine-grained multimodal fake news detection. Unlike other frameworks, the proposed TriMFB simultaneously integrates modality-specific features, attention-refined features, and MFB-based cross-modal interactions within a unified tri-feature early fusion architecture. The proposed model extracts textual and visual representations using Bidirectional Encoder Representations from Transformers (BERT) and a 50-layer Residual Network (ResNet50), respectively. Modality-specific features are refined through attention mechanisms and integrated using MFB pooling to capture cross-modal interactions. Experiments conducted on the Fakeddit dataset demonstrate that the proposed framework outperforms baseline bilinear fusion models, achieving a classification accuracy of 0.78 in a six-class setting. Although the overall accuracy remains comparable, the proposed tri-feature fusion strategy substantially improves the detection of challenging minority classes, increasing the F1-score for the Manipulated class from 0.21 to 0.29. These findings suggest that this fusion strategy offers a practical route to more reliable detection of subtly manipulated content, a minority class that is both harder to detect and disproportionately harmful when missed by content moderation systems.

Read PDF

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.