Skip to content
Open access

Lightweight Multimodal Frameworks for Fake News Detection Using Cross-Modal Consistency Modeling and Parameter-Efficient Attention

Oct 2026 · Applied Sciences · 0 citations · 54 references

TL;DR

This paper proposes two lightweight, high-performance multimodal frameworks for fake news detection: Cross-Modal Consistency Modeling (CMCM) and Parameter-Efficient Cross-Modal Attention (PE-CMA).

Abstract

The rapid proliferation of fake news poses significant societal and psychological risks, driving an urgent need for automated detection systems. While conventional unimodal methods fail to capture complex cross-modal relationships, existing multimodal frameworks are often computationally prohibitive for real-world deployment. To address this limitation, this paper proposes two lightweight, high-performance multimodal frameworks for fake news detection: Cross-Modal Consistency Modeling (CMCM) and Parameter-Efficient Cross-Modal Attention (PE-CMA). The CMCM architecture utilizes a similarity branch to explicitly model semantic alignment and misalignment between text–image pairs, effectively identifying mismatched content characteristic of fake news. Conversely, the PE-CMA architecture introduces a lightweight cross-modal attention mechanism combined with a learned token pooling technique. This compresses token representations into a highly informative subset prior to attention application, significantly lowering computational complexity while preserving cross-modal interactions. Both frameworks leverage MobileNetV3-Large and TinyBERT as highly efficient image and text encoders, respectively. Extensive evaluations on the Fakeddit and Weibo datasets demonstrate the superiority of the proposed methods. On Fakeddit, CMCM and PE-CMA achieve classification accuracies of 92.29% and 91.17%, respectively. On Weibo, PE-CMA and CMCM deliver accuracies of 91.81% and 91.06%, respectively. Ultimately, these architectures outperform several state-of-the-art baselines, offering an optimized balance between classification accuracy and computational efficiency.

Read PDF

Similar papers

Open access Oct 2026

MLCL: LVLM-guided multi-level contrastive learning for fake news detection

This paper proposes a novel LVLM-Guided multi-level contrastive learning network (MLCL), and introduces a multi-level alignment strategy: inside each modality, a normalized InfoNCE loss aligns features from the two encoders to reduce redundancy.

Jun Li, Ling-Hao Yan, Qing-Xu Liu et al. · 0 citations
Open access Oct 2026

Gated bidirectional cross-modal attention framework with domain generalization for multimodal fake news detection

The rapid proliferation of multimodal misinformation on social media necessitates systems that identify fake news across domains. Existing studies rely on simple concatenation-based fusion, exhibiting poor generalization across heterogeneous platforms with varied content patterns and visual semantics. To address this,...

Sapana Yakkundi, Rudragoud Patil, Aijazahamed Qazi et al. · 0 citations
Book Open access Nov 2026

Uni-Detector: Towards Universal Multimodal Fake News Detection

The rapid rise of social media platforms has significantly increased information accessibility while also facilitating the widespread dissemination of fake news, causing profoundly negative impacts on individuals and society. Current fake news detection methods are typically tailored for specific modality combinations...

Li-Yuan Zhang, Yong Liu, Wei Zhang et al. · 0 citations
Open access Sep 2026

Synergistic Lightweight Bilinear Pooling Fusion for Fake News Detection

To improve cross-modal interaction modeling while controlling the complexity of multimodal fusion, this paper proposes a multimodal fake news detection framework that integrates textual and visual information through cross-modal attention and a lightweight bilinear pooling module at the fusion stage, while retaining BE...

Jun Li, Jun Li, Ling-Hao Yan et al. · 0 citations
Conference Open access Sep 2026

Domain-Aware LoRA for Multimodal Fake News Detection

Fake news detection is a critical artificial intelligence task. Early methods rely on unimodal information, while recent research favors multimodal and multi-domain learning for robust detection. Despite the progress, existing methods have three prominent limitations in multi-domain scenarios: insufficient domain-speci...

Jia-Yi Hu, Yong Yao · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.