Skip to content
Open access

Bidirectional cross-modal attention with adaptive gating for multimodal Alzheimer’s disease classification

Aug 2026 · Biomedical engineering and physics express · Vol 12, pp. 045067 · 0 citations · 42 references
Physics Medicine

TL;DR

A multimodal deep learning classification framework integrating structural magnetic resonance imaging (sMRI) and clinical features and an adaptive gated fusion module that dynamically integrates concatenated global multimodal features with cross-modal interaction features is proposed.

Abstract

Alzheimer’s disease (AD) is a neurodegenerative disorder, and mild cognitive impairment (MCI) represents a transitional stage between AD and cognitively normal (CN) individuals. Early diagnosis is clinically important for delaying disease progression. To address the limitations of single-modal approaches and the insufficient modeling of complex cross-modal interactions in existing multimodal fusion methods, this paper proposes a multimodal deep learning (DL) classification framework integrating structural magnetic resonance imaging (sMRI) and clinical features. The framework employs a 3D ResNet-34 to extract imaging features and a multilayer perceptron to encode clinical data. A bidirectional cross-modal attention mechanism enhances associations between imaging and clinical modalities, followed by an adaptive gated fusion module that dynamically integrates concatenated global multimodal features with cross-modal interaction features. To evaluate the robustness of the proposed framework, all experiments were repeated using five different random seeds, and the results are reported as mean ± standard deviation. Experimental results demonstrate competitive performance across multiple classification tasks, achieving accuracies of 95.67% ± 1.70% for three-class classification (CN vs MCI vs AD) and 93.64% ± 2.36% for four-class classification (CN vs early MCI (EMCI) vs late MCI (LMCI) vs AD). For binary classification (AD vs CN, AD vs MCI, MCI vs CN, and EMCI vs LMCI), the method achieves accuracies of 96.83% ± 1.53%, 95.33% ± 1.00%, 95.83% ± 1.39%, and 93.61% ± 2.35%, respectively. The proposed framework provides an effective solution for multimodal DL-based computer-aided diagnosis of AD.

Read PDF

Similar papers

Sep 2026

NeuroFusion: A Multimodal Transformer Framework for Early and Explainable Detection of Alzheimer’s Disease

Alzheimer's disease (AD) is a progressive neurodegenerative disorder, and a great deal of pathological changes can be observed in the early stages of the disease before significant cognitive function is clinically evident. In this study, a multimodal Transformer framework named NeuroFusion for early and explainable det...

Mintu Debnath · 0 citations
Open access Sep 2026

Analyzing Deep Learning Approaches in Unimodal and Multimodal Frameworks for Alzheimer’s Disease Stage Classification

In this paper, we present a detailed study on deep learning approaches for the binary classification of Alzheimer’s disease stages using both unimodal and multimodal frameworks. Alzheimer’s disease is a progressive neurodegenerative brain disorder and the leading cause of dementia, characterized by cognitive decline, m...

Sraddha Sigdel, Stuti Khadka, Sujal Singh et al. · 0 citations
Aug 2026

Generative Brain Priors-Driven Self-Regulated and Clinically-Guided Multimodal Fusion for Early Alzheimer's Disease Diagnosis.

The proposed GBP-SCMF provides an effective and interpretable multimodal strategy for computer-aided AD diagnosis and integrates three complementary mechanisms: generative brain-prior enhancement to inject disease-related pathological knowledge into imaging representations, self-regulated multimodal alignment to reduce...

Yi-Bo Huang, Xiao-Long Guo, Zhiyi Li et al. · 0 citations
Sep 2026

A Multimodal Explainable Deep Learning Framework for Alzheimer's Disease Diagnosis using 3D Magnetic Resonance Imaging and Clinical Data

Dementia is a major and growing global health burden, with Alzheimer's disease (AD) accounting for most cases. Timely and accurate diagnosis is central to managing this burden and increasingly depends on integrating complementary clinical and imaging information. Multimodal deep learning can combine these modalities fo...

Yusuf Brima, M. Atemkeng, L. Namamula et al. · 0 citations
Sep 2026

A Deep Learning-Powered Framework for the Early Prediction of Alzheimer's Disease through Advanced Magnetic Resonance Imaging and Analysis.

An advanced DL-powered framework for the early prediction of AD using MRI data demonstrates high accuracy, robustness, and interpretability, supporting its potential for reliable early AD diagnosis in clinical settings.

K. V. S. V. Trinadh Reddy, Gundeboyina Srinivasalu, T. V. Rao et al. · 0 citations
Sep 2026

AD-Deep Fusion: A Deep Feature Fusion and Ensemble Learning Framework for Early Alzheimer’s Disease Diagnosis

Alzheimer's disease (AD) is a chronic neurodegenerative disease in which early diagnosis is crucial for early intervention and the appropriate management of patients. But the patho-octical changes in early stages, such as mild cognitive impairment (MCI), have been hard to detect with traditional diagnostic methods. Thi...

Tarun Kumar · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.