It is demonstrated that task-agnostic representation learning can capture physiologically meaningful multimodal neural representations that remain transferable across individuals, offering a promising foundation for more robust and reusable BCI pipelines.
Abstract
Combining complementary neurophysiological modalities offers a promising strategy for improving motor imagery (MI) brain-computer interfaces (BCIs), but learning shared representations across modalities remains largely unexplored. Here, we propose a two-phase deep learning framework for multimodal EEG–MEG decoding that explicitly decouples representation learning from downstream classification. In the first phase, a convolutional encoder-decoder learns a shared latent representation by predicting the power spectral density (PSD) of EEG and MEG signals directly from time-domain activity, rather than using the conventional objective of reconstructing the input signal. In the second phase, the encoder is frozen and its learned representations are reused, without further adaptation, to perform the classification of the downstream MI-BCI task. The framework was evaluated on simultaneous EEG and MEG recordings from 20 participants. The learned representations consistently outperformed conventional handcrafted spectral features, increasing median classification accuracy from 0.734 to 0.794. The multimodal framework also improved performance over MEG alone (median accuracy from 0.680 to 0.794) and yielded a modest increase over EEG alone (median accuracy from 0.765 to 0.794), providing a more robust decoding strategy than single-modality approaches. Furthermore, the learned latent representations were transferable across participants, with more than half of cross-subject models performing within 0.01 accuracy of their subject-specific counterparts. These findings demonstrate that task-agnostic representation learning can capture physiologically meaningful multimodal neural representations that remain transferable across individuals, offering a promising foundation for more robust and reusable BCI pipelines.
A dynamic re-initialization framework for EEG–fNIRS multimodal decoding achieves cross-modal balanced learning through a diagnosis–adjustment–re-initialization mechanism, which achieves cross-modal balanced learning through a diagnosis–adjustment–re-initialization mechanism.
Jia-Ru Dai, Li Zhu, Fabio Babiloni et al.· Cognitive Neurodynamics· 0 citations
The integration of structured frequency-domain priors and attention mechanisms improves the fidelity of generated EEG samples, which in turn enhances downstream classification performance.
A comprehensive taxonomy of MI EEG cross-variability decoding studies from 2020 to 2025 is presented, systematically organizing advances in deep learning and transfer learning and critically evaluate core algorithmic approaches, including Convolutional Neural Networks, transformers, feature alignment, domain adaptation...
Li-Jun Wang, Yue-Ying Zhou, Peng-Pai Wang et al.· Frontiers in Neuroscience· 0 citations
Identification of Motor Imagery (MI) tasks from electroencephalography (EEG) signals plays an important role in brain–computer interfaces (BCIs), especially in the development of non-invasive assistive technologies for individuals with motor impairments. Despite recent advancements, many existing MI decoding methods an...
Angkon Deb, Celia Shahnaz, S. Fattah et al.· IEEE Access· 0 citations
Objective Deep learning classification methods are increasingly popular in the brain-computer interface (BCI) field due to their ability to learn complex, non-linear representations from EEG data. Unlike traditional machine learning approaches, which typically rely on hand-crafted features, deep learning models autonom...
David Trocellier, Simon Kojima, B. N'Kaoua et al.· Frontiers in Neuroergonomics· 0 citations
The experimental results demonstrated that the MTANet model, empowered by the EEG inception attention and parallel temporal sequence attention modules, effectively improved the accuracy and stability of MI decoding.
Yun-Feng Qin, Li Zhang, Yu Liu et al.· Behavioural Brain Research· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.