Neural State Prediction (NSP), a latent-predictive framework that constrains both the prediction target and the available context, is introduced and jointly designing latent targets and their context offers a promising direction for EEG foundation models that learn from distributed signal structure.
Abstract
EEG foundation models increasingly use masked prediction to learn from unlabeled recordings, but optimizing this objective does not ensure transferable neural representations. A central challenge is that stable positional cues and local correlations can make masked regions predictable without integrating distributed neural context. To reduce this reliance on low-information prediction paths, we introduce Neural State Prediction (NSP), a latent-predictive framework that constrains both the prediction target and the available context. NSP uses a Target Encoder updated by an exponential moving average (EMA) to define latent supervision. Identity residualization removes additive effects associated with channel identity and relative time from the targets, while topology-separated context excludes their immediate spatial and temporal neighborhood from the visible input. We pretrain NSP on 2.2 million EEG segments from TUEG and evaluate it across 30 downstream datasets spanning clinical diagnosis, sleep staging, emotion recognition, motor imagery, event-related potentials, cognitive-state decoding, and language retrieval. Under full-parameter multi-task fine-tuning on EEG-FM-Bench, NSP achieves 63.94 macro balanced accuracy across 14 datasets, exceeding the strongest evaluated baseline by 2.35 percentage points. Controlled component ablations assess the contribution of each mechanism, while matched context controls and held-out interventions characterize the role of context geometry, signal content, and positional information. Jointly designing latent targets and their context offers a promising direction for EEG foundation models that learn from distributed signal structure.
NeuroLens (Latent Embeddings of Neural Semantics), a self-supervised model based on the Joint-Embedding Predictive Architecture (JEPA) framework that learns denoised, semantically informative latents from chronic neural recordings, is introduced as a new paradigm for studying how neural representations change during le...
Hanrui Lyu, Bai-Yuan Chen, Tian Tan et al.· 0 citations
Electroencephalography (EEG) provides a non-invasive measure of ongoing neural activity, but building general-purpose EEG models remains challenging due to the heterogeneity of subjects, devices, and electrode montages. Existing EEG foundation models predominantly rely on reconstruction-based objectives defined on the...
Minsu Kim, Ye-Sung Kim, Hye-seon Jeon et al.· 0 citations
Pretrained EEG backbones improve transfer performance, but downstream diagnosis heads remain hard to audit: predictions are made from unrestricted hidden states, whereas explanations are usually produced only after the decision. We introduce tPoE-EIB, an evidence-information bottleneck head for adapting EEG backbones u...
Yinghao Wang, Shu-Jian Yu, Duc Han Le et al.· 0 citations
This study proposes the squeeze-and-excitation (SE)-data-adaptive Gaussian average filtering (DAGAF) adaptive tokenizer (SEDAT), a hybrid framework integrating SE-based spatial aggregation, DAGAF-based signal decomposition, instantaneous-frequency-guided adaptive segmentation, and Fourier-domain resampling into a singl...
Muhammad Zulkifal Aziz, Yue Zhuo, Bin-Wen Huang et al.· Journal of Neural Engineerin...· 0 citations
Neuroscientific learning theories propose that the brain acquires knowledge by constructing internal world models. Supervised learning, the dominant approach in deep neural networks (DNN), relies on external category labels, making it difficult to reconcile with biological learning. There is an increasing trend towards...
Dirk Gütlin, Denise Kittelmann, Ryszard Auksztulewicz· bioRxiv· 0 citations