Skip to content
Open access

Inner speech decoding from EEG

TL;DR

This thesis compares three standard architectures a compact convolutional network (EEGNet), an LSTM recurrent network, and a self-attention Transformer against a hybrid model that feeds a shared convolutional front end into parallel recurrent and self-attention branches and fuses them before classification.

Abstract

Inner speech the silent production of words in the mind, without any movement or sound is an appealing control signal for a brain computer interface (BCI), because the command is the thought. For someone who has lost the ability to speak or move, a decoder that reads intended words directly would be far more natural than the indirect mental tasks most BCIs rely on. Reading inner speech from scalp electroencephalography (EEG) is, however, extremely hard: the signals are weak and non-stationary, the neural traces of covert language are faint, and reported four-class accuracies in the literature rarely climb much past the low thirties. In this regime the meaningful question is not whether a model reaches high accuracy none reliably do - but whether a design choice yields a real, statistically reliable signal, assessed honestly. This thesis compares three standard architectures a compact convolutional network (EEGNet), an LSTM recurrent network, and a self-attention Transformer against a hybrid model that feeds a shared convolutional front end into parallel recurrent and self-attention branches and fuses them before classification. All four are evaluated identically on the public Thinking Out Loud inner speech dataset (Nieto et al., 2022), under subject-dependent five-fold cross-validation on the four-class directional-word task (Up, Down, Right, Left), with on-the-fly augmentation and a fixed seed. The unit of statistical analysis is the subject (n = 10). The hybrid model attains the highest mean accuracy, 28.8% (SD 3.0%), and is the only model whose accuracy is statistically significantly above the 25% chance level (Wilcoxon signed-rank p = 0.010; one-sample t-test p = 0.003), a result that survives Bonferroni correction across the four model-versus-chance tests. The three baselines do not reach significance against chance. In direct paired comparisons, however, the hybrid does not significantly outperform any individual baseline (versus EEGNet p = 0.064; versus the Transformer p = 0.084; versus the LSTM p = 0.125), and an ablation shows that each single branch performs at roughly the level of its corresponding baseline (≈ 0.26), with the two branch fusion adding a small, non-significant improvement. With ten subjects, the study can resolve only differences of about four percentage points or larger, so these null results are inconclusive rather than evidence of equivalence. The protocol was executed twice on identical hardware: the baselines reproduced exactly, while the hybrid’s mean shifted by two tenths of a percentage point enough to move its comparison against EEGNet from p = 0.014 to p = 0.064. The above-chance result held in both executions; the paired comparisons did not, and are reported here as unstable at this sample size. Only EEGNet was evaluated under a subject-independent split, where it scored 25.6-26.7%; because that baseline does not exceed chance under subject-dependent evaluation either, these experiments do not measure the size of the cross-subject gap, which is cited here from the literature rather than demonstrated. The accuracies reported here fall within the range of prior decoding studies on this dataset, which spans roughly 26-36%. The contribution of this thesis is therefore a controlled, like-for-like benchmark of four architectures under one protocol, with rigorous statistical assessment, rather than a new state of the art.

Read PDF

Similar papers

Preprint Aug 2026

Decoding silent reading from non-invasive EEG

Non-invasive decoding of inner speech faces a fundamental data problem: a corpus pairing brain activity with a person's spontaneous inner monologue cannot be collected, and the available proxy paradigms (cued repetitive and retrospectively reported generative inner speech) are slow to acquire, poorly time-locked, and s...

I. Marquardt, A. Alchanat, Priyanka Jain · 0 citations
Open access Aug 2026

Interpretable Brain-computer Interface for Emotion-aware Thought-to-speech using Eeg Signal Decoding

This study contributes to the advancement of trustworthy, next-generation brain–computer interfaces and provides a practical basis for assistive communication tools serving individuals with paralysis, amyotrophic lateral sclerosis, locked-in syndrome, and other conditions that disrupt natural speech.

Abhimanyu Singh, Edith Paulin S · 0 citations

From Neurons to Conversation: Speech Brain-Computer Interfaces

By reframing speech BCIs as adaptive, user-centred systems, this work outlines the interdisciplinary priorities spanning speech neuroscience, neural engineering, machine learning, clinical practice, and neuroethics needed to move from proof-of-concept decoding toward reliable, expressive, and controllable communication...

Moein Khajehnejad, Forough Habibollahi, T. Boccato et al. · 0 citations
#machine learning Preprint Sep 2026

A Common Measure of Communication for Speech Brain-Computer Interfaces

Deriving open-vocabulary mutual information (OVMI), an information-theoretic quantity that measures the information conveyed by a decoder relative to a reference distribution over the words a user may wish to communicate, provides the speech BCI community with a principled way to compare heterogeneous systems, improve...

D. Jayalath, Benjamin Ballyk, Oiwi Parker Jones · 3 citations
Preprint Sep 2026

Brain2Speech-Net: Intelligible, Real-Time Brain-to-Speech Synthesis Without Text Decoding

Brain2Speech-Net is presented, among the first single-stage frameworks to remain intelligible under limited data while removing intermediate text decoding, and achieves strong intelligibility in objective and listening tests while running faster than real time.

Shreeram Suresh Chandra, Ze-Xin Cai, Yu Tsao et al. · 0 citations

Decoding Imagined Speech: A Strictly Subject-Independent Approach Using EEG

This study presents a transparent baseline investigation of a multi-class imagined speech EEG dataset under a strictly subject-independent evaluation framework, providing a strong basis for future brain-computer interface studies targeting improved cross-subject generalization in EEG-based imagined speech decoding.

Frederik Møllskov Trier, Xiao-Peng Mao, S. Puthusserypady · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.