Skip to content

SYNAPSE: Neuro-Symbolic Visual Thought-to-Text Decoding via Topological Semantic Denoising

May 2026 · arXiv.org · Vol abs/2605.27790 · 0 citations · 24 references
Computer Science

TL;DR

SYNAPSE (Symbolic Neural Alignment for Precise Semantic Extraction for Precise Semantic Extraction) is introduced, a lightweight neuro-symbolic framework that stabilizes neural text generation through inference-time symbolic regularization.

Abstract

Recent advances in large language models have accelerated open-vocabulary EEG-to-imagined-text decoding, where non-invasive neural activity recorded during visual perception is translated into coherent natural language descriptions of viewed stimuli. However, existing systems remain highly vulnerable to biological noise, where corrupted neural projections induce hallucinated or semantically unstable generation in frozen language models. We introduce SYNAPSE (Symbolic Neural Alignment for Precise Semantic Extraction), a lightweight neuro-symbolic framework that stabilizes neural text generation through inference-time symbolic regularization. By purifying EEG-derived semantic candidates using commonsense graph structure and latent exemplars, SYNAPSE improves semantic stability without end-to-end LLM fine-tuning. Experiments across popular EEG decoding benchmarks and multiple frozen LLM backends demonstrate consistent gains over unconstrained prompting baselines, robustness under object-label ablation, and performance commensurate with substantially more resource-intensive fine-tuned systems, while preserving biometric privacy by localizing raw EEG processing entirely within the encoder stack.

View source

Similar papers

#machine learning Preprint Sep 2026

The Semantic Bottleneck: Leveraging Semantic Representations for Non-Invasive Speech Decoding

This work introduces Brain2Semantics2Text, a method that reconstructs text through an intermediate semantic embedding space and describes the core principles of the approach, its implementation, and the strategies used to mitigate the challenges of learning a reliable neural-to-semantic mapping.

Gilad Landau, D. Jayalath, Oiwi Parker Jones · 1 citation
Preprint Sep 2026

HDND: Hierarchical Dynamic Neural Decoding for Multilingual Word/Character Retrieval from Non-Invasive Brain Recordings

While deep learning has enabled language decoding from intracranial brain recordings, extending this capability to non-invasive recordings remains an unresolved challenge. Decoding individual words from non-invasive brain recordings is particularly difficult, as word-level neural evidence is weak, temporally distribute...

Yue-Yang Li, Shu-Ran Chen, W. Siok et al. · 1 citation
Preprint Sep 2026

SENSE: Semantic Neural Speech Synthesis from Brain Dynamics via Spatial Graph Encoding

Reconstructing speech from non-invasive brain signals offers a promising pathway for restoring communication in individuals who are cognitively intact but unable to speak. Existing EEG-to-speech approaches formulate this task as acoustic reconstruction, optimizing waveform fidelity while ignoring whether the generated...

Jisoo Park, Seonghak Lee, Hyojin Park et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

Proposed Progressive Contrastive Alignment (ProCA), a unified and model-agnostic framework for adaptive neural-semantic alignment that progressively refines class-level contrastive supervision from frozen vision-language priors to EEG-aware semantic relations, and introduces structure-consistent interpolation to constr...

Kang-Lei Zhou, Chun-Yan Lan, Dong-Yang Li et al. · 0 citations
#machine learning Preprint Aug 2026

Margin-Regularized Structured Semantic Alignment for Brain-Language Correspondence

This work proposes a margin-regularized structured semantic alignment framework that directly aligns brain embeddings with text embeddings in a shared semantic space, enabling retrieval-based decoding and enables explicit modeling of the correspondence between neural representations and language semantics.

Jia-Qi Wang, Hua-Wen Hu, Shu Zhang · 1 citation
#artificial intelligence Preprint Oct 2026

Teaching neural decoders with language

Brain-computer interfaces decode neural activity, yet class-label supervision (CLS) leaves relationships among classes implicit. We propose Language as Supervision (LaS), which aligns neural features with natural-language class descriptions through learned projections and predicts classes using candidate text prototype...

Xuan-Zhi Wen, Yong-Hao Song, Yu-Hong Zhang et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.