Skip to content
Preprint

Adaptive Cortically Constrained EEG-Vision Alignment for Zero-Shot Brain-to-Image Retrieval

Sep 2026 · 0 citations · 30 references
Computer Science

TL;DR

The proposed adaptive cortically constrained EEG-vision alignment method reconstructs EEG responses into predefined ROI-level source-pattern representations and encodes them with a Neuro-ROI Attention Encoder and achieves strong 200-shot retrieval performance.

Abstract

Zero-shot brain-to-image retrieval requires robust alignment between noisy EEG responses and visual representations. Existing EEG-vision alignment methods often operate in sensor space and apply fixed visual supervision to all responses, ignoring both spatial mixing in scalp EEG and response-wise variability in alignment reliability. We propose an adaptive cortically constrained EEG-vision alignment method for zero-shot brain-to-image retrieval. The method reconstructs EEG responses into predefined ROI-level source-pattern representations and encodes them with a Neuro-ROI Attention Encoder. To handle response-wise variability, we introduce an evidence-based adaptive visual supervision strategy that weights detail-controlled visual targets using model-based alignment evidence. On THINGS-EEG, the proposed method achieves strong 200-way zero-shot retrieval performance, with ROI-level attribution providing post hoc interpretability of the learned source-pattern representations. These results show that cortically constrained representation learning and adaptive supervision can jointly support EEG-vision alignment for zero-shot brain-to-image retrieval.

View source

Similar papers

#artificial intelligence Preprint Sep 2026

ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding

Proposed Progressive Contrastive Alignment (ProCA), a unified and model-agnostic framework for adaptive neural-semantic alignment that progressively refines class-level contrastive supervision from frozen vision-language priors to EEG-aware semantic relations, and introduces structure-consistent interpolation to constr...

Kang-Lei Zhou, Chun-Yan Lan, Dong-Yang Li et al. · 0 citations
Preprint Aug 2026

SCORE: Subject Coordinate Recovery for Label-Free Cross-Subject EEG-to-Image Retrieval

This work proposes Subject Coordinate Recovery (SCORE), a target label-free framework combining recovery-aware source training with coordinate alignment at deployment that brings brain-based visual decoding closer to robust, practical, low-latency deployment across users.

Zhenyao Cui, Siyuan Kan, Siyang Li et al. · 1 citation
Sep 2026

Structured Visual Target Learning For Cross-Subject eeg-to-image retrieval

This work proposes a training-free representation refinement that aligns frozen embeddings without updating either encoder, which preserves the spatial information of the Perception Encoder, converts its patch grid into a compact set of learned visual views, and aggregates them for each image with a block-structured, c...

Salini Yadav, Taveena Lotey, Mickael Coustaty et al. · 0 citations
Sep 2026

The Visual Target Matters: Learning across the Visual Hierarchy for Brain-to-Image Retrieval

NeuroGlyph, which learns a trial-independent visual target from multiple depths of a frozen visual backbone, achieves the strongest system-level performance in six of eight reported metrics, and support learning retrieval targets across the visual hierarchy rather than prescribing one visual depth.

Ye Wang, Hao-Kun Ren, Hong Yu et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.