BAT-CLIP: Trimodal Alignment of Brain, Audio and Text
BAT-CLIP is proposed, the first CLIP-style trimodal alignment framework for iEEG that jointly aligns neural embeddings to both pretrained audio and text anchors in a shared, frozen audio-text manifold and yields more robust representations than bimodal CLIP baselines.
Su-hyun Kim, Jin-Mo Han, Danny Dongyeop Han et al.
· 0 citations