This work highlights the need to audit feature transferability and report worst-case domain robustness in cognitive speech screening by proposing a fusion method that integrates XLM-R text baseline scores with evidence anchors selected during training.
Abstract
Speech-based screening is a promising, non-invasive approach for detecting Alzheimer's disease and related cognitive risks. However, models trained on a single domain often generalize poorly to unseen languages, tasks, or recording protocols. This paper investigates this deployment gap using a leave-one-corpus-out evaluation across four distinct datasets. Among 70 interpretable speech and language features, 59 exhibit direction conflicts between healthy control and cognitive risk groups across corpora, with pause, silence, and speech rate showing high protocol sensitivity. Furthermore, while the XLM-R text baseline achieves strong average performance, its Area Under the ROC Curve (AUC) drops to 0.520 on the weakest held-out domain. A standard GroupDRO baseline reaches a 0.766 mean speaker AUC and a 0.504 worst-domain AUC under the same protocol. To address this, we propose a fusion method that integrates XLM-R text baseline scores with evidence anchors selected during training. Balanced fusion achieves a 0.785 mean speaker AUC, while anchor-heavy fusion raises the worst-case speaker AUC to 0.615. This work highlights the need to audit feature transferability and report worst-case domain robustness in cognitive speech screening.
A layer-wise analysis of nine SSL speech backbones using a low-capacity logistic regression probe reveals that the transferred discriminative signal lacks pathological specificity, highlighting critical limitations that must be addressed before speech-based pathology recognition models can be reliably deployed in clini...
Serli Kopar, Sam Gijsen, Abner Hernandez et al.· 0 citations
This study provides a scalable, objective, and explainable framework for speech-based cognitive screening, combining cognitive status classification with natural language explanations that clinicians can assess and verify, bridging the gap between advanced AI and clinical utility.
Zi-Yun Cui, Wen Wu, Chuan Shi et al.· arXiv.org· 0 citations
Background: Alzheimer's disease (AD) affects over 55 million people worldwide, and early detection through speech analysis offers a low-cost, non-invasive alternative to neuroimaging. However, clinical deployment of speech-based classifiers faces underexplored challenges: domain shifts across recording environments, li...
A. Singh· NSRI Student Research Journa...· 0 citations
The role of speech preprocessing and dataset curation across widely used benchmarks for speech-based AD detection is revisited, suggesting that ``cleaner''speech datasets are not necessarily more reliable for real-world AD detection.
Lu Sun, Shreeram Suresh Chandra, Lin Zhang et al.· 0 citations
A cross-modal behavioral marker is tested under frozen pretrained models across gaze, text, and audio that separates semantic engagement from production mechanics without training on dementia data at any stage, and the implication for multimodal interaction systems is direct: adapt to semantic engagement, not productio...
Leticia Pinto-Alva, Gale M. Lucas, Maja J. Matarić et al.· Proceedings of the 28th Inte...· 0 citations
This work evaluates pre-trained embeddings from four state-of-the-art open-source SFMs across three datasets in zero-shot and k-shot cross-lingual settings for multi-class PD severity assessment and shows that pre-trained speech embeddings enable meaningful cross-lingual transfer, although performance is sensitive to d...
Simon Pals, Cristian Tejedor-García· arXiv.org· 0 citations
By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.