Large language models (LLMs) with human-like performance on linguistic tasks have transformed the study of language in neurodiverse conditions. LLMs provide representations of linguistic input in the form of high-dimensional vectors (embeddings), and next-token predictions computed from these embeddings. Previous crosslinguistic evidence suggests a complexity reduction in the form of both lower intrinsic dimensionality (ID) of LLM representations and higher mean surprisal (prediction error) in psychosis. We hypothesized that these metrics reflect a general deficit of information compression in psychosis, linked to grammatical organization as what enables predictions in language.We operationalized surprisal difference as the difference between surprisal as estimated from word frequency and surprisal as based on a contextual LM, which is sensitive to grammatical organization over and above lexical concepts. Using a dataset of 144 Turkish speakers, including 106 patients with schizophrenia-spectrum disorders (SSD) - 56 with chronic schizophrenia (SZH), 33 with first-episode psychosis (FEP), and 17 with schizoaffective disorder (SZA) - and 38 healthy controls. We report: (1) Surprisal difference is attenuated in all clinical groups relative to controls, independently of word count; (2) Compressibility (intrinsic dimension) is reduced in SZH and FEP; (3) Syntactic complexity and compressibility both predict surprisal difference. These results, further refining an alteration in the geometry of the semantic space in psychosis as previously attested, suggest a broader deficit in information compression in this disorder, with a mechanistic underpinning in the operations of grammar.
The usefulness of automated speech and language markers to monitor or predict psychotic symptoms depends on their ability to detect changes in mental state. To date, research linking psychosis and Natural Language Processing (NLP) has been conducted almost exclusively using cross-sectional experimental designs, lim...
S. Just, Shrankhla Pandey, D. Stein et al.· Translational Psychiatry· 0 citations
This work analyzed brief story retellings from 86 patients with left-hemisphere stroke and derived discrete linguistic features and embeddings with Large Language Models, providing proof of concept for a fast, largely automated discourse screener of acute LI.
Monitoring cognitive impairment (CI) in motor neuron disease (MND) is essential for timely treatment and care, yet challenging due to co-occurring speech difficulties. The Edinburgh Cognitive and Behavioural ALS Screen (ECAS) provides a robust metric for CI assessment, with the Verbal Fluency Index (VFI) a central elem...
B. Mirheidari, Leslie Ing, Daniel Blackburn et al.· 0 citations
This work investigates the effectiveness of internal representations from encoder and decoder components of Speech LLMs for Parkinson's Disease detection across multilingual and cross-lingual settings and proposes a Squeeze-and-Excitation (SE)-based dynamic layer aggregation framework, which surpasses best-layer select...
Sarthak Giri, Z. Pang, Tatsuya Kawahara· arXiv.org· 0 citations