Oct 2026· Biomedicines· Vol 14· 0 citations· 48 references
Medicine
Abstract
Background: Cognitive impairment is a frequent manifestation of multiple sclerosis (MS). Although the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) is the recommended screening battery, the Montreal Cognitive Assessment (MoCA) is more commonly used in routine clinical practice. The ability of published MoCA cutoffs to detect MS-specific cognitive impairment remains unclear. Objective: This study aimed to evaluate the diagnostic performance of published Italian MoCA cutoffs for MS-specific cognitive impairment and develop a machine learning (ML) pipeline to improve screening accuracy. Methods: We prospectively enrolled 222 people with MS who underwent both MoCA and BICAMS assessment. Cognitive impairment was defined as performance below the 5th percentile on at least one BICAMS test. The sensitivity, specificity, and balanced accuracy of four published Italian MoCA cutoffs were calculated. An elastic-net penalized logistic regression model incorporating age, education, and raw MoCA score was trained using nested five-fold cross-validation to predict cognitive impairment. We additionally evaluated the impact of disability and fatigue on cognitive impairment and model performance. Results: Cognitive impairment was identified in 62 (27.9%) participants. Raw MoCA scores were significantly lower in cognitively impaired participants than in cognitively preserved participants (22.68 ± 4.29 vs. 25.77 ± 3.67; p < 0.0001). Published MoCA cutoffs, however, showed extreme specificity (0.92–0.99) but below-chance sensitivity (0.10–0.44), yielding low balanced accuracy (0.54–0.68). The ML model achieved good discrimination (ROC-AUC = 0.787, 95% CI 0.717–0.852), with sensitivity = 0.69, specificity = 0.72, and balanced accuracy = 0.71. Conclusions: Published Italian MoCA cutoffs have insufficient sensitivity for screening MS-specific cognitive impairment. An ML-based scoring approach substantially improves sensitivity while maintaining acceptable specificity, offering a practical tool to enhance cognitive screening in MS.
The findings support the potential role of structural MRI biomarkers combined with interpretable ML approaches for the classification of cognitive impairment and the integration of demographic variables improved model performance, particularly in binary discrimination tasks, whereas multiclass classification remained m...
Alessia Venuto, A. Faraci, Alessandro Grimaldi et al.· Epidemiology Biostatistics a...· 0 citations
Existing MRI-based prediction models for cognitive impairment often rely on a single biomarker or simply compare algorithms, act as black boxes, and lack external validation, which limits their clinical translation. We developed and externally validated an interpretable multimodal machine-learning model that classifies...
Xiu-Pan Chen, Bao-Wen Zhang, Meng-Die Li et al.· Bioengineering· 0 citations
This study aims to develop a cognitive impairment screening model based on the Clinical Dementia Rating (CDR) using the XGBoost and SHapley Additive exPlanations (SHAP) framework, with the goal of improving predictive performance while enhancing clinical interpretability. The Open Access Series of Imaging Studies (OASI...
Jing-Yang Sun, Chen-Xi Huang, Quan Lan et al.· Journal of Mechanics in Medi...· 0 citations
Dementia and its earlier stages mild cognitive impairment (MCI) and subjective cognitive decline (SCD) are increasingly common, yet automated tools that distinguish all four cognitive states simultaneously remain rare. Most published models address a simpler binary problem; the four-class case, which is what clinicians...
Mohamed Sherif N. Abd Rabou, Heba M. Tawfik, N. A. Ismail et al.· Scientific Reports· 0 citations
It is demonstrated that the ACE-R is the most accurate screening tool for detecting mild vascular cognitive impairment, with the MoCA trailing by a very small margin, while the MMSE may be less sensitive in the early stages.
The RF model discriminated strongly in Shenzhen, but external miscalibration and systematic probability overestimation mean that high AUC does not make raw probabilities transportable; local calibration assessment and, if needed, recalibration are required before clinical use.
En-Guang Li, Fang-Zhu Ai, Pei-Pei Cai et al.· BMC Psychiatry· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.