Skip to content
Review Open access

Interpretable machine learning for identifying mild cognitive impairment among Chinese patients with obstructive sleep apnea: a multicenter cross-sectional study

Oct 2026 · BMC Psychiatry · Vol 26 · 0 citations · 48 references
Medicine

TL;DR

The RF model discriminated strongly in Shenzhen, but external miscalibration and systematic probability overestimation mean that high AUC does not make raw probabilities transportable; local calibration assessment and, if needed, recalibration are required before clinical use.

Abstract

Mild cognitive impairment (MCI) is clinically relevant in obstructive sleep apnea (OSA). We developed and externally validated an interpretable machine-learning model for concurrent clinically defined MCI to support prioritization for formal cognitive assessment rather than diagnosis. This multicenter cross-sectional diagnostic-prediction study included 400 eligible patients with OSA from Changchun, divided into a training set (n = 280) and an internal algorithm-selection hold-out (n = 120), plus an independent Shenzhen external-validation sample (n = 192). MCI classification integrated reported cognitive decline, objective cognitive evidence, largely preserved everyday independence, dementia exclusion, and assessment-team consensus with physician participation. Of 27 candidate predictors, redundancy review left 24 and LASSO-Boruta consensus retained nine. Feature selection was performed once on the full training set before repeated cross-validation and was not nested within resampling folds. Eight algorithms were tuned using repeated 10-fold cross-validation with training-fold-only SMOTE and PR-AUC as the primary metric. The RF threshold (0.3228) was derived from training out-of-fold probabilities and locked before validation. MCI was classified in 93/280 (33.2%), 38/120 (31.7%), and 57/192 (29.7%) participants. The nine RF predictors were coffee consumption, physical activity, AHI, MSaO2, PHQ-9, GAD-7, ESS, CPSS-14, and PSQI total scores. In the internal hold-out used for algorithm selection, RF achieved ROC-AUC 0.953, PR-AUC 0.936, and Brier score 0.060; these selection-conditioned estimates are not unbiased generalization estimates. In independent external validation, ROC-AUC was 0.957, PR-AUC 0.809, and Brier score 0.051. Calibration intercept − 0.616 and slope 0.701 indicated systematic probability overestimation despite strong discrimination. The RF model discriminated strongly in Shenzhen, but external miscalibration and systematic probability overestimation mean that high AUC does not make raw probabilities transportable; local calibration assessment and, if needed, recalibration are required before clinical use. The MCI outcome cannot be reproduced from questionnaire/scale scores alone, and Supplementary Table S10 is a retrospective operational specification rather than the original CRF. Performance evidence comes almost entirely from male OSA patients; validity in women is unestablished, and the model should not be used for clinical assessment in females. It is a research screening-prioritization tool, not a diagnostic, causal, prognostic, or clinical-impact instrument.

Read PDF

Similar papers

Open access Sep 2026

An Interpretable Multimodal Machine-Learning Model for Predicting Cognitive Impairment from Routine MRI: A Study with External Validation

Existing MRI-based prediction models for cognitive impairment often rely on a single biomarker or simply compare algorithms, act as black boxes, and lack external validation, which limits their clinical translation. We developed and externally validated an interpretable multimodal machine-learning model that classifies...

Xiu-Pan Chen, Bao-Wen Zhang, Meng-Die Li et al. · 0 citations
Open access Oct 2026

Identifying Mild Cognitive Impairment from Routinely Collected Physical, Functional and Psychosocial Measures in Community-Dwelling Older Adults: A Comparative Machine-Learning and Regression Modelling Study in the Northern Japanese ORANGE Registry

Routine non-cognitive data support moderate, well-calibrated MCI discrimination, but machine learning added little over regression, but this is an exploratory triage aid requiring external validation.

Ayuto Kodama, Takako Ohnuma, Kana Sasaki et al. · 0 citations
Open access Nov 2026

Machine Learning Improves Questionnaire-Based Sleep Apnea Screening: A Multi-Cohort Multi-Visit Validation Study.

Obstructive sleep apnea (OSA) affects a large portion of the global population but remains substantially underdiagnosed due to limited access to polysomnography. While machine learning has shown promise for scalable OSA screening, many recent models rely on overnight physiological monitoring and are not validated acros...

N. Hoang, Zi-Lu Liang · 0 citations
Review Open access Oct 2026

Explainable machine learning for identifying mild cognitive impairment in older adults with chronic diseases: Model development and temporal validation.

OBJECTIVE This study aimed to develop and validate an interpretable machine-learning classification model for identifying MCI at the time of assessment among older adults with chronic conditions. We also evaluated model performance and the stability of TreeSHAP-based feature explanations across survey waves. METHODS...

Kun Ruan, Yuan Li · 0 citations
Open access Oct 2026

A Feasible Machine Learning Approach to Improve Cognitive Screening in Multiple Sclerosis

Background: Cognitive impairment is a frequent manifestation of multiple sclerosis (MS). Although the Brief International Cognitive Assessment for Multiple Sclerosis (BICAMS) is the recommended screening battery, the Montreal Cognitive Assessment (MoCA) is more commonly used in routine clinical practice. The ability of...

Michelangelo Dini, Letizia Turchi, Giulia Gamberini et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.