Skip to content
Review Open access

Predictive performance of machine learning models for bloodstream infection by validation type: A systematic review and meta-analysis.

Oct 2026 · International Journal of Medical Informatics · Vol 223, pp. 106740 · 0 citations · 62 references
Medicine

TL;DR

A systematic review and meta-analysis of ML-based BSI prediction models to quantify their discriminative performance and appraise the certainty of the evidence concluded that Rigorous external validation, calibration and decision-analytic reporting, and adherence to prediction-model reporting standards are needed before clinical implementation.

Abstract

Purpose

Bloodstream infection (BSI) is a life-threatening condition for which culture-based diagnosis is slow, motivating interest in machine learning (ML) models that predict BSI from routine clinical data. To date, this evidence has been summarized only narratively, without quantitative synthesis or formal appraisal of methodological quality. We performed a systematic review and meta-analysis of ML-based BSI prediction models to quantify their discriminative performance and appraise the certainty of the evidence.

Methods

We searched five databases for English-language studies published between 2013 and 2025. The area under the receiver operating characteristic curve (AUROC) was the primary discrimination measure and was pooled using random-effects models. Risk of bias was assessed with the Prediction model Risk Of Bias Assessment Tool (PROBAST), and certainty of evidence was assessed with GRADE.

Results

Twenty-six studies were included, of which 24 (28 estimates) contributed to the meta-analysis. The pooled AUROC was 0.82 (95 % confidence interval, 0.77-0.86), with extreme heterogeneity (I2 = 99.9 %) and a wide 95 % prediction interval (0.46-0.96). Discrimination declined as validation became more stringent, from internal validation (0.86) to external/temporal validation (0.77; P = 0.005), indicating a generalizability gradient, whereas performance did not differ significantly by clinical setting (P = 0.52) or target organism (P = 0.53). Most studies (96 %) were at high risk of bias in the PROBAST analysis domain, and the overall certainty of evidence was very low.

Conclusion

ML models showed promising discrimination for BSI prediction (pooled AUROC 0.82). However, the prediction interval was wide (0.46-0.96) and performance declined under external validation, indicating limited generalizability; moreover, the current evidence is of very low certainty. Rigorous external validation, calibration and decision-analytic reporting, and adherence to prediction-model reporting standards are needed before clinical implementation.

Read PDF

Similar papers

Review Sep 2026

Machine Learning for Mortality Prediction in Infective Endocarditis: A Systematic Review and Meta-Analysis.

Infective endocarditis (IE) continues to be an often fatal condition despite improvements in cardiac surgical procedures and antibiotic therapy, and conventional scoring tools show poor generalizability. Machine learning (ML) addresses these limitations by capturing complex, nonlinear clinical relationships, outperform...

Vatsalya Choudhary, Muskan Jain, F. Tamanna et al. · 0 citations
Review Open access Oct 2026

Towards precision medicine in valvular heart diseases: a systematic review of predictive multimodal machine learning models

While multimodal models offer notable performance advantages over unimodal approaches, their application in VHD remains limited and future research should prioritize the integration of heterogeneous data sources alongside rigorous external validation to ensure clinical generalizability and facilitate adoption in valvul...

V. Idakwo, C. Strote, C. Goelz et al. · 0 citations
Meta-analysis Open access Sep 2026

Systematic review and meta-analysis of risk prediction models for anti-tuberculosis drug-induced liver injury in East Asian populations

Objective This study systematically evaluates the construction methods, predictive factors, and performance of risk prediction models for anti-tuberculosis drug-induced liver injury (ATB-DILI). It aims to furnish evidence-based evidence for early detection of East Asian individuals at high risk of ATB-DILI and the deve...

Hong-Jiao Li, Xin-Yi Feng, Xi Zheng et al. · 0 citations
Review Open access Sep 2026

Machine Learning Models for Predicting Unplanned Readmission and Mortality in the ICU: A Systematic Review and Meta-Analysis

Objective: To determine how predictive performance varies across artificial intelligence model architectures for predicting unplanned readmission and mortality in the intensive care unit (ICU), evaluated either as separate or composite outcomes. Methods: A systematic review was conducted following PRISMA guidelines. Se...

Luis E. Fernandez-Curbelo, Tania Rivero-Blanco, C. Cruz-Corona et al. · 0 citations
Review Open access Sep 2026

Machine learning models for identifying prediabetes: a systematic review of performance, validation, and implications for primary care

Background Machine learning models have been proposed for identifying prediabetes, but their methodological quality, generalisability, and readiness for primary care implementation remain uncertain. Methods We conducted a Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020-compliant systema...

Liang Wang, Yan Zhang, Hao Yang et al. · 0 citations
Review Open access Sep 2026

Optimizing Tuberculosis Incidence Prediction: A Systematic Review of Hybrid Modeling Approaches and Machine Learning Techniques

ABSTRACT Background Tuberculosis (TB) remains a significant global health problem, particularly in low‐ and middle‐income countries (LMICs), where accurate prediction of TB incidence is crucial for effective public health interventions. Objective This review assessed and compared statistical, machine learning (ML), and...

D. Singh, Bipindra Pandey, Bibek Giri et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.