Skip to content
Open access

Development of an interpretable machine learning model for predicting in-hospital mortality in ICU patients with sepsis: a retrospective cohort study

Sep 2026 · Frontiers in Medicine · Vol 13 · 0 citations · 32 references
Medicine

TL;DR

An interpretable RF-based machine learning model for predicting in-hospital mortality in patients with sepsis was developed and internally validated and showed acceptable discrimination, reasonable calibration, and potential clinical net benefit in internal validation.

Abstract

Background Sepsis ranks among the primary causes of mortality in intensive care units (ICUs), often resulting in multiple organ dysfunction due to dysregulated systemic inflammation. Timely recognition of patients at high risk is essential, yet existing clinical scoring systems show limited predictive performance. We aimed to design and evaluate an interpretable machine learning model to predict the risk of in-hospital mortality in individuals with sepsis. Methods This retrospective study screened 503 sepsis patients who were admitted to the ICU at Hebei Provincial People's Hospital from January 2022 through January 2025. After excluding patients with ICU stay less than 24 h, incomplete clinical data, or pregnancy, 431 patients were included. The dataset was randomly partitioned into a training set (n = 301) and a validation set (n = 130). Eight machine learning algorithms—including logistic regression, naive Bayes, support vector machine, single-layer neural network, random forest (RF), LightGBM, K-nearest neighbors, and decision tree—were trained and evaluated. Model performance was assessed by ROC curves (AUC), accuracy, F1 score, sensitivity, specificity, Brier score, expected calibration error, and decision curve analysis. The best-performing model was interpreted using SHAP values. Results Among 431 patients, 198 (45.9%) died during hospitalization. Feature selection using the Boruta algorithm identified 12 key predictors. The RF model achieved the most balanced overall performance, with an area under the ROC curve of 0.804 (95% CI, 0.730–0.879) in the validation set, accuracy of 0.785, F1 score of 0.778, sensitivity of 0.817, and specificity of 0.757. SHAP analysis identified lactate dehydrogenase and urea as the most influential predictors, followed by age, APACHE II score, and procalcitonin. An interactive web application was developed as a research prototype to demonstrate the feasibility of model deployment. Conclusions We developed and internally validated an interpretable RF-based machine learning model for predicting in-hospital mortality in patients with sepsis. The model showed acceptable discrimination, reasonable calibration, and potential clinical net benefit in internal validation. SHAP-based interpretation provided insight into key predictive factors, while the web-based calculator demonstrated the feasibility of model deployment. However, external and prospective validation is required before its clinical utility and generalizability can be established.

Read PDF

Similar papers

Open access Sep 2026

Development and Validation of an Interpretable Machine Learning-Based Prediction Model of Sepsis: A Retrospective Multicenter Cohort Study.

Although the model shows potential for identifying high-risk individuals at the 24-hour prediction landmark, further prospective validation and clinical impact assessment are required before routine clinical implementation.

Zhang-Cong Lu, Ling-Han Hu, Peng-Fei Shui et al. · 0 citations
Open access Sep 2026

Development and Validation of an Interpretable Machine Learning Model to Predict Mortality in Patients With Sepsis-Induced Coagulopathy: Multicenter Cohort Study

The ML model developed in this study demonstrated superior accuracy, robustness, and generalizability in predicting early mortality in patients with SIC, and the findings provide valuable insights for prognostic assessment and the individualized management of patients with SIC.

Jia-Xuan Sun, Jing-Yuan Wang, Yu-Xin Dong et al. · 0 citations
Open access Aug 2026

Development and Validation of an Interpretable Machine Learning Model for Predicting In-Hospital Mortality in Diabetic Patients with Sepsis-Associated Acute Kidney Injury.

A CatBoost-based machine learning model incorporating 32 clinically accessible variables showed good predictive performance for in-hospital mortality in patients with diabetes and SA-AKI, supporting early risk stratification and clinical decision-making.

Yan-Ni Wang, Hongjie Shen, Sheng-Ze Wu et al. · 0 citations
Sep 2026

Machine Learning Model for Predicting Risk Factor Analysis and a Mortality Prediction Model of Acute Cholangitis Complicated with Sepsis.

The internally validated models showed preliminary discriminatory ability for outcome-specific risk stratification for sepsis and mortality and showed preliminary discriminatory ability for outcome-specific risk stratification in acute cholangitis.

Zhu-Lin Li, Lei-Qi Xue, Xiao-Jie Zhu et al. · 0 citations
Open access Sep 2026

Machine learning for the early prediction of 28-day mortality in patients with sepsis in the ICU based on MIMIC-Ⅳ database

A machine learning model based on routinely available clinical data from MIMIC-IV demonstrated moderate discriminatory ability for predicting 28-day mortality in septic patients, with SHAP analysis providing insights into model interpretability.

Yi Sun, Ting-Ting Wang, Meng-Na Zhang et al. · 0 citations
Sep 2026

Interpretable Machine Learning for In-Hospital Mortality Prediction in Patients With Diabetes and ARDS: Development and External Validation.

Logistic Regression showed potential as an interpretable early ICU risk-stratification tool and externally validated machine learning models for in-hospital mortality prediction in patients with diabetes and ARDS.

Ya-Lin Dong, Meng-Xue Hou, Qian-Qian Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.