Skip to content
Review Open access

Artificial Intelligence-Assisted Systematic Literature Reviews in Metabolic Phenotyping: A Methodological Framework and Validation Study

Aug 2026 · Phenomics · Vol 6, pp. 372 - 390 · 0 citations · 52 references
Medicine

TL;DR

OpenAI model o3-mini can independently complete the three main stages of systematic literature reviews in the metabolomics domain, thus considerably reducing the time to complete such reviews, at minimal cost.

Abstract

Systematic literature reviews are widely acknowledged to be at the top of most evidence hierarchies but are very time-consuming and labour-intensive. The advent of artificial intelligence (AI) offers possibilities to accelerate the review process. We propose a systematic literature review protocol that incorporates AI and evaluate the accuracy of AI against a human-constructed gold standard. Human researchers performed a systematic literature review on the PubMed metabolomic literature investigating Long COVID. OpenAI model o3-mini was then used via the application programming interface to carry out the three key stages of a systematic literature review: 1) screening articles for inclusion criteria, 2) evaluating articles' risk of bias (RoB) using a customised metabolomics tool based on well-established quality criteria, and 3) extracting data from articles. The performance of AI was evaluated against a manually created reference by the assessment of accuracy, negative predictive value, precision, sensitivity, specificity, F1 score, and Cohen's kappa. Out of the 320 identified articles, 33 met all inclusion criteria. AI performed screening, RoB assessment, and data extraction with mean accuracies of 92.7% ± 4.9%, 91.9% ± 5.9%, and 92.0% ± 9.2%, respectively, in ~ 10 h and at a cost of ~ 15.35 USD, while human reviewers took ~ 116 h, equivalent to ~ 2000 USD at minimum wages, to complete these steps in duplicate. OpenAI model o3-mini can independently complete the three main stages of systematic literature reviews in the metabolomics domain, thus considerably reducing the time to complete such reviews, at minimal cost. Nonetheless, human reviewers should always verify the AI-generated output to ensure robustness.

Read PDF

Similar papers

#graph neural networks Review Open access Oct 2026

Mathematical foundations of artificial intelligence in healthcare: a systematic review

Artificial intelligence (AI) in healthcare relies on diverse mathematical frameworks, yet their contributions to model development, evaluation, interpretability, and clinical translation remain fragmented. This systematic review synthesized the classical and emerging mathematical foundations underpinning healthcare AI...

Yuliana Jiménez-Gaona, V. Lakshminarayanan · 0 citations
Review Open access Oct 2026

Diagnostic performance of artificial intelligence in pediatric diseases: a systematic review and meta-analysis

Artificial intelligence (AI) has increasingly been applied in medical diagnostics and has shown promise in improving the detection of pediatric diseases. This systematic review and meta-analysis evaluated the diagnostic performance of AI models in identifying pediatric respiratory, systemic/inflammatory, and neurologic...

Ahmed Shaban, Hany A. Zaki, Benny Ponappan et al. · 0 citations
Review Open access Sep 2026

Comprehensive application of artificial intelligence in preserved ratio impaired spirometry: A systematic literature review

Background Artificial intelligence (AI) has expanded into respiratory disease diagnosis, subtyping, and prognosis, enabling early detection and precision care. However, AI applications in Preserved Ratio Impaired Spirometry (PRISm) remain nascent. This study analyzes this gap to guide future research. Methods A systema...

Qian Wu, Hui Guo, Rui-Han Li et al. · 0 citations
Review Open access Oct 2026

Artificial Intelligence for Diagnosis in Medical Imaging and Pathology: A Systematic Review of Reported Discriminative Performance with an Exploratory Diagnostic Test Accuracy Meta-Analysis

High reported AUC values reflect discrimination in selected, mostly retrospective datasets and do not establish clinical effectiveness or readiness for routine use.

D. Maltsev, Hanna Fedoryshyn, Svitlana Myslovska et al. · 0 citations
Review Open access Sep 2026

Artificial Intelligence Reporting Guidelines in Radiology: A Systematic Review

No single imaging-specific document comprehensively addresses model development, validation, diagnostic workflow integration, and post-deployment monitoring; complementary guidance may therefore be required.

Katarzyna Ochman, Miłosz Korbaś, Dominika Kaczyńska et al. · 0 citations
Review Open access Oct 2026

Artificial intelligence tools for evidence synthesis in the biomedical field: A living rapid review and evidence map.

Evidence synthesis (ES) is costly and time-intensive. Artificial intelligence (AI) tools are increasingly used to automate or semi-automate ES tasks. We conducted a living rapid review of AI tools that automate or semi-automate ES tasks. We searched for published articles and preprints through MEDLINE, Embase, and the...

G. Adam, M. Davies, E. Caputo et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.