Aug 2026· Phenomics· Vol 6, pp. 372 - 390· 0 citations· 52 references
Medicine
TL;DR
OpenAI model o3-mini can independently complete the three main stages of systematic literature reviews in the metabolomics domain, thus considerably reducing the time to complete such reviews, at minimal cost.
Abstract
Systematic literature reviews are widely acknowledged to be at the top of most evidence hierarchies but are very time-consuming and labour-intensive. The advent of artificial intelligence (AI) offers possibilities to accelerate the review process. We propose a systematic literature review protocol that incorporates AI and evaluate the accuracy of AI against a human-constructed gold standard. Human researchers performed a systematic literature review on the PubMed metabolomic literature investigating Long COVID. OpenAI model o3-mini was then used via the application programming interface to carry out the three key stages of a systematic literature review: 1) screening articles for inclusion criteria, 2) evaluating articles' risk of bias (RoB) using a customised metabolomics tool based on well-established quality criteria, and 3) extracting data from articles. The performance of AI was evaluated against a manually created reference by the assessment of accuracy, negative predictive value, precision, sensitivity, specificity, F1 score, and Cohen's kappa. Out of the 320 identified articles, 33 met all inclusion criteria. AI performed screening, RoB assessment, and data extraction with mean accuracies of 92.7% ± 4.9%, 91.9% ± 5.9%, and 92.0% ± 9.2%, respectively, in ~ 10 h and at a cost of ~ 15.35 USD, while human reviewers took ~ 116 h, equivalent to ~ 2000 USD at minimum wages, to complete these steps in duplicate. OpenAI model o3-mini can independently complete the three main stages of systematic literature reviews in the metabolomics domain, thus considerably reducing the time to complete such reviews, at minimal cost. Nonetheless, human reviewers should always verify the AI-generated output to ensure robustness.
Artificial intelligence (AI) in healthcare relies on diverse mathematical frameworks, yet their contributions to model development, evaluation, interpretability, and clinical translation remain fragmented. This systematic review synthesized the classical and emerging mathematical foundations underpinning healthcare AI...
Yuliana Jiménez-Gaona, V. Lakshminarayanan· Frontiers in Artificial Inte...· 0 citations
Artificial intelligence (AI) has increasingly been applied in medical diagnostics and has shown promise in improving the detection of pediatric diseases. This systematic review and meta-analysis evaluated the diagnostic performance of AI models in identifying pediatric respiratory, systemic/inflammatory, and neurologic...
Ahmed Shaban, Hany A. Zaki, Benny Ponappan et al.· Egyptian Pediatric Associati...· 0 citations
Background Artificial intelligence (AI) has expanded into respiratory disease diagnosis, subtyping, and prognosis, enabling early detection and precision care. However, AI applications in Preserved Ratio Impaired Spirometry (PRISm) remain nascent. This study analyzes this gap to guide future research. Methods A systema...
Qian Wu, Hui Guo, Rui-Han Li et al.· PLoS ONE· 0 citations
High reported AUC values reflect discrimination in selected, mostly retrospective datasets and do not establish clinical effectiveness or readiness for routine use.
D. Maltsev, Hanna Fedoryshyn, Svitlana Myslovska et al.· Journal of Pioneering Medica...· 0 citations
No single imaging-specific document comprehensively addresses model development, validation, diagnostic workflow integration, and post-deployment monitoring; complementary guidance may therefore be required.
Katarzyna Ochman, Miłosz Korbaś, Dominika Kaczyńska et al.· Diagnostics· 0 citations
Evidence synthesis (ES) is costly and time-intensive. Artificial intelligence (AI) tools are increasingly used to automate or semi-automate ES tasks. We conducted a living rapid review of AI tools that automate or semi-automate ES tasks. We searched for published articles and preprints through MEDLINE, Embase, and the...
G. Adam, M. Davies, E. Caputo et al.· Research Synthesis Methods· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.