Medical Article Assessment Using Artificial Intelligence.

Abstract

Background and Objectives The worthiness of a medical article is not known until it is read and critically evaluated. A process using artificial intelligence (AI) was developed and assessed to do that for a specific article. Methods A medical article was uploaded to an AI large language model program with instructions to answer specific bounded questions about that article only, its methodological components, assessment of findings, and appropriateness and validity of conclusions. Fifty articles were evaluated and compared using AI and human assessment. Results Agreement was found 89% of the time. Disagreements were concerned with word use, context, and by experiences and human memory. No AI fabrications occurred. Conclusion This method eliminated, or at least heightened awareness of the problems, biases, limitations, and confounders of an article to be read. Isolation and validity of the components that collectively produce the conclusions from what is found and said in an article is more clearly delineated by a step-by-step process, eliminates human legacy conflicts, and quickly determines the legitimacy of conclusions.