Skip to content

Right for the Wrong Reasons: A Benchmark for Hallucination and Clinical Safety in AI Health Triage

· 0 citations · 9 references

TL;DR

An empirical benchmark for evaluating clinical triage systems that assesses explanation quality alongside decision outcomes, and provides a reproducible, checkpoint-based evaluation pipeline and outline a roadmap for bias stress-testing, hallucination mitigation, and open benchmark release.

View source

Similar papers

Review Open access Sep 2026

Retrieve-Then-Verify for Evaluating Evidence Support and Hallucination in Large Language Model–Generated Medical Information: Empirical Study

Retrieval-based evidence verification provides a reproducible and transparent approach for evaluating the reliability of AI-generated medical information, with direct relevance to digital health practice, evidence-based medicine, and medical informatics.

Zhao-Hui Liang, Cynthia Sheffield, Gisela Butera et al. · 0 citations
Conference Open access Sep 2026

Factual Hallucination in Medical Large Language Models: Typology, Evaluation, and Systematic Governance

A fine-grained hallucination classification framework based on medical knowledge graphs is proposed and a three-tier risk stratification scheme that references FDA medical AI software risk classification standards is established, highlighting the unique characteristics of the medical domain.

Zi-Jiao Liu · 0 citations
Review Open access 2026

AI Hallucination And Fabricated References: A Growing Crisis For Medical Researchers A Narrative Review

A narrative review distinguishes fabrication, the invention of an entirely non-existent source, from unfaithfulness, the citation of a genuine source in support of a claim it does not contain, and argues that the two failure modes require different detection strategies.

M. Rana, M. Alkhlewi, Turki Abdulaziz Alsohaibani et al. · 0 citations
Open access Aug 2026

Advancing Generative Artificial Intelligence for Clinical Assessment: Commentary on Chen, Horga, and Escola 2026.

Addressing confidence in deploying LLM-derived ratings as a scalable, multilingual tool for schizophrenia research and clinical practice would strengthen confidence in deploying LLM-derived ratings as a scalable, multilingual tool for schizophrenia research and clinical practice.

George Chatzisofroniou, Alex S. Cohen · 0 citations
2026

Research protocol: Evaluating Chain-of-Thought Reasoning in LLMs for Complex Clinical Psychiatric Cases

This study provides a framework for evaluating LLMs in psychiatry and supporting their safe, evidence-based integration into mental health practice and is anticipated to improve diagnostic accuracy, especially among non-specialists.

Vittorio De Vita, Bianca Destro Castaniti, Antonio Cristiano et al. · 0 citations

The Judgment-Consequence Gap: LLM Moral Reasoning in Healthcare Decisions

This work investigates how large language models reason about responsibility and its consequences, tracing their judgments across successive levels, from the behavior, to the resulting illness, to the denial of care.

Hadi Hosseini, Samarth Khanna, Leona Pierce · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.