Y. Harada

From examinations to consultations: a physician-reviewed Japanese benchmark for large language models in traditional Kampo medicine

Objectives: Patients and clinicians increasingly ask large language models (LLMs) about Kampo, Japan's traditional medicine. Yet evaluations of LLMs have measured accuracy on examination questions, which ask what a model knows; a consultation asks whether it can apply that knowledge to the patient at hand. No benchmark...