TCMQA: A 38K-Question Traditional Chinese Medicine Benchmark with a Licensed-Practitioner Reference
TCMQA, an open benchmark of 38,279 questions from Chinese TCM licensing examinations, paired with 15,151 responses from 101 licensed practitioners, is presented, and 29 instruction-tuned models from 9 families are evaluated, finding difficulty does not transfer between models and practitioners.
Tzu-Heng Huang, Jet Lin, Eric Lin
· 0 citations