Large language models for medical consultation are often evaluated after a clinical problem has already been made clear, although real consultations may begin with a vague, minimized, or misframed concern. We evaluated three API models across four physician-authored, multi-turn vignettes under baseline and entry-to-car...
Yining Hua, C. Ayubcha, Hongbin Na et al.· 0 citations
CARE-Bench, a source-grounded benchmark that evaluates sequential patient-facing triage as a four-label per-turn current-action task, is introduced, which improves 10 of 11 models and supports explicit evaluation of action timing before deployment.
StagedWorkspace is proposed, a versioned workspace for knowledge-work agents that binds parsed records and review diffs to content hashes of the native files as they change, and motivates benchmarks that score evidence, staged edits, and submitted artifacts as explicit state transitions.
Yining Hua, Hongbin Na, Yifan Zhou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
