Large language models for medical consultation are often evaluated after a clinical problem has already been made clear, although real consultations may begin with a vague, minimized, or misframed concern. We evaluated three API models across four physician-authored, multi-turn vignettes under baseline and entry-to-car...
Yining Hua, C. Ayubcha, Hongbin Na et al.· 0 citations
This work introduces WorkWorlds, an evaluation infrastructure that separates organizational state from task specification, and implements WorkWorlds in a primary synthetic pharmaceutical company with 8 measured tasks across 6 employee seats, and construct additional organizational worlds.
StagedWorkspace is proposed, a versioned workspace for knowledge-work agents that binds parsed records and review diffs to content hashes of the native files as they change, and motivates benchmarks that score evidence, staged edits, and submitted artifacts as explicit state transitions.
Yining Hua, Hongbin Na, Yifan Zhou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
