A scalable adversarial evaluation framework that uses controlled term substitutions and impression removals across intensity levels to expose clinically meaningful failure modes, including missed anatomical modifiers, altered diagnostic certainty, and omitted severity descriptors is developed.
Magdalini Paschali, Asad Aali, Arogya Koirala et al.· 0 citations
A reproducible DSPy+HELM benchmarking study integrates structured prompting into an established evaluation framework and quantifies how prompt choice alone impacts leaderboards.
Asad Aali, Muhammad Ahmed Mohsin, V. Bikia et al.· 1 citation
This work introduces OpenMTB-Audit, an open-source benchmark of 500 synthetic non-small cell lung cancer cases spanning five adversarial error categories and four safety labels, and developed MTB-AuditAgent, a deterministic seven-module framework separating evidence verification, missing-information detection, safety c...
Negin Ashrafi, Jia Luo, Stacey M. Frumm et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.