Large language models are increasingly being used to evaluate clinical texts, a concept known as LLM-as-a-judge. However, most of the existing evidence focuses on English data and uses pooled agreement metrics that obscure clinically relevant failure modes. This study audited six open-weight models against expert judge...
T. Pakull, S. Warmer, K. Arzideh et al.· npj Digital Medicine· 1 citation
This work formalizes polarity-aware evidence grounding: linking each response sentence to its contextual evidence with a supporting, contradicting, or irrelevant label, and proposes eTracer, a post-hoc framework whose context-aware signed scorer recovers the full evidence map in a single forward pass per response.
Bo-Hao Chu, Qianli Wang, Hendrik Damm et al.· 0 citations
A human-annotated benchmark that grounds each summarized claim in both cited sentences and contributory phrases within them and introduces a decoupled evaluation framework that separately scores content, traceability, and locatability, together with a proxy for the amount of source text a clinician must inspect to veri...
Bo-Hao Chu, Hendrik Damm, T. Pakull et al.· 0 citations
Instead of post-hoc diagnosis, E-Closure is introduced to supervise three dependencies for reliable reasoning during training, combining generation supervision on supported original and counterfactual responses with bidirectional switching constraints.
Bo-Hao Chu, Hendrik Damm, Qianli Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.