#artificial intelligence
May 2026
JudgmentBench: Comparing Rubric and Preference Evaluation for Quality Assessment
JudgementBench, a benchmark of 30 real-world legal tasks, paired with 1,539 rubric scores and 1,530 pairwise preference judgments collected from practicing attorneys, supports a broader research agenda on how expert judgment should be elicited, aggregated, and used as supervision in domains without verifiable ground tr...
Russell Yang, Rui-Shi Chen, Pierce Kelaita et al.
· arXiv.org · 4 citations
· ⚡2