Extensive experiments demonstrate that AnyAudio-Judge not only significantly enhances zero-shot alignment detection compared to state-of-the-art baselines, but also provides precise and interpretable reward signals that substantially improve instruction alignment in downstream reinforcement learning for audio generatio...
Hai-Tao Li, Tian Tan, Yuguang Yang et al.· arXiv.org· 3 citations
This work introduces LexRubric, a rubric-based benchmark for evaluating open-ended Chinese legal tasks and evaluates 18 recent general and legal-domain LLMs on LexRubric, showing that different models exhibit distinct capability profiles, and that open-ended legal tasks remain challenging for current LLMs.
Yifan Chen, Haitao Li, Yiran Hu et al.· arXiv.org· 1 citation
GenRubric is introduced, a self-evolving framework that improves rubric generation from unlabeled queries without requiring additional human annotations during self-evolution, and experiments show that self-evolution improves the agreement between evaluations induced by generated rubrics and those induced by expert-wri...
Yifan Chen, Hai-Tao Li, Qing-Yao Ai et al.· 1 citation
This work introduces LongJudgeBench, a comprehensive benchmark for evaluating LLM judges on long-form outputs across diverse real-world scenarios and judging protocols, and systematically evaluates a broad range of LLM judges, covering multiple base models and judging settings.
Junjie Chen, Yuxin Dong, Haitao Li et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
