Large language models (LLMs) offer a scalable approach to social simulation, but their credibility depends on how agents are constructed. Existing methods can partially reproduce population-level patterns, yet often fail to capture human-like diversity. Our analysis shows that static-profile agents exhibit stronger dem...
Hexi Wang, Yujia Zhou, Bangde Du et al.· 0 citations
Ranking is a fundamental component of modern information access systems. Reinforcement learning (RL) provides a flexible framework for directly optimizing coarse-grained feedback and system-level objectives defined over the complete ranking list. However, existing RL-based ranking methods typically treat each sampled p...
Yiteng Tu, Weihang Su, Zitao Su et al.· arXiv.org· 0 citations
This work introduces LexRubric, a rubric-based benchmark for evaluating open-ended Chinese legal tasks and evaluates 18 recent general and legal-domain LLMs on LexRubric, showing that different models exhibit distinct capability profiles, and that open-ended legal tasks remain challenging for current LLMs.
Yifan Chen, Haitao Li, Yiran Hu et al.· arXiv.org· 1 citation
GenRubric is introduced, a self-evolving framework that improves rubric generation from unlabeled queries without requiring additional human annotations during self-evolution, and experiments show that self-evolution improves the agreement between evaluations induced by generated rubrics and those induced by expert-wri...
Yifan Chen, Hai-Tao Li, Qing-Yao Ai et al.· 1 citation
This work introduces LongJudgeBench, a comprehensive benchmark for evaluating LLM judges on long-form outputs across diverse real-world scenarios and judging protocols, and systematically evaluates a broad range of LLM judges, covering multiple base models and judging settings.
Junjie Chen, Yuxin Dong, Haitao Li et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.