LitReview Arena is introduced, a battle-style evaluation platform with a structured protocol tailored to literature review quality: domain experts with AI paper-writing experience compare anonymized drafts, are matched to topics within their expertise, and provide dimension-wise outcomes over five literature-review-spe...
Ruotong Zhao, Zhi-Yu Chen, Xurui Liu et al.· 0 citations
While all four models exhibited comparable adherence to guideline-based content, DeepSeek-R1 demonstrated superior performance in supplementary informational value and readability, highlighting the importance of evaluating LLMs not only for accuracy but also for their capacity to enhance clinical communication and deci...
Li Xu, Xu Qiu, Jia-Yi Deng et al.· Neurology Asia· 0 citations
This work introduces Ideation Arena, a battle style platform that evaluates research ideas through pairwise human assessment, and constructs Ideation Arena Eval, a benchmark for assessing whether automated evaluators align with human preferences in research ideation.
Zhi-Yu Chen, Keyu Zhao, Ji-Gao Fu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.