Automated research systems support literature synthesis, ideation, experiments, writing, and peer review, but their evaluation is dispersed across tasks, benchmarks, and studies that are difficult to compare directly. We review this literature from the perspective of evaluation design and evidence, covering six targets...
Liu-Lei Zhang, De-Jing Zhou, Chu-Yue Huang et al.· 0 citations
The Profiling, Investigation, and Judgment (PIJ), comprising 2,500 real homicide cases from five countries, is introduced and it is found that performance degrades systematically as tasks shift from explicit fact extraction to implicit reasoning over unknown suspect profiles.
Yu-Tong Yao, Yan-Jie Cao, Guan-Hua Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.