Automated research systems support literature synthesis, ideation, experiments, writing, and peer review, but their evaluation is dispersed across tasks, benchmarks, and studies that are difficult to compare directly. We review this literature from the perspective of evaluation design and evidence, covering six targets...
Liu-Lei Zhang, De-Jing Zhou, Chu-Yue Huang et al.· 0 citations
The Profiling, Investigation, and Judgment (PIJ), comprising 2,500 real homicide cases from five countries, is introduced and it is found that performance degrades systematically as tasks shift from explicit fact extraction to implicit reasoning over unknown suspect profiles.
Yu-Tong Yao, Yan-Jie Cao, Guan-Hua Chen et al.· 0 citations
IndicDetect provides standard data splits, an evaluation protocol, and baselines to establish a robust, language-aware foundation for AI-generated text detection in Indic scripts, and finds substantial robustness failures.