How Is Automated Research Evaluated? A Survey of Benchmarks and Evaluation Practices
Automated research systems support literature synthesis, ideation, experiments, writing, and peer review, but their evaluation is dispersed across tasks, benchmarks, and studies that are difficult to compare directly. We review this literature from the perspective of evaluation design and evidence, covering six targets...
Liu-Lei Zhang, De-Jing Zhou, Chu-Yue Huang et al.
· 0 citations