The rapid rise of autonomous AI scientists marks a paradigm shift in scientific discovery by automating the research lifecycle. Yet their rushed development has outpaced critical oversight, leaving key workflow decisions dangerously unscrutinized. We present a much-needed systematic analysis of open-source AI scientist...
Ziming Luo, Atoosa Kasirzadeh, Nihar B. Shah· Proceedings of the National...· 0 citations
A randomized experiment and an anonymous post-survey at ICML 2026 investigate how reviewers use LLM-use policies in practice and how different LLM-use policies affect review outcomes, and discusses implications for future peer-review policy and tool design.
Sunnie S. Y. Kim, W. Deng, Jennifer Wortman Vaughan et al.· 1 citation
The results show that LLM agents, even without executing code, can identify many real-world reproducibility problems from paper-repository pairs, and ReproRepo can serve as a reusable, scalable framework for future evaluations of LLM agents on real-world reproducibility auditing.
Shanda Li, Qiuhong Anna Wei, Jingwu Tang et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.