#artificial intelligence
Jun 2026
ReproRepo: Scaling Reproducibility Audits with GitHub Repository Issues
The results show that LLM agents, even without executing code, can identify many real-world reproducibility problems from paper-repository pairs, and ReproRepo can serve as a reusable, scalable framework for future evaluations of LLM agents on real-world reproducibility auditing.
Shanda Li, Qiuhong Anna Wei, Jingwu Tang et al.
· arXiv.org · 0 citations