SWE-Prometheus: Measuring Engineering Governance Improvements in Real-World Repositories
Large language model based coding agents have made substantial progress on repository-level software engineering tasks. Existing repository benchmarks, however, usually start from a human-identified issue and evaluate whether a patch satisfies a functional signal. We present SWE-Prometheus, a benchmark for the broader...
Jia-Jun Wu, Lei-Xin Sun, Zi-Hang Tan et al.
· 0 citations