Real-world software engineering rarely consists of isolated changes. Features, migrations, and systematic fixes often unfold across multiple pull requests (PRs), requiring coordinated modifications across a repository. Yet most executable repository-level benchmarks retain a single issue or PR as the task unit, while e...
Wei-Hao Li, Zi-Hang Xu, Zhong-Qiu Wang et al.· 0 citations
Reliable repository-level coding requires agents not only to generate correct code but also to preserve constraints and respond to tool feedback across long interactions. However, our diagnostic analysis shows that agents often fail to act on relevant information already available in context, while final Pass/Fail outc...
Yu-Jia Luo, Zhi-Yi Lai, Zi-Qi Miao et al.· 0 citations
SWE-Nexus enables task construction from validated behavior beyond individual historical changes, a fully automated pipeline that constructs repository-level implementation tasks from test execution from test execution.
Song-Wei Yu, Zi-Qi Miao, Jing-Xuan Xu et al.· 0 citations
Results distinguish functional success from constraint compliance, with failures concentrated in workflow ordering, tool-use discipline, and reporting, and substantial interactions between models and scaffolds.
Wen-Ya Zhu, Xin-Ping Lei, Zhi-Yi Lai et al.· 0 citations
While test-time scaling enhances Large Language Model (LLM) agents in long-horizon software engineering (SWE), sparse binary rewards (Pass/Fail) create a severe credit assignment crisis and waste failed exploratory trajectories. Current trajectory optimization and scaling methods are costly and structurally limited, re...
Jing-Xuan Xu, Gang Wu, Ya-Nan Wu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
