SWE-Shift: Evaluating Coding Agents in Evolving Workspaces
Repository-level coding benchmarks largely assume that tasks and environments remain unchanged throughout execution. In software development, code, dependencies, runtime state, and requirements can change while an agent is still working. We introduce SWE-Shift, a benchmark for evaluating coding agents under such mid-ex...
Victor Shea-Jay Huang, Rong-Qing Li, Zhangyue Yin et al.
· 0 citations