Doc2Harness: Benchmarking LLMs on Long-Horizon Harness Engineering of Coding Agents
Agents driven by large language models are increasingly deployed on long-horizon tasks, where they use tools and modify real workspaces. How well they perform depends as much on the harness around the model as on the model itself. Existing benchmarks measure downstream task success under a fixed harness, leaving harnes...
Yuyao Ge, Sheng-Hua Liu, Pei-Zhong Gao et al.
· 0 citations