#artificial intelligence
Sep 2025
BuildBench: Benchmarking LLM Agents on Compiling Real-World Open-Source Software
A more challenging and realistic benchmark, BUILD-BENCH, comprising OSS that is more diverse in quality, scale, and characteristics is proposed, and a strong baseline LLM-based agent, OSS-BUILD-AGENT, an effective system with enhanced build instruction retrieval module that achieves state-of-the-art performance on BUIL...
Ze-Hua Zhang, Ati Priya Bajaj, Divij Handa et al.
· arXiv.org · 2 citations