Ati Priya Bajaj

BuildBench: Benchmarking LLM Agents on Compiling Real-World Open-Source Software

A more challenging and realistic benchmark, BUILD-BENCH, comprising OSS that is more diverse in quality, scale, and characteristics is proposed, and a strong baseline LLM-based agent, OSS-BUILD-AGENT, an effective system with enhanced build instruction retrieval module that achieves state-of-the-art performance on BUIL...