High Coverage Does Not Guarantee Regression Detection: A Target-Blind Audit of Representative Task Panels for Versioned AI Coding Agents
Re-evaluating versioned artificial intelligence (AI) coding agents is expensive, motivating small task panels that represent a full benchmark. We audit whether such representativeness predicts regression-screening value (a regression is a task the previous configuration solved and the target failed), with every selecto...