Efficient Benchmarking in Production: A Study of an Evolving LLM Agent
It is shown that multidimensional 2PL adaptive testing achieves the best overall score fidelity, and difficulty-stratified fixed subsets are deployed because of their operational simplicity and transfer without recalibration to five other agent families and remain stable across calibration windows as short as one day.