EarlyEval: Cheaper Agent Evaluation via Early Outcome Prediction
This work introduces early outcome prediction, a complementary axis of efficiency that instead cuts cost within each task within each task, and instantiates EarlyEval, a lightweight framework that trains a pair of LightGBM success and failure classifiers over behavioral, textual, and reference-solution features and hal...
Yu-Ling Shi, Zhensu Sun, Jun-Sen Dong et al.
· 4 citations
· ⚡1