Efficient Cost-Aware LLM Evaluation via Bayesian Bandit Gittins Indices
GittinsEval is consistently competitive, with particularly strong gains over configuration-level Bayesian optimization on large-example benchmarks and over cost-unaware bandit baselines on large-candidate tasks.
Qian Xie, Yue-Li He, Nai-Ren Cao
· 0 citations