Preprint
Aug 2026
Benchmarking LLM Judges for Mobile Agent Evaluation
This work introduces MobileJudgeBench, a benchmark for systematically evaluating LLM-as-judge methods on mobile agent trajectories, and reveals benchmark quality metrics reliably predict real-world judge utility.
Zi-Qiang Wang, Li Gu, Zhixiang Chi et al.
· 0 citations