#artificial intelligence
May 2026
Codifying the Judge: Scalable Evaluation via Program Distillation
PAJAMA is introduced, a system that synthesizes programs as judges, aggregates their decisions into a joint verdict, and incorporates a fallback mechanism to selectively escalate low-confidence cases to an LLM.
Tzu-Heng Huang, Sheng-Qi Qiu, Frederic Sala
· arXiv.org · 0 citations