Can LLMs Write Reliable Rubrics? A Meta-Evaluation for Experiment Reproduction
This work presents the first systematic meta-evaluation of LLM-generated rubrics intrinsically by semantic similarity and extrinsically by score alignment with ground-truth rubrics, and meta-evaluate generated rubrics intrinsically and extrinsically by score alignment with ground-truth rubrics.