Commit-first LLM judging inherits the judge's own errors
commit-first judging does not remove the anchor that gets gamed, it moves it from the candidate to the judge's own answer, so evaluation is only as good as the judge is at the task, so evaluation is only as good as the judge is at the task.
Idil Gozel
· 1 citation