Judge Circuits Explain Format-Induced Inconsistency in LLM-as-a-Judge
By structurally decoupling abstract judging from output formatting, this work provides a mechanistic account of format-induced inconsistency on the open-weight models the authors study and implies that benchmark comparisons of judge reliability across formats partly measure the fragile formatting stage, and can underst...
Nils Feldhus, Tanja Baeumel, Elena Golimblevskaia et al.
· 1 citation