Decision Models vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Places
LLM judges now score outputs against rubrics, in benchmarks and as training rewards. Decision models return probabilities over permitted answers with a confidence score but no free text. Two such models are Jev and an open reproduction, Perplexity's Decider. We compare each with three flash-tier LLM judges on nine pane...