DecisionPivot: A Diagnostic Benchmark for Decision Models in LLM Systems
Decision models support routing, guardrails, and output verification in LLM systems. However, item accuracy alone cannot establish whether models make correct decisions across controlled variations or assign reliable confidence to their predictions. We introduce DecisionPivot, a diagnostic benchmark comprising 48 tasks...
Xia-Lie Zhuang, Ming-Cong Lei, Zun-Hai Su et al.
· 1 citation