Ming-Cong Lei

DecisionPivot: A Diagnostic Benchmark for Decision Models in LLM Systems

This work introduces DecisionPivot, a diagnostic benchmark comprising 48 tasks and 40,033 items across seven decision roles that provides fine-grained diagnostics of decision failures that aggregate evaluation alone cannot reveal, and evaluates 40 decision models and 14 general models using documented, model-specific p...