System1-Arena: Which Decisions Can Be Left to System 1?
The largest System-1 models match or exceed fast closed LLMs in non-agentic accuracy, with better-calibrated probabilities at one-quarter of the latency, and a reasoning LLM is the most accurate, at about 70x the cost of a fast LLM.
Tian-Yu Chen, Xin-Yang Liu, Ru-Yi An et al.
· 1 citation