API Benchmark Scores Do Not Reliably Transfer to Chatbot Interfaces
This work audits ChatGPT, Claude, and Gemini across seven systems and nine benchmarks spanning general capability, social bias, and sycophancy, finding systematic API--interface differences in both accuracy and consistency.
Jennifer Wang, Joachim Baumann, Daniel E. Ho et al.
· 0 citations