We Keep Evaluating LLMs, But Are We Learning Anything?
Large language model (LLM) research has become increasingly dominated by benchmark-oriented evaluations that measure performance on predefined tasks and datasets. While such evaluations are useful for tracking progress, they often provide limited scientific insight into how these systems reason, generalize, fail, or su...