Li Xu

Are Benchmarks Reliable? Toward Structural Diagnosis via Item-Level Capability Boundaries

Evaluating large language models (LLMs) relies heavily on benchmark scores, yet aggregate metrics can obscure whether individual items serve their intended measurement purpose. BSDProbe provides an item-level framework for benchmark structural diagnosis that jointly characterizes correctness transitions and their suppo...