Benchmark Contamination: A Taxonomy Organized by Defeated Mitigation
A benchmark score is a joint property of the model, the evaluation harness, the elicitation budget, the sampled population, and contamination status. Leaderboards publish the model and the score, so capability and leakage stay observationally equivalent. Existing taxonomies classify contamination for automated detectio...
Johanna Angulo, Víctor Yeste, H. Espinós-Morató
· 0 citations