SA-Bench: Evaluating Semantic Alignment in LLM-Based Paper Reproduction
SemanticAlign-Bench (SA-Bench), a diagnostic benchmark covering 30 papers from ICLR, ICML and NeurIPS 2025, is introduced and indicates that scaffolds optimized for executability provide limited leverage for scientific reproduction; narrowing the gap requires scaffolds that prioritize semantic specification verificatio...