HEPToolBench 1.2: Testing How Reliably Language Models Can Drive Particle Physics Software
HEPToolBench is introduced, a benchmark of 28 collider-simulation tasks scored by deterministic, task-specific scorers, plus a three-task structured-debugging extension, and moving syntax generation into deterministic software can substantially improve reliability for both small local and frontier models.
Aadarsh Singh, Sudhir Vempati
· 1 citation