Reasoning Core, a collection of 50 generators spanning mathematics, logic, planning, state tracking, formal languages, structured data, games, causality, and code, is introduced, with semantic scorers, difficulty controls, and task evaluators.
Damien Sileo, V. Lacombe, Dimitri Kachler· 0 citations
CrisBench, a 1,200-question benchmark of lifecycle reasoning that combines a controlled formal setting with programs executed against Cordis, a runtime that manages component dependencies and cleanup, and asks models to identify affected components, predict state after a specified teardown order, and determine which co...
Damien Sileo, Dimitri Kachler· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.