Endpoint accuracy on abstract-reasoning benchmarks does not reveal whether a language model has acquired a transferable rule or fit distribution-specific regularities. We study this distinction in small language models on the ARC-TGI benchmark, which organizes abstract grid transformations into controllable task famili...
Nur A. Zarin Nishat, Jens Lehmann, Andrei C. Aioanei et al.· 0 citations
How do humans and artificial agents learn to act in a world whose rules they do not yet know? We use LS20, a novel ARC-AGI-3 game, as an artificial world: a microcosm whose mechanics must be discovered through exploration and improvisation alone. We operationalise a methodological loop: observe how humans explore, adap...
Andrei C. Aioanei, Syeda Khushbakht Batool, Alexander Aston et al.· IEEE Symposium on Artificial...· 0 citations
The results show that strong fine-tuned variant prediction, a plausible corruption prior, and functional generation are distinct claims that require separate validation.
Su-Su Hu, Preetam Gattogi, Jens Lehmann et al.· 0 citations
Tycho, a coding-agent system that constructs and uses game-specific models during interaction and introduces Tycho, a coding-agent system that constructs and uses game-specific models during interaction in ARC-AGI-3.
Jens Lehmann, Andrei C. Aioanei, Sahar Vahdati· arXiv.org· 10 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.