Training language-model agents to play long-horizon strategy games is hard because deterministic feedback is sparse and often arrives only at the end of a game. In-game scores can offer dense signals, but they do not reliably predict future outcomes: in 8-68% of position pairs across eight strategy games, the higher-sc...
Yan-Chen Liu, Xin-Yu Che, Brihi Joshi et al.· 0 citations
This work introduces GameLogicBench, a benchmark of 72 gameplay-logic tasks in Godot projects, and compared versions of the benchmark evaluator built with and without validation using mutants.
Xin-Yu Che, Yun-Fei Ge, Shi-Hao Li et al.· arXiv.org· 2 citations
This work introduces MindTopo, a benchmark of topological intuition across five properties grounded in cognitive science and formal topology: continuity, separation, order, enclosure, and knots, which performs better on reasoning than on planning, and the best-performing model remains far below observed human performan...
Yun-Fei Ge, An-Bang Liu, Qineng Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.