A game ships when a player can launch it, finish it, and return to a saved world, none of which a successful build guarantees, yet game-creation agents are mostly tested on one engine or on one-prompt browser games. We present CEGame-Bench, the first long-horizon benchmark for complete-game creation across five product...
Zi-Xuan Dong, Yang-Hai Wang, Han-Yan Bian et al.· 0 citations
Results distinguish functional success from constraint compliance, with failures concentrated in workflow ordering, tool-use discipline, and reporting, and substantial interactions between models and scaffolds.
Wen-Ya Zhu, Xin-Ping Lei, Zhi-Yi Lai et al.· 0 citations
HappyWorld-Bench is introduced, a comprehensive benchmark that evaluates whether generated worlds remain reliable as agents interact with them, and highlights the need to evaluate world models not only by visual quality, but also by state consistency and the correctness of their responses to actions and interventions.
Zhi-Qi Bai, Ju-Nai Cai, Yi-Xin Chen et al.· 0 citations
This work introduces GameLogicBench, a benchmark of 72 gameplay-logic tasks in Godot projects, and compared versions of the benchmark evaluator built with and without validation using mutants.
Xin-Yu Che, Yun-Fei Ge, Shi-Hao Li et al.· 2 citations
AVE-Agent is proposed, a modular agent framework that decomposes complex instructions into dependent subtasks and iteratively improves editing results through self-reflection and evaluator feedback, and improves instruction execution, Fidelity Preserving, and audio-visual alignment in joint editing while maintaining co...
The paradigm of 3D shape as code is explored, leveraging and scaling the coding ability of an LLM for 3D modeling, and Procedura, a novel 3D modeling agent framework that writes an object as a procedural assembly, a parametric program whose named parts are joined by typed, machine-checkable mates.
You-Tian Lin, Yikang Yang, Zhanpeng Hu et al.· 2 citations· ⚡1
ABot-AgentOS is presented, a general robotic Agent Operating System that sits above low-level controllers and provides a deliberative agent layer for scene-conditioned planning, context-isolated skill execution, multi-stage verification, multi-modal memory, and edge-cloud collaboration.
Jiayi Tian, Shiao Liu, Yuting Xu et al.· 0 citations
Coding agent infrastructure is shifting from harness engineering toward loop engineering as coding agents are deployed for sustained long-horizon software development. Existing benchmarks often center on localized tasks or end-state outcomes, offering limited insight into sustained execution. We introduce LOOPSBENCH, a...
Han Li, Zhemin Fang, Rili Feng et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
