ArtifactArena: Evaluating Models by What They Build in the Physical World
To evaluate the frontier, we must measure models not by what they say, but by what they can engineer and build in grounded physical environments. We introduce \textsc{ArtifactArena}, an open-ended platform where models face a physically grounded hardware-software co-design challenge: engineering fully functional robots...
Kushagra Tiwary, David Mayo, Nikhil Behari et al.
· 0 citations