Realtime-Bench: Can Frontier Models Solve Real-time Interactive Problems?
It is found that temporal costs limit success in evolving environments and that higher reasoning effort has mixed effects under time pressure, reflecting a trade-off between decision quality and timely execution.
Jing-Yu Tang, Xu Yang, Zhe-Hao Zhang et al.
· 0 citations