Recent advances in multimodal foundation models yield strong performance on static perception and reasoning benchmarks, yet such evaluations largely overlook a central aspect of intelligence: acting competently in dynamic environments over extended time horizons. We introduce PlaySuite, a large-scale benchmark for eval...
Dheeraj Varghese, Anna Vettoruzzo, Walter Simoncini et al.· 0 citations
TimeSage-EV is introduced, a live benchmark for agentic time series analysis in evolving environments that evaluates state identification, data summarization, and outlook reasoning, and is released as a research resource with monthly updates, code, a leaderboard, and failure-mode analyses.
Qingren Yao, Ya-Xuan Kong, Yuqi Nie et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.