Agents pair reasoning models with harnesses that organize model calls, execute tools, load skill instructions, and retain history in memory. Understanding agent performance requires linking execution conditions to outcomes, behavior, and resource use. We introduce AlphaDiana, a measurement system with modular interface...
Zhanke Zhou, Zongze Li, Weikai Huang et al.· 0 citations
Reward-guided discrete diffusion enables test-time alignment with downstream objectives, but applying Sequential Monte Carlo (SMC) guidance at every denoising step is computationally expensive. Active guidance steps require additional reward evaluations and, for gradient-based proposals, value-gradient computations. Sp...
Jaehyeon Kim, Ziseok Lee, Siyoung Choi et al.· 0 citations
Rapid advances in AI capabilities are causing benchmarks to saturate. Once several models approach perfect scores, a benchmark loses its power to differentiate between them, and with it its utility for informing AI safety cases and frontier policies. Yet benchmark items produce far more information than the scores we t...
Morio Hamada, Jehyeok Yeon, Matteo Migliarini et al.· 0 citations
Large language model (LLM) agents can solve complex interactive tasks, yet reasoning and tool calls take time. In continuously changing environments, an otherwise correct action may arrive too late. We introduce RealtimeBench, with 180 tasks across six game types, to evaluate agents while games continue running during...
Ning-Xin Pan, Han-Yu Li, Ye-Qing Shen et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Video deep research aims to answer questions by jointly understanding video content and retrieving external knowledge from the open Web. However, these tasks often require diverse and multi-step tool-use trajectories, which may lead to unnecessary video tool calls, incurring additional costs and failure risk. In this p...
Xintong Zhang, Xiaomeng Fan, Shilin Yan et al.· 0 citations
Razborov's flag algebra method is one of the most successful tools for proving asymptotic density inequalities in extremal graph theory. It reduces an inequality about all large graphs avoiding a forbidden pattern to finitely many algebraic conditions, and a certificate satisfying them can be found by semidefinite prog...
Gyeongwon Jeong, Seonghun Park, Jihoon Hyun et al.· 0 citations
Vision-language-action (VLA) models have rapidly advanced generalist robot manipulation by harnessing the semantic knowledge of pretrained vision-language backbones. However, their visual representations are typically grounded in 2D image coordinates rather than calibrated camera geometry. This limitation is especially...
Yue Peng, Yongzhe Zhao, Artur Habuda et al.· 0 citations
Vision-Language Models (VLMs) are increasingly deployed as high-level planners for embodied agents, with an emerging strategy of scaling test-time compute to improve capability. However, we observe that doing so increases latency, token usage, and FLOPs while yielding uneven, often diminishing gains in downstream succe...
Jadelynn Dao, Milan Ganai, Yasmina Abukhadra et al.· 0 citations
Tool-using large language model (LLM) agents face two distinct security failures: unauthorized external actions and exposure of sensitive plaintext inside the runtime before any final output check can intervene. Existing defenses usually protect one boundary, either the planner/runtime or the point where external actio...
Fine-tuning APIs make frontier LLMs easy to customize, but they can also weaken safety alignment during fine-tuning. While prior work shows that benign supervised fine-tuning (SFT) can reduce refusal behavior, deployed fine-tuning pipelines increasingly support preference-based objectives, whose safety risks remain les...
Sangyeon Yoon, Wonje Jeung, Yoonjun Cho et al.· 0 citations
Timbre transfer aims to modify the timbral identity of a musical recording while preserving its original melody and rhythm. While single-instrument timbre transfer has made substantial progress, existing approaches to multi-instrument settings commonly rely on separate-then-transfer pipelines that propagate source-sepa...
Vision-language-action (VLA) models with flow-matching action heads, such as {\pi}0 and {\pi}0.5, have become a standard recipe for generalist robot manipulation, but every action chunk is produced by integrating a learned velocity field over about ten sequential action-expert evaluations, so action generation dominate...
Wuyang Luan, Junhui Li, Weiguang Zhao et al.· 0 citations