The ARIA framework for MAS-agnostic runtime inspection and amendment is developed, designed to integrate with any MAS that exposes execution trajectories and supports continuation replacement, and a compact model is taught to recognize when intervention is needed and how to correct an ongoing run.
This work studies the benign case: agents follow one protocol, none intends to deceive, but some read a misleading passage, testing three open-weight models on commonsense reasoning, knowledge QA, and moral judgment, and concludes that robustness should be judged against exposure-matched baselines.
Jonas Becker, Jan Philip Wahle, T. Ruas et al.· arXiv.org· 2 citations
Existing methods induce various forms of knowledge from agent traces, from sample workflows to programmatic skills. We propose ARISE (Agent Routine Induction from Successful Experience), which identifies recurring procedures in agent traces and synthesizes them into a reusable library of agent subroutines. Across five...
Zhihan Lei, Jiarui Yan, Joshua Momo et al.· 0 citations
T2J-BENCH is introduced, a benchmark of 63 whole-repository PyTorch-to-JAX migration tasks spanning 18 model families across both training and serving, and TWINHARNESS, a reference-grounded agent harness that turns the agent's executable PyTorch source into legitimate self-verification feedback.
Tao Feng, Jie-Feng Chen, Lin-Xin Song et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Many recent document embedding models are trained on document-as-image representations, embedding rendered pages as images rather than the underlying source. Meanwhile, existing benchmarks for scientific document retrieval, such as ArXivQA and ViDoRe, treat documents as images of pages, implicitly favoring such represe...
Ghazal Khalighinejad, Raghuveer Thirukovalluru, Alexander H. Oh et al.· 0 citations
Audio-text retrieval systems based on Contrastive Language-Audio Pretraining (CLAP) achieve strong performance on traditional benchmarks; however, these benchmarks rely on caption-style queries that differ substantially from real-world search behavior, limiting their assessment of practical retrieval robustness. We pre...
HaeJun Yoo, Yongseop Shin, Insung Lee et al.· 0 citations
It is found that external rewards drive most of the accuracy gains, while preserving more coherent reasoning when rewarded for reasoning tokens, while preserving more coherent reasoning when rewarded for reasoning tokens through internal attention rewards.
There has been growing interest in building agents that can interact with digital platforms to execute meaningful enterprise tasks autonomously. Among the approaches explored are tool-augmented agents built on abstractions such as Model Context Protocol (MCP) and web agents that operate through graphical interfaces. Ye...
Large language models (LLMs) increasingly store user preferences in persistent memory to support personalization across interactions. However, in third-party communication settings governed by social and institutional norms, some user preferences may be inappropriate to apply. We introduce BenchPreS, which evaluates wh...
Sangyeon Yoon, SunKyoung Kim, Hyesoo Hong et al.· arXiv.org· 8 citations· ⚡2
Draft-Thinking is proposed, a lightweight adaptation framework that learns a compact, self-contained working derivation that directly supports the final answer in a long chain-of-thought reasoning model.
Jie Cao, Tianwei Lin, Zhen-Xuan Fan et al.· arXiv.org· 3 citations· ⚡1
We examine how lyric representation shapes computational similarity using four 384-dimensional multilingual MiniLM representations of 7,891 K-pop songs by 1,456 artists from charts spanning 2000 to October 2023. Whole-song truncated embeddings provide the strongest standardized separation between neighbouring and rando...
Oktay Karaku\c{s}, Can Ey\"upo\u{g}lu· 0 citations
Crafting effective reward signals remains a central challenge in reinforcement learning (RL) for complex reasoning. Existing methods for automated reward optimization search with a fixed proposer which never learns from its costly trials. We present Dual-Evolving Reinforcement Learning (DERL), a dual-training framework...
Sitao Cheng, Tianle Li, Xuhan Huang et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.