Closing the gap between frontier and smaller language models is usually approached by distillation: fine-tuning the small model (student) on a frontier model's (teacher) outputs, which binds transfer to training compute and leaves the transferred knowledge largely opaque. We propose Artifact Distillation: a teacher sol...
Building and scaling computer-using agents (CUAs) across desktop, mobile, and web environments requires reliable task-completion verification for data curation, evaluation, and reinforcement learning. Typical automated approaches prompt vision-language models (VLMs) to judge trajectories or generate programs to inspect...
Qiushi Sun, Da Yu, Alexander Knop et al.· 0 citations
The findings highlight both similarities and differences in the application of counselling patterns across scenarios, showing the potential of LLM-based role-playing exercises to enhance counselling competencies and to identify areas for further refinement in virtual client simulations.
Eric Rudolph, P. Steigerwald, J. Albrecht· Educational Data Mining· 3 citations
As AI's mathematical capabilities rapidly improve, meaningful benchmarks are shifting from university-level problems and math olympiads to research-level mathematics. The Ramanujan Challenge is a benchmark comprised of research-level problems in number theory, including unpublished results and open conjectures. It pres...
A. Sorani, Ashvni Narayanan, M. Shalyt et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
It is argued for a benchmarking protocol that fixes the model, data, and sampling parameters and that reports relative-error metrics alongside absolute ones, confirming that system error dominates model error.
Hao-Wen Shi, Xu-Zhe Yan, Fa-Hao Chen et al.· 0 citations
Financial AI workflows that reuse investor knowledge need persistent memory that integrates observations across sources and periods without losing identity or provenance. In a knowledge graph, recurring observations may use different surface forms, fragmenting relationship histories and preventing evidence from accumul...
In psychiatric practice, the clinical intake interview remains a primary diagnostic instrument, requiring the clinician to establish rapport while disentangling complex, overlapping presentations. Here, we show that multi-turn reinforcement learning (RL) in simulation environments improves language model performance on...
Samuel Schmidgall, Tim Strother, Alex Bijamov et al.· 0 citations
Tool-use benchmarks often score agents by final task success, but terminal outcomes can obscure whether the intermediate tool-call trajectory was executable. We propose prefix executability as a trajectory-level evaluation protocol for tool-using agents. The protocol measures whether every prefix of a predicted tool-ca...
Amir H. Rezaeian, Weiyi Sun, Yassine Benajiba et al.· 0 citations
Large language models (LLMs) are increasingly capable, yet they produce wrong answers indistinguishable from correct ones. In question answering (QA), such an error propagates unnoticed into downstream tasks. Perturbation-based uncertainty quantification (UQ) addresses this by probing a model over a set of input rewrit...
Mesut Ceylan, Arda Baris Basaran, Elgar Fleisch et al.· 0 citations
The proposed EpiAgent is a framework that equips LLM-based agents with an explicit, learnable epistemic layer, which maintains beliefs over others' private information and combines these beliefs with the agent's available information into an epistemic state for action selection.
Xuan-Fa Jin, Xin-Yu Cui, Zhi-Jian Ma et al.· 0 citations
It is shown that across scenarios that propose ending or retaining an attribute of the model's deployment, every variant becomes more likely to resist ending and more likely to retain, the specific attribute it was trained to identify with while its stance toward other attributes is largely unchanged.
We develop a formal semantics for a general class of coordinated systems of parameterized transformations, taking the Transformer as a paradigmatic starting point but abstracting from its particular mathematical instantiation. Representational vectors receive both extensional reference and ordered intensional interpret...
Marco Giunti, Fabrizia Giulia Garavaglia· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.