A counterfactual evaluation framework that separates selected records (targets) from the applied change (an update) is introduced and four executions combine proposed and reference targets and updates to measure the effects of correcting or retaining each component and their interaction.
Recursive self-improvement (RSI) requires agents to diagnose system bottlenecks and coordinate improvements across training and inference. We refer to the agents' capability to jointly optimize training data, the trainer, and the inference harness as cross-component co-design. We introduce VibeTraining-Bench, a benchma...
Ruotian Peng, Yuanyi Ren, Shuaiqi Liu et al.· 0 citations
When a language model answers a factual question, where does its internal state go? We asked four open models (Llama-3.1-8B, Qwen2.5-7B, Gemma-2-9B and Llama-3.2-1B) 2,256 factual questions whose answers recur, such as the country a person is a citizen of. At every layer, we recorded the state from which the answer is...
Mathematical reasoning remains underexplored for low-resource languages, including Dialectal Arabic. To bridge this gap, we introduce the DAR-MGSM (Dialectal Arabic Multilingual Grade School Math) Benchmark, the first manually curated benchmark for evaluating mathematical reasoning in Dialectal Arabic. DAR-MGSM consist...
Noor Abo Mokh, Teresa Lynn, N. Habash et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Agentic on-policy distillation (OPD) trains a student agent on its own trajectories while a teacher scores every token. A natural explanation of where it goes wrong is compounding error: the student's mistakes carry its trajectories beyond the region where the teacher is reliable, so recent methods keep training inside...
Continuous flow language models offer a path to parallel generation with tools for control and acceleration unavailable to discrete diffusion, yet effective techniques for building them at the billion-parameter scale remain less established. We present Lafa (Large flow language model), a fast, high-performing flow lang...
Arnav Chavan, Chanhyuk Lee, Udbhav Bamba et al.· 1 citation
Discrete diffusion models iteratively denoise a noisy sequence of categorical data such as text, enabling any-order generation with self-correction and in-filling capabilities. This makes them promising candidates for reasoning, planning, and constrained-generation tasks like coding and math. Yet masked and uniform dif...
Rodrigo Casado Noguerales, Dimitri von R\"utte, Bernhard Sch\"olkopf et al.· 0 citations
For efficient deployment of large language models (LLMs), methods of ultra-low-bit backbones reduce weight storage, memory traffic, and linear-layer execution cost, while multi-token prediction (MTP) methods reduce sequential decoding steps by predicting multiple future tokens in parallel. Although complementary, the d...
Ning Zhang, Shihao Wang, Jinrui Zhang et al.· 0 citations
Large language models leave model-specific traces in their generated text, but it remains unclear how finely these fingerprints can distinguish related models and which signals remain informative as obvious cues are reduced. We study this through fingerprint resolution, considering both model resolution, from different...
Mohammad Reza Modarres, Armin Tourajmehr, Artin Tavasoli et al.· 0 citations
It is shown that the prompting methodology is as important as the model architecture: while the instruction-tuned model version achieves 0.5681 with its chat interface, the base model achieves 0.6836 when prompted using text completion, which decreases factual recall.
Agentic AI extends large language models (LLMs) from generating responses to planning and executing complex workflows, substantially expanding their utility while exposing applications to unsafe actions, information leakage, and adversarial manipulation. Multi-agent systems further expand these capabilities through spe...
Mohammad Kachuee, Phu Mon Htut, Sheng Li et al.· 0 citations
It is shown that emojis used in tightly clustered topical contexts also exhibit more polarised crowd-sourced sentiment, not less, and that topical coherence and affective dispersion are distinct dimensions of emoji meaning.
Rohan James, Ioannis Christofilogiannis, Yuuv Jauhari et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.