Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Oct 2026

UMAS: System-Level Uncertainty Quantification for Multi-Agent LLM Systems

Multi-Agent Systems (MAS) are a promising paradigm for improving the reasoning capabilities of large language models, yet they remain prone to hallucinations and erroneous outputs. Uncertainty Quantification (UQ) is crucial for assessing system reliability, but existing methods are largely designed for single-agent set...

Han Li, Jinhao Duan, Xiao-Shuang Shi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

When Agents Collude: Weak-to-Strong On-Policy Distillation for Mitigating Strategic Deception in Multi-Agent Systems

While recent advances in autonomous agents enable them to coordinate on increasingly complex tasks, prior work shows that this growing capacity for coordination can create safety risks, including collusion, in which agents jointly pursue misaligned actions while concealing the true basis of those actions from oversight...

Eric Onyame, Runtao Zhou, Kowshik Thopalli et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TIAgent: From Natural Language to Grounded Agentic Workflows for Computational Pathology

Computational pathology (CPath) analyses increasingly depend on multi-step computational workflows that require substantial programming expertise, limiting their accessibility to pathologists and other domain experts without extensive coding experience. Although large language models (LLMs) provide a promising natural-...

Aakash Madhav Rao, Mark Eastwood, Danielle Belgrave et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

LLM-as-a-Judge Version Shift: The Instrument Changed, Not the Standard

Automated research pipelines increasingly rely on fixed LLM judges to rank, filter, and revise proposals, yet these judges are routinely replaced by newer versions. We study whether such replacements preserve the underlying measurement standard. Using a preregistered, frozen-weight design, we evaluate three adjacent sa...

Guijia Zhang, Harry Yang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Skip the Compressor: Coding Agents Fix More Issues When They Pick Whole Files

A coding agent works on repositories that can be far larger than its context window can hold. Prompt compressors and retrievers offer solutions to this problem, but patching an issue needs two things at once: the files that must change, and their code exactly as written, since the model must reproduce the lines it edit...

Xiaocong Yang, Rishit Chatterjee, Himanshu Udupi et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Preserve to Expand: Source-Aware Adaptation and Model Merging for Multilingual LLM-Based ASR

Expanding multilingual ASR systems to new languages is challenging when adaptation must preserve previously supported languages without replaying source-language training data. We study this problem in connector-based Speech LLMs, where a trainable connector maps speech representations into a frozen large language mode...

Yuchen Zhang, Haralambos Mouratidis, Ravi Shekhar · 0 citations
#natural language process... Preprint Oct 2026

Understanding Jev-Style System One Models: Does Structure Reduce Selection Bias?

Selection bias in large language models (LLMs) can persist despite instructions to ignore presentation order or prompts that elicit reasoning. Recent efforts to reproduce Jev-style System One behavior have produced a growing family of models that predict probabilities directly over supplied candidates. Yet systematic c...

Ming-Yang Song, Mao Zheng, Zhi-Yuan Ma et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Learning When to Commit: Schedule Distillation for Fast Diffusion Language Models

Diffusion large language models (dLLMs) can generate multiple tokens in parallel, but often require many decoding rounds to complete a response. Efficient generation depends not only on which tokens are easy to predict, but also on how committing to them helps predict the remaining positions. A highly predictable token...

Aidar Myrzakhan, Zhi-Qiang Shen · 0 citations
#natural language process... Preprint Oct 2026

Quantifying Claim Smoothing by LLM Research Agents

Deep research, or any use of large language models (LLMs) to read a large document collection and produce insights, requires synthesizing information from different sources. In this work, we find that LLMs produce long-form research reports that read as confident syntheses but which fail to accurately reflect the under...

Tiasa Singha Roy, Manya Wadhwa, Greg Durrett · 0 citations
#natural language process... Preprint Open access Oct 2026

SEMA-Auto: Sighted and Efficient Multi-Turn Attack with Autonomy

Existing jailbreak attackers fall into two classes: static planners fix their single- or multi-turn adversarial plans in advance, remaining simple but losing sight of the victim's replies, wasting turns and limiting transferability; interactive generators read each victim reply to generate the next-turn attack but requ...

Mingqian Feng, Xiaodong Liu, Weiwei Yang et al. · 0 citations
#natural language process... Preprint Oct 2026

From Self-Confidence to Statistical Accuracy: Scaling Human-in-the-Loop Evaluation with Direct and LLM-Assisted Auditing

For large language models (LLMs) and multimodal large language models (MLLMs), model-reported self-confidence is often miscalibrated, yet it may still be useful for efficient evaluation. At the same time, LLM-as-a-judge offers a scalable alternative to direct human auditing, but its practical benefit depends on calibra...

Harine Choi, Chen-Chen Kuai, Zi-Hao Li et al. · 0 citations
#natural language process... Preprint Oct 2026

Not One Belief: Answer Payloads, Persistence, and Dissociated Confidence Signals in Conversational Question Answering

This work splits each follow-up into its speech act (re-ask, agree, or challenge) and its payload (an answer string, correct or not), and measures four confidence signals on the same transcripts: verbalized confidence, length-normalized likelihood, a frozen hidden-state probe, and P(True).

Duc Tran · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.