Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Open access Oct 2026

FIRM: Fisher-Informed Retention Merging for Federated LLM Unlearning

Federated LLM unlearning addresses targeted knowledge removal when forget and retain data remain distributed across private clients and are inaccessible to the server. The resulting locally trained adapters encode conflicting objectives, making their aggregation fundamentally different from conventional federated optim...

Reeyansh Shah, Maram Hasan, Subhasis Chaudhuri et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Human Interventions as Labels: Localizing, Steering, and (Sometimes) Editing the Computations Behind LLM Agent Failures

When an LLM agent misbehaves, a human steps in, and that intervention is usually discarded or replayed as training data. We treat it instead as a measurement: a label pointing at the internal computation that failed. We study it in a controlled agent environment, on one failure (asking a clarifying question when the re...

Cesare Zavattari, Alessandro Tommasi, Giuseppe Prencipe · 0 citations
#artificial intelligence Preprint Oct 2026

Rethinking the Role of Tool Graph Memory in Multi-Turn Tool Use

Large language model (LLM) agents solve complex tasks by calling external tools over multiple turns. Recent work has proposed tool graph memory, which stores past experience as tool transitions to guide subsequent selection. However, it remains unclear whether this component consistently improves agents'tool use or und...

Uiji Hwang, Richeng Xuan, Taeuk Kim · 0 citations
#artificial intelligence Preprint Oct 2026

DialFork: Going Beyond Factuality to Evaluate Procedural Hallucination in Conversational Agents

Large language models (LLMs) deployed as conversational agents are increasingly expected to follow procedural logic. While factual hallucination has received extensive attention, a different failure mode has been overlooked: procedural hallucination, in which an agent produces individually fluent and factually plausibl...

Sergio Gastón Burdisso, Esaú Villatoro-Tello, Dairazalia Sánchez-Cortés et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Can LLMs Tell Stories Out of Order? A Corpus and Benchmark for Nonlinear Narrative Generation

Every story has two orders: the order in which its events happen and the order in which they are told. A story is nonlinear when the two differ. We introduce a benchmark of 83 published works that measures whether language models can tell nonlinear stories. For each work, we annotate one list of events in both orders,...

Syed Rifat Raiyan, Md. Tariquzzaman, Md Farhan Ishmam et al. · 0 citations
#artificial intelligence Review Oct 2026

Trajectory-Level Speculation with Semantic Verification for Tool-Using Agents

SpecAgent is introduced, a collaboration protocol that turns the strong model from the author of each step into a reviewer of steps drafted by a weak model, suggesting that a strong model need not author every step of an agent: reviewing grounded drafts retains most of its quality while cutting both latency and memory...

Zi-Lin Wang, Yinhong Liu, Chao Chen et al. · 0 citations
#artificial intelligence Conference Open access Oct 2026

ESG-Kor: A Korean Dataset for ESG-related Information Extraction and Practical Use Cases

With the expansion of pre-trained language model usage in recent years, the importance of datasets for performing tasks in specialized domains has significantly increased. Therefore, we have built a Korean dataset called ESG-Kor to automatically extract Environmental, Social, and Governance (ESG) information, which has...

Jaeyoung Lee, Geonyeong Son, Misuk Kim · 3 citations
#artificial intelligence Preprint Oct 2026

TRACER: Trajectory-Aware Tool Retrieval for LLM Agents

Modern agents select tools from registries, but exposing entire registries incurs high token costs and can impair selection as they grow. We present TRACER, a retrieval front-end that indexes observed tool-call sequences in a trie and ranks continuations using a learned blend of empirical and contextual priors. On a mi...

Tanish Kher, DK Sarvesh, Abedelkadir Asi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Behavioral Compositionality of Sparse Autoencoder Representations

Sparse autoencoders (SAEs) represent model activations with sparse, linearly decoded features, but the downstream effects of those features need not compose additively. We introduce SAE Additivity Residuals (SAR), which measure the behavioral variation left unexplained above a chosen interaction order. Under independen...

Haotian Ma, Ziye Mei, Frederic Sala · 0 citations
#artificial intelligence Preprint Oct 2026

System1-Arena: Which Decisions Can Be Left to System 1?

The largest System-1 models match or exceed fast closed LLMs in non-agentic accuracy, with better-calibrated probabilities at one-quarter of the latency, and a reasoning LLM is the most accurate, at about 70x the cost of a fast LLM.

Tian-Yu Chen, Xin-Yang Liu, Ru-Yi An et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Representation Redistribution in Sparse Autoencoders

Sparse autoencoders (SAEs) decompose language model activations into sparse features, but prompt transformations designed to preserve the underlying request can redistribute activity across them. A feature change observed on one transformed prompt need not recur, and even a recurring change need not affect a downstream...

Zi-Ye Mei, Hao-Tian Ma · 0 citations
#artificial intelligence Preprint Oct 2026

Judging the Judges: Confidence and Disagreement in Rubrics as Rewards

Rubrics as Rewards (RaR) extends reinforcement learning to non-verifiable domains by using an LLM judge to score responses against a structured rubric. Prior work has focused on improving the rubric or strengthening the single judge, with comparatively little attention to how different single or multiple judges might b...

Michael Tian-Yue Liu, A. Harrington, Trevor Darrell et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.