Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Oct 2026

Language Models Share a Readout Bottleneck in Working Memory

Large language models (LLMs) reproduce a human working-memory signature on the N-back task: performance declines as memory load N increases, and errors concentrate on lures, items that repeat the current stimulus at a neighboring but incorrect serial position. We ask whether this shared behavioral signature reflects a...

Dongyu Gong · 0 citations
#artificial intelligence Review Oct 2026

CARE-SD: Explainable Reasoning Architecture for Local SLM Self-Disclosure Analysis in Textual Data

Cybersecurity interviews uncover critical security experiences, behaviors, and privacy concerns often not fully captured by conventional technical assessments. Consequently, identifying genuine self-disclosures is challenging because statements are context-dependent, categories overlap, and automated interpretations ma...

Aisvarya Adeseye, Adeyemi Adeseye, Mohammad Tahir et al. · 0 citations
#artificial intelligence Preprint Oct 2026

CoSTA: Compressed Speech Token Adaptation for Efficient Spoken Dialogue Models

Spoken Dialogue Models (SDMs) typically share a speech-token space for generation and synthesis, leading to long autoregressive sequences and costly inference. Lower-rate speech tokenizers shorten sequences but may introduce compression-quality trade-offs and costly replacement without breaking this coupling. To addres...

Ying-Zhuo Deng, Chong Li, Bing Liu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

When Judges Agree and Are Wrong: Consistency-Accuracy Dissociation as a Blind Spot for Label-Free Evaluation

Label-free evaluation methods, such as self-consistency filtering, majority-vote aggregation, and agreement-based reliability scoring, rely on an implicit assumption that consistency can serve as a proxy for correctness when ground-truth labels are unavailable or expensive to obtain. In this paper, we test this assumpt...

Xiang Zhang, Lovedeep Gondara, Jekaterina Novikova · 1 citation
#artificial intelligence Preprint Open access Oct 2026

ToolBottleneckBench: Measuring Tool-Agent Performance under Controlled Pressures and Fixed Harness Budgets

The success score of a tool agent reflects both its model and the budgets of the harness that runs it. We present ToolBottleneckBench, a benchmark that measures tool-agent performance under controlled pressures and fixed harness budgets. Synthetic enterprise tasks stay fixed while one pressure varies: the registered to...

Zichuan Xu, Yuyang Dong, Makoto Onizuka et al. · 0 citations
#artificial intelligence Preprint Oct 2026

A Jury, Not an Electorate: Label-Free Reliability Estimation for Ensembles of Language Models

The jury, with nine experts of up to 3B parameters, performs comparably to the same fusion rule with label-fitted weights, showing no statistically significant advantage from supervision, and outperforms the best single model with matched self-consistency and the strongest label-free alternative on the full benchmark.

A. Rozza, D. Mambelli, S. Motta et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews

Peer review is under strain from the growth of submissions, and review comments written by humans or AI can misstate what a paper says. We introduce ReviewFact, a benchmark that labels such factual errors in review comments under one definition across NLP, machine learning, and the natural sciences, and that measures c...

Dingjie Song, Zhiling Yan, Ziqian Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

ReviewPilot: A Multi-Agent System for Screening and Data Extraction in Systematic Reviews

Systematic literature reviews follow the PRISMA process of screening scholarly works and extracting evidence from included studies. Deep research tools based on large language models (LLMs) can search and summarize the literature but do not record which studies are excluded or where extracted values come from. We devel...

Zhaoqian Xue, Shaoze Zhou, Xuexin Li et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Learning to Read Out: Unembedding Dynamics in Language Model Pretraining

When does a language model acquire a capability? Developmental studies usually answer this by tracking when models start producing the correct token. But that prediction passes through the unembedding matrix, or readout, which is itself still being learned during pretraining. We show that a model's hidden states can en...

Matteo He, William F. Shen, Alexandru Iacob et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Same Context, Different Agents: A Behavioral Study of Semantic Layers, Orchestration and Compaction in Data Agents

Answering questions over heterogeneous data means combining evidence from files, databases, documents and the web. Data agents automate this, but their success depends on context. Three context-engineering techniques (CETs) help by shaping it: semantic layers describe the data, orchestration splits work among agents, a...

Zhivar Sourati, Marianne Menglin Liu, Zheng Wang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Wrong Votes, Right Gradients: Why Majority-Vote Rewards Track Verifiable RL

Reinforcement learning with self-generated labels, such as majority vote over a model's own samples, often recovers most of the gain of training with verifiable rewards. This is puzzling from the usual prompt-level view, in which majority vote only returns a model's modal answer and cannot add information about correct...

Dylan Wilson, Chengsong Huang, Jia-Xin Huang · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Probing Negation Understanding in Vision-Language Models With Object Attention

Negation is a fundamental aspect of language understanding and it is important vision-language models (VLMs) are able to process it effectively. We investigate how VLMs process negation by analysing attention patterns of different models. We draw comparisons between human gaze and attention in models when processing af...

Beth Pearson, Michael Wray, Martha Lewis · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.