Skip to content

Category

natural language processing

9,568 papers

#machine learning Preprint Open access Nov 2026

Does Reasoning Make Language Models Agree?

Language models face two opposing concerns: monoculture, in which models err in correlated ways, and multiplicity, in which equally accurate models make conflicting decisions. The rise of reasoning models has complicated this debate: On the one hand, reasoning may increase model agreement if models anchor on the same s...

Mila Gorecki, Moritz Hardt · 0 citations
#machine learning Preprint Open access Nov 2026

Enhancing Sentiment Classification on Small Datasets through Data Augmentation and Transfer Learning

Small-scale sentiment classification often suffers from data scarcity, which limits the generalization ability of the models. This study evaluates and compares the effectiveness of three data augmentation strategies: Easy Data Augmentation (EDA), back-translation, and contextual token substitution (nlpaug-style), with...

Mahmoud S. Mayaleh, Samer A. Mayaleh · 0 citations
#machine learning Preprint Open access Nov 2026

What We Keep of What We Forget: Replacement Operators and Routing Semantics in Training-Free MoE Expert Pruning

Training-free expert pruning makes two decisions: which experts to remove, and what the layer computes when its router still selects a removed expert. Published methods change both at once. Holding the mask fixed, we compare replacement operators from three families on OLMoE, DeepSeek-V2-Lite and Moonlight, with Granit...

Ezza Ali, Sehrish Bibi, Momina Moetesum et al. · 0 citations
#machine learning Preprint Oct 2026

MOSAIC: Addressing Disproportionate Task-Modality Dependencies via Modality-Partitioned Gradient Routing

MOSAIC (MOdality-Separated Architecture with Inter-modal Cross-attention), which preserves unimodal representations while enabling controlled interaction between them, and uses modality-specific losses to route gradients to their corresponding partitions, demonstrates that modality partitioning yields consistent gains...

Aryan Chowdhury, Yi-Zheng Sun, Thomas Carroll et al. · 0 citations
#machine learning Preprint Oct 2026

FARO: Function-Space Adaptive Return-to-Risk Optimization via Cross-Block Equal-Risk-Contribution Budget Allocation

FARO, a function-space adaptive optimizer that makes the partition of parameters into blocks the unit of decision, is introduced, a function-space adaptive optimizer that makes the partition of parameters into blocks the unit of decision.

Xiao-Jun Wu, Ce-Hao Yang, Xuhui Jiang et al. · 0 citations

EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective

This paper studies agent memory from a self-evolving perspective and introduces EvoMemBench, a unified benchmark organized along two axes: memory scope (in-episode vs. cross-episode) and memory content (knowledge-oriented vs. execution-oriented).

Yu-Yao Wang, Zhongjian Zhang, Mo-Han Chi et al. · 21 citations · ⚡1
#artificial intelligence Preprint Open access Nov 2026

M$^\star$: Every Task Deserves Its Own Memory Harness

Large language model agents rely on a memory harness to write, organize, retrieve, and use past experience. A harness that works for one task often fails on another, because conversations, embodied planning, and expert reasoning require different storage and retrieval behavior. To address this limitation, we introduce...

Wenbo Pan, Shujie Liu, Xiangyang Zhou et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

Enhancing Safety of Large Language Models via Embedding Space Separation

Safety alignment does not fully prevent large language models (LLMs) from producing harmful content under adversarial attacks. We observe that existing attack methods typically move harmful embeddings toward regions of harmless embeddings. This motivates us to explore whether increasing the distance between harmful and...

Xu Zhao, Xiting Wang, Weiran Shen · 0 citations
#artificial intelligence Book Open access Jan 2026

Eroding the Truth-Default: A Causal Analysis of Human Susceptibility to Foundation Model Hallucinations and Disinformation in the Wild

JudgeGPT and RogueGPT are presented, a dual-axis framework that decouples ''authenticity'' from ''attribution'' to investigate the mechanisms of human susceptibility and suggest that ''pre-bunking'' interventions should target cognitive source monitoring rather than demographic segmentation to ensure trustworthy inform...

Alexander Loth, Martin Kappes, Marc-Oliver Pahl · 10 citations
#artificial intelligence Preprint Open access Nov 2026

Optimizing Anytime Reasoning via Budget Relative Policy Optimization

Scaling test-time compute is crucial for enhancing the reasoning capabilities of large language models (LLMs). Existing approaches typically employ reinforcement learning (RL) to maximize a verifiable reward obtained at the end of reasoning traces. However, such methods optimize only the final performance under a large...

Penghui Qi, Zichen Liu, Tianyu Pang et al. · 0 citations
#artificial intelligence Preprint Open access Nov 2026

From Association to Causation: Improving Retrieval Precision of Retrieval-Augmented Generation via Causal Relations and an Attention Mechanism

Retrieval-Augmented Generation (RAG) grounds LLM generation on retrieved documents, but the standard terminal retrieval stage--dense-vector similarity, optionally followed by reranking--often returns documents that share keywords with the query without containing the needed information, a failure mode that grows with t...

Jing Liu, Yongxing Qi, Muchen Jiang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.