Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Open access Oct 2026

Scale, Drivers, and Limits of Representational Alignment Across Large Language Models

Comparing large language models can reveal shared representational structure and systematic differences between them. However, aggregate similarity measures can obscure how agreement varies across geometric scales and which linguistic properties support it. We introduce two complementary methods to resolve where models...

Jialin Wu, Meenakshi Khosla · 0 citations
#artificial intelligence Preprint Oct 2026

RealityBench: Simulated Environments to Evaluate a Vision Language Model's Ability to Document Human Physical Work

Augmenting worker capabilities in the physical world through guidance has been a decades-long goal for AI agents. One key supporting capability is to understand what the worker is doing, seeing through the human's camera or smart glasses, and assist them in documentation. Despite advances in vision language models, the...

Andrew Perrault, Anmol Takiar, Dominik Winecki et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

RUBATO: Decoupled Clocks Allow Full-Duplex Models to Think as Fast as They Can

Recent Speech Full-Duplex (FDX) models are capable of engaging in naturalistic conversation by listening and speaking at the same time. Building on this foundation, recent architectures introduce internal thinking streams to enhance their intelligence. To guarantee these streams process successfully in real time, exist...

Yi-Jen Shih, Puyuan Peng, Haohe Liu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Agentic Data Engineering for LLMs: System Design and a Controlled Empirical Study

LLM data engineering requires iterative experimentation to determine how data selection, rewards, and curricula affect model learning, making it a natural setting for AI-for-AI (AI4AI) research. Can agents use experimental feedback to progressively improve strategies, and do the resulting strategies improve target-mode...

Ruomeng Ding, Qianli Shen, Zhaoyang Han et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Learnable Low-Rank Polynomial Sketch for Effective Linear Attention

Softmax attention in Transformers suffers from quadratic complexity in sequence length, making it impractical for long-context applications. Linear attention alleviates this issue by replacing the exponential kernel with alternative functions that enable linear-time computation. Among existing linear attention approach...

Zongyue Qin, Haoran Deng, Jason Cong et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation

Diffusion language models (DLMs) offer parallel sampling for faster generation than autoregressive models, an increasingly important advantage as inference becomes a dominant computational workload. However, DLMs degrade quickly with fewer sampling steps, process the full sequence at every step, and require many passes...

Hermann Kumbong, Ishan S. Khare, Iddah Mlauzi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Is the Future Predictable? Modeling Future Predictability for Reliable Temporal Reasoning

Large language models (LLMs) remain unreliable when reasoning about the future. Existing models often overlook the difference among future states, committing to specific answers even when the queried facts are inherently volatile. To capture this challenge, we introduce ChronoRegime, a future-oriented temporal reasonin...

Yongyi Huang, Huaping Zhang, Wenyao Cui et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Contrastive Covariance Subspaces for Activation Steering

Activation steering controls large language model behavior by adding a direction to hidden activations during inference. For steering to work well, that direction must be a pure signal for the target concept: any confound entangled with it, such as an incidental topic or writing style, is injected into the residual str...

Alexandros Xenos, Manos Plitsis, N. Foteinopoulou et al. · 0 citations
#artificial intelligence Review Sep 2026

SemTree: Judge-Aware Semantic Decision Trees for Inspectable and Repairable Rule Decisions

Rule decisions such as content moderation, advertising compliance, and eligibility checks combine several conditions, exemptions, and missing-information cases, and an error can be fixed only once the failing condition is known. We introduce SemTree, a framework that represents a rule decision as a semantic decision tr...

Jin-Cheng Gao, Wei Ding, Shuo Sun · 0 citations
#artificial intelligence Preprint Open access Oct 2026

GameSmith: Scaling Zero-Sum Self-Play with Synthesised Games

Post-training large language models (LLMs) on two-player zero-sum games provides a verifiable reward, and the gains have been shown to transfer to general reasoning. Existing pipelines, however, rely on a handful of hand-written games and on advantage estimators tied to them, so both the supply of games and the advanta...

Weixian Waylon Li, Jiaxin Zhang, Han Zhou et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

EmoXpt: Analyzing Emotional Variances in Human Comments and LLM-Generated Responses

The widespread adoption of generative AI has generated diverse opinions, with individuals expressing both support and criticism of its applications. This study investigates the emotional dynamics surrounding generative AI by analyzing human tweets referencing terms such as ChatGPT, OpenAI, Copilot, and LLMs. To further...

Shireesh Reddy Pyreddy, Tarannum Shaila Zaman · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.