Skip to content

Category

natural language processing

9,568 papers

#natural language process... Preprint Open access Oct 2026

PremiseSQL: Evaluating Premise Critique and Abstention in Text-to-SQL Systems

Recent advances in large language models (LLMs) have substantially improved Text-to-SQL performance, yet existing NL2SQL systems largely assume that user queries are valid and answerable. As a result, models often generate executable SQL even for queries with flawed premises. We introduce premise critique ability in NL...

Shuo Lin, Jinzhe Li, Chenlu Guo et al. · 0 citations

Intern-Decision: Efficient Multimodal Decision Making with Autoregressive Masked Language Modeling

Interactive agents repeatedly choose among a finite set of actions, labels, or ordinal outcomes. Generating a free-form response for each choice adds latency and complicates the interface between a model and its environment. We present Intern-Decision, a family of 0.8B, 2B, and 4B multimodal decision models that return...

Tong Zhu, Zhe Xu, Ze-Feng He et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Unfragmenting Nawatl NMT: Single-Variant Specialization for Masewalkopa

In minoritized (low-resource) language technologies, a common response to data sparsity is to aggregate text across multiple varieties and treat the combined data as a single corpus. However, mixed corpora of closely related indigenous variants can produce an artificial register that is accountable to no single speaker...

Luis A. Mercado-Campos, Alexis Palmer · 0 citations
#natural language process... Preprint Oct 2026

Beyond Context Length: Characterising the Difficulty of Long-Context Reasoning

Long-context language models support ever longer context windows, and evaluations typically treat context length as the main indicator of difficulty. However, context length alone cannot explain why models fail on long-context tasks that require reasoning over complex information. Contexts of equal length can pose very...

Shi-Wen Qin, C. Barker, Henry Gouk et al. · 0 citations
#natural language process... Preprint Oct 2026

Name-Bias in Large Language Models

Names carry demographic indicators such as age, gender, and race, which makes them a subtle but strong target of bias in large language models (LLMs). In this work, we present an evaluation of name-based bias across 6 local large language models spanning multiple providers and parameter scales. Using a fill-in-the-blan...

Kalyan Bhetwal, Ceren Mert, Ian Whitehouse · 0 citations
#natural language process... Preprint Open access Oct 2026

Learning Speech Attribute Representations via Multi-Teacher Distillation

Recent post-training approaches have shown that self-supervised speech encoders can be adapted to learn a single utterance-level speech attribute through knowledge distillation. In this work, we investigate whether a single speech encoder can simultaneously preserve multiple complementary utterance-level speech represe...

Maryem Bouziane, Salima Mdhaffar, Yannick Est\`eve · 0 citations
#natural language process... Preprint Oct 2026

TEM: Temporal State Tracking Memory for Large Language Model Agents

An agent's memory must remain useful as information changes across conversations. A new fact may replace an earlier value without making that value irrelevant to a later question. We present Temporal State Tracking Memory (TEM), a training-free framework for tracking these changes. TEM stores facts as versioned records...

Peng Song, Yun-Kai Zhuang, Li-Ye Shi · 0 citations
#natural language process... Preprint Open access Oct 2026

Dynamic ordering in sequence generation in Transformers: experiments on low-resource Tagging scenarios

This paper introduces TagInsert, a Transformer-based model that challenges the common left-to-right (L2R) generation paradigm in Transformers, for sequence labelling tasks where dependencies may not naturally align with a L2R order. TagInsert lifts the L2R constraint by removing the decoder-side attention mask and enab...

Giacomo Bais, Tejaswini Deoskar · 0 citations
#natural language process... Preprint Open access Oct 2026

Content associations with answer selection and engagement in supply chain community question answering

Community question-answering platforms are important ecosystems for knowledge sharing, yet research on what makes an answer best or a question engaging has often focused on either individual lexical features or broad topics. This exploratory study examines both levels in Yahoo! Chiebukuro, asking which nouns and semant...

Hisatoshi Naganawa · 0 citations
#natural language process... Preprint Open access Oct 2026

Behavioral Forgetting Is Not Privacy in Machine Unlearning

Machine unlearning aims to remove targeted information from large language models, but existing evaluations often measure forgetting only on a designated benchmark distribution. We argue that such behavioral forgetting is an insufficient standard for privacy-oriented unlearning, and that evaluation should instead test...

Tyler Lizzo, Larry Heck · 0 citations
#natural language process... Preprint Open access Oct 2026

SceneWeave: Audience-Guided Scene Exploration for Dramatic Adaptation

Adapting prose into a script requires transforming narration and inner experience into scenes that convey relationships and psychological contradictions. Planning specifies intended effects but leaves their realization in dialogue and action unresolved. Drawing on screenwriters' accounts of revising scenes and their co...

Aolin Li, Xiao Xu, Haihua Xie · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.