Skip to content

Category

natural language processing

9,568 papers

#natural language process... Preprint Open access Nov 2026

DecisionRank: On-Policy Distillation for Decision-Model Rerankers

Decision models target structured tasks by directly predicting choices or scores, avoiding autoregressive decoding latency. However, transferring a generative LLM's ranking knowledge to a decision model remains challenging: the teacher expresses preferences through a ranked list of document ID sequences, while the stud...

Yanran Wu, Dian Yu, Chongyang Bai et al. · 0 citations
#natural language process... Preprint Open access Nov 2026

RangeSWA: Training-Free Length Extrapolation for Continuous Diffusion Language Models

Continuous diffusion language models show promising potential in text generation tasks, but are prone to problems such as text repetition, semantic drift, and generation quality degradation when the generation length exceeds the training length. To address these challenges, we propose RangeSWA, a training-free length e...

Guangfu Guo, Xiaoqian Lu, Linsey Pang et al. · 0 citations
#natural language process... Preprint Oct 2026

PersonaChatBench: Evaluating Chat Assistants with Diverse Simulated Users

PersonaChatBench is introduced, a framework for evaluating task competence and responsiveness to diverse user needs that provides a basis for evaluating consistency across users and guiding the development of assistants that better accommodate diverse needs in everyday applications.

Zhe-Yuan Deng, Tao-Ran Li, Jing-Wen Zhang et al. · 0 citations
#natural language process... Preprint Oct 2026

Asynchronous Flow Map Language Models

Asynchronous flow map language models (aFMLMs), which incorporate prediction order into one-step modeling by learning the flow maps of asynchronous flows, are introduced, which can generate all tokens in a single forward pass by internalizing the ordering encoded in the flow into their hidden computations.

Chanhyuk Lee, Wonjung Kim, Patrick Pynadath et al. · 0 citations
#natural language process... Preprint Oct 2026

TurnTurk-GPT: Text-Based Turn-Taking Prediction for Turkish

TurnTurk-GPT outperforms the multilingual detector under both recording-disjoint and speaker-disjoint evaluation, and its gain over a zero-shot Turkish language model is largest for speakers seen in training, while on unseen speakers it matches this strong baseline.

Ahmet Tugrul Bayrak, Fatma Nur Korkmaz, Nur Yağmur Tuncer et al. · 0 citations
#natural language process... Preprint Open access Nov 2026

Iterated Integrals as Lexical Fingerprints: Path Signature Embeddings for Lexical Similarity

While sentence embeddings are primarily designed for semantic generalization, their latent geometry implicitly encodes surface-level lexical properties, a relationship that remains poorly understood. Shallow pooling methods discard word order, while deep Transformer models obscure these lexical alignments behind comput...

Raj Shekhar Singh, Pratham Agarwal · 0 citations
#natural language process... Preprint Oct 2026

Stepwise-Querying: Distilling Reasoning without Access to Teacher Chain-of-Thought

This work proposes Stepwise Querying, which elicits step-specific explanations without requiring access to the teacher's internal chain-of-thought (CoT) traces, and introduces Stepwise Explanation Information Gain (SEIG), a diagnostic based on the log-ratio of a frozen student's probabilities of correct step completion...

Di-Cong Yu, Wen-Hua Wang, Tian Wang · 0 citations
#natural language process... Preprint Open access Nov 2026

GraphNIAH: A Benchmark for Long-Context Reasoning over Real-World Graphs

The needle-in-a-haystack (NIAH) benchmark was introduced as a test for measuring a model's ability to find small relevant facts within a very large body of input text. However, existing NIAH benchmarks each suffer from one or more of the following limitations: (1) reliance on synthetic data, so their evaluations may no...

Minh-Nam Tran, Abulhair Saparov · 0 citations
#natural language process... Preprint Open access Nov 2026

Precision--Recall Trade-off on the Inference Level for LLMs in Grammatical Error Correction

Large language models (LLMs) have recently been adopted for Grammatical Error Correction (GEC), achieving strong performance via both full fine-tuning and prompt-based approaches. As probabilistic sequence models, LLMs expose inference-time parameters that directly modify token generation behavior; however, their poten...

Ryszard Staruch, Filip Grali\'nski · 0 citations
#natural language process... Preprint Oct 2026

Saidzoda-Tajik-LFM-2.6B: Adapting a 2.6B Hybrid Model to Tajik Tool Calling, and What Continued Pretraining Takes Away

We release Saidzoda-Tajik-LFM-2.6B, a Tajik adaptation of the 2.6B-parameter hybrid model LFM2.5-2.6B-Base, built for tool calling in Tajik on modest hardware. The recipe has two stages: LoRA continued pretraining (CPT) on 1,485,319 cleaned Tajik web documents for 3 epochs, then one epoch of supervised fine-tuning (SFT...

Tohir Saidzoda, Nekruz Maxudov, Bedil Karimov et al. · 0 citations
#natural language process... Preprint Open access Nov 2026

Digital sovereignty in professional translation workflows: a case study of migrating from Windows to Linux

This study examines digital sovereignty in professional translation through a screening of computer-assisted translation tools and translation management systems, and a case study of migrating a translator's workstation from Windows to Linux. The framework combines three principles - Control, Continuity and Exit - with...

Michael Farrell · 0 citations
#natural language process... Preprint Open access Nov 2026

CEFR Level Assessment across Languages and Text Granularities

Automatic assessment of textual CEFR levels is an important task in educational natural language processing. However, accurate CEFR level prediction remains challenging due to the naturally imbalanced distribution of CEFR levels and the ambiguous boundaries between adjacent levels. To address these challenges, we propo...

Eugene Matsumura, Yuki Arase · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.