Skip to content

Category

natural language processing

9,568 papers

Protection Is Not One Event: A Survey of RAG Protection Research by Measured Endpoint

A systematic survey and human-coded evidence map of 118 full-text-confirmed RAG defense papers, organized by measured endpoint rather than claimed goal or defense mechanism, and the taxonomy, dataset, coding protocols, and testbed are released to enable comparable, claim-aligned RAG security evaluation.

Peiyang Liu, Xi Wang, Di Liang et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Finitely Verifiable Segmentation: Decidability for Every Tokenizer with a Finite-State Verifier

A segmentation policy assigns to each byte string at most one segmentation into tokens. Call it finitely verifiable when a finite automaton over marked strings, bytes paired with boundary bits, accepts exactly the policy's own segmentations. The automaton judges a proposed segmentation and need not compute one. The pap...

Nicklas Nidh\"ogg · 0 citations
#artificial intelligence Preprint Open access Oct 2026

When Multiple Choices Are Correct: Asymmetric Probability Allocation in Jev and Other Decision Models

Decision models return normalized probability distributions over candidate choices, which downstream applications can use to select among choices. Although their providers emphasize the reliability of these probabilities, calibration on tasks with a single correct choice does not establish their reliability when multip...

Rushab Munot · 0 citations
#machine learning Preprint Jan 2026

ChemBART: Pre-training a Reaction Language Model for Comprehensive Synthesis Planning

This work presents ChemBART, a BART-based language model that adopts a reaction-centric pre-training strategy that unifies diverse chemical tasks to facilitate synthesis planning with comprehensive implementation information and highlights the potential of reaction-focused pre-training.

Kenan Karina Li, Yi-Jian Zhang, Jin Wang et al. · 0 citations
#artificial intelligence Conference Open access Sep 2025

Domain-Specific Constitutional AI: Enhancing Safety in LLM-Powered Mental Health Chatbots

This work introduces an approach to apply Constitutional AI training with domain-specific mental health principles for safe, domain-adapted CAI systems in computational mental health applications.

Chenhan Lyu, Yu-Tong Song, Pengfei Zhang et al. · 7 citations
#artificial intelligence Preprint Open access Oct 2026

Low-Bit N-Gram Embeddings for Language Models

Many recent open-weight language models use n-gram embedding tables to improve performance. These tables store learned representations of short token sequences, such as pairs or triples of consecutive tokens, which the model retrieves during processing. However, they can require substantial memory: DeepSeek-V4.1-Flash,...

Stephen Chung, Wenyu Du · 0 citations
#natural language process... Preprint Open access Oct 2026

Can an Agent Debug a Web Corpus? Agentic Auditing of Slovak FineWeb2

Multilingual pipelines such as FineWeb2 apply one recipe across a thousand languages, leaving the failure modes of individual languages unanticipated. We use an LLM once, as a corpus debugger rather than a classifier: a tool-using agent explores the corpus through a read-only, budgeted API and compiles each finding int...

Marek \v{S}uppa, Ivan Vykopal, Jaroslav Kop\v{c}an · 0 citations
#natural language process... Preprint Open access Oct 2026

Bilingual Language Models Capture Cross-Linguistic Influence in Second-Language Reading

While monolingual language model (LM) surprisal is widely established as a predictor of reading times, it cannot capture the non-native (L2) reading dynamics that are shaped by the reader's first language (L1). In this work, we investigate whether the cross-lingual transfer within bilingual models aligns with human L1-...

Abderrahmane Issam, Irene E. Winther, Stefan L. Frank · 0 citations
#artificial intelligence Preprint Oct 2026

How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions

Purpose: To describe an evidence-aware retrieval evaluation protocol for a clinical retrieval-augmented generation (RAG) system over breast lesion management literature, addressing the dependence of retrieval scores on annotation coverage. Methods: An 18-document corpus and an 18-query development benchmark, with one Y...

Miguel Mochizuki Silva, Samuel Ismael, Mateus C. Dias et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

An Empirical Study of Recent Large Language Models for Knowledge Graph to Text Generation on Standard Benchmarks

Knowledge graph-to-text (KG-to-text) generation verbalizes a set of knowledge graph triples into fluent natural language. While fine-tuned encoder-decoder models have long been the standard approach, recent LLMs are becoming increasingly competitive. We benchmark recent LLMs against fine-tuned encoder-decoder models, u...

Priyanka, Renaud Delbru, Souhail Bakkali et al. · 0 citations
#artificial intelligence Open access Oct 2026

The Geometry of Metaphor: Probing and Steering Metaphor Representations in Large Language Models

Metaphor is a crucial aspect of human cognition. As such, we would like to understand how it is represented in large language models (LLMs) and how it might be controlled. We use mechanistic interpretability techniques to identify causal subspaces in a range of LLMs covering different architectures and sizes. We show t...

Shi-Hui Li, Mette Friis Andersen, Martha Lewis · 0 citations
#natural language process... Preprint Oct 2026

Towards User Simulators That Stay On Task And Still Sound Natural

Users increasingly rely on AI systems for extended, multi-turn tasks, yet evidence indicates that LLM-based system performance degrades over prolonged interaction. To evaluate and improve AI assistants in such settings, we need user simulators that faithfully follow complex user intents while exhibiting realistic conve...

Mustafa Omer Gul, Philippe Laban, Tanya Goyal et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.