Skip to content

Category

natural language processing

9,568 papers

#natural language process... Preprint Oct 2026

PA1-OPD: One-Step Prefix-Augmented On-Policy Distillation for Language Model Pretraining

Knowledge distillation (KD) improves language-model pretraining by matching teacher distributions at corpus prefixes, but provides no direct supervision at contexts induced by student predictions. We introduce PA1-OPD, which augments corpus-path distillation with teacher feedback after one student-sampled transition pe...

Zhen-He Wu, Jian Yang, Ya-Ping Jin et al. · 0 citations
#natural language process... Preprint Oct 2026

Moral Combat: Exploiting Moral Foundations Theory to Jailbreak LLMs

Social psychology has long described how people can be persuaded to interpret a harmful act as moral. Recent research suggests that Large Language Models (LLMs) echo aspects of human psychology, from cognitive biases to social conformity. This raises a question with direct safety implications: can LLMs be moralized to...

Adel Khorramrouz, Yi-Chia Wang, Sharon Levy · 0 citations
#artificial intelligence Preprint Oct 2026

REWIND: Uncertainty-Guided Trajectory Repair for Test-Time Reasoning

An early mistake in the generated reasoning can constrain all subsequent reasoning. Repeated-generation methods, like MCMC-based approaches, attempt to improve output quality by sampling multiple generations, but their effectiveness can be limited by randomly selecting where to regenerate. On MATH500 with Qwen2.5-Math-...

Yi-Cheng Ding, Meng-Yu Wang, Min Zhou et al. · 0 citations
#natural language process... Preprint Oct 2026

GraphRAG-LTM: A Layered Threat Modeling Framework for Attacks on Graph Retrieval-Augmented Generation

Graph retrieval-augmented generation (GraphRAG) uses document-derived knowledge graphs to assemble evidence for large language model (LLM) answers. Its security depends on both the seed chunks retrieved for a query and the graph evidence assembled from them, yet attacks on this evidence path remain underexplored. We in...

Yi-Ning Tang, Jun-Yu Zhang, Hao-Miao Qiu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Retrieve What Helps, Only When It Helps: Agentic Reinforcement Learning for Selective Retrieval-Augmented Machine Translation

Retrieving external knowledge can improve large language model (LLM) translation by providing supplementary information such as idiom interpretations and terminology. However, existing retrieval-augmented machine translation systems typically apply predefined retrieval strategies uniformly across all inputs. We argue t...

Shijun Li, Yang Liu, Najmeh Sadoughi et al. · 0 citations
#natural language process... Preprint Oct 2026

One Block Ahead: Promoting Sampler State in Diffusion Language Models

It is demonstrated that for uniform-state diffusion LMs, where a block's denoising progress is not visible in its intermediate tokens, concurrent decoding is advantageous if the next block's tokens are promoted together with the corresponding sampler state, including the self-conditioning signal and the denoising time.

Yang-Yi Shen, Pin-Jui Ku, Nicolai Oswald et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Structure-Preserving Document-Level Data Augmentation via Discourse Parsing

Data augmentation (DA) plays a vital role in improving model performance in low-resource or limited-supervision scenarios within Natural Language Processing (NLP). Existing DA methods, such as synonym replacement and back-translation, have demonstrated effectiveness on the word or sentence level; however, they frequent...

Rui-Lin Shang, Shi-Long Hou, Zi Long et al. · 0 citations
#natural language process... Preprint Oct 2026

Towards Efficient Simultaneous Inverse Text Normalization with Pretrained Text-to-Text Language Model and Read-Tag-Write Policy

Streaming Inverse Text Normalization (ITN) is vital for converting spoken-form outputs from streaming Automatic Speech Recognition into formatted written text. Existing streaming ITN methods rely on hybrid systems combining neural tagging with expert-crafted finite-state transducer rules, limiting scalability across do...

K. Hoang, Khanh Le, B. Nguyen et al. · 0 citations
#natural language process... Preprint Oct 2026

More Than Seeing: Vision as Scalable Anchors in Native Multimodal Pre-Training

Native multimodal pre-training trains a single model from scratch on text and multimodal data, enabling it to understand both language and visual inputs. However, how visual signals shape scaling behavior and support capabilities beyond visual understanding remains unclear. We investigate this question through controll...

Haoyuan Wu, Ao-Qi Wu, Jia-Ni Hu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

How Do LLMs Understand Legal Philosophy? Diagnosing Legal-Philosophical Reasoning in LLMs

Legal reasoning is a fundamental capability for large language models (LLMs) to complete legal AI tasks such as legal judgment prediction. In legal practice, this reasoning is shaped by legal philosophy: a judge's view of the nature and sources of law guides how legal materials are interpreted and applied, so judges wo...

Shuyuan Zheng, Yun-seo Lee, Xing Gao et al. · 0 citations
#natural language process... Preprint Oct 2026

ForkGRPO: Efficient Exploration and Fine-Grained Credit Assignment for Diffusion Language Models

Diffusion large language models (dLLMs) have advanced rapidly, yet strengthening their reasoning through reinforcement learning (RL) remains an open challenge. Any-order generation can suffer from entropy degradation, which narrows the reasoning paths available for exploration. Recent work mitigates this issue by apply...

Zhao-Yang Jia, Cheng-Wei Zhou, G. Datta et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.