Skip to content

Category

natural language processing

9,568 papers

#machine learning Preprint Oct 2026

LED: Improving Masked Diffusion Language Models by Lookahead Editing

This design introduces a rewritable proposal that uses additional compute to improve expressivity while keeping the simple mask-based transition schedule of MDMs, and fine-tune Qwen2.5-7B and Qwen3-8B to obtain LED-\texttt{7B} and LED-\texttt{8B}, respectively.

Yu-Yan Zhou, Ze-Yuan Yang, Yuxuan Song et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Can LLMs predict the outcomes of machine learning experiments?

This work evaluates how accurately large Language Models predict the impact of self-generated ML experiment ideas before these are put into training runs to show that current LLMs have useful but limited intuition about which ML ideas will work.

Ayush Bansal, Aldo Pareja, S. Klein et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Progressive Misalignment Can Emerge from Benign Recursive Self-Distillation

This paper observes that when a safe model is recursively self-distilled on its own (safe) generations while receiving an additional non-harmful cue, it becomes increasingly misaligned across a diverse set of harmful queries; it is called Progressive Misalignment.

Karim Abdel Sadek, F. Di Gennaro, Fanny Yang · 0 citations
#machine learning Preprint Oct 2026

Binding-Specific Relearning Savings for Test-Time Continual Learning

This work tests whether learning a specific factual binding produces a later relearning advantage beyond familiarity with its entity, answer vocabulary, format, or query slot, and whether that advantage remains positive after adjustment for measured pre-relearning behavior.

Zhe Zhou · 0 citations
#artificial intelligence Review Open access Jan 2026

Scalable Real-Time Data Pipelines for AI and Machine Learning–Driven Enterprise Systems

It is concluded that horizontally scalable, log-based messaging, combined with fault-tolerant, in-memory and micro-batch computation and durable, replicated storage constituted the technical foundation that made real-time, ML-driven enterprise analytics feasible within this period and that this layered architecture con...

Harsh Verma · 0 citations
#natural language process... Preprint Open access Oct 2026

ORACLE-SWE: Quantifying the Contribution of Critical Information Signals on SWE Agents

Recent advances in Language Model (LM) agents have increasingly focused on repository-level software engineering (SWE) tasks, leading to various agentic workflows, training methods and failure analysis. Interestingly, rather than directly generating or evaluating edit patches, these approaches first examine and improve...

Kenan Li, Qirui Jin, Liao Zhu et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

Cost-Efficient RAG for Entity Matching with LLMs: A Blocking-based Batch Processing Framework

Large language models (LLMs) offer a compelling approach to entity matching (EM) in label-scarce settings, yet their matching quality is sensitive to records with ambiguous or sparse attributes due to the absence of external factual grounding. Retrieval-augmented generation (RAG) directly addresses this grounding gap b...

Chuangtao Ma, Zeyu Zhang, Arijit Khan et al. · 0 citations
#computer vision Preprint Open access Oct 2026

Can MLLMs Read the Room? A Multimodal Benchmark for Assessing Deception in Multi-Party Social Interactions

Despite their advanced reasoning capabilities, state-of-the-art Multimodal Large Language Models (MLLMs) still lack a core component of human intelligence: the ability to "read the room" and assess deception in complex social interactions. To rigorously evaluate this limitation, we introduce Multimodal Interactive Dece...

Caixin Kang, Yifei Huang, Liangyang Ouyang et al. · 0 citations

How Do LLM-Generated Texts Impact Term-Based Retrieval Models?

This paper investigates the influence of LLM-generated content on term-based retrieval models, and reveals that LLM-generated texts exhibit smoother high-frequency and steeper low-frequency Zipf slopes, higher term specificity, and greater document-level diversity.

Wei Huang, Ke-Ping Bi, Yin-Qiong Cai et al. · 1 citation
#natural language process... Preprint Open access Oct 2026

Enhancing Knowledge Density via Hierarchical Context Pruning for Retrieval-Augmented Repository-Level Code Completion

Retrieval-Augmented Generation (RAG) has advanced repository-level code completion by retrieving external code snippets, API documentation, or type definitions to expand the model's contextual awareness. However, under the finite token budget of the context window, existing retrieval-augmented methods often saturate th...

Xiaohan Chen, Xiang Chen, Yu Tian et al. · 0 citations
#natural language process... Preprint Open access Oct 2026

X-Alpha: An AI Quant Researcher with Memory-Driven Self-Evolution

Human quantitative researchers mine alpha through an iterative process: they derive hypotheses from financial knowledge, implement and test them as factors, and use the resulting evidence to guide subsequent research. Yet automated alpha mining faces three key bottlenecks: noisy financial knowledge is not directly acti...

Fengyuan Liu, Yuchen Fu, Yuqi Wang et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.