Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Open access Oct 2026

When More Metadata Misleads: Probing Field-Level Grounding in LLM-Generated Museum Descriptions

Metadata-conditioned generation is often framed as a data-to-text task in which additional input fields should improve grounding. Museum description generation challenges this assumption because catalogue records are heterogeneous, partially visual, and unevenly documented across geographic regions. We study how metada...

Clemencia Siro, Laura Hollink · 0 citations
#artificial intelligence Preprint Oct 2026

Prompting Strategy Effects Depend on the Judge: A Multilingual Study of LLM-as-a-Judge Robustness

LLM-as-a-Judge evaluation is increasingly applied to multilingual tasks, yet prompting strategies such as Chain-of-Thought and Role Conditioning are recommended based solely on English benchmarks. Whether their effectiveness transfers across judge models and languages remains unknown: prompt-sensitivity studies are lar...

A. Mehrabi, Mohammad Aliannejadi, Clemencia Siro · 0 citations
#artificial intelligence Preprint Oct 2026

Prompt Sensitivity in Tool-Augmented Model Comparisons

Language models are compared on question-answering benchmarks that pose each question in one wording, and a reworded question can change which of two models scores higher. We ask whether giving the models tools makes such comparisons more stable. An accuracy gain cannot answer this, because tools change several steps b...

M. Modrzejewski, Tomasz Radzikowski · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Mixing Matters: Evidence Position Bias Across Sequence Mixers in Long-Context Question Answering

Long-context models often use answer-bearing evidence less effectively when it appears away from a prompt boundary. We compare this position bias across Transformer, state-space, and hybrid Mamba architectures by moving one gold document through a fixed set of nine distractors. The evaluated Transformers show a beginni...

Aman Behera, Namit Solanki, Mehul Anand · 0 citations
#machine learning Preprint Open access Oct 2026

Delta N-gram: Forward-Only Continual Writing into a Language Model's Native N-gram Memory

Our previous analysis found that a model's native hashed N-gram table is where continual updates disturb the base least, but its writes needed backpropagation and changed the pretrained table. We present Delta N-gram, a forward-only write path into that table. The pretrained table T^0 is never modified. Evidence is wri...

Hao Wu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Mostly Reading: What Open-Book Scores Measure in Document-Level LoRA Adapters

Single-document LoRA adapters have been proposed as units of knowledge to be merged and retrieved; yet open-book scoring, with the document in the prompt, can credit a document's own adapter (its specialist) for reading that document as readily as for holding it. Training one adapter for each of 150 Wikipedia articles...

Martino M. L. Pulici, Cuong Xuan Chu, Evgeny Kharlamov et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Joint or Per-Option? Compact Encoders for Closed-Set Decisions from 17 Million to 1 Billion Parameters

Many language-model pipelines end in a closed-set decision, such as selecting a tool. Prompting a large language model for it is slow and order-sensitive. We ask how small an encoder for such decisions can be and whether it should read the options jointly or separately. In a three-seed study at 32 million parameters, p...

Tardelli Ronan Coelho Stekel · 0 citations
#artificial intelligence Preprint Oct 2026

Scaling Laws for Safety Probes

Six new safety datasets of sufficient size and difficulty are constructed and it is found that probe error follows two simple scaling laws, which allow safety researchers to determine how to create the best probe for any given model and label budget.

Yu-Chen Wu, Jerry W. Wei · 0 citations
#artificial intelligence Preprint Oct 2026

Consistency Is Not Validity: Self-Rewarded Moral Argumentation Makes Language Models Decisive but Pliable

It is concluded that consistency under reordering can be optimized without improving the moral judgment it is meant to signal: consistency under reordering can be optimized without improving the moral judgment it is meant to signal.

Marius De Kuthy Meurers, Aaron T. Parisi, Bernd Bohnet · 0 citations
#machine learning Preprint Open access Oct 2026

AQL-Lite: Enabling Efficient Knowledge Acquisition for Arabic LLMs via Data-Centric Continual Pretraining

Training Arabic large language models faces challenges from noisy web data, dialectal variation, and the high cost of continual pretraining (CPT). We introduce AQL-Lite (AQL: Arabic Quality Language), a time- and resource-efficient framework for adapting a multilingual LLM to Modern Standard Arabic (MSA). AQL-Lite coup...

Houssam Eddine Boukhalfa, Mourad Bouache, Mourad Dahmane · 0 citations
#machine learning Preprint Open access Oct 2026

baseVultra: Compact Nonlinear Recurrence with Reallocated Capacity

Nonlinear recurrent networks remain useful for streaming sequence modeling, yet gated cell design is still dominated by LSTM and GRU. We study whether recurrent computation can be reallocated away from gate transforms and toward candidate generation. We propose baseVultra, a compact recurrent cell that concentrates the...

Linke Zhang · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.