Skip to content

Category

natural language processing

3,231 papers

#natural language process... Preprint Aug 2026

First Make It Playable, Then Make It Good: Staged Interaction Learning for Small Dialogue-Game Agents

It is suggested that imitating full trajectories helps with playability, while turn-level and teacher-guided training usually improve decision-making and increase the overall score, and small models are performant simply by using careful curation strategies rather than aggressive changes.

Syed Mahbubul Huq, P. Madhyastha · 0 citations
#natural language process... Preprint Aug 2026

Below the Noise Floor: Bimodal Seed Collapse and Distinct Failure Modes in Small-Model Knowledge Distillation

On a 740-instance healthcare API routing task with a 1.5B Qwen student and a 20B teacher, eight KD variants are compared against supervised cross-entropy, finding single-seed evaluation is unable to detect central failure modes in small-model KD.

Dipto Sumit, Sakib Ul Haque, Farig Sadeque · 0 citations
#natural language process... Preprint Aug 2026

AI Writers Have a Consistent Stylometric Footprint, but AI Editors Do Not

It is shown that AI generation leaves a consistent ``stylometric footprint'': a small subset of features, primarily entropy and lexical diversity, consistently separates AI-generated text from human writing across 8 LLMs and 5 domains, while the remaining features depend heavily on the domain and generator.

Zhengyang Shan, Yukyung Lee, Sophie Hao · 0 citations
#natural language process... Preprint Aug 2026

Speculative Probing: LLM Monitoring at Speculative-Decoding Cost

It is found that the speculative-decoding module in recent LLMs can be repurposed for efficient high-quality classification by appending a trained soft prompt at the end of the target sequence, which can repurpose the speculative-decoding module into a sequence classifier.

Collin Zhang, Tingwei Zhang, Vitaly Shmatikov · 0 citations
#computer vision Preprint Aug 2026

Trustworthy RAG: An Evaluation Agent for Detecting Misinformation and Knowledge Poisoning in Generative AI Systems

An Evaluation Agent, middleware that combines Natural Language Inference factual verification, a five-signal poison detector with relevance-weighted aggregation, and a Trust Index is proposed, which reliably blocks instruction injection of unsafe advice while contradiction and subtle semantic weakening remain hard.

Balkrishna Giri, M. Hasan, Jussi Rasku et al. · 0 citations
#machine learning Preprint Aug 2026

Demystifying Reinforcement Learning Post-Training of Language Models

This work deconstructs the RL post-training algorithm, investigating each step to clarify what is actually happening beneath the surface, and uses the entropy of the policy's output distribution as a lens to compare the distributions learned through pretraining, SFT, and RL post-training, revealing how each stage shapes model certainty.

D. Clay, Saket Gollapudi, Sankar V Harilal et al. · 0 citations
#computer vision Preprint Aug 2026

What's the Catch? Evaluating Temporal Consistency in Vision-Language Models

It is indicated that current VLMs can identify anomalies within individual frames but struggle to integrate information across frames to reason about temporal consistency, and TimeCatch provides a controlled benchmark for evaluating temporal grounding in vision-language models.

Marek Hradil, Danae Sánchez Villegas · 0 citations
#natural language process... Preprint Aug 2026

Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within $5090

This report presents an open pretraining recipe that trains a collection of Puro-2B models from scratch on up to 1.4 trillion tokens with FP8 precision on consumer-grade RTX 5090 GPUs, and derives a Puro Cost Scaling Law that relates training cost to average model performance.

Kairong Luo, Jia-Rui Cui, Yao-Rui Yin et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.

MIT News · Artificial Intelligence Aug 20, 2026

Paving the way for greener ammonia production

New MIT research could lead to better materials for a fossil-fuel-free process for making the chemical that's essential to fertilizer and other products.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.