Skip to content

Category

natural language processing

2,491 papers

#machine learning Conference Jan 2026

Audit Me If You Can: Query-Efficient Active Fairness Auditing of Black-Box LLMs

BAFA, the Bounded Active Fairness Auditor is introduced, the Bounded Active Fairness Auditor for query-efficient auditing of black-box LLMs, suggesting that active sampling can reduce resources needed for independent fairness auditing with LLMs, supporting continuous model evaluations.

David Hartmann, Lena Pohlmann, Lelia Hanslik et al. · 7 citations
#artificial intelligence Preprint Dec 2025

ScalePRM: Training Process Reward Models by Scaling Verification Compute Without Ground Truth

ScalePRM, which scales verification compute as an alternative to ground-truth supervision for training process reward models, generates multiple independent verifications of each reasoning step and aggregate their judgments to produce synthetic step-level labels without ground truth.

Salman Rahman, Sruthi Gorantla, Arpit Gupta et al. · 0 citations
#machine learning Preprint May 2025

Kronecker Factorization Improves Efficiency and Interpretability of Sparse Autoencoders

KronSAE is proposed, a design that factorizes the latent space into heads and forms post-latent features as pairwise compositions of lower-dimensional pre-latents using mAND, a differentiable AND-like interaction that imposes a compositional co-activation prior while remaining compatible with standard SAE objectives and variants.

Vadim Kurochkin, Yaroslav Aksenov, Daniil Laptev et al. · 1 citation

You Do Not Fully Utilize Transformer's Representation Capacity

Layer-Integrated Memory (LIMe) is introduced, a lightweight extension that leverages existing key-value buffers and learns per-head, per-layer routing weights to integrate representations from previous layers to improve perplexity per FLOP and yield strong gains on synthetic tasks while preserving higher value-vector entropy and token separability.

Gleb Gerasimov, Yaroslav Aksenov, Nikita Balagansky et al. · 4 citations

Amortizing intractable inference in large language models

This work interprets chain-of-thought reasoning as a latent variable modeling problem and demonstrates that this distribution-matching paradigm of LLM fine-tuning can serve as an effective alternative to maximum-likelihood training and reward-maximizing policy optimization.

Edward J. Hu, Moksh Jain, Eric Elmoznino et al. · 110 citations · ⚡19
#machine learning Preprint Aug 2026

TopoCompress: Long Context Compression via Graph-Wired Semantic Trajectories

TopoCompress is introduced, a training-free and model-agnostic framework that compresses long contexts by selecting coherent semantic spans by selecting coherent semantic spans and achieves performance comparable to the strongest baseline while using a 4x smaller compression budget.

Daniel Agyei Asante, Yang Li · 1 citation
#artificial intelligence Preprint Aug 2026

SingProbe Technical Report

SingProbe is introduced, a lightweight intrinsic runtime guard that directly reuses hidden states produced during LLM inference and operates alongside autoregressive decoding and extends this paradigm to medical generation through SingProbe-Med, which selectively activates risk-directed decoding interventions only when clinically relevant risks emerge.

Singg Team · 0 citations
#machine learning Preprint Aug 2026

What It Costs to Compose, Rebuild, and Correct Precomputed Memory

Both warm-rebuilding trained compressions of key-value caches and serving specifically-phrased updates beside a memory, as pasted text or injected cache state, show particular promise for keeping precomputed memories current, the latter as an interim measure between rebuilds.

Asa Shepard · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.

MIT News · Artificial Intelligence Aug 20, 2026

Paving the way for greener ammonia production

New MIT research could lead to better materials for a fossil-fuel-free process for making the chemical that's essential to fertilizer and other products.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.