Skip to content

Category

natural language processing

3,089 papers

#machine learning Preprint Jul 2026

Accelerating LLM Inference via Vector Index Based Output Embeddings

This work reformulates the output projection followed by top-k token selection as a maximum inner product search over token embeddings and replaces the dense vocabulary projection with an HNSW-based vector index, suggesting approximate retrieval is a practical alternative to dense output projections in latency-sensitive small-batch decoding.

M. Loretz, Sepp Hochreiter · 0 citations
#machine learning Preprint Aug 2026

Fast Weight Attention for Continual Learning

This framework separates temporal alignment, plasticity, forgetting, and bounded rehearsal in recurrent sequence models, together with numerically stable positive-decay renormalization, to remain competitive in language modeling and improve length extrapolation on variable-digit addition.

Yi-Fan Zhang, Steve Ta, Jasper Zhang et al. · 0 citations
#machine learning Preprint Aug 2026

The Calls are Coming from Inside the Model: Investigating Probe-based Detection of Tool-Calling Errors in LLMs

Overall, it is found that probing is an effective means to catch a range of different tool-calling errors, including errors arising from using an argument that has the wrong value but the correct type, which might not be recorded by standard logging frameworks.

Eric C. Yeats, Brendan Kennedy, Loc Truong et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Comparing Chunking and Embedding Strategies for Turkish RAG Systems

This work compares Turkish document question answering across three chunking strategies, five embedding models, and two LLMs, over three documents with contrasting layouts, finding the faster LLM is not the more accurate one.

Mustafa Sertac Turkel, Fatma Nur Korkmaz, Ahmet Tugrul Bayrak · 0 citations
#artificial intelligence Preprint Jul 2026

Self-Generated Text Recognition: Quality Heuristics, Cross-Task Transfer, and Downstream Bias in LLM Evaluation

Evaluating 13-21 models across six presentation operationalizations and four task-domain operationalizations suggests that, despite confounds, some models possess practical SGTR capabilities, and that SGTR should be monitored and considered in the design of safety-critical AI applications.

J. St-Amand, Callum Canavan, S. Imran et al. · 0 citations
#artificial intelligence Preprint Jul 2026

AI Models Can Predict and Collaboratively Modulate Human Memory Search

This study explores and evaluates the ability of LLMs to follow and enhance human mental trajectories during semantic memory search and demonstrates that an LLM's abilities to track and predict human memory trajectories in this task exceed those of other humans.

Eric Lacosse, Mariana Duarte, Graham Todd et al. · 0 citations
#artificial intelligence Preprint Aug 2026

MathAdv: What Theorem Provers Know, Reason, Formalize, and Generalize

This work introduces MathAdv, a diagnostic benchmark spanning 13 domains across undergraduate- and graduate-level mathematics, and shows how component-wise evaluation can reveal model capabilities and failure modes that aggregate theorem-proving accuracy obscures.

Jiajie Yuan, Connor Martinez Lockhart, Xiao-Yun Liu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

JuryProbe: An Empirical Consensus-Risk Diagnostic for Routing Reference-Free Factuality Judge Panels to Grounded Verification

JuryProbe is introduced, an empirical consensus-risk diagnostic for reference-free factuality judge panels, paired with a calibration-based routing policy, which estimates consensus risk from a labeled calibration probe using false-negative-only (FN-only) judge correlation and false-consensus lift.

Tianxing Zhou, Ruixi Lin · 0 citations
#artificial intelligence Preprint Aug 2026

Search, Inspect, Fetch: Exploiting Structure-Aware Boolean Retrieval for Deep-Search Agents

This work introduces Sieve, a search-inspect-fetch strategy driven by a Boolean Query Language (BQL): it searches webpage fields to filter candidates, uses an interchangeable ranker to order them, presents structure-rich result cards for inspection, and fetches only selected sections.

Shuai Wang, Haodong Chen, Yu Yin et al. · 2 citations

Where Steering Signals Come From: Activation Source Selection in Activation Steering

Tail subtraction is introduced, which removes shared prompt and continuation semantics from boundary states and yields cleaner, more stable steering signals, and suggests that steering depends on representations of what the model is about to do, not merely on what has already appeared.

Jiaran Ye, Lingxu Ran, Zijun Yao et al. · 2 citations
#artificial intelligence Preprint Jul 2026

An LLM-Based Framework for Intent-Driven Network Topology Design

This work investigates the ability of Large Language Models to generate structurally valid and constraint-compliant network topologies through a constraint-driven pipeline combining hierarchical modeling and systematic validation, and provides a systematic benchmark for understanding how LLMs handle structural and resilience constraints in topology synthesis.

Kholoud El-Habbouli, Fengrong Zhou, Stéphane Huet · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.

MIT News · Artificial Intelligence Aug 20, 2026

Paving the way for greener ammonia production

New MIT research could lead to better materials for a fossil-fuel-free process for making the chemical that's essential to fertilizer and other products.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.