Skip to content

Category

machine learning

17,191 papers

#artificial intelligence Preprint Open access Oct 2026

Factual Access States in Diffusion Language Models: From Mechanism to Knowledge Editing and Retrieval

Factual recall is a lookup: some representation inside the network serves as the key, and what that key is made of decides which queries can retrieve the fact, what an edit must cover, and what a retriever can read. We call it the factual access state. In autoregressive (AR) models the subject position enriches attribu...

Yuchen Guo, Zhuoyuan Mao, Yiwen Guo · 0 citations
#artificial intelligence Preprint Oct 2026

TRCM: Topology-Aware Route-Consistency Modeling for Robust Neural Vehicle Routing

TopologyAware RouteConsistency Modeling (TRCM), which reuses node representations from a standard autoregressive construction pipeline to predict pairwise same-route probabilities and injects them into customer selection as a route-consistency signal, supports explicit route-consistency modeling as an effective structu...

Pei-Heng Jian, Zhen-Wei Wang, Tie-Hua Zhang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Learned Readout Tokens for Extracting Large Language Model Confidence

Large language models (LLMs) are increasingly used within everyday applications where their responses have significant downstream impacts. For responsible deployment of such systems, we desire insight into how much we can trust their individual outputs. A popular approach for estimating LLM confidence is to train probe...

Nima Seifi, Martin Ester · 0 citations
#artificial intelligence Preprint Oct 2026

AnchorRM: Parallel Intra-Batch State Reconstruction with Anchor-Based Residual Memory for Temporal Graph Neural Networks

AnchorRM, an anchor-based residual memory mechanism that reconstructs event-specific intra-batch node states without executing sequential recurrent updates, substantially improves the scalability and training efficiency of memory-based temporal graph learning while maintaining competitive predictive performance.

Haroon Gharwi, Kai Shu, Yue Dai · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Can Native Safety Travel? Reusing Safety Pretraining Across Models via On-Policy Distillation

Safety pretraining has emerged as a promising paradigm for embedding safety deeply into a model during pretraining, yielding robustness to subsequent fine-tuning that conventional safety post-training often lacks. We refer to this safety acquired during model pretraining as native safety. Yet native safety is expensive...

Bingqi Shang, Yang Zhang, Yiwei Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Self-Evolving Agents through Privileged Retrospective Distillation

Retrospective Self-Distillation (RSD), a multi-round framework that turns such experience into dense supervision using privileged retrospective context, and frontier-guided context-policy evolution, where a stronger frontier model proposes constrained edits to how privileged context is constructed.

Yu-Hang Zhou, Yi-Fan Wu, Bo Peng et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Orthogonal Boundary Unlearning for Dual-Use Concepts in Large Language Models

Mitigating catastrophic risks from large language models requires excising hazardous operational capabilities, such as cyberwarfare exploitation and pathogen enhancement, without degrading benign scientific utility. In these dual-use domains, legitimate defensive science and malicious attacks share vocabulary, syntax,...

Niccol\`o Ronchetti · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Projected Distillation: On Learning to Solve Hard Problems from Close, Correct Targets

On-policy learning is central to post-training: training on a model's own generations limits distribution shift and helps preserve existing capabilities. On hard problems, however, on-policy RL provides no reward-based learning signal when all attempts fail. On-policy distillation provides next-token supervision from a...

Shripad V. Deshmukh, Christian Bock, Kangrui Ruan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Beyond Scalar Leaderboards: Adaptive Sampling for Pareto Frontier Identification in Multi-Objective LLM Arenas

Vector-Borda Empirical-Gap Elimination (VB-EGE) is presented, a fixed-confidence adaptive sampling algorithm for efficiently identifying models on the Pareto frontier in arena-style evaluation and established a worst-case lower bound showing that VB-EGE is minimax-optimal up to logarithmic factors.

Liang Twist Shan, Jia-Hao Ai, Zhi-Mei Ren · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.