Skip to content

Category

machine learning

17,191 papers

#artificial intelligence Preprint Open access Oct 2026

In-Context Learning Before Specialisation: Theory of Learning in a Solvable Topic Model

Sequence models can generalise in fundamentally distinct ways: extrapolating structures seen in training, or using their prompt to adapt to novel tasks. The prevailing strategy determines how the model behaves beyond its training distribution, controlling potential capabilities and risks. Recent work has characterised...

Francesco Cagnetta, Casper L. Christensen · 0 citations
#artificial intelligence Preprint Oct 2026

Provably Efficient Risk-Sensitive Offline Reinforcement Learning via Optimized Certainty Equivalents

Risk-sensitive reinforcement learning (RL) addresses decision-making under uncertainty and adverse outcomes. Learning risk-sensitive policies from fixed datasets is important when additional interaction with the environment is costly. Existing work on risk-sensitive RL focuses on online settings or specific risk measur...

Han-Zhen Wang, Boxiang Lyu, Zhong-Xiang Dai et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Harmful Partial Interventions and Benign Leakage in Concept-based Models

Artificial intelligence systems deployed in high-risk settings increasingly require models that support meaningful human oversight. Concept-based models (CMs) offer a promising framework by enabling users to inspect and intervene on intermediate, human-understandable concepts. However, concept interventions can counter...

Gregory Verghese, Christopher J. Soelistyo, Mateo Espinosa Zarlenga et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

The Delegation Dilemma: Economies of Scale, Accountability, and Polycentric Governance

Many collective-action systems are neither fully decentralized nor fully centralized: agents voluntarily organize into institutions that share organizational costs and delegate decisions to representatives. Delegation can reduce individual costs, but it also transfers control to representatives whose private objectives...

Arin Mukhopadhyay, Aris Filos-Ratsikas, Panayiotis Danassis · 0 citations
#artificial intelligence Preprint Oct 2026

Reliable Knowledge Acquisition for Continual Learning Agents

As agents powered by foundation models move into open-ended environments, continual learning from experience becomes essential. For agents built on models with fixed parameters, this learning requires reusing prior task experience in context to improve performance and efficiency on future tasks. Existing memory and exp...

Yi-Xu Huang, Jia-Qi W. Ma · 0 citations
#artificial intelligence Preprint Open access Oct 2026

FIRM: Fisher-Informed Retention Merging for Federated LLM Unlearning

Federated LLM unlearning addresses targeted knowledge removal when forget and retain data remain distributed across private clients and are inaccessible to the server. The resulting locally trained adapters encode conflicting objectives, making their aggregation fundamentally different from conventional federated optim...

Reeyansh Shah, Maram Hasan, Subhasis Chaudhuri et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Human Interventions as Labels: Localizing, Steering, and (Sometimes) Editing the Computations Behind LLM Agent Failures

When an LLM agent misbehaves, a human steps in, and that intervention is usually discarded or replayed as training data. We treat it instead as a measurement: a label pointing at the internal computation that failed. We study it in a controlled agent environment, on one failure (asking a clarifying question when the re...

Cesare Zavattari, Alessandro Tommasi, Giuseppe Prencipe · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Router Drift Control: Mitigating Off-Policy Degradation in Mixture-of-Experts Reinforcement Learning

Reinforcement learning (RL) can become off-policy due to training-inference mismatch, mini-batch updates, and asynchronous training.The resulting mismatch is especially harmful in Mixture-of-Experts (MoE) models, where rollout--training discrepancies can change routing decisions and lead to router drift. Rollout Routin...

Liangyao Jin, Zhixin Wang, Liming Liu et al. · 0 citations
#artificial intelligence Open access Oct 2026

Efficient Pairwise Difference Learning: A Comparative Study of Encoding Strategies and Training Pair Selection

Experiments across nearly 200 benchmark classification datasets using Decision Tree, Multilayer Perceptron, Gaussian Naive Bayes, and Support Vector Classifier as base models reveal that the proposed triplet with absolute difference encoder achieves the highest average F1 scores.

Bernard Georges, Mohamed Karim Belaid, Manuel Rodrigues · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Learning to Search for Executable Patternmaking from Certified Programs

Recent models generate sewing patterns from images or text, and program-based representations make these patterns executable. These systems produce a finished pattern and do not model how a patternmaker turns one pattern into another. In practice a new style is made by editing an existing pattern: lengthening the bodic...

Zhuotao Xu, Chi Zeng, Liying Yang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

DialFork: Going Beyond Factuality to Evaluate Procedural Hallucination in Conversational Agents

Large language models (LLMs) deployed as conversational agents are increasingly expected to follow procedural logic. While factual hallucination has received extensive attention, a different failure mode has been overlooked: procedural hallucination, in which an agent produces individually fluent and factually plausibl...

Sergio Gastón Burdisso, Esaú Villatoro-Tello, Dairazalia Sánchez-Cortés et al. · 0 citations
#artificial intelligence Preprint Oct 2026

When Does Muon Actually Win? A Paired Data-, Time-, and Tuning-Budget Benchmark

Muon's gains in data efficiency motivate evaluating its performance under explicit data, time, and tuning budgets. On a single A100 GPU, we compare a reference single-device Muon implementation with AdamW across 17.7M- and 33.6M-parameter causal language models and 2.70M-parameter vision transformers. A common 23-candi...

M. Akhtar, H. Nounou, M. Mansouri et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.