Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Oct 2026

Progress-Aware Distillation for Mitigating Stagnation in Small Language Model Agents

Progress-Aware Distillation (ProD) is proposed, which explicitly detects and penalizes stagnation in student-generated trajectories and encodes the stagnation gap between student and teacher into an adaptive margin for dynamically penalizing possible stagnation.

Yuan-Pu Cao, Saket Sathe, Hanyu Wang et al. · 0 citations
#machine learning Preprint Oct 2026

Comprehensive Comparisons of Reinforcement Learning Algorithms in Autonomous Driving

This paper presents a comprehensive comparison of four representative reinforcement learning (RL) methods in autonomous vehicle (AV) decision-making, including: Fitted Value Iteration (FVI), Rollout Classification Policy Iteration (RCPI), Deep Q-Network (DQN), and a discrete-action adaptation of Deep Deterministic Poli...

De-Chen Xie, Mu-Shuang Liu · 0 citations
#machine learning Preprint Oct 2026

W-JEPA: Wavelet Joint-Embedding Predictive Architecture for Wearable Activity Recognition

A major challenge in wearable device activity recognition is the heterogeneity across datasets in sensor placement, channel count, sampling rate and subjects. Moreover, the motion patterns that distinguish activities often appear as subtle, scale-specific variations within otherwise similar waveforms. As a result, raw...

Yogesh Prabhu, L. Natarajan, Jing-Jing Zou · 0 citations
#machine learning Preprint Open access Oct 2026

Train to Stitch: Topology-Preserving Regularization for Interoperable Representations

As large, powerful pre-trained models become more prevalent, there is growing interest in developing methods that allow different neural networks to be seamlessly combined with little or no direct communication between them. Take autoencoder-based data compression as an example: the ability to independently choose arch...

Akshay Malhotra, Nicolas Zilberstein, Shahab Hamidi-Rad · 0 citations
#machine learning Preprint Oct 2026

Selective Next-Location Prediction with MetaModelSelect: A Lightweight Post-Hoc Confidence Metamodel

Next-location prediction can support proactive mobile-network decisions, but acting on unreliable predictions can waste resources. We apply MetaModelSelect, a lightweight post-hoc confidence metamodel, to selective cellular next-location prediction. The mobility-specific model combines a learned embedding of the predic...

Calvin Jary, Nafiseh Kahani · 0 citations
#machine learning Preprint Oct 2026

Fully sequential Gaussian process regression for preference learning

We study continuous global optimization problems in which the objective function cannot be directly evaluated; rather, we observe only which of two selected design points appears to perform better, subject to noise. Such comparisons complicate the use of Gaussian process regression because they yield non-Gaussian poste...

I. Ryzhov · 0 citations
#machine learning Preprint Open access Oct 2026

RA$^2$: Retain-Anchored Attraction Preserves Forget-Adjacent Utility in LLM Unlearning

Large Language Model (LLM) unlearning is often evaluated primarily by target suppression and clean retain utility. These metrics can miss a local failure mode: a model may perform well on standard retain prompts, yet degrade on benign reasoning when prompts lie near the forgotten domain. This phenomenon is termed forge...

Zinan Ling, Yang Xiao, Ruimeng Ye et al. · 0 citations
#machine learning Preprint Oct 2026

Robust Explanatory Analysis for Structured Optimization Networks (REASON) in Learning

We seek a hierarchical resolution of residual error under a composite learning objective as a principled mechanism for identifying and exploiting additional information, particularly under distribution shift and perturbation. Inspired by the System 1/System 2 paradigm, we formulate this principle as a two-loop mechanis...

Vahid Jebraeeli, Hamid Krim, Keisuke Fujii · 0 citations
#machine learning Preprint Oct 2026

One-Step Prediction Fidelity Is a Poor Proxy for Planning Performance in JEPA World Models

Latent world models are routinely selected, checkpointed and ablated on one-step prediction loss, on the assumption that a model which predicts the next latent better is a better model. In model-based RL this assumption is known to be unreliable; we ask whether it also fails for latent world models, where the training...

Joshua Cheung, Zhang He · 0 citations
#artificial intelligence Preprint Oct 2026

Policy-Verified Self-Training: Learning Agent Compliance from Verifiable Policy Rewards

Runtime policy verifiers can prevent agents from executing disallowed actions, but their decisions are typically used only for enforcement and discarded afterward. We ask whether these decisions can instead become verifiable policy rewards for training the agents they guard. We introduce Policy-Verified Self-Training (...

Min-Young Yu · 0 citations
#artificial intelligence Preprint Oct 2026

Asymptotic Behavior of Transformers

It is shown that even a three-token, single-layer attention-only transformer can fail to converge, and that, while each transformer has a temperature threshold, the supremum of this set is infinite, so there is no global minimal temperature that forces all transformers to converge.

Katy Blumer, Da-Cheng Juan, Jon M. Kleinberg et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.