Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Nov 2026

Reinforcing What the Student Has Learned: Teacher-Guided On-Policy Distillation

On-policy distillation (OPD) improves language-model reasoning through dense teacher feedback on student-generated responses.We first observe an amplitude disparity in this feedback: on math reasoning responses, style-related positions exhibit 3.5 times the mean absolute teacher--student log-probability difference of m...

Bo-Zhen Fang, Lin-Hao Zhong, Xue-Hao Wang et al. · 0 citations
#machine learning Preprint Open access Nov 2026

Non-Parametric Mutual Information Estimation with Vine Copulas

We introduce VINE: a non-parametric mutual information (MI) estimator based on simplified D-vine copulas. Approximating the joint density with a simplified D-vine allows the density ratio to simplify to a product of pair copulas, which we can estimate non-parametrically. This structural simplification yields VINE, a fl...

Sigurd Holmsen, Berit Omli {\O}ksnes, Ingrid Hob{\ae}k Haff et al. · 0 citations
#machine learning Preprint Open access Nov 2026

$O(1/n)$ Convergence Rate for RVI $Q$-Learning

We establish finite-time convergence guarantee for synchronous relative value iteration (RVI) $Q$-learning for finite weakly communicating Markov decision processes (MDPs). For stochastic Krasnosel'ski\u{\i}--Mann iterations driven by a non-expansive, linearly regular map on a finite-dimensional normed space, we establ...

Avik Kar, Siddharth Chandak, Rahul Singh et al. · 0 citations
#machine learning Preprint Open access Nov 2026

Instrumental Variables in Continuous-Time Stochastic Processes

Causal questions often arise in systems that evolve in continuous time. While instrumental variable (IV) methods provide a principled approach to identify causal effects in static or discrete-time settings, even in the presence of unobserved confounding, they do not yet extend to continuous-time dynamics. In this work,...

Lars Pennig, S{\o}ren Wengel Mogensen, Niki Kilbertus · 0 citations
#machine learning Preprint Open access Nov 2026

Calibrated Target Noise Recovers Curvature from the Gradients

Estimating curvature information from gradients alone is a fundamental problem in machine learning. The challenge becomes particularly acute in settings where only aggregate mini-batch gradients are available, yet curvature information is still required for applications such as preconditioning in optimisation, sampling...

Arash Jamshidi, Katsiaryna Haitsiukevich, Aristides Gionis et al. · 0 citations
#machine learning Preprint Open access Nov 2026

An Information Bottleneck for Post-hoc Memorization Mitigation in LLMs

Recent studies have shown that large language models (LLMs) can memorize and reproduce copyrighted training data, raising serious privacy and intellectual property concerns. In this work, we investigate whether memorization can be mitigated without modifying or retraining the underlying model through an information bot...

Dina EL Zein, Shashi Kumar, James Henderson · 0 citations
#machine learning Preprint Open access Nov 2026

Simple Meta-Learning for HPO and CASH Using Performance Representations

Bayesian optimization for Hyperparameter Optimization (HPO) and Combined Algorithm Selection and Hyperparameter Optimization (CASH) often relies on explicit hyperparameter encodings as surrogate inputs. In high-dimensional search spaces, however, such representations can make it difficult for standard surrogates to lea...

Emiel Witting, Cheng Yan, Tom Julian Viering · 0 citations
#machine learning Preprint Open access Nov 2026

Online Learning with Ordered Experts (via Two-point Feedback)

We study adversarial online learning with expert recommendations in a totally ordered action space, where the experts' recommendations may change and be reordered arbitrarily. Our focus is two-point feedback: on each round the learner plays two current recommendations, observes both, and pays their average. We study tw...

Shiliang Zuo · 0 citations
#machine learning Preprint Open access Nov 2026

Monotone Viability Learning for Offline Safe Reinforcement Learning

Offline safe reinforcement learning requires reliable long-horizon safety estimates from fixed data. Learning Hamilton-Jacobi (HJ) viability in this setting calls for semantic preservation, convergence, and numerical stability. To address these challenges, we propose Monotone Viability Learning (MoViL), which learns vi...

Ziqian Wang, Zhen Zhang · 0 citations
#machine learning Preprint Open access Nov 2026

Binding Paraphrased Instructions to Encountered Objects in sLLM Agents under Partial Observability

Reliable deployment of LLM agents requires grounding diverse user expressions in their environments. Although RL-finetuned smaller large language model (sLLM) agents rival larger prompted LLMs on embodied tasks, their robustness to instruction paraphrases remains unclear. We introduce ALFWorld-Para to evaluate this rob...

Chanyoung Kim, Harim Song, Byoungchan Ko et al. · 0 citations
#machine learning Preprint Nov 2026

ACSeL: Adaptive Configuration Search for Hardware-Constrained LLM Inference

Serving large language models (LLMs) under tight memory and latency service-level objectives (SLOs), including on edge devices, requires jointly selecting the model size, batch size, quantization algorithm, and mixed-precision quantization recipes. Exhaustive search over this combinatorially large space is infeasible....

Bo-Kun Wang, Hung-Yueh Chiang, Diana Marculescu · 0 citations
#machine learning Preprint Open access Nov 2026

MambaTG: Candidate-Aware State Space Modeling for Future Link Prediction on Temporal Graphs

Future link prediction on temporal graphs involves both repeated interactions between previously connected node pairs and first-time interactions between pairs with no prior interaction. While repeated-edge prediction can exploit direct pairwise evidence, unseen-edge prediction must generalize beyond historical recurre...

Nguyen Hong Quan, Sitao Luan, Yilun Zheng et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.