Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Oct 2026

On k-nearest-neighbor regression in metric spaces

We study mean squared consistency of k-nearest-neighbor regression for metric space valued features. For a fixed feature distribution mu with atomless distance distributions, we describe how neighbor selection redistributes probability through the density of a uniformly chosen neighbor of an independent query. This giv...

L. Györfi, Vladimir G. Pestov, Harro Walk et al. · 0 citations
#machine learning Preprint Open access Nov 2026

Trainable Vector Quantization for Large Language Models

Vector Quantization (VQ) is a rapidly evolving technique for compressing Large Language Model (LLM) weights, reducing memory usage, and speeding up inference. However, extreme compression deteriorates model performance, which is challenging to recover due to the discrete nature of VQ parameters. Existing methods employ...

Anastasiia Prutianova, Alina Bogdanova, Mikhail Shutov et al. · 0 citations
#machine learning Preprint Open access Nov 2026

ElTab: Elastically Looped Tabular Transformers

Tabular transformer models such as TabPFN achieve strong predictive performance but incur substantial inference costs, making them difficult to deploy in resource-constrained settings. While looped transformers reduce parameter count through weight sharing, they can lose significant predictive power when stopped early....

Mieszko Komisarczyk, Saurabh Mathur, Maurice Kraus et al. · 0 citations
#machine learning Preprint Open access Nov 2026

DIFFNAS: Predictor-Free Neural Architecture Search via Diffusion Model and Zero-Cost Evaluation

Neural Architecture Search (NAS) has advanced the automated design of deep networks, but remains computationally expensive due to reliance on model training or performance predictors. We introduce DIFFNAS, a predictor-free NAS framework that leverages a discrete graph diffusion model guided by zero-cost performance pro...

Yize Sun, Hanzhang Ma, Zixin Wu et al. · 0 citations
#machine learning Preprint Open access Nov 2026

Continual Reinforcement Learning Is an Integration Problem

This paper presents an opinionated set of ten desiderata intended to inform the design and evaluation of reinforcement-learning agents that learn continually throughout a continuing lifetime. We use these desiderata to examine a representative selection of existing approaches. Progress on individual desiderata is valua...

Nis Meinert, Jakob Gawlikowski, Edward Grant et al. · 0 citations
#machine learning Preprint Oct 2026

Exploring Bad Minima in Transfer Learning

Over three types of adversarial attacks, the empirical results show a strong relationship between generalization on the source task and transferability, and do not rule out generalization on the source task as a sufficient condition for successful transfer.

Mina Remeli · 0 citations
#machine learning Preprint Open access Nov 2026

Towards Out-of-Distribution Uncertainty Quantification for Machine-Learned Interatomic Potentials via Pre-Training

Informative uncertainty quantification (UQ) is essential for the practical deployment of machine-learned interatomic potentials (MLIPs), as it provides insight into their reliability across chemical space. Although numerous post-hoc uncertainty estimation methods for MLIPs have recently been proposed, most have been tr...

Stefan P. Schmid, Tobias Setzer, Maximilian Scheurer · 0 citations
#machine learning Preprint Open access Nov 2026

Do LLMs Know When They Are Wrong About Molecules? In-Context Property Prediction with Self-Reported Uncertainty

Large language models (LLMs) are used in many domains, but molecular property prediction with them is still little explored. In this work we evaluate the capability of 7 frontier LLMs to predict molecular properties together with a self-reported uncertainty from in-context examples, and compare them with classical base...

Matthias Busch, Marius Tacke, Tamadur Albaraghtheh et al. · 0 citations
#machine learning Preprint Open access Nov 2026

Task Vectors Can Be Linearly Decomposed into Interpretable and Controllable Components

Task Vectors (TVs) provide a compact way to steer large language models, but they are typically treated as atomized directions merely extracted from hidden states, leaving their internal functional structure poorly understood. Motivated by prior work that decomposes in-context learning into Task Recognition (TR) and Ta...

Yukiya Horiba, Hakaze Cho, Takahiro Yakoh · 0 citations
#machine learning Preprint Open access Nov 2026

Locality-Controlled Out-of-Distribution Guidance for Robust Regulatory DNA Sequence Design

Designing regulatory DNA sequences for targeted gene-expression control is an important challenge. Recent approaches frame this task as property-conditioned generation, where diffusion models trained on natural sequences are guided toward high predicted activity through reward-based fine-tuning or sampling-time guidanc...

Dabin Jeong, Marwane Bourdim, Mo Lotfollahi · 0 citations
#machine learning Preprint Open access Nov 2026

Leakage-Controlled Structure-Preserving Augmentation and Template-Aware Evaluation for Bangla Symptom-Based Disease Prediction

Bangla symptom-based disease prediction is commonly evaluated on a small, imbalanced structured benchmark containing many profiles that differ by only one or two symptoms. We test whether train-only asymmetric Bernoulli perturbation improves classification using 725 unique profiles spanning 85 diseases and 172 binary s...

Sabah Nushra, Shovan Samanta Turzo, Moinul Hossain et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.