Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Open access Oct 2026

Putting Transformer Theories to the Test

Several formal theories have been developed to characterize the capabilities and limitations of the transformer architecture, each employing different abstractions that capture different features of the architecture. Due to the differences in their underlying assumptions and conceptual frameworks, these theories can di...

Awni Altabaa, Tobias Schnabel, Kiran Tomlinson · 0 citations
#machine learning Preprint Oct 2026

PRISM: Promoting Sampling Diversity of Large Language Models with Implicit Stochastic Modulation

Large language models (LLMs) exhibit mode collapse, where their output distribution concentrates on familiar semantic modes. When diversity disappears, repeated sampling becomes semantic repetition rather than discovery, making rare but stronger solutions unlikely to surface and leaving self-evolution and continual lea...

Qi-Xin Xu, Zi-Han Zhu, Xiaojiang Liu et al. · 0 citations
#machine learning Preprint Oct 2026

DBCM: Dual-Branch Calibration Module for Test-Time Adaptation in Time Series Forecasting

Non-stationarity induces test-time distribution shifts in time series forecasting (TSF), resulting in forecast residuals between predictions and the corresponding ground truth. Recent works on test-time adaptation for TSF address this by introducing lightweight calibration modules around frozen forecasters, updated usi...

Jae-Hoon Jeon, Kunwoo Kang, Sang Yup Lee et al. · 0 citations
#machine learning Preprint Oct 2026

GS-MoE: Training-Free MoE Compression via Groupwise Subspace Sharing and Pruning

Mixture-of-Experts (MoE) models reduce computation through sparse activation, but storing their expert parameters remains a major memory bottleneck. We introduce GS-MoE, a training-free compression framework that addresses redundancy across and within experts through two compression axes: shared-subspace rank and exper...

Carson Cary, Yu-Kai Jin, Yi-Hao Huang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

REDAR: Reinforcement-Driven Adaptive Regularisation for Class Incremental Learning

Regularisation-based class-incremental learning (CIL) methods control the stability-plasticity trade-off through fixed coefficients tuned offline, independently of the continual learning objective and blind to phase-specific variations in data volume, task difficulty, and class similarity. We argue this is a fundamenta...

Akila Ayanthi, Darshana Priyasad, Tharindu Fernando et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Compatible Likelihoods for Flow Matching on Manifolds

On the simplest non-Euclidean manifold, the 1D flat torus, we exhibit a distribution where a recently proposed extension of Riemannian flow matching is globally optimized by a velocity field that pushes samples away from the data distribution. We trace this failure mode to a property we call compatibility; a likelihood...

Lucas Ng, Georgios Batzolis, Mark Girolami · 0 citations
#machine learning Preprint Open access Oct 2026

Beyond Heuristics and Commercial Navigation: An AI-Augmented Decision-Support for Ambulance Travel Time Estimation

Accurate ambulance travel time estimation is critical for emergency medical dispatch, yet existing decision-support practices often rely on static lookup tables or simplified assumptions regarding how ambulance travel time differs from ordinary passenger-car travel. For instance, they assume ambulances simply travel a...

Muhammad Adil Abid, Johan Holmgren, Fabian Lorig et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Sharp Bounds on the Winner's Bias under Independent and Nonnegatively Correlated Noise

Reporting the best of $M$ noisy, unbiased scores overstates the winner's value by up to $c\sqrt{V}$, where $V$ is the total noise variance and the sharp constant $c$ depends on how the noise is dependent. It was known only at the two extremes, arbitrary dependence ($\sqrt{(M-1)/M}$) and i.i.d. noise. We determine it fo...

Ivan Viakhirev, Kirill Borodin, Grach Mkrtchian · 0 citations
#machine learning Preprint Open access Oct 2026

Towards Trustworthy AI-Enabled Emergency Medical Dispatch: Uncertainty-Aware Ambulance Travel Time Estimation

Emergency medical dispatch increasingly relies on AI-enabled decision support systems when making ambulance dispatch decisions. In this process, accurate ambulance travel time estimates are essential for timely resource allocation and prehospital care. However, existing ambulance travel time estimation approaches typic...

Muhammad Adil Abid, Johan Holmgren, Fabian Lorig et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Agreement rather than normalisation keeps depth reusable in looped language models

Looped language models apply one block of layers repeatedly, and the design pays off only if depth is reusable: loop steps beyond the trained budget must remain usable at inference. We ask whether that rests on normalising the state between loop steps, as the released Ouro models do, or on agreement between the loop a...

Ivan Viakhirev, Kirill Borodin, Maxim Abramov et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Beyond Local Accuracy: Benchmarking the Rollout Reliability of PDE Foundation Models

PDE foundation models enable data-efficient adaptation but are deployed autoregressively, so short-horizon accuracy need not imply reliable simulation. We ask whether the short-horizon advantage of a foundation-model recipe persists when its predictions are repeatedly fed back as inputs for a long horizon. We define er...

Jaewan Park, Seid Koric, Giri Krishnan et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Every Weight Is a Path of Shared Discrete Decisions

We introduce TWIG (Tree-structured Weights with Inherited Gates), a representation in which every weight of a neural network is the end of a path of small discrete decisions: a sign, a shift by a power of two, a zero gate, an index into a shared table. Weights that belong together share the upper part of their paths, a...

Ammar Ali, Stamatis Lefkimmiatis · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.