Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Oct 2026

SQuAT: Spherical Lattice Vector Quantization-Aware Training

Vector quantization (VQ), in particular lattice-based methods, offer strong rate-distortion trade-offs for low-bit large language models (LLMs), yet their behavior under quantization-aware training (VQ-QAT) remains poorly understood. We scale lattice VQ-QAT to billion-parameter LLMs and multi-billion-token training reg...

Sebastian Loeschcke, Ivan Koryakovskiy, T. V. D. van der Ouderaa et al. · 0 citations
#machine learning Preprint Oct 2026

Harmful Responses Are Jailbreak Templates: Transferring Autoregressive Jailbreaks to Diffusion Language Models

This work proposes RMT-Jailbreak, a general framework that transfers existing autoregressive (AR) jailbreak attacks to dLLMs through their induced harmful responses, revealing strong cross-paradigm transferability of jailbreak attacks.

Jin-Wei Gan, Zi-Feng Cheng, Zhiwei Jiang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Bridging the Data Gap: Source-Informed Task-Space Transport for Few-Shot Diffusion

Many deployments require a model to move rapidly from a data-rich source to a related target observed only sparsely. This is especially consequential where target data are difficult to collect, as in healthcare settings with persistent population or acquisition imbalances. Retraining or fine-tuning a high-capacity gene...

Jing Jiang, Jin-Ping Peng, R. Deen et al. · 0 citations
#machine learning Preprint Oct 2026

The Value of System 1 Models in Medicine

Many clinical decisions are a choice among a few fixed options, taken quickly and in large numbers. Such decisions also need an uncertainty estimate to know when to defer to a clinician. Generative language models answer slowly in free text and state their confidence poorly. In contrast, System 1 models answer zero-sho...

Xiu-Feng Yang, Konstantinos Vrettos, Zeineb Ben Chaaben et al. · 1 citation
#machine learning Preprint Open access Oct 2026

Identifiability from Stationary Covariance in Linear SDEs with Reciprocal Interactions and Latent Variables

Continuous-time stochastic differential equations (SDEs) provide a natural framework for modeling interacting dynamical systems. A central causal question is whether causal effects among observed variables can be identified from observational data drawn from the stationary distribution, given the underlying causal grap...

Ana Leticia Garcez Vicente, Saber Salehkaleybar · 0 citations
#machine learning Preprint Open access Oct 2026

Extreme Compression of Per-Layer Embeddings via Cross-Layer Latent Vector Quantization

Scaling embedding capacity alongside Transformer computation is an emerging trend in language models. This trend makes high compression rates increasingly useful. Hence, we study extreme compression of Per-Layer Embeddings (PLE), which follow this trend and account for 35.2% of the parameters of Gemma 4 E4B. At such ra...

Jiacheng Liu, Yaxin Luo, Xiaohan Zhao et al. · 0 citations
#machine learning Preprint Open access Oct 2026

The Bayesian Learning Rule Beyond KL Geometry

The Bayesian learning rule (BLR) exploits the relation between Bayesian updating and the Kullback-Leibler divergence (KLD) to derive efficient additive updates for exponential family variational posteriors. The KL geometry is powerful but restrictive: combined with posterior families with parameter-dependent support it...

Sophia Sklaviadis, Wu Lin, Andre Martins et al. · 0 citations
#machine learning Preprint Oct 2026

DISC: Domain-Integrated Similarity Cost for Time-Series Dataset

Domain-Integrated Similarity Cost (DISC), a learnable aggregation framework that uses calibration transfer observations to select, weight, and combine similarity metrics for different downstream tasks, is proposed and shows that time-series dataset similarity is task-dependent and that learned metric integration provid...

Yen-Ku Liu, Hong-Jie Chen, Franck Dernoncourt et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Deep ReLU Networks Can Fail the Best Approximation Property for Continuous Target Functions

We construct a continuous function on $[-1,1]^2$ for which the infimum of the $L^2$-approximation error over the class of ReLU networks with two hidden layers and architecture $(2,2,1,1)$ is not attained. This counterexample shows that deep ReLU networks do not satisfy the best approximation property in general, even f...

Sebastian Kassing · 0 citations
#machine learning Preprint Open access Oct 2026

QuaNAS: Uncertainty-Aware Reuse of Earlier Searches for Query-Efficient Neural Architecture Search

Neural architecture search (NAS) on a new dataset often affords only tens of short training runs, so what the search knows before its first evaluation decides its efficiency. Yet most NAS methods start from scratch, guided at best by zero-cost proxies that are unreliable across tasks. QuaNAS treats a library of earlier...

Brama Seta Putra Satria, Dwi Sunaryono, Misbakhul Munir Irfan Subakti et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Local Discrimination of Binary Classifiers via Localized AUC Functional

Risk prediction models are frequently evaluated with AUC, which means that during evaluation we are blind to performance heterogeneity, which could lead to bad decision-making in clinics. In this work, we aim to change that by identifying patient cohorts for whom the risk prediction model might not be an accurate predi...

Wenye Ren, Anna Gy\H{o}rffy-Kerekes, Tancredi Dorsi et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.