Skip to content

Category

data science

3,686 papers

#machine learning Preprint Open access Oct 2026

Accelerating Non-Smooth and Heavy-Tailed Sampling

Anchored Langevin dynamics (ALD) is useful for non-smooth sampling where the density of the target distribution is possibly non-differentiable and heavy-tailed; reflected anchored Langevin dynamics (RALD) can sample possibly non-differentiable target density on a constrained domain. In this paper, we propose and study...

Pervez Ali, Xiaoyu Wang, Yingli Wang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

A General $\widetilde{\Omega}(\sqrt{T \gamma_T})$ Lower Bound for Kernel Bandits

The kernel bandit problem consists of sequentially optimizing an unknown function with noisy feedback, where the function has bounded norm in a given Reproducing Kernel Hilbert Space (RKHS). A central quantity in the regret analysis of kernel bandits is the maximum information gain $\gamma_T$. In particular, the best e...

Chenkai Ma, Jonathan Scarlett · 0 citations
#machine learning Preprint Oct 2026

Transformed Samplers with Variance Reduction

Markov chain Monte Carlo (MCMC) methods are the standard tool for computing expectations under complex probability distributions. Control variates reduce the variance of the resulting estimates, but a good control variate requires solving the Poisson equation of the sampler, which rarely admits a closed-form solution....

Si-Ran Liu, Michalis Tisias, P. Dellaportas · 0 citations
#machine learning Preprint Open access Oct 2026

Conformal Prediction under Partial Verification

Conformal prediction provides prediction sets with finite-sample guarantees, but the label verification required for calibration can be expensive. We develop a partial verification method that returns exactly the same prediction sets as complete verification. We characterize calibration certificates, the verified infor...

Zijun Yu, Yu Gu, Vahid Partovi Nia et al. · 0 citations
#machine learning Preprint Oct 2026

Calibrating Ambiguity Set via Diagnostic Transport for Distributionally Robust Optimization

Distributionally robust optimization (DRO) protects decisions against distributional uncertainty by optimizing over an ambiguity set, but poorly aligned set geometry can require large radii and yield overly conservative decisions. We introduce diagnostic-transport DRO (DT-DRO), which uses held-out calibration data to a...

Wen-Bin Zhou, Elizabeth Cucuzzella, Shi-Xiang Zhu · 0 citations
#machine learning Preprint Open access Oct 2026

What can linear attention learn from nonlinear teachers in-context?

Linear attention is a tractable model for understanding the mechanisms governing in-context learning in transformers. For linear regression tasks, recent asymptotic analyses have characterised its learning and generalisation behaviour. We extend this theory to nonlinear single-index targets, $y=f(x^\top w)+\varepsilon...

Mary Letey, Arman Rysmakhanov, Yue M. Lu et al. · 0 citations
#machine learning Preprint Oct 2026

How Many Directions Must a Truncated Diffusion Sampler Retain? Matching Bounds Under Power-Law Spectra

Diffusion samplers can reduce computation by generating selected spectral coordinates and filling the remaining directions with noise. How many directions must they retain? We study this question for data with power-law covariance spectra. For Gaussian data compared to a smoothed target, we prove matching bounds on the...

Radmehr Karimian, A. Mohades, Johannes Lederer · 0 citations
#machine learning Preprint Oct 2026

JevForest: Path Voting for Budgeted Feature Acquisition

Choosing which information to observe is central to prediction under limited observation budgets. We study JevForest, a feature acquisition policy that aggregates path-dependent proposals from bootstrapped trees, weights them by global training information gain, and predicts from the acquired values with a shared maske...

Yu-Hua Yan · 0 citations
#machine learning Preprint Open access Oct 2026

The optimal information complexity of VC learning

Steinke and Zakynthinou(2020) introduces the Conditional Mutual Information (CMI) framework of analyzing the information complexity of learning algorithms based on algorithm-dependent information-theoretic quantities. We study one of these quantities, the evaluated Conditional Mutual Information (eCMI). It has been an...

Steve Hanneke, Juexiao Wang · 0 citations
#machine learning Preprint Oct 2026

Bilevel optimization for data-driven learning of Koopman embeddings using kernel-based autoencoders

Koopman operator theory provides a linear framework for analyzing nonlinear dynamical systems and has become a major tool for data-driven modeling. A central challenge, however, is that finite-dimensional approximations computed by methods such as extended dynamic mode decomposition (EDMD) require the dictionary to be...

J. N. N'konzi, F. Nüske, Stefan Klus · 0 citations
#machine learning Preprint Oct 2026

Closing the Horizon Gap in Policy Optimization for Adversarial MDPs

We consider policy optimization for online episodic tabular Markov decision processes (MDPs) with adversarial losses and bandit feedback. Policy optimization updates the policy locally at each state and avoids optimization over the occupancy-measure polytope, but its existing regret bounds are larger by a factor of the...

Ming-Yi Li, Taira Tsuchiya · 0 citations
#machine learning Preprint Oct 2026

Composite Online-to-Nonconvex Conversion with Optimal Oracle Complexity

We consider stochastic nonsmooth nonconvex composite optimization, which includes several important problems such as constrained optimization and the regularized training of neural networks. The objective is the sum of a possibly nonsmooth nonconvex Lipschitz function and a convex regularizer, and the function is acces...

Ming-Yi Li, Taira Tsuchiya, Kenji Yamanishi · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.