Skip to content

Category

data science

3,686 papers

#machine learning Preprint Sep 2026

Exact Finite Attention Responses From RoPE Derivatives

This work derives exact local responses for attention interventions, allowing candidate edits to be scored from a cached baseline and one backward pass, and yields an exact query-conditioned gradient-step representation whose curvature identifies attention-preserving query directions, and minimum-norm query control.

Julie Huang, Maggie Chlon, G. Gutin et al. · 1 citation
#machine learning Preprint Open access Sep 2026

Just add noise: Debiasing tree-based variable importance in mixed data

Variable importance scores from tree-based methods such as random forests favor continuous predictors over categorical ones. We present a theoretical analysis of this bias and propose a simple remedy: add a small amount of noise to each categorical predictor. The correction is demonstrated on a variety of simulated and...

Jiahe Li, Omar Melikechi · 0 citations
#machine learning Preprint Sep 2026

Equilibrium bias and convergence in augmented primal--dual dynamics with sampled constraints

This work studies the stability and convergence of augmented primal-dual dynamics when constraint values are estimated from samples. Unbiased constraint observations can produce a biased augmented multiplier signal, shifting the equilibria of the mean dynamics. For componentwise inequalities, we give a necessary and su...

Kang Liu, Meng-Xiao Chen, Si-Qin Xiong et al. · 0 citations
#machine learning Preprint Sep 2026

Resolution-Independent Analysis of Encoder--Decoder Operator Learning via Limiting Kernels

The framework covers matrix-valued kernels constructed from radial and dot product kernels, NTKs arising from wide encoder--decoder neural networks, and encoder--decoder pairs based on Fourier, Legendre polynomial, wavelet, PCA, or pointwise sampling representations.

Lei Shi, Jia-Qi Yang, Ding-Xuan Zhou · 0 citations
#machine learning Preprint Sep 2026

A pullback-corrected scalar auxiliary variable optimizer with momentum and adaptive mobility

A pullback-corrected scalar auxiliary variable (PB--SAV) method, one scalar tracks the shifted objective while the component gradients build a positive semidefinite curvature correction of rank at most the number of components, reducing to a dense system whose order is the number of components.

Jia-Hao Zhang, Shi-Heng Zhang, Guang Lin · 0 citations
#machine learning Review Sep 2026

Beyond Point Forecasts: A Survey on Probabilistic Forecasting for Time Series and Spatiotemporal Data

This survey develops a unified perspective by organizing probabilistic forecasting methods according to where and how uncertainty is introduced into the forecasting pipeline, and identifies unresolved challenges surrounding uncertainty in evolving dependency structures, physics-informed predictive distributions, foreca...

Donia Besher, Rajdeep Pathak, Madhurima Panja et al. · 0 citations
#machine learning Preprint Sep 2026

Stochastic Gradient Descent over P2

This work constructs a Gaussian random-field approximation whose velocity field matches the mean and covariance of the original stochastic gradient, and shows that the Gaussian approximation captures the SGD dynamics with second-order weak accuracy.

Maria Oprea, Qin Li, Yu-Nan Yang · 0 citations
#machine learning Preprint Sep 2026

Sharp Rates and a One-Line Correction for Spectral Representation Learning

A self-supervised encoder is trained once, frozen, and reused through lightweight probes on tasks nobody named at training time; the practitioner's question is when the off-the-shelf features are good enough and when they need fixing. Canonical correlation analysis, HGR maximal correlation, and the population optimum o...

Di-Er Tang, Jing-Yee Tan, Guang-Yue Han · 0 citations
#machine learning Preprint Sep 2026

Bandits with Probing: Optimal Regret and the Limits of Winner Feedback

A learner probes at most $k$ of $n$ arms each round, receives the maximum of their rewards in $[0,1]$, and competes with the best fixed arm. When does the probing advantage pay for learning? We determine two minimax laws. Under independent stochastic rewards with winner feedback (the maximum and a winning label), or on...

Yong-Jie Guan · 0 citations
#machine learning Preprint Sep 2026

Structured Features Overfit Where Random Features Grok

Xu, Vardi and Safran (ICML 2026) prove that over-parameterized ridge regression over an unstructured random Gaussian feature map groks, with the delay between memorization and generalization growing as $1/\lambda$ in the weight decay. We show that on a structured feature map the same delay does not appear. For a band-l...

Chon-Fai Kam, M. Bessafi, Frédéric Cadet · 0 citations
#machine learning Preprint Sep 2026

Nonparametric Variance-Penalized Actor-Critic: Statistical Inference for Risk-Sensitive Reinforcement Learning

This work proposes a nonparametric variance-penalized actor-critic (VPAC) framework that replaces the variance critic with statistically grounded online estimators based on bootstrapping and random scaling, techniques drawn from the statistical inference literature for stochastic approximation.

Saunak Kumar Panda, Tong Li, Yi-Sha Xiang et al. · 0 citations
#machine learning Preprint Sep 2026

Linear Ensemble Sampling with Smaller Ensembles

This work proposes an ensemble sampling algorithm that refreshes the ensemble only when the regularized Gram matrix changes substantially and achieves the sharper regret bound, and is the first ensemble-sampling guarantee that simultaneously recovers both canonical regret scalings known for randomized linear bandit alg...

Taehyun Hwang, Min-hwan Oh · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.