Skip to content

Category

data science

3,686 papers

#machine learning Preprint Oct 2026

Pre-training of Bayesian Optimization Algorithm through Bayesian Optimization

A framework for optimizing parameters using sample paths drawn from a Gaussian process inferred from the information available at the start of BO, which can effectively select parameter configurations that achieve strong performance among a range of candidate configurations.

Satoshi Katayama, Shoyo Hunt, Shintaro Masuda et al. · 0 citations
#machine learning Preprint Open access Oct 2026

m-Set Adversarial Bandits with Winner Feedback

We show upper and lower bounds on the regret of $m$-set adversarial bandits for different utilities (winner reward or sum of rewards) and feedback models (winner index, winner reward, sum of rewards, and their combinations). By comparing to standard bounds for combinatorial and MNL bandits, our results reveal how subtl...

Nicol\`o Cesa-Bianchi, Matteo Papini · 0 citations
#machine learning Preprint Oct 2026

Expected Sample Complexity in Multi-Armed Bandits

Sample complexity is a widely used metric in sequential decision-making problems, defined as the number of suboptimal decisions during the interaction between the agent and an environment. We study the sample complexity of stochastic multi-armed bandit problems and introduce the expected sample complexity performance m...

Nadav Sukenik, Nadav Merlis · 0 citations
#machine learning Preprint Oct 2026

Identifiability of a dissipative knowledge-dynamics model: exact recovery under designed excitation, degeneration on observational data

For two concepts, this work proves a constructive structural identifiability theorem for the associated inverse problem under explicit excitation conditions, together with monotonicity, robustness and L-stability results.

А. А. Костанян, A. Beklaryan · 0 citations
#machine learning Preprint Oct 2026

Fluctuations of Nonlinear Observables in Mean Field Neural Network Training

Mean field limits describe the training dynamics of wide neural networks through the evolution of the empirical distribution of their parameters. Although functional central limit theorems characterize the asymptotic fluctuations of this distribution, quantities of practical interest are typically nonlinear observables...

Arnaud Descours, Geoffrey Lacour · 0 citations
#machine learning Preprint Open access Oct 2026

Leaner Transformers Can Easily Learn to Cluster

Transformers have in-context learning capabilities, where some known learning algorithms can be executed in the forward pass through the model. Recent work shows that transformers can exactly perform Lloyd's algorithm for $k$-means clustering with $n$ points in $d$ dimensions with an embedding size $d_{\textsf{emb}} =...

Charlotte Park, Kenneth L. Clarkson, Lior Horesh et al. · 0 citations
#machine learning Preprint Open access Oct 2026

EntroPrefill: Renyi-Guided Context Pruning with Conditional Stability Guarantees for Retrieval-Augmented Generation

Mid-prefill pruning can reduce the sequence processed by deeper transformer layers, but attention concentration alone does not certify that discarded context is dispensable. We formulate EntroPrefill as a Renyi-guided proposal mechanism coupled to explicit constraints on discarded attention mass. Sink-isolated, regular...

Inbasekaran S · 0 citations
#machine learning Preprint Oct 2026

Gauss-Newton Accuracy and Indefinite Hessians: Uniform Coexistence in Low-Cost Sets

We study the accuracy of Gauss-Newton curvature in ridge-regularized nonlinear least squares. Under local regularity and persistence of level-set curvature magnitude along an exact-fit section, we prove uniform coexistence of two curvature regimes. Global minimizers exist, and every global minimizer has relative Hessia...

Kihun Rhee, H. Byun · 0 citations
#machine learning Preprint Oct 2026

Global Exponential Convergence of Two-Layer Linear Network Training

We prove global exponential (linear) convergence with an explicit rate in the rich scaling for wide two-layer linear networks trained with smooth Polyak-Lojasiewicz predictor losses. Gradient flow in the factors closes exactly in terms of a finite-dimensional Bures flow of the neuron law covariance, in which the predic...

Stephen Y. Zhang, Gabriel Peyré · 1 citation · ⚡1
#machine learning Preprint Open access Oct 2026

Benign Overfitting under Heterogeneous Input Fusion

Benign overfitting is extensively studied when learning from a single high-dimensional input, but its behavior under heterogeneous input fusion remains largely unexplored. We study this question for minimum-norm linear interpolation under a heterogeneous Gaussian design, comparing two statistically dependent input bloc...

Houzhen Liu, Xiaobo Xia · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.