Skip to content

Category

data science

3,683 papers

#machine learning Preprint Open access Oct 2026

Strictly Replicable Realizable Learning: Unknown Marginals, Finite-Class Interpolation, and the Cost of Shared Randomness

Strict replicability requires two independent training samples, processed with the same random seed, to produce exactly the same hypothesis. We study realizable Boolean learning under unknown and known instance marginals. For unknown marginals, we obtain the worst-case sample complexity $\Theta(((\log M)^2/\rho^2+\log(...

Guangjian Zhang · 0 citations
#machine learning Preprint Open access Oct 2026

Learning Bidirectional Causal Interactions with Heteroscedastic Neural Networks

Estimating contemporaneous bidirectional interactions from observational data is difficult because each outcome is endogenous to the other, while flexible regressions may capture only reduced-form dependence. This paper proposes SEM-DNN, a heteroscedastic neural simultaneous-equation estimator that learns reciprocal st...

Masahiro Tanaka · 0 citations
#machine learning Preprint Open access Oct 2026

Convergence of Large-Stepsize SGD for the Cross-entropy Loss via Stochastic Lyapunov Stability

Modern deep learning has been shown to operate using learning rates far larger than those justified by classical optimization theory. Most prior analyses of this phenomenon focus on deterministic gradient descent, leaving the stochastic setting largely unexplored. In this work, we provide sharp convergence guarantees f...

Konstantinos Emmanouilidis, Lachlan MacDonald, Salma Tarmoun et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Instance-dependent Stochastic Lipschitz bandit

We study the Lipschitz bandit problem, where a learner sequentially maximizes an unknown Lipschitz function $f$ over a domain $\mathcal{X} \subset [0,1]^d$ using noisy pointwise evaluations. Existing regret bounds are either worst-case, scaling as $\tilde{\Theta} \left ( T^{d+1/d+2}\right )$, or adaptive via the zoomin...

Marius Potfer, Vianney Perchet · 0 citations
#machine learning Preprint Open access Oct 2026

Causal Representation Learning for Generalisable Recommendation

Predictive models trained on observational data often fail to generalise when deployed, especially when the training data is a product of the system being optimised. Recommender systems are a canonical example: they are trained on interaction logs confounded by the deployed policy, past user behaviour, and platform fil...

Yorgos Felekis, Michael O'Riordan, Oriol Corcoll et al. · 0 citations
#machine learning Preprint Open access Oct 2026

On the Complexity of Best-Arm Identification in Non-Stationary Linear Bandits

We study the fixed-budget best-arm identification (BAI) problem in non-stationary linear bandits. Concretely, given a fixed time budget $T\in \mathbb{N}$, finite arm set $\mathcal{X} \subset \mathbb{R}^d$, and a potentially adversarial sequence of unknown parameters $\lbrace \theta_t\rbrace_{t=1}^{T}$ (hence non-statio...

Leo Maynard-Zhang, Zhihan Xiong, Kevin Jamieson et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Stochastic Inverse Problem: stability, regularization and Wasserstein gradient flow

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with measurements. Consequently, these problems are naturally framed as stochastic inverse pr...

Qin Li, Maria Oprea, Li Wang et al. · 0 citations
#machine learning Preprint Oct 2026

Privacy Accounting for Empirical Denoisers

Diffusion models have emerged as the foundation of modern generative systems, yet their high memorization capacity raises privacy concerns. While differentially private (DP) training provides formal guarantees, it comes at a cost in sample quality. In this work, we study a complementary question: how much privacy loss...

William Cheng, Dongjun Kim, Mijung Park · 0 citations
#machine learning Preprint Open access Oct 2026

Online Distributional Prediction via Latent Cluster Geometry Under Drift and Corruption

Online learning in non-stationary streams is often formulated as tracking a point estimate, although many applications require predicting the full data-generating distribution. We study online distributional prediction under drift and bounded causal adversarial corruption. Candidate laws are represented by variable-siz...

Navyansh Mahla, Prateek Chanda, Ganesh Ramakrishnan · 0 citations
#machine learning Preprint Open access Oct 2026

Transient Amplification in Cascaded Gradient Methods: Exact Minimax Laws and Tracking without Resonance

Leader-follower gradient iterations, including bilevel and two-time-scale methods, can exhibit large finite-time excursions despite asymptotic stability. For cascaded iterations with block matrix J = [[A,0],[C,D]], symmetric diagonal blocks of norm at most gamma < 1, and coupling norm at most c, we prove an exact, dime...

Ahanaf Hasan Ariq, Davide Wiest · 0 citations
#machine learning Preprint Open access Oct 2026

Softly Symbolifying Kolmogorov-Arnold Networks

Kolmogorov--Arnold Networks (KANs) offer a promising path toward interpretable machine learning: their learnable activations can be studied individually while collectively fitting complex data accurately. In practice, however, trained activations often lack *symbolic fidelity*, learning pathological decompositions with...

James Bagrow, Josh Bongard · 0 citations
#machine learning Preprint Open access Oct 2026

From Dueling Bandits to Episodic MDPs: Learning with Adversarial Preference Feedback

In dueling bandits, the learner compares two arms in each round and observes only which one is preferred. This paper asks what changes when the compared pair also affects the next state, as in a recommendation interface where the pair shown to a user affects the user's next context. We formulate this problem as a state...

Taira Tsuchiya, Shinji Ito, Haipeng Luo · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.