Skip to content

Category

data science

3,686 papers

#machine learning Preprint May 2025

Why and When Deep is Better than Shallow: Implementation-Agnostic State-Transition Model of Deep Learning

The message is that the statistical cost of depth is the metric entropy of the set $B(k,F)$ of compositions, and it separates the models whose estimation error is independent of the depth from those whose estimation error grows with it.

Sho Sonoda, Yuka Hashimoto, Isao Ishikawa et al. · 0 citations
#machine learning Preprint Open access Sep 2026

LOD: Latent Objective Discovery in Heterogeneous Multi-Agent Reinforcement Learning

In multi-agent reinforcement learning (MARL) settings, agents are often heterogeneous with diverse intrinsic utility functions. In this study, we introduce Latent Objective Discovery (LOD) as a framework for decomposing agents' distinct utilities into mixed underlying objectives in a low-dimensional latent space. Laten...

Ke Sun, Zhaoyang Shi · 0 citations
#machine learning Preprint Open access Sep 2026

Advanced Policies: A First-Principles Path from Policy Gradient to Q-Learning

We apply entropy to reinforcement learning in two ways: entropy-augmented reward defines the soft objective, while relative-entropy regularization controls the size of a policy-improvement step without changing that objective. Together they yield a one-parameter family of advanced policies connecting a base policy to i...

Donghoon Lee · 0 citations
#machine learning Preprint Sep 2026

Elicitation and Decision Geometry in Single-Index Bandits

We study two-arm contextual bandits with arm-specific single indices and a shared unknown monotone link. Monotonicity makes the optimal action depend only on the contrast between the index directions, hence arm-specific reward functions need not be estimated. We introduce Natural Boundary Learning (NBL), a greedy proce...

Sakshi Arya, Cheng Soon Ong · 0 citations
#machine learning Preprint Sep 2026

Multi-Task Learning of Conditional Mean Operators: applications to dynamical systems and uncertainty quantification

MTL-CMO is introduced, a multi-task framework that jointly learns shared function spaces and task-specific operators across multiple datasets and T-CMO, a transfer learning method that reuses the shared spaces to estimate, in closed form, the operator of a new conditional distribution.

Sami Chemlal, Thibaut Germain, Rémi Flamary et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Convex Optimization Is Free When Accuracy Is Expensive

This paper studies convex optimization when the gradient cannot be evaluated exactly, but only approximated by a hierarchy of algorithms whose compute grows like $\delta^{-\gamma}$ in the accuracy $\delta$. When $\gamma>2$, falling into the Harder-Than-Monte-Carlo (HTMC) regime, the price of accuracy outruns the varian...

Arthur Paing, Arthur Jacot · 0 citations
#machine learning Preprint Sep 2026

A Hierarchy of Entropy-Shapley Games for Multivariate Predictive Uncertainty

A hierarchy of three entropy-based Shapley games makes this output-side choice explicit for any ordered multivariate outcome, ranging from per-component marginal entropy to fully joint entropy, and establishes a chain-rule decomposition of the joint attribution and characterize the cross-component term through conditio...

Niklas Koenen, Claudia Battistin, Jeriek Van den Abeele et al. · 0 citations
#machine learning Preprint Sep 2026

GUIDE-FBO: Guidance via Uncertainty Intervention and Distributional Exchange for Federated Bayesian Optimization

GUIDE-FBO is proposed, in which agents exchange compact distributions over the locations of their respective optima inferred from local Gaussian process (GP) posteriors, rather than raw observations, query points, or surrogate parameters, and remains effective across settings ranging from homogeneous to severely hetero...

Jing Wei, Chen-Xi Li, Song-Hao Wang · 0 citations
#machine learning Preprint Open access Sep 2026

Conformal Prediction and Conditional Coverage for Tabular Foundation Models

Tabular foundation models (TFMs) provide predictive distributions for regression, but their prediction regions can exhibit undercoverage or overcoverage even when point predictions are accurate. We introduce C-USIM (Conditionally-Uniformized Score Integration Method), a lightweight application of highest predictive den...

Sungwoo Park, Sunghee Park, Won Chang · 0 citations
#machine learning Preprint Sep 2026

Information-Theoretic Analysis of Next-Token Prediction under Markovian Data

An information-theoretic framework for generalization in next-token prediction under temporally dependent data is developed, revealing the roles of context length, model complexity, sample size, margin, and temporal mixing and yielding informative guarantees for deterministic algorithms over continuous hypothesis space...

Masoud Kavian, Abdellatif Zaidi, Milad Sefidgaran · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.