Skip to content

Category

data science

3,686 papers

#machine learning Preprint Sep 2026

High-Dimensional Learning Dynamics of Attention-Indexed Models

This work studies attention-indexed models, a broad framework that can represent multi-layer and multi-head attention architectures, and reveals that attention parameterization itself can act as an architectural implicit bias.

Yi-Zhou Xu, M. Sagitova, L. Zdeborová et al. · 0 citations
#machine learning Preprint Sep 2026

Spectral characteristics of autoencoder parameters as a vector representation of data

Experimental results suggest that the parameters of trained autoencoders can be viewed as sample representations, allowing for a high degree of accuracy in distinguishing between models trained on different data subsets, without resorting to complex vector generation algorithms or using the original samples.

M. Nikitina, Anton Bishuk, O. Bakhteev · 0 citations
#machine learning Preprint Sep 2026

Causal Foundation Models

Causal foundation models are pretrained neural networks that estimate causal quantities, such as the average treatment effect, on entirely new datasets using in-context learning without requiring model updates.

Christopher Stith, Hossein Rahmani, Jesse C. Cresswell · 0 citations
#machine learning Preprint Sep 2026

No-Regret Bayesian Optimization with Finite-Library Input-Warped Kernels

Finite-Library Input-Warped Bayesian Optimization (FLIWBO), which selects warps from a finite library of smooth input maps by any history-dependent rule, and adapts the input geometry to accelerate learning while retaining high-probability convergence guarantees under mild hypotheses, with an explicit library-size cost...

Edvin Ketabati Augustinsson, Robert A. Bridges · 0 citations
#machine learning Preprint Sep 2026

TRACE: Spatiotemporal Contact Memory Graph Network Simulator for Granular Dynamics

Learned graph simulators provide an efficient alternative to high-fidelity solvers for granular dynamics. However, granular motion depends strongly on inter-granular contact history, which is difficult to preserve when particle contacts form, break, and rearrange. Existing simulators mainly store temporal information i...

Chang-Jian Zhou, Negin Yousefpour, Jie Qi et al. · 0 citations
#machine learning Preprint Sep 2026

Tail-Likelihood Reinforcement Learning

Reinforcement learning typically optimizes average reward. For generative policies, the average can hide an important distinction: two policies can achieve the same mean reward while having very different chances of producing a rare but high-reward rollout. This matters as sampling increases during training and inferen...

Shrinivas Ramasubramanian, Daman Arora, Fahim Tajwar et al. · 0 citations
#artificial intelligence Review Sep 2026

Evaluating Graph Neural Networks for Change-Criticality Classification in Maritime Navigation Charts

Graph neural networks (GNNs) are a class of neural networks suitable for learning on graph-structured data. Their application to spatial data is a natural extension, however its relatively unclear which message-passing operations, architectural configurations, and graph representation is best suited for classifying cha...

A. Potnis, Jacob Arndt · 0 citations
#artificial intelligence Preprint Sep 2026

The Geometry of Ignorance: LLMs Know When to Temper Bayesian Priors

The direction of ignorance is causally active: raising or lowering $\lambda$ at the final prediction state steers the prediction toward or away from the unigram prior in KL divergence, with larger models generally exhibiting lower prior reliance in the high-context limit.

To-Ni J. B. Liu, Jiajun Bao, Yizhou Liu et al. · 0 citations
#data science Jul 2026

Non-asymptotic Convergence of Stochastic Gradient Descent in Score-based Generative Models

This analysis quantifies the role of the reweighting factor in the score approximation error, providing theoretical guidance for weighting choices used in practice, and develops a Neural Tangent Kernel analysis tailored to diffusion training with stochastic gradients.

Stanislas Strasman, Sobihan Surendran, S. Le Corff · 0 citations
#machine learning Preprint May 2026

Variation Spaces for Encoder--Decoder Neural Operators: Approximation and Generalization

A variation space for nonlinear operators between Hilbert spaces, defined through vector-valued Borel measures of bounded variation, is formulated and analyzed, which yields algebraic approximation and learning rates in contrast to the complexity barriers for Lipschitz and Fr\'echet differentiable operator classes.

Jia-Qi Yang, Lei Shi · 0 citations

Stabilizing Private LASSO under Heterogeneous Covariates via Anisotropic Objective Perturbation

This work proposes a Gram-based anisotropic objective perturbation, a ``pre-distortion"strategy that counteracts the distortion from the covariate structure to restore isotropy in the estimation process and provides theoretical insights into designing stable and efficient private estimators without relying on data-depe...

Haruka Tanzawa, Ayaka Sakata · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.