Skip to content

Category

data science

3,683 papers

#machine learning Preprint Oct 2026

textGrain watermarking is harder to detect: can sum-tests still do it optimally?

Watermarking embeds an imperceptible signal in text from large language models that is statistically detectable with a secret key. The recent textGrain watermark (Li et. al. (2026b)) calibrates this signal against the model's sampling entropy through an explicit entropy budget, combining the stochasticity of Red-Green...

Swapnaneel Bhattacharyya, Soham Bonnerjee · 0 citations
#machine learning Preprint Open access Oct 2026

Risk-Averse Inference-Time Diffusion Model Alignment with Finite-Sample Guarantees

Inference-time alignment steers diffusion models toward downstream objectives without costly fine-tuning, but existing methods typically optimize expected cost (or reward) without explicitly controlling tail risk. In this work, we propose a risk-averse framework for inference-time alignment of diffusion models that bal...

Yuchen Liang, Xian Yu · 0 citations
#machine learning Preprint Oct 2026

Monitoring for Shifts at Unknown Times: Parameter-Free Conditional Conformal Martingales

Conditional conformal test martingales provide sequential tests for detecting distribution shifts, using a fixed reference dataset to avoid contamination from test-time samples. Prior work used a penalized betting function via online optimization with smoothing, clipping, and other hyperparameters, which can adapt slow...

Tuo Liu, Drew Prinster, Francesco Orabona · 0 citations
#machine learning Preprint Oct 2026

Accounting for model error in ensemble variational data assimilation through learned generative dynamics

Many approaches have recently been proposed to combine data assimilation with machine learning for improved forecasts with geophysical models. Here, we focus on combining advanced sequential data assimilation schemes with a generative forecasting model which accounts for complex model errors. This generative model prov...

M. Bocquet, T. S. Finn, Si-Bo Cheng · 0 citations
#machine learning Preprint Oct 2026

Deeply unrolled alternating projections for phase retrieval

Deep unrolling methods for inverse problems augment traditional reconstruction algorithms with learned priors to improve their performance. These methods have been developed under the implicit assumption that the geometry of the measurement operator does not change between training and deployment; when this is no longe...

Jia-Yi Yao, Vasileios Charisopoulos, Rebecca Willett · 0 citations
#machine learning Preprint Open access Oct 2026

Tight End-to-End Accounting for Differentially Private Synthetic Data

Differentially private (DP) pipelines often combine heterogeneous mechanisms, yet their guarantees are best analyzed using different notions of privacy (e.g., bounded range, zCDP, ADP). When composing them, we have to analyze the guarantees through a reduced common representation that loses accounting precision. This i...

Georgi Ganev, Vadym Doroshenko, Arun Ganesh et al. · 0 citations
#machine learning Preprint Open access Oct 2026

A Generalized McDiarmid Inequality: Sample Reuse and Non-Uniform Unbounded Differences

We develop a novel generalization of McDiarmid's concentration inequality and use it to obtain a uniform law of large numbers result and error bounds on stochastic optimization problems which simultaneously incorporate two key features: 1) They capture the benefit of training sample reuse in algorithms that also employ...

Jeremiah Birrell · 0 citations
#machine learning Preprint Open access Oct 2026

SCOPE Before You Sample: Conformal Scores Guide Posterior Exploration for Fast and Calibrated Bayesian Predictive Inference

Bayesian predictive regions account for parameter uncertainty but can be poorly calibrated under model misspecification, even with expensive full MCMC. Cheaper approximations such as variational inference reduce the cost but often yield less accurate predictive distributions. We propose SCOPE (Score-guided Conformal Po...

Zahra Moslemi, Ziyi Liang, Babak Shahbaba · 0 citations
#machine learning Preprint Open access Oct 2026

In-context classification: Calibration and noise in linear attention with softmax readout

We study in-context binary classification in a simple attention model trained to minimise a logistic loss. Each prompt has a latent logistic teacher, and the learner must infer its direction from Bernoulli-labeled context examples. We derive an asymptotic prediction for the test logit in a high-dimensional regime with...

Arman Rysmakhanov, Mary Letey, Yue M. Lu et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Measuring Variable Importance Using Proportional Inclusive Marginal Effects

Shapley-based measures are widely used for measuring variable importance in statistics and machine learning. However, these measures have a serious issue--a nonactive variable can get a positive importance measure when it is correlated with an active variable. Herin et al. recently proposed a measure called proportiona...

Youngseo Cho, V. Roshan Joseph · 0 citations
#machine learning Preprint Open access Oct 2026

Minimax Optimality of Shampoo for Nonstationary Stochastic Optimization

We develop a comprehensive theoretical analysis of Matrix Shampoo for tracking time-varying optima in nonstationary stochastic optimization. We derive finite-horizon high-probability bounds for average tracking error that disentangle initialization, optimizer drift, momentum-induced drift penalty, stochastic noise, and...

Abir Sarkar, Nirmalya Mandal, Martin T. Wells · 0 citations
#machine learning Preprint Open access Oct 2026

Feature Normalization under Finite Training Budgets

Standardizing a rare feature can help stochastic gradient descent learn its effect within a finite budget, but it also changes the noise cost of learning. We characterize the lowest rare-subgroup risks attainable by standardized and unscaled training when each chooses a nonnegative constant learning rate and a determin...

Johan Larsson · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.