Skip to content

Category

data science

3,683 papers

#machine learning Preprint Open access Oct 2026

Two For The Price Of One: Curvature-Aware Pruning Preserves Influence Functions Too

Post-training pruning enables efficient deployment, but conventional methods do not explicitly preserve internal-gradient alignment between sparse and dense models. We study novel connections between downstream performance of compressed models and the ability to retain gradient information via influence-function preser...

Mehdi Makni, Natalia Ponomareva, Rahul Mazumder · 0 citations
#machine learning Preprint Open access Oct 2026

Recalibrating Many Questions with Few Labels: Minimax Rates and Identification Limits

Many related prediction problems, which we call questions, come with few labels each. What information can be shared across them, and what is actually necessary for good decisions? We answer both for recalibration, motivated by decision models such as Jev (TypeSafe AI, 2026) that return a probability for any yes/no que...

Xiaoyu Li, Chiwun Yang · 0 citations
#machine learning Review Oct 2026

Operator Surrogates

This chapter provides a mathematical introduction to operator surrogates, which are finite-parametric maps approximating complex (typically nonlinear) operators between infinite-dimensional spaces, and presents convergence rate bounds for holomorphic operators that depend on the number of trainable parameters and the r...

Christoph Schwab, Josephine Westermann, J. Zech · 1 citation
#machine learning Preprint Open access Oct 2026

Learning a Group Element from Its Action: Galois Correspondences, Optimal ERM, and an Abel-Ruffini Threshold for the Natarajan Dimension

We study learning an unknown element $g$ of a group acting with finite orbits on a countable set, from examples $(x,gx)$. After a sample on $A$, the consistent hypotheses are the restrictions of a coset of the pointwise stabilizer of $A$, and the sample forces exactly the labels of points this stabilizer fixes; for a G...

Xiaoyu Li · 0 citations
#machine learning Preprint Oct 2026

Counterfactual Certification for Sequential Unlearning with Long-Run Performance Guarantees

Certified machine unlearning ensures the proximity between the unlearned model and a model retrained without the data to be forgotten. Extending this framework to sequential deletion requests, typically arriving as groups of variable size (e.g., all records of one user or of coordinated users), is challenging. For unle...

Hanna Benarroch, Jamal Atif, Olivier Cappé · 0 citations
#machine learning Preprint Oct 2026

Follow the Perturbed Leader for Linear Bandits: $\sqrt{T}$ Regret over General Convex Sets

This work gives the first adversarial linear bandit algorithm based on Follow-the-Perturbed-Leader (FTPL) that achieves $\sqrt{T}$ regret over general convex action sets and develops a systematic way to analyze the stability term in the FTPL regret through the Fisher information of the perturbation distribution.

Chen-Yu Wei · 0 citations
#machine learning Preprint Open access Oct 2026

Effect of Spherical Parameter Space on Number of Non-Forgetting Tasks and Capacity of Continual Learning

We propose a continuous learning formulation for $T$ non-forgetting tasks with the spherical parameter space $\mathbb{S}^{d-1}(\sqrt{d})$ in asymptotic regime $d\rightarrow \infty$. Each task $i$ has an optimum $\bm{\Theta}_i$, minimizing its corresponding loss function $R_i(\bm{w})$ on sphere. We reduce each task $i$...

Nazanin Mirhosseini · 0 citations
#machine learning Preprint Oct 2026

Measure Neural Mappings

We introduce and define measure neural mappings (MNMs), which combine measure-dependent neural transport with ensemble consistency for learning operators on probability measures. Ensemble consistency requires outputs from growing ensembles sampled from an input law to converge to the specified population output in prob...

Ricardo Baptista, E. Calvello, Bo-Han Chen et al. · 0 citations
#machine learning Preprint Open access Oct 2026

The Surprising Expressivity of a Single Neuron with Autoregressive Chain-of-Thought

The success of autoregressive language models trained with Chain-of-Thought~(CoT) supervision raises a fundamental question: How simple can a next-token predictor be while still enabling the efficient simulation of general computation through its autoregressively generated CoT? Surprisingly, we show that a single neuro...

Roey Magen, Nirmit Joshi, Gal Vardi · 0 citations
#machine learning Preprint Open access Oct 2026

Online LLM Personalization from Pairwise Preferences Across Users

Large language models can answer the same question in different styles, but users' preferred styles are hidden and vary across users and questions. We study inference-time personalization through online selection from a fixed set of prompts, each representing a persona. Users arrive sequentially, each asks a short sequ...

Romain Puech, Georgy Salakhutdinov, Dimitris Bertsimas · 0 citations
#machine learning Preprint Oct 2026

Can R\'enyi Accountants Beat Lossless Accountants for DP-SGD?

Recent frameworks in differential privacy (DP), such as privacy loss distributions and $f$-DP, provide lossless representations of the privacy leakage of mechanisms. These approaches are often considered to yield tighter $(\varepsilon, \delta)$-DP guarantees than those obtained from relaxed notions such as R\'enyi DP....

Jinho Bok · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.