Skip to content

Category

data science

3,683 papers

#artificial intelligence Preprint Oct 2026

High-Value Training Data from Noisy, Diverse Sources

Training state-of-the-art models increasingly requires learning from large, heterogeneous datasets whose examples vary in quality, domain relevance, and source of supervision. Dataweighting---assigning different weights to training examples---offers a general way to control how such data influences training, but learni...

Hedi Driss, Evan Frick, Anastasios Nikolas Angelopoulos et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Differentially Private Synthetic Data via Generalized Moment Matching

We study $(\varepsilon,\delta)$-differentially private synthetic data for arbitrary databases of $n$ records in $[-1,1]^d$ under a specified integral probability metric (IPM). We introduce generalized moment matching, which estimates moments privately, fits a probability measure, and samples synthetic records. A genera...

Rundong Ding, Yiyun He, Yizhe Zhu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Why Constrained Updates Still Forget: A Functional-Path Analysis of Continual SFT

Supervised fine-tuning adapts language models to specialized tasks but can disrupt previously acquired behavior. Existing approaches constrain parameters, gradients, or replay objectives, yet the connection between the protected object, the intervening trajectory, and retained outputs remains unclear. We develop a func...

Qingsen Ma, Dianyun Wang, Jiahong Liu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

When to Follow the Teacher: Advantage-Based On-Policy Distillation

Online Policy Distillation (OPD) often outperforms offline methods such as Supervised Fine-Tuning (SFT) by training on trajectories sampled directly from the student. However, standard OPD trains the student to follow the teacher at every state of the trajectory, assuming that teacher guidance is always beneficial. We...

Mahdi Sabbaghi, George Pappas, H. Hassani et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Diffusion Language Models for Perplexity-Aware Black-Box Attacks

\emph{Continuous-space} attacks find prompts that trigger malicious behaviors, such as overthinking, in black-box LLMs by sampling or optimizing over a low-dimensional Gaussian latent space and decoding it to text through a \emph{random mapping} and nearest-token lookup. Because the random mapping is not learned from l...

Ali Al-Lawati, Elsayed Eshra, Dongwon Lee et al. · 0 citations
#artificial intelligence Preprint Oct 2026

SABLE: Scalable Affine Bayesian Latent-space Exploration

It is shown that the off-span norm implicitly selected by affine EI can lead to underexploration, and SABLE instead prescribes it using a finite-horizon schedule, without restricting search to a learned subspace.

Erik Bodin, L. Kreusser, Donney Fan et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Local Discrimination of Binary Classifiers via Localized AUC Functional

Risk prediction models are frequently evaluated with AUC, which means that during evaluation we are blind to performance heterogeneity, which could lead to bad decision-making in clinics. In this work, we aim to change that by identifying patient cohorts for whom the risk prediction model might not be an accurate predi...

Wenye Ren, Anna Gy\H{o}rffy-Kerekes, Tancredi Dorsi et al. · 0 citations
#machine learning Preprint Oct 2026

What Comes Next and Why: Interpretable Next-Event Prediction with Neuro-Symbolic Rules

In real-world applications, being able to explain why a prediction is made is often as important - if not more so - than achieving high accuracy. However, existing methods for sequential event prediction typically prioritize accuracy at the expense of interpretability. Neuro-symbolic approaches offer a promising direct...

Tim Bauerschmidt, Isabel Valera, J. Vreeken · 0 citations
#machine learning Preprint Open access Oct 2026

Transformers with CoT Discover Heavy-Ball Acceleration Through Training

Modern transformers often solve complex tasks by generating and refining intermediate reasoning steps. To develop a theoretical understanding of chain-of-thought (CoT) reasoning, a notable recent study by Huang et al. (2025) viewed transformers as algorithm executors, and showed that when transformers' CoT steps are su...

Yuxuan Cai, Yuan Cao · 0 citations
#machine learning Preprint Open access Oct 2026

Width and Depth Limits Commute During Training

Recent work established that the infinite-width and infinite-depth limits of residual networks commute at initialization when residual branches are scaled by $1/\sqrt{depth}$. In particular, the network output converges to the same limit whether width and depth tend to infinity sequentially or jointly. We extend this c...

Ruijia Zhang, Soufiane Hayou · 0 citations

When Reconstruction Is Not Enough: Doubly Robust Counterfactual and Interventional Mediation Analysis with Learned Multimodal Representations

A workflow combining modality-specific variational autoencoders trained outside the estimation sample, cross-fitted doubly robust and one-step estimators, locked phenotypes, select-then-confirm pathway analysis, portable representations for external replication, and diagnostics for representation insufficiency, exposur...

Cong Cao · 0 citations
#machine learning Preprint Oct 2026

AI Mindmeld: A Latent Interconnect Protocol

This work calls on specialist developers to provide consistent representation interfaces and, especially, on LLM developers to train models to receive, combine and reason with these inputs, which could expand scientific agents' information while preserving conventional tools'flexibility.

Siavash Golkar, Jake Kovalic, Shirley Ho · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.