Skip to content

Category

data science

3,683 papers

#machine learning Preprint Open access Oct 2026

Early learning in large residual networks

We study the early training dynamics of nonlinear residual networks with blocks of zero hidden layers as a model of more general residual networks. We analyze networks in a sequential limit where first width and depth diverge, then the number of training data points diverges, and finally the input dimension diverges. T...

Vladimir Narovlansky, Boris Hanin · 0 citations
#machine learning Preprint Open access Oct 2026

Operationalising Weaker Faithfulness: Recovery, Ambiguity and Computational Limits

Variables can predict an outcome jointly while each is individually independent of it, causing structure learners to discard informative links. We investigate how to operationalise weaker faithfulness through two approaches: selective protection in an adjacency learner and explicit retention of alternative directed gra...

Cillian Hourican, Rick Quax · 0 citations
#machine learning Preprint Sep 2026

Autoregressive Physics-Informed Neural Operator Surrogates and Joint 4-D Seismic-Production Bayesian History Matching

A surrogate-accelerated Bayesian history-matching framework, demonstrated on a realistic synthetic model, with an exposure bound and a Loewner-order inequality explaining why joint assimilation is no less informative.

Clement Etienam, D. Blom, H. Pattathil et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Residual Calibration via Local Feature-Space Refinement

Deep neural networks often struggle to provide reliable confidence estimates, making post-hoc calibration essential for reliable decision-making. Existing post-hoc methods largely rely on score-based transformations, which improve marginal calibration but often fail to capture spatially varying miscalibration in local...

Xihao Wang, Chengyao Yu, Ruixing Ming · 0 citations
#machine learning Preprint Open access Oct 2026

Neural LoFi with Backward Coupling: A Spectral Theory of Cross-Layer Feature Learning

During joint training, backpropagation allows later layers to reshape earlier representations, a feedback mechanism absent from purely layer-wise learning. We extend Neural Low-Degree Filtering (Neural LoFi), a recently proposed layer-wise spectral surrogate for feature learning, to capture this interaction. Starting f...

Yatin Dandi, Matteo Vilucchio, Hugo Tabanelli et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Strongly Adaptive Online Learning with Time-Varying Movement Costs

We study strongly adaptive regret for Online Convex Optimization (OCO) with time-varying movement costs, a setting that evaluates a learner's performance over arbitrary sub-intervals. This framework captures complex sequential decision-making problems where both the environment and the cost of switching decisions fluct...

Andrew Jacobsen, Emmanuel Esposito, Hao Qiu et al. · 0 citations
#machine learning Preprint Oct 2026

Contextual Decision Making: Predictive or Generative

Contextual decision making uses observed covariates to guide decisions under uncertainty. Two natural approaches are predict-then-optimize (PtO), which learns the conditional expected objective, and generate-then-optimize (GtO), which learns conditional uncertainty and optimizes using generated scenarios. We study when...

L. J. Hong, Wei-Huan Huang, Xin-Ya Li · 0 citations
#machine learning Preprint Oct 2026

Data Quality Audit and Bivariate Temperature-Humidity Analysis of a Long-Term LoRaWAN Network: Anomaly Detection, PCA, Clustering and Machine Learning

Long-term environmental IoT/LPWAN deployments often aggregate heterogeneous data streams from diverse devices without systematic auditing of each variable's actual coverage prior to analysis-an increased risk when multiple sensor types coexist within the same network. This work proposes a C++17 processing pipeline appl...

Mamadou Sow · 0 citations
#machine learning Preprint Open access Oct 2026

Optimal Multiclass Online Regret with Arbitrary Label Spaces

We determine the optimal regret in agnostic multiclass online learning with arbitrary, possibly infinite, label spaces. For every hypothesis class of multiclass Littlestone dimension $d<\infty$, we prove a regret upper bound of $O(\min\{T,\sqrt{dT}\})$ over $T$ rounds, matching the known lower bound. This resolves a qu...

Sajad Ashkezari, Shai Ben-David · 0 citations
#machine learning Preprint Oct 2026

DBCM: Dual-Branch Calibration Module for Test-Time Adaptation in Time Series Forecasting

Non-stationarity induces test-time distribution shifts in time series forecasting (TSF), resulting in forecast residuals between predictions and the corresponding ground truth. Recent works on test-time adaptation for TSF address this by introducing lightweight calibration modules around frozen forecasters, updated usi...

Jae-Hoon Jeon, Kunwoo Kang, Sang Yup Lee et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Compatible Likelihoods for Flow Matching on Manifolds

On the simplest non-Euclidean manifold, the 1D flat torus, we exhibit a distribution where a recently proposed extension of Riemannian flow matching is globally optimized by a velocity field that pushes samples away from the data distribution. We trace this failure mode to a property we call compatibility; a likelihood...

Lucas Ng, Georgios Batzolis, Mark Girolami · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Efficient Benchmarking Is Just Feature Selection and Multiple Regression

Efficient benchmarking techniques aim to lower the computational cost of evaluating LLMs by predicting full benchmark scores using only a subset of a benchmark's questions. By reframing this problem as an instance of multiple regression with feature selection, we find that existing efficient benchmarking methods can be...

Sam Bowyer, Acyr Locatelli, Kris Cao · 0 citations

From tech blogs

See all →
GPT-Lab Nov 3, 2026

Sovereignty Is the Option to Leave

Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.