Skip to content

Category

data science

3,822 papers

#machine learning Preprint Aug 2026

Activation-Keyed Momentum: An Anisotropic Momentum Update via the Delta Rule

Activation-Keyed Momentum (AK-Momentum), which builds direction-awareness into the momentum update rule, is proposed, and it is proved that it is a valid momentum, that it applies the input-side curvature correction without matrix inversion, and that it clears stale directions faster than EMA under both a fixed and a d...

E. Hong, Guan-Nan Qu · 0 citations

SPACR: Single-Pass Adaptive Training of Uncertainty-Aware Conformal Regressors

SPACR (Single-Pass Adaptive Conformal Regressor), a novel method for directly training uncertainty-aware regressors within a differentiable loss, jointly optimizes accuracy, efficiency, and validity without batch-splitting or a predefined confidence level during training.

S. Messoudi, Sylvain Rousseau, Sébastien Destercke · 0 citations

Theoretical Foundations and Effective Algorithms for Policy-Aware Simulator Learning

This work proposes that the objective for learning simulators should be strategic robustness rather than predictive accuracy, and formulate this as a zero-sum minimax game between a model player and an adversarial policy player, which yields a provably convergent active data selection algorithm.

Christoph Dann, Yishay Mansour, M. Mohri · 0 citations
#machine learning Preprint Sep 2026

Cooperative Multi-Task Semantic Communication for Joint Classification and Regression Tasks

This paper extends the cooperative multi-task SemCom framework to jointly handle heterogeneous classification and regression tasks on the complex Cityscapes dataset and adopts the information maximization (InfoMax) principle so that it accommodates mixed discrete and continuous semantic variables.

Ahmad Halimi Razlighi, M. Rahman, Maximilian H. V. Tillmann et al. · 0 citations
#machine learning Preprint Sep 2026

Correlated initialization of deep residual networks

It is shown that the critical scaling and asymptotic limit are uniquely determined by the decay of correlations together with the Hermite rank of the feature function, which represents meaningful hyperparameters in the asymptotic regime.

Felix Benning, I. Nourdin, G. Peccati · 1 citation
#machine learning Preprint Sep 2026

Towards a Statistical Understanding of Mixture-of-Experts

This paper derives oracle risk bounds for learning dense and sparse routing with evolving experts, separating approximation, expert-learning, and router-estimation errors, and characterize how sparse Top-K routing can retain the benefits of localized aggregation while controlling per-input computation.

Si-Yuan He, Bo-Kai Yang, Jie Hu et al. · 0 citations
#machine learning Preprint Sep 2026

ALRA: Adaptive Local Relational Alignment for Logit-Based Pre-training Distillation of Autoregressive Language Models

This work proposes Adaptive Local Relational Alignment (ALRA), a position-specific framework combining student proposals with teacher guidance, which replaces the teacher-mass coefficients of the two conditional terms with unit coefficients, preventing either term from being downweighted solely because its region has l...

Quang Hoang Trung, Quang Huu Hieu, Phuc-Thanh Nguyen et al. · 0 citations
#machine learning Preprint Sep 2026

Occupancy-based Quantile Risk Control

Occupancy-based Quantile Risk Control (OQRC), a novel method that provides tight risk control bounds with finite-sample validity and establishes a finite-sample guarantee showing that OQRC yields tight risk control bounds that converge to the optimal bounds at a provable rate of $\mathcal{O}_ p(n^{-1/2})$.

Zi-Hao Shi, Hua-Jun Xi, Bing-Yi Jing et al. · 0 citations
#machine learning Preprint Sep 2026

Unifying Conformal Language Tasks with In-Context Ensembles

The Conformal Relevance framework is introduced which uses in-context learning example curation and ensembling to create a score function which maintains coverage while improving conciseness with minimal manual input.

Xiao-Shi Huang, Chen Lin, Bruce Kuwahara et al. · 0 citations
#machine learning Preprint Sep 2026

Statistical Feature Augmentation for Anomaly Detection in Dynamic Graphs

A statistical feature augmentation method that explicitly encodes behavioral interaction statistics into the input feature space and consistently improves detection performance is proposed, showcasing a promising approach for merging classical network analysis with deep learning.

Philipp Schlinge, Jean-Luc Schnipper, M. Atzmueller · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.