This work derives exact local responses for attention interventions, allowing candidate edits to be scored from a cached baseline and one backward pass, and yields an exact query-conditioned gradient-step representation whose curvature identifies attention-preserving query directions, and minimum-norm query control.
Julie Huang, Maggie Chlon, G. Gutin et al.· 1 citation
Variable importance scores from tree-based methods such as random forests favor continuous predictors over categorical ones. We present a theoretical analysis of this bias and propose a simple remedy: add a small amount of noise to each categorical predictor. The correction is demonstrated on a variety of simulated and...
This work studies the stability and convergence of augmented primal-dual dynamics when constraint values are estimated from samples. Unbiased constraint observations can produce a biased augmented multiplier signal, shifting the equilibria of the mean dynamics. For componentwise inequalities, we give a necessary and su...
Kang Liu, Meng-Xiao Chen, Si-Qin Xiong et al.· 0 citations
The framework covers matrix-valued kernels constructed from radial and dot product kernels, NTKs arising from wide encoder--decoder neural networks, and encoder--decoder pairs based on Fourier, Legendre polynomial, wavelet, PCA, or pointwise sampling representations.
Lei Shi, Jia-Qi Yang, Ding-Xuan Zhou· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
A pullback-corrected scalar auxiliary variable (PB--SAV) method, one scalar tracks the shifted objective while the component gradients build a positive semidefinite curvature correction of rank at most the number of components, reducing to a dense system whose order is the number of components.
This survey develops a unified perspective by organizing probabilistic forecasting methods according to where and how uncertainty is introduced into the forecasting pipeline, and identifies unresolved challenges surrounding uncertainty in evolving dependency structures, physics-informed predictive distributions, foreca...
Donia Besher, Rajdeep Pathak, Madhurima Panja et al.· 0 citations
This work constructs a Gaussian random-field approximation whose velocity field matches the mean and covariance of the original stochastic gradient, and shows that the Gaussian approximation captures the SGD dynamics with second-order weak accuracy.
A self-supervised encoder is trained once, frozen, and reused through lightweight probes on tasks nobody named at training time; the practitioner's question is when the off-the-shelf features are good enough and when they need fixing. Canonical correlation analysis, HGR maximal correlation, and the population optimum o...
A learner probes at most $k$ of $n$ arms each round, receives the maximum of their rewards in $[0,1]$, and competes with the best fixed arm. When does the probing advantage pay for learning? We determine two minimax laws. Under independent stochastic rewards with winner feedback (the maximum and a winning label), or on...
Xu, Vardi and Safran (ICML 2026) prove that over-parameterized ridge regression over an unstructured random Gaussian feature map groks, with the delay between memorization and generalization growing as $1/\lambda$ in the weight decay. We show that on a structured feature map the same delay does not appear. For a band-l...
Chon-Fai Kam, M. Bessafi, Frédéric Cadet· 0 citations
This work proposes a nonparametric variance-penalized actor-critic (VPAC) framework that replaces the variance critic with statistically grounded online estimators based on bootstrapping and random scaling, techniques drawn from the statistical inference literature for stochastic approximation.
This work proposes an ensemble sampling algorithm that refreshes the ensemble only when the regularized Gram matrix changes substantially and achieves the sharper regret bound, and is the first ensemble-sampling guarantee that simultaneously recovers both canonical regret scalings known for randomized linear bandit alg...
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.