When providing forecasted probabilities with a predictive model, the ideal model offers perfect calibration: the true probability of the outcome (i.e., the probability that $Y=1$) exactly matches the forecasted probability $f(X)$. In practice, models inevitably exhibit calibration error, and it is therefore important t...
In many settings involving stochastic differential equations, including in diffusion based generative AI, our aim is to accurately generate samples from a terminal distribution. Typically, this is done by generating i.i.d. samples of diffusion paths. Given a fixed simulation budget, a reasonable way to gain efficiency...
We study an online sketched Newton method that approximates the Newton direction at each step via a state-of-the-art sketching solver, called the generalized accelerated sketch-and-project solver (GAS), thereby mitigating the computational bottleneck of classical second-order methods. The GAS solver improves upon vanil...
Xinchen Du, Elizaveta Rebrova, Micha{\l} Derezi\'{n}ski et al.· 0 citations
Pairwise Likelihood MIA (PL-MIA), a unified method that combines a Gaussian likelihood-ratio (GLR) statistic with population calibration and the Cauchy combination test, is proposed, demonstrating how statistical principles can turn noisy model outputs into more powerful, calibrated, and reproducible evidence for membe...
Sheng-Jie Niu, Ze-Bin Yun, Ye-Heng Ge et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work proposes a learning procedure for system identification in interacting particle systems from single-snapshot observations of collective behaviors, unlike existing approaches that rely on observations of trajectories, and test it on a variety of representative models with steady-state and quasi-stationary patt...
Bao-Li Hao, Mauro Maggioni, Ming Zhong· 0 citations
This work studies tree tensor networks (TTNs), a model class that generalizes deep linear networks and Tucker decompositions and shows they embed arbitrary read-once Boolean formulas, and thus contain polynomial-size targets that cannot be learned by gradient descent in polynomial time under the same mechanism as neura...
Zach Furman, Stephan Wäldchen, Yang-Da Bei et al.· 0 citations
It is argued that TrED is a well-posed and unsolved problem, and an important direction for future research, which examines the transfer learning literature to identify mechanisms that are promising building blocks for a solution, and finds that most methods are tailored to a single regime.
Ricardo Ribeiro Pereira, Jacopo Bono, H. Ferreira et al.· 0 citations
Every step from Adam's momentum and denominator to the spectral hitting law is formalized inside the closed state-evolution model, and it is proved that a stronger arbitrary-gradient Adam theorem is impossible, and that exact two-step linear-network loss dynamics do not identify factor spectra or heavy-tail hitting tim...
Theoretically, it is proved that exact early loss dynamics in linear networks do not determine factor spectral tails, that Adam recurrences alone do not imply spectral redistribution, and that projected singular-basis spreading implies contraction of a spectral-tail potential and hence a dimension-corrected hitting-tim...
Classical convergence guarantees for stochastic gradient methods typically assume Lipschitz-smooth objectives and finite-variance gradient noise, both frequently violated in practice. In contrast, we study nonconvex stochastic optimization under the joint relaxation of these assumptions: objectives with $(L,s)$-H\"olde...
Low-Rank Adaptation (LoRA) is an effective approach for adapting large pretrained models by learning low-rank weight updates. In practice, the LoRA rank is used to control an adapter's parameter budget and representational capacity. We show that this view is incomplete: while the nominal rank determines the representat...
Zi-Han Zhu, Zhe-Hang Du, Xu-Yang Chen et al.· 0 citations
Outliers are important for stress-testing algorithms and understanding system behaviour under rare conditions. Despite being commonly described as low-likelihood events, existing generative approaches rarely control likelihood explicitly. In this work, we introduce a measure-theoretic notion of outliers based on the di...
Amartya Mukherjee, Tristan Milne, Kry Yik-Chau Lui et al.· 0 citations
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Is your company’s AI sovereign? A practical guide for CIOs on AI vendor lock-in, EU Data Act switching, cloud sovereignty, and testing your exit plan before you need it. The post Sovereignty Is the Option to Leave appeared first on GPT-Lab.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.