Decoded Quantum Interferometry (DQI) reduces optimization problems with two-variable constraints to decoding cycle codes. For one such problem, namely MaxCut, prior work showed that DQI achieves a nontrivial satisfaction fraction guarantee only on linear-girth graphs, for which MaxCut is classically easy. However, thes...
Anuj Apte, Shouvanik Chakrabarti, An-Di Gu et al.· 0 citations
SF-NorMuon, a schedule-free spectral optimizer that closes the performance gap with tuned AdamW baselines, makes horizon-free optimization more practical, taking a step towards truly open-ended, continual learning.
The discovery of scaling laws has motivated training neural networks on ever increasing quantities of data. This is typically done with a constant decoupled weight decay which causes the network weights to shrink steadily over the course of training. Taking inspiration from the Robbins--Monro conditions, we propose to...
Anuj Apte· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.