Anytime Training with Schedule-Free Spectral Optimization
SF-NorMuon, a schedule-free spectral optimizer that closes the performance gap with tuned AdamW baselines, makes horizon-free optimization more practical, taking a step towards truly open-ended, continual learning.