The Multiple Timescales of Gradient Descent on the Edge of Stability: A Perturbative Derivation of the Central Flow
A perturbative regime in which the central flow is the limit of gradient descent, and the central flow emerges as the leading-order term in the expansion, while the self-stabilization mechanism appears in the next-order term.
Raphael Berthier
· 0 citations