Preprint
Aug 2026
Is Grokking a Loss of Normal Hyperbolicity of the Interpolation Manifold?
A simple, optimizer-agnostic diagnostic: the smallest nonzero singular value of the residual Jacobian of the residual Jacobian, which, for the squared loss, equals the slowest normal restoring rate of the manifold.
Suvinava Basak
· 0 citations