Eigenvalues of the Hessian in Deep Learning: The Origin of Symmetry and Its Breaking
It is shown that a natural account of these spectral phenomena emerges when the original setting is understood as a departure from a nearby, otherwise hidden, highly symmetric reference.
Yossi Arjevani
· 0 citations