Stochastic Gradient Descent over P2
This work constructs a Gaussian random-field approximation whose velocity field matches the mean and covariance of the original stochastic gradient, and shows that the Gaussian approximation captures the SGD dynamics with second-order weak accuracy.
Maria Oprea, Qin Li, Yu-Nan Yang
· 0 citations