Precise Convergence Speed of Clipped SGD
A tightened convergence analysis of clipped gradient descent on $(L_0, L_1)-smooth functions, with quantitative constants, is presented, with quantitative constants matching the more traditional analysis of smooth functions.
David A. R. Robin
· 0 citations