SoftServe: A Scalable Quasi-Newton Method for Deep Learning
SoftServe, a family of QN methods designed to overcome non-convexity and enormous parameter sizes, is introduced, and derives positivedefinite curvature estimates from the variational objective of Berglund et al. (2025), even in the presence of negative curvature.
Joohwan Ko, Tetiana Parshakova, Diana Cai et al.
· 0 citations