Jie-Yan Liu

Adaptive parameter manifold learning for low-dimensional neural network optimization.

Deep neural networks have achieved remarkable success across diverse domains, yet their massive over-parameterization introduces significant optimization challenges, particularly susceptibility to overfitting and noise memorization. While traditional stochastic gradient descent treats all parameters equally in the nati...