Gabriel L. Oliveira

One Size Does Not Fit All: Curvature-Aware Adaptive Perturbation for SAM

Poor generalisation in deep neural networks is frequently associated with convergence to sharp minima. Sharpness-Aware Minimisation (SAM) improves generalisation of deep neural networks by minimising a combination of the training loss and the local sharpness of the loss landscape, biasing convergence towards flat minim...