Saliency-Informed Sparsity For Gating Deep Convolutional Feature Space
This work adopts a biologically plausible saliency-informed dropout technique as an explainable alternative to the unstructured standard random dropout approach and presents empirical results on regimes where such structured dynamic and static sparsities interact optimally to prune a ResNet model on the Imagenette data...