One Loop, Two Gains: Can Active Learning win the Lottery for Free?
The lottery ticket hypothesis posits the existence of winning tickets: sparse subnetworks that, when trained in isolation from their original initialization, match the accuracy of the full dense network. The predominant method for discovering such tickets, iterative magnitude pruning, alternates pruning with full retra...
Benedikt Tscheschner, Eduardo Veas, Marc Masana
· 0 citations