How Does Parameter Pruning Reshape DNN Representations? An Interaction-Driven Exploration
The high sensitivity of DNN performance to the pruning of certain modules is attributed to whether the pruning operation removes generalizable low-order interaction patterns.