Opleiding DSAI Pruning-aware Shapley values estimation for Large Language Models
It is reported that the nonuniform semistructured framework detects critical layers and that, as demonstrated through successive pruning experiments, their preservation from pruning greatly reduces performance degradation, compared to a fully pruned model.
Ann Marini, Qinyu Chen, Nusa Zidaric
· 0 citations