Per-Matrix Optimality Is Not Enough: Three-Level Optimization for Low-Rank LLM Compression
Per-matrix singular value decomposition (SVD) truncation is Eckart-Young optimal in the whitened Frobenius norm, but errors from independently compressed matrices compound through the block's nonlinear forward pass. Inspired in part by hierarchical variational optimization in quantum many-body methods, we introduce a t...
Hui-Cheng Zhang, Xi-Yao Feng, Ze-Tong Li et al.
· 0 citations