GA-SVD: Generation-aware Singular Value Decomposition for LLM Compression
Large language models (LLMs) demonstrate strong generalization across a broad range of reasoning and generation tasks, but their large parameter counts impose substantial memory and computation costs, hindering deployment in practical resource-constrained settings. One-shot low-rank compression is a promising solution...
Sheng-Kun Tang, Cong Zeng, Zong-Fang Liu et al.
· 0 citations