#artificial intelligence
Feb 2026
LORA-CRAFT: Cross-layer Rank Adaptation via Frozen Tucker Decomposition of Pre-trained Attention Weights
CRAFT achieves competitive performance with existing methods while requiring only extremely low Tucker adaptation parameters, and its efficiency advantage grows with model scale, as the frozen Tucker factors better capture the richer cross-layer structure of larger pre-trained models.
Kasun Dewage, Marianna Pensky, Suranadi De Silva et al.
· arXiv.org · 1 citation