Not All Task Vectors Need Equal Rank: Energy-Proportional Allocation for Model Merging
Spectral Energy-proportional Rank Allocation (SERA) is proposed, a simple task-adaptive strategy that allocates ranks according to the singular-value energy structure of each task vector, extending SVD-based model merging from uniform-capacity merging to task-dependent capacity allocation.
Hyunjoong Cho, Jinhyeok Jang
· 0 citations