JevSoup: System-One Routing for Training-Free LoRA Composition
JevSoup is proposed, a training-free framework separating System One expert routing from System Two execution using only the input and expert descriptions, which retains the leading expert's update, projects the second onto the orthogonal complement of the first update's row space, and combines them with equal weights.
Xiu-Ying Wang, Jia-Hua Cheng, Shuo-Tian Li et al.
· 0 citations