Making LoRA Identifiable: Orthogonal Alignment for Continual Learning
There is growing interest in applying Parameter-Efficient Fine-Tuning (PEFT) to Continual Learning, as it enables faster training, mitigates catastrophic forgetting, and facilitates better adaptation to new tasks. Prior approaches have explored a range of strategies, including extending new LoRA branches for each incom...
P. Singh, Mohammadi Zaki, Akash Saha et al.
· 0 citations