Functional Subnetwork Localization for Efficient Continual Learning in Large Language Models
Biological intelligence continually adapts to new information while retaining prior skills through localized plasticity. In contrast, continual learning in large language models (LLMs) remains vulnerable to catastrophic forgetting. A promising direction is to identify functionally specialized subnetworks within LLMs th...
Shuo-Ran Jiang, Wen-Tao Zhu, Yang Xiang et al.
· 0 citations