Fine-Grained Analysis of Catastrophic Forgetting in Continual Learning via Algorithmic Stability
Understanding catastrophic forgetting, in which learning new tasks degrades performance on previously learned tasks, remains a fundamental challenge in continual learning (CL). Existing theoretical analyses often rely on specific model or task structures and offer limited insight into how iterative optimization affects...