Forget About It: Mitigating Forgetting Without Replay or Auxiliary Objectives
It is suggested that simple in-training interpolation deserves consideration before introducing more elaborate forgetting-mitigation mechanisms, and Sequential Fine-tuning with Averaging with Averaging with SFA is introduced and evaluated.
Anat Kleiman, G. Dziugaite, Jonathan Frankle et al.
· 16 citations
· ⚡2