Decoupling Knowledge and Privacy: Post-Task Self-Distillation Replay for LLM Continual Learning
SPARK is proposed, a retention-correction decomposition that first freezes the learned post-task distribution and then applies selective correction around this stable reference and achieves effective selective PII suppression while preserving strong continual-learning utility and knowledge retention across diverse sett...