Test-Time Unlearning via Sparse Autoencoder
Machine unlearning aims to remove specific knowledge from a trained large language model (LLM) without retraining from scratch. Existing methods modify model weights via gradient ascent and its advances. While effective on certain benchmarks, these weight-based approaches exhibit a sharp forget-utility trade-off, where...
Pingzhi Li, Jinhao Duan, Vaishnav Tadiparthi et al.
· 0 citations