Dual distillation and distribution-aware memory replay with self-learning for class-incremental learning
Class-Incremental Learning (CIL) aims to enable models to continuously learn new classes while retaining knowledge of previously learned classes. However, due to the severe imbalance between the number of new and old class samples during incremental stages, and the inconsistent supervision mechanisms employed by existi...