Kaizen: Practical Self-supervised Continual Learning with Continual Fine-tuning

Self-supervised learning (SSL) has shown remarkable performance in computer vision tasks when trained offline. However, in a Continual Learning (CL) scenario where new data is introduced progressively, models still suffer from catastrophic forgetting. Retraining a model from scratch to adapt to newly generated data is time-consuming and inefficient. Previous approaches suggested re-purposing self-supervised objectives with knowledge distillation to mitigate forgetting across tasks, assuming that labels from all tasks are available during fine-tuning. In this paper, we generalize self-supervised continual learning …

adapt catastrophic forgetting computer computer vision continual cs.lg data fine-tuning generated offline performance practical retraining self-supervised learning ssl supervised learning tasks vision