Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning

arXiv:2404.00781v1 Announce Type: new
Abstract: Deep representation learning methods struggle with continual learning, suffering from both catastrophic forgetting of useful units and loss of plasticity, often due to rigid and unuseful units. While many methods address these two issues separately, only a few currently deal with both simultaneously. In this paper, we introduce Utility-based Perturbed Gradient Descent (UPGD) as a novel approach for the continual learning of representations. UPGD combines gradient updates with perturbations, where it applies smaller modifications to …

abstract arxiv catastrophic forgetting continual cs.ai cs.lg deal loss representation representation learning struggle type units