Revisiting Neural Networks for Continual Learning: An Architectural Perspective

arXiv:2404.14829v1 Announce Type: new
Abstract: Efforts to overcome catastrophic forgetting have primarily centered around developing more effective Continual Learning (CL) methods. In contrast, less attention was devoted to analyzing the role of network architecture design (e.g., network depth, width, and components) in contributing to CL. This paper seeks to bridge this gap between network architecture design and CL, and to present a holistic study on the impact of network architectures on CL. This work considers architecture design at the network …

arxiv continual cs.cv cs.lg networks neural networks perspective type