Continual Learning and Catastrophic Forgetting

arXiv:2403.05175v1 Announce Type: new
Abstract: This book chapter delves into the dynamics of continual learning, which is the process of incrementally learning from a non-stationary stream of data. Although continual learning is a natural skill for the human brain, it is very challenging for artificial neural networks. An important reason is that, when learning something new, these networks tend to quickly and drastically forget what they had learned before, a phenomenon known as catastrophic forgetting. Especially in the last decade, …

abstract artificial artificial neural networks arxiv book brain catastrophic forgetting continual cs.ai cs.cv cs.lg data dynamics human natural networks neural networks process q-bio.nc reason something stat.ml type