VERSE: Virtual-Gradient Aware Streaming Lifelong Learning with Anytime Inference

arXiv:2309.08227v2 Announce Type: replace
Abstract: Lifelong learning or continual learning is the problem of training an AI agent continuously while also preventing it from forgetting its previously acquired knowledge. Streaming lifelong learning is a challenging setting of lifelong learning with the goal of continuous learning in a dynamic non-stationary environment without forgetting. We introduce a novel approach to lifelong learning, which is streaming (observes each training example only once), requires a single pass over the data, can learn in a …

abstract acquired agent arxiv continual continuous cs.ai cs.cv cs.lg dynamic environment gradient inference knowledge lifelong learning streaming training type virtual