Toward industrial use of continual learning : new metrics proposal for class incremental learning

arXiv:2404.06972v1 Announce Type: new
Abstract: In this paper, we investigate continual learning performance metrics used in class incremental learning strategies for continual learning (CL) using some high performing methods. We investigate especially mean task accuracy. First, we show that it lacks of expressiveness through some simple experiments to capture performance. We show that monitoring average tasks performance is over optimistic and can lead to misleading conclusions for future real life industrial uses. Then, we propose first a simple metric, Minimal …

abstract accuracy arxiv class continual cs.ai cs.lg incremental industrial mean metrics paper performance show simple strategies through type