Why Retraining Can Be Harder Than Training

A neural network perspective on learning, unlearning and relearning

In a rapidly changing world, humans are required to quickly adapt to a new environment. Neural networks show why this is easier said than done. Our article uses a perceptron to demonstrate why unlearning and relearning can be costlier than learning from scratch.

Introduction

One of the positive side effects of artificial intelligence (AI) is that it can help us to better understand our own …

artificial intelligence artificial-neural-network machine learning thoughts-and-theory