Improved Forward-Forward Contrastive Learning

arXiv:2405.03432v1 Announce Type: new
Abstract: The backpropagation algorithm, or backprop, is a widely utilized optimization technique in deep learning. While there's growing evidence suggesting that models trained with backprop can accurately explain neuronal data, no backprop-like method has yet been discovered in the biological brain for learning. Moreover, employing a naive implementation of backprop in the brain has several drawbacks. In 2022, Geoffrey Hinton proposed a biologically plausible learning method known as the Forward-Forward (FF) algorithm. Shortly after this paper, …

abstract algorithm arxiv backpropagation brain cs.lg cs.ne data deep learning evidence implementation optimization type while