Employing Layerwised Unsupervised Learning to Lessen Data and Loss Requirements in Forward-Forward Algorithms

arXiv:2404.14664v1 Announce Type: new
Abstract: Recent deep learning models such as ChatGPT utilizing the back-propagation algorithm have exhibited remarkable performance. However, the disparity between the biological brain processes and the back-propagation algorithm has been noted. The Forward-Forward algorithm, which trains deep learning models solely through the forward pass, has emerged to address this. Although the Forward-Forward algorithm cannot replace back-propagation due to limitations such as having to use special input and loss functions, it has the potential to be useful …

abstract algorithm algorithms arxiv brain chatgpt cs.ai cs.lg data deep learning forward-forward algorithm however loss performance processes propagation requirements through trains type unsupervised unsupervised learning