all AI news
[D] Backpropagation is not just the chain-rule, then what is it?
May 18, 2023, 7:31 p.m. | /u/fromnighttilldawn
Machine Learning www.reddit.com
(Even worse, "Backpropagation is reverse-mode autodiff" (wtf is a reverse-mode autodiff LOL).)
However, I fail to understand what people mean by this.
The idea of using chain-rule is very intuitive. You break a derivative into a composition. There are some terms that are common between the derivatives with respect to different weights. You save the value of those derivatives and reuse them to save computation.
What …
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Senior Data Analyst - SQL
@ Experian | Heredia, Costa Rica
Lead Business Intelligence Developer
@ L.A. Care Health Plan | Los Angeles, CA, US, 90017
(USA) Senior Manager, Data Analytics
@ Walmart | (USA) AR BENTONVILLE Home Office J Street Offices, Suite #2
Autonomous Haulage System Application Specialist
@ Komatsu | Belo Horizonte, BR
Machine Learning Engineer
@ GFT Technologies | Alcobendas, M, ES, 28108