Breaking it Down: Gradient Descent

Exploring and visualizing the mathematical fundamentals of gradient descent with Grad-Descent-Visualizer.

Outline
1. What is Gradient Descent?
2. Breaking Down Gradient Descent
  2.1 Computing the Gradient
  2.2 Descending the Gradient
3. Visualizing Multivariate Descents with Grad-Descent-Visualizer
  3.1 Descent Montage
4. Conclusion: Contextualizing Gradient Descent
5. Resources

1. What is Gradient Descent?

Gradient descent is an optimization algorithm that is used to improve the performance of deep/machine learning models. Over a repeated series of training steps, gradient descent identifies …

breaking deep learning differentiation gradient gradient-descent machine learning python