Let’s Get to the Bottom of Optimization

Steepest descent on the Himmelblau function (self-generated-image)

Building a visualizer to play around with different optimization algorithms

In this article I am going to be displaying a visualization tool I created to understand how optimization algorithms work on 2D functions. I will provide a brief background about some of the math in the algorithms as well as delve into the implementation details from the visualizer tool.

Visualization

If you want to play around with the different optimization algorithms being run …

data science gradient-descent line-search newtons-method optimization