Flux.jl on MNIST — What about ADAM?

Flux.jl on MNIST — What about ADAM?

So far we’ve seen a performance analysis using the standard gradient descent optimizer. But which results do we get, if we use a more sophisticated one like ADAM?

In Flux.jl on MNIST — Variations of a theme, I presented three neural networks for recognizing handwritten digits as well as three variations of the gradient descent algorithm (GD) for training these networks.

The follow-up article Flux.jl on …

adam data science julia machie-learning mnist neural networks