Deep Learning Library From Scratch 3: More optimisers

Welcome to part 3 of this series, where we build a deep learning library from scratch.

In this post, we will add more optimisation functions and loss functions to our library.

Here is the Github repo for this series

ashwins-code
/
Zen-Deep-Learning-Library

Deep Learning library written in Python. Contains code for my blog series on building a deep learning library.

Optimisation functions

The goal of an optimisation function is to tweak the network parameters to minimise the neural network's loss. …

deep learning deeplearning learning library machinelearning numpy python