Fantastic activation functions and when to use them

Top 10 Activation functions, their pros, cons, when to use them, and a cheat sheet

Activation functions are an important component in an ML model, along with weights and biases. They have been instrumental in making Deep Neural Networks training, a reality and they are a constantly evolving field of study. In this blog post, we pit them against each other and observe their pros, cons, when to use them, and their evolution.

Paperswithcode lists 48 activation …

ai cheatsheet machine learning