Sigmoid and SoftMax Functions in 5 minutes

The math behind two of the most used activation functions in Machine Learning

Photo by Tomáš Malík on Unsplash. Edited by author

The Sigmoid and SoftMax functions define activation functions used in Machine Learning, and more specifically in the field of Deep Learning for classification methods.

Activation function: Function that transforms the weighted sum of a neuron so that the output is non-linear

Note. The sigmoid function is also called The Logistic Function since it was first introduced …

ai machine learning mathematics sigmoid softmax