Why do We use Cross-entropy in Deep Learning — Part 1

Why do We use Cross-entropy in Deep Learning — Part 1

Explanation of one of the most widely used loss functions in Artificial Neural Networks

If you’ve just started in the field of Deep Learning and have read some specialized articles, I am very sure that you have come across any of the following terms: entropy, cross-entropy, binary cross-entropy, or categorical cross-entropy.

All of them derive from the same concept: Entropy, which may be familiar to …

artificial intelligence cross-entropy deep-dives deep learning entropy mathematics part