[D] Why do we always illustrate and depict the Loss Functions of Neural Networks as Non-Convex?

Web: https://www.reddit.com/r/MachineLearning/comments/sb1s2e/d_why_do_we_always_illustrate_and_depict_the_loss/

Why do we always illustrate and depict the Loss Functions of Neural Networks as Non-Convex?

By doing a quick Google Images Search of "Loss Functions for Neural Networks" - we are generally shown the same types of pictures. The Loss Function is generally illustrated as a colorful and wavy/bumpy surface :

​

https://i.stack.imgur.com/wk9sd.jpg

My Question: Does anyone know why we often use these kinds of illustrations? My impression is that we want to point out that the Loss Functions for …

machinelearning networks neural neural networks