Web: https://www.reddit.com/r/MachineLearning/comments/sb1s2e/d_why_do_we_always_illustrate_and_depict_the_loss/

Jan. 23, 2022, 7:34 p.m. | /u/ottawalanguages

Machine Learning reddit.com

Why do we always illustrate and depict the Loss Functions of Neural Networks as Non-Convex?

By doing a quick Google Images Search of "Loss Functions for Neural Networks" - we are generally shown the same types of pictures. The Loss Function is generally illustrated as a colorful and wavy/bumpy surface :

https://i.stack.imgur.com/wk9sd.jpg

My Question: Does anyone know why we often use these kinds of illustrations? My impression is that we want to point out that the Loss Functions for …

machinelearning networks neural neural networks

Data Analytics and Technical support Lead

@ Coupa Software, Inc. | Bogota, Colombia

Data Science Manager

@ Vectra | San Jose, CA

Data Analyst Sr

@ Capco | Brazil - Sao Paulo

Data Scientist (NLP)

@ Builder.ai | London, England, United Kingdom - Remote

Senior Data Analyst

@ BuildZoom | Scottsdale, AZ/ San Francisco, CA/ Remote

Senior Research Scientist, Speech Recognition

@ SoundHound Inc. | Toronto, Canada