[D] Claim: Deep Neural Networks Are "Automatically" Performing Feature Engineering in the Background

Web: https://www.reddit.com/r/MachineLearning/comments/sgt96x/d_claim_deep_neural_networks_are_automatically/

I have often heard that Deep Learning Models (i.e. Deep Neural Networks) are automatically performing feature engineering within the network themselves. This is contrasted with traditional statistical and Machine Learning models where the feature engineering is typically done prior to training the model:

​

​

https://preview.redd.it/a8pvvie3kye81.png?width=1240&format=png&auto=webp&s=1ef560cde5082ad01f77d380b01f3574c6533154

Apparently, the operations that Neural Networks perform during the training phase are equivalent to "searching for meaningful combinations of variables that produce better performance results on the training data". I have heard that this …

deep engineering feature engineering machinelearning networks neural neural networks