Impact of Pixel Normalization Technique on Weights, Gradients, and Activations in Neural Network

There are different ways to process an image either before or during the training of a neural network trained to take in image inputs.

Some of the pixel adjustment techniques used:

1. Scaling each pixel as a fraction of the maximum pixel value
2. Centering each pixel to have a combined mean of 0
3. Normalizing each pixel so the distribution of the combined pixels have mean of 0 and standard deviation of 1

Additionally, the mean, max, and variance …

deeplearning image impact inputs network neural network normalization pixel process scaling training value