Understanding and Improving Group Normalization. (arXiv:2207.01972v1 [cs.CV])

Various normalization layers have been proposed to help the training of
neural networks. Group Normalization (GN) is one of the effective and
attractive studies that achieved significant performances in the visual
recognition task. Despite the great success achieved, GN still has several
issues that may negatively impact neural network training. In this paper, we
introduce an analysis framework and discuss the working principles of GN in
affecting the training process of the neural network. From experimental
results, we conclude the …

arxiv cv normalization understanding