Group Normalization

Image retrieved from Deep Learning Blogs

This post will be an overview of what’s happening ‘under the hood’ of Group Normalization (GN), the paper on this technique can be retrieved from the arXiv e-print repository. Group Normalization was introduced in early 2018 as an alternative to Batch Normalization (BN). GN proposed by Research Engineer Dr. Yuxin Wu and Research Scientist Dr. Kaiming from Facebook’s AI Research (FAIR).

Deep Learning Neural Networks