Batch Normalization

Let's talk about the definition first: batch normalization literally means batch normalization. at every SGD. Before activation, normalize the mini-batch so that the mean of the results is 0 and the variance is 1.

Guess you like

Origin http://43.154.161.224:23101/article/api/json?id=324912222&siteId=291194637