Table 2.
Variables used in batch normalization.
Parameter | Meaning |
---|---|
z | The output of a layer |
znorm | The normalization of z |
~li | Input of the non-linearity layer |
α | Mean value of the minibatch |
δ2 | Variance of the minibatch |
l | Layer index |
i | ith data in the mini batch |
ε | A small constant |
m | The number of samples of the minibatch |