Skip to main content
. 2018 Nov 8;12:818. doi: 10.3389/fnins.2018.00818

Table 2.

Variables used in batch normalization.

Parameter Meaning
z The output of a layer
znorm The normalization of z
~li Input of the non-linearity layer
α Mean value of the minibatch
δ2 Variance of the minibatch
l Layer index
i ith data in the mini batch
ε A small constant
m The number of samples of the minibatch