Skip to main content
. 2019 Feb 22;19(4):924. doi: 10.3390/s19040924
Algorithm 1 The forward-propagation algorithm of quantization sub-layer for input features
Input: Values of input features over a mini-batch: B={x1,x2,…,xm};
Boundary values to be estimated: max_moving,min_moving
Output: {qidx=Quantization(xidx)}
Step1. max_x=1b∑idx=0idx=b−1max(xidx),min_x=1b∑idx=0idx=b−1min(xidx) //Real Boundary values
Step2. max_moving=(1−λ)⋅max_x+λ⋅max_moving,
max_moving=(1−λ)⋅max_x+λ⋅max_moving //Moving Boundary values
Step3. Sx=max(|max_x|,|min_x|)2N−1−1 //Scaling factor
Step4. qidx=xidxmax(Sx,ε) //Quantization