Table 1.
Analysis of the MLP weight’s statistics: amplitude dynamics before and after the normalization to zero mean and unit variance, the accuracy before and after three-bit UQ quantization (FP32 and UQ) and SQNR.
| Weights File Name | min Weights FP32 |
max Weights FP32 |
min Weights Norm FP32 |
max Weights Norm FP32 |
acc. FP32 (%) |
acc. UQ[H] (%) |
SQNR UQ[H] (dB) |
|---|---|---|---|---|---|---|---|
| mnist_weights_used | −0.5185 | 0.3447 | −7.0638 | 4.8371 | 98.1 | 97.66 | 12.9455 |
| mnist_weights_1 | −0.4948 | 0.3594 | −6.6845 | 5.0123 | 98.28 | 98.17 | 12.9623 |
| mnist_weights_2 | −0.5122 | 0.3533 | −6.960 | 4.948 | 98.18 | 97.9 | 12.9021 |
| mnist_weights_3 | −0.5096 | 0.3624 | −6.9375 | 5.0808 | 98.3 | 97.92 | 12.9204 |