Table 12.
Product quantization for all combinations of and on fully connected layer only.
| Splitting Parameter | s = 2 | s = 4 | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Clusters | 1 | 2 | 4 | 8 | 12 | 16 | 1 | 2 | 4 | 8 | |
| Model 1 | Loss | 1.38 | 0.52 | 0.22 | 0.23 | 0.24 | 0.24 | 1.39 | 0.38 | 0.22 | 0.23 |
| Accuracy (%) | 35.46 | 90.01 | 94.14 | 94.14 | 93.97 | 94.49 | 35.46 | 90.53 | 93.97 | 94.15 | |
| Compression Rate | 6.14 | 6.11 | 6.05 | 5.93 | 5.82 | 5.72 | 6.11 | 6.04 | 5.93 | 5.72 | |
| Flops | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | |
| Model 2 | Loss | 1.40 | 0.47 | 0.31 | - | - | - | 1.37 | 0.76 | - | - |
| Accuracy | 16.87 | 81.41 | 91.05 | - | - | - | 16.87 | 76.25 | - | - | |
| Compression Rate | 5.27 | 5.25 | 5.20 | - | - | - | 5.25 | 5.20 | - | - | |
| Flops | 0.99 | 0.99 | 0.99 | - | - | - | 0.99 | 0.99 | - | - | |
| Model 3 | Loss | 1.43 | 0.64 | 0.95 | - | - | - | 1.48 | 0.37 | - | - |
| Accuracy (%) | 16.87 | 79.69 | 94.84 | - | - | - | 16.87 | 90.71 | - | - | |
| Compression Rate | 9.69 | 9.59 | 9.41 | - | - | - | 9.59 | 9.41 | - | - | |
| Flops | 0.99 | 0.99 | 0.99 | - | - | - | 0.99 | 0.99 | - | - | |
| Model 4 | Loss | 1.37 | 0.57 | 0.18 | 0.20 | 0.20 | 0.20 | 1.38 | 0.46 | 0.21 | 0.20 |
| Accuracy (%) | 37.00 | 85.54 | 95.35 | 95.70 | 95.52 | 95.70 | 36.60 | 88.12 | 95.01 | 95.52 | |
| Compression Rate | 13.03 | 12.86 | 12.57 | 12.06 | 11.59 | 11.15 | 12.86 | 12.57 | 12.06 | 11.15 | |
| Flops | 0.98 | 0.98 | 0.98 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | |
| Model 5 | Loss | 1.36 | 0.35 | 0.19 | 0.21 | 0.21 | 0.21 | 1.37 | 0.35 | 0.21 | 0.20 |
| Accuracy (%) | 35.46 | 91.74 | 95.18 | 95.87 | 95.52 | 96.04 | 35.46 | 89.84 | 94.66 | 95.70 | |
| Compression Rate | 6.14 | 6.11 | 6.05 | 5.93 | 5.82 | 5.72 | 6.11 | 6.05 | 5.93 | 5.72 | |
| Flops | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | |