Table 2.
Demonstration of decoder depth and dimension with random sampling strategy.
| Depth | Dimension | Voi-S | Voi-M | A-Rand |
|---|---|---|---|---|
| 2 | 512 | 0.264 | 0.157 | 0.083 |
| 4 | 512 | 0.234 | 0.129 | 0.071 |
| 8 | 512 | 0.256 | 0.143 | 0.079 |
| 4 | 128 | 0.325 | 0.173 | 0.089 |
| 4 | 256 | 0.317 | 0.166 | 0.085 |
Left and right hand side is the demonstration of decoder depth with fixed dimension 512. Right hand side is the demonstration of decoder dimension with fixed depth 4. An overlay decoder degrades the accuracy.