Table 4. Quantitative comparison of model variants with different head numbers on the reducedresolution QB testing set.
The best results are bold. H is the number of heads in the MHSA mechanism.
| H | SAM | ERGAS | sCC | Q4 | Dλ | DS | HQNR |
|---|---|---|---|---|---|---|---|
| 1 | 1.1138 ± 0.4043 | 0.7738 ± 0.2898 | 0.9917 ± 0.0049 | 0.9488 ± 0.0651 | 0.0267 ± 0.0211 | 0.0426 ± 0.0392 | 0.9324 ± 0.0527 |
| 2 | 1.1575 ± 0.4212 | 0.8070 ± 0.3019 | 0.9909 ± 0.0053 | 0.9455 ± 0.0671 | 0.0304 ± 0.0258 | 0.0464 ± 0.0447 | 0.9255 ± 0.0617 |
| 4 | 1.1655 ± 0.4227 | 0.8138 ± 0.3033 | 0.9908 ± 0.0053 | 0.9449 ± 0.0672 | 0.0289 ± 0.0240 | 0.0448 ± 0.0448 | 0.9284 ± 0.0604 |
| Ideal value | 0 | 0 | 1 | 1 | 0 | 0 | 1 |