Table 5.
The performance of models was evaluated by DB metrics FID scores and KID scores, alongside the subjective MOS rating of each individual set. The best result is colored in red and the second best is colored in blue
| Model | Metric | W Ref | W/O Ref | Total | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| A2L_D24 | A2R_D24 | B3R_D24 | A2R_D10 | A2R_D14 | A2R_D17 | B3L_D24 | B3R_D17 | TX12E2L_D14 | TX12E2R_D14 | TX12E3L_D14 | TX13B1L_D14 | TX13B3R_D14 | W Ref | W/O Ref | All | ||
| UNSB | FID768 ↓ | 1.768 | 1.699 | 1.510 | 1.975 | 1.638 | 1.567 | 1.643 | 1.620 | 1.372 | 1.454 | 1.594 | 1.641 | 1.603 | 1.659 | 1.611 | 1.622 |
| FID2048 ↓ | 335.571 | 336.422 | 267.572 | 434.316 | 318.284 | 324.705 | 317.714 | 271.564 | 318.818 | 274.218 | 312.400 | 243.367 | 201.276 | 313.189 | 301.666 | 304.325 | |
| KID ↓ | 0.663 | 0.643 | 0.485 | 0.968 | 0.645 | 0.707 | 0.750 | 0.585 | 0.715 | 0.537 | 0.685 | 0.516 | 0.439 | 0.597 | 0.655 | 0.641 | |
| MOS ↑ | 31.700 | 22.900 | 33.300 | 26.100 | 19.400 | 25.800 | 26.600 | 30.000 | 33.900 | 24.200 | 22.200 | 26.300 | 19.100 | 29.300 | 25.360 | 26.269 | |
| 2D CycleGAN | FID768 ↓ | 1.668 | 1.509 | 1.465 | 1.553 | 1.364 | 1.640 | 1.415 | 1.349 | 1.490 | 1.250 | 1.437 | 1.564 | 1.140 | 1.547 | 1.420 | 1.449 |
| FID2048 ↓ | 215.451 | 240.731 | 219.724 | 260.986 | 250.141 | 247.595 | 217.812 | 214.397 | 254.606 | 216.557 | 254.916 | 215.287 | 178.178 | 225.302 | 231.048 | 229.722 | |
| KID ↓ | 0.284 | 0.327 | 0.288 | 0.383 | 0.353 | 0.351 | 0.339 | 0.293 | 0.366 | 0.283 | 0.364 | 0.300 | 0.226 | 0.300 | 0.326 | 0.320 | |
| MOS ↑ | 37.000 | 42.300 | 30.700 | 31.400 | 44.200 | 42.700 | 40.400 | 48.000 | 35.900 | 42.200 | 35.400 | 49.000 | 47.100 | 36.667 | 41.630 | 40.485 | |
| 3D CycleGAN-GL | FID768 ↓ | 1.633 | 1.128 | 1.081 | 1.287 | 1.247 | 1.283 | 1.075 | 1.089 | 1.304 | 1.283 | 1.162 | 1.077 | 0.892 | 1.281 | 1.170 | 1.195 |
| FID2048 ↓ | 281.033 | 165.763 | 161.590 | 173.151 | 185.445 | 193.396 | 166.591 | 154.707 | 183.646 | 195.985 | 171.409 | 152.085 | 119.148 | 202.795 | 169.556 | 177.227 | |
| KID ↓ | 0.401 | 0.206 | 0.193 | 0.212 | 0.246 | 0.294 | 0.207 | 0.195 | 0.224 | 0.255 | 0.228 | 0.164 | 0.124 | 0.267 | 0.215 | 0.227 | |
| MOS ↑ | 46.900 | 42.100 | 62.200 | 63.300 | 39.000 | 46.300 | 50.400 | 42.800 | 46.100 | 47.100 | 47.400 | 50.800 | 62.300 | 50.400 | 49.550 | 49.746 | |
| 3D CycleGAN–2 | FID768 ↓ | 0.994 | 0.840 | 0.723 | 0.969 | 0.927 | 0.953 | 0.794 | 0.793 | 0.949 | 1.023 | 0.859 | 0.880 | 0.749 | 0.852 | 0.890 | 0.881 |
| FID2048 ↓ | 176.433 | 140.350 | 131.675 | 202.865 | 174.571 | 165.633 | 140.414 | 136.360 | 197.414 | 187.966 | 171.102 | 153.010 | 135.396 | 149.486 | 166.473 | 162.553 | |
| KID ↓ | 0.190 | 0.136 | 0.107 | 0.198 | 0.161 | 0.193 | 0.121 | 0.125 | 0.176 | 0.238 | 0.159 | 0.110 | 0.115 | 0.144 | 0.160 | 0.156 | |
| MOS ↑ | 56.900 | 65.300 | 39.700 | 37.500 | 62.900 | 45.700 | 55.900 | 57.600 | 55.400 | 48.200 | 52.900 | 62.300 | 50.200 | 53.967 | 52.860 | 53.115 | |
| 3D CycleGAN–3 | FID768 ↓ | 0.821 | 0.730 | 0.747 | 0.883 | 0.793 | 0.763 | 0.701 | 0.715 | 0.822 | 0.835 | 0.825 | 0.775 | 0.685 | 0.766 | 0.780 | 0.777 |
| FID2048 ↓ | 177.323 | 139.419 | 147.526 | 172.697 | 161.605 | 134.269 | 133.621 | 165.109 | 166.120 | 169.130 | 164.375 | 150.130 | 134.827 | 154.756 | 155.188 | 155.089 | |
| KID ↓ | 0.187 | 0.127 | 0.144 | 0.179 | 0.167 | 0.122 | 0.126 | 0.172 | 0.180 | 0.185 | 0.182 | 0.136 | 0.114 | 0.153 | 0.156 | 0.155 | |
| MOS ↑ | 54.500 | 65.900 | 50.200 | 57.700 | 56.800 | 58.900 | 60.000 | 50.600 | 56.600 | 56.100 | 40.300 | 55.500 | 71.000 | 56.867 | 56.350 | 56.469 | |
Note: FID768 and FID2048 refer to the Fréchet Inception Distance computed with 768 and 2048 features, respectively. KID refers to the Kernel Inception Distance. Both FID and KID indicate better performance with lower scores. Mean Opinion Score (MOS) rates the subjective quality of images with higher scores reflecting better quality.