TABLE III:
Quantitative performance evaluation of different methods when tested on the out-of-federation data. The best results are marked in bold. The underlined results indicate a statistically significant difference from our result (p<0.05).
| Models (# of param.) | DSC [Mean(SD) %] | ASD [Mean(SD) mm] | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| ||||||||||||
| Liver | Kidney | Pancreas | Spleen | Gallbladder | Global | Liver | Kidney | Pancreas | Spleen | Gallbladder | Global | |
| Localized | ||||||||||||
| - Client #1 | 92.63(3.46) | - | - | - | - | 3.70(4.93) | - | - | - | - | ||
| - Client #2 | - | 85.07(16.53) | - | - | - | - | 5.28(17.98) | - | - | - | ||
| - Client #3 | - | - | 73.78(11.47) | - | - | 76.13 | - | - | 6.02(7.19) | - | - | 4.57 |
| - Client #4 | - | - | - | 85.01(15.57) | - | - | - | - | 3.64(9.40) | - | ||
| - Client #5 | 92.78(4.97) | 89.14(16.38) | 57.13(26.67) | 88.18(15.80) | 53.45(33.93) | 3.15(5.41) | 4.19(11.60) | 6.73(7.94) | 3.49(5.60) | 5.29(9.17) | ||
|
| ||||||||||||
| Centralized | ||||||||||||
| - U-Net (97M) | 95.35(4.07) | 85.50(16.97) | 77.44(11.05) | 91.46(10.59) | 68.02(32.17) | 83.55 | 2.06(4.68) | 9.09(15.33) | 2.91(3.97) | 2.49(5.23) | 2.08(3.43) | 3.73 |
| - MENU-Net (78M) | 95.84(3.35) | 88.70(15.30) | 78.65(9.98) | 92.57(8.89) | 67.86(31.26) | 84.72 | 1.85(4.57) | 4.26(14.35) | 2.48(4.15) | 1.58(3.38) | 3.79(13.25) | 2.79 |
|
| ||||||||||||
| Federated | ||||||||||||
| - U-Net (97M) | 95.00(5.41) | 88.03(15.76) | 76.53(10.52) | 92.37(12.44) | 64.35(30.94) | 83.26 | 2.76(6.66) | 5.97(15.98) | 2.59(2.71) | 1.13(2.39) | 1.70(1.87) | 2.83 |
| - MENU-Net (78M) | 95.21(4.11) | 88.12(16.88) | 77.92(10.91) | 90.97(13.29) | 69.45(31.61) | 84.33 | 2.39(5.74) | 4.56(14.78) | 3.44(9.85) | 1.38(2.64) | 1.79(3.28) | 2.71 |