Table 1.
Detection and segmentation performance comparisons of the 6 nnU-Net models on Testing Data Set 1
| Model | Overall sensitivity (all lesions) | Average Sensitivity (per patient) | FP rate | HD95/Avg. HD | DSC |
|---|---|---|---|---|---|
| nnU-Net | 0.903 | 0.937 ± 0.136 95% CI: 0.917–0.956 |
1.79 ± 1.79 95% CI: 1.52–2.04 |
2.20 ± 3.70/ 0.40 ± 0.91 |
0.675 ± 0.168 |
| nnU-Net with ADS | 0.894 | 0.934 ± 0.139 95% CI: 0.914–0.954 |
0.91 ± 1.27 95% CI: 0.73–1.10 |
1.47 ± 1.26/ 0.25 ± 0.29 |
0.726 ± 0.149 |
| nnU-Net with ADS and 643 patch size | 0.894 | 0.925 ± 0.151 95% CI: 0.903–0.947 |
3.26 ± 2.07 95% CI: 2.96–3.57 |
1.67 ± 1.98/ 0.29 ± 0.56 |
0.710 ± 0.157 |
| nnU-Net with ADS and batch size 5 | 0.906 | 0.940 ± 0.130 95% CI: 0.921–0.958 |
1.21 ± 1.51 95% CI: 0.99–1.43 |
2.00 ± 2.90/ 0.36 ± 0.78 |
0.678 ± 0.162 |
| nnU-Net with ADL | 0.904 | 0.930 ± 0.156 95% CI: 0.907–0.952 |
0.65 ± 1.17 95% CI: 0.48–0.82 |
1.45 ± 1.91/ 0.23 ± 0.42 |
0.758 ± 0.145 |
| nnU-Net with ADS and ADL | 0.895 | 0.918 ± 0.175 95% CI: 0.893–0.943 |
0.66 ± 1.14 95% CI: 0.49–0.83 |
1.46 ± 1.54/ 0.23 ± 0.33 |
0.758 ± 0.149 |
Abbreviations: Average sensitivity = average of metastasis-level sensitivity per patient over all patients; Avg HD = the average Hausdorff distance of detected true positive brain metastases in mm; DSC = Dice similarity coefficient of detected true positive brain metastases; FP rate = false-positive rate; HD95 = the 95 percentile Hausdorff distance of detected true positive brain metastases in mm; mean ± standard deviation; overall sensitivity = lesion-level sensitivity.