Table 4.
Results for base model and local model on defined testset with AUC and FROC. Metrics were calculated individually on each dataset. The second and fourth row show the results for datasets containing only NST slides.
| LocalSentinel | LocalAxillary | CAMELYON16 | CAMELYON17 | |||||
|---|---|---|---|---|---|---|---|---|
| AUC | FROC | AUC | FROC | AUC | FROC | AUC | FROC | |
| Model | (95% CI) | (95% CI) | (95% CI) | (95% CI) | (95% CI) | (95% CI) | (95% CI) | (95% CI) |
| Base | 0.929 | 0.744 | 0.898 | 0.503 | 0.969 | 0.838 | 0.997 | 0.967 |
| (0.800–0.998) | (0.566–0.912) | (0.700–1.000) | (0.201–0.911) | (0.926–0.998) | (0.757–0.913) | (0.990–1.000) | (0.886–1.000) | |
| Base | 0.992 | 0.844 | 1.000 | 0.594 | 0.976 | 0.820 | - | - |
| (only NST) | (0.966–1.000) | (0.688–1.000) | (1.000–1.000) | (0.212–1.000) | (0.936–0.999) | (0.732–0.902) | - | - |
| Local | 0.972 | 0.774 | 1.000 | 0.758 | 0.981 | 0.825 | 0.976 | 0.910 |
| (0.910–1.000) | (0.592–0.940) | (1.000–1.000) | (0.632–1.000) | (0.953–1.000) | (0.746–0.900) | (0.926–1.000) | (0.722–1.000) | |
| Local | 0.997 | 0.870 | 1.000 | 0.744 | 0.988 | 0.817 | - | - |
| (only NST) | (0.985–1.000) | (0.706–1.000) | (1.000–1.000) | (0.619–1.000) | (0.965–1.000) | (0.730–0.896) | - | - |