Table 3.
Senior Pathologist 1A | Senior Pathologist 1B | Senior Pathologist 2A | Senior Pathologist 2B | Pathologist A | Pathologist B | Resident A | Resident B | Our model | |
---|---|---|---|---|---|---|---|---|---|
Sensitivity | 0.8261 | 0.8261 | 0.9565 | 1 | 0.4782 | 1 | 0.5652 | 0.3913 | 0.9565 |
Specificity | 0.9459 | 0.9730 | 0.9189 | 0.8648 | 1 | 0.8378 | 1 | 0.7567 | 1 |
Precision | 0.9048 | 0.9500 | 0.8800 | 0.8214 | 1 | 0.7931 | 1 | 0.5000 | 1 |
Negative predictive value | 0.8974 | 0.9000 | 0.9714 | 1 | 0.7551 | 1 | 0.7872 | 0.6667 | 0.9737 |
False negative rate | 0.1739 | 0.1739 | 0.0435 | 0 | 0.5217 | 0 | 0.4348 | 0.6087 | 0.0435 |
False positive rate | 0.0541 | 0.0270 | 0.0811 | 0.1351 | 0 | 0.1622 | 0 | 0.2432 | 0 |
Accuracy | 0.9000 | 0.9167 | 0.9333 | 0.9167 | 0.8000 | 0.9000 | 0.8333 | 0.6167 | 0.9833 |
F1 | 0.8636 | 0.8837 | 0.9167 | 0.9019 | 0.6471 | 0.8846 | 0.7222 | 0.4390 | 0.9778 |
Exposure to WSI (years) | 1.5 | 1.5 | 1.5 | 1 | 0.25 | 0.5 | 0 | 0 | - |
Experience (decades) | 1.2 | 1.4 | 0.7 | 0.9 | 0.4 | 0.4 | 0 | 0 | - |