Table 5.
Model/annotator | FP | FN | 0–1 accuracy | PPV | NPV | Threshold | |
---|---|---|---|---|---|---|---|
Embryologist 1 | 0.378 | 0.432 | 0.324 | 0.353 | 0.509 | 0.722 | 3.667 |
Embryologist 2 | 0.376 | 0.619 | 0.134 | 0.426 | 0.469 | 0.793 | 3.333 |
Embryologist 3 | 0.378 | 0.311 | 0.444 | 0.339 | 0.539 | 0.698 | 3.889 |
Embryologist 4 | 0.395 | 0.473 | 0.318 | 0.390 | 0.480 | 0.704 | 3.889 |
Embryologist 5 | 0.382 | 0.526 | 0.238 | 0.402 | 0.484 | 0.753 | 3.222 |
Embryologist 6 | 0.392 | 0.527 | 0.257 | 0.411 | 0.474 | 0.74 | 3.556 |
Embryologist 7 | 0.408 | 0.340 | 0.476 | 0.391 | 0.509 | 0.673 | 3.111 |
Embryologist 8 | 0.375 | 0.487 | 0.264 | 0.378 | 0.496 | 0.747 | 2.667 |
Mean embryologists | 0.386 | 0.464 | 0.307 | 0.386 | 0.495 | 0.729 | 3.417 |
SD embryologists | 0.027 | 0.095 | 0.104 | 0.027 | 0.022 | 0.035 | 0.392 |
Model F | 0.331 | 0.408 | 0.254 | 0.332 | 0.540 | 0.770 | 1.896 |
For each score, the best threshold, False Rate, False Positive (FP), False Negative (FN), and 0–1 accuracy are reported.