Table 2.
Compact model (EfficientNet-B0) and grader performance.
| OP Threshold |
Gradability | Grader 1 | Total N (%) |
Precision [Recall] | Kappa (SE) | ||
|---|---|---|---|---|---|---|---|
| Ungradable N (%) |
Gradable N (%) |
||||||
| Efficient Net-B0 Model |
OP1 0.5 |
Ungradable | 759 (23.3) | 554 (17.0) | 1313 (40.3) | 0.58 [0.92] | 0.58 |
| Gradable | 66 (2.0) | 1882 (57.7) | 1948 (59.7) | 0.97 [0.77] | (0.01) | ||
|
OP2 0.23 |
Ungradable | 686 (21.0) | 267 (8.2) | 953 (29.2) | 0.71 [0.88] | 0.69 | |
| Gradable | 139 (4.3) | 2169 (66.5) | 2308 (70.8) | 0.94 [0.89] | (0.01) | ||
|
OP3 0.15 |
Ungradable | 640 (19.6) | 195 (6.0) | 835 (25.6) | 0.77 [0.78] | 0.69 | |
| Gradable | 185 (5.7) | 2241 (68.7) | 2426 (74.4) | 0.92 [0.92] | (0.02) | ||
| Grader 2 | N/A | Ungradable | 544 (16.7) | 215 (6.6) | 759 (23.3) | 0.72 [0.66] | 0.59 |
| Gradable | 281 (8.6) | 2221 (68.1) | 2502 (76.7) | 0.89 [0.91] | (0.02) | ||
| Total N (%) | 825 (25.3) | 2436 (74.7) | 3261 (100) | N/A | |||
OP Operating point, SE Standard error.