Table 1. Sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) for ROP diagnosis by 7 retinal fellows.*.
Responses are compared to a reference standard of diagnosis by an expert pediatric retinal specialist. Analysis is performed by eye for diagnosis of mild or worse ROP, type-2 or worse ROP, and treatment-requiring ROP. Results are displayed as proportion (standard error), and unknown diagnoses by graders are considered incorrect responses.†
Mild or worse ROP |
Type-2 or worse ROP |
Treatment-requiring ROP |
|||||||
---|---|---|---|---|---|---|---|---|---|
Physician | Sensitivity | Specificity | AUC | Sensitivity | Specificity | AUC | Sensitivity | Specificity | AUC |
Fellow 1 | 0.952 (0.021) | 0.727 (0.037) | 0.840 (0.026) | 0.884 (0.049) | 0.727 (0.031) | 0.805 (0.034) | 1.000 (…) | 0.914 (0.018) | 0.957 (0.013) |
Fellow 2 | 0.914 (0.027) | 0.608 (0.041) | 0.785 (0.029) | 0.907 (0.044) | 0.707 (0.032) | 0.819 (0.031) | 1.000 (…) | 0.678 (0.031) | 0.839 (0.031) |
Fellow 3 | 0.867 (0.033) | 0.902 (0.025) | 0.884 (0.024) | 0.512 (0.076) | 0.976 (0.011) | 0.744 (0.050) | 0.933 (0.064) | 0.987 (0.007) | 0.960 (0.038) |
Fellow 4 | 0.933 (0.024) | 0.720 (0.038) | 0.827 (0.027) | 0.814 (0.059) | 0.937 (0.017) | 0.875 (0.036) | 1.000 (…) | 0.893 (0.020) | 0.946 (0.014) |
Fellow 5 | 0.838 (0.035) | 0.930 (0.021) | 0.889 (0.024) | 0.651 (0.073) | 0.946 (0.016) | 0.799 (0.045) | 0.867 (0.088) | 0.910 (0.019) | 0.888 (0.052) |
Fellow 6 | 0.838 (0.056) | 0.832 (0.031) | 0.845 (0.027) | 0.535 (0.076) | 0.883 (0.022) | 0.709 (0.049) | 0.667 (0.122) | 0.906 (0.192) | 0.786 (0.074) |
Fellow 7 | 0.971 (0.016) | 0.797 (0.034) | 0.884 (0.023) | 0.953 (0.032) | 0.712 (0.032) | 0.833 (0.029) | 0.933 (0.064) | 0.811 (0.026) | 0.872 (0.041) |
Standard error values are reported for each sensitivity, specificity and AUC value.
Unknown diagnoses were provided for 0 (0%) eyes by fellow 1, 41 (17%) eyes by fellow 2, 0 (0%) eyes by fellow 3, 7 (3%) eyes by fellow 4, 7 (3%) eyes by fellow 5, 19 (8%) eyes by fellow 6, and 0 (0%) eyes by fellow 7.