Table 1.
Diagnostic performance of retina and nonretina specialists.
| Step and observer group | AUROCa (95% CI) | Sensitivity (95% CI) | Specificity (95% CI) | Accuracy (95% CI) | ||||||
| Step 1: No AIb | ||||||||||
|
|
Nonretina specialist | 0.878 (0.860-0.895) | 0.934 (0.910-0.958) | 0.821 (0.794-0.848) | 0.859 (0.840-0.878) | |||||
|
|
Retina specialist | 0.921 (0.907-0.935) | 0.930 (0.905-0.954) | 0.912 (0.890-0.933) | 0.918 (0.904-0.932) | |||||
|
|
Both | 0.901 (0.889-0.913) | 0.932 (0.915-0.949) | 0.870 (0.850-0.890) | 0.891 (0.878-0.905) | |||||
| Step 2: AI Probc | ||||||||||
|
|
Nonretina specialist | 0.922 (0.905-0.940) | 0.977 (0.966-0.989) | 0.867 (0.837-0.897) | 0.905 (0.884-0.926) | |||||
|
|
Retina specialist | 0.956 (0.946-0.966) | 0.969 (0.954-0.984) | 0.943 (0.924-0.962) | 0.952 (0.940-0.964) | |||||
|
|
Both | 0.941 (0.930-0.951) | 0.973 (0.963-0.982) | 0.909 (0.889-0.928) | 0.930 (0.918-0.943) | |||||
| Step 3: AI Prob+Evidd | ||||||||||
|
|
Nonretina specialist | 0.929 (0.913-0.946) | 0.982 (0.974-0.990) | 0.876 (0.846-0.906) | 0.912 (0.892-0.933) | |||||
|
|
Retina specialist | 0.958 (0.948-0.969) | 0.971 (0.956-0.987) | 0.945 (0.926-0.964) | 0.954 (0.942-0.966) | |||||
|
|
Both | 0.945 (0.935-0.955) | 0.976 (0.967-0.985) | 0.914 (0.895-0.933) | 0.935 (0.923-0.947) | |||||
aAUROC: area under the receiver operating characteristic curve.
bNo AI: without artificial intelligence assistance.
cAI Prob: artificial intelligence assistance with a probability score.
dAI Prob+Evid: artificial intelligence assistance with a probability score and visual evidence heatmap.