Skip to main content
. 2023 Nov 29;25:e48142. doi: 10.2196/48142

Table 1.

Diagnostic performance of retina and nonretina specialists.

Step and observer group AUROCa (95% CI) Sensitivity (95% CI) Specificity (95% CI) Accuracy (95% CI)
Step 1: No AIb

Nonretina specialist 0.878 (0.860-0.895) 0.934 (0.910-0.958) 0.821 (0.794-0.848) 0.859 (0.840-0.878)

Retina specialist 0.921 (0.907-0.935) 0.930 (0.905-0.954) 0.912 (0.890-0.933) 0.918 (0.904-0.932)

Both 0.901 (0.889-0.913) 0.932 (0.915-0.949) 0.870 (0.850-0.890) 0.891 (0.878-0.905)
Step 2: AI Probc

Nonretina specialist 0.922 (0.905-0.940) 0.977 (0.966-0.989) 0.867 (0.837-0.897) 0.905 (0.884-0.926)

Retina specialist 0.956 (0.946-0.966) 0.969 (0.954-0.984) 0.943 (0.924-0.962) 0.952 (0.940-0.964)

Both 0.941 (0.930-0.951) 0.973 (0.963-0.982) 0.909 (0.889-0.928) 0.930 (0.918-0.943)
Step 3: AI Prob+Evidd

Nonretina specialist 0.929 (0.913-0.946) 0.982 (0.974-0.990) 0.876 (0.846-0.906) 0.912 (0.892-0.933)

Retina specialist 0.958 (0.948-0.969) 0.971 (0.956-0.987) 0.945 (0.926-0.964) 0.954 (0.942-0.966)

Both 0.945 (0.935-0.955) 0.976 (0.967-0.985) 0.914 (0.895-0.933) 0.935 (0.923-0.947)

aAUROC: area under the receiver operating characteristic curve.

bNo AI: without artificial intelligence assistance.

cAI Prob: artificial intelligence assistance with a probability score.

dAI Prob+Evid: artificial intelligence assistance with a probability score and visual evidence heatmap.