Table 2.
The performance of Interpretable Eye Diseases Screening System (IEDSS) for identifying common eye diseases in internal dataset and multicenter datasets.
| SAHZU |
APHNU |
FAHUSTC |
|||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUROC (%)(95% CI) | ACC (%)(95%CI) | F1(95%CI) | Sensitivity (%) (95% CI) | Specificity (%)(95% CI) | AUROC (%)(95% CI) | ACC (%)(95%CI) | F1(95%CI) | Sensitivity (%)(95% CI) | Specificity (%) (95% CI) | AUROC (%)(95% CI) | ACC (%)(95%CI) | F1(95%CI) | Sensitivity (%) (95% CI) | Specificity (%) (95% CI) | |
| wet-AMD | 98·84(98·48-99·20) | 95·34(94·63-96·06) | 0·7813(0·7759-0·7866) | 95·49(92·22-97·47) | 95·33(94·50-96·04) | 98·62(98·36-99·32) | 94·70(93·69-95·70) | 0·5750(0·5560-0·5940) | 94·52(85·84-98·23) | 94·70(93·56-95·66) | 98·84(98·44-99·24) | 95·96(95·22-96·70) | 0·7860(0·7728-0·7992) | 93·95(89·65-96·61) | 96·14(95·29-96·84) |
| BRVO | 99·61(99·40-99·82) | 97·55(97·02-98·08) | 0·8469(0·8422-0·8516) | 97·82(94·70-99·19) | 97·53(96·90-98·04) | 99·24(99·33-99·89) | 96·93(96·16-97·70) | 0·7986(0·7832-0·8141) | 97·50(92·32-99·35) | 96·89(95·96-97·62) | 99·51(99·25-99·77) | 98·20(97·70-98·70) | 0·9026(0·8930-0·9121) | 95·78(92·14-97·84) | 98·43(97·84-98·87) |
| CRVO | 98·61(98·21-99·01) | 94·25(93·46-95·05) | 0·6245(0·6182-0·6308) | 98·14(94·22-99·52) | 94·06(93·16-94·84) | 97·74(98·09-99·13) | 87·26(85·77-88·75) | 0·5224(0·5032-0·5416) | 98·53(94·25-99·74) | 86·40(84·71-87·94) | 97·38(96·78-97·98) | 92·18(91·18-93·19) | 0·5958(0·5800-0·6117) | 96·91(92·57-98·86) | 91·88(90·74-92·90) |
| CSCR | 98·16(97·70-98·62) | 95·68(94·98-96·37) | 0·7088(0·7028-0·7147) | 89·23(83·80-93·06) | 96·08(95·32-96·72) | 98·54(97·56-98·76) | 98·13(97·52-98·73) | 0·7049(0·6874-0·7225) | 87·76(74·45-94·92) | 98·40(97·69-98·90) | 98·72(98·30-99·14) | 94·94(94·11-95·76) | 0·5175(0·5014-0·5336) | 89·16(79·94-94·62) | 95·12(94·21-95·89) |
| DR | 98·75(98·37-99·13) | 96·07(95·41-96·73) | 0·9443(0·9414-0·9473) | 95·91(94·56-96·95) | 96·15(95·23-96·91) | 98·56(98·25-99·25) | 93·45(92·34-94·55) | 0·9259(0·9158-0·936) | 93·69(91·77-95·20) | 93·26(91·56-94·65) | 98·25(97·76-98·74) | 95·82(95·06-96·57) | 0·9442(0·9368-0·9516) | 93·97(92·28-95·31) | 96·94(95·97-97·68) |
| EMM | 99·35(99·08-99·62) | 97·67(97·16-98·19) | 0·8824(0·8783-0·8866) | 94·75(91·45-96·87) | 97·97(97·38-98·43) | 97·29(98·99-99·71) | 93·03(91·89-94·17) | 0·5939(0·5751-0·6128) | 92·45(85·23-96·45) | 93·07(91·77-94·17) | 98·40(97·93-98·87) | 92·29(98·34-99·17) | 0·5607(0·5447-0·5767) | 91·78(85·77-95·49) | 92·32(91·21-93·31) |
| MH | 99·74(99·57-100·00) | 99·09(98·77-99·42) | 0·9045(0·9006-0·9083) | 98·61(94·56-99·76) | 99·11(98·70-99·40) | 99·50(99·51-99·97) | 98·18(97·58-98·78) | 0·7244(0·7072-0·7416) | 95·83(84·57-99·28) | 98·24(97·51-98·77) | 99·60(99·36-99·84) | 98·75(98·34-99·17) | 0·7671(0·7535-0·7808) | 96·55(87·05-99·40) | 98·80(98·29-99·16) |
| RT | 99·26(98·97-99·70) | 96·73(96·13-97·34) | 0·8846(0·8805-0·8888) | 96·50(94·17-97·96) | 96·77(96·04-97·37) | 99·08(98·88-99·64) | 94·70(93·69-95·70) | 0·8000(0·7846-0·8154) | 94·88(90·79-97·29) | 94·67(93·47-95·67) | 98·82(98·41-99·23) | 95·56(94·79-96·33) | 0·7858(0·7726-0·7991) | 92·12(87·77-95·06) | 95·89(95·02-96·62) |
| VH | NA | 99·39(99·16-99·61) | 0·9333(0·9301-0·9366) | 97·03(93·35-98·79) | 99·49(99·14-99·69) | NA | 99·19(98·85-99·53) | 0·9501(0·9541-0·9585) | 96·15(92·29-98·20) | 99·46(99·04-99·70) | NA | 99·38(99·13-99·63) | 0·9635(0·9575-0·9696) | 97·12(94·42-98·59) | 99·59(99·29-99·76) |
| RD | NA | 99·65(99·48-99·82) | 0·9905(0·9893-0·9918) | 99·17(98·22-99·64) | 99·76(99·44-99·90) | NA | 99·77(99·59-99·95) | 0·9863(0·9819-0·9908) | 99·18(97·41-99·79) | 99·69(99·32-99·86) | NA | 99·73(99·56-99·90) | 0·9906(0·9875-0·9937) | 99·44(98·22-99·85) | 99·78(99·52-99·90) |
| RMO | NA | 99·46(99·24-99·67) | 0·9395(0·9364-0·9426) | 94·17(89·80-96·82) | 99·71(99·43-99·86) | NA | 99·38(99·08-99·68) | 0·9252(0·9151-0·9353) | 97·06(91·02-99·24) | 99·48(99·09-99·71) | NA | 99·21(98·92-99·50) | 0·8889(0·8788-0·899) | 93·55(87·28-96·97) | 99·41(99·09-99·63) |
| ODE | NA | 99·52(99·28-99·75) | 0·9292(0·9259-0·9325) | 100·00(95·60-100·00) | 99·50(99·17-99·70) | NA | 99·69(99·48-99·91) | 0·9048(0·8935-0·9161) | 97·44(84·92-99·87) | 99·73(99·41-99·88) | NA | 99·70(99·53-99·88) | 0·9160(0·9071-0·9250) | 96·77(87·83-99·44) | 99·75(99·51-99·88) |
| OA | NA | 99·73(99·55-99·91) | 0·9557(0·953-0·9583) | 97·98(92·19-99·65) | 99·78(99·53-99·90) | NA | 99·58(99·33-99·83) | 0·9241(0·914-0·9343) | 98·53(90·99-99·92) | 99·60(99·25-99·80) | NA | 99·68(99·49-99·86) | 0·9250(0·9165-0·9335) | 97·37(89·95-99·54) | 99·72(99·47-99·86) |
| SG | NA | 99·24(98·95-99·54) | 0·9383(0·9351-0·9414) | 94·06(89·60-96·75) | 99·58(99·26-99·77) | NA | 98·46(97·99-98·93) | 0·9180(0·9075-0·9286) | 97·82(94·70-99·19) | 98·52(97·93-98·95) | NA | 97·83(97·36-98·30) | 0·9111(0·9019-0·9203) | 97·62(95·52-98·79) | 97·86(97·29-98·32) |
AUROC is not applicable for multi-class models since the multi-class models make decisions by selecting the highest probability in each sample instead of a threshold.
SAHZU, the Second Affiliated Hospital of Zhejiang University; APHNU, the Affiliated People's Hospital of Ningbo University; FAHUSTC, the First Affiliated Hospital of University of Science and Technology of China; wet-AMD, wet age-related macular degeneration; BRVO, branch retinal vein occlusion; CRVO, central retinal vein occlusion; CSCR, central serous chorioretinopathy; DR, diabetic retinopathy; EMM, epimacular membrane; MH, macular Hole; RT, retinal tears; VH, vitreous hemorrhage; RD, retinal detachment; RMO, refractive media opacity; ODE, optic disc edema; OA, optic atrophy; SG, suspected glaucoma; NA, not applicable.