Table 2.
Models Performance Disclosed by Retinal Imaging Type and OCTA Scanning Protocol (n = 726)
Task | Data | Models | FR | OCT | OCTA (All) | OCTA (3 × 3 SCP) | OCTA (3 × 3 DCP) | OCTA (6 × 6 SCP) | OCTA (6 × 6 DCP) | FR + OCT + OCTA† |
---|---|---|---|---|---|---|---|---|---|---|
DM diagnosis | Images | LR | 0.63 (0.08) | 0.82 (0.03)∗ | 0.74 (0.04) | 0.70 (0.06) | 0.63 (0.05) | 0.67 (0.06) | 0.65 (0.06) | 0.87 (0.03) |
LDA | 0.64 (0.10) | 0.82 (0.04)∗ | 0.74 (0.06) | 0.71 (0.04) | 0.64 (0.05) | 0.67 (0.04) | 0.66 (0.04) | 0.87 (0.03) | ||
SVC-Linear | 0.53 (0.07) | 0.67 (0.08)∗ | 0.64 (0.09) | 0.59 (0.05) | 0.53 (0.06) | 0.62 (0.08) | 0.50 (0.08) | 0.85 (0.03) | ||
SVC-rbf | 0.57 (0.06) | 0.78 (0.04)∗ | 0.66 (0.04) | 0.65 (0.05) | 0.59 (0.10) | 0.53 (0.13) | 0.55 (0.08) | 0.86 (0.03) | ||
RF | 0.65 (0.07) | 0.78 (0.04)∗ | 0.66 (0.05) | 0.62 (0.06) | 0.58 (0.07) | 0.58 (0.05) | 0.61 (0.05) | 0.86 (0.05) | ||
+ clinical variables | LR | 0.67 (0.08) | 0.86 (0.03)∗ | 0.78 (0.04) | 0.77 (0.05) | 0.71 (0.06) | 0.72 (0.05) | 0.74 (0.05) | 0.89 (0.03) | |
LDA | 0.67 (0.06) | 0.86 (0.03)∗ | 0.77 (0.05) | 0.76 (0.06) | 0.73 (0.04) | 0.72 (0.05) | 0.75 (0.05) | 0.89 (0.04) | ||
SVC-Linear | 0.57 (0.09) | 0.79 (0.07)∗ | 0.77 (0.04) | 0.69 (0.09) | 0.61 (0.05) | 0.69 (0.09) | 0.56 (0.08) | 0.88 (0.03) | ||
SVC-rbf | 0.66 (0.06) | 0.85 (0.05)∗ | 0.76 (0.06) | 0.69 (0.06) | 0.66 (0.04) | 0.69 (0.06) | 0.68 (0.04) | 0.87 (0.04) | ||
RF | 0.67 (0.05) | 0.86 (0.03)∗ | 0.70 (0.06) | 0.72 (0.04) | 0.66 (0.05) | 0.65 (0.06) | 0.72 (0.05) | 0.87 (0.05) | ||
DR diagnosis | Images | LR | 0.56 (0.09) | 0.54 (0.03) | 0.77 (0.03)∗ | 0.76 (0.04)∗ | 0.73 (0.03) | 0.69 (0.06) | 0.74 (0.04) | 0.77 (0.02) |
LDA | 0.55 (0.07) | 0.54 (0.04) | 0.77 (0.04)∗ | 0.76 (0.04)∗ | 0.74 (0.03) | 0.70 (0.08) | 0.73 (0.04) | 0.77 (0.03) | ||
SVC-Linear | 0.47 (0.07) | 0.50 (0.05) | 0.77 (0.04)∗ | 0.77 (0.05)∗ | 0.74 (0.03) | 0.68 (0.06) | 0.73 (0.04) | 0.77 (0.03) | ||
SVC-rbf | 0.49 (0.09) | 0.49 (0.05) | 0.78 (0.03)∗ | 0.77 (0.04)∗ | 0.73 (0.02) | 0.70 (0.07) | 0.73 (0.03) | 0.77 (0.03) | ||
RF | 0.54 (0.04) | 0.47 (0.03) | 0.75 (0.03)∗ | 0.72 (0.05)∗ | 0.71 (0.03) | 0.63 (0.06) | 0.69 (0.05) | 0.76 (0.04) | ||
+ clinical variables | LR | 0.78 (0.04) | 0.78 (0.04) | 0.82 (0.04)∗ | 0.81 (0.04)∗ | 0.80 (0.03) | 0.79 (0.05) | 0.80 (0.05) | 0.81 (0.04) | |
LDA | 0.78 (0.04) | 0.78 (0.04) | 0.82 (0.03)∗ | 0.82 (0.04)∗ | 0.80 (0.04) | 0.79 (0.05) | 0.79 (0.05) | 0.82 (0.03) | ||
SVC-Linear | 0.77 (0.04) | 0.77 (0.04) | 0.82 (0.04)∗ | 0.81 (0.04)∗ | 0.80 (0.04) | 0.79 (0.05) | 0.80 (0.05) | 0.81 (0.05) | ||
SVC-rbf | 0.77 (0.04) | 0.78 (0.04) | 0.82 (0.04)∗ | 0.81 (0.05)∗ | 0.80 (0.04) | 0.79 (0.05) | 0.80 (0.04) | 0.81 (0.04) | ||
RF | 0.74 (0.03) | 0.77 (0.04) | 0.81 (0.04)∗ | 0.80 (0.05)∗ | 0.79 (0.04) | 0.79 (0.05) | 0.80 (0.06) | 0.81 (0.04) | ||
Referable DR diagnosis | Images | LR | 0.42 (0.18) | 0.60 (0.11) | 0.87 (0.12)∗ | 0.83 (0.15) | 0.86 (0.08)∗ | 0.74 (0.18) | 0.82 (0.11) | 0.87 (0.10) |
LDA | 0.55 (0.19) | 0.45 (0.11) | 0.87 (0.08)∗ | 0.86 (0.11) | 0.86 (0.10)∗ | 0.70 (0.20) | 0.80 (0.13) | 0.87 (0.08) | ||
SVC-Linear | 0.49 (0.19) | 0.49 (0.13) | 0.85 (0.10)∗ | 0.76 (0.14) | 0.73 (0.14) | 0.76 (0.14) | 0.83 (0.09) | 0.83 (0.08) | ||
SVC-rbf | 0.52 (0.20) | 0.58 (0.11) | 0.73 (0.11)∗ | 0.70 (0.18) | 0.77 (0.09)∗ | 0.69 (0.14) | 0.77 (0.10) | 0.73 (0.13) | ||
RF | 0.57 (0.12) | 0.53 (0.12) | 0.77 (0.08)∗ | 0.79 (0.08) | 0.83 (0.07)∗ | 0.71 (0.10) | 0.72 (0.10) | 0.73 (0.09) | ||
+ clinical variables | LR | 0.82 (0.11) | 0.82 (0.11) | 0.92 (0.02)∗ | 0.89 (0.08) | 0.90 (0.03)∗ | 0.84 (0.09) | 0.90 (0.03) | 0.92 (0.02) | |
LDA | 0.75 (0.14) | 0.81 (0.10) | 0.91 (0.06)∗ | 0.90 (0.06) | 0.90 (0.04)∗ | 0.87 (0.04) | 0.88 (0.06) | 0.87 (0.07) | ||
SVC-Linear | 0.74 (0.14) | 0.66 (0.08) | 0.90 (0.04)∗ | 0.86 (0.05)∗ | 0.84 (0.07) | 0.76 (0.10) | 0.79 (0.11) | 0.85 (0.06) | ||
SVC-rbf | 0.70 (0.16) | 0.63 (0.11) | 0.91 (0.05)∗ | 0.88 (0.06)∗ | 0.86 (0.06) | 0.70 (0.13) | 0.83 (0.07) | 0.89 (0.04) | ||
RF | 0.68 (0.10) | 0.74 (0.10) | 0.79 (0.08)∗ | 0.84 (0.08) | 0.87 (0.06)∗ | 0.78 (0.10) | 0.70 (0.10) | 0.79 (0.07) |
Models performance described by mean area under the curve [AUC] (standard deviation).
DCP = deep capillary plexus; DM = diabetes mellitus; DR = diabetic retinopathy; FR = fundus retinography; LR = logistic regression; LDA = linear discriminant analysis; OCTA = OCT angiography; rbf = radial basis function; RF = random forest; SCP = superficial capillary plexus; SVC = support vector classifier.
The greatest AUCs by model and single image type.
Combination of all retinal images techniques.