Table 2.
Patient VISUHEALTH-AI DR performance evaluation by site.
| Precision | Recall | F-Score | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Referable | Non-Referable | Ungradable | Referable | Non-Referable | Ungradable | Referable | Non-Referable | Ungradable | |
| 1 | 19.30 (10.05–31.91) |
99.70 (99.13–99.94) |
28.32 (24.48–32.41) |
47.83 (26.82–69.41) |
71.01 (68.56–73.37) |
98.66 (95.24–99.84) |
27.50 (18.10–38.62) |
82.95 (81.38–84.43) |
44.01 (40.21–47.87) |
| 2 | 54.05 (44.33–63.55) |
96.09 (94.91–97.06) |
52.89 (47.61–58.12) |
55.56 (45.68–65.12) |
86.05 (84.21–87.76) |
92.31 (87.81–95.54) |
54.79 (47.95–61.51) |
90.79 (89.68–91.83) |
67.25 (63.23–71.09) |
| 3 | 19.05 (5.45–41.91) |
87.96 (83.50–91.56) |
61.92 (55.96–67.62) |
33.33 (9.92–65.11) |
68.08 (62.95–72.91) |
82.86 (77.07–87.7) |
24.24 (11.09–42.26) |
76.75 (73.25–80.00) |
70.88 (66.64–74.86) |
| 4 | 23.26 (11.76–38.63) |
96.84 (95.47–97.89) |
79.25 (70.28–86.51) |
71.43 (41.90–91.61) |
94.81 (93.16–96.16) |
72.41 (63.34–80.3) |
35.09 (22.91–48.87) |
95.82 (94.78–96.70) |
75.68 (69.48–81.17) |
| 5 | 18.18 (2.28–51.78) |
96.23 (91.97–98.60) |
47.54 (34.60–60.73) |
50.00 (6.76–93.24) |
79.27 (72.87–84.76) |
85.29 (68.94–95.05) |
26.67 (7.79–55.10) |
86.93 (82.96–90.27) |
61.05 (50.50–70.89) |
| 6 | 32.18 (22.56–43.06) |
97.44 (96.03–98.45) |
45.64 (38.51–52.91) |
56.00 (41.25–70.01) |
82.16 (79.47–84.63) |
94.68 (88.02–98.25) |
40.88 (32.56–49.60) |
89.15 (87.53–90.62) |
61.59 (55.72–67.23) |
| 7 | 61.90 (51.91–71.21) |
92.87 (90.94–94.51) |
83.33 (75.20–89.66) |
71.43 (61.00–80.41) |
94.08 (92.27–95.58) |
68.35 (59.92–75.97) |
66.33 (59.25–72.90) |
93.47 (92.19–94.60) |
75.10 (69.30–80.30) |
| 8 | 40.66 (33.45–48.17) |
97.25 (96.14–98.11) |
41.54 (37.03–46.16) |
59.20 (50.05–67.90) |
76.68 (74.43–78.82) |
91.51 (86.91–94.89) |
48.21 (42.50–53.95) |
85.75 (84.35–87.06) |
57.14 (53.32–60.90) |
| 9 | 13.48 (8.31–20.24) |
90.37 (88.45–92.06) |
83.26 (77.58–87.99) |
86.36 (65.09–97.09) |
89.05 (87.05–90.84) |
56.29 (50.64–61.82) |
23.31 (17.06–30.57) |
89.71 (88.35–90.95) |
67.17 (63.00–71.14) |
| 10 | 22.73 (16.37–30.16) |
73.65 (71.25–75.95) |
86.85 (83.15–89.99) |
71.43 (56.74–83.42) |
89.66 (87.74–91.36) |
46.3 (42.70–49.93) |
34.48 (27.97–41.46) |
80.87 (79.28–82.39) |
60.4 (57.51–63.23) |
| 11 | 44.19 (29.08–60.12) |
96.79 (93.77–98.60) |
77.63 (66.62–86.40) |
90.48 (69.62–98.83) |
87.64 (83.15–91.28) |
81.94 (71.11–90.02) |
59.38 (46.37–71.49) |
91.98 (89.32–94.16) |
79.73 (72.34–85.89) |
| 12 | 9.16 (4.82–15.45) |
90.55 (88.74–92.16) |
93.39 (87.39–97.10) |
100.0 (73.54–100.0) |
92.93 (91.28–94.34) |
41.85 (35.90–47.98) |
16.78 (11.06–23.94) |
91.72 (90.53–92.81) |
57.80 (52.73–62.75) |
| 13 | 20.69 (11.17–33.35) |
94.33 (91.91–96.20) |
58.97 (42.10–74.43) |
60.00 (36.05–80.88) |
89.10 (86.11–91.64) |
47.92 (33.29–62.81) |
30.77 (20.81–42.24) |
91.64 (89.77–93.27) |
52.87 (41.87–63.67) |
| 14 | 28.33 (17.45–41.44) |
99.17 (97.89–99.77) |
25.58 (13.52–41.17) |
77.27 (54.63–92.18) |
87.07 (83.97–89.76) |
78.57 (49.20–95.34) |
41.46 (30.68–52.88) |
92.73 (90.97–94.24) |
38.60 (26.00–52.43) |
| 15 | 28.57 (13.22–48.67) |
88.03 (84.44–91.04) |
72.55 (58.26–84.11) |
80.00 (44.39–97.48) |
91.93 (88.74–94.45) |
43.02 (32.39–54.15) |
42.11 (26.31–59.18) |
89.94 (87.62–91.95) |
54.01 (45.30–62.56) |
| 16 | 19.70 (10.93–31.32) |
99.16 (97.87–99.77) |
25.58 (13.52–41.17) |
76.47 (50.10–93.19) |
85.10 (81.87–87.95) |
84.62 (54.55–98.08) |
31.33 (21.59–42.44) |
91.59 (89.73–93.21) |
39.29 (26.50–53.25) |
| 17 | 32.63 (23.36–43.02) |
92.98 (90.62–94.89) |
93.75 (79.19–99.23) |
86.11 (70.5–95.33) |
90.85 (88.28–93.01) |
38.96 (28.05–50.75) |
47.33 (38.55–56.23) |
91.90 (90.22–93.38) |
55.05 (45.22–64.59) |
| 18 | 20.00 (11.65–30.83) |
84.59 (81.73–87.16) |
83.53 (78.40–87.86) |
88.24 (63.56–98.54) |
88.18 (85.52–90.5) |
62.28 (56.91–67.44) |
32.61 (23.20–43.18) |
86.35 (84.44–88.10) |
71.36 (67.55–74.95) |
| 19 | 27.17 (18.42–37.45) |
99.67 (98.83–99.96) |
40.00 (21.13–61.33) |
92.59 (75.71–99.09) |
88.31 (85.68–90.61) |
90.91 (58.72–99.77) |
42.02 (33.03–51.41) |
93.65 (92.19–94.91) |
55.56 (38.10–72.06) |
| 20 | 32.00 (21.69–43.78) |
93.62 (92.01–95.00) |
40.51 (34.20–47.05) |
26.09 (17.48–36.29) |
85.38 (83.26–87.33) |
84.21 (76.2–90.37) |
28.74 (22.01–36.24) |
89.31 (87.98–90.55) |
54.70 (49.33–59.99) |
| Total | 29.6 (27.40–31.88) |
92.56 (92.13–92.97) |
58.58 (56.97–60.19) |
62.69 (59.17–66.12) |
85.65 (85.11–86.18) |
65.06 (63.40–66.69) |
40.22 (38.25–42.21) |
88.97 (88.62–89.31) |
61.65 (60.50–62.80) |