Table 3.
Annotator’s Performance in Legit.Health-AD-Test Visual Sign Severity Assessment
| Visual Signs | RSD | RMAE (Mean) | RMAE (Median) | FAR | PAR1 | PAR2 | Cohen’s Kappa |
|---|---|---|---|---|---|---|---|
| Erythema | 12.1 | 11.2 | 8.8 | 34.0 | 88.0 | 91.5 | 0.35 |
| Edema | 7.9 | 7.3 | 5.6 | 55.8 | 93.1 | 96.7 | 0.22 |
| Oozing | 10.3 | 9.5 | 7.5 | 44.4 | 89.9 | 93.1 | 0.39 |
| Excoriations | 12.7 | 11.6 | 9.4 | 39.7 | 79.0 | 87.1 | 0.20 |
| Lichenification | 10.1 | 9.3 | 7.4 | 46.8 | 88.0 | 92.9 | 0.21 |
| Dryness | 16.5 | 14.9 | 12.2 | 20.4 | 72.4 | 80.3 | 0.19 |
| Average | 11.6 | 10.6 | 8.5 | 40.2 | 85.0 | 90.3 | 0.26 |
Abbreviations: FAR, full agreement rate; PAR, partial agreement rate; RMAE, relative mean absolute error; RSD, relative SD.
These results provide the baseline to appraise the results of Legit.Health-SCORADNet.