Table 4.
Annotator’s Performance in Legit.Health-AD-FPK-IVI Visual Sign Severity Assessment
| Visual Signs | RSD | RMAE (Mean) | RMAE (Median) | FAR | PAR1 | PAR2 | Cohen’s Kappa |
|---|---|---|---|---|---|---|---|
| Erythema | 11.9 | 10.8 | 8.8 | 42.3 | 80.1 | 88.2 | 0.23 |
| Edema | 8.6 | 8.0 | 6.3 | 54.0 | 90.9 | 94.5 | 0.13 |
| Oozing | 12.7 | 11.6 | 9.4 | 35.1 | 81.9 | 87.3 | 0.27 |
| Excoriations | 9.7 | 9.0 | 7.0 | 45.0 | 92.7 | 95.5 | 0.08 |
| Lichenification | 13.3 | 12.2 | 9.7 | 27.9 | 85.5 | 90.9 | 0.27 |
| Dryness | 18.2 | 16.4 | 13.4 | 10.8 | 70.2 | 81.0 | 0.09 |
| Average | 12.4 | 11.3 | 9.1 | 35.9 | 86.6 | 89.6 | 0.18 |
Abbreviations: FAR, full agreement rate; PAR, partial agreement rate; RMAE, relative mean absolute error; RSD, relative SD.
These results provide the baseline to appraise the results of Legit.Health-SCORADNet.