Table 5:
Prediction of Gout Flare by Chief Complaint
GOUT-CC-2019-CORPUS | CC-2020-CORPUS | |||||
Annotator or Algorithm | Precision | Recall | F1 Score | Precision | Recall | F1 Score |
MID | 0.88 | 0.92 | 0.90 | NA | NA | NA |
JDO | 0.84 | 0.97 | 0.90 | 0.56 | 1.0 | 0.71 |
AM | NA | NA | NA | 0.67 | 1.0 | 0.80 |
Human Average | 0.86 | 0.95 | 0.90 | 0.62 | 1.0 | 0.76 |
NAIVE-GF | 0.23 | 1.00 | 0.38 | 0.28 | 0.56 | 0.37 |
SIMPLE-GF | 0.44 | 0.84 | 0.58 | 0.37 | 0.40 | 0.38 |
BERT-GF | 0.71 | 0.48 | 0.56 | 0.79∗ | 0.47∗ | 0.57∗ |
BERT-GF for the CC-2020-Corpus used a combined dataset of both corpi, due to the heavy class-imbalance in CC-2020-Corpus.