Table 3:
Annotator Agreement in GOUT-CC-2019-CORPUS and CC-2020-CORPUS
| Corpus Name | GF* POS | GF NEG | GF UNK | Review** | Agreement | Cohen’s κ |
| GOUT-CC-2019-CORPUS | 93 | 194 | 13 | CC | 0.883 | 0.825 |
| GOUT-CC-2019-CORPUS | 70 | 118 | 9 | Chart | 0.849 | 0.774 |
| CC-2020-CORPUS | 14 | 7992 | 129 | CC | 0.977 | 0.965 |
| CC-2020-CORPUS | 25 | 232 | 7 | Chart | 0.904 | 0.856 |
*
GF (Gout Flare)
**
Review refers to the process that was made to determine gout status. Chart indicates a full chart review, CC indicates that only the chief complaint was used to predict whether a patient was presenting with a gout flare.