Table 3.
Annotator | Precision (%) | Recall (%) | F-measurea (%) |
Annotator 1 | 93.4 | 89.5 | 91.4 |
Annotator 2 | 95.6 | 91.6 | 93.5 |
Annotator 3 | 93.4 | 89.5 | 91.4 |
Annotator 4 | 89.7 | 73.4 | 80.7 |
Annotator 1 & 2 | 96.1 | 92.8 | 94.4 |
Annotator 3 & 4 | 98.7 | 96.2 | 97.4 |
a F-measure = 2*(Precision*Recall)/(Precision+Recall)