Table 1. Annotator’s agreement with QUALITY correction overall and for one term, two terms, three terms and more per artifact.
Overall | One Term | Two Terms | > = Three Terms | |
---|---|---|---|---|
Fleiss′ Kappa | 0.49 | 0.54 | 0.50 | 0.33 |
Gwet′ sAC | 0.52 | 0.57 | 0.53 | 0.37 |
Overall | One Term | Two Terms | > = Three Terms | |
---|---|---|---|---|
Fleiss′ Kappa | 0.49 | 0.54 | 0.50 | 0.33 |
Gwet′ sAC | 0.52 | 0.57 | 0.53 | 0.37 |