Table 2.
Interannotator agreement.
| Answers | Annotator 1 | Annotator 2 | Annotator 3 | All |
| “Not relevant” | 0.607143 | 1.000000 | 1.000000 | 0.869048 |
| “Relevant” | 1.000000 | 0.621622 | 0.864865 | 0.828829 |
| Macroaverage | 0.803571 | 0.810811 | 0.932432 | 0.848938 |
Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.