Table 1. Interannotator agreement measures among subgroups of and all annotators.
| A o | κ w | 95% CI | |
| PI–RA | 0.944 | 0.604 | 0.415–0.793 |
| RA–RN | 0.937 | 0.580 | 0.372–0.787 |
| RN–PI | 0.951 | 0.655 | 0.459–0.851 |
|
Krippendorff's α | 95% CI | |
| PI–RA–RN | 0.944 | 0.599 | 0.566–0.631 |
Abbreviations: CI, confidence interval. PI, principal investigator; RA, research assistant; RN, registered nurse.
Note: IAA is reported using all labels (Positive, Indeterminate, and Negative).
A
o
is observed agreement, and
κ
w
is a weighted Kappa coefficient, both of which are used to measure IAA between pairs of annotators.
and Krippendorff's
α
are used to measure IAA across all three annotators.