Skip to main content
. Author manuscript; available in PMC: 2018 Oct 1.
Published in final edited form as: Ann Epidemiol. 2017 Sep 22;27(10):677–685.e4. doi: 10.1016/j.annepidem.2017.09.001

Table 1.

Agreement and association measures for the AIM data set

Measure Method Estimate (95% CI)
Agreement Average pairwise Cohen* 0.438 (0.309, 0.567)
Fleiss* 0.434 (0.432, 0.435)
Model-based Kappa 0.388 (0.350, 0.427)

Association Average pairwise weighted Cohen* 0.726 (0.641, 0.811)
ICC* 0.721 (0.661, 0.783)
Model-based Weighted Kappa 0.587 (0.543, 0.631)
*

Based on a subset of 84 subjects who were classified by all 119 raters.