Table 1.
Agreement and association measures for the AIM data set
Measure | Method | Estimate (95% CI) |
---|---|---|
Agreement | Average pairwise Cohen* | 0.438 (0.309, 0.567) |
Fleiss* | 0.434 (0.432, 0.435) | |
Model-based Kappa | 0.388 (0.350, 0.427) | |
| ||
Association | Average pairwise weighted Cohen* | 0.726 (0.641, 0.811) |
ICC* | 0.721 (0.661, 0.783) | |
Model-based Weighted Kappa | 0.587 (0.543, 0.631) |
Based on a subset of 84 subjects who were classified by all 119 raters.