Table B2.

Computing Subject-Level Agreement Coefficients ${\kappa }_{G|i}^{☆}$ Between Raters 1 and 2 Based on the $\mathrm{AC}{}_1$ Coefficient.

		$(1-{\pi }_k)[{\epsilon }_{\mathrm{ik}}^{(1)}+{\epsilon }_{\mathrm{ik}}^{(2)}]/[2(q-1)]$
Subject $(i)$	$p_{a|i}$	$k=1$	$k=2$	$k=3$	$p_{e|i}$ a	${\kappa }_{G|i}^{(1,2)}$ b	${\kappa }_{G|i}^{☆(1,2)}$ c
1	1	0.1833	0	0	0.1833	1	1.0406
2	1	0.1833	0	0	0.1833	1	1.0406
3	1	0.1833	0	0	0.1833	1	1.0406
4	1	0.1833	0	0	0.1833	1	1.0406
5	1	0	0	0.4	0.4	1	0.9335
6	1	0.1833	0	0	0.1833	1	1.0406
7	1	0.1833	0	0	0.1833	1	1.0406
8	1	0.1833	0	0	0.1833	1	1.0406
9	1	0.1833	0	0	0.1833	1	1.0406
10	1	0	0.4167	0	0.4167	1	0.9253
11	1	0.1833	0	0	0.1833	1	1.0406
12	0	0	0.2083	0.2	0.4083	–0.3616	–0.4322
13	1	0	0.4167	0	0.4167	1	0.9253
14	1	0	0	0.4	0.4	1	0.9335
15	0	0.0917	0	0.2	0.2917	–0.3616	–0.3745
	$p_a$				$p_e$	${\hat{\kappa }}_G$	${\hat{\kappa }}_G$
Average	0.867				0.266	0.818	0.818

^a This is obtained by summing columns 3, 4, and 5. ^bThis is computed as $(p_{a|i}-p_e)/p_e$ (i.e., Col 7 = (Col2 − 0.266)/(1 − 0.266)). ^cThis is computed based on Equation (16): Col8 = Col7 − 2×(1 − 0.818)×(Col6 − 0.266)/(1 − 0.266)