Table 2.

Comparison of the Cohen κ coefficients and the number of raters in different studies.

Study	Cohen κ coefficient	Raters, n
This study	0.61 (P<.05)	2
Chang et al [12]	0.25 (P<.05)	2
Vallance et al [30]	0.53 (P<.05), 0.57 (P<.05), 0.64 (P<.05)a	3
Wallace et al [31]	0.60-0.85 (P<.05)b	2
Hoffman and Ladner [32]	0.60 (P<.05)	2

^aCohen κ coefficient was calculated between each pair of the 3 raters, resulting in 3 values of the Cohen κ coefficient.

^bA value range rather than an overall value of the Cohen κ coefficient was reported by Wallace et al [31].