. Author manuscript; available in PMC: 2012 May 14.

Published in final edited form as: Health Serv Outcomes Res Methodol. 2012 Mar;12(1):62–79. doi: 10.1007/s10742-012-0082-1

Table 1.

Rater agreement and reliability estimates of simulated data

Simulation type	% of no detection	% agreement within			Cronbach alpha	Pearson correlation	Intra-class correlation
Simulation type	% of no detection	0 year	2 years	5 years	Cronbach alpha	Pearson correlation	Intra-class correlation
Overall	11.0	40.4	84.0	96.0	0.989	0.982	0.982
N = 100	32.7	22.6	46.9	85.3	0.951	0.943	0.946
N = 5000	0.2	46.5	96.5	99.6	0.997	0.995	0.990
d ≤ 15	20.6	44.8	88.7	99.0	0.989	0.979	0.970
d > 15	0.5	36.6	79.9	93.4	0.989	0.984	0.990
N = 100, d ≤ 15	44.8	35.1	71.9	98.0	0.969	0.945	0.932
N = 100, d > 15	2.4	5.0	11.6	67.4	0.934	0.965	0.957
N = 5000, d ≤ 15	0.4	49.3	96.5	99.5	0.995	0.991	0.983
N = 5000, d > 15	0.0	44.4	96.6	99.7	0.998	0.996	0.993
Researchers	10.3	50.7	84.5	97.1	0.990	0.984	0.987
Students	11.3	36.2	83.8	95.6	0.989	0.981	0.981