Skip to main content
. Author manuscript; available in PMC: 2013 Sep 1.
Published in final edited form as: Contemp Clin Trials. 2012 May 22;33(5):869–880. doi: 10.1016/j.cct.2012.05.004

Table 5.

Results of Simulation Study 1 to assess performance of ICC estimation methods when data follow a common correlation model, with same (ρ, π) for all clusters using 2000 simulated data sets

A. Bias and mean estimated values
True ρ True π Estimated mean bias Estimated mean relative bias Mean ρ̂

ano fc pe gee ano fc pe gee ano fc pe gee re

0.02 0.1 −0.001 −0.003 −0.004 −0.005 −0.05 −0.15 −0.20 −0.25 0.019 0.017 0.016 0.015 0.056
0.2 −0.001 −0.003 −0.003 −0.004 −0.05 −0.15 −0.15 −0.20 0.019 0.017 0.017 0.016 0.033
0.3 −0.001 −0.003 −0.003 −0.004 −0.05 −0.15 −0.15 −0.20 0.019 0.017 0.017 0.016 0.025
0.4 0.000 −0.002 −0.002 −0.004 0.00 −0.10 −0.10 −0.20 0.020 0.018 0.018 0.016 0.023
0.5 0.000 −0.002 −0.002 −0.004 0.00 −0.10 −0.10 −0.20 0.020 0.018 0.018 0.016 0.022

0.05 0.1 −0.002 −0.004 −0.005 −0.008 −0.04 −0.08 −0.10 −0.16 0.048 0.046 0.045 0.042 0.125
0.2 −0.001 −0.003 −0.003 −0.006 −0.02 −0.06 −0.06 −0.12 0.049 0.047 0.047 0.044 0.079
0.3 −0.001 −0.003 −0.003 −0.005 −0.02 −0.06 −0.06 −0.10 0.049 0.047 0.047 0.045 0.063
0.4 0.000 −0.002 −0.002 −0.005 0.00 −0.04 −0.04 −0.10 0.050 0.048 0.048 0.045 0.057
0.5 0.000 −0.002 −0.002 −0.004 0.00 −0.04 −0.04 −0.08 0.050 0.048 0.048 0.046 0.055

0.10 0.1 −0.003 −0.006 −0.007 −0.011 −0.03 −0.06 −0.07 −0.11 0.097 0.094 0.093 0.089 0.234
0.2 −0.002 −0.005 −0.005 −0.008 −0.02 −0.05 −0.05 −0.08 0.098 0.095 0.095 0.092 0.159
0.3 −0.001 −0.004 −0.004 −0.007 −0.01 −0.04 −0.04 −0.07 0.099 0.096 0.096 0.093 0.132
0.4 0.000 −0.003 −0.003 −0.005 0.00 −0.03 −0.03 −0.05 0.100 0.097 0.097 0.095 0.121
0.5 0.001 −0.002 −0.002 −0.005 0.01 −0.02 −0.02 −0.05 0.101 0.098 0.098 0.095 0.118

0.25 0.1 −0.009 −0.013 −0.016 −0.026 −0.04 −0.05 −0.06 −0.10 0.241 0.237 0.234 0.224 0.510
0.2 −0.004 −0.008 −0.009 −0.014 −0.02 −0.03 −0.04 −0.06 0.246 0.242 0.241 0.236 0.393
0.3 −0.001 −0.005 −0.006 −0.010 0.00 −0.02 −0.02 −0.04 0.249 0.245 0.244 0.240 0.350
0.4 0.001 −0.004 −0.005 −0.008 0.00 −0.02 −0.02 −0.03 0.251 0.246 0.245 0.242 0.329
0.5 0.001 −0.004 −0.004 −0.008 0.00 −0.02 −0.02 −0.03 0.251 0.246 0.246 0.242 0.324
B. Empirical coverage probability of 95% confidence intervals for ρ
True ρ True π Wald interval ECP Linear interval ECP

ano fc pe ano fc pe gee

0.02 0.1 1.000 1.000 1.000 0.718 0.666 0.654 0.871
0.2 0.999 0.998 0.998 0.754 0.711 0.705 0.858
0.3 0.997 0.996 0.996 0.790 0.754 0.722 0.858
0.4 0.990 0.991 0.994 0.834 0.796 0.777 0.860
0.5 0.987 0.991 0.993 0.839 0.812 0.786 0.869

0.05 0.1 1.000 1.000 1.000 0.876 0.842 0.852 0.797
0.2 1.000 1.000 1.000 0.910 0.884 0.878 0.835
0.3 0.999 0.999 0.998 0.915 0.887 0.884 0.858
0.4 0.996 0.995 0.996 0.926 0.909 0.902 0.865
0.5 0.992 0.993 0.996 0.922 0.905 0.900 0.872

0.10 0.1 1.000 1.000 1.000 0.963 0.949 0.953 0.793
0.2 0.999 0.999 0.998 0.976 0.965 0.965 0.839
0.3 0.999 0.999 0.998 0.976 0.962 0.965 0.860
0.4 0.995 0.996 0.997 0.969 0.955 0.956 0.873
0.5 0.996 0.996 0.997 0.968 0.952 0.958 0.879

0.25 0.1 1.000 0.998 0.998 0.994 0.989 0.992 0.872
0.2 0.999 0.998 0.998 0.997 0.991 0.994 0.867
0.3 0.998 0.998 0.998 0.994 0.988 0.991 0.882
0.4 0.996 0.996 0.996 0.988 0.980 0.988 0.898
0.5 0.992 0.992 0.994 0.984 0.978 0.982 0.898

ECP, empirical coverage probability; ano, ANOVA; fc, Fleiss-Cusick; pe, Pearson; gee, generalized estimating equations; re, random intercept logistic regression