Skip to main content
. Author manuscript; available in PMC: 2020 Sep 1.
Published in final edited form as: Biometrics. 2019 Mar 29;75(3):1000–1008. doi: 10.1111/biom.13031

TABLE 1.

Type I error rates for detecting at least one AE at the nominal significance level of 0.05 based on 1,000 replicates.

n ρ r Bonf. (Fisher) Bonf. (Score) Perm. (Fisher) Perm. (Score) Proposed
Simulation settings mimicking Example One
100 0 0 0.006 0.017 0.058 0.055 0.060
0.3 0 0.002 0.017 0.048 0.047 0.050
0.6 0 0.004 0.014 0.045 0.047 0.045
0.9 0 0.004 0.012 0.042 0.039 0.043
0.3 0.15 0.004 0.015 0.05 0.048 0.050
0.6 0.3 < 0.001 0.008 0.044 0.048 0.046
0.9 0.45 0.001 0.008 0.026 0.028 0.030
200 0 0 0.003 0.019 0.051 0.056 0.051
0.3 0 0.007 0.019 0.040 0.047 0.042
0.6 0 0.004 0.021 0.047 0.047 0.045
0.9 0 0.006 0.013 0.037 0.037 0.036
0.3 0.15 0.011 0.020 0.049 0.052 0.052
0.6 0.3 0.009 0.021 0.053 0.056 0.054
0.9 0.45 0.005 0.016 0.052 0.058 0.053
Simulation settings mimicking Example Two
100 0 0 < 0.001 0.003 0.049 0.044 0.056
0.3 0 < 0.001 0.001 0.042 0.042 0.052
0.6 0 < 0.001 0.001 0.054 0.055 0.066
0.9 0 < 0.001 0.001 0.049 0.049 0.049
0.3 0.15 0.001 0.001 0.041 0.046 0.047
0.6 0.3 < 0.001 < 0.001 0.042 0.048 0.056
0.9 0.45 < 0.001 < 0.001 0.048 0.047 0.049
200 0 0 0.001 0.002 0.054 0.062 0.062
0.3 0 0.001 0.003 0.044 0.052 0.046
0.6 0 0.002 0.004 0.053 0.061 0.059
0.9 0 < 0.001 0.002 0.044 0.050 0.044
0.3 0.15 < 0.001 0.002 0.043 0.050 0.046
0.6 0.3 < 0.001 0.002 0.045 0.055 0.054
0.9 0.45 0.001 0.002 0.031 0.039 0.036