TABLE 1.
Type I error rates for detecting at least one AE at the nominal significance level of 0.05 based on 1,000 replicates.
| n | ρ | r | Bonf. (Fisher) | Bonf. (Score) | Perm. (Fisher) | Perm. (Score) | Proposed |
|---|---|---|---|---|---|---|---|
| Simulation settings mimicking Example One | |||||||
| 100 | 0 | 0 | 0.006 | 0.017 | 0.058 | 0.055 | 0.060 |
| 0.3 | 0 | 0.002 | 0.017 | 0.048 | 0.047 | 0.050 | |
| 0.6 | 0 | 0.004 | 0.014 | 0.045 | 0.047 | 0.045 | |
| 0.9 | 0 | 0.004 | 0.012 | 0.042 | 0.039 | 0.043 | |
| 0.3 | 0.15 | 0.004 | 0.015 | 0.05 | 0.048 | 0.050 | |
| 0.6 | 0.3 | < 0.001 | 0.008 | 0.044 | 0.048 | 0.046 | |
| 0.9 | 0.45 | 0.001 | 0.008 | 0.026 | 0.028 | 0.030 | |
| 200 | 0 | 0 | 0.003 | 0.019 | 0.051 | 0.056 | 0.051 |
| 0.3 | 0 | 0.007 | 0.019 | 0.040 | 0.047 | 0.042 | |
| 0.6 | 0 | 0.004 | 0.021 | 0.047 | 0.047 | 0.045 | |
| 0.9 | 0 | 0.006 | 0.013 | 0.037 | 0.037 | 0.036 | |
| 0.3 | 0.15 | 0.011 | 0.020 | 0.049 | 0.052 | 0.052 | |
| 0.6 | 0.3 | 0.009 | 0.021 | 0.053 | 0.056 | 0.054 | |
| 0.9 | 0.45 | 0.005 | 0.016 | 0.052 | 0.058 | 0.053 | |
| Simulation settings mimicking Example Two | |||||||
| 100 | 0 | 0 | < 0.001 | 0.003 | 0.049 | 0.044 | 0.056 |
| 0.3 | 0 | < 0.001 | 0.001 | 0.042 | 0.042 | 0.052 | |
| 0.6 | 0 | < 0.001 | 0.001 | 0.054 | 0.055 | 0.066 | |
| 0.9 | 0 | < 0.001 | 0.001 | 0.049 | 0.049 | 0.049 | |
| 0.3 | 0.15 | 0.001 | 0.001 | 0.041 | 0.046 | 0.047 | |
| 0.6 | 0.3 | < 0.001 | < 0.001 | 0.042 | 0.048 | 0.056 | |
| 0.9 | 0.45 | < 0.001 | < 0.001 | 0.048 | 0.047 | 0.049 | |
| 200 | 0 | 0 | 0.001 | 0.002 | 0.054 | 0.062 | 0.062 |
| 0.3 | 0 | 0.001 | 0.003 | 0.044 | 0.052 | 0.046 | |
| 0.6 | 0 | 0.002 | 0.004 | 0.053 | 0.061 | 0.059 | |
| 0.9 | 0 | < 0.001 | 0.002 | 0.044 | 0.050 | 0.044 | |
| 0.3 | 0.15 | < 0.001 | 0.002 | 0.043 | 0.050 | 0.046 | |
| 0.6 | 0.3 | < 0.001 | 0.002 | 0.045 | 0.055 | 0.054 | |
| 0.9 | 0.45 | 0.001 | 0.002 | 0.031 | 0.039 | 0.036 | |