Table 2.
Simulation Results.
| Model index | Time effects | Scenario 1 | Scenario 2.1 | Scenario 2.2 | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Main | Interaction | Standard | Confounding (+) | Confounding (−) | |||||||||||||||||||
| fixed | random | fixed | random | %bias | SD | SE | cov | pwr | α | %bias | SD | SE | cov | pwr | α | %bias | SD | SE | cov | pwr | α | ||
| 1 | disc | 0.4 | 0.08 | 0.08 | 0.94 | 1 | 0.05 | −0.5 | 0.11 | 0.08 | 0.83 | 1 | 0.20 | 0.7 | 0.10 | 0.09 | 0.92 | 1 | 0.10 | % | |||
| 2 | disc | H/G | 0.3 | 0.08 | 0.08 | 0.94 | 1 | 0.04 | −0.4 | 0.10 | 0.10 | 0.93 | 1 | 0.07 | 0.7 | 0.10 | 0.09 | 0.93 | 1 | 0.07 | |||
| 3 | disc | UN | 0.9 | 0.10 | 0.11 | 0.96 | 1 | 0.03 | 0.6 | 0.12 | 0.12 | 0.95 | 0.99 | 0.07 | 2.3 | 0.12 | 0.12 | 0.95 | 0.99 | 0.04 | |||
| 4 | disc | lin | 0.5 | 0.08 | 0.08 | 0.93 | 1 | 0.06 | 0.1 | 0.11 | 0.08 | 0.82 | 1 | 0.21 | 0.5 | 0.10 | 0.09 | 0.90 | 1 | 0.12 | |||
| 5 | disc | H/G | lin | H/G | 0.6 | 0.25 | 0.24 | 0.93 | 0.6 | 0.05 | 8.0 | 0.28 | 0.26 | 0.93 | 0.53 | 0.05 | 4.2 | 0.28 | 0.26 | 0.93 | 0.53 | 0.07 | |
| 6 | disc | UN | lin | UN | 1.5 | 0.29 | 0.31 | 0.96 | 0.38 | 0.03 | 9.3 | 0.32 | 0.33 | 0.95 | 0.39 | 0.05 | 6.8 | 0.32 | 0.35 | 0.96 | 0.32 | 0.04 | |
| 7 | disc | lin | lin | lin | 0.9 | 0.25 | 0.24 | 0.93 | 0.59 | 0.05 | 9.2 | 0.29 | 0.23 | 0.87 | 0.62 | 0.13 | 5.0 | 0.28 | 0.26 | 0.93 | 0.54 | 0.09 | |
| 8 | lin | H/G | lin | H/G | −0.4 | 0.14 | 0.14 | 0.95 | 0.96 | 0.05 | −4.7 | 0.16 | 0.16 | 0.94 | 0.85 | 0.08 | 4.5 | 0.17 | 0.16 | 0.92 | 0.92 | 0.08 | |
| 9 | lin | UN | lin | UN | −1.5 | 0.16 | 0.17 | 0.96 | 0.85 | 0.02 | −2.7 | 0.18 | 0.19 | 0.96 | 0.79 | 0.04 | 5.3 | 0.19 | 0.2 | 0.95 | 0.8 | 0.04 | |
| 10 | lin | lin | lin | lin | −0.8 | 0.14 | 0.14 | 0.94 | 0.95 | 0.05 | −9.8 | 0.17 | 0.13 | 0.81 | 0.88 | 0.18 | 2.2 | 0.18 | 0.15 | 0.92 | 0.92 | 0.12 | |
| Model index | Time effects | Scenario 3 | Scenario 4.1 | Scenario 4.2 | |||||||||||||||||||
| Main | Interaction | Early adoption | Confounding (+) & Early adoption | Confounding (−) & Early adoption | |||||||||||||||||||
| fixed | random | fixed | random | %bias | SD | SE | cov | pwr | α | %bias | SD | SE | cov | pwr | α | %bias | SD | SE | cov | pwr | α | ||
| 1 | disc | −33.6 | 0.09 | 0.09 | 0.49 | 0.98 | 0.04 | −33.1 | 0.12 | 0.08 | 0.44 | 0.94 | 0.20 | −32.8 | 0.11 | 0.09 | 0.53 | 0.95 | 0.10 | ||||
| 2 | disc | H/G | −33.6 | 0.09 | 0.09 | 0.51 | 0.97 | 0.04 | −33.4 | 0.11 | 0.10 | 0.56 | 0.89 | 0.07 | −32.8 | 0.11 | 0.10 | 0.58 | 0.92 | 0.07 | |||
| 3 | disc | UN | −32.7 | 0.10 | 0.11 | 0.7 | 0.88 | 0.03 | −32.3 | 0.13 | 0.12 | 0.72 | 0.79 | 0.06 | −31.8 | 0.13 | 0.13 | 0.76 | 0.78 | 0.05 | |||
| 4 | disc | lin | −33.4 | 0.09 | 0.08 | 0.46 | 0.98 | 0.04 | −33.0 | 0.12 | 0.08 | 0.43 | 0.94 | 0.20 | −32.8 | 0.11 | 0.09 | 0.49 | 0.95 | 0.09 | |||
| 5 | disc | H/G | lin | H/G | −8.0 | 0.24 | 0.24 | 0.95 | 0.49 | 0.04 | 2.1 | 0.30 | 0.27 | 0.92 | 0.49 | 0.08 | −4.0 | 0.31 | 0.27 | 0.91 | 0.47 | 0.10 | |
| 6 | disc | UN | lin | UN | −3.9 | 0.28 | 0.32 | 0.98 | 0.29 | 0.01 | 4.8 | 0.34 | 0.34 | 0.94 | 0.33 | 0.04 | 2.9 | 0.37 | 0.37 | 0.95 | 0.29 | 0.04 | |
| 7 | disc | lin | lin | lin | −6.8 | 0.24 | 0.24 | 0.95 | 0.47 | 0.04 | 4.2 | 0.31 | 0.24 | 0.85 | 0.59 | 0.14 | −2.4 | 0.31 | 0.26 | 0.9 | 0.48 | 0.11 | |
| 8 | lin | H/G | lin | H/G | −3.0 | 0.14 | 0.14 | 0.95 | 0.93 | 0.03 | −6.6 | 0.18 | 0.16 | 0.90 | 0.83 | 0.07 | 2.9 | 0.17 | 0.16 | 0.95 | 0.90 | 0.07 | |
| 9 | lin | UN | lin | UN | −1.9 | 0.16 | 0.18 | 0.97 | 0.83 | 0.02 | −1.8 | 0.20 | 0.19 | 0.93 | 0.76 | 0.05 | 2.5 | 0.20 | 0.20 | 0.96 | 0.73 | 0.05 | |
| 10 | lin | lin | lin | lin | −2.9 | 0.14 | 0.14 | 0.94 | 0.94 | 0.05 | −10.8 | 0.18 | 0.13 | 0.81 | 0.87 | 0.21 | 1.0 | 0.17 | 0.15 | 0.93 | 0.92 | 0.11 | |
bias , standard deviation (SD), estimated standard error (SE), coverage rate of 95% confidence interval (cov), power (pwr), and Type 1 error (α) of estimated intervention effect. Rows correspond to fitting models 1 through 10 under the scenarios described in Table 1; +/− imply positive/negative effect of confounding factors on outcome. Models include discrete (disc) or linear (lin) fixed time effects for all clusters (main effect) and/or control clusters (interaction effect). H/G, UN, and lin indicate Hooper/Girling, unstructured, and linear random effect structure for time effects.