Table 2.
Focal effects (labeled b in Figures 1A–C) and the fit of model D (Figure 1D) in data simulated to resemble data in the 13 reanalyzed studies (23 effects total, see Table 1 for references and characteristics).
| S. E. | Focal effect [95% CI] in models A–C | Fit of Model D | ||||
|---|---|---|---|---|---|---|
| A | B | C | χ 2 | CFI | RMSEA [90% CI] | |
| 1.1 | 0.09 [0.02; 0.16]* | 0.17 [0.10; 0.23]* | −0.05 [−0.12; 0.03] | 0.6 | 1.00 | 0.00 [0.00; 0.00] |
| 2.1 | 0.04 [0.00; 0.08]* | 0.08 [0.04; 0.12]* | −0.03 [−0.08; 0.03] | 1.4 | 1.00 | 0.00 [0.00; 0.00] |
| 3.1 | 0.10 [−0.01; 0.20] | 0.32 [0.23; 0.41]* | −0.14 [−0.26; −0.03]* | 0.3 | 1.00 | 0.00 [0.00; 0.00] |
| 3.2 | −0.03 [−0.12; 0.07] | 0.25 [0.17; 0.34]* | −0.19 [−0.31; −0.08]* | 3.0 | 1.00 | 0.00 [0.00; 0.05] |
| 3.3 | 0.09 [−0.01; 0.18] | 0.18 [0.09; 0.27]* | −0.07 [−0.18; 0.05] | 1.0 | 1.00 | 0.00 [0.00; 0.00] |
| 4.1 | 0.08 [0.04; 0.12]* | 0.33 [0.30; 0.36]* | −0.16 [−0.20; −0.12]* | 0.4 | 1.00 | 0.00 [0.00; 0.00] |
| 4.2 | −0.01 [−0.04; 0.03] | −0.15 [−0.19; −0.12]* | 0.10 [0.06; 0.14]* | 0.7 | 1.00 | 0.00 [0.00; 0.00] |
| 4.3 | 0.03 [0.00; 0.07] | 0.13 [0.10; 0.17]* | −0.07 [−0.11; −0.03]* | 0.9 | 1.00 | 0.00 [0.00; 0.00] |
| 5.1 | 0.05 [0.01; 0.09]* | 0.25 [0.22; 0.29]* | −0.13 [−0.18; −0.09]* | 0.5 | 1.00 | 0.00 [0.00; 0.00] |
| 5.2 | 0.06 [0.02; 0.11]* | 0.26 [0.23; 0.30]* | −0.13 [−0.18; −0.09]* | 0.9 | 1.00 | 0.00 [0.00; 0.00] |
| 6.1 | 0.13 [0.09; 0.17]* | 0.30 [0.27; 0.34]* | −0.11 [−0.15; −0.06]* | 5.6 | 1.00 | 0.00 [0.00; 0.03] |
| 7.1 | 0.13 [0.06; 0.19]* | 0.31 [0.25; 0.37]* | −0.11 [−0.19; −0.04]* | 0.7 | 1.00 | 0.00 [0.00; 0.00] |
| 7.2 | 0.12 [0.05; 0.19]* | 0.30 [0.25; 0.36]* | −0.12 [−0.19; −0.04]* | 0.0 | 1.00 | 0.00 [0.00; 0.00] |
| 8.1 | 0.16 [0.11; 0.22]* | 0.29 [0.23; 0.34]* | −0.08 [−0.13; −0.03]* | 10.3 | 0.99 | 0.02 [0.00; 0.05] |
| 8.2 | 0.09 [0.04; 0.14]* | 0.14 [0.09; 0.18]* | −0.03 [−0.09; 0.02] | 50.6 | 0.96 | 0.08 [0.06; 0.10] |
| 8.3 | 0.28 [0.23; 0.34]* | 0.34 [0.28; 0.39]* | −0.04 [−0.09; 0.02] | 1.2 | 1.00 | 0.00 [0.00; 0.00] |
| 9.1 | −0.14 [−0.26; −0.01]* | 0.05 [−0.08; 0.18] | −0.13 [−0.30; 0.03] | 3.3 | 1.00 | 0.00 [0.00; 0.07] |
| 10.1 | 0.17 [0.04; 0.30]* | 0.28 [0.16; 0.40]* | −0.07 [−0.21; 0.06] | 0.9 | 1.00 | 0.00 [0.00; 0.00] |
| 11.1 | 0.15 [0.05; 0.24]* | 0.52 [0.45; 0.59]* | −0.25 [−0.33; −0.18]* | 0.0 | 1.00 | 0.00 [0.00; 0.00] |
| 11.2 | 0.22 [0.13; 0.30]* | 0.44 [0.36; 0.51]* | −0.14 [−0.22; −0.06]* | 0.2 | 1.00 | 0.00 [0.00; 0.00] |
| 11.3 | 0.35 [0.26; 0.44]* | 0.48 [0.40; 0.56]* | −0.09 [−0.16; −0.01]* | 21.0 | 0.98 | 0.07 [0.04; 0.10] |
| 12.1 | 0.16 [0.05; 0.27]* | 0.03 [−0.09; 0.14] | 0.09 [−0.06; 0.25] | 1.3 | 1.00 | 0.00 [0.00; 0.00] |
| 13.1 | −0.21 [−0.30; −0.11]* | −0.33 [−0.42; −0.25]* | 0.08 [−0.02; 0.18] | 1.9 | 1.00 | 0.00 [0.00; 0.02] |
CI, confidence interval; Statistically significant effects that align with effects and conclusions in the original studies are in italics while statistically significant effects that diverge from effects and conclusions in the original studies are in bold; * p < 0.05.