Table 1. Test of Excess Significance.
Set of studies | Proportion of significant results | Mean observed power | Mean power to detect RE estimate | Mean power to detect FE estimate |
---|---|---|---|---|
Note. Proportion of significant results in each data set and three measures of average power: (a) mean power to detect the effect size reported in each individual study, (b) mean power to detect an effect of the meta-analytic size estimated with a random-effects (RE) model, and (c) mean power to detect an effect of the meta-analytic size estimated with a fixed-effect (FE) model. The p values refer to the significance of one-tailed binomial tests contrasting the probability of the observed proportion of significant results given the three estimates of average power. | ||||
† p < .10. * p < .05. | ||||
Vohs et al. (2006); Caruso et al. (2013) | .86 | .68, p = .122 | .55, p = .017* | .55, p = .017* |
Klein et al. (2014); Rohrer et al. (2015) | .02 | .14, p = .998 | .05, p = .884 | .05, p = .884 |
Table 1 in Vohs (2015) | .85 | .70, p = .103 | .67, p = .060† | .65, p = .043* |
Table 2 in Vohs (2015) | .79 | .65, p = .096† | .84, p = .820 | .77, p = .526 |