Table 4.
Summary results of effect size estimates and percentages of times the null hypothesis of no effect was rejected of fixed-effect meta-analysis (FE), replication, hybrid, hybridR, and hybrid0 methods to 67 studies of the Reproducibility Project: Psychology
| Overall | JEP: LMC | JPSP | PSCI: Cog. | PSCI: Soc. | ||
|---|---|---|---|---|---|---|
| Number of study pairs | 67 | 20 | 18 | 13 | 16 | |
| Mean (SD) | FE | 0.322 (0.229) | 0.416 (0.205) | 0.133 (0.083) | 0.464 (0.221) | 0.300 (0.241) |
| Replication | 0.199 (0.280) | 0.291 (0.264) | 0.026 (0.097) | 0.289 (0.365) | 0.206 (0.292) | |
| Hybrid | 0.250 (0.263) | 0.327 (0.287) | 0.071 (0.087) | 0.388 (0.260) | 0.245 (0.275) | |
| Hybrid0 | 0.266 (0.242) | 0.353 (0.237) | 0.080 (0.075) | 0.400 (0.236) | 0.257 (0.259) | |
| HybridR | 0.268 (0.254) | 0.368 (0.241) | 0.083 (0.093) | 0.394 (0.272) | 0.247 (0.271) | |
| %Significant results (i.e., p value < .05) | FE | 70.1% | 90% | 44.4% | 92.3% | 56.2% |
| Replication | 34.3% | 50% | 11.1% | 46.2% | 31.2% | |
| Hybrid | 28.4% | 45% | 11.1% | 30.8% | 25% | |
| Hybrid0 | 28.4% | 45% | 11.1% | 30.8% | 25% | |
| HybridR | 34.3% | 55% | 16.7% | 38.5% | 25% | |
% Significance was based on two-tailed p values; JEP: LMC = Journal of Experimental Psychology: Learning, Memory, and Cognition; JPSP = Journal of Personality and Social Psychology; PSCI: cog. = Psychological Science cognitive psychology; PSCI: soc. = Psychological Science social psychology