Table S4.
Spearman's rank order correlations of reproducibility indicators with characteristics of original study, characteristics of replication study, and contextual variability
Characteristic | Subjective replication (“Did it replicate?”) | Original effect size within 95% CI of replication | Meta-analytic estimate | Effect size difference | Replication P < 0.05 in original direction |
Contextual sensitivity† | −0.23* | −0.30* | −0.49* | −0.01 | −0.18 |
Original study effect size | 0.28* | 0.12 | 0.79* | 0.28* | 0.28* |
Surprisingness of original finding‡ | −0.25* | −0.13 | −0.21 | 0.10 | −0.23* |
Number in original study | −0.18 | −0.22* | −0.44* | −0.09 | −0.13 |
Power of replication study | 0.30* | −0.06 | 0.14 | −0.05 | 0.39* |
Surprisingness of replication result§ | −0.51* | −0.36* | −0.32 | 0.34* | −0.44* |
Similarity of replication to original study§ | 0.05 | −0.04 | −0.01 | −0.08 | 0.02 |
P < 0.05.
Coded by authors of this study.
Coded by Reproducibility Project coordinators.
Coded by replication team.