Table 1.

Replication success criteria for each quantitative measure of replication success. Note: we conducted one-sided one-sample t-tests for all studies (i.e. H₀: µ = 0 and H_a: µ > 0). Therefore, we were only interested in finding positive effect sizes. The alpha levels range from 0.0001 to 0.5 in increments of 0.0001 (i.e. 5000 thresholds); the BF thresholds range from 1/10 to 200 in increments of 1/25 (i.e. 4998 thresholds).

metric	replication success criteria
(1) significance	original and replication studies have a positive effect size, in addition to replication study being significant; we included a range of alpha levels from 0.0001 to 0.5
(2) Small Telescopes	replication effect size is not significantly smaller than an effect size that would have given the original study with a positive effect size a statistical power level of 33%; we used 0.05 as level for alpha
(3) classical meta-analysis	original study and fixed-effect meta-analysis have a positive effect size, in addition to meta-analysis being significant; we included a range of alpha levels from 0.0001 to 0.5
(4) BF	original and replication studies have a positive effect size, in addition to the JZS BF of the replication study being larger than a BF threshold; we included a range of BF thresholds from 1/10 to 200
(5) replication BF	the replication BF is larger than a BF threshold, given that the original study is significant; we included a range of BF thresholds from 1/10 to 200
(6) Bayesian meta-analysis	original study and fixed-effect Bayesian meta-analysis have a positive effect size, in addition to the JZS BF of the meta-analysis being larger than a BF threshold; we included a range of BF thresholds from 1/10 to 200
(7) sceptical p-value	original study has a positive effect size, in addition to sceptical p-value being significant; we included a range of alpha levels from 0.0001 to 0.5