Table 4.
Percentages replication success across different publication bias levels. Note: percentages replication success for the columns where truth is 0 represent percentages false positives; percentages replication success for the columns where truth is 0.5 represent percentages true positives.
| replication success criteria | publication bias 100% |
publication bias 75% |
publication bias 50% |
publication bias 25% |
publication bias 0% |
|||||
|---|---|---|---|---|---|---|---|---|---|---|
| truth 0 (%) | truth 0.5 (%) | truth 0 (%) | truth 0.5 (%) | truth 0 (%) | truth 0.5 (%) | truth 0 (%) | truth 0.5 (%) | truth 0 (%) | truth 0.5 (%) | |
| significance (p < 0.05) | 6.2 | 97.9 | 3.1 | 97.2 | 3.1 | 96.6 | 2.8 | 96 | 2.8 | 95.4 |
| Small Telescopes (p > 0.05) | 51.7 | 99.9 | 28.1 | 99.5 | 25.1 | 99.3 | 24.7 | 99.1 | 24 | 98.8 |
| classical meta-analysis (p < 0.05) | 40.5 | 99.8 | 10.5 | 99.2 | 7.7 | 98.6 | 6.4 | 98.2 | 5.9 | 97.6 |
| Bayes factor (BF > 1) | 5.2 | 97.7 | 2.3 | 97 | 2.3 | 96.4 | 2 | 95.8 | 2 | 95.2 |
| replication Bayes factor (BF > 1) | 9.8 | 97.6 | — | — | — | — | — | — | — | — |
| Bayesian meta-analysis (BF > 1) | 29.4 | 99.7 | 7 | 99 | 5 | 98.4 | 4 | 97.9 | 3.7 | 97.3 |
| sceptical p-value (ps < 0.025) | 4.7 | 97.9 | 0.8 | 95.5 | 0.5 | 93.3 | 0.3 | 91 | 0.3 | 89.1 |