Table 2. Study replication methods characteristics.
| Characteristic | Categories | All discipline studies(N=177) | BiomedicineN (%) | EconomicsN (%) | EducationN (%) | Health sciences*N (%) | PsychologyN (%) | Other (mixture of two or more of the above)N (%) |
|---|---|---|---|---|---|---|---|---|
| Did the replication study team specify that they contacted the original study project team? | Yes, the author teams overlapped Yes, there was contact No, the teams did not overlap or contact |
16 (9.0) 44 (24.9) 117 (66.1) |
2 (33.3) - 4 (66.7) |
- - 5 (100) |
- - 5 (100) |
4 (9.5) 14 (33.3) 24 (57.1) |
10 (11.6) 9 (10.5) 67 (77.9) |
- 21 (63.6) 12 (36.4) |
| Does the replication study refer to a protocol that was registered prior to data collection? | Yes No |
81 (45.8) 96 (54.2) |
2 (33.3) 4 (66.7) |
- 5 (100) |
1 (20.0) 4 (80.0) |
18 (42.9) 24 (57.1) |
39 (45.3) 47 (54.7) |
21 (63.6) 12 (36.4) |
| Do the authors specify that they used an identical protocol? | Yes No † Not reported Unsure |
41 (23.2) 70 (39.5) 64 (36.2) 2 (1.1) |
2 (33.3) 1 (16.7) - 2 (33.3) |
1 (20.0) 3 (60.0) 1 (20.0) - |
- 3 (60.0) 2 (40.0) - |
9 (21.4) 15 (35.7) 17 (40.5) - |
8 (9.3) 34 (39.5) 44 (51.2) - |
21 (63.6) 12 (36.64) - - |
| Does the study indicate that data is shared publicly? | Yes‡ No |
112 (63.3) 65 (36.7) |
2 (33.3) 4 (66.7) |
- 5 (100) |
1 (20.0) 4 (80.0) |
18 (42.9) 24 (57.1) |
70 (81.4) 16 (18.6) |
21 (63.6) 12 (36.4) |
| What is the study design used? | Data re-analysis Experimental Observational Trial |
35 (19.8) 52 (29.4) 85 (48.0) 5 (2.8) |
- 2 (33.3) 3 (50.0) 1 (16.7) |
3 (60.0) 1 (20.0) 1 (20.0) - |
1 (20.0) - 3 (60.0) 1 (20.0) |
26 (61.9) 10 (23.8) 3 (7.1) 3 (7.1) |
5 (5.8) 39 (45.3) 42 (48.8) - |
33 (100) - |
| Did the study specify a primary outcome? | Yes No |
43 (24.3) 134 (75.7) |
- 6 (100) |
- 5 (100) |
- 5 (100) |
26 (61.9) 16 (38.1) |
13 (15.1) 73 (84.9) |
- 33 (100) |
*
One study provided results by outcome not by studies being replicated, in this instance we were unable to determine how the results corresponded to the studies the author listed they replicated so these data are missing.
†
In these instances authors specified deviations between their protocol and that of the original research team.
‡
This was not verified. We simply recorded what the authors reported. It is possible that self-reported sharing and rates of actual sharing are not identical.