Table 2. Delphi voting results by round.
| Round 1 | Round 2 | Round 3 | |||||
|---|---|---|---|---|---|---|---|
| # | Open science practice | Scale | N (%)a | Scale | N (%)a | Scale | N (%)a |
| 1 | Whether clinical trials have been registered before starting recruitment | 1–3 4–6 7–9 |
9 (11.7) 4 (5.2) 64 (83.1) |
||||
| 2 | Whether systematic reviews have been registered before data collection | 1–3 4–6 7–9 |
6 (7.9) 14 (18.4) 56 (73.7) |
Include Exclude Discuss No expertise |
36 (75.0) 7 (14.6) 5 (10.4) 10 |
Include Exclude Abstain |
15 (88.2) 2 (11.8) 4 |
| 3 | Whether hypothesis testing research has been registered | 1–3 4–6 7–9 |
17 (22.1) 18 (23.4) 42 (54.5) |
Include Exclude Discuss No expertise |
26 (51.0) 18 (35.3) 7 (13.7) 5 |
Include Exclude Abstain |
7 (46.7) 8 (53.3) 5 |
| 4 | Whether any research paper has been registered | 1–3 4–6 7–9 |
13 (16.7) 28 (35.9) 37 (47.4) |
Include Exclude Discuss No expertise |
15 (28.8) 28 (53.8) 9 (17.3) 4 |
Include Exclude Abstain |
7 (41.2) 10 (58.8) 3 |
| 5 | Whether data were shared openly at the time of publication (with limited exceptions) | 1–3 4–6 7–9 |
11 (14.1) 13 (16.7) 54 (69.2) |
Include Exclude Discuss No expertise |
46 (85.2) 3 (5.6) 5 (9.3) 3 |
||
| 6 | Whether code was shared openly at the time of publication (with limited exceptions) | 1–3 4–6 7–9 |
4 (5.1) 18 (23.1) 56 (71.8) |
Include Exclude Discuss No expertise |
46 (86.8) 4 (7.5) 3 (5.7) 4 |
||
| 7 | Whether study materials were shared openly at the time of publication (with limited exceptions) | 1–3 4–6 7–9 |
11 (14.1) 17 (21.8) 50 (64.1) |
Include Exclude Discuss No expertise |
34 (70.8) 6 (12.5) 8 (16.7) 7 |
Item modified for voting (See #8) | |
| 8c | Whether there was a statement about study materials sharing with publications | Include Exclude Abstain |
18 (94.7) 1 (5.3) 2 |
||||
| 9 | Reporting the number of preprints | 1–3 4–6 7–9 |
13 (16.9) 21 (27.3) 43 (55.8) |
Include Exclude Discuss No expertise |
30 (57.7) 13 (25.0) 9 (17.3) 4 |
Include Exclude Abstain |
15 (88.2) 2 (11.8) 0 |
| 10 | Reporting whether articles were published open access at the time of publication | 1–3 4–6 7–9 |
10 (13.0) 14 (18.2) 53 (68.8) |
Include Exclude Discuss No expertise |
34 (64.2) 8 (15.1) 11 (20.8) 3 |
Item modified for voting (See #12) | |
| 11 | Reporting whether articles were published open access but allowing an embargo period (e.g., 1 year) | 1–3 4–6 7–9 |
23 (30.3) 27 (35.5) 26 (34.2) |
Include Exclude Discuss No expertise |
28 (53.8) 14 (26.9) 10 (19.2) 4 |
Item modified for voting (See #12) | |
| 12c | Reporting what proportion of articles are published open access with a breakdown of time delay | Include Exclude Abstain |
20 (100) 0 (0) 1 |
||||
| 13 | Reporting whether reporting guideline checklists were used | 1–3 4–6 7–9 |
5 (6.4) 13 (16.7) 60 (76.9) |
Include Exclude Discuss No expertise |
39 (83.0) 4 (8.5) 4 (8.5) 10 |
||
| 14 | Reporting whether author conflicts of interests were declared | 1–3 4–6 7–9 |
9 (11.5) 4 (5.1) 65 (83.3) |
||||
| 15 | Reporting whether author contributions were described | 1–3 4–6 7–9 |
5 (6.4) 17 (21.8) 56 (71.8) |
Include Exclude Discuss No expertise |
44 (80.0) 6 (10.9) 5 (9.1) 1 |
||
| 16 | Reporting on the use of open lab notebooks | 1–3 4–6 7–9 |
18 (23.1) 32 (41.0) 28 (35.9) |
Include Exclude Discuss No expertise |
13 (28.9) 26 (57.8) 6 (13.3) 12 |
Include Exclude Abstain |
6 (35.3) 11 (64.7) 4 |
| 17 | Reporting whether ORCID identifiers were used | 1–3 4–6 7–9 |
9 (11.5) 11 (14.1) 58 (74.4) |
Include Exclude Discuss No expertise |
48 (87.3) 5 (9.1) 2 (3.6) 2 |
||
| 18 | Reporting that registered clinical trials were reported in the registry within 2 years of study completion | 1–3 4–6 7–9 |
9 (11.5) 11 (14.1) 58 (74.4) |
Include Exclude Discuss No expertise |
45 (93.8) 1 (2.1) 2 (4.2) 8 |
Item revoted on with 1 year timeframe (See #19) | |
| 19c | Reporting that registered clinical trials were reported in the registry within 1 year of study completion | Include Exclude Abstain |
11 (91.7) 1 (8.3) 5 |
||||
| 20 | Reporting the number of replication studies | 1–3 4–6 7–9 |
11 (14.1) 22 (28.2) 45 (57.7) |
Include Exclude Discuss No expertise |
28 (58.3) 14 (29.2) 6 (12.5) 7 |
Item modified for voting (See #21 and #22) | |
| 21c | Reporting citations to data (refers to data cited in papers) | Include Exclude Abstain |
17 (89.5) 2 (10.5) 3 |
||||
| 22c | Reporting citations to code (refers to code cited in papers) | Include Exclude Abstain |
14 (77.8) 4 (22.2) 2 |
||||
| 23b | Reporting on the use of Research Resource Identifiers (RRIDs) (where relevant) | 1–3 4–6 7–9 |
9 (17.3) 25 (48.1) 18 (34.6) |
Include Exclude Abstain |
7 (53.8) 6 (46.2) 4 |
||
| 24b | Reporting whether research articles include funding statements | 1–3 4–6 7–9 |
8 (15.4) 7 (13.5) 37 (71.2) |
Include Exclude Abstain |
16 (94.1) 1 (5.9) 0 |
||
| 25b | Reporting whether a published paper has open peer reviews available | 1–3 4–6 7–9 |
9 (17.6) 19 (37.3) 23 (45.1) |
Include Exclude Abstain |
8 (44.4) 10 (55.6) 2 |
||
| 26b | Reporting whether a data management plan was shared | 1–3 4–6 7–9 |
11 (21.6) 15 (29.4) 25 (49.0) |
Include Exclude Abstain |
4 (21.1) 15 (78.9) 1 |
||
| 27c | Reporting whether data/code/materials are shared with a clear license | Include Exclude Abstain |
14 (87.5) 2 (12.5) 1 |
||||
| 28b | Reporting whether the data/code/materials license is open or not | 1–3 4–6 7–9 |
6 (12.0) 15 (30.0) 29 (58.0) |
Include Exclude Abstain |
13 (81.3) 3 (18.8) 1 |
||
| 29b | Reporting the use of nonproprietary software when sharing data/code/materials | 1–3 4–6 7–9 |
11 (21.6) 19 (37.3) 21 (41.2) |
Include Exclude Abstain |
6 (54.5) 5 (45.5) 6 |
||
| 30b | Reporting the use of persistent identifiers when sharing data/code/materials | 1–3 4–6 7–9 |
5 (9.6) 14 (26.9) 33 (63.5) |
Include Exclude Abstain |
15 (88.2) 2 (11.8) 0 |
||
| 31b | Reporting whether workflows in computational environments were shared | 1–3 4–6 7–9 |
8 (15.4) 25 (48.1) 19 (36.5) |
Include Exclude Abstain |
2 (13.3) 13 (86.7) 5 |
||
| 32b | Reporting the (presumed) gender ratio of the authorship team | 1–3 4–6 7–9 |
23 (44.2) 21 (40.4) 8 (15.4) |
Include Exclude Abstain |
4 (22.2) 14 (77.8) 2 |
||
| 33b | Reporting trial results in a manuscript-style publication (peer reviewed or preprint) | 1–3 4–6 7–9 |
11 (21.2) 19 (36.5) 22 (42.3) |
Include Exclude Abstain |
12 (100) 0 5 |
||
| 34c | Reporting systematic review results in a manuscript-style publication (peer reviewed or preprint) | Include Exclude Abstain |
11 (100) 0 6 |
||||
aBolded numbers indicate consensus.
bItem introduced during round 2.
cItem introduced during round 3.