Table 1.
Item Number | Delphi Round 1 | Delphi Round 2 | Final Version of Item | ||
---|---|---|---|---|---|
Mean ± SD | Modification | Mean ± SD | Modification | ||
1 | 8.375 ± 1.41 | None | 8.25 ± 1.39 | None | I. Introduction to Research |
2 | 8 ± 1.69 | Wording change | 6.75 ± 2.12 | None | a. Importance of research to practice and implementation of professional best practice |
3 | 8.25 ± 1.39 | None | 8.875 ± 0.35 | None | b. Posing a research question |
4 | 8 ± 1.31 | None | 8.38 ± 0.74 | None | c. Introduction to study design |
5 | 7.25 ± 2.05 | Wording change | 8 ± 1.31 | None | II. Appraisal of the Literature |
6 | 7.88 ± 0.99 | None | 8.38 ± 0.5 | None | a. Searching the literature to answer a question |
7 | 7 ± 1.60 | None | 7.13 ± 1.25 | None | b. Types of studies |
8 | 5.88 ± 1.46 | None | 6.88 ± 0.99 | None | i. Classification by time: retrospective, prospective |
9 | 6.13 ± 1.13 | None | 6.88 ± 0.99 | None | ii. Classification by control: case control, cohort, randomized controlled trial |
10 | 6 ± 0.93 | None | 6.75 ± 1.04 | None | c. Criterion standard comparisons |
11 | 7.13 ± 1.55 | None | 7.63 ± 0.92 | None | d. Internal and external validity |
12 | 6.38 ± 1.30 | Wording change | 7.63 ± 0.74 | None | e. Determining significance |
5.38 ± 2.07 | Removed | f. Understanding the literature in the era of social media* | |||
3.63 ± 2.72 | Removed | i. Deciphering blog posts* | |||
4.88 ± 2.90 | Removed | ii. Appraising the quality of various electronic resources* | |||
13 | Added | 7.88 ± 0.99 | None | g. Matching measurements with objectives and conclusions | |
14 | 7.5 ± 1.41 | None | 7.63 ± 1.41 | None | III. Basic Statistical Concepts |
15 | 7.13 ± 1.25 | None | 7.13 ± 1.25 | None | a. Samples and populations |
16 | 7.75 ± 1.16 | None | 7.25 ± 1.04 | None | b. Hypothesis testing |
17 | 7.13 ± 1.31 | None | 7.25 ± 1.04 | None | c. p‐values |
18 | 7.5 ± 1.31 | None | 7.38 ± 0.92 | None | d. 95% CIs |
19 | 6.88 ± 1.46 | None | 6.75 ± 1.28 | None | e. Alpha (type I) errors |
20 | 6.88 ± 1.46 | None | 6.75 ± 1.28 | None | f. Beta (type 2) errors: power analysis, sample size |
21 | 6.63 ± 1.41 | None | 7 ± 1.41 | None | g. Specific statistical procedures (intro) |
6.38 ± 1.60 | None | 6.88 | Removed | i. Student's t‐test* | |
6.63 ± 1.60 | None | 6.5 ± 1.07 | Removed | ii. Linear regression* | |
6.5 ± 1.51 | None | 5.88 ± 1.25 | Removed | iii. Logistic regression* | |
22 | 7.13 ± 1.36 | None | 6.88 ± 0.99 | None | h. Measurement error and types of biases |
23 | 7.5 ± 1.07 | None | 7.63 ± 0.92 | None | i. Outcomes |
24 | 7.13 ± 1.46 | None | 7.38 ± 1.41 | None | ii. Sensitivity and specificity |
25 | 6.5 ± 1.31 | None | 6.75 ± 1.49 | None | iii. ORs |
26 | 6.25 ± 1.28 | None | 6.63 ± 1.51 | None | iv. Relative risk |
27 | Added | 6.88 ± 1.25 | None | v. Reliability/inter‐rater agreement | |
28 | Added | 6.38 ± 1.51 | None | vi. Domains of validity for assessment instruments | |
29 | 7.38 ± 1.06 | None | 7.25 ± 1.98 | None | IV. Specific types of research |
30 | 6.88 ± 1.36 | None | 7.63 ± 1.77 | None | a. Quantitative research |
31 | 6.88 ± 1.55 | None | 7.25 ± 1.91 | None | b. Qualitative research |
32 | 6.88 ± 1.55 | None | 7.63 ± 1.51 | None | c. Survey research |
33 | 6.25 ± 0.89 | None | 6.75 ± 1.91 | None | d. Meta‐analysis and systematic reviews |
5.5 ± 1.69 | None | 5.38 ± 1.77 | Moved to special interest | e. Research on particular topics* | |
6.88 ± 1.36 | None | 6.25 ± 1.75 | Moved to special interest | i. Clinical research* | |
5.25 ± 1.83 | None | 4.13 ± 2.2 | Moved to special interest | ii. Basic science research* | |
5.75 ± 1.49 | None | 5.5 ± 1.77 | Moved to special interest | iii. Translational research* | |
6.13 ± 1.89 | None | 6 ± 1.07 | Moved to special interest | iv. Education research* | |
Added | 6.13 ± 1.73 | Moved to special interest | 1. Conceptual frameworks* | ||
Added | 6 ± 1.41 | Moved to special interest | 2. Assessment methods* | ||
5.75 ± 1.49 | None | 5.25 ± 1.58 | Moved to special interest | v. Population research* | |
34 | 7.63 ± 1.69 | None | 7.88 ± 1.81 | None | V. Research ethics and the IRB |
35 | 8 ± 0.93 | None | 7.63 ± 1.92 | None | a. Informed consent |
36 | 6.25 ± 1.28 | None | 6.13 ± 1.73 | None | b. Equipoise and randomized trials |
37 | 7.125 ± 1.64 | Wording change | 7.63 ± 1.69 | None | c. Conflicts of interest |
3.13 ± 1.55 | Removed | d. Animal research* | |||
38 | 6.63 ± 1.51 | None | 7.25 ± 1.67 | None | VI. Conducting research |
8.25 ± 1.39 | Removed (redundancy) | a. Formulating an answerable question* | |||
8.125 ± 0.83 | Removed (redundancy) | b. Searching the literature* | |||
39 | 8.125 ± 0.99 | None | 7.5 ± 1.41 | None | c. Selecting appropriate study design |
40 | 7 ± 1.51 | None | 6.75 ± 1.49 | None | d. Data management |
41 | 8.13 ± 1.46 | None | 8.25 ± 1.16 | None | e. Writing an abstract and a manuscript |
42 | 8 ± 1.4 | Wording change | 8.13 ± 1.13 | None | f. Publishing and presenting your work ‐ dissemination avenues |
5.75 ± 2.66 | Removed | g. Securing funding* | |||
43 | 6.63 ± 1.69 | Wording change | 7.25 ± 1.28 | None | h. Peer review for acceptance to journals and meetings |
44 | Added | 6.88 ± 1.64 | None | i. Collaboration in research endeavors, including mentor/mentee relationships |
Items eliminated or moved.