Table 1.
Short competency name used in manuscript | Master’s programs (N = 23) |
Doctoral programs (N = 13) |
|
---|---|---|---|
Competency 1: Assess sources of bias and variation in published studies and threats to study validity (bias) including problems with sampling, recruitment, randomization, and comparability of study groups | Assessing bias in publications | ||
Extensively covered in required coursework | 18 (78.3%) | 9 (69.2%) | |
Briefly covered in required coursework | 4 (17.4%) | 2 (15.4%) | |
Covered only in elective coursework | 0 (0.0%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 2: Recognize limitation in statistical competency and realize when it would be best to involve a professional statistician | Need for statistical consultation | ||
Extensively covered in required coursework | 12 (52.2%) | 6 (46.2%) | |
Briefly covered in required coursework | 8 (34.8%) | 5 (38.5%) | |
Covered only in elective coursework | 0 (0.0%) | 0 (0.0%) | |
Not covered in any coursework | 2 (8.7%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 3: Identify the strengths and limitations of study designs for addressing a clinical or translational research question | Study design | ||
Extensively covered in required coursework | 17 (73.9%) | 9 (69.2%) | |
Briefly covered in required coursework | 5 (21.7%) | 2 (15.4%) | |
Covered only in elective coursework | 0 (0.0%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 4: Communicate research findings for scientific and lay audiences | Research communication | ||
Extensively covered in required coursework | 18 (78.3%) | 10 (76.9%) | |
Briefly covered in required coursework | 4 (17.4%) | 1 (7.7%) | |
Covered only in elective coursework | 0 (0.0%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 5: Understand the basic principles and practical importance of probability, random variation, commonly used statistical probability distributions, hypothesis testing, type I and type II errors, and confidence limits | Basics of probability | ||
Extensively covered in required coursework | 21 (91.3%) | 11 (84.6%) | |
Briefly covered in required coursework | 1 (4.3%) | 0 (0.0%) | |
Covered only in elective coursework | 0 (0.0%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 6: Understand the value of data quality and data management | Data quality and management | ||
Extensively covered in required coursework | 11 (47.8%) | 5 (38.5%) | |
Briefly covered in required coursework | 10 (43.5%) | 6 (46.2%) | |
Covered only in elective coursework | 1 (4.3%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 7: Understand the reasons for performing research that is reproducible from data collection through publication of results | Reproducible research | ||
Extensively covered in required coursework | 11 (47.8%) | 8 (61.5%) | |
Briefly covered in required coursework | 7 (30.4%) | 1 (7.7%) | |
Covered only in elective coursework | 4 (17.4%) | 2 (15.4%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 8: Understand appropriate methods for data presentation, especially effective statistical graphs and tables | Data visualization | ||
Extensively covered in required coursework | 17 (73.9%) | 9 (69.2%) | |
Briefly covered in required coursework | 4 (17.4%) | 1 (7.7%) | |
Covered only in elective coursework | 1 (4.3%) | 1 (7.7%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 9: Distinguish between variable types (e.g. continuous, binary, categorical) and understand the implications for selection of appropriate statistical methods | Appropriate statistical methods | ||
Extensively covered in required coursework | 22 (95.7%) | 11 (84.6%) | |
Briefly covered in required coursework | 0 (0.0%) | 0 (0.0%) | |
Covered only in elective coursework | 0 (0.0%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 10: Understand the potential misinterpretation of results in the presence of multiple comparisons | Multiple comparisons | ||
Extensively covered in required coursework | 12 (52.2%) | 6 (46.2%) | |
Briefly covered in required coursework | 10 (43.5%) | 5 (38.5%) | |
Covered only in elective coursework | 0 (0.0%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 11: Evaluate size of the effect with a measure of precision | Effect size | ||
Extensively covered in required coursework | 16 (69.6%) | 7 (53.8%) | |
Briefly covered in required coursework | 5 (21.7%) | 4 (30.8%) | |
Covered only in elective coursework | 0 (0.0%) | 0 (0.0%) | |
Not covered in any coursework | 1 (4.3%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 12: Understand issues relating to generalizability of a study, including sampling methods and the amount and type of missing data | Generalizability | ||
Extensively covered in required coursework | 12 (52.2%) | 6 (46.2%) | |
Briefly covered in required coursework | 9 (39.1%) | 5 (38.5%) | |
Covered only in elective coursework | 1 (4.3%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 13: Evaluate the impact of statistics on ethical research (e.g. an inadequate power calculation may mean it is unethical to ask subjects to consent to a study) and of ethics on statistical practice | Statistical ethics | ||
Extensively covered in required coursework | 9 (39.1%) | 4 (30.8%) | |
Briefly covered in required coursework | 9 (39.1%) | 7 (53.8%) | |
Covered only in elective coursework | 2 (8.7%) | 0 (0.0%) | |
Not covered in any coursework | 2 (8.7%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 14: Compute descriptive and simple inferential statistics appropriate for the data and research question | Descriptive statistics | ||
Extensively covered in required coursework | 21 (91.3%) | 11 (84.6%) | |
Briefly covered in required coursework | 0 (0.0%) | 0 (0.0%) | |
Covered only in elective coursework | 1 (4.3%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 15: Understand the components of sample size, power, and precision | Power and sample size | ||
Extensively covered in required coursework | 14 (60.9%) | 9 (69.2%) | |
Briefly covered in required coursework | 6 (26.1%) | 1 (7.7%) | |
Covered only in elective coursework | 1 (4.3%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 2 (8.7%) | 3 (23.1%) | |
Competency 16: Understand the need to address loss to follow-up | Loss to follow-up | ||
Extensively covered in required coursework | 9 (39.1%) | 7 (53.8%) | |
Briefly covered in required coursework | 9 (39.1%) | 3 (23.1%) | |
Covered only in elective coursework | 3 (13.0%) | 1 (7.7%) | |
Not covered in any coursework | 1 (4.3%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 17: Understand the concepts and bias implications of reliability and validity of study measurements and evaluate the reliability and validity of measures | Reliability and validity | ||
Extensively covered in required coursework | 8 (34.8%) | 4 (30.8%) | |
Briefly covered in required coursework | 8 (34.8%) | 5 (38.5%) | |
Covered only in elective coursework | 4 (17.4%) | 2 (15.4%) | |
Not covered in any coursework | 2 (8.7%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 18: Evaluate potential violations of the assumptions behind common statistical methods | Violation of assumptions | ||
Extensively covered in required coursework | 16 (69.6%) | 9 (69.2%) | |
Briefly covered in required coursework | 5 (21.7%) | 2 (15.4%) | |
Covered only in elective coursework | 1 (4.3%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 19: Identify when clustered, matched, paired, or longitudinal statistical methods must be used | Correlated data | ||
Extensively covered in required coursework | 14 (60.9%) | 7 (53.8%) | |
Briefly covered in required coursework | 7 (30.4%) | 3 (23.1%) | |
Covered only in elective coursework | 1 (4.3%) | 1 (7.7%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 20: Understand the concepts of sensitivity, specificity, positive and negative predictive value, and receiver operating characteristic curves | Diagnostic accuracy | ||
Extensively covered in required coursework | 14 (60.9%) | 7 (53.8%) | |
Briefly covered in required coursework | 6 (26.1%) | 4 (30.8%) | |
Covered only in elective coursework | 2 (8.7%) | 0 (0.0%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 21: Understand the purpose of data and safety monitoring plans | Data safety and monitoring | ||
Extensively covered in required coursework | 8 (34.8%) | 5 (38.5%) | |
Briefly covered in required coursework | 6 (26.1%) | 2 (15.4%) | |
Covered only in elective coursework | 3 (13.0%) | 3 (23.1%) | |
Not covered in any coursework | 4 (17.4%) | 1 (7.7%) | |
Missing | 2 (8.7%) | 2 (15.4%) | |
Competency 22: Identify appropriate methods to address potential confounding and effect modification | Confounding and effect modification | ||
Extensively covered in required coursework | 15 (65.2%) | 7 (53.8%) | |
Briefly covered in required coursework | 6 (26.1%) | 3 (23.1%) | |
Covered only in elective coursework | 1 (4.3%) | 1 (7.7%) | |
Not covered in any coursework | 0 (0.0%) | 0 (0.0%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 23: Understand the purpose of meta-analysis and its place in the hierarchy of evidence | Meta-analysis | ||
Extensively covered in required coursework | 2 (8.7%) | 1 (7.7%) | |
Briefly covered in required coursework | 8 (34.8%) | 2 (15.4%) | |
Covered only in elective coursework | 7 (30.4%) | 7 (53.8%) | |
Not covered in any coursework | 5 (21.7%) | 1 (7.7%) | |
Missing | 1 (4.3%) | 2 (15.4%) | |
Competency 24: Understand the uses, importance, and limitations of early stopping rules in clinical trials | Early stopping rules | ||
Extensively covered in required coursework | 6 (26.1%) | 2 (15.4%) | |
Briefly covered in required coursework | 5 (21.7%) | 3 (23.1%) | |
Covered only in elective coursework | 10 (43.5%) | 5 (38.5%) | |
Not covered in any coursework | 1 (4.3%) | 1 (7.7%) | |
Missing | 1 (4.3%) | 2 (15.4%) |