Skip to main content
. 2020 Jun 19;5(1):e12. doi: 10.1017/cts.2020.498

Table 1.

Competency frequencies and relative frequencies by degree program type for CTSA institutions, including full definitions and short competency names used in our manuscript

Short competency name used in manuscript Master’s programs
(N = 23)
Doctoral programs
(N = 13)
Competency 1: Assess sources of bias and variation in published studies and threats to study validity (bias) including problems with sampling, recruitment, randomization, and comparability of study groups Assessing bias in publications
 Extensively covered in required coursework 18 (78.3%) 9 (69.2%)
 Briefly covered in required coursework 4 (17.4%) 2 (15.4%)
 Covered only in elective coursework 0 (0.0%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 2: Recognize limitation in statistical competency and realize when it would be best to involve a professional statistician Need for statistical consultation
 Extensively covered in required coursework 12 (52.2%) 6 (46.2%)
 Briefly covered in required coursework 8 (34.8%) 5 (38.5%)
 Covered only in elective coursework 0 (0.0%) 0 (0.0%)
 Not covered in any coursework 2 (8.7%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 3: Identify the strengths and limitations of study designs for addressing a clinical or translational research question Study design
 Extensively covered in required coursework 17 (73.9%) 9 (69.2%)
 Briefly covered in required coursework 5 (21.7%) 2 (15.4%)
 Covered only in elective coursework 0 (0.0%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 4: Communicate research findings for scientific and lay audiences Research communication
 Extensively covered in required coursework 18 (78.3%) 10 (76.9%)
 Briefly covered in required coursework 4 (17.4%) 1 (7.7%)
 Covered only in elective coursework 0 (0.0%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 5: Understand the basic principles and practical importance of probability, random variation, commonly used statistical probability distributions, hypothesis testing, type I and type II errors, and confidence limits Basics of probability
 Extensively covered in required coursework 21 (91.3%) 11 (84.6%)
 Briefly covered in required coursework 1 (4.3%) 0 (0.0%)
 Covered only in elective coursework 0 (0.0%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 6: Understand the value of data quality and data management Data quality and management
 Extensively covered in required coursework 11 (47.8%) 5 (38.5%)
 Briefly covered in required coursework 10 (43.5%) 6 (46.2%)
 Covered only in elective coursework 1 (4.3%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 7: Understand the reasons for performing research that is reproducible from data collection through publication of results Reproducible research
 Extensively covered in required coursework 11 (47.8%) 8 (61.5%)
 Briefly covered in required coursework 7 (30.4%) 1 (7.7%)
 Covered only in elective coursework 4 (17.4%) 2 (15.4%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 8: Understand appropriate methods for data presentation, especially effective statistical graphs and tables Data visualization
 Extensively covered in required coursework 17 (73.9%) 9 (69.2%)
 Briefly covered in required coursework 4 (17.4%) 1 (7.7%)
 Covered only in elective coursework 1 (4.3%) 1 (7.7%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 9: Distinguish between variable types (e.g. continuous, binary, categorical) and understand the implications for selection of appropriate statistical methods Appropriate statistical methods
 Extensively covered in required coursework 22 (95.7%) 11 (84.6%)
 Briefly covered in required coursework 0 (0.0%) 0 (0.0%)
 Covered only in elective coursework 0 (0.0%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 10: Understand the potential misinterpretation of results in the presence of multiple comparisons Multiple comparisons
 Extensively covered in required coursework 12 (52.2%) 6 (46.2%)
 Briefly covered in required coursework 10 (43.5%) 5 (38.5%)
 Covered only in elective coursework 0 (0.0%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 11: Evaluate size of the effect with a measure of precision Effect size
 Extensively covered in required coursework 16 (69.6%) 7 (53.8%)
 Briefly covered in required coursework 5 (21.7%) 4 (30.8%)
 Covered only in elective coursework 0 (0.0%) 0 (0.0%)
 Not covered in any coursework 1 (4.3%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 12: Understand issues relating to generalizability of a study, including sampling methods and the amount and type of missing data Generalizability
 Extensively covered in required coursework 12 (52.2%) 6 (46.2%)
 Briefly covered in required coursework 9 (39.1%) 5 (38.5%)
 Covered only in elective coursework 1 (4.3%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 13: Evaluate the impact of statistics on ethical research (e.g. an inadequate power calculation may mean it is unethical to ask subjects to consent to a study) and of ethics on statistical practice Statistical ethics
 Extensively covered in required coursework 9 (39.1%) 4 (30.8%)
 Briefly covered in required coursework 9 (39.1%) 7 (53.8%)
 Covered only in elective coursework 2 (8.7%) 0 (0.0%)
 Not covered in any coursework 2 (8.7%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 14: Compute descriptive and simple inferential statistics appropriate for the data and research question Descriptive statistics
 Extensively covered in required coursework 21 (91.3%) 11 (84.6%)
 Briefly covered in required coursework 0 (0.0%) 0 (0.0%)
 Covered only in elective coursework 1 (4.3%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 15: Understand the components of sample size, power, and precision Power and sample size
 Extensively covered in required coursework 14 (60.9%) 9 (69.2%)
 Briefly covered in required coursework 6 (26.1%) 1 (7.7%)
 Covered only in elective coursework 1 (4.3%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 2 (8.7%) 3 (23.1%)
Competency 16: Understand the need to address loss to follow-up Loss to follow-up
 Extensively covered in required coursework 9 (39.1%) 7 (53.8%)
 Briefly covered in required coursework 9 (39.1%) 3 (23.1%)
 Covered only in elective coursework 3 (13.0%) 1 (7.7%)
 Not covered in any coursework 1 (4.3%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 17: Understand the concepts and bias implications of reliability and validity of study measurements and evaluate the reliability and validity of measures Reliability and validity
 Extensively covered in required coursework 8 (34.8%) 4 (30.8%)
 Briefly covered in required coursework 8 (34.8%) 5 (38.5%)
 Covered only in elective coursework 4 (17.4%) 2 (15.4%)
 Not covered in any coursework 2 (8.7%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 18: Evaluate potential violations of the assumptions behind common statistical methods Violation of assumptions
 Extensively covered in required coursework 16 (69.6%) 9 (69.2%)
 Briefly covered in required coursework 5 (21.7%) 2 (15.4%)
 Covered only in elective coursework 1 (4.3%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 19: Identify when clustered, matched, paired, or longitudinal statistical methods must be used Correlated data
 Extensively covered in required coursework 14 (60.9%) 7 (53.8%)
 Briefly covered in required coursework 7 (30.4%) 3 (23.1%)
 Covered only in elective coursework 1 (4.3%) 1 (7.7%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 20: Understand the concepts of sensitivity, specificity, positive and negative predictive value, and receiver operating characteristic curves Diagnostic accuracy
 Extensively covered in required coursework 14 (60.9%) 7 (53.8%)
 Briefly covered in required coursework 6 (26.1%) 4 (30.8%)
 Covered only in elective coursework 2 (8.7%) 0 (0.0%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 21: Understand the purpose of data and safety monitoring plans Data safety and monitoring
 Extensively covered in required coursework 8 (34.8%) 5 (38.5%)
 Briefly covered in required coursework 6 (26.1%) 2 (15.4%)
 Covered only in elective coursework 3 (13.0%) 3 (23.1%)
 Not covered in any coursework 4 (17.4%) 1 (7.7%)
 Missing 2 (8.7%) 2 (15.4%)
Competency 22: Identify appropriate methods to address potential confounding and effect modification Confounding and effect modification
 Extensively covered in required coursework 15 (65.2%) 7 (53.8%)
 Briefly covered in required coursework 6 (26.1%) 3 (23.1%)
 Covered only in elective coursework 1 (4.3%) 1 (7.7%)
 Not covered in any coursework 0 (0.0%) 0 (0.0%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 23: Understand the purpose of meta-analysis and its place in the hierarchy of evidence Meta-analysis
 Extensively covered in required coursework 2 (8.7%) 1 (7.7%)
 Briefly covered in required coursework 8 (34.8%) 2 (15.4%)
 Covered only in elective coursework 7 (30.4%) 7 (53.8%)
 Not covered in any coursework 5 (21.7%) 1 (7.7%)
 Missing 1 (4.3%) 2 (15.4%)
Competency 24: Understand the uses, importance, and limitations of early stopping rules in clinical trials Early stopping rules
 Extensively covered in required coursework 6 (26.1%) 2 (15.4%)
 Briefly covered in required coursework 5 (21.7%) 3 (23.1%)
 Covered only in elective coursework 10 (43.5%) 5 (38.5%)
 Not covered in any coursework 1 (4.3%) 1 (7.7%)
 Missing 1 (4.3%) 2 (15.4%)