TABLE 1.

Extant and/or Post-intervention Knowledge and Critical Appraisal Skills among Physicians^a

Author (Year) Study Design	Sample Description	Intervention/Exposure	Results
Akl et al. (2004)17 Non-randomized trial	49 internal medicine residents	Intervention: 2-week rotation in EBM integrated into daily teaching rounds Comparison: no intervention	Berlin EBM Assessmentb max score = 15 Intervention: Mean pre-intervention score (SD): 5.2 (2.9) Mean post-intervention score (SD): 6.4 (2.4) Comparison: Mean baseline score (SD): 8.3 (2.2) Mean follow-up score (SD): 6.8 (2.4) Adjusted mean difference in change between intervention and comparison group: 2.52 (95% CI 0.84 to 4.18, p = .006)
Anderson et al. (2013)24 Cross-sectional	4,713 U.S. obstetrics and gynecology residents	Two-item knowledge assessment assessing statistical literacy	26% correctly answered the positive predictive value item 42% correctly answered the p-value item 12% correctly answered both questions
Beasley & Woolley (2002)25 Cross-sectional	177 volunteer community-based statewide medical school faculty	EBM knowledge assessment	Mean % correct: 34 Self-reported understanding (“1” = not well” to “5” = extremely well) of various statistical and epidemiologic concepts ranged from 2.8 to 4.0
Cheatham (2000)19 Repeated measures	12 surgical residents	Twelve-month curriculum in biostatistics and study design as part of monthly journal club	Mean % correct pre-curriculum: 59 Mean % correct post-curriculum: 79 p < .004
Dinkevich et al. (2006)20 Repeated measures	69 pediatric residents	EBM training module for 2 hours a week for 4 weeks	Fresno EBM Testc Mean % correct pre-training: 17 Mean % correct post-training: 63 p = .0001
Lao et al. (2014)23 Repeated measures	5 pediatric surgery fellows, residents, or attending physicians	Two-year long training curriculum in EBM, delivered over a six-session journal club format	EBM knowledge assessment, max score = 20 Mean score (SD) pre-training: 11.1 (5.7) Mean score (SD) early post-training: 16.2 (4.9) Mean score (SD) late post-training: 16.8 (3.6) p = .05 (comparison for pre vs. early post-session) p = .03 (comparison for pre vs. late post-session)
MacRae et al. (2004a)15 RCT	81 general surgeons in academic and community-based practice settings	Intervention: virtual journal club (monthly mailed package of guided instruction for critical appraisal of two clinical articles) Comparison: clinical articles only	No baseline measures reported Intervention: mean % correct 58 Comparison: mean % correct 50 p < .0001
MacRae et al. (2004b)30 Psychometric validation study	44 general surgery resident	Intervention: residents who were exposed to an epidemiologist led critical appraisal journal club Comparison: residents who were not exposed to the journal club	EBM assessment max score = 121 No baseline measures reported Intervention: mean score 56.6 Comparison: mean score 49.3 p = .02
Mimiaga et al. (2014)26 Cross-sectional	115 HIV specialists and general physicians	Interpretation of data from two clinical trials of pre-exposure prophylaxis	72% correctly interpreted results of both trials 60% were able to specify the correct dosing of drug based on information presented in trials
Shaughnessy et al. (2012)21 Repeated measures	22 family medicine residents	30 hours of face-to-face education in EBM concepts provided during residency orientation	Modified Fresno EBM testc max score = 160, passing score = 113 Mean score (range) pre-intervention: 104.0 (49–134) Mean score (range) post-intervention: 121.5 (65–154) p = .001 % with passing score pre-intervention: 40.1 % with passing score post-intervention: 73.4 p = .025
Sprague et al. (2012)22 Repeated measures	62 surgeons, surgical residents, and medical students	A 2.5-day course for evidence-based surgery, study design, aspects of RCTs and statistics	Modified Fresno EBM Testc, questions from CAMS testd and other assessment items. Mean % correct pre-course: 38.2 Mean % correct post-course: 51.7 p < .001
Susarla & Redett (2014)27 Cross-sectional	22 interns, junior-and senior-level plastic surgery residents	Biostatistical knowledge assessment	Mean % correct (range): 53.0 (0 to 83.3)
Taylor et al. (2004)16 RCT	145 health care practitioners	Intervention: single 3-hour EBM workshop Control: wait list	Knowledge assessment score range: −18 to +18; critical appraisal rated using 5 point Likert scale (1 = no ability, 5 = superior ability) No baseline measures reported Intervention: mean (SD) knowledge score 9.7 (5.3) Mean(SD) critical appraisal scores: methodology 2.4 (2.5), results 2.6 (28), generalizability 2.7 (2.2) Control: mean (SD) knowledge score 8.0 (5.1) Mean (SD) critical appraisal scores: methodology 2.0 (2.1), results 1.7 (1.8), generalizability 2.4 (1.7)
Thomas et al. (2005)18 Non-randomized trial	46 internal medicine residents	Interventions: EBM conference group EBM small discussion group Comparison: no EBM exposure	EBM assessment, max score = 25 No baseline measures reported Mean score (SD) EBM small group discussion: 17.8 (4.5) Mean score (SD) EBM conference group: 12.2 (4.6) Mean score (SD) comparison group: 12.0 (4.5) p = .014 for small group v. conference group p = .002 small group v. comparison group
Weiss & Samet (1980)29 Cross-sectional	141 internal medicine physicians	Epidemiology and biostatistics knowledge assessment	Max score = 10 Mean score (SD): 7.4 (1.6) Item-level mean % correct ranged from 40 to 97
Windish et al. (2007)28 Cross-sectional	309 residents from 11 internal medicine residency programs	Knowledge assessment reflecting commonly used statistical methods and results in research literature	Mean % correct: 41.1 Item-level mean % correct ranged from 10.5 to 87.4 75% report not understanding all of the statistics encountered in the literature

^aStudy description and results excerpted from evidence tables provided in Appendix B of the Digital Supplement.

^bBerlin Questionnaire: a 15-item test assessing EBM knowledge and skills in the five domains of assess, ask, acquire, appraise, and apply.

^cFresno Test: a 12 short-answer item test assessing ability to form an answerable question, list evidence-based resources, and interpret research results.

^dCenter for Applied Medical Statistics (CAMS) test: a test of statistical knowledge and application of statistics to real-world scenarios.

Notes: CI = confidence interval; EBM = evidence-based medicine; HIV = human immunodeficiency virus; PGY = post-graduate year; RCT = randomized clinical trial; SD = standard deviation