Skip to main content
. 2021 Oct 11;79(5):618–639. doi: 10.1177/10775587211051182
Study Simeone et al. (2017) Tofighi et al. (2019)
Study team member M.D. A.G. M.D. A.G.
Selection bias Participants representative of target population Somewhat likely Somewhat likely Very likely Very likely
Percent of selected individuals who agreed to participate N/A N/A N/A N/A
Section rating Moderate Moderate Strong Strong
Study design Indicate the study design Retrospective electronic medical record review Retrospective electronic medical record review Survey Survey
Study described as randomized No No No No
Was randomized method described N/A N/A N/A N/A
Was randomized method appropriate N/A N/A N/A N/A
Section rating Weak Weak Weak Weak
Confounders Important differences between groups pre-intervention Yes Yes No No
Indicate % of confounders controlled Yes Yes Can’t tell Can’t tell
Section rating Strong Strong Weak Weak
Blinding Outcome assessors aware of intervention or exposure status of participants N/A N/A Can’t tell Can’t tell
Participants aware of research question N/A N/A Can’t tell Can’t tell
Section rating N/A N/A Moderate Moderate
Data collection Data collection methods valid Yes Yes Can’t tell Can’t tell
Data collection tools reliable Yes Yes Can’t tell Can’t tell
Section rating Strong Strong Weak Weak
Withdrawals and dropouts Withdrawals and dropouts reported in #s/reasons per groups N/A N/A N/A N/A
% of participants completing the study N/A N/A N/A N/A
Section rating N/A N/A N/A N/A
Final score Discrepancy between reviewers (Y/N) N N N N
Reason for discrepancy N/A N/A N/A N/A
Final global rating Moderate Moderate Weak Weak

Note. EPHPP = Effective Public Health Practice Project; SU = substance use.