Table 3.
EPHPP Quality Assessments for Quantitative Studies
Study |
Aggarwal et al. (2019)
|
Bachhuber et al. (2018)
|
Barocas et al. (2019)
|
Chavis et al. (2020)
|
|||||
---|---|---|---|---|---|---|---|---|---|
Domain | Study team member | M.D. | A.G. | M.D. | A.G. | M.D. | A.G. | M.D. | A.G. |
Selection bias | Participants representative of target population | Somewhat likely | Somewhat likely | Somewhat likely | Somewhat likely | Very likely | Very likely | Very likely | Very likely |
Percent of selected individuals who agreed to participate | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |
Section rating | Moderate | Moderate | Moderate | Moderate | Moderate | Moderate | Strong | Strong | |
Study design | Indicate the study design | Cohort analytic | Cohort analytic | Retrospective chart review | Retrospective chart review | Cohort analytic | Cohort analytic | Retrospective RSR data review | Retrospective RSR data review |
Study described as randomized | No | No | No | No | No | No | No | No | |
Was randomized method described | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |
Was randomized method appropriate | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |
Section rating | Moderate | Moderate | Weak | Weak | Moderate | Moderate | Weak | Weak | |
Confounders | Important differences between groups pre-intervention | Yes | Yes | Can’t tell | Can’t tell | Yes | Yes | Yes | Yes |
Indicate % of confounders controlled | Most | Most | Can’t tell | Can’t tell | <60% | <60% | Most | Most | |
Section rating | Strong | Strong | Weak | Weak | Weak | Weak | Strong | Strong | |
Blinding | Outcome assessors aware of intervention or exposure status of participants | Yes | Yes | Can’t tell | Can’t tell | Yes | Yes | Yes | Yes |
Participants aware of research question | Can’t tell | Can’t tell | Can’t tell | Can’t tell | Can’t tell | Can’t tell | Can’t tell | Can’t tell | |
Section rating | Weak | Weak | Moderate | Moderate | Weak | Weak | Weak | Weak | |
Data collection | Data collection methods valid | Yes | Yes | Yes | Yes | Yes | Yes | Can’t tell | Can’t tell |
Data collection tools reliable | Yes | Yes | Can’t tell | Can’t tell | Yes | Yes | Can’t tell | Can’t tell | |
Section rating | Strong | Strong | Moderate | Moderate | Strong | Strong | Weak | Weak | |
Withdrawals and dropouts | Withdrawals and dropouts reported in #s/reasons per groups | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
% of participants completing the study | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |
Section rating | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |
Final score | Discrepancy between reviewers (Y/N) | N | N | N | N | N | N | N | N |
Reason for discrepancy | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |
Final global rating | Moderate | Moderate | Weak | Weak | Weak | Weak | Weak | Weak |