Table 2.
Risk of bias assessment for included before-after studies
YingWu et al | Dong et al | Shaw et al | ||
---|---|---|---|---|
Questions | 1. Was the study question or objective clearly stated? | Yes | Yes | Yes |
2. Were eligibility/selection criteria for the study population prespecified and clearly described? | Yes | Yes | Yes | |
3. Were the participants in the study representative of those who would be eligible for the test/service/intervention in the general or clinical population of interest? | No | Yes | No | |
4. Were all eligible participants that met the prespecified entry criteria enrolled? | Cannot determine | Cannot determine | Cannot determine | |
5. Was the sample size sufficiently large to provide confidence in the findings? | No | Yes | No | |
6. Was the test/service/intervention clearly described and delivered consistently across the study population? | Yes | Yes | Yes | |
7. Were the outcome measures prespecified, clearly defined, valid, reliable, and assessed consistently across all study participants? | Yes | Yes | Yes | |
8. Were the people assessing the outcomes blinded to the participants’ exposures/interventions? | Not applicable | Not applicable | Not applicable | |
9. Was the loss to follow-up after baseline 20% or less? Were those lost to follow-up accounted for in the analysis? | Yes | Yes | No | |
10. Did the statistical methods examine changes in outcome measures from before to after the intervention? Were statistical tests done that provided p values for the pre-to-post changes? | Yes | Yes | Yes | |
11. Were outcome measures of interest taken multiple times before the intervention and multiple times after the intervention (i.e., did they use an interrupted time-series design?) | No | No | No | |
12. If the intervention was conducted at a group level (e.g., a whole hospital, a community, etc.) did the statistical analysis take into account the use of individual-level data to determine effects at the group level? | Not applicable | Not applicable | Not applicable | |
Quality rating | Poor | Poor | Poor |