Supplementary Table 2.
Detailed assessment of included non-randomized studies with the ROBINS-I tool.
| Domain | Reference | Azaripour et al. 2015 | Buschang et al. 2018 | Dallel et al. 2020 | Gujar et al. 2020 | Han et al. 2015 | Karhanetci et al. 2013 | Madariaga et al. 2020 | Miethke et al. 2005 | Miethke et al. 2007 | Mulla Issa et al. 2020 | Mummolo et al. 2020a | Mummolo et al. 2020b | Sifakakis et al. 2018 | Srinath et al. 2016 | Wang et al. 2019 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1. Confounding | 1.1 | Y | Y | Y | Y | Y | PY | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 1.2 | N | N | N | N | N | N | N | N | N | N | N | N | N | PN | N | |
| 1.3 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| 1.4 | PN | PN | Y | Y | PN | Y | PY | PN | PN | PN | PN | PN | Y | NI | Y | |
| 1.5 | NA | NA | Y | Y | NA | Y | PY | NA | NA | NA | NA | NA | Y | NA | Y | |
| 1.6 | N | NA | N | N | NA | N | N | NA | NA | NA | NA | NA | N | NI | N | |
| 1.7 | PN | PN | NA | Y | PN | Y | NI | PN | PN | PN | PN | PN | Y | NI | Y | |
| 1.8 | NA | NA | NA | Y | NA | Y | NA | NA | NA | NA | NA | NA | Y | NA | Y | |
| Judgement | Serious | Serious | Moderate | Low | Serious | Moderate | NI | Serious | Serious | Serious | Serious | Serious | Moderate | NI | Low | |
| 2. Selection of participants into the study | 2.1 | PY | PY | N | N | PY | N | N | NI | NI | PY | N | N | N | NI | N |
| 2.2 | PY | PY | NA | NA | PY | NA | NA | NA | NA | PY | NA | NA | NA | NI | NA | |
| 2.3 | PY | PY | NA | NA | PY | NA | NA | NA | NA | PY | NA | NA | NA | NI | NA | |
| 2.4 | Y | Y | Y | Y | Y | Y | PN | NI | NI | Y | Y | Y | Y | PY | Y | |
| 2.5 | PN | PN | NA | NA | PN | NA | NI | NA | NA | PN | NA | NA | NA | NI | NA | |
| Judgement | Serious | Serious | Low | Low | Serious | Low | NI | NI | NI | Serious | Low | Low | Low | NI | Low | |
| 3. Classification of interventions | 3.1 | Y | Y | Y | Y | Y | Y | Y | NI | NI | Y | Y | Y | Y | Y | Y |
| 3.2 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | |
| 3.3 | N | PN | N | N | N | N | N | Y | Y | NI | N | N | N | PN | N | |
| Judgement | Low | Low | Low | Low | Low | Low | Low | PN | PN | Low | Low | Low | Low | Low | Low | |
| 4. Deviations from intended interventions | 4.1 | N | N | N | N | N | N | PN | PN | PN | N | N | N | N | PN | N |
| 4.2 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| 4.3 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| 4.4 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| 4.5 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| 4.6 | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| Judgement | Low | Low | Low | Low | Low | Low | Low | Low | Low | Low | Low | Low | Low | Low | Low | |
| 5. Missing data | 5.1 | PY | Y | Y | Y | Y | N | PY | NI | NI | Y | Y | Y | Y | NI | N |
| 5.2 | NP | N | N | N | N | Y | PN | NI | NI | N | N | N | N | NI | N | |
| 5.3 | PN | N | N | N | N | N | PN | NI | NI | N | N | N | N | NI | N | |
| 5.4 | NA | NA | NA | NA | NA | PY | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| 5.5 | NA | NA | NA | NA | NA | N | NA | NA | NA | NA | NA | NA | NA | NA | NA | |
| Judgement | Low | Low | Low | Low | Low | Moderate | Low | NI | NI | Low | Low | Low | Low | NI | Low | |
| 6. Measurement of outcomes | 6.1 | PN | N | PN | N | PN | PN | PN | N | N | PY | PN | PN | N | N | N |
| 6.2 | PY | NI | Y | N | Y | PY | NI | NI | NI | Y | N | N | PN | Y | NI | |
| 6.3 | Y | Y | Y | Y | Y | Y | Y | PY | PY | Y | Y | Y | Y | Y | Y | |
| 6.4 | N | N | N | N | N | N | PN | PN | PN | PN | N | N | N | PN | N | |
| Judgement | Moderate | Low | Moderate | Low | Moderate | Moderate | NI | NI | NI | Moderate | Low | Low | Low | Moderate | Low | |
| 7. Selection of the reported result | 7.1 | N | N | N | N | PN | N | PN | N | N | N | PN | PN | N | NI | N |
| 7.2 | N | N | N | N | PN | N | PN | NI | NI | N | N | N | N | NI | N | |
| 7.3 | N | N | N | N | PN | N | PN | PN | PN | N | N | N | N | NI | N | |
| Judgement | Low | Low | Low | Low | Low | Low | Low | NI | NI | Low | Low | Low | Low | NI | Low | |
| Overall | Judgement | Serious | Serious | Moderate | Low | Serious | Moderate | NI | Serious | Serious | Serious | Serious | Serious | Low | Moderate | Low |
N, no; NA, not applicable; NI, no information; PN, probably no; PY, probably yes; Y, yes