Table 5.
Risk of bias assessment
| Study | Domain 1 | Domain 2 | Domain 3 | Domain 4 | Risk of bias | FD | |||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | LoC | 1 | 2 | 3 | 4 | 5 | LoC | 1 | 2 | 3 | 4 | 5 | LoC | 1 | 2 | 3 | 4 | 5 | 6 | LoC | 1 | 2 | 3 | RoB | |||
| (Eder et al. 2018) | Evaluator 1 | Y | Y | Y | P-Y | P-Y | Low | Y | Y | Y | Y | Y | Low | P-Y | P-Y | Y | N | N-I | High | Y | P-Y | Y | Y | P-Y | N | UC | P-Y | Y | Y | Low | Low |
| Evaluator 2 | P-Y | P-Y | Y | P-N | P-Y | Low | Y | N-I | P-Y | Y | P-Y | Low | P-N | Y | P-Y | N | N-I | High | P-Y | P-Y | N-I | Y | P-Y | N | Low | P-Y | Y | P-Y | Low | ||
| (Winburn et al. 2018) | Evaluator 1 | Y | P-Y | P-Y | P-Y | P-Y | Low | P-Y | P-N | P-Y | P-N | P-Y | High | N-I | P-Y | P-Y | N | N | High | P-Y | Y | P-Y | Y | P-Y | N | UC | N | P-Y | Y | High | High |
| Evaluator 2 | P-Y | P-Y | P-N | P-Y | P-Y | Low | P-N | N | P-Y | P-N | N-I | High | N-I | P-Y | P-Y | N-I | N-I | UC | P-N | P-Y | N | Y | N-I | P-N | UC | P-N | P-Y | Y | High | ||
| (du Toit et al. 2019) | Evaluator 1 | Y | P-Y | Y | P-Y | P-Y | Low | Y | P-N | P-Y | N | P-Y | High | P-Y | Y | Y | N | N | High | Y | P-Y | P-Y | P-Y | Y | N | High | N | Y | P-Y | High | High |
| Evaluator 2 | P-Y | P-N | P-Y | P-N | P-N | High | P-Y | Y | P-Y | P-N | N-I | High | P-Y | P-Y | N-I | N | N | High | P-N | P-Y | P-Y | P-Y | N-I | N | High | N | P-Y | P-Y | High | ||
| (Rogers et al. 2017) | Evaluator 1 | N-I | P-Y | Y | P-Y | P-Y | Low | P-N | Y | P-Y | N | Y | High | Y | Y | Y | N | N | High | Y | P-Y | Y | Y | P-Y | N | High | N | P-Y | Y | High | High |
| Evaluator 2 | P-Y | P-Y | P-Y | P-Y | Y | Low | P-N | N-I | P-N | P-Y | Y | High | Y | P-Y | P-Y | N | N-I | UC | P-Y | P-Y | P-Y | Y | P-N | N-I | Low | P-Y | P-Y | P-Y | Low | ||
| (Brainard et al. 2016) | Evaluator 1 | Y | P-Y | Y | P-Y | P-Y | Low | Y | Y | Y | P-Y | P-Y | Low | N-I | P-Y | Y | Y | N-I | Low | Y | Y | Y | Y | P-Y | P-Y | Low | Y | Y | Y | Low | Low |
| Evaluator 2 | Y | P-Y | Y | Y | Y | Low | P-Y | Y | N-I | Y | P-Y | Low | P-Y | P-Y | P-Y | Y | P-Y | Low | P-Y | Y | P-Y | Y | N-I | P-N | Low | Y | P-Y | Y | Low | ||
| (Salmoiraghi and Hussain 2015) | Evaluator 1 | N-I | Y | P-Y | Y | Y | Low | Y | Y | P-Y | N | Y | High | N-I | P-N | Y | N | N | High | Y | P-Y | P-Y | Y | P-Y | N | High | N | Y | Y | High | High |
| Evaluator 2 | P-N | N-I | N | N-I | P-N | High | P-Y | P-Y | P-N | P-N | Y | High | N-I | P-N | P-N | N-I | N-I | High | N-I | N | P-N | N-I | N | N | High | N | P-N | P-N | High | ||
| (Ward et al. 2015) | Evaluator 1 | Y | P-Y | P-Y | Y | Y | Low | Y | N | P-Y | N | Y | High | Y | Y | Y | N | N | High | Y | P-Y | Y | Y | P-Y | N | High | N | Y | P-Y | High | High |
| Evaluator 2 | Y | P-Y | P-Y | Y | P-Y | Low | Y | N-I | P-Y | P-N | Y | High | N-I | P-Y | P-Y | N-I | N-I | UC | P-Y | Y | N-I | N-I | P-Y | N | High | P-N | P-Y | P-Y | High | ||
| (Kimmel et al. 2019) | Evaluator 1 | Y | Y | P-Y | P-Y | Y | Low | Y | P-Y | Y | Y | Y | Low | Y | Y | P-Y | Y | N-I | Low | Y | P-Y | Y | Y | P-Y | P-Y | Low | P-Y | P-Y | Y | Low | Low |
| Evaluator 2 | P-Y | P-Y | P-Y | P-N | Y | Low | Y | P-Y | N-I | P-Y | Y | Low | Y | P-Y | P-Y | Y | N-I | Low | P-N | P-Y | P-Y | Y | P-Y | P-Y | Low | P-Y | Y | P-Y | Low | ||
| (Kelton et al. 2018) | Evaluator 1 | Y | P-Y | Y | P-Y | Y | Low | Y | Y | Y | P-Y | Y | Low | N-I | Y | Y | N | N | High | Y | P-Y | Y | Y | P-Y | N | High | N | Y | Y | High | High |
| Evaluator 2 | Y | Y | P-Y | P-Y | P-Y | Low | Y | P-Y | P-Y | P-N | Y | Low | N-I | P-N | P-Y | N-I | N-I | UC | Y | N-I | P-N | N-I | N-I | N-I | UC | P-N | P-Y | P-Y | UC | ||
| (Marsh-Feiley et al. 2018) | Evaluator 1 | Y | Y | Y | P-Y | Y | Low | Y | Y | Y | Y | Y | Low | Y | P-Y | P-Y | Y | Y | Low | Y | Y | P-Y | Y | Y | Y | Low | P-Y | Y | Y | Low | Low |
| Evaluator 2 | Y | P-Y | Y | P-Y | P-Y | Low | Y | P-Y | P-Y | P-Y | P-Y | Low | N-I | P-Y | P-Y | Y | Y | Low | P-Y | Y | P-Y | P-Y | P-Y | P-Y | Low | Y | Y | P-Y | Low | ||
| (Bashshur et al. 2016) | Evaluator 1 | P-Y | P-Y | N | P-N | P-Y | High | N-I | N-I | N-I | N | N-I | High | N-I | P-Y | Y | N | N | High | P-Y | Y | P-Y | P-Y | Y | N | High | N | N-I | Y | High | High |
| Evaluator 2 | P-Y | P-N | P-N | P-N | N | High | N-I | N-I | N-I | P-N | N-I | High | N-I | N-I | P-N | N-I | N-I | High | P-Y | N-I | P-Y | N-I | N-I | N-I | UC | P-N | P-N | N-I | High | ||
| (Gattu et al. 2016) | Evaluator 1 | Y | Y | P-Y | N-I | P-Y | Low | N-I | N-I | N-I | P-Y | N-I | UC | N-I | P-Y | Y | N | N | High | P-Y | P-Y | P-Y | P-Y | N-I | N | High | N | P-Y | P-Y | High | High |
| Evaluator 2 | P-Y | Y | P-N | N-I | N-I | UC | N-I | N-I | N-I | N-I | N-I | UC | N-I | P-Y | N-I | N | N | High | P-Y | N-I | P-Y | P-N | N-I | N | High | N | P-Y | N-I | High | ||
| (Pak and Pak 2015) | Evaluator 1 | N-I | P-Y | Y | P-Y | P-Y | Low | Y | Y | Y | N | Y | High | Y | Y | Y | N | N | High | P-Y | P-Y | Y | P-Y | P-Y | N | High | N | P-Y | Y | High | High |
| Evaluator 2 | Y | P-Y | P-Y | P-Y | P-N | Low | Y | Y | P-Y | P-N | Y | Low | Y | P-Y | P-N | N-I | N-I | UC | P-N | N | P-Y | P-Y | P-Y | N-I | High | N | P-Y | P-Y | High | ||
| (Guevorkian 2017) | Evaluator 1 | N-I | P-Y | Y | P-Y | P-Y | Low | Y | P-Y | Y | P-Y | N | High | N | P-Y | Y | Y | N | High | Y | Y | P-Y | Y | P-Y | P-Y | Low | Y | P-Y | Y | Low | Low |
| Evaluator 2 | Y | P-Y | Y | P-Y | P-Y | Low | P-Y | P-Y | P-Y | P-Y | N | High | N | P-Y | P-Y | Y | N | High | P-Y | Y | P-Y | P-Y | P-Y | P-Y | Low | P-Y | P-Y | Y | Low | ||
| (Nadar et al. 2018) | Evaluator 1 | Y | P-Y | Y | P-Y | P-Y | Low | Y | Y | Y | P-Y | Y | Low | Y | P-Y | Y | Y | Y | Low | Y | Y | Y | Y | P-Y | Y | Low | P-Y | Y | P-Y | Low | Low |
| Evaluator 2 | Y | P-Y | Y | P-Y | P-N | Low | Y | Y | Y | P-Y | Y | Low | Y | P-Y | Y | P-Y | Y | Low | Y | P-Y | Y | Y | P-Y | Y | Low | Y | Y | P-Y | Low | ||
| (Lazarus et al. 2020) | Evaluator 1 | Y | Y | Y | P-Y | P-Y | Low | P-Y | Y | Y | N | N | High | N | Y | P-Y | Y | N | High | Y | Y | P-Y | Y | P-Y | Y | Low | N | P-Y | Y | High | High |
| Evaluator 2 | Y | Y | P-Y | P-Y | P-Y | Low | P-Y | Y | P-Y | P-N | P-N | High | N-I | P-Y | P-Y | Y | Y | Low | P-Y | Y | Y | Y | P-Y | Y | Low | P-N | P-Y | Y | UC | ||
| (Boggan et al. 2020) | Evaluator 1 | Y | P-Y | Y | P-Y | P-Y | Low | Y | P-Y | Y | P-Y | Y | Low | Y | Y | P-Y | Y | Y | Low | Y | P-Y | Y | P-Y | P-Y | P-Y | Low | Y | P-Y | P-Y | Low | Low |
| Evaluator 2 | P-Y | P-Y | P-Y | N-I | P-N | UC | P-Y | P-Y | Y | P-Y | Y | Low | Y | Y | P-Y | Y | Y | Low | P-Y | Y | Y | Y | P-Y | P-Y | Low | P-Y | P-Y | P-Y | Low | ||
| (Culmer et al. 2019) | Evaluator 1 | Y | P-Y | Y | P-Y | P-Y | Low | P-Y | N | P-Y | N | Y | High | Y | P-Y | Y | Y | N-I | Low | Y | P-Y | Y | Y | P-Y | P-Y | Low | N | P-Y | Y | High | High |
| Evaluator 2 | Y | P-Y | Y | P-Y | P-Y | Low | P-Y | N | P-N | N | Y | High | Y | Y | P-Y | Y | N-I | Low | P-Y | P-Y | Y | P-Y | P-Y | P-Y | Low | P-N | P-Y | Y | High | ||
LoC = level of concern, Y = yes , FD = final decision, UC = unclear, N-I = no information, RoB = risk of bias, N = no, P-Y = probably yes, P-N = probably no