Table 3.
Quality appraisal using AXIS checklist.
| Name of first author (year) | Q1 | Q2 | Q3 | Q4 | Q5 | Q6 | Q7 | Q8 | Q9 | Q10 | Q11 | Q12 | Q13 | Q14 | Q15 | Q16 | Q17 | Q18 | Q19 | Q20 | Total (max 20) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| RQ | SD | SD | RQ | SD | RB | RB | SD | RB | RQ | RQ | RQ | RB | RB | RB | RQ | SD | RQ | SD | SD | ||
| Allard et al. (2003) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | ✓ | X | ✓ | X | ✓ | ✓ | 16 |
| Anson and Bloom (1988) | X | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | X | X | 13 |
| Dir et al. (2019) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | X | ✓ | ✓ | ✓ | ✓ | ✓ | 16 |
| Gayman and Bradley (2013) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | 16 |
| Gayman et al. (2018) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | X | X | ✓ | ✓ | ✓ | ✓ | X | ✓ | 15 |
| Holgate and Clegg (1991) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | X | ✓ | ✓ | − | X | ✓ | X | ✓ | ✓ | ✓ | − | 13 |
| Holloway (2019) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | X | ✓ | 16 |
| Jin et al. (2018) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | − | X | ✓ | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | 17 |
| Lewis et al. (2013) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | X | X | ✓ | ✓ | ✓ | ✓ | X | ✓ | 15 |
| Lindquist and Whitehead (1986) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | X | X | ✓ | X | X | X | X | 11 |
| Merhav et al. (2018) | ✓ | ✓ | − | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | X | ✓ | X | ✓ | ✓ | ✓ | 15 |
| Rhineberger-Dunn et al. (2016) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | X | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | 16 |
| Rhineberger-Dunn et al. (2017) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | X | 16 |
| White et al. (2015) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | X | ✓ | ✓ | ✓ | X | ✓ | 15 |
| Whitehead (1985) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | X | X | ✓ | X | ✓ | X | ✓ | X | 12 |
| Whitehead (1986a) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | X | X | ✓ | ✓ | ✓ | X | X | X | 12 |
| Whitehead (1986b) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | X | X | ✓ | ✓ | X | X | ✓ | − | 12 |
| Whitehead (1987) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | X | ✓ | 15 |
| Whitehead and Lindquist (1985) | ✓ | ✓ | X | ✓ | ✓ | ✓ | X | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | X | ✓ | X | ✓ | X | ✓ | X | 14 |
Note: Question grouping: RQ = reporting quality; SD = study design; RB = risk of bias (Kiss et al. 2018). Ratings: ✓= criteria met; – = don’t know/partially met; X = criteria not met.