TABLE 2.
AXIS critical appraisal
| Introduction | Janco et al. (1996)28 | Heijnen et al. (2000)21 | Van der Net et al. (2006) 29 | Nazzaro et al. (2006)30 | Fromme et al. (2007)31 | Tlacuilo‐Parra et al. (2008)22 | Tiktinsky et al. (2009)32 | Koiter et al. (2009)23 | Ross et al. (2009)33 | Sherlock et al. (2010)34 | Khawaji et al. (2010)35 | Buxbaum et al. (2010)36 | Groen et al. (2011)24 | Gonzalez et al. (2011)37 | Khair et al. (2012)38 | Broderick et al. (2012)39 | Baumgardner et al. (2013)40 | den Uijl et al. (2013)41 | Broderick et al. (2013)25 | Niu et al. (2014)26 | McGee et al. (2015)42 | Von Mackensen et al. (2016)27 | Cuesta‐Barriuso et al. (2016)43 | Bouskill et al. (2016)44 | Carneiro et al. (2017)45 | Baumann et al. (2017)14 | Flaherty et al. (2018)15 | Kempton et al. (2018)46 | Pinto et al. (2018)47 | Pinto et al. (2018)48 | Versloot et al. (2019)49 | Goto et al. (2019)50 | Zanon et al. (2020)51 | Timmer et al. (2020)52 | Taylor et al. (2020)53 | Bérubé et al. (2020)54 | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Q1. | N | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | N | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | N | Y | N | Y | Y | Y | Y | Y | ||
| Methods | ||||||||||||||||||||||||||||||||||||||
| Q2. | Y | * | Y | Y | Y | Y | Y | Y | Y | Y | * | * | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | * | Y | Y | Y | * | ||
| Q3. | N | N | N | N | N | N | N | N | N | N | N | N | N | N | N | Y | N | N | N | N | N | N | N | Y | Y | N | N | N | N | N | N | N | N | N | N | N | ||
| Q4. | N | Y | Y | N | N | N | Y | Y | Y | N | Y | N | N | N | Y | Y | N | N | Y | Y | Y | Y | N | Y | Y | Y | N | N | Y | Y | Y | N | Y | N | Y | Y | ||
| Q5. | N | N | N | N | N | N | N | Y | N | Y | N | N | N | N | N | N | Y | N | N | N | N | N | N | N | N | N | N | N | Y | Y | N | N | Y | N | N | N | ||
| Q6. | N | N | N | N | N | N | Y | Y | Y | N | Y | N | N | N | N | N | N | N | N | Y | Y | N | N | Y | Y | N | N | Y | Y | Y | N | N | Y | Y | Y | Y | ||
| Q7. | N | NA | N | N | N | N | N | N | NA | N | N | N | N | N | N | N | Y | N | N | N | NA | N | N | N | N | N | N | N | Y | N | Y | N | N | N | Y | N | ||
| Q8. | N | N | Y | N | N | Y | Y | Y | N | Y | Y | N | Y | Y | Y | N | Y | Y | Y | Y | N | Y | Y | Y | Y | N | Y | Y | N | N | Y | Y | N | Y | N | N | ||
| Q9. | N | N | Y | N | N | Y | Y | Y | N | Y | Y | N | Y | Y | Y | N | Y | Y | N | Y | N | Y | Y | Y | Y | N | N | Y | N | N | Y | Y | N | Y | N | N | ||
| Q10. | N | N | Y | N | N | Y | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | N | Y | N | Y | Y | N | Y | NA | N | Y | NA | Y | Y | Y | Y | N | Y | Y | ||
| Q11. | N | N | Y | N | N | Y | Y | Y | N | Y | N | Y | Y | Y | Y | Y | Y | N | N | Y | Y | Y | N | Y | Y | N | N | N | Y | Y | Y | N | Y | Y | Y | Y | ||
| Results | ||||||||||||||||||||||||||||||||||||||
| Q12. | N | N | Y | Y | N | Y | Y | Y | Y | Y | N | Y | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | N | N | Y | N | ||
| Q13. | Y | N | Y | Y | Y | Y | Y | Y | NA | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | NA | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | ||
| Q14. | N | NA | N | N | N | N | N | Y | NA | N | N | N | N | N | N | N | Y | N | N | N | NA | N | N | N | N | N | N | N | Y | N | Y | N | N | N | N | N | ||
| Q15. | N | N | N | N | Y | N | N | Y | N | Y | N | N | Y | N | N | Y | Y | N | Y | Y | N | N | N | Y | Y | Y | Y | Y | N | Y | N | N | N | Y | N | Y | ||
| Q16. | N | N | N | Y | N | N | Y | Y | Y | Y | Y | N | Y | Y | N | Y | Y | Y | N | Y | Y | N | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | N | Y | N | N | ||
| Discussion | ||||||||||||||||||||||||||||||||||||||
| Q17. | N | N | Y | Y | N | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | N | N | Y | Y | Y | Y | Y | N | N | Y | Y | Y | ||
| Q18. | N | Y | Y | Y | N | N | N | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | ||
| Other | ||||||||||||||||||||||||||||||||||||||
| Q19. | Y | N | * | N | * | N | N | Y | * | N | N | Y | Y | N | N | Y | N | N | N | Y | N | Y | * | N | Y | Y | N | Y | N | N | Y | N | N | N | N | N | ||
| Q20a. | N | N | Y | Y | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | ||
| Q20b. | Y | N | N | Y | N | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | Y | N | Y | N | N | Y | Y | Y | Y | N | N | Y | Y | Y | Y | N | Y | N | Y | Y | ||
Unable to Determine; ‘N’ = No; ‘NA’ = Not applicable; ‘Y’ = Yes. Q1. Were the aims/objectives clear? Q2. Was the study design appropriate for the stated aim (s)? Q3. Was the sample size justified? Q4. Was the target/reference population clearly defined? (Is it clear who the research was about?) Q5. Was the sample frame taken from an appropriate population base so that it closely represented the target/reference population under investigation? Q6. Was the selection process likely to select subjects/participants that were representative of the target/reference population under investigation? Q7. Were measures undertaken to address and categorise non‐responders? Q8. Were the risk factor and outcome variables measured appropriate to the aims of the study? Q9. Were the risk factor and outcome variables measured correctly using instruments /measurements that had been trialled, piloted or published previously? Q10. Is it clear what was used to determine statistical significance and/or precision estimates? (eg p‐values, confidence intervals) Q11. Were the methods (including statistical methods) sufficiently described to enable them to be repeated? Q12. Were the basic data adequately described? Q13. Does the response rate raise concerns about non‐response bias? Q14. If appropriate, was information about non‐ responders described? Q15. Were the results internally consistent? Q16. Were the results presented for all the analyses described in the methods? Q17. Were the authors’ discussions and conclusions justified by the results? Q18. Were the limitations of the study discussed? Q19. Were there any funding sources or conflicts of interest that may affect the authors’ interpretation of the results? Q20a. Was ethical approval attained? Q20b. Was consent of participants attained?