Table 4.
Quality check within MMAT.
| Study design | Methodological quality criteria | Study | Yes | No | Can’t tell | Comments |
|---|---|---|---|---|---|---|
| Quantitative | ①Is the sampling strategy relevant to address the research question? ②Is the sample representative of the target population? ③Are the measurements appropriate? ④Is the risk of nonresponse bias low? ⑤Is the statistical analysis appropriate to answer the research question? |
Wu et al., 2011 [18] | ①②③④⑤ | |||
| Sheikhtaheri et al., 2018 [17] | ①②③④⑤ | |||||
| Zayim et al., 2015 [16] | ①②③④⑤ | |||||
| Hay et al., 2017 [22] | ①②③④⑤ | |||||
| Pimmer et al., 2018 [24] | ①②③④ | ⑤ | Method of data analysis not mentioned. | |||
| Ortega et al., 2010 [23] | ①②③④⑤ | |||||
| Qualitative | ①Is the qualitative approach appropriate to answer the research question? ②Are the qualitative data collection methods adequate to address the research question? ③Are the findings adequately derived from the data? ④Is the interpretation of results sufficiently substantiated by data? ⑤Is there coherence between qualitative data sources, collection, analysis and interpretation? |
Hsu et al., 2018 [25] | ①②③④ | ⑤ | Method of data analysis was not stated. | |
| Wu, 2014 [26] | ①②③④⑤ | |||||
| Willemse, 2014 [27] | ①②③④⑤ | |||||
| Beauregard et al., 2017 [28] | ①②③④⑤ | |||||
| George et al., 2017 [29] | ①②③④ | ⑤ | Method of data analysis was not stated. | |||
| Mixed methods | ①Is there an adequate rationale for using a mixed methods design to address the research question? ②Are the different components of the study effectively integrated to answer the research question? ③Are the outputs of the integration of qualitative and quantitative components adequately interpreted? ④Are divergences and inconsistencies between quantitative and qualitative results adequately addressed? ⑤Do the different components of the study adhere to the quality criteria of each tradition of the methods involved? |
Mather et al., 2016 [30] | ①②③④ | ⑤ | Method of data analysis was not stated. | |
| Burke et al., 2014 [34] | ①②③④ | ⑤ | Method of data analysis was not stated. | |||
| Lai et al., 2016 [35] | ①②③④⑤ | |||||
| Wu et al., 2014 [31] | ①②③④⑤ | |||||
| O'Connor et al., 2018 [32] | ①②③④⑤ | |||||
| Dearnley et al., 2008 [36] | ①②③④⑤ | |||||
| Gallegos et al., 2019 [33] | ①②③④⑤ |
Note: MMAT = Mixed Method Appraisal Tool.