Skip to main content
. 2021 Aug 21;8(4):477–485. doi: 10.1016/j.ijnss.2021.08.004

Table 4.

Quality check within MMAT.

Study design Methodological quality criteria Study Yes No Can’t tell Comments
Quantitative ①Is the sampling strategy relevant to address the research question?
②Is the sample representative of the target population?
③Are the measurements appropriate?
④Is the risk of nonresponse bias low?
⑤Is the statistical analysis appropriate to answer the research question?
Wu et al., 2011 [18] ①②③④⑤
Sheikhtaheri et al., 2018 [17] ①②③④⑤
Zayim et al., 2015 [16] ①②③④⑤
Hay et al., 2017 [22] ①②③④⑤
Pimmer et al., 2018 [24] ①②③④ Method of data analysis not mentioned.
Ortega et al., 2010 [23] ①②③④⑤
Qualitative ①Is the qualitative approach appropriate to answer the research question?
②Are the qualitative data collection methods adequate to address the research question?
③Are the findings adequately derived from the data?
④Is the interpretation of results sufficiently substantiated by data?
⑤Is there coherence between qualitative data sources, collection, analysis and interpretation?
Hsu et al., 2018 [25] ①②③④ Method of data analysis was not stated.
Wu, 2014 [26] ①②③④⑤
Willemse, 2014 [27] ①②③④⑤
Beauregard et al., 2017 [28] ①②③④⑤
George et al., 2017 [29] ①②③④ Method of data analysis was not stated.
Mixed methods ①Is there an adequate rationale for using a mixed methods design to address the research question?
②Are the different components of the study effectively integrated to answer the research question?
③Are the outputs of the integration of qualitative and quantitative components adequately interpreted?
④Are divergences and inconsistencies between quantitative and qualitative results adequately addressed?
⑤Do the different components of the study adhere to the quality criteria of each tradition of the methods involved?
Mather et al., 2016 [30] ①②③④ Method of data analysis was not stated.
Burke et al., 2014 [34] ①②③④ Method of data analysis was not stated.
Lai et al., 2016 [35] ①②③④⑤
Wu et al., 2014 [31] ①②③④⑤
O'Connor et al., 2018 [32] ①②③④⑤
Dearnley et al., 2008 [36] ①②③④⑤
Gallegos et al., 2019 [33] ①②③④⑤

Note: MMAT = Mixed Method Appraisal Tool.