Table 2.
Evaluation of the quality of articles according to the Mixed Methods Appraisal Tool (MMAT). a
| Reference | Screen questions | 1. Qualitative studies | 2. Randomised controlled trials | 3. Nonrandomised studies | 4. Quantitative descriptive studies | 5. Mixed-methods studies | Decision | |||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Criteria b | S1 | S2 | 1 | 2 | 3 | 4 | 5 | 1 | 2 | 3 | 4 | 5 | 1 | 2 | 3 | 4 | 5 | 1 | 2 | 3 | 4 | 5 | 1 | 2 | 3 | 4 | 5 | |
| Abu Mansour and Abu Shosha (2021) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| Carter and Turner (2021) | Y | Y | CT | N | CT | Y | CT | E | ||||||||||||||||||||
| Deldar et al. (2021) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| Gab Allah (2021) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| Holge-Hazelton et al. (2021) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| Jackson and Nowell (2021) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| Jónsdóttir et al. (2022) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| Kagan et al. (2021) | Y | Y | Y | Y | Y | Y | Y | Y | Y | CT | Y | Y | CT | Y | Y | Y | Y | I | ||||||||||
| Losty and Bailey (2021) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| Middleton et al. (2021) | Y | Y | Y | CT | Y | Y | Y | I | ||||||||||||||||||||
| Moyo et al. (2022) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| Vázquez-Calatayud et al. (2022) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
| White (2021) | Y | Y | Y | Y | Y | Y | Y | I | ||||||||||||||||||||
MMAT (Mixed Methods Appraisal Tool) is a critical appraisal tool developed for the appraisal of quantitative, qualitative and mixed-methods studies included in systematic mixed-studies reviews.
Criteria: Screening questions: (S1) Are there clear research questions? (S2) Do the collected data allow to address the research questions? Qualitative questions: (1.1) Is the qualitative approach appropriate to answer the research question? (1.2) Are the qualitative data collection methods adequate to address the research question? (1.3) Are the findings adequately derived from the data? (1.4) Is the interpretation of results sufficiently substantiated by data? (1.5) Is there coherence between qualitative data sources, collection, analysis and interpretation? Randomised controlled trials: (2.1) Is randomisation appropriately performed? (2.2) Are the groups comparable at baseline? (2.3) Are there complete outcome data? (2.4) Are outcome assessors blinded to the intervention provided? (2.5) Did the participants adhere to the assigned intervention? Nonrandomised studies: (3.1) Are the participants representative of the target population? (3.2) Are measurements appropriate regarding both the outcome and intervention (or exposure)? (3.3) Are there complete outcome data? (3.4) Are the confounders accounted for in the design and analysis? (3.5) During the study period, is the intervention administered (or exposure occurred) as intended? Quantitative descriptive studies: (4.1) Is the sampling strategy relevant to address the research question? (4.2) Is the sample representative of the target population? (4.3) Are the measurements appropriate? (4.4) Is the risk of nonresponse bias low? (4.5) Is the statistical analysis appropriate to answer the research question? Mixed-methods studies: (5.1) Is there an adequate rationale for using a mixed-methods design to address the research question? (5.2) Are the different components of the study effectively integrated to answer the research question? (5.3) Are the outputs of the integration of qualitative and quantitative components adequately interpreted? (5.4) Are divergences and inconsistencies between quantitative and qualitative results adequately addressed? (5.5.) Do the different components of the study adhere to the quality criteria of each tradition of the methods involved? CT, cannot tell; E, excluded; I, Included; N, no; Y, yes.