Table 2.
Summary of Mixed Methods Appraisal Tool (MMAT) results by study design (n=79).
Screening Questions (all study
types) (n=79) *If no or can’t tell for screening questions, study not further categorized/evaluated | |||
| |||
Yes | No | Can’t Tell | |
S1. Are there clear research questions? | 69 (87.3%) | 8 (10.1%) | 2 (2.5%) |
S2. Do the collected data allow to address the research questions? | 69 (87.3%) | 5 (6.3%) | 5 (6.3%) |
Did not meet MMAT screening criteria n=10 (12.7%) | |||
| |||
Qualitative n=5 (6.3%) | |||
| |||
Methodological quality criteria | Yes | No | Can’t Tell |
1.1 Is the qualitative approach appropriate to answer the research question | 5 (100%) | 0 (0%) | 0 (0% |
1.2 Are the qualitative data collection methods adequate to address the research question? | 5 (100%) | 0 (0%) | 0 (0% |
1.3 Are the findings adequately derived from the data? | 5 (100%) | 0 (0%) | 0 (0% |
1.4. Is the interpretation of results sufficiently substantiated by data? | 5 (100%) | 0 (0%) | 0 (0% |
1.5. Is there coherence between qualitative data sources, collection, analysis and interpretation? | 5 (100%) | 0 (0%) | 0 (0% |
| |||
Quantitative randomized controlled trials n=3 (3.8%) | |||
| |||
2.1. Is randomization appropriately performed? | 1 (33.3%) | 0 (0.0%) | 2 (66.7%) |
2.2. Are the groups comparable at baseline? | 3 (100%) | 0 (0%) | 0 (0% |
2.3. Are there complete outcome data? | 3 (100%) | 0 (0%) | 0 (0% |
2.4. Are outcome assessors blinded to the intervention provided? | 2 (66.7%) | 0 (0.0%) | 1 (33.3%) |
2.5 Did the participants adhere to the assigned intervention? | 2 (66.7%) | 0 (0.0%) | 1 (33.3%) |
| |||
Quantitative non-randomized n=53 (67.1%) | |||
| |||
3.1. Are the participants representative of the target population? | 45 (84.9%) | 2 (3.8%) | 6 (11.3%) |
3.2. Are measurements appropriate regarding both the outcome and intervention (or exposure)? | 47 (88.7%) | 2 (3.8%) | 4 (7.6%) |
3.3. Are there complete outcome data? | 39 (73.6%) | 13 (24.5%) | 1 (1.9%) |
3.4. Are the confounders accounted for in the design and analysis? | 17 (32.1%) | 36 (67.9%) | 0 (0%) |
3.5. During the study period, is the intervention administered (or exposure occurred) as intended? | 25 (47.2%) | 1 (1.9%) | 27 (50.9%) |
| |||
Quantitative descriptive n=2 (2.5%) | |||
| |||
4.1. Is the sampling strategy relevant to address the research question? | 2 (100.0%) | 0 (0%) | 0 (0%) |
4.2. Is the sample representative of the target population? | 1 (50.0%) | 0 (0%) | 1 (50.0%) |
4.3. Are the measurements appropriate? | 1 (50.0%) | 1 (50.0%) | 0 (0%) |
4.4. Is the risk of nonresponse bias low? | 2 (100.0%) | 0 (0%) | 0 (0%) |
4.5. Is the statistical analysis appropriate to answer the research question? | 2 (100.0%) | 0 (0%) | 0 (0%) |
| |||
Mixed methods n=6 (7.6%) | |||
| |||
5.1. Is there an adequate rationale for using a mixed methods design to address the research question? | 3 (50.0%) | 3 (50.0%) | 0 (0%) |
5.2. Are the different components of the study effectively integrated to answer the research question? | 5 (83.3 %) | 1 (16.7%) | 0 (0%) |
5.3. Are the outputs of the integration of qualitative and quantitative components adequately interpreted? | 5 (83.3%) | 1 (16.7%) | 0 (0%) |
5.4. Are divergences and inconsistencies between quantitative and qualitative results adequately addressed? | 4 (66.7%) | 1 (16.7%) | 1 (16.7%) |
5.5. Do the different components of the study adhere to the quality criteria of each tradition of the methods involved? | 4 (66.7%) | 2 (33.3%) | 0 (0%) |