Skip to main content
. Author manuscript; available in PMC: 2025 May 1.
Published in final edited form as: J Interprof Care. 2021 Oct 10;38(3):411–426. doi: 10.1080/13561820.2021.1980379

Table 2.

Summary of Mixed Methods Appraisal Tool (MMAT) results by study design (n=79).

Screening Questions (all study types) (n=79)
*If no or can’t tell for screening questions, study not further categorized/evaluated

Yes No Can’t Tell
S1. Are there clear research questions? 69 (87.3%) 8 (10.1%) 2 (2.5%)
S2. Do the collected data allow to address the research questions? 69 (87.3%) 5 (6.3%) 5 (6.3%)
Did not meet MMAT screening criteria n=10 (12.7%)

Qualitative n=5 (6.3%)

Methodological quality criteria Yes No Can’t Tell
1.1 Is the qualitative approach appropriate to answer the research question 5 (100%) 0 (0%) 0 (0%
1.2 Are the qualitative data collection methods adequate to address the research question? 5 (100%) 0 (0%) 0 (0%
1.3 Are the findings adequately derived from the data? 5 (100%) 0 (0%) 0 (0%
1.4. Is the interpretation of results sufficiently substantiated by data? 5 (100%) 0 (0%) 0 (0%
1.5. Is there coherence between qualitative data sources, collection, analysis and interpretation? 5 (100%) 0 (0%) 0 (0%

Quantitative randomized controlled trials n=3 (3.8%)

2.1. Is randomization appropriately performed? 1 (33.3%) 0 (0.0%) 2 (66.7%)
2.2. Are the groups comparable at baseline? 3 (100%) 0 (0%) 0 (0%
2.3. Are there complete outcome data? 3 (100%) 0 (0%) 0 (0%
2.4. Are outcome assessors blinded to the intervention provided? 2 (66.7%) 0 (0.0%) 1 (33.3%)
2.5 Did the participants adhere to the assigned intervention? 2 (66.7%) 0 (0.0%) 1 (33.3%)

Quantitative non-randomized n=53 (67.1%)

3.1. Are the participants representative of the target population? 45 (84.9%) 2 (3.8%) 6 (11.3%)
3.2. Are measurements appropriate regarding both the outcome and intervention (or exposure)? 47 (88.7%) 2 (3.8%) 4 (7.6%)
3.3. Are there complete outcome data? 39 (73.6%) 13 (24.5%) 1 (1.9%)
3.4. Are the confounders accounted for in the design and analysis? 17 (32.1%) 36 (67.9%) 0 (0%)
3.5. During the study period, is the intervention administered (or exposure occurred) as intended? 25 (47.2%) 1 (1.9%) 27 (50.9%)

Quantitative descriptive n=2 (2.5%)

4.1. Is the sampling strategy relevant to address the research question? 2 (100.0%) 0 (0%) 0 (0%)
4.2. Is the sample representative of the target population? 1 (50.0%) 0 (0%) 1 (50.0%)
4.3. Are the measurements appropriate? 1 (50.0%) 1 (50.0%) 0 (0%)
4.4. Is the risk of nonresponse bias low? 2 (100.0%) 0 (0%) 0 (0%)
4.5. Is the statistical analysis appropriate to answer the research question? 2 (100.0%) 0 (0%) 0 (0%)

Mixed methods n=6 (7.6%)

5.1. Is there an adequate rationale for using a mixed methods design to address the research question? 3 (50.0%) 3 (50.0%) 0 (0%)
5.2. Are the different components of the study effectively integrated to answer the research question? 5 (83.3 %) 1 (16.7%) 0 (0%)
5.3. Are the outputs of the integration of qualitative and quantitative components adequately interpreted? 5 (83.3%) 1 (16.7%) 0 (0%)
5.4. Are divergences and inconsistencies between quantitative and qualitative results adequately addressed? 4 (66.7%) 1 (16.7%) 1 (16.7%)
5.5. Do the different components of the study adhere to the quality criteria of each tradition of the methods involved? 4 (66.7%) 2 (33.3%) 0 (0%)