Skip to main content
. 2019 Jul-Aug;24(4):254–269. doi: 10.5863/1551-6776-24.4.254

Table 2.

Article Quality Assessment (cont.)

Article MMAT Design Category* Quality Criteria* Comments Quality Score,* %
Criteria Criteria Met
Herschman18
Qualitative Sources of qualitative data are relevant Yes 75
Process of analyzing qualitative data is relevant Unable to determine The form of data analysis is not clear
Appropriate consideration given to how findings relate to context Yes
Appropriate consideration given to how findings relate to the researchers' influence Yes
Holtz16 Qualitative Sources of qualitative data are relevant Yes 100
Process of analyzing qualitative data is relevant Yes
Appropriate consideration given to how findings relate to context Yes
Appropriate consideration given to how findings relate to the researchers' influence Yes
Jibb27 Mixed methods (qualitative plus cross-sectional analytic) Recruitment minimizes selection bias No 50
Appropriate measures and absence of contamination between groups Unable to determine Source of survey instrument not clear
Groups are comparable or differences controlled for Yes
Complete outcome data (≥80%) and acceptable response rate or follow-up rate if applicable Yes
Sources of qualitative data are relevant Yes
Process of analyzing qualitative data is relevant Yes
Appropriate consideration given to how findings relate to context Yes
Appropriate consideration given to how findings relate to the researchers' influence Yes
Mixed method design relevant to the questions Unable to determine Rationale for using mixed method not mentioned
Integration of qualitative and quantitative data is relevant Yes
Appropriate consideration given to the limitations of this integration Unable to determine Limitations associated with mixed method not mentioned
Kenny17 Qualitative Sources of qualitative data are relevant Yes 75
Process of analyzing qualitative data is relevant Yes
Appropriate consideration given to how findings relate to context Yes
Appropriate consideration given to how findings relate to the researchers' influence Unable to determine

* Quality assessed using the Mixed Methods Appraisal Tool (MMAT) – Version 2011. MMAT contains 5 study design categories: qualitative, quantitative randomized controlled, quantitative non-randomized, quantitative descriptive, and mixed methods. Each category contains 4 (or 3 for Mixed Methods) criteria. Scores range from 0% to 100%. For qualitative, quantitative randomized controlled, quantitative non-randomized, and quantitative descriptive studies, scores are calculated as a percentage of criteria met. For mixed methods studies, scores are calculated as the lowest score from among the 3 relevant designs (quantitative [Quan], qualitative [Qual], mixed methods [MM]): 25% when Quan = 1 or Qual = 1 or MM = 0; 50% when Quan = 2 or Qual = 2 or MM = 1; 75% when Quan = 3 or Qual = 3 or MM = 2; 100% when Quan = 4 or Qual = 4 or MM = 3.