Table 2.
Article Quality Assessment (cont.)
| Article | MMAT Design Category* | Quality Criteria* | Comments | Quality Score,* % | |
|---|---|---|---|---|---|
| Criteria | Criteria Met | ||||
| Herschman18 |
Qualitative | Sources of qualitative data are relevant | Yes | 75 | |
| Process of analyzing qualitative data is relevant | Unable to determine | The form of data analysis is not clear | |||
| Appropriate consideration given to how findings relate to context | Yes | ||||
| Appropriate consideration given to how findings relate to the researchers' influence | Yes | ||||
| Holtz16 | Qualitative | Sources of qualitative data are relevant | Yes | 100 | |
| Process of analyzing qualitative data is relevant | Yes | ||||
| Appropriate consideration given to how findings relate to context | Yes | ||||
| Appropriate consideration given to how findings relate to the researchers' influence | Yes | ||||
| Jibb27 | Mixed methods (qualitative plus cross-sectional analytic) | Recruitment minimizes selection bias | No | 50 | |
| Appropriate measures and absence of contamination between groups | Unable to determine | Source of survey instrument not clear | |||
| Groups are comparable or differences controlled for | Yes | ||||
| Complete outcome data (≥80%) and acceptable response rate or follow-up rate if applicable | Yes | ||||
| Sources of qualitative data are relevant | Yes | ||||
| Process of analyzing qualitative data is relevant | Yes | ||||
| Appropriate consideration given to how findings relate to context | Yes | ||||
| Appropriate consideration given to how findings relate to the researchers' influence | Yes | ||||
| Mixed method design relevant to the questions | Unable to determine | Rationale for using mixed method not mentioned | |||
| Integration of qualitative and quantitative data is relevant | Yes | ||||
| Appropriate consideration given to the limitations of this integration | Unable to determine | Limitations associated with mixed method not mentioned | |||
| Kenny17 | Qualitative | Sources of qualitative data are relevant | Yes | 75 | |
| Process of analyzing qualitative data is relevant | Yes | ||||
| Appropriate consideration given to how findings relate to context | Yes | ||||
| Appropriate consideration given to how findings relate to the researchers' influence | Unable to determine | ||||
* Quality assessed using the Mixed Methods Appraisal Tool (MMAT) – Version 2011. MMAT contains 5 study design categories: qualitative, quantitative randomized controlled, quantitative non-randomized, quantitative descriptive, and mixed methods. Each category contains 4 (or 3 for Mixed Methods) criteria. Scores range from 0% to 100%. For qualitative, quantitative randomized controlled, quantitative non-randomized, and quantitative descriptive studies, scores are calculated as a percentage of criteria met. For mixed methods studies, scores are calculated as the lowest score from among the 3 relevant designs (quantitative [Quan], qualitative [Qual], mixed methods [MM]): 25% when Quan = 1 or Qual = 1 or MM = 0; 50% when Quan = 2 or Qual = 2 or MM = 1; 75% when Quan = 3 or Qual = 3 or MM = 2; 100% when Quan = 4 or Qual = 4 or MM = 3.