Table 2.
Quality appraisal of included studies based on Mixed Methods Appraisal Tool (Hong et al., 2018)
| Study (by design) | Methodological quality criteria | ||||
|---|---|---|---|---|---|
| Qualitative studies | Qualitative approach appropriate to answer research question? | Data collection methods adequate to answer research question? | Findings adequately derived from data? | Interpretation of results sufficiently substantiated by data? | Coherence between qualitative data, sources, collection, analysis, and interpretation? |
| Chlebowski et al. (2018) | Y | Y | Y | Y | Y |
| Jones and Jassi (2020) | Y | Y | Y | Y | Y |
| London et al. (2020) | Y | Y | Y | Y | Y |
| Randomized controlled trials | Randomization appropriately performed? | Groups comparable at baseline? | Complete outcome data? | Outcome assessors blinded to the intervention provided? | Participants adhered to assigned intervention? |
| Gordon et al. (2015) | Y | Y | Y | N | Y |
| McNally Keehn et al. (2013) | Y | Y | Y | N | Y |
| Pahnke et al. (2014) | Y | Y | Y | N | Y |
| Weiss et al. (2018) | Y | Y | Y | N | Y |
| White et al. (2013) | Y | Y | Y | N | Y |
| Non-randomized studies | Participants representative of target population? | Measurements appropriate for both outcome and intervention? | Complete outcome data? | Confounders accounted for in design/analysis? | Intervention administered as intended? |
|---|---|---|---|---|---|
| Hillier et al. (2012) | Y | Y | N | Y | Y |
| Jassi et al. (2021) | Y | Y | Y | Y | Y |
| Lordo et al. (2017) | Y | Y | Y | N | Y |
| Swain et al. (2019) | Y | Y | Y | Y | Y |
| Thomson et al. (2015) | Y | Y | Y | Y | Y |
| Quantitative descriptive studies | Sampling strategy relevant to research question? | Sample representative of target population? | Measurements appropriate? | Risk of nonresponse bias low? | Statistical analysis appropriate to answer research question? |
|---|---|---|---|---|---|
| Albaum et al. (2020) | Y | Y | Y | N | Y |
| Brewe et al. (2021) | Y | Y | Y | Y | Y |
| Brown et al. (2015) | Y | Y | Y | N | Y |
| Burnham Riosa et al. (2019) | C | Y | Y | N | Y |
| Kang et al. (2021) | Y | C | Y | N | Y |
| Kerns et al. (2018) | Y | Y | Y | N | Y |
| Klebanoff et al. (2019) | N | Y | Y | N | Y |
| Storch et al. (2015) | N | Y | Y | N | Y |
| Walsh et al. (2018) | Y | Y | Y | Y | Y |
| Mixed methods studies | Adequate rationale for mixed methods design to address research question? | Different components of study effectively integrated to answer research question? | Outputs of integration of qualitative/ quantitative components adequately interpreted? | Divergences/inconsistencies between quantitative and qualitative results adequately addressed? | Different components of study adhere to the quality criteria of each tradition of methods involved? |
|---|---|---|---|---|---|
| Backman et al. (2018) | N | N | N | Y | N |
| Drmic et al. (2017) | N | N | N | Y | Y |
| Edgington et al. (2016) | N | N | N | N | Y |
C Can’t tell, N No, Y Yes