Table 4.
MMAT
| Bardosh et al. 2017 [16] | Brewster et al. 2015 [17] | Carrera et al. 2015 [18] | Frykman et al. 2014 [19] | Wiener-Ogilvie et al. 2008 [20] | Atkins et al. 2008 [21] | Baer et al. 2009 [22] | Bonetti et al. 2005 [23] | Garner et al. 2011 [24] | Glisson et al. 2010 [25] | Holth et al. 2011 [26] | Lee et al. 2018 [27] | Lochman et al. 2009 [28] | Rapkin et al. 2017 [29] | Rohrbach et al. 1993 [30] | Seys et al. 2018 [31] | Williams et al. 2014 [32] | Williams et al. 2017 [33] | |||
| 1. Qualitative | ||||||||||||||||||||
| Data sources relevant? | Y | Y | Y | Y | Y | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | ||
| Data analysis process relevant? | Y | Y | Y | Y | Y | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | ||
| Findings relate to context? | Y | Y | Y | Y | Y | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | ||
| Findings relate to researchers' influence? | N | N | N | Y | N | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | ||
| 2. Quantitative randomized | ||||||||||||||||||||
| Clear description of the randomization? | N/A | N/A | N/A | N/A | N/A | N | N | Y | Y | N | N | Y | N | Y | N | Y | N | Y | ||
| Clear description of allocation or concealment? | N/A | N/A | N/A | N/A | N/A | N | N | N | N | Y | N | N | Y | N | Y | N | N | N | ||
| Complete outcome data? | N/A | N/A | N/A | N/A | N/A | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | Y | N | Y | ||
| Low withdrawal/drop-out? | N/A | N/A | N/A | N/A | N/A | Y | Y | N | Y | N | N | N | Y | N | Y | N | Y | Y | ||
| Total score (%) | 75 | 75 | 75 | 100 | 75 | 50 | 50 | 50 | 75 | 50 | 25 | 50 | 75 | 50 | 50 | 50 | 25 | 25 | ||
| Aarons et al. 2009 [34] | Becker et al. 2016 [35] | Beenstock et al. 2012 [36] | Beets et al. 2008 [37] | Bonetti et al. 2009 [38] | Chou et al. 2011 [39] | Cummings et al. 2017 [40] | David and Schiff 2017 [41] | Edmunds et al. 2014 [42] | Gnich et al. 2018 [43] | Guerrero et al. 2018 [44] | Huis et al. 2013 [45] | Little et al. 2015 [46] | Llasus et al. 2014 [47] | Nelson and Steele 2007 [48] | Potthoff et al. 2017 [49] | Presseau et al. 2016 [50] | Simmonds et al. 2012 [51] | Stockdale et al. 2018 [52] | Wanless et al. 2015 [53] | |
| 3. Quantitative - non-randomized | ||||||||||||||||||||
| Recruitment minimizes selection bias? | Y | N | N | Y | Y | Y | N | N | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | Y |
| Measurements appropriate? | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| Comparable groups or control for differences? | Y | Y | Y | N | N | Y | N | Y | Y | Y | Y | N | Y | Y | Y | N | Y | Y | Y | Y |
| Complete outcome data, acceptable response rate, or acceptable follow-up rate? | N | N | N | N | N | N | N | Y | N | N | N | Y | Y | N | N | N | N | Y | N | N |
| Total score (%) | 75 | 50 | 50 | 50 | 50 | 75 | 25 | 75 | 75 | 75 | 75 | 75 | 100 | 50 | 75 | 50 | 75 | 100 | 75 | 75 |
| Armson et al. 2018 [54] | Birken et al. 2015 [55] | Kauth et al. 2010 [56] | Lukas et al. 2009 [57] | Panzano et al. 2012 [58] | Rangachari et al. 2015 [59] | Shrubsole et al. 2018 [60] | ||||||||||||||
| 1. Qualitative | ||||||||||||||||||||
| Data sources relevant? | Y | Y | Y | Y | Y | Y | Y | |||||||||||||
| Data analysis process relevant? | Y | Y | Y | N | N | Y | Y | |||||||||||||
| Findings relate to context? | Y | Y | Y | Y | Y | Y | Y | |||||||||||||
| Findings relate to researchers' influence? | N | N | N | N | N | N | N | |||||||||||||
| 2. Quantitative randomized | ||||||||||||||||||||
| Clear description of the randomization? | N/A | N/A | N | N/A | N/A | N/A | Y | |||||||||||||
| Clear description of allocation or concealment? | N/A | N/A | N | N/A | N/A | N/A | Y | |||||||||||||
| Complete outcome data? | N/A | N/A | Y | N/A | N/A | N/A | Y | |||||||||||||
| Low withdrawal/drop-out? | N/A | N/A | Y | N/A | N/A | N/A | N | |||||||||||||
| 3. Quantitative non-randomized | ||||||||||||||||||||
| Recruitment minimizes selection bias? | Y | Y | N/A | Y | N | Y | N/A | |||||||||||||
| Measurements appropriate? | Y | Y | N/A | Y | Y | Y | N/A | |||||||||||||
| Comparable groups or control for differences? | N | N | N/A | N | N | N | N/A | |||||||||||||
| Complete outcome data, acceptable response rate, or acceptable follow-up rate? | Y | N | N/A | N | Y | Y | N/A | |||||||||||||
| 4. Mixed methods | ||||||||||||||||||||
| Research design relevant? | Y | Y | Y | N | N | Y | Y | |||||||||||||
| Integration of qualitative and quantitative data relevant? | Y | Y | Y | Y | Y | Y | Y | |||||||||||||
| Appropriate consideration given to limitations associated with integration? | Y | Y | N | N | N | N | N | |||||||||||||
| Total score (%) | 75 | 50 | 50 | 25 | 25 | 75 | 75 | |||||||||||||