Table 4.
Evaluation of the methodological quality of the studies considered to assess the risk of bias (based on Schulz et al., 2010; Pluye et al., 2011).
| Author(s) | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | Sum | % | Score |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Barkoukis et al. (2016) | Y | Y | Y | Y | N | Y | Y | Y | P | N | N | 7.5 | 68 | *** |
| Codella et al. (2019) | Y | Y | P | N | N | N | N | N | Y | N | Y | 4.5 | 41 | ** |
| Duncan and Hallward (2019) | Y | Y | Y | P | N | Y | Y | Y | P | Y | Y | 9 | 82 | **** |
| Elbe and Brand (2016) | Y | Y | Y | P | N | Y | Y | Y | P | P | Y | 8.5 | 77 | **** |
| Elliot et al. (2008) | P | Y | Y | P | N | N | Y | Y | P | N | N | 5.5 | 50 | ** |
| Elliot et al. (2006) → (see Elliot et al., 2004) | ||||||||||||||
| Elliot et al. (2004) | N | Y | Y | P | N | Y | Y | Y | N | N | N | 5.5 | 50 | ** |
| Goldberg et al. (2000) → (see Goldberg et al., 1996a) | ||||||||||||||
| Goldberg et al. (1996a) | Y | P | Y | P | N | Y | P | Y | P | P | N | 6.5 | 59 | *** |
| Goldberg et al. (1996b) | Y | Y | Y | P | N | N | P | P | P | N | N | 5 | 45 | ** |
| Goldberg et al. (1991) | N | Y | P | N | N | N | P | Y | P | N | N | 3.5 | 32 | ** |
| Goldberg et al. (1990) | N | Y | Y | P | N | N | Y | Y | P | N | N | 5 | 45 | ** |
| Halliburton and Fritz (2018) | P | Y | N | P | N | N | P | Y | Y | Y | Y | 6.5 | 59 | *** |
| Horcajo et al. (2019) | Y | Y | Y | Y | Y | N | Y | Y | Y | Y | Y | 10 | 90 | **** |
| Horcajo and de la Vega (2014) | Y | Y | Y | Y | N | Y | P | Y | Y | P | N | 8 | 73 | *** |
| Hurst et al. (2020) | Y | P | Y | Y | N | P | Y | N | P | N | Y | 6 | 54 | *** |
| Jalilian et al. (2011) | Y | P | P | Y | N | N | P | Y | N | N | Y | 5.5 | 50 | ** |
| Laure et al. (2009) | Y | Y | Y | P | N | N | Y | Y | Y | P | N | 7 | 63 | *** |
| Lucidi et al. (2017) | Y | Y | Y | N | N | Y | Y | N | Y | P | Y | 7 | 63 | *** |
| MacKinnon et al. (2001) | Y | Y | P | Y | N | Y | P | Y | Y | P | N | 7.5 | 68 | *** |
| Mallia et al. (2020) | Y | Y | Y | Y | N | P | N | N | Y | P | Y | 7 | 63 | *** |
| Medina et al. (2019) | P | Y | Y | N | N | N | P | N | P | N | N | 3 | 27 | ** |
| Nicholls et al. (2020) | Y | Y | Y | Y | N | P | Y | Y | Y | N | Y | 8.5 | 77 | **** |
| Nilsson et al. (2004) | Y | Y | P | P | N | N | Y | N | N | N | N | 4 | 36 | ** |
| Ntoumanis et al. (2020) | Y | Y | Y | Y | Y | N | Y | Y | Y | N | Y | 9 | 81 | **** |
| Ranby et al. (2009) | Y | Y | Y | P | N | Y | Y | Y | Y | P | Y | 8 | 73 | *** |
| Sagoe et al. (2016) | Y | Y | P | Y | N | N | Y | Y | P | N | N | 6 | 54 | *** |
| Wicki et al. (2018) | Y | Y | N | P | N | N | P | N | Y | N | N | 4 | 36 | ** |
| Wippert and Fließer (2016) | P | Y | N | N | P | N | P | N | N | N | Y | 3.5 | 32 | ** |
| Yager et al. (2019) | Y | Y | Y | Y | N | N | P | Y | P | Y | N | 6.5 | 59 | *** |
1: [Introduction] Scientific background and explanation of rationale. Y, precise scientific background; P, brief overview; N, not specified.
2: [Introduction] Specification of a research question, specific objectives and/or hypotheses. Y, yes; P, implied; N, not specified.
3: [Methods] Information concerning the intervention (especially regarding: content, implementation, transparency/sufficient details for replication. Y, yes; P, implied; N, not specified.
4: [Methods] Completely defined pre-specified primary and secondary outcome measures, including how and when they were assessed; fit of collected data and research question. Y, measures specified beforehand, validated and reliable (Cronbach's alpha > 0.80); P, measure specified beforehand, but weaknesses concerning measures applied (e.g., single-item, Cronbach's alpha <0.80); N, measures not specified appropriately, regardless of the quality of the measure used.
5: [Methods] Determination of the sample size before conducting the study. Y, yes; N, not specified.
6: [Methods] Minimization of a selection bias in the recruitment of participants. Y, indication of why the selected sample is considered representative; P, sample representative with limitations; N, not reported or disregarded.
7: [Methods] Representativeness of the participants with regard to study goal. Y, yes; P, partly; N, no;.
8: [Methods] Information about sample composition, e.g., randomization. Y, yes; N, no.
9: [Results] Statistical methods used to compare groups for primary and secondary outcomes, completeness of information (e.g., checking for distribution violation before using metric procedures). Y, yes; P, partly; N, no.
10 [Results/Discussion] Significance of results/limits, e.g., low drop-out below 20%. Y, yes; P, partly; N, no or lack of report.
11 [Acknowledgments] Conflict of interest. Y, no conflict of interest/criterion met, N, conflict of interest (incl. reviewed conflict of interest) or not specified/criterion not met.
Score:
(lowest quality),
(highest quality).