1. Did the study address a clearly focused question/issue? |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
2. Is the research method (study design) appropriate for answering the research question? |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
3. Is the method of selection of the subjects (employees, teams, divisions, organizations) clearly described? |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
4. Could the way the sample was obtained introduce (selection) bias? |
No |
No |
No |
No |
No |
No |
No |
No |
Yes |
Yes |
No |
No |
No |
Yes |
No |
No |
No |
5. Was the sample of subjects representative with regard to the population to which the findings will be referred? |
Yes |
Yes |
Yes |
No |
Yes |
Yes |
Yes |
Yes |
Yes |
Cannot tell |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
No |
6. Was the sample size based on pre‐study considerations of statistical power? |
No |
No |
Yes |
Yes |
No |
Yes |
No |
No |
Yes |
No |
No |
No |
Yes |
No |
No |
Yes |
No |
7. Was a satisfactory response rate achieved? |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
No |
Yes |
Yes |
Yes |
No |
Yes |
Yes |
Yes |
Yes |
No |
8. Are the measurements (questionnaire) likely to be valid and reliable? |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
9. Was the statistical significance assessed? |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
10. Are confidence intervals given for the main results? |
No |
No |
No |
Yes |
No |
No |
Yes |
No |
Yes |
No |
No |
Yes |
No |
Yes |
No |
No |
Yes |
11. Could there be confounding factors that have not been accounted for? |
Cannot tell |
Cannot tell |
No |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
Cannot tell |
12. Can the results be applied to our organization? |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Yes |
Criteria met in the appraisal of the quality |
9 |
9 |
11 |
10 |
9 |
10 |
10 |
8 |
10 |
7 |
9 |
9 |
10 |
9 |
9 |
10 |
8 |