Skip to main content
. 2017 Sep 29;7(9):e015247. doi: 10.1136/bmjopen-2016-015247

Table 4.

Quality assessment of included studies in the summed item scoring method cut-off point 10 meta-analysis14

Study Patient selection: Patient selection: Patient selection: Patient selection: Index test: Index test: Index test: Index test: Index test:
Consecutive or random sample Avoid case-control/avoid artificially inflated base rate Avoided inappropriate exclusions Overall risk of bias PHQ-9 interpreted blind to reference test Was a threshold prespecified? If translated, appropriate translation If translated, psychometric properties reported Overall risk of bias
Allegiant studies
13. Gräfe et al23 ✓ ✓ ✓ Low ? ✓ ✓ ✓ Unclear
16. Kroenke et al12 ✓ ✓ ✓ Low ✓ ✓ N/A N/A Low
22. Navinés et al28 ✓ ✓ ✓ Low ✓ ✓ ✓ ? Unclear
29. Thekkumpurath et al26 × × ✓ High ✓ ✓ N/A N/A Low
33. Williams et al49 ✓ ✓ ✓ Low ? ✓ N/A N/A Unclear
Non-allegiant studies
1. Adewuya et al55 ✓ ✓ × Unclear ✓ ✓ N/A N/A Low
2. Arroll et al42 ✓ ✓ ✓ Low ✓ ✓ N/A N/A Low
3. Azah et al62 ✓ × ? High ✓ ✓ ✓ ✓ Low
4. Chagas et al50 ✓ ✓ ✓ Low ✓ ✓ ✓ ✓ Low
6. de Lima Osorio et al60 ✓ × ✓ High ? × N/A N/A High
7. Elderon et al51 ✓ ✓ ✓ Low ✓ ✓ N/A N/A Low
8. Fann et al30 ✓ × × High ✓ ✓ N/A N/A Low
9. Fine et al56 ✓ ✓ ✓ Low ? ✓ N/A N/A Unclear
10. Gelaye et al31 ? × ? High ✓ × ✓ ? High
11. Gilbody et al57 ? ✓ ? Unclear ✓ ✓ N/A N/A Low
12. Gjerdingen et al48 ✓ ✓ ✓ Low ? ✓ N/A N/A Unclear
14. Hyphantis et al32 ✓ × ✓ High ✓ ✓ ? ? Unclear
15. Khamseh et al34 ✓ ✓ ? Unclear ✓ ✓ ✓ ? Unclear
19. Liu et al63 ✓ ✓ ? Unclear ✓ × ✓ ? High
20. Lotrakul et al46 × ✓ ? Unclear ✓ ✓ ✓ ? Unclear
23. Patel et al61 ✓ ✓ ✓ Low ✓ ✓ ? ? Unclear
24. Phelan et al58 × ✓ ✓ High ✓ × N/A N/A High
25. Rooney et al52 ✓ ✓ ✓ Low ? × N/A N/A High
26. Sherina et al ✓ ✓ × High ✓ ✓ ✓ ✓ Low
27. Sidebottom et al59 ✓ ✓ ✓ Low ✓ ✓ N/A N/A Low
28. Stafford et al37 ✓ ✓ ✓ Low ✓ ✓ N/A N/A Low
30. Thombs et al38 × ✓ ? High ✓ ? N/A N/A Unclear
32. Watnick et al53 ? × ✓ High ✓ ✓ N/A N/A Low
34. Wittkampf et al64 ✓ ✓ ✓ Low ✓ ? N/A N/A Unclear
35. Zhang et al54 ✓ ✓ ? Unclear ? ✓ ? ? Unclear
36. Zuithoff et al47 ✓ ✓ ✓ Low ✓ ✓ ✓ ? Unclear
Study Reference test: Reference test: Reference test: Reference test: Reference test: Flow / timing: Flow / timing: Flow / timing: Flow / timing:
Reference test correctly classifies target condition Reference test interpreted blind to PHQ-9 If translated, appropriate translation If translated, psychometric properties reported Overall risk of bias Interval of 2 weeks or less All participants receive same reference test All participants included in analysis? Overall risk of bias
Allegiant studies
13. Gräfe et al23 ✓ ? N/A N/A Unclear ✓ ✓ ✓ Low
16. Kroenke et al12 ✓ ✓ N/A N/A Low ✓ ✓ ✓ Low
22. Navinés et al28 ✓ ✓ ? ? Unclear ✓ ✓ ✓ Low
29. Thekkumpurath et al26 ✓ ✓ N/A N/A Low ? ✓ ✓ Unclear
33. Williams et al49 ✓ ? N/A N/A Unclear ? ✓ ✓ Unclear
Non-allegiant studies
1. Adewuya et al55 ✓ ✓ N/A N/A Low ✓ ✓ ✓ Low
2. Arroll et al42 ✓ ✓ N/A N/A Low ? ✓ ✓ Unclear
3. Azah et al62 ✓ ✓ ✓ ✓ Low ✓ ✓ × High
4. Chagas et al50 ✓ ✓ ? ? Unclear ✓ ✓ × High
6. de Lima Osorio et al60 ✓ ? N/A N/A Unclear ? ✓ ✓ Unclear
7. Elderon et al51 ✓ ✓ N/A N/A Low ✓ ✓ ✓ Low
8. Fann et al30 ✓ ? N/A N/A Unclear ✓ ✓ × High
9. Fine et al56 ✓ ? N/A N/A Unclear ? ✓ ✓ Unclear
10. Gelaye et al31 ✓ ✓ ✓ ✓ Low ✓ ✓ × High
11. Gilbody et al57 ✓ ✓ N/A N/A Low ? ✓ ✓ Unclear
12. Gjerdingen et al48 ✓ ? N/A N/A Unclear ✓ ✓ × High
14. Hyphantis et al32 ✓ ✓ ? ? Unclear ✓ ✓ × High
15. Khamseh et al34 ✓ ✓ ✓ ? Unclear ✓ ✓ ? Unclear
19. Liu et al63 ✓ ✓ ✓ ✓ Low ✓ ✓ ? Unclear
20. Lotrakul et al46 ✓ ✓ ✓ ✓ Low ? ✓ × High
23. Patel et al61 ✓ ✓ ✓ ? Unclear ? ✓ × High
24. Phelan et al58 ✓ ✓ N/A N/A Low ✓ ✓ ✓ Low
25. Rooney et al52 ✓ ? N/A N/A Unclear ? ✓ × High
26. Sherina et al ✓ ✓ ✓ ✓ Low ✓ ✓ ✓ Low
27. Sidebottom et al59 ✓ ✓ N/A N/A Low ✓ ✓ × High
28. Stafford et al37 ✓ ✓ N/A N/A Low ✓ ✓ × High
30. Thombs et al38 ? ✓ N/A N/A Unclear ✓ ✓ ✓ Low
32. Watnick et al53 ✓ ✓ N/A N/A Low ✓ ✓ ✓ Low
34. Wittkampf et al64 ✓ ✓ N/A N/A Low ? ✓ × High
35. Zhang et al54 ✓ ? ✓ ✓ Unclear × ✓ × High
36. Zuithoff et al47 ✓ ✓ ? ? Unclear ? ✓ ✓ Unclear

N/A, not applicable; PHQ-9, Patient Health Questionnaire-9.✓,criterion met; ✗, criterion not met; ?, insufficient information to code whether criterion met.