Table 3.

Quality assessment of included studies in the algorithm meta-analysis¹³

Study	Patient selection:	Patient selection:	Patient selection:	Patient selection:	Index test:	Index test:	Index test:	Index test:
	Consecutive or random sample	Avoid case-control/avoid artificially inflated base rate	Avoided inappropriate exclusions	Overall risk of bias	PHQ-9 interpreted blind to reference test	If translated, appropriate translation	If translated, psychometric properties reported	Overall risk of bias
Allegiant studies
Diez-Quevedo et al22	✗	✓	✗	High	?	✓	✓	Unclear
Gräfe et al23	✓	✓	✓	Low	?	✓	✓	Unclear
Lowe et al24	✗	✓	✓	High	✓	✓	✓	Low
Muramatsu et al27	?	✓	?	Unclear	✓	✓	?	Unclear
Navines et al28	✓	✓	✓	Low	✓	✓	?	Unclear
Spitzer et al25	✗	✓	✓	High	✓	N/A	N/A	Low
Thekkumpurath et al26	✗	✗	✓	High	✓	N/A	N/A	Low
Non-allegiant studies
Arroll et al42	✓	✓	✓	Low	✓	N/A	N/A	Low
Ayalon et al43	?	✓	✓	Unclear	?	✓	?	Unclear
Eack et al29	?	✓	?	Unclear	?	N/A	N/A	Unclear
Fann et al30	✓	✗	✗	High	✓	N/A	N/A	Low
Gelaye et al31	?	✗	?	High	✓	✓	?	Unclear
Gjerdingen et al48	✓	✓	✓	Low	?	N/A	N/A	Unclear
Henkel et al44	✓	✓	✓	Low	?	N/A	N/A	Unclear
Hyphantis et al32	✓	✓	✗	High	✓	?	?	Unclear
Inagaki et al33	✓	✗	✓	High	✓	?	?	Unclear
Khamseh et al34	✓	✓	?	Unclear	✓	✓	?	Unclear
Lamers et al45	✓	✗	✗	High	✓	?	?	Unclear
Lotrakul et al46	✗	✓	?	High	✓	✓	?	Unclear
Persoons et al35	✓	✓	✓	Low	✓	✓	N/A	Low
Picardi et al36	✓	✓	✓	Low	✓	?	?	Unclear
Stafford et al37	✓	✓	✓	Low	✓	N/A	N/A	Low
Thombs et al38	✗	✓	?	Unclear	?	N/A	N/A	Unclear
Thomspon et al39	?	✓	✓	Unclear	?	N/A	N/A	Unclear
Turner et al40	✓	✓	✓	Low	✓	N/A	N/A	Low
van Steenbergen-Wijenburg et al41	?	✓	✓	Unclear	?	?	?	Unclear
Zuithoff et al47	✓	✓	✓	Low	✓	✓	?	Unclear

Study	Reference test:	Reference test:	Reference test:	Reference test:	Reference test:	Flow/timing:	Flow/timing:	Flow/timing:	Flow/timing:
	Reference test correctly classifies target condition	Reference test interpreted blind to PHQ-9	If translated, appropriate translation	If translated, psychometric properties reported	Overall risk of bias	Interval of 2 weeks or less	All participants receive same reference test	All participants included in analysis?	Overall risk of bias
Allegiant studies
Diez-Quevedo et al22	✓	✓	✓	?	Unclear	✓	✓	✓	Low
Gräfe et al23	✓	?	N/A	N/A	Unclear	✓	✓	✓	Low
Lowe et al24	✓	✓	N/A	N/A	Low	✓	✓	✓	Low
Muramatsu et al27	✓	✓	✓	✓	Low	✓	✓	?	Unclear
Navines et al28	✓	✓	?	?	Unclear	✓	✓	✓	Low
Spitzer et al25	✓	✓	N/A	N/A	Low	✓	✓	✗	High
Thekkumpurath et al26	✓	✓	N/A	N/A	Low	?	✓	✗	High
Non-allegiant studies
Arroll et al42	✓	✓	N/A	N/A	Low	✓	✓	✓	Low
Ayalon et al43	✓	?	✓	?	Unclear	?	✓	✓	Unclear
Eack et al29	✓	?	N/A	N/A	Unclear	?	✓	?	Unclear
Fann et al30	✓	?	N/A	N/A	Unclear	✓	✓	✗	High
Gelaye et al31	✓	✓	✓	✓	Low	✓	✓	✗	High
Gjerdingen et al48	✓	?	N/A	N/A	Unclear	✓	✓	✗	High
Henkel et al44	✓	?	N/A	N/A	Unclear	✓	✓	✗	High
Hyphantis et al32	✓	✓	?	?	Unclear	✓	✓	✗	High
Inagaki et al33	✓	✓	✓	?	Unclear	✓	✓	✗	High
Khamseh et al34	✓	✓	✓	?	Unclear	✓	✓	?	Unclear
Lamers et al45	✓	✓	?	?	Unclear	?	✓	✗	High
Lotrakul et al46	✓	✓	✓	✓	Low	?	✓	✗	High
Persoons et al35	✓	✓	?	?	Unclear	✓	✓	✓	Low
Picardi et al36	✓	✓	✓	?	Unclear	✓	✓	✗	High
Stafford et al37	✓	✓	N/A	N/A	Low	✓	✓	✗	High
Thombs et al38	?	✓	N/A	N/A	Unclear	✓	✓	✓	Low
Thompson et al39	✓	?	N/A	N/A	Unclear	✓	✓	✗	High
Turner et al40	✓	?	N/A	N/A	Unclear	?	✓	✗	High
van Steenbergen-Wijenburg et al41	✓	✗	?	?	High	✓	✓	✗	High
Zuithoff et al47	✓	✓	?	?	Unclear	?	✓	✓	Unclear

✓, criterion met; ✗, criterion not met; ?, insufficient information to code whether criterion met; N/A, not applicable; PHQ-9, Patient Health Questionnaire-9.