Table 1. Methodological quality of included studies according to Bhandari et al (2003).

Study	Primary guidelines		Secondary guidelines		Results	Implications for patient care
	Did clinicians face diagnostic uncertainty?	Independent blind comparison with a reference standard	Did the results of the test influence the decision to perform the reference standard?	Were the methods described in sufficient detail to permit replication?	Are likelihood ratios of the test being evaluated or data necessary for their calculations provided?	Will the reproducibility of the test result and its interpretation be satisfactory in clinical setting?
Bianchi et al (2008)	No	Indeterminate	Yes	Yes	No	No
Borggrefe et al (2015)	No	Yes	No	Yes	Yes	No
Brunner et al (2015)	No	No	N/A	Yes	No	Yes
Cha and Shin (2017)	No	Yes	No	Yes	Yes	No
Dolce et al (2014)	No	Yes	No	Yes	Yes	Yes
Ganesh et al (2016)	No	Yes	Indeterminate	No	Yes	Yes
Giugale et al (2017)	No	Yes	No	No	Yes	Yes
Gurbuz et al (2017)	No	Yes	No	No	No	Yes
Haug et al (2013)	No	Yes	No	Yes	No	Yes
Hill et al (2015)	No	Yes	No	Yes	No	Yes
Joseph and Harvey (2011)	No	No	N/A	Yes	Yes	No
Kiyak (2018)	No	No	Indeterminate	Yes	Yes	Yes
Kumar et al (2001)	Yes	Yes	No	Yes	Yes	Yes
Lee et al (2013)	No	Yes	No	Yes	Yes	Yes
Marsland et al (2014)	No	No	N/A	Yes	No	No
Oc et al (2018)	Yes	Yes	No	Yes	No	Yes
Ozer and Toker (2011)	No	No	N/A	Yes	Yes	No
Ozer et al (2012)	No	Yes	No	Yes	No	Yes
Pace and Cresswell (2010)	Yes	Yes	No	No	Yes	Yes
Patel et al (2013)	No	Yes	No	No	No	No
Poole et al (2016)	No	Yes	No	Yes	No	Yes
Rausch et al (2015)	No	No	N/A	Yes	Yes	No
Riddick et al (2012)	No	Yes	No	No	No	Yes
Soong et al (2008)	No	Yes	No	No	Yes	Yes
Stoops et al (2017)	No	Yes	No	Yes	No	Yes
Sügün et al (2011)	Yes	No	N/A	Yes	Yes	Yes
Takemoto et al (2012)	No	Yes	No	Yes	No	Yes
Taylor et al (2017)	Yes	No	N/A	Yes	Yes	No
Thomas and Greenberg (2009)	No	Indeterminate	No	No	No	No
Tweet et al (2010)	No	Yes	No	No	Yes	Yes
Vaiss et al (2014)	No	No	No	Yes	Yes	No
Vernet et al (2017)	Indeterminate	Yes	No	No	No	No
Watchmaker et al (2016)	No	Yes	No	No	Yes	Yes
Williams et al (2016)	No	Yes	No	No	Yes	No

Note : Indeterminate: unable to determine based on data provided in article; N/A: not applicable, that is, no reference standard used.