Table 1.

Methodological Quality of Selected Studies

	Criteria	Hepsen S16	Fatourechi V18	Duan L9	Mizukoshi T13	Sato J12	Zhao N15	Arao T14	Sencar ME17	Li F19	Kubota S11	Saklamaz A20	Benbassat CA21	Forkert IO10	Martinez DS23	Bahadir ÇT22	Quality of Study Score
1	If human subjects were used, did the author give a detailed description of the sample of subjects used to perform the index test?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
2	Did the authors clarify the qualification, or competence of the raters who performed the index test?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
3	Was the reference standard explained?	Yes	Yes	Yes	Yes	No	No	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
4	If inter rater ability was tested, were raters blinded to the findings of other raters?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
5	If intra rater reliability was tested, were raters blinded to their own prior findings of the test under evaluation?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
6	Was the order of examination varied?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
7	If human subjects were used, was the time period between the reference standard and the index test short enough to be reasonably sure that the target condition did not change between the two tests?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
8	Was the stability (or theoretical stability) of the variable being measured taken into account when determining the suitability of the time interval between repeated measures?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
9	Was the reference standard independent of the index test?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
10	Was the execution of the (index) test described in sufficient detail to permit replication of the test?	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
11	Was the execution of the reference standard described in sufficient detail to permit its replication?	Yes	No	Yes	Yes	No	No	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
12	Were withdrawals from the study explained?	NA	No	Yes	No	No	Yes	No	No	No	Yes	Yes	Yes	Yes	Yes	Yes	Moderate
13	Were the statistical methods appropriate for the purpose of the study?	NA	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Moderate