Skip to main content
. 2022 Oct 27;24(10):e40877. doi: 10.2196/40877

Table 1.

Reliability of included reviews based on A Measurement Tool to Assess Systematic Review (AMSTAR 2) judgmentsa.

Review ID (reference) 1b 2c 3d 4e 5f 6g 7h 8i 9j 10k 11l 12m 13n 14o 15p 16q Overall quality
Allner et al [21] Yr PYs Nt PY Y Y N N N N NMACu NMAC N N NMAC Y Very Lowv
Brunetti al [22] Y N Y PY Y Y N N Y N Y N N N Y Y Very Lowv
Carbo et al [23] Y PY Y N Y Y N PY Y Y Y N N Y N Y Very Lowv
Cordes et al [24] Y N Y PY N N N PY Y N NMAC NMAC N N NMAC Y Very Lowv
Cruz et al [25] Y N Y PY Y Y N Y N N NMAC NMAC N N NMAC Y Loww
Elbaz et al [26] Y N Y PY Y N N PY N N NMAC NMAC N N NMAC Y Very Lowv
Farabi et al [27] Y N Y PY Y Y N PY Y N NMAC NMAC Y N NMAC Y Very Lowv
Gaveikaite et al [28] Y N Y PY Y Y N Y Y N NMAC NMAC N Y NMAC Y Very Lowv
Glinkowski et al [29] Y N Y PY Y Y N N N N NMAC NMAC N N NMAC Y Very Lowv
Hallensleben et al [30] Y N Y PY Y Y N Y N N NMAC NMAC N N NMAC Y Very Lowv
Hartasanchez et al [31] Y N Y PY Y Y N PY N N NMAC NMAC N N NMAC Y Very Lowv
Hrynyschyn et al [32] Y N Y PY Y Y N Y Y N NMAC NMAC Y N NMAC Y Very Lowv
Karamanidou et al [33] Y PY Y PY Y Y N PY N Y NMAC NMAC N Y NMAC Y Very Lowv
Kierkegaard et al [34] Y PY Y PY Y N N N N N NMAC NMAC N Y NMAC Y Very Lowv
Kingsdorf et al [35] Y PY Y PY Y Y N PY N N NMAC NMAC N Y NMAC Y Very Lowv
Labiris et al [36] Y N Y PY N N N PY N N NMAC NMAC N N NMAC Y Very Lowv
Maresca et al [37] Y PY Y N N N N PY N N NMAC NMAC N N NMAC N Very Lowv
Martin et al [38] Y PY Y N Y Y N Y N N NMAC NMAC N Y NMAC Y Very Lowv
McFarland et al [39] Y Y Y PY Y Y N Y PY N Y Y Y Y Y Y Loww
Mold et al [40] Y PY N PY Y Y Y Y N N NMAC NMAC N Y NMAC Y Very Lowv
Nielsen et al [41] Y PY Y PY N N N PY N N NMAC NMAC N Y NMAC Y Very Lowv
O’Cathail et al [42] Y PY Y PY Y Y N PY N N NMAC NMAC N Y NMAC Y Very Lowv
Ohannessian et al [43] Y N Y PY Y Y N PY N N NMAC NMAC N N NMAC Y Very Lowv
Pron et al [44] Y PY Y PY N N N PY PY N NMAC NMAC N Y NMAC Y Very Lowv
Raja et al [45] Y N Y PY Y Y N PY N N NMAC NMAC N N NMAC Y Very Lowv
Simmonds-Buckley et al [46] Y PY Y Y Y Y N Y PY N Y Y Y Y Y Y Loww
Singh et al [47] Y N Y PY N N N Y N N NMAC NMAC N N NMAC Y Very Lowv
Tokgoz et al [48] Y Y Y PY Y Y N PY Y Y NMAC NMAC Y Y NMAC Y Loww
Trettel et al [49] Y N N PY N N N N N N NMAC NMAC N N NMAC Y Very Lowv
Udsen et al [50] Y PY Y PY Y Y N Y N N NMAC NMAC N Y NMAC N Very Lowv
Verma et al [51] Y N Y PY Y Y Y N N Y NMAC NMAC N N NMAC Y Very Lowv
Willard et al [52] N PY N PY Y Y N N N N NMAC NMAC N N NMAC Y Very Lowv
Zanin et al [53] Y PY Y PY Y Y N PY PY N NMAC NMAC N Y NMAC Y Very Lowv

aJudgments were made by 2 overview authors based on AMSTAR 2, a critical appraisal tool for systematic reviews that include randomized or nonrandomized studies of health care interventions or both.

bDomain 1—Did the research questions and inclusion criteria for the review include the components of PICO (Patients, Intervention, Comparator, and Outcomes)

cDomain 2—Did the report of the review contain an explicit statement that the review methods were established before the conduct of the review and did the report justify any significant deviations from the protocol?

dDomain 3—Did the review authors explain their selection of the study designs for inclusion in the review?

eDomain 4—Did the review authors use a comprehensive literature search strategy?

fDomain 5—Did the review authors perform study selection in duplicate?

gDomain 6—Did the review authors perform data extraction in duplicate?

hDomain 7—Did the review authors provide a list of excluded studies and justify the exclusions?

iDomain 8—Did the review authors describe the included studies in adequate detail?

jDomain 9—Did the review authors use a satisfactory technique for assessing the risk of bias (RoB) in individual studies that were included in the review?

kDomain 10—Did the review authors report on the sources of funding for the studies included in the review?

lDomain 11—If meta-analysis was performed, did the review authors use appropriate methods for statistical combination of results?

mDomain 12—If meta-analysis was performed, did the review authors assess the potential impact of RoB in individual studies on the results of the meta-analysis or other evidence synthesis?

nDomain 13—Did the review authors account for RoB in individual studies when interpreting or discussing the results of the review?

oDomain 14—Did the review authors provide a satisfactory explanation for, and discussion of, any heterogeneity observed in the results of the review?

pDomain 15—If they performed quantitative synthesis, did the review authors carry out an adequate investigation of publication bias (small-study bias) and discuss its likely impact on the results of the review?

qDomain 16—Did the review authors report any potential sources of conflict of interest, including any funding they received for conducting the review?

rY: methodological requirements met.

sPY: methodological requirements partly met.

tN: methodological requirements not met.

uNMAC: no meta-analysis conducted.

vXX: studies rated as “critically low.”

wX: studies rated as “low.”