Skip to main content
. 2022 Jan;73:101539. doi: 10.1016/j.arr.2021.101539

Table 2.

Quality assessment using the NIH Quality Assessment Tool for cross-sectional and observational cohort studies.

Study Quality assessment question
Quality rating Risk of bias
1 2 3 4 5 6 7 8 9 10 11 12 13 14
(Sharma et al., 1999) Y Y CD NR NA NA NA Y Y N Y NA CD N 5 / 10 Some
(Zulli et al., 2005) Y Y CD NR NA NA NA Y Y N Y NA CD N 5 / 10 Some
(Lukhanina et al., 2008) Y Y CD NR NA NA NA Y Y N N NA CD N 4 / 10 High
(de Vilhena Toledo and Junqueira, 2010) Y Y CD NR NA NA NA Y Y N Y NA CD N 5 /10 Some
(Niwa et al., 2011) Y Y Y Y NA NA NA Y Y N Y NA Y N 8 /10 Low
(Bidikar et al., 2014) Y Y CD NR NA NA NA Y Y N N NA Y N 5 / 10 Some
(Maetzler et al., 2015) Y Y CD NR NA NA NA Y Y N Y NA CD N 5 / 10 Some
(Lin et al., 2016) Y N CD NR N NA NA Y Y Y Y NA CD Y 6 / 11 Some
(Guo et al., 2016) Y Y CD NR N NA NA Y Y N Y NA Y Y 7 /11 Some
(Nonogaki et al., 2017) Y Y CD NR NA NA NA Y Y N Y NA CD Y 6 / 10 Some
(Lin et al., 2017a) Y Y CD NR N NA NA Y Y N Y NA Y N 6 / 11 Some
(Lin et al., 2017b) Y Y CD NR N NA NA Y Y N Y NA CD Y 6 / 11 Some
(Kim et al., 2018) Y Y Y Y NA NA NA Y Y N Y NA NA Y 8 / 9 Low
(Combs et al., 2018) Y Y CD NR NA NA NA Y Y N Y NA CD N 5 / 10 Some
(McDermott et al., 2019) Y Y CD NR N NA NA Y Y N Y N CD N 5 / 12 High
(Sander et al., 2019) Y Y CD NR N NA NA Y Y N Y NA Y N 6 / 11 Some
(Nicolini et al., 2020) Y Y Y Y NA NA NA Y Y N Y NA Y Y 9 / 10 Low
(Del Pino et al., 2020) Y Y CD NR NA NA NA Y Y N Y NA CD Y 6 / 10 Some
(Lin et al., 2020) Y Y CD NR Y Y Y Y Y Y Y Y CD Y 11 / 14 Low
(Quinci, M.A., Astell, A.J., 2021) Y N CD NR NA NA NA Y Y N Y NA CD N 4 / 10 High

Abbreviations: Y = Yes, N = No, NA= not applicable, NR = not reported, CD = cannot determine. Questions were:

  • 1)
    Was the research question or objective in this paper clearly stated?
  • 2)
    Was the study population clearly specified and defined?
  • 3)
    Was the participation rate of eligible persons at least 50%?
  • 4)
    Were all the subjects selected or recruited from the same or similar populations (including the same time period)? Were inclusion and exclusion criteria for being in the study prespecified and applied uniformly to all participants?
  • 5)
    Was a sample size justification, power description, or variance and effect estimates provided?
  • 6)
    For the analyses in this paper, were the exposure(s) of interest measured prior to the outcome(s) being measured?
  • 7)
    Was the timeframe sufficient so that one could reasonably expect to see an association between exposure and outcome if it existed?
  • 8)
    For exposures that can vary in amount or level, did the study examine different levels of the exposure as related to the outcome (e.g., categories of exposure, or exposure measured as continuous variable)?
  • 9)
    Were the exposure measures (independent variables) clearly defined, valid, reliable, and implemented consistently across all study participants?
  • 10)
    Was the exposure(s) assessed more than once over time?
  • 11)
    Were the outcome measures (dependent variables) clearly defined, valid, reliable, and implemented consistently across all study participants?
  • 12)
    Were the outcome assessors blinded to the exposure status of participants?
  • 13)
    Was loss to follow-up after baseline 20% or less?
  • 14)
    Were key potential confounding variables measured and adjusted statistically for their impact on the relationship between exposure(s) and outcome(s)?