Table 3.
Risk of bias assessment for longitudinal studies
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | Overall | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Author (Year) | Was the research question or objective in this paper clearly stated? | Was the study population clearly specified and defined? | Was the participation rate of eligible persons at least 50%? | Were all the subjects selected or recruited from the same or similar populations (including the same time period)? Were inclusion and exclusion criteria for being in the study prespecified and applied uniformly to all participants? | Was a sample size justification, power description, or variance and effect estimates provided? | For the analyses in this paper, were the exposure(s) of interest measured prior to the outcome(s) being measured? | Was the timeframe sufficient so that one could reasonably expect to see an association between exposure and outcome if it existed? | For exposures that can vary in amount or level, did the study examine different levels of the exposure as related to the outcome (e.g., categories of exposure, or exposure measured as continuous variable)? | Were the exposure measures (independent variables) clearly defined, valid, reliable, and implemented consistently across all study participants? | Was the exposure(s) assessed more than once over time? | Were the outcome measures (dependent variables) clearly defined, valid, reliable, and implemented consistently across all study participants? | Were the outcome assessors blinded to the exposure status of participants? | Was loss to follow-up after baseline 20% or less? | Were key potential confounding variables measured and adjusted statistically for their impact on the relationship between exposure(s) and outcome(s)? | Overall assessment |
| Arango et al. (2018) [43] | Yes | Yes | NR | Yes | No | Yes | Yes | Yes | Yes | No | Yes | NR | No | No | Fair |
| Arora et al. (2017) [15] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | NR | No | Yes | Good |
| Benner et al. (2017) [44] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | NR | Yes | Good |
| Boen et al. (2020) [34] | Yes | No | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | NR | Yes | Yes | Good |
| Cristini et al. (2012) [52] | Yes | No | NR | NR | No | Yes | Yes | Yes | No | No | No | NR | Yes | No | Poor |
| Davis et al. (2019) [61] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | CD | Yes | Good |
| DeWit et al. (2011) [53] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | Yes | Yes | Good |
| Fulco et al. (2019) [16] | Yes | Yes | CD | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | CD | Yes | Good |
| Gonzales et al. (2014) [54] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | Yes | Yes | Good |
| Gunnarsódttir et al. (2021) [62] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | No | NR | Yes | No | Good |
| Hatchel et al. (2018) [55] | Yes | Yes | NR | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | NR | No | Fair |
| Jiang et al. (2020) [45] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | NR | NR | No | Fair |
| Joyce (2019) [35] | Yes | Yes | NR | Yes | No | Yes | Yes | Yes | No | No | Yes | NR | No | No | Fair |
| Klinck et al. (2020) [46] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | Yes | Yes | Good |
| Leonard et al. (2016a) [30] | Yes | Yes | NA | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | No | Yes | Good |
| Leonard et al. (2016b) [31] | Yes | Yes | NA | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | Yes | Yes | Good |
| Lester et al. (2013) [63] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | Yes | No | Good |
| Lester & Cross (2015) [56] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | Yes | No | Good |
| Li & Lerner (2011) [64] | Yes | No | NR | No | No | Yes | Yes | Yes | No | Yes | Yes | NR | No | Yes | Fair |
| Loukas et al. (20161) [57] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | No | No | Good |
| Markowitz (2016) [36] | Yes | Yes | NR | Yes | No | Yes | Yes | Yes | No | No | No | NR | No | Yes | Good |
| McNeil et al. (2020) [32] | Yes | Yes | NA | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | Yes | Yes | Good |
| Moffa et al. (2016) [47] | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No | No | No | NR | No | No | Fair |
| Okado et al. (2018) [58] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | No | Yes | NR | Yes | No | Good |
| Pierre et al. (2020) [48] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | NR | No | Good |
| Pössel et al. (2016) [66] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | No | Yes | Good |
| Sanders et al. (2020) [49] | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes | NR | Yes | No | Good |
| Shochet & Smith (2014) [59] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | Yes | No | Good |
| Shochet et al. (2011) [60] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | Yes | No | Good |
| Stiles & Gudiño (2018) [33] | Yes | Yes | NA | Yes | No | Yes | Yes | Yes | No | Yes | Yes | NR | NR | No | Fair |
| Tucker et al. (2011) [50] | Yes | Yes | NR | Yes | No | Yes | Yes | Yes | No | No | Yes | NR | No | Yes | Good |
| Wickrama & Vazsonyi (2011) [37] | Yes | No | NR | Yes | No | Yes | Yes | Yes | No | No | No | NR | No | No | Poor |
| Wright & Wachs (2019) [51] | Yes | Yes | Yes | Yes | No | Yes | Yes | Yes | No | No | Yes | NR | Yes | No | Good |
| Yu et al. (2016) [65] | Yes | Yes | NR | Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | NR | Yes | Yes | Good |
NR Not Reported, NA Not Applicable, CD Cannot Determine