Table 5.
Grading the quality of evidence for the individual components of the chain of evidence (key questions)57
Adequacy of information to answer key questions | Analytic validity | Clinical validity | Clinical utility |
---|---|---|---|
Convincing | Studies that provide confident estimates of analytic sensitivity and specificity using intended sample types from representative populations | Well-designed and conducted studies in representative population(s) that measure the strength of association between a genotype or biomarker and a specific and well-defined disease or phenotype | Well-designed and conducted studies in representative population(s) that assess specified health outcomes |
Two or more Level 1 or 2 studies that are generalizable, have a sufficient number and distribution of challenges, and report consistent results | Systematic review/meta-analysis of Level 1 studies with homogeneity | Systematic review/meta-analysis of randomized controlled trials showing consistency in results | |
At least one large randomized controlled trial (Level 2) | |||
One Level 1 or 2 study that is generalizable and has an appropriate number and distribution of challenges | Validated Clinical Decision Rule | ||
High quality Level 1 cohort study | |||
Adequate | Two or more Level 1 or 2 studies that | Systematic review of lower quality studies | Systematic review with heterogeneity |
Lack the appropriate number and/or distribution of challenges | Review of Level 1 or 2 studies with heterogeneity | One or more controlled trials without randomization (Level 3) | |
Are consistent, but not generalizable | Case/control study with good reference standards | Systematic review of Level 3 cohort studies with consistent results | |
Modeling showing that lower quality (Level 3, 4) studies may be acceptable for a specific well- defined clinical scenario | Unvalidated Clinical Decision Rule (Level 2) | ||
Inadequate | Combinations of higher quality studies that show important unexplained inconsistencies | Single case-control study | Systematic review of Level 3 quality studies or studies with heterogeneity |
Nonconsecutive cases | |||
One or more lower quality studies (Level 3 or 4) | Lacks consistently applied reference standards | Single Level 3 cohort or case-control study | |
Expert opinion | Single Level 2 or 3 cohort/case-control study | Level 4 data | |
Reference standard defined by the test or not used systematically | |||
Study not blinded | |||
Level 4 data |