Skip to main content
. Author manuscript; available in PMC: 2021 Sep 1.
Published in final edited form as: Integr Environ Assess Manag. 2020 Apr 28;16(5):718–728. doi: 10.1002/ieam.4271

Table 1.

Comparison of attributes of Classic Systematic Review, Classic Weight of Evidence, and an integrated approach.

Attribute Classic SR Classic WoE Integrated SR & WoE
Emphasis Transparent and unbiased assembly of information Hypothesis best supported by available information Scientific rigor while accommodating many situations
Generality of results General applicability (e.g., the chemical is a carcinogen) General or case-specific (e.g., the chemical caused this cancer cluster) General or case specific
Institutions Institutions specify methods and compile results (e.g., Cochrane) None; users define methods Some government agencies recommend for specific applications
Consistency Consistent methods within fields Diverse methods even within fields Consistent framework with diverse options
Sources of information Published experiments from literature Literature, purposive studies and models, data bases, etc. Any type of information
Types of evidence One per assessment or, if more than one, assessed separately Usually more than one Usually more, because most questions cannot be answered with only one type
Implications of evidence One type of study with one implication Multiple types of evidence have different implications for hypotheses Usually multiple types of inferences
Meta-analysis Standard inferential method Seldom used Encouraged when appropriate
Causation Not an issue because the experiments that answer the question are inherently causal Causal inference from heterogeneous evidence that seldom experimentally answers the assessment question Recommends distinct assessment to establish causation and then use the causal relationship to make predictions.
Role of rating Used to express risk of bias or other qualities, but not for inference Implied by the concept of weighting but seldom employed Recommended for transparency of weighting evidence and drawing inferences
Role of expertise Expertise needed but latitude minimized by detailed methods and statistical inference Expert knowledge and judgment are essential and explicit Expert knowledge and judgment are essential and explicit
Tools Software tools for literature searching, screening search results, and extracting information No known software tools for automating steps in environmental assessments Software tools for literature search, screening and extraction.