Table 3.
Principle | 2007 process | 2020 process |
---|---|---|
Appropriateness | Goals sufficiently clarified | Goals sufficiently clarified |
Relevant decision criteria not stated at outseta | Relevant decision criteria stated at outset | |
A variety of considerations prioritized | A variety of considerations prioritized | |
Little indication of critical questioning of evidence sources in terms of their relevance and usea | Critical questioning of evidence sources in terms of their relevance and use | |
Application of methods akin to those of multicriteria decision analysis | Application of methods akin to those of multicriteria decision analysis | |
Little indication of differentiation between internal and external validity of evidencea | Differentiation between internal and external validity of evidence | |
No required assessment of local applicability prior to utilizationa | Local applicability assessed prior to utilization | |
Quality | Unclear how quality criteria were applieda | Application of strict quality criteria that were appropriate to the research question and in accordance with methods akin to GRADE |
Food intake pattern relied on data modeling | Evidence of impacts ordered according to evidential hierarchies | |
No statement and strategy for dealing with and assessing the quality of industry-funded researcha | A clear statement indicating that industry-funded research was explicitly excluded from the evidence base | |
Rigor | Unclear whether or what practices were used for systematic review, rapid review, realist review, or other synthesis methodsa | Process followed good practices for systematic review and other synthesis methods |
Criteria for evidence selection and inclusion uncleara | Selection and inclusion criteria clearly described | |
Methods for formulating recommendations uncleara | Methods for formulating recommendations clearly described | |
Stewardship | The role of democratically elected agents or their representatives in the design or alteration of government evidence advisory bodies uncleara | The role of democratically elected agents or their representatives in the design or alteration of government evidence advisory bodies uncleara |
Unclear whether and how agents were accountable to the publica | Unclear whether and how agents were accountable to the publica | |
Unclear how conflicts of interest were handled or mitigateda | Process explicitly banned conflicts of interest | |
Lack of robust defenses against imposition of institutional structures by nonmandated or unaccountable agentsa | Process included robust defenses against imposition of institutional structures by nonmandated or unaccountable agents | |
Representation | Unclear if decision authority was with public representativesa | Unclear if decision authority was with public representativesa |
Unclear whether legislatures and representatives had ability to veto or override technical agencies when necessarya | Unclear whether legislatures and representatives had ability to veto or override technical agencies when necessarya | |
Transparency | No links to the journal articles that overview the review process and intake patterna | Information easily accessible |
One journal article was behind a paywalla | Information free to access | |
Unable to locate publication of transcripts or minutes of expert body deliberationsa | Unable to locate publication of transcripts or minutes of expert body deliberationsa | |
Deliberation | Process sought passive public input on an ad hoc basis | Process sought passive public input through formalized deliberative mechanisms |
No active public engagementa | No active public engagementa | |
Contestability | Review process not subject to peer reviewa | Review process subject to peer review |
Expert conclusions subject to peer review | Expert conclusions subject to peer review | |
No established formal appeals procedures or rules for decisions of evidence-synthesizing bodiesa | No established formal appeals procedures or rules for decisions of evidence-synthesizing bodiesa | |
No inclusion or publication of dissenting opinions or alternative viewpointsa | Dissenting opinions and alternative viewpoints gathered during process available |
Indicators that were absent in the documents analyzed are noted with an ‘a’.