Skip to main content
BMJ Open logoLink to BMJ Open
. 2024 Nov 9;14(11):e088418. doi: 10.1136/bmjopen-2024-088418

Exploring how to widen the acceptability of public health interventions: a systematic review protocol

Kaitlin Conway-Moore 1, Fiona Graham 2, Alison R McKinlay 3, Jack Birch 2, Emily Oliver 2, Clare Bambra 2, Michael P Kelly 2,4, Chris Bonell 1,
PMCID: PMC11551972  PMID: 39521457

Abstract

Abstract

Introduction

Health interventions that require significant change to individual lifestyles or social norms can pose a challenge for widespread public acceptability and uptake. At the same time, over the last two decades, there has been increasing attention paid to the rise of populist movements globally, defined by ‘the people’ pushing against ‘an elite’ viewed as depriving the people of their sovereignty. To understand potential overlap in these two areas, this study aims to synthesise existing international evidence on linkages between populist attitudes and reduced uptake, acceptability, adherence and/or effectiveness of public health interventions. The goal of this work is to create a conceptual framework that can be used to inform policy strategies aimed at widening the impact of public health interventions.

Methods and analysis

A systematic review will be performed via searches across databases and websites relevant to public health and social science research, informed by preliminary searches on the topic. There will be no language restrictions, but included studies will be limited to those produced since 2008, the year of the global financial crisis, from which most current literature on populism dates. Risk of bias will be assessed using validated tools according to study design. Due to expected heterogeneity across included studies, this will be a systematic review without meta-analysis. Findings will be synthesised narratively, and the strength of the evidence will be assessed using the Grading of Recommendations Assessment, Development and Evaluation approach. The review will be reported according to the Systematic Reviews without Meta-Analysis reporting guidelines.

Ethics and dissemination

Ethical review is not required for this study. Public dissemination will be informed via consultation with our Patient and Public Involvement and Engagement Strategy Group, along with reporting via peer-reviewed publication, relevant international conferences, a policy brief and a workshop with public health and communications experts.

PROSPERO registration number

CRD42024513124.

Keywords: Health policy, Public health, Social medicine


STRENGTHS AND LIMITATIONS OF THIS STUDY.

  • This systematic review on the impact of populist attitudes on the acceptability and uptake of public health interventions is informed by preliminary searches on the same topic and uses a peer-reviewed search strategy.

  • The review adheres to the Systematic Reviews without Meta-Analysis reporting guidelines.

  • Findings from this review can be used to better inform future public health interventions to increase both individual and population-level acceptability and uptake.

  • A limitation of this review lies in the fact that the expected heterogeneity of included studies will prohibit meta-analysis.

Introduction

The widespread acceptability of public health interventions is key to their uptake and success. However, achieving broad-based public support can be challenging when interventions require significant change to individual lifestyles or social norms. This was made evident in a 2013 systematic review on the public acceptability of government interventions aimed at changing health-related behaviours such as tobacco and alcohol consumption, diet and exercise.1 In this review, it was found that people tended to be most receptive to interventions that were the least intrusive to their lives or targeted towards the behaviour of others, even though these types of interventions also tended to be the least effective.1

One of the most salient examples of the potentially negative impact of a lack of acceptability and uptake of public health interventions occurred in 2019, when the WHO declared vaccine hesitancy among the top ten threats to global health.2 Along with vaccine hesitancy, however, there have recently been instances of public protest and backlash against other government-led health interventions in countries around the world. Among these are climate change mitigation strategies, sexual and reproductive healthcare provision, and non-pharmaceutical-based infection control measures, with negative reactions having the potential to contribute to further uncertainties about and scepticism towards, public health interventions globally.3,7

One potential driver of this phenomenon could be connected to the rise of populist politics and attitudes over the last two decades. Responding and adding to widespread dissatisfaction with, and alienation from, existing government structures, populist politics are generally constructed by those making such appeals in terms of ‘the people’ standing in opposition to an ‘elite’ who are viewed as depriving the people of their sovereignty or pushing for unwelcome social change.8 9 While who is said to make up ‘the people’ and who ‘the elite’ varies and can change over time and across the political spectrum, this matters less than the clear distinction of ‘us’ versus ‘them’.10 In left-wing populism, the distinction is generally binary, with people economically in the middle and bottom of society presented as pushing against those at the top. In right-wing populism, on the other hand, the distinction is more often triadic, with ‘the people’ presented as pushing upward against ‘the elite’ and downward against a specific ‘other’ or ‘out group’, the latter of which often includes immigrants, ethnic/religious/linguistic minorities, or members of the LGBTQ+ community.11 12

While much of the current discourse about populist movements and attitudes has centred on their impact on social cohesion and illiberalism, there may be important implications for public health that require examination. In particular, evidence suggests that support for conspiracy theories may have an important role to play in opposition to public health interventions and one that can be connected directly to populist attitudes through a focus on the alleged wrongdoings of existing institutions, elites and authorities that lie at the root of many such theories.13 It has been argued that this focus is particularly relevant when the scientific data being presented in support of public health interventions threaten an individual’s worldview or ideologies or when it has an impact on public policy, as promoting conspiracy theories provides room for rejecting the information being provided by experts.

Interestingly, when looking at the core drivers of scepticism concerning issues such as climate change, vaccination or COVID-19 restrictions, existing evidence suggests that they are often different.13 For example, while climate change scepticism tends to be rooted in conservative or neo-liberal political values, and especially support for an economy free from the kinds of regulations that commonly proposed environmental protection measures might involve, other factors have been found to be more powerful drivers of vaccine scepticism or hesitancy, such as religiosity, gender, ethnic minority status, educational attainment and a lack of trust in both government and scientists.13,16 When it comes to COVID-19 restrictions, worldview and group identity have been noted as major drivers of scepticism.13 More specifically, it has been argued that opposition to mandatory self-isolation, facemask requirements, and limitations to travel, leisure and social activities mainly came from those who generally oppose government intervention in the lives of citizens, limitations to personal freedom and resulting social change.13 17 18

To better understand the role that populist attitudes play in affecting the acceptability and uptake of different public health interventions, there is a need for a synthesis of empirical evidence, including both quantitative and qualitative research. To this end, the present protocol outlines a systematic review that seeks to answer the following research question: what existing international evidence is there for statistical associations or thematic linkages between populist attitudes and the reduced uptake, acceptability, adherence and/or effectiveness of public health interventions?

While a set of preliminary searches of published literature conducted by the authors of this protocol, along with media coverage on the topic, has identified interventions focused on vaccination, climate change, sexual and reproductive healthcare, non-pharmaceutical-based infection control, tobacco and alcohol consumption, diet and exercise as key areas of focus, this study will take a broader approach to include all potentially relevant public health interventions. The findings can then be harnessed into a conceptual framework that can be used to inform policy strategies aimed at overcoming resistance to public health interventions by those with populist attitudes, with the goal of improving health outcomes at both the individual and population level.

Methods and analysis

Research design overview

The review will follow the Systematic Reviews without Meta-Analysis (SWiM) reporting guidelines (see online supplemental appendix 1 for the SWiM reporting items).19 The protocol for this review has been registered with PROSPERO International Prospective Register of Systematic Review, registration number CRD42024513124.

Inclusion criteria

Types of participants

Given our desire to ultimately identify evidence applicable to a UK policy context, studies will be included if participants are adults living in countries as defined by membership in the Organisation for Economic Co-operation and Development.

Types of interventions

To be included, studies will need to focus on a specific public health intervention, such as those addressing vaccination, disease screening, non-pharmaceutical infection controls, sexual/reproductive healthcare provision, increased access to healthcare, climate change mitigation, road safety, anti-pollution measures, water fluoridation, gun control, mental healthcare provision, improvements to diet and exercise, and those related to gambling, as well as tobacco and alcohol or other drug use.

Types of exposure or moderator

Included studies will have a focus on participant attitudes which can be construed as populist in the sense of being hostile to at least one of the following: (1) elites (eg, government, business, medical and other health professionals, mainstream media, science and the wealthy), (2) out-groups (eg, women, migrants, minoritised ethnic/racial/religious groups or gender/sexual minorities), (3) checks on popular sovereignty (eg, legal rights, personal freedoms and other government-imposed regulations) or (4) social change (eg, promotion of equality, diversity and inclusion, state intervention or market regulation).

Types of outcomes

The outcome(s) of interest are uptake of, acceptability of, adherence to and/or effectiveness of public health interventions. To be included, studies will need to report on the impact of populist attitudes on one or more of these outcome measures.

Types of study design

This study will include any report of empirical research that uses the following research design: (1) trials or other before and after (controlled and uncontrolled) evaluations of public health interventions examining whether populist attitudes moderate or otherwise affect intervention uptake, acceptability, adherence and/or effectiveness; (2) cross-sectional, longitudinal or discrete choice studies examining associations between populist attitudes and the uptake, acceptability, adherence and/or effectiveness of public health interventions; or (3) qualitative research (eg, interviews, focus groups, ethnographies) examining linkages between populist views and views on or behaviour/practices in relation to public health interventions.

Search strategy

Our search strategy is informed by a preliminary set of searches we conducted on how populist attitudes relate to the uptake, acceptability, adherence or effectiveness of public health interventions, which was used to establish the existence of pertinent evidence on this topic and to inform search terms. Based on this preliminary set of searches, we will limit this systematic review to literature published since 2008, the year of the global financial crisis, from which the contemporary literature on populism largely dates. We will not limit our search by language or publication type.

In terms of bibliographic database searches, we will mainly use free-text terms as studies meeting our inclusions criteria are unlikely to be reliably indexed in databases with controlled vocabularies such as Medical Subject Headings. We will take the following concepts from our inclusion criteria to develop a search string linked by ‘AND’: populist attitude AND public health intervention AND outcome. For each concept, we will use free-text and controlled-vocabulary terms linked by ‘OR’. The following databases will searched, based on their relevance to medical, psychological, economic and social scientific research: CINAHL; Dissertation Abstracts; EconLit; EMBASE; Global Health; Global Index Medicus; International Bibliography of the Social Sciences; Ovid MEDLINE; PsycINFO; Scopus; Social Policy and Practice; Sociological Research Online; and Web of Science (including Science Citation Index Expanded, Social Sciences Citation Index, Arts & Humanities Citation Index and Emerging Sources Citation Index). An example of the final search strategy employed in Ovid MEDLINE and peer-reviewed by a librarian at the London School of Hygiene and Tropical Medicine can be found in online supplemental appendix 2.

We will also run searches on the following websites to retrieve relevant grey literature: Centers for Disease Control and Prevention; Community Research and Development Information Service; Drug and Alcohol Findings Effectiveness Bank; European Centre for Disease Prevention and Control; Google; Google Scholar; Intergovernmental Panel on Climate Change; International Planned Parenthood Federation; Marie Stopes International; The Campbell Library; Open Library; United Nations Environment Programme; and the World Health Organization.

Reference lists of all included studies will be hand-searched for additional studies that meet our inclusion criteria. Finally, we will contact subject experts for relevant ongoing or completed research and anything that may have been missed in our systematic searching outlined above.

Data management and screening

Results of comprehensive searching will be downloaded into EPPI Reviewer 620 and duplicates will be removed. Two reviewers will pilot the screening of successive batches of 50 titles and abstracts, meeting to discuss disagreements and calling on a third reviewer to settle disagreements where necessary. After refinements and once we achieve a batch-level agreement rate of 90%, each record will be screened by one reviewer for potential inclusion based on its title and abstract. Full texts will be obtained for references judged as meeting our inclusion criteria or where there is insufficient information from the title and abstract to decide. Screening of full texts will follow the same process outlined for title and abstract screening.

Data extraction

Data extraction will be carried out by one reviewer using EPPI Reviewer 620 with cross-checking conducted by a second reviewer. The following data will be extracted from each included record: basic study details (ie, first author, publication date, study location, timing and duration, individual participant characteristics); study methods (ie, design (including intervention type), sampling and sample size, allocation, blinding, control of confounding, data collection, attrition, analysis); outcome measures (ie, outcome type (eg, focus on uptake, acceptability, adherence or effectiveness of public health interventions), timing, reliability of measures, intra-class correlation coefficients, effect sizes); and relevant moderation analyses. If included studies are reported in languages that cannot be translated by the review team, a review author will complete the data extraction form in collaboration with a translator. In the case of missing data, we will contact the authors of the document in question and request the missing details. If authors cannot be traced or do not respond after a period of 2 months, we will record the information as missing in our extraction sheet and take this into account in our risk of bias assessment for that record.

Study quality and risk of bias appraisal

Two reviewers will independently assess the quality of each study and then meet to compare their assessments. Disagreements will be resolved through discussion and, where necessary, via a third reviewer. Depending on the study design, different quality assessment and risk of bias tools will be employed. For randomised controlled trials, we will use the Cochrane Risk of Bias (RoB 2) tool, which assesses domains of bias in trial design, conduct and reporting.21 For non-randomised studies and quasi-experimental evaluations, we will use the Risk of Bias in Non-Randomized Studies - of Interventions tool.22 This tool evaluates studies based on seven domains of potential bias, including confounding, selection bias, intervention measurement, deviations from intended interventions, missing data, outcome measurement and reported results.23 For quantitative observational studies including cohort, cross-sectional and case-control designs, we will use the Cambridge Quality Checklists, which evaluate study methods used in determining correlates, risk factors and causal risk factors.24 Qualitative studies will be assessed using the EPPI Centre’s quality assessment evaluation tool.25

Data analysis and synthesis

As this is a multi-methods review including both quantitative and qualitative research and based on the heterogeneity of quantitative evidence identified in our preliminary searches, this will be a systematic review without meta-analysis, with all findings synthesised narratively. Narrative synthesis will focus on how the uptake, acceptability, adherence and/or effectiveness of public health interventions appear to be affected by the holding of populist views among potential beneficiaries within each study. Where possible, we will explore the reasons for any differences found between those who hold and do not hold populist views in each study. As part of this synthesis, we will also reflect on the nature of the interventions on which the included studies report, as these may be different based on study setting/location. Results will be ordered by topic as appropriate, including vaccination; disease screening; infection control measures; sexual and/or reproductive health; increased access to healthcare; climate change; road safety; water fluoridation; gun control; mental health; diet and exercise; gambling; and tobacco, alcohol and other drug use, among others. Where appropriate, we will use meta-ethnographic methods to inform our narrative synthesis of qualitative evidence. The overarching aim of this narrative synthesis will be the development of a conceptual framework that can be used to inform policy strategies aimed at widening the impact of key public health interventions.

Characteristics of all the studies included in this review will be presented in a table that outlines the authorship, publication date, study design, setting, sample population and size, as well as type(s) of intervention, exposure(s)/moderator(s) and outcome(s). The strength of the evidence presented in our review will be assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach26 for quantitative studies, and the Confidence in the Evidence from Reviews of Qualitative Research framework27 for qualitative studies, which will be included in a table outlining our summary findings for each outcome of interest. GRADE assessments will examine the quality of evidence based on five domains (eg, risk of bias, inconsistency, indirectness, imprecision and publication bias) and will result in a given outcome being placed in one of four levels of certainty based on the presented body of evidence (eg, high, moderate, low or very low).28 Depending on the number of studies found for each outcome, we will also create funnel plots to assess whether there is evidence of publication bias.

Patient and public involvement

As a project funded under the National Institute for Health and Care Research Policy Research Unit Behavioural and Social Sciences, this study has a designated Patient and Public Involvement and Engagement (PPIE) representative who will be regularly consulted to ensure their robust engagement with the research process, including the planning of future qualitative research that will complement the present study. To date, collaboration with our PPIE representative has included the production of a lay summary of the research project and critical revision of this protocol, with feedback incorporated in order to strengthen engagement with a wide audience. Following execution of the review, findings will also be presented to our PPIE Strategy Group to understand the extent to which the findings align with their own experiences, to produce a lay summary of the findings for broader public engagement with the research outputs and to identify public dissemination opportunities.

Ethics and dissemination

The research involves no human participants and draws solely on evidence available in the public domain, so ethical approval is not required for this project. Dissemination of findings will include presentation to our PPIE Strategy Group, peer-reviewed publications in international journals, presentations at international public health and social science conferences, a policy brief and a workshop with public health and communications experts to relay findings and recommendations for improved uptake and acceptability of future public health interventions.

supplementary material

online supplemental file 1
bmjopen-14-11-s001.docx (35.5KB, docx)
DOI: 10.1136/bmjopen-2024-088418

Acknowledgements

The authors are grateful to Stuart Edwards, a member of the NIHR Policy Research Unit in Behavioural and Social Sciences PPIE Strategy Group, who provided critical feedback to this manuscript. The authors also wish to thank our policy partners at the Department of Health and Social Care (DHSC), including the Behavioural and Social Sciences Team (BeSST) at the Office for Health Improvement and Disparities (OHID), who provided helpful feedback throughout the research.

Footnotes

Funding: This project is funded by the National Institute for Health and Care Research (NIHR) (Policy Research Unit Behavioural and Social Sciences (project reference NIHR206124)). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.

prepub: Prepublication history and additional supplemental material for this paper are available online. To view these files, please visit the journal online (https://doi.org/10.1136/bmjopen-2024-088418).

Patient consent for publication: Not applicable.

Provenance and peer review: Not commissioned; externally peer reviewed.

Patient and public involvement: Patients and/or the public were involved in the design, conduct, reporting or dissemination plans of this research. Refer to the Methods section for further details.

Contributor Information

Kaitlin Conway-Moore, Email: kaitlin.conway@lshtm.ac.uk.

Fiona Graham, Email: fiona.graham@ncl.ac.uk.

Alison R McKinlay, Email: a.mckinlay@ucl.ac.uk.

Jack Birch, Email: j.birch@newcastle.ac.uk.

Emily Oliver, Email: emily.oliver@newcastle.ac.uk.

Clare Bambra, Email: clare.bambra@newcastle.ac.uk.

Michael P Kelly, Email: mk744@medschl.cam.ac.uk.

Chris Bonell, Email: chris.bonell@lshtm.ac.uk.

References

  • 1.Diepeveen S, Ling T, Suhrcke M, et al. Public acceptability of government intervention to change health-related behaviours: a systematic review and narrative synthesis. BMC Public Health. 2013;13:756. doi: 10.1186/1471-2458-13-756. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.de Figueiredo A, Simas C, Karafillakis E, et al. Mapping global trends in vaccine confidence and investigating barriers to vaccine uptake: a large-scale retrospective temporal modelling study. The Lancet. 2020;396:898–908. doi: 10.1016/S0140-6736(20)31558-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Kennedy J. Populist politics and vaccine hesitancy in Western Europe: an analysis of national-level data. Eur J Public Health. 2019;29:512–6. doi: 10.1093/eurpub/ckz004. [DOI] [PubMed] [Google Scholar]
  • 4.Abi-Hassan S. In: The Oxford Handbook of Populism. Kaltwasser CR, Taggart P, Espejo PO, et al., editors. Vol. 1. Oxford University Press: 2017. Populism and gender; pp. 426–44. [Google Scholar]
  • 5.Huber RA. The role of populist attitudes in explaining climate change skepticism and support for environmental protection. Env Polit. 2020;29:959–82. doi: 10.1080/09644016.2019.1708186. [DOI] [Google Scholar]
  • 6.Pugh S. Politics, power, and sexual and reproductive health and rights: impacts and opportunities. Sex Reprod Health Matters . 2019;27:1662616. doi: 10.1080/26410397.2019.1662616. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Ozduzen O, Aslan Ozgul B, Ianosev B. Institutions of governance are all corrupted’: anti-political collective identity of anti-lockdown protesters in digital and physical spaces. Soc Mov Stud. 2024;23:676–94. doi: 10.1080/14742837.2023.2246920. [DOI] [Google Scholar]
  • 8.Wirth W, Esser F, Wettstein M, et al. The appeal of populist ideas, strategies and styles: a theoretical model and research design for analyzing populist political communication. 2016
  • 9.Vallacher RR, Fennell E. In: The Psychology of Populism: The Tribal Challenge to Liberal Democracy. Forgas JP, Crano WD, Fiedler K, editors. First Edition. Routledge; 2021. Rapid social change and the emergence of populism. [Google Scholar]
  • 10.Mudde C, Kaltwasser CR. Vox populi or vox masculini? Populism and gender in Northern Europe and South America. Pat Prej. 2015;49:16–36. doi: 10.1080/0031322X.2015.1014197. [DOI] [Google Scholar]
  • 11.Judis JB. The Guardian; [26-Oct-2023]. Us v them: the birth of populism.https://www.theguardian.com/politics/2016/oct/13/birth-of-populism-donald-trump Available. Accessed. [Google Scholar]
  • 12.Bambra C, Lynch J. Welfare Chauvinism, Populist Radical Right Parties and Health Inequalities Comment on “A Scoping Review of Populist Radical Right Parties’ Influence on Welfare Policy and its Implications for Population Health in Europe.”. Int J Health Policy Manag. 2021;10:581–4. doi: 10.34172/ijhpm.2020.149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Rutjens BT, van der Linden S, van der Lee R. Science skepticism in times of COVID-19. Group Processes & Intergroup Relations. 2021;24:276–83. doi: 10.1177/1368430220981415. [DOI] [Google Scholar]
  • 14.Robertson E, Reeve KS, Niedzwiedz CL, et al. Predictors of COVID-19 vaccine hesitancy in the UK household longitudinal study. Brain Behav Immun. 2021;94:41–50. doi: 10.1016/j.bbi.2021.03.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Aechtner T, Religion FJ. Trust, and Vaccine Hesitancy in Australia: An Examination of Two Surveys. J Acad Study Relig. 2022;35:218–44. doi: 10.1558/jasr.22476. [DOI] [Google Scholar]
  • 16.Marti M, de Cola M, MacDonald NE, et al. Assessments of global drivers of vaccine hesitancy in 2014-Looking beyond safety concerns. PLoS One. 2017;12:e0172310. doi: 10.1371/journal.pone.0172310. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Dryhurst S, Schneider CR, Kerr J, et al. Risk perceptions of COVID-19 around the world. J Risk Res. 2020;23:994–1006. doi: 10.1080/13669877.2020.1758193. [DOI] [Google Scholar]
  • 18.Kerr J, Panagopoulos C, van der Linden S. Political polarization on COVID-19 pandemic response in the United States. Pers Individ Dif. 2021;179:110892. doi: 10.1016/j.paid.2021.110892. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Campbell M, McKenzie JE, Sowden A, et al. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ. 2020:l6890. doi: 10.1136/bmj.l6890. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Centre at the Social Science Research Unit I of EU of L EPPI-reviewer. [24-Aug-2023]. https://eppi.ioe.ac.uk/cms/Default.aspx?tabid=2914 Available. Accessed.
  • 21.The Cochrane Collaboration . Cochrane Methods Bias; 2023. [6-Dec-2023]. RoB 2: a revised cochrane risk-of-bias tool for randomized trials.https://methods.cochrane.org/bias/resources/rob-2-revised-cochrane-risk-bias-tool-randomized-trials Available. Accessed. [Google Scholar]
  • 22.The Cochrane Collaboration . Cochrane Methods Bias; 2023. [6-Dec-2023]. ROBINS-i tool.https://methods.cochrane.org/robins-i Available. Accessed. [Google Scholar]
  • 23.Sterne JA, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ . 2016:i4919. doi: 10.1136/bmj.i4919. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Murray J, Farrington DP, Eisner MP. Drawing conclusions about causes from systematic reviews of risk factors: The Cambridge Quality Checklists. J Exp Criminol. 2009;5:1–23. doi: 10.1007/s11292-008-9066-0. [DOI] [Google Scholar]
  • 25.EPPI-Centre . Tools. Social Science Research Unit. UCL Institute of Education; 2021. [5-Jan-2024]. https://eppi.ioe.ac.uk/cms/Resources/Tools/tabid/184/Default.aspx Available. Accessed. [Google Scholar]
  • 26.Murad MH, Mustafa RA, Schünemann HJ, et al. Rating the certainty in evidence in the absence of a single estimate of effect. Evid Based Med. 2017;22:85–7. doi: 10.1136/ebmed-2017-110668. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Lewin S, Booth A, Glenton C, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implement Sci. 2018;13:2. doi: 10.1186/s13012-017-0688-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.The Cochrane Collaboration . In: Cochrane Handbook for Systematic Reviews of Interventions. Higgins J, Thomas J, Chandler J, editors. Vol. 6. 2023. Chapter 14: completing ‘summary of findings’ tables and grading the certainty of the evidence; p. 4. [Google Scholar]

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    online supplemental file 1
    bmjopen-14-11-s001.docx (35.5KB, docx)
    DOI: 10.1136/bmjopen-2024-088418

    Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

    RESOURCES