Abstract
Background
Due to the explosion in rapid reviews in the literature during COVID-19, their utility in universal health coverage and in other routine situations, there is now a need to document and further advance the application of rapid review methods, particularly in low-resource settings where a scarcity of resources may preclude the production of a full systematic review. This is the introductory article for a series of articles to further the discussion of rapid reviews for health policy and systems decision-making.
Main body
The series of papers builds on a practical guide on the conduct and reporting of rapid reviews that was published in 2019. The first paper provides an evaluation of a rapid review platform that was implemented in four centers in low-resource settings, the second paper presents approaches to tailor the methods for decision-makers through rapid reviews, the third paper focuses on selecting different types of rapid review products, and the fourth pertains to reporting the results from a rapid review.
Conclusion
Rapid reviews have a great potential to inform universal health coverage and global health security interventions, moving forward, including preparedness and response plans to future pandemics. This series of articles will be useful for both researchers leading rapid reviews, as well as decision-makers using the results from rapid reviews.
Keywords: Rapid reviews, Decision-making, Health systems, Policy, Knowledge synthesis, Evidence synthesis
Background
Knowledge synthesis is an important tool that can be used by decision-makers, such as patient partners, healthcare providers, and policymakers, to enhance evidence-informed decision-making. Rapid reviews have emerged as a resource-efficient way to conduct knowledge synthesis that can provide evidence in a more timely and relevant manner than other forms of knowledge synthesis [1–6], such as a systematic review. The most recent definition of a rapid review put forth by the Cochrane Rapid Review Methods Group for organizations that only conduct knowledge synthesis for decision-makers is as follows: “A rapid review is a form of knowledge synthesis that accelerates the process of conducting a traditional systematic review through streamlining or omitting various methods to produce evidence for stakeholders in a resource-efficient manner [7].” This definition advances previously proposed definitions for rapid reviews, as it focuses on providing timely evidence to decision-makers. The definition currently does not differentiate between the topic that the rapid review is focused on—such as health services or effectiveness research—and as such, can be applied to all topics.
According to the Cochrane Rapid Review Methods Group, rapid reviews are a demand-driven product [8]. Through a rapid review, the evidence is contextualized for decision-makers, improving the uptake of research results, and leading to an increased impact on decision-making [6, 9]. Furthermore, it is hypothesized that the use of knowledge synthesis products that are relevant to decision-maker needs will reduce research waste [10].
A key approach to further increasing the uptake of rapid reviews includes engaging decision-makers at onset and throughout the entire rapid review process. The intention is for the decision-maker to become a member of the research team using an integrated knowledge generation and uptake approach [11–13]. This strategy is often called “co-production” or “co-creation” of research and is hypothesized to have a much greater impact than simply engaging decision-makers at certain stages of the knowledge synthesis process [14].
Rapid reviews have demonstrated great utility during urgent and emergent situations [15]. Indeed, more than 3000 rapid reviews (and counting!) were conducted during the COVID-19 pandemic [16]. Also, rapid reviews have become an efficient approach to tackling universal health coverage policy and systems decision-making [17]. Now more than ever rapid reviews have become prominent for decision-making.
Previously, there was a dearth of methodological guidance on the conduct of rapid reviews, particularly for health policy and systems research. As such, we published a practical guide on the conduct and reporting of rapid reviews [15]. Due to the explosion in rapid reviews in the literature during COVID-19, as well as their utility in universal health coverage [17, 18] and in other routine situations [19, 20], there is now a need to document and further advance the application of rapid review methods. This is particularly important in low-resource settings, where a scarcity of resources may preclude the production of a full systematic review. Moreover, rapid reviews are critical to answer complex policy and systems questions [21]. To address this need, we have written this series of articles to further the discussion of rapid reviews for health policy and systems decision-making. It is hoped that this series of articles will be useful for both researchers leading rapid reviews, as well as decision-makers using the results from rapid reviews.
Main text
First paper
The first paper in the series begins with assessing rapid review centers in low- and middle-income countries (LMICs), supported by the Alliance for Health Policy and Systems Research (HPSR), World Health Organization (WHO), through the Embedded Rapid Review (ERA) initiative [22]. This initiative supported several platforms to conduct rapid reviews for decision-making and included both researcher and decision-maker participants. Sixteen participants in this initiative were interviewed. The interviews identified four themes that supported the use of rapid reviews in policy and systems decision-making: (1) organizational structural arrangements of the platform, (2) management of the rapid review process, (3) rapid reviews as the immediate policy-relevant outputs, and (4) the engagement process. This paper provides guidance for rapid review centers in LMICs, as well as insight into how to increase the impact and relevance of rapid reviews.
Second paper
The second paper focuses on ways that researchers can tailor rapid review methods to suit the needs of decision-makers [23]. Suggestions to expedite the knowledge synthesis process include using a team experienced in knowledge synthesis, engaging the decision-makers who commissioned the review from project onset and throughout its conduct, and drafting a clear protocol for the rapid review methods. For the literature search, strategies, such as limiting by date or language, as well as using a staged approach to searching (e.g., searching for systematic reviews then randomized trials then observational studies sequentially) are described. Other methods, such as using a single reviewer for steps of the review process (e.g., screening, data abstraction, methodological quality appraisal), use of automation tools in the review process, and providing a short descriptive summary of the evidence, are considered.
Third paper
The third paper focuses on the process of selecting a rapid review approach from three different types of rapid reviews (annotated bibliographies, thematic summaries, and rapid syntheses) with varying timelines to address complex policy questions [24]. Two stages are discussed; the first is scoping the literature, which involves discussions with the decision-makers who requested the rapid review and conducting literature searches to conceptually map the evidence. The second stage is selecting an optimal approach, which includes additional consultation with decision-makers to refine the question and tailor the methodological approach. Other considerations discussed to guide the selection of a method include the breadth and depth of the literature, time required for the rapid review, and whether a static or evolving conceptual framework can be used to guide the rapid review conceptualization.
Fourth paper
The final paper in the series provides suggestions on how to report the results from a rapid review [25]. The paper recommends considering the balance between providing sufficient details on the research process with the level of detail requested by the decision-maker, as well as the time and resources available to report the rapid review findings. Suggestions, such as the use of publications or conference presentations to establish clear messaging, crafting the key messages from the review findings with decision-makers, having ongoing engagement with decision-makers throughout the rapid review process, and use of different products for different types of decision-makers, are discussed. The use of pre-prints as a dissemination strategy for rapid reviews is also discussed, which gained more prominence during the COVID-19 pandemic. Finally, gauging impact and reach using dissemination measures and bibliometrics is suggested.
Conclusions
Several methodological challenges regarding the conduct of rapid reviews have been highlighted in this series of papers, as well as in a recent paper that was published specifically on rapid reviews within the COVID-19 context [26]. We suggest using the Alliance HPSR/WHO guide [17] along with the updated guidance here to tailor rapid review methods for decision-making. In light of the pandemic, rapid reviews have a strategic role to play in supporting evidence-informed policymaking. Rapid reviews have a great potential to inform universal health coverage and global health security interventions, moving forward, including preparedness and response plans to future pandemics.
Acknowledgements
The team acknowledges the land on which this research was conducted, in Toronto, Ontario, Canada. For thousands of years, it has been the traditional land of the Huron-Wendat, the Seneca, and most recently the Mississaugas of the Credit. The land is still home to many Indigenous people from across Turtle Island and we are grateful for the opportunity to work on this land. This article was supported by the Alliance for Health Policy and Systems Research. The Alliance is able to conduct its work thanks to the commitment and support from a variety of funders. These include our long-term core contributors from national governments and international institutions, as well as designated funding for specific projects within our current priorities. For the full list of Alliance contributors, please visit https://ahpsr.who.int/about-us/funders. Finally, the authors would like to thank Navjot Mann for formatting the manuscript.
Abbreviations
- LMICs
Low- and middle-income countries
- HPSR
Alliance for Health Policy and Systems Research
- WHO
World Health Organization
- ERA
Embedded Rapid Review initiative
Authors’ contributions
ACT wrote the first draft, which was edited by the other authors. The authors read and approved the final manuscript.
Funding
This series was funded by the Alliance for Health Policy and Systems Research, an international partnership hosted by the World Health Organization, with support from the Norwegian Government Agency for Development Cooperation (Norad), the Swedish International Development Cooperation Agency (Sida), and the UK Department for International Development (DFID). ACT is funded by a Tier 2 Canada Research Chair in Knowledge Synthesis and SES is funded by a Tier 1 Canada Research Chair in Knowledge Translation.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
ACT is an Associate Editor for the Systematic Reviews journal and was not involved with the decision to publish or the publication process. The other authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Andrea C. Tricco, Email: Andrea.Tricco@unityhealth.to
Sharon E. Straus, Email: Sharon.Straus@unityhealth.to
Abdul Ghaffar, Email: Ghaffara@who.int.
Etienne V. Langlois, Email: Langloise@who.int
References
- 1.Featherstone RM, Dryden DM, Foisy M, Guise JM, Mitchell MD, Paynter RA, et al. Advancing knowledge of rapid reviews: an analysis of results, conclusions and recommendations from published review articles examining rapid reviews. Syst Rev. 2015;4:50. doi: 10.1186/s13643-015-0040-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Hartling L, Guise JM, Hempel S, Featherstone R, Mitchell MD, Motu'apuaka ML, et al. Fit for purpose: perspectives on rapid reviews from end-user interviews. Syst Rev. 2017;6:32. doi: 10.1186/s13643-017-0425-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Hartling LG, Guise J-M, Kato E, Anderson J, Aronson N, Belinson S, Berliner E, Dryden D, Featherstone R, Foisy M, Mitchell M, Moto'apuaka M, Noorani H, Paynter R, Robinson KA, Schoelles K, Umscheid CA, Whitlock E. EPC methods: an exploration of methods and context for the production of rapid reviews. Rockville: Agency for Healthcare Research and Quality; 2015. [PubMed] [Google Scholar]
- 4.Hartling L, Guise JM, Kato E, Anderson J, Belinson S, Berliner E, et al. A taxonomy of rapid reviews links report types and methods to specific decision-making contexts. J Clin Epidemiol. 2015;68:1451–1462.e1453. doi: 10.1016/j.jclinepi.2015.05.036. [DOI] [PubMed] [Google Scholar]
- 5.Hartling L, Guise JM, Kato E, Anderson J, Aronson N, Belinson S, et al. AHRQ comparative effectiveness reviews. In EPC methods: an exploration of methods and context for the production of rapid reviews. Rockville: Agency for Healthcare Research and Quality (US); 2015. [PubMed] [Google Scholar]
- 6.Moore G, Redman S, Rudge S, Haynes A. Do policy-makers find commissioned rapid reviews useful? Health Res Policy Syst. 2018;16:17. doi: 10.1186/s12961-018-0293-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Hamel C, Michaud A, Thuku M, Skidmore B, Stevens A, Nussbaumer-Streit B, et al. Defining rapid reviews: a systematic scoping review and thematic analysis of definitions and defining characteristics of rapid reviews. J Clin Epidemiol. 2020;129:74–85. doi: 10.1016/j.jclinepi.2020.09.041. [DOI] [PubMed] [Google Scholar]
- 8.Garritty C, Gartlehner G, Nussbaumer-Streit B, King VJ, Hamel C, Kamel C, et al. Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. 2021;130:13–22. doi: 10.1016/j.jclinepi.2020.10.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Tricco AC, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J, et al. A scoping review of rapid review methods. BMC Med. 2015;13:224. doi: 10.1186/s12916-015-0465-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383:267–276. doi: 10.1016/S0140-6736(13)62228-X. [DOI] [PubMed] [Google Scholar]
- 11.Langlois EV, Montekio VB, Young T, Song K, Alcalde-Rabanal J, Tran N. Enhancing evidence informed policymaking in complex health systems: lessons from multi-site collaborative approaches. Health Res Policy Syst. 2016;14:1–11. doi: 10.1186/s12961-016-0089-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Jackson CL, Greenhalgh T. Co-creation: a new approach to optimising research impact. Med J Aust. 2015;203:283–284. doi: 10.5694/mja15.00219. [DOI] [PubMed] [Google Scholar]
- 13.Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving research impact through co-creation in community-based health services: literature review and case study. Milbank Q. 2016;94:392–429. doi: 10.1111/1468-0009.12197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Tricco AC, Zarin W, Rios P, Nincic V, Khan PA, Ghassemi M, et al. Engaging policy-makers, health system managers, and policy analysts in the knowledge synthesis process: a scoping review. Implement Sci. 2018;13:31. doi: 10.1186/s13012-018-0717-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Tricco AC, Langlois E, Straus SE. WHO: Rapid reviews to strengthen health policy and systems: a practical guide. World Health Organization; 2017. [Google Scholar]
- 16.COVID-END [https://www.mcmasterforum.org/networks/covid-end]
- 17.Langlois EV, Straus SE, Antony J, King VJ, Tricco AC. Using rapid reviews to strengthen health policy and systems and progress towards universal health coverage. BMJ Glob Health. 2019;4:e001178. doi: 10.1136/bmjgh-2018-001178. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Organization WH . International Bank for Reconstruction and Development/The World Bank. Healthy systems for universal health coverage: a joint vision for healthy lives. 2017. [Google Scholar]
- 19.McGregor M, Brophy JM. End-user involvement in health technology assessment (HTA) development: a way to increase impact. Int J Technol Assess Health Care. 2005;21:263–267. doi: 10.1017/S026646230505035X. [DOI] [PubMed] [Google Scholar]
- 20.Zechmeister I, Schumacher I. The impact of health technology assessment reports on decision making in Austria. Int J Technol Assess Health Care. 2012;28:77–84. doi: 10.1017/S0266462311000729. [DOI] [PubMed] [Google Scholar]
- 21.Bosch-Capblanch X, Lavis JN, Lewin S, Atun R, Røttingen J-A, Dröschel D, et al. Guidance for evidence-informed policies about health systems: rationale for and challenges of guidance development. PLOS Med. 2012;9:e1001185. doi: 10.1371/journal.pmed.1001185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Mijumbi‑Deve RM, Kawooya I, Kayongo E, Izizinga R, Mamuye H, Amog K, et al. Paper 1: Demand-driven rapid reviews for health policy and systems decision-making: lessons from Lebanon, Ethiopia, and South Africa on researchers and policymakers’ experiences. Syst Rev. 2022; 10.1186/s13643-022-02021-3 [DOI] [PMC free article] [PubMed]
- 23.King VJ, Stevens A, Nussbaumer-Streit B, Kamel C, Garritty C. Paper 2: Performing rapid reviews. Syst Rev. 2022; 10.1186/s13643-022-02011-5 [DOI] [PMC free article] [PubMed]
- 24.Wilson MG, Oliver S, Melendez-Torres GJ, Lavis JN, Waddell K, Dickson K. Paper 3: Selecting rapid review methods for complex questions related to health policy and system issues. Syst Rev. 2022; 10.1186/s13643-021-01834-y [DOI] [PMC free article] [PubMed]
- 25.Kelly SE, McGowan J, Barnhardt K, Straus SE. Paper 4: a review of reporting and disseminating approaches for rapid reviews in health policy and systems research. Syst Rev. 2022; 10.1186/s13643-022-01897-5 [DOI] [PMC free article] [PubMed]
- 26.Tricco AC, Garritty CM, Boulos L, Lockwood C, Wilson M, McGowan J, et al. Rapid review methods more challenging during COVID-19: commentary with a focus on 8 knowledge synthesis steps. J Clin Epidemiol. 2020;126:177–183. doi: 10.1016/j.jclinepi.2020.06.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.