Abstract
Background
Coronavirus disease 2019 (COVID-19) has no confirmed specific treatments. However, there might be in vitro and early clinical data as well as evidence from severe acute respiratory syndrome and Middle Eastern respiratory syndrome that could inform clinicians and researchers. This systematic review aims to create priorities for future research of drugs repurposed for COVID-19.
Methods
This systematic review will include in vitro, animal, and clinical studies evaluating the efficacy of a list of 34 specific compounds and 4 groups of drugs identified in a previous scoping review. Studies will be identified both from traditional literature databases and pre-print servers. Outcomes assessed will include time to clinical improvement, time to viral clearance, mortality, length of hospital stay, and proportions transferred to the intensive care unit and intubated, respectively. We will use the GRADE methodology to assess the quality of the evidence.
Discussion
The challenge posed by COVID-19 requires not just a rapid review of drugs that can be repurposed but also a sustained effort to integrate new evidence into a living systematic review.
Trial registration
PROSPERO 2020 CRD42020175648
Supplementary Information
The online version contains supplementary material available at 10.1186/s13643-021-01693-7.
Keywords: COVID-19, SARS-CoV2, Severe acute respiratory syndrome, SARS, Middle East respiratory syndrome Coronavirus, MERS-CoV, Repurposed, Repurposing
Background
The coronavirus disease 2019 (COVID-19) pandemic represents one of the deadliest and economically most consequential outbreaks in around 100 years [1, 2]. To date, only remdesivir (Gilead Sciences) has shown to possibly lower the time to recovery [3, 4]. In the past, developing antiviral agents has taken 5.9 years on average [5]. In the current crisis, it appears feasible that this timeline will be significantly reduced if there were early signs of efficacy. Moreover, a candidate drug could be offered emergency use authorization by the U.S. Food and Drug Administration and similar designations by regulatory authorities across the world, as was the case with remdesivir.
Drug repurposing has been a successful strategy for a variety of therapeutic areas [6]. In the case of COVID-19, compounds of interest include those that have previously been found to either be clinically efficacious or have in vitro activity against the coronaviruses that cause severe acute respiratory syndrome (SARS) and Middle Eastern respiratory syndrome (MERS), which share significant structural similarities with SARS-CoV-2, the virus that causes COVID-19 [7, 8]. However, the existing clinical and preclinical research studying these viruses as a whole has never been systematically reviewed. Information on drugs potentially active against COVID-19 is expected to change rapidly as the results of ongoing and future studies become available. It is crucial that both researchers and health care providers are able to access the optimum and most up-to-date information to inform future or ongoing studies and provide clinical care.
The objectives for the current protocol are (1) to systematically review which existing medications have shown to be potentially effective against SARS or MERS and could therefore be potentially repurposed; (2) to present the early evidence that supports testing readily available drugs against SARS-CoV-2; (3) to provide the best available level of evidence for the efficacy of each individual candidate drug; and (4) to report harmful effects associated with use of these drugs.
Methods/design
This protocol specifies the conduct and reporting of a systematic review in compliance with the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols 2015 statement (PRISMA-P) [9]. The protocol has been registered with the International Prospective Register of Systematic Reviews (PROSPERO) and assigned the identifier CRD42020175648. This is intended as a living systematic review that will be continuously updated via semi-automated approaches, and updates will be published intermittently based on triggers that include substantial changes to the evidence base for any included intervention.
Data sources
Bibliographical databases for literature search include Medline (via PubMed), Embase, the International Clinical Trials Registry Platform (ICTRP), ClinicalTrials.gov (for nonrandomised studies and trials with summary results), as well as the following preprint servers: MedRxiv, BioRxiv, chemRxiv, Preprints.org, and the Chinese-language server ChinaXiv. Our search strategy combines terms for COVID-19, SARS, MERS, and their causative agents with drug names, based on the following eligibility criteria (see Additional file 2: Appendix).
Eligibility criteria
All clinical, in vitro, and animal studies that test interventions used to treat diseases associated with SARS-CoV-2, SARS-CoV, or MERS-CoV are eligible for inclusion in the systematic review.
Study design
Single-arm and controlled studies with or without randomisation as well as open-label or blinded designs will be included. Future clinical studies should be focused on agents that were found to be promising in in vitro or in animal studies, and these should be included here as we are aiming to identify potentially effective treatments.
Interventions
The interventions we studied were derived from a scoping review by the World Health Organisation (WHO) [10]. They encompass both single-agent and combination regimens with one or more of the following agents: atazanavir, azithromycin, baloxavir marboxil, baricitinib, bevacizumab, chloroquine, colchicine, darunavir/cobicistat, emtricitabine/tenofovir, enisamium iodide, favipiravir (T-705), fingolimod, ganciclovir, hydroxychloroquine, indinavir, lopinavir/ritonavir, mycophenolic acid/mofetil, nelfinavir, niclosamide, nitazoxanide, nitric oxide, novaferon, oseltamivir, pirfenidone, quercetin, remdesivir (GS-5734), ribavirin, ruxolitinib, sirolimus, sofosbuvir, tocilizumab, thymosin alpha-1, triazavirin, and umifenovir. We have additionally included glucocorticosteroids (with or without mineralocorticoids), interferons, statins, and convalescent serum or plasma.
Comparators, participants, follow-up periods, and languages
For clinical studies, eligible studies include patients with mild-to-moderate or severe disease in both outpatient and inpatient settings, with the latter including intensive care unit (ICU) and non-ICU patients. For clinical studies to be included, participants must not just have symptoms compatible with COVID-19 but either laboratory confirmation of infection of respective viruses—severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), severe acute respiratory syndrome coronavirus (SARS-CoV), or Middle Eastern Respiratory Syndrome Coronavirus (MERS-CoV)—or be presumed to be infected on clinical grounds after careful deliberation. No restrictions on minimum follow-up periods or language of the articles are included. Our team includes native speakers of various languages, and additional translator services will be used as needed.
Animal and in vitro studies are eligible for inclusion if they seek to provide evidence on the potential human use of the interventions for the conditions described above. These studies will be summarised separately from the clinical studies in a summary of findings table and visualised together with clinical studies illustrate the current pipeline of evidence for early investigations into new treatments.
Outcomes
Studies are eligible if they include clinical endpoints related to time to clinical improvement, time to viral clearance, mortality, hospital admission or transfer to a higher level of care, including transfer to an ICU or ICU-like setting and total and ICU length of stay, proportion of intubations, length of mechanical ventilation, normalization of selected laboratory data (such as C-reactive protein, d-dimer, lactate dehydrogenase, ferritin, and lymphocyte count), and adverse events.
Study selection, data management, and data extraction
Two reviewers will use the same eligibility criteria to evaluate the studies. Conflicts will be resolved by discussion. Data management for the study selection process will occur in Covidence (Veritas Health Innovation, Melbourne, Australia). Study data will be extracted by one reviewer and verified by a second reviewer. In addition to the outcome measures, the following characteristics of the verified RCTs will be extracted: (1) reference details (including the first author’s last name and the publication year); (2) country of origin; (3) the specific coronavirus studied (SARS-CoV-2, SARS-CoV, or MERS-CoV); (4) type of cell or animal studied (applicable only to in vitro or animal study); (5) blinded versus open-label design (applicable to controlled studies); (6) inclusion and exclusion criteria; (7) baseline patient characteristics, in particular duration since onset of symptoms, outpatient versus non-ICU versus ICU setting, and mild-to-moderate versus severe disease; (8) intervention(s) studied; (9) control(s, if any); (10) total number of participants; (11) primary outcome; (12) secondary outcome(s); (13) results; and (14) conclusions. Corresponding authors will be contacted for clarification where necessary.
Quality and risk of bias assessment
The quality of the available evidence will be evaluated using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework [11] and applied separately for each intervention with one or more included studies in humans. Risk of bias will be assessed for any randomised trials using the revised Cochrane risk of bias tool [12], and the Risk of Bias in Nonrandomised Studies of Interventions (ROBINS-I) tool [11]. Animal and in vitro studies will not be assessed for risk of bias, and a narrative review of these studies will be done separately.
Data synthesis and analysis
The extracted data will be collated and qualitatively synthesized via an interactive mechanism to select, sort, and filter columns for the results tables on our website (www.CovidDrugs.org). We will devise various pre-populated tables that can be viewed and downloaded as well. Tables that include a summary of findings will be developed for each treatment (incorporating multiple outcomes per table) and included on the website as well as in the Additional file 2: Appendix of the manuscript and its updates.
While the review is initially focused on mapping the status and quality of evidence for each of the treatments that are being tested for use in treating COVID-19, we will undertake safety and efficacy meta-analyses where possible. Where multiple controlled studies are available for a similar patient population, we will calculate a relative risk with a 95% confidence interval via a random-effects meta-analysis in RevMan, STATA, or the R metafor package. Heterogeneity will be assessed as τ2. Funnel plots and Egger’s test will be reported to assess publication bias.
Living systematic review
COVID-19 is now endemic and there is a need to identify, review, critically appraise, and synthesize new studies in an ongoing way [13]. Following the first complete publication of the systematic review, it will be transformed into a living and open systematic review [14–17]. This includes automated search updates, semi-automated combining and de-duplicating all search results, and semi-automated updating of included study lists and summary tables made available on the website and in an extensible markup language (XML) stream. As new articles or registrations are identified by daily database searches, these are assigned to reviewers for screening using an alert system. Once screened, their relevance and inclusion status will be updated on the website and in the XML stream. The search terms will be reviewed intermittently and updated by consensus among the reviewer group during meetings, and at least quarterly.
The proposed living systematic review seeks to monitor the quality of evidence for repurposed drugs used in COVID-19. Our initial focus is on providing a platform for capturing relevant controlled studies as they are registered, completed, and reported, as well as animal and in vitro studies that may support the need for clinical studies. Synthesis is focused on visualising important information including the design, grading, risk of bias and extracted summary results. As results for more trials become available, the systematic review will be extended to include individual safety and efficacy meta-analyses for some of the interventions and outcomes. Where future updates include meta-analyses for individual treatments and outcomes, appropriate tests for heterogeneity and meta-biases will be applied.
In terms of dissemination, the completed review manuscript and intermittent updates (e.g., when the number of included studies changes, when a conclusion for any intervention changes, or for any other pre-defined triggers) will be posted to medRxiv. This ensures that each substantial update can be cited but the complete history and most recently available evidence is available in one location with a single digital object identifier (DOI).
We will adapt and use methods from natural language processing and crowd sourcing to support the review process, learning from recently developed tools and processes to add non-human and crowd-based screening and extraction [18–20]. We will open source our methods and results and intend to crowd source future review efforts, which may alter the number of authors on review updates.
Discussion
This systematic review will summarize the emerging evidence on repurposed drugs for the treatment of COVID-19, extrapolating from early evidence for COVID-19 itself as well as SARS and MERS. The protocol extends beyond synthesizing evidence about potential treatment compounds that were identified in a scoping review by the WHO to incorporate pre-print servers and trial registries and to become an ongoing monitoring of the available evidence for each of the treatments. Initial syntheses are focused on mapping the evidence in terms of how much is available across animal, in vitro, and clinical studies, as well as the quality and risks of bias in any clinical studies. This protocol was written in accordance with the PRISMA-P statement (Additional file 1) and is registered with PROSPERO.
The challenge posed by COVID-19 requires not just a rapid review of drugs that can be repurposed but also a sustained effort to monitor the evidence base as it evolves. By incorporating animal and in vitro studies, the approach should be particularly useful in prioritizing candidates for testing in clinical studies and compare across the broad range of drugs that have been proposed. Finally, future investigators could benefit from preliminary estimates of efficacy for power and sample size calculations where appropriate, and their study designs could inform relevant clinical safety and efficacy endpoints as well as gaps in outcome measures that should be incorporated into future studies.
Supplementary Information
Additional file 1. PRISMA-P 2015 Checklist.
Acknowledgements
The authors would like to thank Lisa Liang Philpotts, MSLS of Massachusetts General Hospital, Boston, MA, USA, for reviewing an early version of the search strategy.
Abbreviations
- COVID-19
Coronavirus disease 2019
- GRADE
Grading of Recommendations Assessment, Development and Evaluation
- MERS
Middle Eastern respiratory syndrome
- MERS-CoV
Middle Eastern respiratory syndrome coronavirus
- PRISMA-P
Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols
- PROSPERO
International Prospective Register of Systematic Reviews
- SARS
Severe acute respiratory syndrome
- SARS-CoV
Severe acute respiratory syndrome coronavirus
- SARS-CoV-2
Severe acute respiratory syndrome coronavirus 2
- XML
Extensible Markup Language
- WHO
World Health Organisation
Authors’ contributions
BPG conceived the study, developed the criteria, searched the literature, and wrote the protocol. LZ, AEL, NE, ET, LL, ES, HHC, CBK, KCJ, AA, HY, WCL, and FM assisted in protocol design, managing the literature, selecting the studies, and extracting data. BPG, CB, TLM, DT, LH, DLS, and AGD developed the concept for the automation systems and implemented the website. AGD advised on protocol design and revised the manuscript. All authors read and approved the final manuscript. The opinions or assertions contained herein are the private views of the co-authors and are not to be construed as official or as reflecting true views of their employers.
Funding
DIFUTURE (BPG, LCH) is funded by the German Federal Ministry of Education and Research under 01ZZ1603[A-D] and 01ZZ1804[A-I]. The funding source does not have any role in the decision to publish. Open Access funding enabled and organized by Projekt DEAL.
Availability of data and materials
All data and materials are available at www.CovidDrugs.org.
Declarations
Ethics approval and consent to participate
Not applicable
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Benjamin P. Geisler, Email: bgeisler@post.harvard.edu
Lara Zahabi, Email: larazahabi@gmail.com.
Adam Edward Lang, Email: a.edward.lang@gmail.com.
Naomi Eastwood, Email: naomi.eastwood@nhs.net.
Elaine Tennant, Email: elaine.tennant@gmail.com.
Ljiljana Lukic, Email: lukic.ljilja@gmail.com.
Elad Sharon, Email: sharone@mail.nih.gov.
Hai-Hua Chuang, Email: chhaihua@gmail.com.
Chang-Berm Kang, Email: cbk5000@gmail.com.
Knakita Clayton-Johnson, Email: knakita.cj@gmail.com.
Ahmed Aljaberi, Email: aaljabery17@gmail.com.
Haining Yu, Email: haining.h.yu@gmail.com.
Chinh Bui, Email: chinh@mit.edu.
Tuan Le Mau, Email: tlemau@mit.edu.
Wen-Cheng Li, Email: 620313@cgmh.org.tw.
Debbie Teodorescu, Email: dlteodor@med.harvard.edu.
Ludwig Christian Hinske, Email: ludwig.hinske@med.uni-muenchen.de.
Dennis L. Sun, Email: dsun09@calpoly.edu
Farrin A. Manian, Email: fmanian@mgh.harvard.edu
Adam G. Dunn, Email: adam.dunn@sydney.edu.au
References
- 1.Barro RJ, Ursúa JF, Weng J. The coronavirus and the great influenza pandemic: lessons from the “Spanish flu” for the coronavirus’s potential effects on mortality and economic activity. Cambridge: National Bureau of Economic Research; 2020. [Google Scholar]
- 2.He D, Zhao S, Li Y, Zhuang Z, Cao P, Gao D, Lou Y, Yang L. History is the best model–a comparison of the COVID-19 with the 1918-19 pandemic influenza in United Kingdom. 2020. [Google Scholar]
- 3.Wang Y, Zhang D, Du G, Du R, Zhao J, Jin Y, Fu S, Gao L, Cheng Z, Lu Q, et al. Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial. Lancet. 2020;395(10236):1569–1578. doi: 10.1016/S0140-6736(20)31022-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Beigel JH, Tomashek KM, Dodd LE, Mehta AK, Zingman BS, Kalil AC, Hohmann E, Chu HY, Luetkemeyer A, Kline S, Lopez de Castilla D, Finberg RW, Dierberg K, Tapson V, Hsieh L, Patterson TF, Paredes R, Sweeney DA, Short WR, Touloumi G, Lye DC, Ohmagari N, Oh MD, Ruiz-Palacios GM, Benfield T, Fätkenheuer G, Kortepeter MG, Atmar RL, Creech CB, Lundgren J, Babiker AG, Pett S, Neaton JD, Burgess TH, Bonnett T, Green M, Makowski M, Osinusi A, Nayak S, Lane HC, ACTT-1 Study Group Members Remdesivir for the treatment of Covid-19 — preliminary report. New England J Med. 2020;383(19):1813–1826. doi: 10.1056/NEJMoa2007764. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Mohs RC, Greig NH. Drug discovery and development: role of basic biological research. Alzheimers Dement (N Y) 2017;3(4):651–657. doi: 10.1016/j.trci.2017.10.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Pushpakom S, Iorio F, Eyers PA, Escott KJ, Hopper S, Wells A, Doig A, Guilliams T, Latimer J, McNamee C, Norris A, Sanseau P, Cavalla D, Pirmohamed M. Drug repurposing: progress, challenges and recommendations. Nature Reviews Drug Discovery. 2019;18(1):41–58. doi: 10.1038/nrd.2018.168. [DOI] [PubMed] [Google Scholar]
- 7.Xu J, Zhao S, Teng T, Abdalla AE, Zhu W, Xie L, Wang Y, Guo X. Systematic comparison of two animal-to-human transmitted human coronaviruses: SARS-CoV-2 and SARS-CoV. Viruses. 2020;12(2):244. doi: 10.3390/v12020244. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Rabaan AA, Al-Ahmed SH, Haque S, Sah R, Tiwari R, Malik YS, Dhama K, Yatoo MI, Bonilla-Aldana DK, Rodriguez-Morales AJ. SARS-CoV-2, SARS-CoV, and MERS-COV: a comparative overview. Infez Med. 2020;28(2):174–184. [PubMed] [Google Scholar]
- 9.Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. Brit Med J. 2015;349(jan02 1):g7647. doi: 10.1136/bmj.g7647. [DOI] [PubMed] [Google Scholar]
- 10.World Health Organisation . Landscape analysis of therapeutics as 17 February 2020. 2020. [Google Scholar]
- 11.Andrews JC, Schunemann HJ, Oxman AD, Pottie K, Meerpohl JJ, Coello PA, Rind D, Montori VM, Brito JP, Norris S, et al. GRADE guidelines: 15. Going from evidence to recommendation-determinants of a recommendation's direction and strength. J Clin Epidemiol. 2013;66(7):726–735. doi: 10.1016/j.jclinepi.2013.02.003. [DOI] [PubMed] [Google Scholar]
- 12.Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA: Cochrane handbook for systematic reviews of interventions: Wiley; 2019. 10.1002/9781119536604. [DOI] [PMC free article] [PubMed]
- 13.Glasziou PP, Sanders S, Hoffmann T. Waste in covid-19 research. BMJ. 2020;369:m1847. doi: 10.1136/bmj.m1847. [DOI] [PubMed] [Google Scholar]
- 14.Elliott JH, Synnot A, Turner T, Simmonds M, Akl EA, McDonald S, Salanti G, Meerpohl J, MacLehose H, Hilton J, Tovey D, Shemilt I, Thomas J, Agoritsas T, Hilton J, Perron C, Akl E, Hodder R, Pestridge C, Albrecht L, Horsley T, Platt J, Armstrong R, Nguyen PH, Plovnick R, Arno A, Ivers N, Quinn G, Au A, Johnston R, Rada G, Bagg M, Jones A, Ravaud P, Boden C, Kahale L, Richter B, Boisvert I, Keshavarz H, Ryan R, Brandt L, Kolakowsky-Hayner SA, Salama D, Brazinova A, Nagraj SK, Salanti G, Buchbinder R, Lasserson T, Santaguida L, Champion C, Lawrence R, Santesso N, Chandler J, Les Z, Schünemann HJ, Charidimou A, Leucht S, Shemilt I, Chou R, Low N, Sherifali D, Churchill R, Maas A, Siemieniuk R, Cnossen MC, MacLehose H, Simmonds M, Cossi MJ, Macleod M, Skoetz N, Counotte M, Marshall I, Soares-Weiser K, Craigie S, Marshall R, Srikanth V, Dahm P, Martin N, Sullivan K, Danilkewich A, Martínez García L, Synnot A, Danko K, Mavergames C, Taylor M, Donoghue E, Maxwell LJ, Thayer K, Dressler C, McAuley J, Thomas J, Egan C, McDonald S, Tritton R, Elliott J, McKenzie J, Tsafnat G, Elliott SA, Meerpohl J, Tugwell P, Etxeandia I, Merner B, Turgeon A, Featherstone R, Mondello S, Turner T, Foxlee R, Morley R, van Valkenhoef G, Garner P, Munafo M, Vandvik P, Gerrity M, Munn Z, Wallace B, Glasziou P, Murano M, Wallace SA, Green S, Newman K, Watts C, Grimshaw J, Nieuwlaat R, Weeks L, Gurusamy K, Nikolakopoulou A, Weigl A, Haddaway N, Noel-Storr A, Wells G, Hartling L, O'Connor A, Wiercioch W, Hayden J, Page M, Wolfenden L, Helfand M, Pahwa M, Yepes Nuñez JJ, Higgins J, Pardo JP, Yost J, Hill S, Pearson L. Living systematic review: 1. Introduction-the why, what, when, and how. J Clin Epidemiol. 2017;91:23–30. doi: 10.1016/j.jclinepi.2017.08.010. [DOI] [PubMed] [Google Scholar]
- 15.Thomas J, Noel-Storr A, Marshall I, Wallace B, McDonald S, Mavergames C, Glasziou P, Shemilt I, Synnot A, Turner T, Elliott J, Agoritsas T, Hilton J, Perron C, Akl E, Hodder R, Pestridge C, Albrecht L, Horsley T, Platt J, Armstrong R, Nguyen PH, Plovnick R, Arno A, Ivers N, Quinn G, Au A, Johnston R, Rada G, Bagg M, Jones A, Ravaud P, Boden C, Kahale L, Richter B, Boisvert I, Keshavarz H, Ryan R, Brandt L, Kolakowsky-Hayner SA, Salama D, Brazinova A, Nagraj SK, Salanti G, Buchbinder R, Lasserson T, Santaguida L, Champion C, Lawrence R, Santesso N, Chandler J, Les Z, Schünemann HJ, Charidimou A, Leucht S, Shemilt I, Chou R, Low N, Sherifali D, Churchill R, Maas A, Siemieniuk R, Cnossen MC, MacLehose H, Simmonds M, Cossi MJ, Macleod M, Skoetz N, Counotte M, Marshall I, Soares-Weiser K, Craigie S, Marshall R, Srikanth V, Dahm P, Martin N, Sullivan K, Danilkewich A, Martínez García L, Synnot A, Danko K, Mavergames C, Taylor M, Donoghue E, Maxwell LJ, Thayer K, Dressler C, McAuley J, Thomas J, Egan C, McDonald S, Tritton R, Elliott J, McKenzie J, Tsafnat G, Elliott SA, Meerpohl J, Tugwell P, Etxeandia I, Merner B, Turgeon A, Featherstone R, Mondello S, Turner T, Foxlee R, Morley R, van Valkenhoef G, Garner P, Munafo M, Vandvik P, Gerrity M, Munn Z, Wallace B, Glasziou P, Murano M, Wallace SA, Green S, Newman K, Watts C, Grimshaw J, Nieuwlaat R, Weeks L, Gurusamy K, Nikolakopoulou A, Weigl A, Haddaway N, Noel-Storr A, Wells G, Hartling L, O'Connor A, Wiercioch W, Hayden J, Page M, Wolfenden L, Helfand M, Pahwa M, Yepes Nuñez JJ, Higgins J, Pardo JP, Yost J, Hill S, Pearson L. Living systematic reviews: 2. Combining human and machine effort. J Clin Epidemiol. 2017;91:31–37. doi: 10.1016/j.jclinepi.2017.08.011. [DOI] [PubMed] [Google Scholar]
- 16.Simmonds M, Salanti G, McKenzie J, Elliott J. Living systematic reviews: 3. Statistical methods for updating meta-analyses. J Clin Epidemiol. 2017;91:38–46. doi: 10.1016/j.jclinepi.2017.08.008. [DOI] [PubMed] [Google Scholar]
- 17.Akl EA, Meerpohl JJ, Elliott J, Kahale LA, Schunemann HJ. Living systematic reviews: 4. Living guideline recommendations. J Clin Epidemiol. 2017;91:47–53. doi: 10.1016/j.jclinepi.2017.08.009. [DOI] [PubMed] [Google Scholar]
- 18.Clark J, Glasziou P, Del Mar C, Bannach-Brown A, Stehlik P, Scott AM. A full systematic review was completed in 2 weeks using automation tools: a case study. J Clin Epidemiol. 2020;121:81–90. doi: 10.1016/j.jclinepi.2020.01.008. [DOI] [PubMed] [Google Scholar]
- 19.Martin P, Surian D, Bashir R, Bourgeois FT, Dunn AG. Trial2rev: combining machine learning and crowd-sourcing to create a shared space for updating systematic reviews. JAMIA Open. 2019;2(1):15–22. doi: 10.1093/jamiaopen/ooy062. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Noel-Storr A. Working with a new kind of team: harnessing the wisdom of the crowd in trial identification. EFSA J. 2019;17(S1):e170715. doi: 10.2903/j.efsa.2019.e170715. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Additional file 1. PRISMA-P 2015 Checklist.
Data Availability Statement
All data and materials are available at www.CovidDrugs.org.