Abstract
Objectives
The number of published clinical practice guidelines related to COVID-19 has rapidly increased. This study explored if basic methodological standards of guideline development have been met in the published clinical practice guidelines related to COVID-19.
Study Design and Setting
Rapid systematic review from February 1 until April 27, 2020 using MEDLINE [PubMed], CINAHL [Ebsco], Trip and manual search, including all types of healthcare workers providing any kind of healthcare to any patient population in any setting.
Results
There were 1342 titles screened and 188 guidelines included. The highest average AGREE II domain score was 89% for scope and purpose, the lowest for rigor of development (25%). Only eight guidelines (4%) were based on a systematic literature search and a structured consensus process by representative experts (classified as the highest methodological quality). The majority (156; 83%) was solely built on an informal expert consensus. A process for regular updates was described in 27 guidelines (14%). Patients were included in the development of only one guideline.
Conclusion
Despite clear scope, most publications fell short of basic methodological standards of guideline development. Clinicians should use guidelines that include up-to-date information, were informed by stakeholder involvement, and employed rigorous methodologies.
Keywords: Coronavirus, COVID-19, SARS CoV-2, Recommendations, Guidelines, Clinical practice guidelines
Graphical Abstract
What is new?
Key findings
-
•
Despite clear scope, most guidelines for SARS CoV-2 infections and for other care in the context of COVID-19 fell short of basic methodological standards. Only 4% were based on a systematic literature search and a structured consensus process by representative experts (classified as the highest methodological quality). Patients were included in the development of one guideline. A process for regular updates was described in 14%.
What this adds to what is known?
-
•
Our study explored if basic methodological standards of guideline development have been met in the published clinical practice guidelines related to COVID-19.
What is the implication/what should change now?
-
•
An insufficient consideration of appropriate methodologies in the guideline development process could lead to misleading information, uncertainty among the professionals, and potentially harmful actions for patients. This paper provides an important benchmark for the future assessment of the quality of COVID-19 guidelines.
1. Introduction
The novel Coronavirus Disease 2019 (COVID-19) spread rapidly worldwide and the number of cases increased globally at an accelerated rate [1,2]. While measures are essential to mitigate the impact of the pandemic specifically, we also need immediate and targeted action to continue effective and safe healthcare generally. Necessary actions to avoid collateral damages to patients range from adapting healthcare to maximizing safety while providing continuation of usual healthcare to rapidly restart routine care in the areas where healthcare has been reduced due to mandated lockdowns. Moreover, healthcare workers in close physical contact with patients could be infected or could be unknowingly carriers of the SARS-CoV-2 virus themselves.
Clinical practice guidelines and recommendations are needed to support therapeutic decisions and provide an essential knowledge source, especially in such a new and challenging situation. Clinical practice guidelines are statements that include recommendations intended to optimize patient care which are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options [3,4].
The number of published guidelines and recommendations related to COVID-19 has rapidly increased since February 2020. However, insufficient consideration of appropriate methodologies and rigorous strategies in the guideline development process could lead to misleading information, uncertainty among professionals, and potentially harmful actions for patients [4,5]. The aim of our study was therefore to systematically review and critically appraise clinical practice guidelines related to SARS-CoV-2 infections and the delivery of healthcare in the current context of COVID-19 from a methodological perspective.
2. Methods
2.1. Data sources and searches
We performed a rapid systematic review informed by the Cochrane Rapid Reviews Interim Guidance from the Cochrane Rapid Reviews Methods Group [6] in collaboration with Cochrane Austria. We will provide yearly updates during the pandemic and thereafter, as appropriate, given the currently increasing evidence and the rising number of published guidelines in the context of COVID-19. An international expert task force including representatives from each of the six WHO regions (Europe, America, Africa, Eastern-Mediterranean, South-East Asia, Western-Pacific) defined research questions, keywords, Medical Subject Headings (MeSH) terms and a search strategy for the rapid systematic review. We searched the MEDical Literature Analysis and Retrieval System OnLINE (MEDLINE) [PubMed], the Cumulative Index to Nursing & Allied Health Literature (CINAHL) [Ebsco] and the Turning Research Into Practice (Trip) database on April 27, 2020 (calendar week 17) for medical guidelines and recommendations in the context of the COVID-19 pandemic published after February 1, 2020. An initial limited search was conducted to verify our selection of search terms and proposed strategy. The results of the initial pilot search were discussed with the task force. The search strategy (Supplement Table A) was adapted accordingly and approved before conducting the literature search in MEDLINE, CINAHL and Trip. To identify grey literature [7], the task force members were asked to indicate any additional guidelines and recommendations not identified in the database queries. In addition, we examined the websites of cross-regional associations and institutions at continent level. The study protocol is publicly available at www.researchgate.net (DOI:10.13140/RG.2.2.21293.51689). All task force members completed conflict of interest forms.
2.2. Study selection
Inclusion criteria were (i) guidelines and recommendations related to the COVID-19 situation, (ii) all types of healthcare workers providing any kind of healthcare to any patient population, (iii) any setting (acute care, rehabilitation, long-term care, practice, home visits, etc.). We did not restrict to any specific authors, e.g. from a certain group of health professionals. We excluded documents that only discuss (i) infection control and exposure safety information, (ii) experimental pharmaceutical treatments, (iii) clinical research recommendations, (iv) ethical guidelines, (v) diagnostic procedures or strategies, (vi) results not produced in direct relation to the COVID-19 situation, (vii) textbooks, theoretical exercises, case studies, experience write-ups, and (viii) documents not available in English.
Results from the searches in MEDLINE and CINAHL were downloaded in Covidence (www.covidence.org) and duplicates removed thereafter. One reviewer (MA) screened titles and abstracts for basic inclusion and exclusion criteria as described above. To ensure accuracy of the selection process, 60 percent of the titles and abstracts were independently screened by other reviewers (EMos, VR, TS). Disagreements were resolved through consensus. Reasons for exclusion are provided in a Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flowchart [8] in Figure 1 and in more detail in the supplementary material (Supplement Table B). Following a training session, full text screening was carried out by at least two reviewers per document (MA, LL, EMos, JM, MO, VR, TS). For the planned updates (living review), we will use automated text mining (tm) based on the tm package in R (www.r-project.org) to support abstract screening and study selection.
Fig. 1.
PRISMA chart.
2.3. Data extraction and quality assessment
Data extracted included study characteristics (Supplement Table C), a critical appraisal according to The Appraisal of Guidelines for Research & Evaluation Instrument (AGREE II) [5] and classification of the guidelines according to the Association of the Scientific Medical Societies (AWMF) Guidance Manual and Rules for Guideline Development [9] . The AGREE II is the gold-standard protocol for clinical guideline assessment, development, and reporting [5]. It comprises 23 items assessing six domains including scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, and editorial independence. The AWMF Guidance Manual and Rules for Guideline Development classifies guidelines as being based either on (i) a systematic literature review including a subsequent synthesis of the evidence and a structured consensus process completed by a representative committee (S3), (ii) a systematic literature review and synthesis of the evidence only (S2e), (iii) a structured consensus process completed by a representative committee only (S2k) or (iv) an informal consensus process by a group of experts (S1) [9].
Reviewers pilot-tested the data extraction form on 19 (10%) of the records (Supplement Table C) then independently extracted the data. AGREE II scores were ranked on a Likert scale from 1=strongly disagree to 7=strongly agree. Mean scores between the two reviewers were calculated for each AGREE II item. AGREE II items were summarized into the six domain scores [5]. An overall rating and a qualitative recommendation were assigned and disagreements were resolved through consensus. AGREE domain-level scores were calculated for each publication and mean domain-level scores were formed for the entire dataset and the S3 guidelines separately.
2.4. Data synthesis and analysis
Descriptive statistics were calculated for relevant extraction fields for the entire dataset using Microsoft Excel, including geographic affiliation of authors, publication status, type of recommendation, target population, focus of recommendation, disease/condition, and setting. Other fields are presented narratively, where appropriate. The world map was created in the Free and Open Source Geographic Information System QGIS (https://qgis.org/en/site/). We used the PRISMA checklist for standardized reporting in systematic reviews and meta-analyses as a reference for the reporting of our results (Supplement Table F).
3. Results
In total, we identified 819 records in MEDLINE, 89 in CINAHL and 434 in Trip through our systematic search, and four additional records through other sources (Fig. 1). We retained 397 documents for abstract and full text screening. Of these, 188 guidelines and recommendations met the inclusion criteria and were selected for data extraction and critical appraisal.
3.1. Target areas, professionals, and country representation of authors
The most frequent medical areas addressed in the guidelines were acute COVID-19 care (n = 46; 24%), surgery (n = 41; 22%), oncology (n = 20; 11%), radiology (n = 14; 7%) and cardiology (n = 10; 5%). A third (n = 57; 30%) of the guidelines focused on miscellaneous other medical areas (Supplement Table D). All except four guidelines (184; 98%) targeted physicians. The four guidelines not targeting physicians referred to care delivered by non-physician health professionals, namely pharmacy practice management for hematopoietic cell transplantation and cellular therapy [10], physiotherapy management for COVID-19 in the acute hospital settings [11], and two articles on pharmaceutical care [12,13]. Overall, 84 guidelines (45%) mentioned the work of non-physician health professionals. This includes naming specific professions and/or grouping all non-physician health professionals under members of a healthcare team. Thirty-two (17%) guidelines also targeted patients and/or the general public. Patients were included as reviewers in the development of only one guideline [14]. Experts from 54 countries participated in the guidelines development, with Africa being the least represented continent and North America being the most represented continent (Fig. 2 and Supplement Table G). A process for regular updates was described in 27 guidelines (14%).
Fig. 2.
Country representation of the guideline authors. Absolute and relative frequencies per country are shown in Supplement Table G.
3.2. Critical methodological appraisal
The highest average AGREE II [5] domain score was given for scope and purpose (89%), followed by clarity of presentation (70%) and editorial independence (61%). Stakeholder involvement was on average fulfilled by 43% and applicability by 35%. The lowest average AGREE domain score (25%) was given for rigor of development due to the fact that methods of development were insufficiently or not reported. The domain scores of each guideline are shown in Supplement Table E. The mean overall quality rating of the guidelines was 3.8 (standard deviation +/-1.4) of a maximum score 7.
Eight of all 188 guidelines (4%) [11,14–20] were classified as having the highest methodological level (systematic literature search and structured consensus process by representative experts; S3) [9] (Table 1 ). Twelve guidelines (6%) were solely based on a systematic literature review and synthesis of the evidence (S2e), while a further 12 (6%) were developed using a structured consensus process completed by a representative committee only (S2k). The majority of the guidelines and recommendations, namely 156 (83%), were developed based on an informal consensus process by a group of experts (S1). Papers which referred to a consensus process or expert opinion without providing any details were also assigned to the group of S1 guidelines. An overview about the number of published guidelines regarding their S-classification is depicted separately for each week in Figure 3 . The eight S3 guidelines had an average overall quality rating of 6.7 (standard deviation +/-0.5) of a maximum score 7 and are depicted Table 2 .
Table 1.
Data extraction for the eight publications classified as the highest methodological level (systematic literature search and structured consensus process by representative experts; S3)
| Authors, reference (ID) | Author countries | Publish date | Regular update | History shown | Methods | Peer-review | Risk of bias - AGREE II score | Care focus | Type focus | Disease/condition, if applicable | Setting |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Jin, Cai, Cheng, Cheng, Deng, Fan, Fang, Huang, Huang, Huang [19] (358) | China | 06.02.20 (Up-date published on 04.09.2020 [21]) | no | no | Literature review and expert consensus | yes | 6 | COVID-19 | COVID-19 | Pneumonia | Generic |
| Gralnek, Hassan, Beilenhoff, Antonelli, Ebigbo, Pellisè, Arvanitakis, Bhandari, Bisschops, Van Hooft [16] (302) | Israel, Italy, Germany, Spain, Belgium, UK, the Netherlands, Poland, Greece, Portugal, France, Denmark, Estonia, Slovenia, Croatia, Switzerland, USA | 18.03.20 (Up-dates published on 17.04.2020 and on 08.07.2020 [22]) | yes | yes | Systemic literature review, followed by a formal consensus process by an international group. | yes | 7 | Routine care | Disease-specific | Gastrointestinal endoscopy | Institution |
| Alhazzani, Møller, Arabi, Loeb, Gong, Fan, Oczkowski, Levy, Derde, Dzierba [15] (76) | Canada, Denmark, Saudi Arabia, USA, Netherlands, China, Italy, UAE, Korea, Australia, UK | 28.03.20 (Update published on 28.01.2021 [23]) | no | no | Systematic literature review and consensus process | yes | 7 | COVID-19 | COVID-19 | Management of critically ill adults with Coronavirus Disease 2019 | Acute / ICU |
| Thomas, Baldwin, Bissett, Boden, Gosselink, Granger, Hodgson, Jones, Kho, Moses [11] (696) | Australia, Belgium, Canada, UK | 30.03.20 | yes | no | Web search for evidence and expert consensus process | yes | 7 | COVID-19 | COVID-19 | Physiotherapy | Acute / ICU |
| Sultan, Lim, Altayar, Davitkov, Feuerstein, Siddique, Falck-Ytter, El-Serag [14] (678) | USA | 31.03.20a | yes | no | Rapid review and expert consensus | yes | 7 | COVID-19 | Disease-specific | Gastrointestinal procedures | Generic |
| Motlagh, Yamrali, Azghandi, Azadeh, Vaezi, Ashrafi, Zendehdel, Mirzaei, Basi, Rakhsha [17] (518) | Iran | 01.04.20 | yes | yes | Literature search and nominal group technique | yes | 6 | Routine care | Disease-specific | Cancer | Generic |
| Rubin, Ryerson, Haramati, Sverzellati, Kanne, Raoof, Schluger, Volpi, Yim, Martin [18] (613) | USA, Canada, South Korea, UK, France, Japan, Germany, Netherlands, Italy, China | 07.04.20 (e-pub ahead of print; official publication in July 2020) | no | no | A systematic review to inform the discussion of a 15-person expert panel to address 14 questions, corresponding to 11 decision points within 3 scenarios and 3 additional clinical situations. | unclear | 7 | COVID-19 | COVID-19 | Chest imaging | Generic |
| Zhao, Xie, Wang [20] (789) | China | 09.04.20 (e-pub ahead of print; official publication in July 2020) | yes | no | Literature review and expert consensus | yes | 6.5 | COVID-19 | COVID-19 | Respiratory rehabilitation | Generic |
COVID-19, coronavirus disease 2019; ICU, intensive care unit; UAE, United Arab Emirates; UK, United Kingdom; USA, United States of America.
Conflict of interest was declared in all these S3 guidelines. Options for comments or external review were not given in any of these. AGREE II scores were ranked on a Likert scale from 1 = strongly disagree to 7 = strongly agree. We included up-dates of the guidelines until 08.02.2021.
This paper itself was not updated, but AGA released a formal recommendation on 11.05.20 titled ‘AGA Institute Rapid Review of the Gastrointestinal and Liver Manifestations of COVID-19, Meta-Analysis of International Data, and Recommendations for the Consultative Management of Patients with COVID-19’ with the same purpose [24].
Fig. 3.
Numbers of published guidelines which increased per week separately for each S-level[9] Guidelines were classified according to the Association of the Scientific Medical Societies (AWMF) Guidance Manual and Rules for Guideline Development[9]. S3 is a systematic literature review including a subsequent synthesis of the evidence and a structured consensus process completed by a representative committee. S2e refers to a systematic literature review and synthesis of the evidence only; S2k guidelines are based on a structured consensus process completed by a representative committee only. S2e and S2k are summarized in this graph as S2. S1 in this work includes both, documents based on an informal consensus process by a group of experts as well as expert opinions.
Table 2.
Mean AGREE II domain scores for the eight publications classified as the highest methodological level (systematic literature search and structured consensus process by representative experts; S3)
| Authors, reference (ID) | Domain 1 score: scope & purpose | Domain 2 score: stakeholder involvement | Domain 3 score: rigor of development | Domain 4 score: clarity of presentation | Domain 5 score: applicability | Domain 6 score: editorial independence | Rate the overall quality of this guideline | I would recommend this guideline for use |
|---|---|---|---|---|---|---|---|---|
| Jin, Cai, Cheng, Cheng, Deng, Fan, Fang, Huang, Huang, Huang [19] (358) | 100% | 67% | 77% | 83% | 58% | 100% | 6 | Yes |
| Gralnek, Hassan, Beilenhoff, Antonelli, Ebigbo, Pellisè, Arvanitakis, Bhandari, Bisschops, Van Hooft [16] (302) | 100% | 78% | 94% | 100% | 58% | 100% | 7 | Yes |
| Alhazzani, Møller, Arabi, Loeb, Gong, Fan, Oczkowski, Levy, Derde, Dzierba [15] (76) | 100% | 47% | 85% | 83% | 67% | 100% | 7 | Yes |
| Thomas, Baldwin, Bissett, Boden, Gosselink, Granger, Hodgson, Jones, Kho, Moses [11] (696) | 100% | 67% | 69% | 100% | 71% | 100% | 7 | Yes |
| Sultan, Lim, Altayar, Davitkov, Feuerstein, Siddique, Falck-Ytter, El-Serag [14] (678) | 100% | 89% | 96% | 94% | 63% | 100% | 7 | Yes |
| Motlagh, Yamrali, Azghandi, Azadeh, Vaezi, Ashrafi, Zendehdel, Mirzaei, Basi, Rakhsha [17] (518) | 97% | 69% | 49% | 67% | 46% | 83% | 6 | Yes |
| Rubin, Ryerson, Haramati, Sverzellati, Kanne, Raoof, Schluger, Volpi, Yim, Martin [18] (613) | 100% | 67% | 81% | 100% | 67% | 100% | 7 | Yes |
| Zhao, Xie, Wang [20] (789) | 100% | 56% | 65% | 67% | 75% | 50% | 6.5 | Yes |
AGREE II scores were ranked on a Likert scale from 1 = strongly disagree to 7 = strongly agree.
4. Discussion
A considerable number of medical guidelines and recommendations related to the COVID-19 pandemic were published from February to April 2020. Despite high AGREE II scores for scope and purpose as well as for clarity of presentation, the majority of the guidelines and recommendations fell short of basic standards. This was mainly due to a lack of appropriate methodologies and rigorous strategies in the guideline development process. The quality and methodological limitations of the guidelines should be placed in the context of the current unprecedented situation and the human resources required to produce high-quality guidelines in a timely manner. While systematically developed statements reflecting the current state of knowledge and supporting health professionals in their work during the COVID-19 pandemic have been urgently needed, basic methodological standards in the guideline development process are nevertheless essential to avoid misleading information and potentially harmful actions for patients and the healthcare system as a whole. One S3 guideline [19] with high overall methodological ratings had been published in calendar week six from when we found the first guidelines in our search (Fig. 3), demonstrating that it was possible to produce high-quality work in a short time. Taking more time to develop guidelines therefore may not always lead to a more rigorous methodological basis. Rather, the methodological commitment, expertise of the authors and engagement of appropriate stakeholders might be important for a rigorous development process, independent of the time period after the outbreak when the guideline was published. Many guidelines have been published since the end of April 2020, with better knowledge, experience and more robust literature accompanying the evolution of the pandemic. Further research should monitor the evolving methodological quality of the guidelines and their updates over time. Similar to our study, a review of prediction models for diagnosis and prognosis of COVID-19 concluded that the published models were poorly reported and at high risk of bias [25].
Clinical practice guidelines with the highest methodological quality, classified as S3 according to AWMF, are built on both a systemic literature review and a structured consensus process by representative experts. Only 4% of all guidelines in our study were S3. Another 6% reported solely a structured consensus process without a systematic literature review (classified as S2k according to AWMF). The majority (83%) was based on an informal consensus by a group of experts only. However, even if some guidelines developers might argue that well-designed studies were lacking at a certain time point and a systemic literature review as a basis for the guideline development was therefore not conducted, a structured consensus process could still have been done.
A clear updating process, patient and public involvement, a systematic development processes incorporating systematic review, an explicit recommendation development process (rigor of development domain), and guidance on implementation of these guidelines (applicability domain) are needed areas to improve guideline development quality. Given the increasing evidence related to the COVID-19 pandemic, a clear updating process, as well as information of where previous and later versions of the guideline can be found might be essential information which should be explicitly stated in each document. Although patient and public involvement is recognized as a key component of clinical practice guideline development [26], almost no citizens, patients or their public representatives were involved in the development of any of the documents, except for one guideline [14].
Non-physician health professionals provide essential care, especially in the area of non-pharmacological interventions including physical activity/exercise, activity pacing, pain management, complex chronic disease management, nutrition, speech/aural care, personal care, disability, rehabilitation, substance use, aged care and psychosocial health [27]. Some of these interventions have been continuously provided during the current COVID-19 situation, some health services have not been delivered due to home quarantine and physical distancing [28]. Guidelines and recommendations on how to manage and respond to this situation are often missing. Currently, the majority of the published guidelines, which we reviewed, did not focus on the specific needs of non-physician health professionals who are usually in direct/face-to-face patient contact. However, due to often unclear information about the background and role of each author in the guideline development process, transparency on stakeholder involvement was sometimes lacking and judgment was left to the discretion of the reviewers. Balanced stakeholder involvement as well as explicit information about this process in the paper would be necessary for a transparent guideline development that takes into account different treatment perspectives.
Our study focused on quality criteria of the published guidelines and recommendations. We did not extract, compare and synthesize the medical content of the recommendations, due to the heterogeneity of medical disciplines included in this work. This might be regarded as a limitation of our work. Nevertheless, our results might also contribute to a further conversation on how best to mobilize national and international resources to develop high-quality guidelines in crisis situations in the future.
5. Conclusion
A considerable number of medical guidelines and recommendations were published in the context of the COVID-19 pandemic from February to April 2020. Despite high AGREE II scores for scope and purpose as well as for clarity of presentation, the majority of the guidelines and recommendations fell short of basic methodological standards. This was mainly due to a lack of appropriate methodologies and rigorous strategies in the guideline development process. Updated guidelines should include up-to-date information, transparent stakeholder involvement, consideration of various patient populations, and rigorous strategies and methodologies. Our study will allow clinicians to better select and appraise clinical practice guidelines. It will create awareness and inspire guideline developers, researchers and journal editors to focus on methodological accuracy instead of publishing large quantities of documents which lack basic methodological standards. Future research should monitor the evolving methodological quality of the guidelines and their updates over time. This paper provides an important benchmark for the future quality assessment of COVID-19 guidelines.
Details of ethics approval
Not required.
Consent for publication
All authors have taken an active part in the study and take responsibility for its contents. The publication of this manuscript is approved by all authors
Availability of data and material
All relevant data are up-loaded as supplemental files.
Funding
This study was partly funded by the COVID-19 Rapid Response Funding Scheme of the Vienna Science and Technology Fund (project number COV20-028). The funding institution had no influence on the results of this work.
Patient and public involvement
Three co-authors (JH, SMa and EMor) are patient representatives/advocates and participated in setting up the study concept and design, interpreting the data and writing and reviewing the manuscript.
Protocol
The protocol was published at www.researchgate.net, DOI: 10.13140/RG.2.2.21293.51689.
Funding Source: This study was partly funded by the COVID-19 Rapid Response Funding Scheme of the Vienna Science and Technology Fund (project number COV20-028). The funding institution had no influence on the results of this work.
Registration/Publication: Protocol published at www.researchgate.net, DOI:10.13140/RG.2.2.21293.51689; preliminary results available at https://www.medrxiv.org/content/10.1101/2020.06.19.20134767v1.
Authors’ contributions
MA, EMos, VR, LL, JM, ME, NF, RF, GGä, SMa, SMi, RMo, SMu, SN, MO, JH, GGa, and TS were responsible for the study conceptualization and design. MA, LL, EMos, JM, MO, VR and TS conducted the literature review and extracted and analyzed data. MA, EMos, VR, LL, JM, AA, SB, NB, ME, NF, RF, GGä, SMa, SMi, RMo, EMor, SMu, SN, MO, MSP, JH, GGa, and TS interpreted the data, wrote and reviewed the manuscript. MA, VR and TS were responsible for the visualization, including tables and figures. All authors have been involved in the revision of the manuscript.
Acknowledgments
We would like to thank Mohammed Gamal, Judith Höllebrand, Claudia Oppenauer, Romualdo Ramos, Sinisa Stefanac and Thea Vliet Vlieland for their support in data management and thoughtful advice.
Footnotes
Conflicts of interest: We declare no competing interests related to this work.
Supplementary material associated with this article can be found, in the online version, at doi:10.1016/j.jclinepi.2021.03.005.
Appendix. Supplementary materials
References
- 1.Zhu N, Zhang D, Wang W, Li X, Yang B, Song J., et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. 2020;382:727–733. doi: 10.1056/NEJMoa2001017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.World Health Organization. Clinical management of severe acute respiratory infection when novel coronavirus (2019-nCoV) infection is suspected—interim guidance. World Health Organization. Available at: https://www.who.int/publications-detail/clinical-management-of-severe-acute-respiratory-infection-when-novel-coronavirus-(ncov)-infection-is-suspected. 2020. Accessed April 5, 2020.
- 3.American Academy of Family Physicians (AAFP). Clinical practice guideline manual. Available at: https://www.aafp.org/patient-care/clinical-recommendations/cpg-manual.html. 2017. Accessed May 22, 2020.
- 4.Institute of Medicine . In: Clinical practice guidelines we can trust. Graham R, Mancher M., editors. National Academies Press; Washington, DC: 2011. Committee on standards for developing trustworthy clinical practice guidelines. [PubMed] [Google Scholar]
- 5.Brouwers MC, Kho ME, Browman GP, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ. 2010;182(18):E839–E842. doi: 10.1503/cmaj.090449. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Garritty C GG, Kamel C, King VJ, Nussbaumer-Streit B, Stevens A, Hamel C, et al. 2020. Cochrane rapid reviews interim guidance from the Cochrane rapid reviews methods group. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13(3):141–146. doi: 10.1097/XEB.0000000000000050. [DOI] [PubMed] [Google Scholar]
- 8.Moher D, Liberati A, Tetzlaff J, Altman DG, The PG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7) doi: 10.1371/journal.pmed.1000097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Muche-Borowski C, Selbmann H, Nothacker M, Müller W, Kopp I. 2012. AWMF guidance manual and rules for guideline development. English version. [Google Scholar]
- 10.Mahmoudjafari Z, Alexander M, Roddy J, Shaw R, Shigle TL, Timlin C, et al. American Society for Transplantation and Cellular Therapy Pharmacy Special Interest Group Position Statement on pharmacy practice management and clinical management for COVID-19 in hematopoietic cell transplant and cellular therapy patients in the United States. Biol Blood Marrow Transplant. 2020;26(6):1043–1049. doi: 10.1016/j.bbmt.2020.04.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Thomas P, Baldwin C, Bissett B, Boden I, Gosselink R, Granger CL, et al. Physiotherapy management for COVID-19 in the acute hospital setting: clinical practice recommendations. J Physiother. 2020;66(2):73–82. doi: 10.1016/j.jphys.2020.03.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Song Z, Hu Y, Zheng S, Yang L, Zhao R. Hospital pharmacists’ pharmaceutical care for hospitalized patients with COVID-19: recommendations and guidance from clinical experience. Res Soc Admin Pharm. 2021;17(1):2027–2031. doi: 10.1016/j.sapharm.2020.03.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.S-q Zheng, L Yang, P-x Zhou, H-b Li, Liu F, R-s Zhao. Recommendations and guidance for providing pharmaceutical care services during COVID-19 pandemic: a China perspective. Res Soc Admin Pharm. 2021;17(1):1819–1824. doi: 10.1016/j.sapharm.2020.03.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Sultan S, Lim JK, Altayar O, Davitkov P, Feuerstein JD, Siddique SM, et al. AGA Institute rapid recommendations for gastrointestinal procedures during the COVID-19 pandemic. Gastroenterology. 2020;159:739–758. doi: 10.1053/j.gastro.2020.03.072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Alhazzani W, Møller MH, Arabi YM, Loeb M, Gong Michelle Ng, Fan E, et al. Surviving sepsis campaign: guidelines on the management of critically ill adults with coronavirus disease 2019 (COVID-19) Intensive Care Med. 2020:1–34. doi: 10.1007/s00134-020-06022-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Gralnek IM, Hassan C, Beilenhoff U, Antonelli G, Ebigbo Alanna, Pellisé Maria, et al. ESGE and ESGENA position statement on gastrointestinal endoscopy and the COVID-19 pandemic. Endoscopy. 2020;52:1–818. doi: 10.1055/a-1155-6229. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Motlagh A, Yamrali M, Azghandi S, Azadeh P, Vaezi M, Ashrafi F, et al. COVID19 prevention & care; a cancer specific guideline. Arch Iran Med. 2020;23(4):255–264. doi: 10.34172/aim.2020.07. [DOI] [PubMed] [Google Scholar]
- 18.Rubin GD, Ryerson CJ, Haramati LB, Sverzellati N, Kanne JP, Raoof S, et al. The role of chest imaging in patient management during the COVID-19 pandemic: a multinational consensus statement from the Fleischner Society. Chest. 2020;158(1):106–116. doi: 10.1016/j.chest.2020.04.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Jin Y-H, Cai L, Cheng Z-S, Cheng H, Deng T, Fan Y-P, et al. A rapid advice guideline for the diagnosis and treatment of 2019 novel coronavirus (2019-nCoV) infected pneumonia (standard version) Mil Med Res. 2020;7(1):4. doi: 10.1186/s40779-020-0233-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Zhao H-M, Xie Y-X, Wang C. Recommendations for respiratory rehabilitation in adults with COVID-19. Chin Med J (Engl) 2020;133(13):1595–1602. doi: 10.1097/CM9.0000000000000848. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Jin Y-H, Zhan Q-Y, Peng Z-Y, Ren X-Q, Yin X-T, Cai L, et al. Chemoprophylaxis, diagnosis, treatments, and discharge management of COVID-19: An evidence-based clinical practice guideline (updated version) Mil Med Res. 2020;7(1):1–33. doi: 10.1186/s40779-020-00270-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Gralnek IM, Hassan C, Beilenhoff U, Antonelli G, Ebigbo A, Pellisé M, et al. ESGE and ESGENA position statement on gastrointestinal endoscopy and COVID-19: an update on guidance during the post-lockdown phase and selected results from a membership survey. Endoscopy. 2020;52(10) doi: 10.1055/a-1213-5761. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Alhazzani W, Evans L, Alshamsi F, Møller MH, Ostermann M, Prescott HC, et al. Surviving sepsis campaign guidelines on the management of adults with coronavirus disease 2019 (COVID-19) in the ICU: first update. Crit Care Med. 2021;49(3):e219–e234. doi: 10.1097/CCM.0000000000004899. [DOI] [PubMed] [Google Scholar]
- 24.Sultan S, Altayar O, Siddique SM, Davitkov P, Feuerstein JD, Lim JK, et al. AGA Institute rapid review of the GI and liver manifestations of COVID-19, meta-analysis of international data, and recommendations for the consultative management of patients with COVID-19. Gastroenterology. 2020;159(1):320–334. doi: 10.1053/j.gastro.2020.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, et al. Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal. BMJ. 2020;369 doi: 10.1136/bmj.m1328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Armstrong MJ, Mullins CD, Gronseth GS, Gagliardi AR. Impact of patient involvement on clinical practice guideline development: a parallel group study. Implement Sci. 2018;13(1):55. doi: 10.1186/s13012-018-0745-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet North Am Ed. 2010;376(9756):1923–1958. doi: 10.1016/S0140-6736(10)61854-5. [DOI] [PubMed] [Google Scholar]
- 28.Pan American Health Organization. Rehabilitation considerations during the COV ID-19 outbreak Available at: https://iris.paho.org/handle/10665.2/52035. 2020. Accessed May 22, 2020.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All relevant data are up-loaded as supplemental files.