Abstract
Introduction
COVID-19 is a highly infectious disease, characterised by respiratory, physical and psychological dysfunctions. Rehabilitation could effectively alleviate the symptoms and promote recovery of the physical and mental health of patients with COVID-19. Recently, rehabilitation medical institutions have issued clinical practice guidelines (CPGs) and expert consensus statements involving recommendations for rehabilitation assessments and rehabilitation therapies for COVID-19. This systematic review aims to assess the methodological quality and reporting quality of the guidance documents, evaluate the heterogeneity of the recommendations and summarise the recommendations with respect to rehabilitation assessments and rehabilitation therapies for COVID-19 to provide a quick reference for front-line clinicians, therapists and patients as well as reasonable suggestions for future guidelines.
Methods and analysis
The electronic databases including PubMed, Embase, Chinese Biomedical Literature Database (CBM), Chinese Science and Technology Periodical Database (VIP), Wanfang Database and China National Knowledge Infrastructure (CNKI) and websites of governments or organisations (eg, National Guideline Clearinghouse, Guidelines International Network, National Institute for Health and Clinical Excellence, Scottish Intercollegiate Guidelines Network and WHO) will be searched for eligible CPGs and expert consensus statements from inception to August 2022. CPGs and expert consensus statements published in Chinese or English and presenting recommendations for modern functional rehabilitation techniques and/or traditional Chinese medicine rehabilitation techniques for COVID-19 will be included. Reviews, interpretations, old versions of CPGs and expert consensus statements and those for the management of other diseases during the pandemic will be excluded. Two reviewers will independently review each article, extract data, appraise the methodological quality following the Appraisal of Guidelines for Research & Evaluation II tool and assess the reporting quality with the Reporting Items for Practice Guidelines in Healthcare statement. The Measurement Scale of Rate of Agreement will be used to evaluate the heterogeneity of the recommendations in different CPGs and expert consensus statements. Agreement between reviewers will be calculated using the intraclass correlation coefficient. We will also summarise the recommendations for rehabilitation in patients with COVID-19. The results will be narratively described and presented as tables or figures.
Ethics and dissemination
Ethics approval is not needed for this systematic review because information from published documents will be used. The findings will be submitted for publication in a peer-reviewed journal and reported in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.
PROSPERO registration number
CRD42020190761.
Keywords: COVID-19, rehabilitation medicine, protocols & guidelines
Strengths and limitations of this study.
This systematic review will comprehensively evaluate the methodological and reporting quality of clinical practice guidelines (CPGs) and expert consensus statements, strictly following the Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument and the Reporting Items for Practice Guidelines in Healthcare (RIGHT) statement.
The Measurement Scale of Rate of Agreement will be used to compare the heterogeneity of recommendations in different CPGs and expert consensus statements.
The reviewers will be trained to use the AGREE II instrument and the RIGHT tool, and the intraclass correlation coefficient will be calculated to test the consistency between the two assessors.
This study will include CPGs and expert consensus statements published in Chinese or English, so any guidance produced in other languages will be excluded.
The validity of the recommendations on rehabilitation for patients with COVID-19 cannot be evaluated.
Introduction
COVID-19 was declared a pandemic by the WHO on 11 March 2020 and has affected more than 200 countries, with 551 226 298 confirmed cases and 6 345 595 deaths worldwide until 8 July 2022.1–3 COVID-19 has posed a huge threat to global public health, the economy and other aspects of people’s daily life.4 During hospitalisation, patients with COVID-19 may suffer from multisystem dysfunctions, including respiratory, cardiovascular, haematological, renal, digestive, neurological, psychiatric and metabolic systems.5–7 Of those patients with discharged COVID-19, 76% of them have at least one or more symptoms, the most common symptoms were fatigue or muscle weakness (63%) and sleep difficulties (26%), accompanied by anxiety or depression (23%).8 Meanwhile, COVID-19 vaccination has been developed as a safe and effective strategy to reduce mortality and severe ICU admission.9 Recently, long COVID-19 syndrome has been used to describe persistent or developmental symptoms and signs after acute COVID-19.10 Long COVID-19 syndrome is manifested as fatigue, muscle weakness, sleep difficulties, palpitations, joint/muscle pain, dizziness, chest pain and so on.8 11 Long COVID-19 affects people’s ability to resume normal life and work, increases the medical burden and causes the loss of economy and productivity.10 Therefore, COVID-19 infection and its long-term sequelae are worthy of attention because the function of these people may deteriorate and require social welfares/medical healthcare in the future.12
A systematic review of five randomised controlled trials confirmed that rehabilitation could improve dyspnoea, muscle strength, walking capacity, sit-to-stand performance, anxiety and quality of life of patients with COVID-19.13 Rehabilitation therapies should be carried out as early as possible to reduce the complications and disability rate and improve the patients’ overall function at different stages of COVID-19.5 14 15 So far, numerous clinical practice guidelines (CPGs) and expert consensus statements of rehabilitation for patients with COVID-19 have been published,16–19 and they have been developed to assist practitioners and patients in making decisions about appropriate healthcare for specific circumstances.20 Notwithstanding, the different emphases of the guidelines, inconsistent or biased recommendations, low certainty of evidences in CPGs and expert consensus statements may decrease clinical application.21 22 Moreover, low methodological quality may reduce the reliability of CPGs and expert consensus statements, attenuate compliance of CPGs and expert consensus statements in clinical practice, waste medical resources and lead to confusion among clinicians, therapists and patients.23 24 The reporting quality of CPGs and expert consensus statements are also important. Non-standard reporting can decrease the clarity and integrity of the content, and provide unclear guidance for guideline users.25 Therefore, CPGs and expert consensus statements with high methodological quality and reporting quality can save medical resources and costs and improve patients’ care and safety.
So far, the methodological quality and reporting quality of CPGs and expert consensus statements of rehabilitation for COVID-19 have not been evaluated. Thus, this systematic review aims to assess the methodological quality and reporting quality of CPGs and expert consensus statements of rehabilitation for COVID-19 with the Appraisal of Guidelines for Research & Evaluation (AGREE) II tool and the Reporting Items for Practice Guidelines in Healthcare (RIGHT) statement. Moreover, the heterogeneity of recommendations in different CPGs and expert consensus statements will be appraised using the Measurement Scale of Rate of Agreement (MSRA) and the current recommendations of rehabilitation for COVID-19 will be summarised to provide some valuable suggestions for guideline users and the formulation of related guidelines of rehabilitation for COVID-19 in the future.
Methods and analysis
Protocol registration
This protocol was registered on the International Prospective Register of Systematic Reviews.
Eligibility criteria
Inclusion criteria
The inclusion criteria are: (1) CPGs and expert consensus statements of rehabilitation for COVID-19 issued by nationally or internationally recognised government authorities, medical/academic societies or organisations; (2) CPGs and expert consensus statements focusing on patients with COVID-19. Patients with COVID-19 who are clinically diagnosed using any recognised diagnostic criteria (such as positive real-time quantitative PCR detection of new coronavirus nucleic acid and highly homologous with known new coronavirus26). There are no restrictions on age, gender, race or nationality; (3) CPGs and expert consensus statements that provide recommendations for modern functional rehabilitation techniques (eg, respiratory training, peripheral muscle training, psychosocial support and occupational therapies, etc) and/or traditional Chinese medicine rehabilitation techniques (eg, tuina, acupuncture, moxibustion and Tai Chi, etc); (4) if there are multiple versions of the CPGs and expert consensus statements, the latest version will be included.
Exclusion criteria
CPGs and expert consensus statements not published in Chinese and English, and reviews, interpretations and guidance for the management of other diseases during the pandemic will be excluded.
Search strategy
The databases including PubMed, Embase, Chinese Biomedical Literature Database (CBM), Chinese Science and Technology Periodical Database (VIP), Wanfang Database, and China National Knowledge Infrastructure (CNKI) will be searched from inception to August 2022. In addition, other international online repositories of guidelines, including the National Guideline Clearinghouse, Guidelines International Network, Scottish Intercollegiate Guidelines Network, National Institute for Health and Clinical Excellence and WHO will be searched using terms related to rehabilitation therapies, COVID-19, guidelines and expert consensus statements. The full-search strategies of each database are displayed in online supplemental file 1. The relevant websites of advising bodies or healthcare organisations (such as the European Society of Physical and Rehabilitation Medicine, American Congress of Rehabilitation Medicine, Canadian Association of Physical Medicine and Rehabilitation, etc) will also be searched. Rehabilitation experts in this field will be consulted, and the reference lists of potentially eligible citations will be reviewed. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flowchart is demonstrated in online supplemental file 2.
bmjopen-2022-060767supp001.pdf (118.2KB, pdf)
bmjopen-2022-060767supp002.pdf (395.5KB, pdf)
Study selection
All retrieved records will be imported into EndNote V.X9 reference management software. After removing the duplicates, two reviewers (YZ and Y-XL) will independently review the titles and abstracts to identify potential records and download the full texts for further screening. Any disagreements will be resolved in discussion with a third reviewer (JL).
Data extraction
Two reviewers (D-LZ and Y-XL) will extract the data independently using a standardised data extraction form, including: (1) the characteristics of CPGs and expert consensus statements: title, country of origin and publication year; (2) stages of disease; (3) recommended rehabilitation assessments; (4) recommended rehabilitation treatment; (5) related contents of methodological quality and reporting quality. The extracted data will be cross-checked by two reviewers, and any disagreements will be resolved through team discussion.
Quality assessment
The methodological quality and reporting quality of the included CPGs and expert consensus statements will be evaluated using AGREE II tool and RIGHT statement, respectively. Two assessors (YZ and Y-YZ) will study the AGREE II User’s Manual and appraise guidelines with My AGREE PLUS online appraisal platform (www.agreetrust.org) to practice the AGREE II tool. Two assessors (Y-XL and D-LZ) will study RIGHT checklist and detailed explanatory documents with examples (www.annals.org). Trained assessors will preassess and discuss the samples of eligible records and then independently assess the methodological quality and reporting quality of the included CPGs and expert consensus statements. Discrepancies will be discussed and resolved through consultation with a third reviewer (R-JJ).
Methodological quality
The AGREE II instrument is developed to evaluate the development and methodological quality of guidelines with high construct validity.27 The AGREE II consists of two overall assessment with 23 items covering six domains: (1) scope and purpose (items 1–3), (2) stakeholder involvement (items 4–6), (3) rigour of development (items 7–14), (4) clarity of presentation (items 15–17), (5) applicability (items 18–21) and (6) editorial independence (items 22–23). Each item is ranked on a seven-point scale (1: strongly disagree to 7: strongly agree), and the standardised score is calculated using the AGREE II formula ((obtained score from all raters—minimum possible score from all raters)/(maximum possible score for all raters—minimum possible score for all raters))×100. According to the criteria of previous guideline appraisals, 5 or 6 domains scoring >60% are usually considered as high quality, 3 or 4 domains scoring >60% are usually considered as moderate quality, 2 or fewer domains scoring >60% are usually considered as low quality.28 29
Reporting quality
The RIGHT statement is used to evaluate the reporting quality of the CPGs and expert consensus statements, which helps to report guidelines transparently and standardly.25 It includes seven domains (22 items in total): (1) basic information (items 1–4), (2) background (items 5–9), (3) evidence (items 10–12), (4) recommendations (items 13–15), (5) review and quality assurance (items 16–17), (6) funding, declaration and management of interest (items 18–19) and (7) other information (items 20–22). Each item is judged as ‘yes’ (relevant information is sufficiently reported) or ‘no’ (relevant information is lacking).30
Heterogeneity assessment in rehabilitation entries
If at least four CPGs and expert consensus statements recommend similar rehabilitation suggestions for patients with COVID-19, the MSRA will be used to compare the heterogeneity of this recommendation in different CPGs and expert consensus statements.31–33 The scoring criteria are 0%–20%: radically different; 20%–40%: numerous major differences; 40%–60%: some major differences; 60%–80%: only minor differences; 80%–100%: essentially identical.34 35
Data analysis
To assess the agreement between reviewers, the intraclass correlation coefficient (ICC) will be calculated using SPSS V.25.0. The scores will be defined as: poor 0.0–0.2, fair 0.21–0.4, moderate 0.41–0.6, good 0.61–0.8 and very good 0.81–1.00.36
The recommended rehabilitation assessments and therapies will be presented in textual description and tables. We will stratify our findings according to the clinical staging system of COVID-19 (including early, development, critical and recovery stage). The reporting rate of each item and overall rate will be listed in tables to reflect the methodological quality and reporting quality of the included CPGs and expert consensus statements.
Patient and public involvement
None.
Ethics and dissemination
No ethics approval is required for this systematic review because information from published documents will be used. Our findings will be published in a peer-reviewed journal and reported in accordance with PRISMA guidelines.
Discussion
This systematic review has several strengths. Firstly, to our knowledge, this will be the first systematic review to comprehensively assess the methodological quality and reporting quality of CPGs and expert consensus statements on rehabilitation for COVID-19. Secondly, the appraisers will be extensively trained to use the AGREE II instrument and the RIGHT tool, and ICC will be calculated to test the consistency between the assessors. Thirdly, the MSRA will be used to evaluate the heterogeneity of recommendations in the CPGs and expert consensus statements. Fourthly, we will summarise the recommendations of rehabilitation assessments and therapies for COVID-19 in CPGs and expert consensus statements according to the disease stages.
Nonetheless, this study also has some limitations. Firstly, there may be language bias as only CPGs and expert consensus statements published in Chinese or English will be included. Secondly, the validity of the recommendations on rehabilitation for COVID-19 cannot be evaluated.
It is anticipated that the findings will provide reasonable suggestions to develop higher quality CPGs and expert consensus statements or improve existing guidelines, and quick references for COVID-19 rehabilitation therapies for clinicians, therapist and patients.
Supplementary Material
Acknowledgments
We acknowledge Home for researchers editorial team for the linguistic editing and proofreading during the preparation of this manuscript.
Footnotes
YZ, Y-XL and D-LZ contributed equally.
Contributors: JL designed the study. YZ, Y-XL and D-LZ drafted the manuscript. Y-XL and YZ will search the literature. YZ, Y-YZ, Y-XL and D-LZ will conduct the quality assessment. D-LZ and Y-XL will analyse the data. R-JJ and JL revised the manuscript. YZ, Y-XL and D-LZ contributed equally to this work and shared first authorship. All authors approved the manuscript.
Funding: This work will be supported by the Department of Science and Technology of Sichuan Province (No. 2019YFS0019) and Sichuan Province Science and Technology Support Program in Sichuan (No. 2014SZ0154). The funder has no role in developing this protocol.
Competing interests: None declared.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review: Not commissioned; externally peer reviewed.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
Ethics statements
Patient consent for publication
Not applicable.
References
- 1.Munster VJ, Koopmans M, van Doremalen N, et al. A Novel Coronavirus Emerging in China - Key Questions for Impact Assessment. N Engl J Med 2020;382:692–4. 10.1056/NEJMp2000929 [DOI] [PubMed] [Google Scholar]
- 2.Wu Z, McGoogan JM. Characteristics of and Important Lessons From the Coronavirus Disease 2019 (COVID-19) Outbreak in China: Summary of a Report of 72 314 Cases From the Chinese Center for Disease Control and Prevention. JAMA 2020;323:1239–42. 10.1001/jama.2020.2648 [DOI] [PubMed] [Google Scholar]
- 3.World Health Organization . WHO coronavirus (COVID-19) Dashboard, 2021. Available: https://covid19.who.int/
- 4.Agostini F, Mangone M, Ruiu P, et al. Rehabilitation setting during and after Covid-19: an overview on recommendations. J Rehabil Med 2021;53:jrm00141. 10.2340/16501977-2776 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Kurtaiş Aytür Y, Füsun Köseoglu B, Özyemişci Taşkıran Özden, et al. Pulmonary rehabilitation principles in SARS-COV-2 infection (COVID-19): the revised guideline for the acute, subacute, and post-COVID-19 rehabilitation. Turk J Phys Med Rehabil 2021;67:129–45. 10.5606/tftrd.2021.8821 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.McPeake J, Shaw M, MacTavish P, et al. Long-Term outcomes following severe COVID-19 infection: a propensity matched cohort study. BMJ Open Respir Res 2021;8:e001080. 10.1136/bmjresp-2021-001080 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Yan Z, Yang M, Lai C-L. Long COVID-19 syndrome: a comprehensive review of its effect on various organ systems and recommendation on rehabilitation plans. Biomedicines 2021;9. 10.3390/biomedicines9080966. [Epub ahead of print: 05 08 2021]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Huang C, Huang L, Wang Y, et al. 6-Month consequences of COVID-19 in patients discharged from Hospital: a cohort study. Lancet 2021;397:220–32. 10.1016/S0140-6736(20)32656-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Yan Z, Yang M, Lai C-L. COVID-19 vaccinations: a comprehensive review of their safety and efficacy in special populations. Vaccines 2021;9. 10.3390/vaccines9101097. [Epub ahead of print: 28 09 2021]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.The Lancet . Understanding long COVID: a modern medical challenge. Lancet 2021;398:725. 10.1016/S0140-6736(21)01900-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Huang L, Yao Q, Gu X, et al. 1-Year outcomes in hospital survivors with COVID-19: a longitudinal cohort study. Lancet 2021;398:747–58. 10.1016/S0140-6736(21)01755-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Yan Z-P, Yang M, Lai C-L. COVID-19 vaccines: a review of the safety and efficacy of current clinical trials. Pharmaceuticals 2021;14. 10.3390/ph14050406. [Epub ahead of print: 25 04 2021]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Fugazzaro S, Contri A, Esseroukh O, et al. Rehabilitation interventions for post-acute COVID-19 syndrome: a systematic review. Int J Environ Res Public Health 2022;19. 10.3390/ijerph19095185. [Epub ahead of print: 24 04 2022]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.XIE Y. Rehabilitation treatment of novel coronavirus pneumonia patients. Journal of Fujian University of Traditional Chinese Medicine 2020;30:5–6. [Google Scholar]
- 15.Zhao H-M, Yu P-M, Wang C. Future pulmonary rehabilitation perspectives following coronavirus disease 2019 in China. Chin Med J 2021;134:2045–7. 10.1097/CM9.0000000000001700 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Society C, Physicians CAoC . Guidelines for diagnosis, treatment and prevention of coronavirus diseases in Chinese adults in 2019. Natl Med J China 2021:1–64. [Google Scholar]
- 17.Association CM, China W-FCCi, Association CH . Consensus of framework and protocol of rehabilitation of coronavirus disease 2019 using WHO-FICs. Chin J Rehabil Theory Pract 2020. [Google Scholar]
- 18.Branch CMAPMaR . Experts consensus on rehabilitation of coronavirus disease 2019. West China Medical Journal 2020;35. [Google Scholar]
- 19.Chinese Association of Rehabilitation Medicine, Respiratory Rehabilitation Committee of Chinese Association of Rehabilitation Medicine, Cardiopulmonary Rehabilitation Group of Chinese Society of Physical Medicine and Rehabilitation . [Recommendations for respiratory rehabilitation of coronavirus disease 2019 in adult]. Zhonghua Jie He He Hu Xi Za Zhi 2020;43:308–14. 10.3760/cma.j.cn112147-20200228-00206 [DOI] [PubMed] [Google Scholar]
- 20.Institute of Medicine Committee on Standards for Developing Trustworthy Clinical Practice G Graham R, Mancher M, Miller Wolman D, eds. Clinical practice guidelines we can trust. Washington (DC): National Academies Press (US), 2011. [PubMed] [Google Scholar]
- 21.Radwan M, Akbari Sari A, Rashidian A, et al. Appraising the methodological quality of the clinical practice guideline for diabetes mellitus using the agree II instrument: a methodological evaluation. JRSM Open 2017;8:205427041668267. 10.1177/2054270416682673 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Vähäniemi A, Välimäki M, Pekurinen V, et al. Quality and utilization of the Finnish clinical practice guideline in schizophrenia: evaluation using agree II and the vignette approach. Neuropsychiatr Dis Treat 2019;15:1239–48. 10.2147/NDT.S192752 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Zhu B, Liu Y, Wang H, et al. Clinical guidelines of UTIs in children: quality appraisal with agree II and recommendations analysis. BMJ Open 2022;12:e057736. 10.1136/bmjopen-2021-057736 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Fan Y, Zhang G, Zhang Z, et al. Critical appraisal of guidelines for antithrombotic therapy in atrial fibrillation Post-Percutaneous coronary intervention. Glob Heart 2022;17:14. 10.5334/gh.1104 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Chen Y, Yang K, Marušic A, et al. A reporting tool for practice guidelines in health care: the right statement. Ann Intern Med 2017;166:128–32. 10.7326/M16-1565 [DOI] [PubMed] [Google Scholar]
- 26.China NHCotPsRo, Medicine TpsRoCSAof C . Diagnosis and treatment plan of novel coronavirus (trial eighth edition). Infect Dis Info 2020;33:289–96. [Google Scholar]
- 27.Brouwers MC, Kho ME, Browman GP, et al. Development of the AGREE II, part 2: assessment of validity of items and tools to support application. CMAJ 2010;182:E472–8. 10.1503/cmaj.091716 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Armstrong JJ, Rodrigues IB, Wasiuta T, et al. Quality assessment of osteoporosis clinical practice guidelines for physical activity and safe movement: an agree II appraisal. Arch Osteoporos 2016;11:6. 10.1007/s11657-016-0260-9 [DOI] [PubMed] [Google Scholar]
- 29.Knight S, Takagi M, Fisher E, et al. A systematic critical appraisal of evidence-based clinical practice guidelines for the rehabilitation of children with moderate or severe acquired brain injury. Arch Phys Med Rehabil 2019;100:711–23. 10.1016/j.apmr.2018.05.031 [DOI] [PubMed] [Google Scholar]
- 30.Liu K, Ma Y, Yang Y, et al. Evaluation of the reporting quality of clinical practice guidelines on prostate cancer using the right checklist. Ann Transl Med 2021;9:1173. 10.21037/atm-21-2956 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Li J-X, Shi Y-M, An L-Y, et al. Quality assessment of the guidelines for the management of malignant pleural effusions and ascites. World J Surg Oncol 2020;18:331. 10.1186/s12957-020-02097-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Yi K-Q, Yang T, Yang Y-M, et al. Appraisal of the diagnostic procedures of acute pancreatitis in the guidelines. Syst Rev 2021;10:17. 10.1186/s13643-020-01559-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Zhao X-H, Yang T, Ma X-D, et al. Heterogeneity of nutrition care procedures in nutrition guidelines for cancer patients. Clin Nutr 2020;39:1692–704. 10.1016/j.clnu.2019.08.022 [DOI] [PubMed] [Google Scholar]
- 34.Pentheroudakis G, Stahel R, Hansen H, et al. Heterogeneity in cancer guidelines: should we eradicate or tolerate? Ann Oncol 2008;19:2067–78. 10.1093/annonc/mdn418 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Wang X, Yang Y-M, Yang T, et al. Evaluation of pharmacotherapy recommendations in guidelines for inflammatory bowel disease. J Clin Pharm Ther 2021;46:599–609. 10.1111/jcpt.13368 [DOI] [PubMed] [Google Scholar]
- 36.Kiriakova V, Cooray SD, Yeganeh L, et al. Management of bone health in women with premature ovarian insufficiency: systematic appraisal of clinical practice guidelines and algorithm development. Maturitas 2019;128:70–80. 10.1016/j.maturitas.2019.07.021 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
bmjopen-2022-060767supp001.pdf (118.2KB, pdf)
bmjopen-2022-060767supp002.pdf (395.5KB, pdf)