Skip to main content
BMJ Open logoLink to BMJ Open
. 2022 Dec 1;12(12):e065407. doi: 10.1136/bmjopen-2022-065407

Impact of health literacy and its interventions on health outcomes in those with atrial fibrillation: a systematic review protocol

Timothy Lathlean 1,2,#, Don Kieu 3,#, Kyle B Franke 1, Nathan O'Callaghan 2,4, Mark A Boyd 1,5, Rajiv Mahajan 1,5,✉
PMCID: PMC9716799  PMID: 36456030

Abstract

Introduction

Atrial fibrillation (AF) is associated with increased risk of stroke, heart failure and death. Health literacy, an aspect that falls within precision health, has been recognised as an important factor. We will be focusing on the impact of these interventions specifically to AF and its health outcomes.

Methods and analysis

This protocol is informed by the Preferred Reporting Items for Systematic review and Meta-Analysis Protocols. The results will be reported in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses to determine the impacts of health literacy interventions on AF outcomes. Searches will be carried out on databases including MEDLINE, EMBASE, Web of Science, CINAHL, Emcare, Cochrane Library and Google Scholar. Citations will be collected via Endnote 20, then into Covidence for duplicate removal, and article screening. Extraction will occur using a standardised extraction tool and studies will be synthesised using best evidence synthesis. Downs and Black’s checklist will be used for risk of bias and assessment of overall quality of evidence will use the Grading of Recommendations, Assessment, Development and Evaluation approach.

Ethics and dissemination

Approval from human research ethics committee is not required. Dissemination will occur in peer-reviewed journals and conference presentations.

PROSPERO registration number

CRD42022304835.

Keywords: Health informatics, Adult cardiology, PREVENTIVE MEDICINE


Strengths and limitations of this study

  • This will be the first review to operationalise health literacy interventions in people with atrial fibrillation.

  • The protocol for this systematic review and meta-analysis follows the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols guidelines.

  • This systematic review will use the Downs and Black checklist for quality appraisal and the Grading of Recommendations, Assessment, Development and Evaluation recommendations for certainty of evidence.

  • The meta-analysis will provide a synthesis of the evidence of health literacy interventions consistent with (a) knowledge, (b) action and (c) health outcomes.

  • Different study designs and definitions of health literacy interventions as well as varied outcomes may limit the ability the extent of comparative analysis.

Introduction

Atrial fibrillation (AF) is the most common sustained cardiac arrhythmia and represents significant morbidity and mortality worldwide.1 The worldwide prevalence of AF is estimated at 0.51% of population and projected to increase further.2 In addition to an increased risk of stroke, heart failure and all-cause death, AF continues to contribute to the growing burden on the healthcare system and its resources.1

Health literacy plays a critical role within a patient’s healthcare and quality of life, and improving it has been a recognised goal by the WHO.3 4 Health literacy has been defined according to three types: functional health literacy, interactive health literacy and critical health literacy.5 It involves people’s knowledge and interactions with health information via four dimensions: accessing, understanding, appraising and applying.6 Health literacy can be considered as an aspect of ‘precision health’, which involves the processes of lifetime monitoring and collection of health data, analysis of collected data and subsequent informed, personalised decision-making and interventions.7–10 A recent scoping review9 identified nine categories of data that can be collected: sociodemographic, anthropometric, clinical, genomic, perspective, behavioural, psychological, nutritional and socioenvironmental data.

Currently, a range of definitions and terms have been used in the health literacy literature, with different aims and contexts, which has created uncertainty and a lack of clarity as to what these constitute. This is particularly pronounced when considering health literacy interventions as a core component of precision health initiatives. Our systematic review and meta-analysis aims to evaluate the effectiveness of health literacy interventions for people with AF. In doing so, we aim to synthesise the current literature to identify the impacts of health literacy interventions on (a) health literacy and knowledge; (b) patient action and behaviour change arising from health literacy and knowledge and (c) health outcomes (eg, quality of life, hospitalisations and/or morbidity/mortality) as a consequence to action taken arising from improvements in health literacy.

Objectives

This systematic review will explore precision health, in particular, the impact of health literacy and its interventions, on AF outcomes. Thus, the systematic review will endeavour to answer the following:

  1. How do health literacy interventions generate additional benefits for precision health initiatives?

  2. What questionnaires and tools are currently available and have been used to assess health literacy interventions generally and in AF?

  3. How effective are health literacy interventions in improving both knowledge and subsequent beneficial actions for AF?

  4. How effective are health literacy interventions that improve knowledge and subsequent beneficial actions in resulting in improved health outcomes such as quality of life, hospitalisations and reduced morbidity/mortality?

Methods

Guidelines and registration

This protocol for our systematic review was done with guidance and adherence to the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols 2015 guidelines,11 12 Cochrane guidelines13 and other reviews already conducted in this area.14 15 Registration was submitted to the International Prospective Register of Systematic Reviews, an international database for systematic reviews prospectively registered by the Centre for Reviews and Dissemination of the University of York (https://www.crd.york.ac.uk/prospero). This occurred on 29 April 2022 and was last updated on 10 May 2022.

Patient and public involvement

None

Eligibility criteria

Selection of studies will consider the following.

Study designs

Randomised control trials and observational studies will be included. Conference presentations, thesis, secondary research (review articles) will be excluded.

Population

Included studies that have enrolled individuals with a primary diagnosis of non-valvular AF. Any age, baseline physical activity or different backgrounds will be considered, as well as those in various settings, such as hospital-based, hospital outpatient clinicals, private clinics, primary care, research-based specialist university clinics. No restrictions will be placed on duration of symptoms or time since diagnosis. Studies in which participants are diagnosed with valvular AF will be excluded.

Interventions

This review will consider studies that evaluate interventions and initiatives focused on health literacy that are aimed at improving any of the following (a) knowledge and/or literacy, (b) patient action and behaviour change and (c) health outcomes, including quality of life, hospitalisations, morbidity/mortality.

Interventions may endeavour to improve any dimension,6 typology5 or similar aspect of health literacy, such as a patient’s ability to read, write, approach numeracy, communicate and/or use electronic technology.16

Interventions considered can address health literacy in any domain6 or setting, and may be in the form of different medium. This can involve face-to-face mediums, such as verbal communication, written communication, visual aids and supportive systems.16 17 We also acknowledge the growing usage of remote mediums and digital initiatives, such as online resources, web-based resources, social media, and mobile applications.

Such intervention fits within Gambhir et al’s7 model of precision health within the ‘Integrated health portal’, allowing for learning and adaptation that feeds back into the rest of the model.

Comparator

In addition to usual clinical care, we will be considering behavioural data, sociodemographic data and clinical data as part of our comparators. Viana et al’s9 scoping review on precision health research showed that these were the top three types of data used for precision health (behavioural (48%), sociodemographic (44%), clinical (43.6%)).

Outcomes

Three categories of outcomes will be collected: outcomes concerned with the knowledge and understanding of AF following intervention; outcomes measuring any resulting patient action following intervention; and finally, outcomes measuring health, wellness and quality of life. Due to the broad nature of measures for outcomes, the following is not an exhaustive list. Any additional outcomes suitable for the three categories listed above will be considered and agreed on by all researchers involved.

Examples of outcomes include:

  • Those related to knowledge and understanding.

    • Test of Functional Health Literacy in Adults (TOFHLA)18/short-TOFHLA (s-TOFHLA).19

    • Rapid Estimate of Adult Literacy in Medicine (REALM)20/REALM-Short Form (REALM-SF).21

    • Medical achievement reading test.22

  • Those related to action.

    • Self-reported measures.

  • Those related to health, wellness, and quality of life.

    • All-cause mortality.

    • Hospitalisations and rehospitalisation rates.

    • Heart function.

    • Quality of life.23

      • Generic instruments: Medical Outcome Study Short-Form 36,24 12-Item Short-Form Health Survey,25 EuroQoL 5-Dimensional.26 27

      • AF-specific instruments: Atrial Fibrillation Effect on QualiTy-of-Life,28 AF-QOL-18,29 QLAF questionnaire,30 Atrial Fibrillation Quality of Life Questionnaire.31

    • Symptom scales.23

    • Physical activity: Internal Physical Activity Questionnaire,32 Lawton-Brody iADL scale,33 Katz-ADL scale.34

    • Self-reported measures.

      • Ability to perform activities of daily life (ADLs).

      • Work and productivity.

Information sources

Searches will be carried out on MEDLINE (via PubMed platform), EMBASE (via OVID platform), Web of Science (via Clarivate platform), CINAHL (via EBSCOhost platform), Emcare (via OVID platform), Cochrane Library and Google Scholar.35

Additionally, to ensure completeness, grey literature36 will be included and citation searching of included articles will be undertaken. Grey literature, or evidence not published in commercial publications can include academic papers, such as theses/dissertations, research and/or governmental reports, conference papers. We intend to search for such literature through resources such as OpenGrey, Scopus and Proquest Digital Dissertations and Digital Dissertations and Conference Papers Index. We also aim to hand-search through relevant conference proceedings and abstracts such as the Cardiac Society of Australia and New Zealand, Asia Pacific Heart Rhythm Society and Heart Rhythm Society conferences.

Search strategy

The draft search strategy was developed initially using the PubMed platform, Medical Subject Headings and key phrases identified during preliminary searches. These were initially performed in January 2022 and then updated in April 2022 and assisted in refining search terms within the (Population, Intervention, Comparator and Outcomes) PICO structure. Phrases specific to the intervention, comparator and outcome components were developed by first identifying core key phrases relevant to our questions, then searching PubMed using these phrases and expanding on synonyms using existing articles and search strategies. We based our search on previous literature including Viana et al’s9 review of precision health. The search will be limited to 2012 onwards as well as English language to minimise risk to including studies published before the research field was mature.

The draft search strategy was reviewed by a librarian specialising in medicine and was also reviewed by the research team. A complete search strategy, which has been adapted to syntax and subject headings of other databases, is included in online supplemental appendix 1.

Supplementary data

bmjopen-2022-065407supp001.pdf (115.9KB, pdf)

Citations from databases will be imported to EndNote 20 (Clarivate Analytics) for article collection, then to Covidence for the remaining processes. Duplicates will be removed electronically via Covidence and checked manually. Eligibility for inclusion will involve two independent reviewers, and first will be done based on title and abstract screening, followed by full-text review. At both stages, reviewers will be blinded to each other’s decisions until discussions occur.

Disagreements between reviewers where one reviewer has recommended a study for inclusion based on full-text review whereas the other has not will automatically be escalated in Covidence. Instances where the third adjudicating reviewer decides yes will be included, whereas those stated no will be excluded. In cases where the third reviewer is uncertain these will be discussed as a group.

Data extraction

Data will be extracted from studies by two independent reviewers using piloting forms and a standardised extraction tool. Extraction will be structured by the following domains:

  1. Article characteristics, which include title, name of first author, publication year, country of study, study type.

  2. Participant details, which include number of participants, demographics, characteristics, study location, recruitment procedures, inclusion and exclusion criteria.

  3. Methods, which include identification of AF, definition and application of precision health initiatives, exposure measurement.

  4. Outcomes, which include measurement tool, timing of measurements, method of aggregation, summary data.

Authors of papers will be contacted to request missing or additional data, where required.

Data synthesis

Best evidence synthesis will be used. Meta-analysis of intervention (effectiveness) can be carried out; however, we will need to account for substantial heterogeneity between and within included studies. Specifically for our review, outcomes will need to be compared according to the specific health literacy intervention carried out. The process for meta-analysis will be informed following data extraction, based on the assumptions of homogeneity.

If homogeneity is sufficient between groups within these categories, a consensus will be reached between all authors regarding the inclusion within the meta-analysis either as a large group or several subgroups. If eligible studies are clearly homogenous, studies will be allocated to appropriate subgroups for analysis. This process will be done by each reviewer independently, determining the factors that would allow for the most accurate comparisons to be made.

In the case of substantial heterogeneity between methods and outcomes and/or instances where there are not sufficient number of outcomes that can be analysed (eg, according to the three questions of (a) knowledge and/or literacy, (b) patient action and behaviour change and (c) health outcomes, including quality of life, hospitalisations, morbidity/mortality) we will carry out the best evidence synthesis in the place of meta-analysis.

To assess the impact of heterogeneity across studies, a statistic test of inconsistency will be carried out, returning I2 which will be reported as a percentage. The Cochrane Handbook for Systematic Reviews of Interventions13 provides a suggested guide for interpretation of I2, group percentages into 0%–40%, 30%–60%, 50%–90%, 75%–100% to potentially mean no importance, moderate, substantial and considerable heterogeneity, respectively. If present, heterogeneity will be explored, and potential options, such as excluding studies with obvious outlying results, will be explored.

Strategies to combat potential publication data will include searches of unpublished studies, contact authors in their respective field and including grey literature. Further statistical tests, such as the Begg and Mazumbar’s rank correlation test and Egger’s linear regression model, may be applied to each category and overall analyses. On publication bias being detected, Duval and Tweedie’s trim and fill correction may be applied and the resultant effect sizes and 95% CIs examined in further detail.

The Downs and Black’s 27-item checklist37 can be used to assess methodological quality of randomised and non-randomised trials. It provides: an overall score for study quality, and a profile of scores for the quality of reporting internal validity, power and external validity.

The data generated from this SR/MA such as Downs and Black’s rating of quality and/or risk of bias as well as data extraction will be available as supplementary material along with the final report/publication.

A Summary of Findings (SoF) will be created using GRADEpro GDT. The SoF will present the following information where appropriate: absolute risks for the treatment and control, estimates of relative risk and a ranking of the quality of the evidence based on the risk of bias, directness, heterogeneity, precision and risk of publication bias of the review results. The Grading of Recommendations, Assessment, Development and Evaluation38 approach will be used to assess quality of evidence.

Clinical implications

This research aims to comprehensively synthesise through systematic review and meta-analysis the existing published and grey literature of health literacy interventions as a component of precision health to improve (a) knowledge and literacy, (b) patient action and behaviour change and (c) health outcomes. We anticipate this information being used to inform the assessment and future implementation of health literacy interventions not only improving the use of such terms in research and practice but having impact on patient outcomes, cost-effectiveness and accessibility.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Twitter: @TimLathlean, @Rajiv_EP

TL and DK contributed equally.

Contributors: All authors (TL, DK, KBF, NO, MAB, RM) have contributed to the focus of this systematic review topic and revisions associated with this protocol manuscript. Specifically, DK, TL and RM were responsible for the initial conceptualisation of this work. TL, DK, RM led the planning and design, and all authors were involved in the conduct and reporting of this manuscript. All authors (TL, DK, KBF, NO, MAB, RM) made substantial contributions to the drafting and critical revision of the work and all authors (TL, DK, KBF, NO, MAB, RM) approved the final manuscript.

Funding: RM has served on the advisory board of Abbott and Medtronic. The University of Adelaide reports receiving on behalf of RM lecture and/or consulting fees from Abbott, Bayer, Biotronik, Medtronic and Pfizer. The University of Adelaide reports receiving on behalf of RM research funding from Abbott, Bayer and Medtronic. The other authors do not report any conflicts of interest with regards to this research.

Competing interests: The University of Adelaide reports receiving on behalf of Dr Mahajan lecture and/or consulting fees from Abbott, Medtronic, Bayer, Biotronik, and Pfizer. The University of Adelaide reports receiving on behalf of Dr Mahajan research funding from Abbott, Bayer, and Medtronic. The remaining authors do not report any conflicts of interest.

Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

Provenance and peer review: Not commissioned; externally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Ethics statements

Patient consent for publication

Not applicable.

References

  • 1.NHFA CSANZ Atrial Fibrillation Guideline Working Group, Brieger D, Amerena J, et al. National heart Foundation of Australia and the cardiac Society of Australia and New Zealand: Australian clinical guidelines for the diagnosis and management of atrial fibrillation 2018. Heart Lung Circ 2018;27:1209–66. 10.1016/j.hlc.2018.06.1043 [DOI] [PubMed] [Google Scholar]
  • 2.Lippi G, Sanchis-Gomar F, Cervellin G. Global epidemiology of atrial fibrillation: an increasing epidemic and public health challenge. Int J Stroke 2021;16:217–21. 10.1177/1747493019897870 [DOI] [PubMed] [Google Scholar]
  • 3.Nutbeam D, Muscat DM. Health promotion glossary 2021. Health Promot Int 2021;36:1578–98. 10.1093/heapro/daaa157 [DOI] [PubMed] [Google Scholar]
  • 4.IPJrMAFTADWHOROfE K. Health literacy : the solid facts, 2013. [Google Scholar]
  • 5.Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int 2000;15:259–67. 10.1093/heapro/15.3.259 [DOI] [Google Scholar]
  • 6.Sørensen K, Van den Broucke S, Fullam J, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health 2012;12:80. 10.1186/1471-2458-12-80 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Gambhir SS, Ge TJ, Vermesh O, et al. Toward achieving precision health. Sci Transl Med 2018;10. 10.1126/scitranslmed.aao3612 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.König IR, Fuchs O, Hansen G, et al. What is precision medicine? Eur Respir J 2017;50:1700391. 10.1183/13993003.00391-2017 [DOI] [PubMed] [Google Scholar]
  • 9.Viana JN, Edney S, Gondalia S, et al. Trends and gaps in precision health research: a scoping review. BMJ Open 2021;11:e056938. 10.1136/bmjopen-2021-056938 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Ginsburg GS, Phillips KA. Precision medicine: from science to value. Health Aff 2018;37:694–701. 10.1377/hlthaff.2017.1624 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Shamseer L, Moher D, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;349:g7647. 10.1136/bmj.g7647 [DOI] [PubMed] [Google Scholar]
  • 12.Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1.. 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Higgins JPT TJ, Chandler J, Cumpston M, et al. Cochrane Handbook for Systematic Reviews of Interventions: Cochrane;, 2022. Available: www.training.cochrane.org/handbook
  • 14.Berkman ND, Sheridan SL, Donahue KE, et al. Health literacy interventions and outcomes: an updated systematic review. Evid Rep Technol Assess 2011;199:1–941. [PMC free article] [PubMed] [Google Scholar]
  • 15.Walters R, Leslie SJ, Polson R, et al. Establishing the efficacy of interventions to improve health literacy and health behaviours: a systematic review. BMC Public Health 2020;20:1040. 10.1186/s12889-020-08991-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Hersh L, Salzman B, Snyderman D. Health literacy in primary care practice. Am Fam Physician 2015;92:118–24. [PubMed] [Google Scholar]
  • 17.Nutbeam D, Lloyd JE. Understanding and responding to health literacy as a social determinant of health. Annu Rev Public Health 2021;42:159–73. 10.1146/annurev-publhealth-090419-102529 [DOI] [PubMed] [Google Scholar]
  • 18.Parker RM, Baker DW, Williams MV, et al. The test of functional health literacy in adults: a new instrument for measuring patients' literacy skills. J Gen Intern Med 1995;10:537–41. [DOI] [PubMed] [Google Scholar]
  • 19.Baker DW, Williams MV, Parker RM, et al. Development of a brief test to measure functional health literacy. Patient Educ Couns 1999;38:33–42. 10.1016/S0738-3991(98)00116-5 [DOI] [PubMed] [Google Scholar]
  • 20.Davis TC, Crouch MA, Long SW, et al. Rapid assessment of literacy levels of adult primary care patients. Fam Med 1991;23:433–5. [PubMed] [Google Scholar]
  • 21.Arozullah AM, Yarnold PR, Bennett CL, et al. Development and validation of a short-form, rapid estimate of adult literacy in medicine. Med Care 2007;45:1026–33. 10.1097/MLR.0b013e3180616c1b [DOI] [PubMed] [Google Scholar]
  • 22.Hanson-Divers EC. Developing a medical achievement reading test to evaluate patient literacy skills: a preliminary study. J Health Care Poor Underserved 1997;8:56–69. 10.1353/hpu.2010.0304 [DOI] [PubMed] [Google Scholar]
  • 23.Aliot E, Botto GL, Crijns HJ, et al. Quality of life in patients with atrial fibrillation: how to assess it and how to improve it. Europace 2014;16:787–96. 10.1093/europace/eut369 [DOI] [PubMed] [Google Scholar]
  • 24. Ware JE, Jr., Sherbourne CD. The mos 36-item short-form health survey (SF-36). I. conceptual framework and item selection. Med Care. 1992;30:473–83. [PubMed] [Google Scholar]
  • 25. Ware J, Jr., Kosinski M, Keller SD. A 12-Item short-form health survey: construction of scales and preliminary tests of reliability and validity.. Med Care. 1996;34:220–33. [DOI] [PubMed] [Google Scholar]
  • 26.Brooks R. EuroQol: the current state of play. Health Policy 1996;37:53–72. 10.1016/0168-8510(96)00822-6 [DOI] [PubMed] [Google Scholar]
  • 27.Rabin R, Charro Fde, de Charro F. EQ-SD: a measure of health status from the EuroQol group. Ann Med 2001;33:337–43. 10.3109/07853890109002087 [DOI] [PubMed] [Google Scholar]
  • 28.Spertus J, Dorian P, Bubien R, et al. Development and validation of the atrial fibrillation effect on quality-of-life (AFEQT) questionnaire in patients with atrial fibrillation. Circ Arrhythm Electrophysiol 2011;4:15–25. 10.1161/CIRCEP.110.958033 [DOI] [PubMed] [Google Scholar]
  • 29.Badia X, Arribas F, Ormaetxe JM, et al. Development of a questionnaire to measure health-related quality of life (HRQoL) in patients with atrial fibrillation (AF-QoL). Health Qual Life Outcomes 2007;5:37. 10.1186/1477-7525-5-37 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Braganca EOV, Filho BL, Maria VH, et al. Validating a new quality of life questionnaire for atrial fibrillation patients. Int J Cardiol 2010;143:391–8. 10.1016/j.ijcard.2009.03.087 [DOI] [PubMed] [Google Scholar]
  • 31.Yamashita T, Kumagai K, Koretsune Y, et al. A new method for evaluating quality of life specific to patients with atrial fibrillation: atrial fibrillation quality of life questionnaire (AFQLQ). Japanese Journal of Electrocardiology 2003;23:332–43. 10.5105/jse.23.332 [DOI] [Google Scholar]
  • 32.Craig CL, Marshall AL, Sjöström M, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc 2003;35:1381–95. 10.1249/01.MSS.0000078924.61453.FB [DOI] [PubMed] [Google Scholar]
  • 33.Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist 1969;9:179–86. 10.1093/geront/9.3_Part_1.179 [DOI] [PubMed] [Google Scholar]
  • 34.Katz S, Downs TD, Cash HR, et al. Progress in development of the index of ADL. Gerontologist 1970;10:20–30. 10.1093/geront/10.1_Part_1.20 [DOI] [PubMed] [Google Scholar]
  • 35.Bramer WM, Rethlefsen ML, Kleijnen J, et al. Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study. Syst Rev 2017;6:245. 10.1186/s13643-017-0644-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Paez A. Gray literature: an important resource in systematic reviews. J Evid Based Med 2017;10:233–40. 10.1111/jebm.12266 [DOI] [PubMed] [Google Scholar]
  • 37.Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 1998;52:377–84. 10.1136/jech.52.6.377 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Guyatt GH, Oxman AD, Vist GE, et al. Grade: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008;336:924–6. 10.1136/bmj.39489.470347.AD [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2022-065407supp001.pdf (115.9KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES