Skip to main content
BMJ Open logoLink to BMJ Open
. 2020 Dec 28;10(12):e038324. doi: 10.1136/bmjopen-2020-038324

Risk factors for mental illness in adults with atopic eczema or psoriasis: protocol for a systematic review

Elizabeth I Adesanya 1,, Yochai Schonmann 2,3, Joseph F Hayes 4, Rohini Mathur 1, Amy R Mulick 1, Lauren Rayner 5, Liam Smeeth 1, Catherine H Smith 6, Sinéad M Langan 1,7, Kathryn E Mansfield 1
PMCID: PMC7772326  PMID: 33372068

Abstract

Introduction

Evidence indicates that people with the common inflammatory skin diseases atopic eczema or psoriasis are at increased risk of mental illness. However, the reasons for the relationship between skin disease and common mental disorders (ie, depression and anxiety) or severe mental illnesses (ie, schizophrenia, bipolar disorder and other psychoses) are unclear. Therefore, we aim to synthesise the available evidence regarding the risk factors for mental illness in adults with atopic eczema or psoriasis.

Methods and analysis

We will conduct a systematic review of randomised controlled trials, cohort, case–control and cross-sectional studies. We will search the following databases from inception to March 2020: Medline, Embase, Global Health, Scopus, the Cochrane Library, Web of Science, Base, PsycInfo, the Global Resource of Eczema Trials, and the grey literature databases Open Grey, PsycExtra and the New York Academy of Medicine Grey Literature Report. We will also search the bibliographies of eligible studies and relevant systematic reviews to identify additional relevant studies. Citation searching of large summary papers will be used to further identify relevant publications. Two reviewers will initially review study titles and abstracts for eligibility, followed by full text screening. We will extract data using a standardised data extraction form. We will assess the risk of bias of included studies using the Quality in Prognosis Studies tool. We will synthesise data narratively, and if studies are sufficiently homogenous, we will consider a meta-analysis. We will assess the quality of the evidence using the Grading of Recommendations, Assessment, Development and Evaluation framework.

Ethics and dissemination

Ethical approval is not required for a systematic review. Results of the review will be published in a peer-reviewed journal and disseminated through conferences.

PROSPERO registration number

CRD42020163941.

Keywords: mental health, eczema, psoriasis, depression & mood disorders, anxiety disorders, schizophrenia & psychotic disorders


Strengths and limitations of this study.

  • This protocol promotes transparent review methods, enables comparison of our final review to our initial plans, minimises risk of bias, and reduces the chance of unplanned duplication.

  • Our systematic review will be the first to critically evaluate studies of the risk factors for mental illness in adults with atopic eczema or psoriasis.

  • We will ensure our review is comprehensive by searching multiple scientific literature databases (including specific grey literature databases), including a range of study types and not limiting to English-language studies.

  • However, the studies we include may use heterogenous methods and be of variable quality, which may limit our ability to calculate pooled estimates from meta-analysis and may limit our conclusions.

Introduction

Psoriasis and atopic eczema are inflammatory skin conditions associated with considerable morbidity and reduced quality of life for both sufferers and their families. Atopic eczema and psoriasis are common in the UK population—psoriasis affects between 1.3% and 2.6% of adults,1 and the prevalence of atopic eczema in adults is approximately 2.5%.2 Similarly, mental illness is common. According to the 2017 Global Burden of Disease Study, mental illness is one of the leading causes of years lived with disability worldwide.3 In England, 17% of adults have common mental disorders (CMD- including depression or anxiety).4 Severe mental illness (SMI—including schizophrenia, bipolar affective disorder and other psychoses) affects nearly 1% of the UK population.4 Individuals with SMI experience substantial health inequalities; they are at increased risk of serious health problems (eg, diabetes mellitus and cardiovascular disease) and die up to 20 years earlier than the general population.4 5

Associations between atopic eczema or psoriasis and mental illness are well established. Evidence suggests that people with atopic eczema or psoriasis are at increased risk of mental illness.6–14 The temporal sequence of the associations between skin disease and mental illness is also well recognised, with evidence suggesting that atopic eczema or psoriasis precedes mental illness diagnosis.10 12 However, the reasons for the relationship between inflammatory skin disease and mental illness are unclear. To the best of our knowledge, there are no existing systematic reviews addressing risk factors for the relationship between atopic eczema or psoriasis and mental illness in adults. Previous systematic reviews have aimed to establish summary measure of effects for the association between either atopic eczema or psoriasis and specific mental illnesses (eg, depression); the majority have focused on the relationship between atopic eczema or psoriasis and CMDs.15–19 One systematic review has investigated the risk factors that mediate the association between atopic eczema and mental illness in children and adolescents only. The majority of studies in this review of children were conducted in European countries or territories. Meta-analysis of the 35 studies included in the review found that although demographic factors such as age, sex and socioeconomic status did not moderate the risk of developing mental illness in children with atopic eczema, children from predominantly minority ethnic backgrounds were more likely to be diagnosed with a mental illness in comparison with their Caucasian counterparts.20

The primary aim of this systematic review will be to explore, synthesise and critically evaluate the strength and quality of all available evidence on the risk factors associated with the development of mental illness (CMDs and SMIs) in adults with atopic eczema or psoriasis. If possible, we will also compare and contrast the risk factors associated with the development of mental illness in adults with atopic eczema to the risk factors in psoriasis. In the context of this systematic review, we will use the term ‘risk factor’ to refer to variables associated with an increased risk of mental illness in individuals with atopic eczema or psoriasis.

Methods

This study protocol adheres to the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P).21

Patient and public involvement

Patients and/or the public were not involved in this systematic review protocol.

Eligibility criteria

We will screen studies for potential inclusion in our review according to the eligibility criteria presented in table 1.

Table 1.

Eligibility criteria

Inclusion criteria Exclusion criteria
Study design and characteristics All RCTs, cohort, case–control and cross-sectional studies where an effect estimate (ie, ratio or difference measures) of the risk factors for mental illness in adults with atopic eczema or psoriasis is reported.
Studies in any language and from any geographical setting will be considered.
Ecological studies, case series studies, case reports and systematic reviews (however, relevant summary reviews will be flagged and reference lists searched for eligible studies).
Studies where correlates (without a measure of effect) have been calculated to estimate the association between a risk factor and mental illness in adults with atopic eczema or psoriasis.
Conference proceedings, letters, editorials, opinion articles and reports (however, relevant conference proceedings/letters will be flagged to try and identify full text).
Participants Human participants aged 18 and over with atopic eczema or psoriasis.
Studies including both adults and children where data for adults is reported separately.
Studies conducted in children or adolescents only.
Animal or cell studies.
Exposure Risk factors for mental illness (CMD or SMI).
Comparators Studies must compare adults with atopic eczema or psoriasis with the risk factors of interest with adults with atopic eczema or psoriasis without the risk factors of interest.
Outcomes Study outcomes must be a CMD or SMI, either clinically diagnosed or self-reported with or without validated tools.

CMD, common mental disorder; RCT, randomised controlled trial; SMI, severe mental illness.

Information sources

We will search the following databases for relevant articles from inception to March 2020: Medline, Embase, Global Health, Scopus, the Cochrane Library (which includes Cochrane Reviews, Cochrane Protocols, Trials, Editorials, Special Collections, Clinical Answers and Other Reviews), Web of Science (which includes the Science Citation Index Expanded, the Social Sciences Citation Index, the Arts & Humanities Citation Index, the Conference Proceedings Citation Index-Science, the Conference Proceedings Citation Index—Social Science & Humanities and the Emerging Sources Citation Index), Base, PsycInfo and the Global Resource of Eczema Trials. Both Medline and Embase capture a large amount of published literature—Medline indexes more than 5200 journals, and Embase indexes almost 8500 journals22 23—while the other databases are likely to contain appropriate papers for this review. To ensure that all relevant literature is included in the review, we will also search for grey literature in Open Grey, the New York Academy of Medicine Grey Literature Report and PsycExtra. Finally, we will search the five largest clinical trial registries—ClinicalTrials.gov, the EU Clinical Trials Register, the Japan Primary Registries Network, International standard Randomised Controlled Trial Number (ISRCTN) and the Australian New Zealand Clinical Trials Registry—to identify relevant trials.24

Search strategy

We will search medical subject headings and free text (in titles, abstracts and keywords) for synonyms relating to three key concepts: (1) ‘risk factors’, (2) ‘atopic eczema or psoriasis’ and (3) ‘mental illness’ (table 2). We will combine the three key concepts in the search strategy using the Boolean logic operator ‘AND’. We have developed and piloted an initial search strategy in the Medline database that has been peer reviewed by a librarian (online supplemental table 1), and we will adapt it appropriately for other databases. We will also manually scrutinise the reference lists and bibliographies of relevant systematic reviews to identify additional papers for inclusion. Finally, we will use citation searching on large summary papers to identify any further relevant publications.

Table 2.

Keywords included in the search strategy for all databases

Search term Keywords
Risk factor terms risk OR risk factor* OR protective factor OR predict* OR correlat* OR associat* OR aetiol* OR etiol* OR relationship OR mediat* OR mechanism* OR caus* OR path*
Atopic eczema or psoriasis terms atopic dermatitis OR eczema OR atopy OR psoriasis OR psoria* OR (pustulo* AND palmopl* OR palmari* OR palmar)
Mental illness terms mental health OR mental* ill* OR mental disorder* OR psychiatr* ill* OR psychiatr* disorder OR psychiatr* disease* OR psychological* ill* OR psychological* disorder* OR psychological* disease* OR affective* OR anxi* OR depress* OR phobi* OR panic OR bipolar* OR schizophrenia OR schizo* OR delusion* OR psychotic* OR psychos#s OR psychological* distress
Supplementary data

bmjopen-2020-038324supp001.pdf (59.1KB, pdf)

Study records

Data management

A single reviewer (EA) will import all results returned from the electronic database searches into the reference management tool EndNote V.X9 (Clarivate Analytics, V.9.2/2019). After identifying and removing duplicate records, we will import the search results into Rayyan (a web application for systematic reviews),25 where the integrated deduplication function will be used to identify any previously missed duplicates.

Study selection

Two reviewers (EA and YS) will independently screen the titles and abstracts of the search results for potentially relevant studies. Both reviewers will then screen the full text of all potentially relevant studies for inclusion using the eligibility criteria. Any disagreements during this process will be discussed by EA and YS, with consultation from a third reviewer (KM) if necessary. We will record and report in a flowchart the reasons for study rejection following full text screening.

Data extraction

We will develop a standardised data extraction form (to extract information described below), which will be piloted by two reviewers (EA and YS) who will extract data from the larger of either 10% or five of the eligible studies. Any disagreements between the two reviewers will be discussed, with a third reviewer (KM) available to arbitrate if required, and changes made to the data extraction form if necessary. A single reviewer (EA) will complete the extraction of data for the remaining studies. We will use a modified version of the Population, Intervention, Comparator(s), Outcome(s) and Study Design (PICOS) framework to summarise data for extraction.26 However, due to the inclusion of observational studies in our review, we will replace the term ‘intervention’ with ‘exposure’, and ‘study design’ will be replaced by ‘study characteristics’. We will extract information for each component of the PICOS framework, in addition to study results for each study included in the review (table 3).

Table 3.

Items that will be collected using the data extraction form

Parameter Information for extraction
Population Participant inclusion and exclusion criteria
Demographic characteristics (age, sex and ethnicity distributions)
Sample size
Exposure Definition and identification of individuals with the risk factor(s) of interest
Number of individuals with the risk factor(s) of interest
Comparator Definition and identification of individuals without the risk factor(s) of interest
Number of individuals without the risk factor(s) of interest
Outcome Definition and identification of mental illness outcome(s)
Number of individuals in exposed and comparison group with the outcome
Study characteristics Bibliographic information (authors, journal, publication year, volume, page numbers and doi)
Study design
Study setting
Study sampling frame
Methods of participant recruitment
Aims and objectives
Study results Unadjusted and fully adjusted effect estimates for the association between risk factors and mental illness
Confounders measured and adjusted for analysis

Exposures

Our exposures of interest will be risk factors for mental illness in people with atopic eczema or psoriasis. We will consider any variable that authors of included papers have conducted analyses to assess whether they are associated with mental illness in people with atopic eczema or psoriasis as potential risk factors. These may include sociodemographic factors (eg, sex, ethnicity and deprivation), lifestyle factors (eg, level of physical activity, diet and alcohol consumption) or environmental factors.

Outcomes

Our primary outcome of interest will be mental illness in individuals with atopic eczema or psoriasis. Mental illness will be grouped into two broad categories (CMD or SMI); unless there are sufficient studies looking at specific mental illnesses (eg, depression), then we will also explore by specific mental illness subgroup. We will include studies regardless of how they capture mental illness outcomes (ie, we will include clinical diagnoses or self-reported mental illness established with or without validated tools).

Risk of bias assessment for individual studies

Two reviewers (EA and YS) will independently assess the risk of bias for the larger of 10%, or five, of the included studies. Any disagreements will be discussed so that a consensus can be reached. A third reviewer (KM) will be available to arbitrate if required. A single reviewer (EA) will then assess risk of bias for the remaining studies. We will use the Quality in Prognosis Studies (QUIPS) tool to assess the risk of bias of included studies.27 QUIPS assesses and evaluates the risk of bias in six different domains: (1) study participation, (2) study attrition, (3) prognostic factor measurement, (4) outcome measurement, (5) study confounding and (6) statistical analysis and reporting.27 For each study included, we will assess and categorise the risk of bias for each domain into one of three qualitative categories (low, moderate or high risk of bias) using the prompting items provided within the tool. We will produce separate risk of bias tables for observational studies and randomised controlled trials (RCTs) along with justifications for the decisions made.

Data synthesis and meta-bias(es)

We will synthesise our results narratively. We will describe and tabulate the results of the studies included in the review according to the study design (RCT, cohort, case–control or cross-sectional studies), skin disease type (either atopic eczema or psoriasis), risk factor under investigation and outcome measure (either CMD or SMI). We will describe and tabulate the results of the RCTs separately from the results of other studies included in the review. If possible, we will also identify risk factors that are common and distinct between atopic eczema and psoriasis. If at least two studies are sufficiently homogeneous (in terms of study design, study population, risk factor assessed and outcome), we will consider a meta-analysis to pool the effect estimates. We will use the I2 statistic to quantify levels of statistical heterogeneity (I2 of 0%–40% may indicate negligible heterogeneity, 30%–60% may indicate moderate heterogeneity, 50%–90% may indicate substantial heterogeneity and 75%–100% may indicate considerable heterogeneity).24 If possible, we will also consider meta-regression to investigate whether study characteristics (eg, study design, risk of bias, study outcome and skin disease) or the demographics of the study population (eg, age and sex) are associated with the magnitude of effects and can explain any observed statistical heterogeneity. We will assess the risk of publication bias for the studies included in the review using funnel plots. We will use STATA V.16.0 to perform all statistical analysis.

Confidence in cumulative evidence

We will use the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) framework to evaluate and summarise the quality of cumulative evidence for each broad outcome (CMD or SMI) and risk factor pair.28 If more than one study are identified for a specific subtype of a CMD or SMI (such as depression or schizophrenia) and a specific risk factor, we will use GRADE to summarise the quality of evidence for that subtype. We will categorise the strength of evidence into four qualitative categories: ‘high’, ‘moderate’, ‘low’ or ‘very low’. The quality of evidence for included studies will be upgraded if there is a large magnitude of effect or a dose-response gradient.28 The quality of evidence will be rated down if there is a high risk of bias, imprecision in the study estimate, a high probability of publication bias or inconsistent results.28 We will present the judgements made during this process in a ‘Summary of Findings’ table.

Ethics and dissemination

As this study is a systematic review that does not involve human participation, we do not require ethical approval. We will disseminate the results of this review by publishing in an open access, peer-reviewed journal and presenting at conferences. We will document any important amendments and protocol deviations, along with justifications, and publish them as an appendix in the final review.

Supplementary Material

Reviewer comments
Author's manuscript

Footnotes

Contributors: EA, SL and KM had the original idea for the review. All authors (EA, YS, JH, RM, AM, LR, LS, CHS, SL and KM) were involved in the design of the study. EA wrote the first draft of the protocol. All authors (EA, YS, JH, RM, AM, LR, LS, CHS, SL and KM) contributed to further drafts and approved the final manuscript. Kate Perris peer reviewed the search strategy.

Funding: EA was funded by a British Skin Foundation (BSF) PhD studentship (Reference: 024/S/18). SL was funded by a Wellcome Trust Senior Clinical Fellowship in Science (Reference: 205039/Z/16/Z).

Competing interests: None declared.

Patient consent for publication: Not required.

Provenance and peer review: Not commissioned; internally peer reviewed.

Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

References

  • 1.Parisi R, Symmons DPM, Griffiths CEM, et al. . Global epidemiology of psoriasis: a systematic review of incidence and prevalence. J Invest Dermatol 2013;133:377–85. 10.1038/jid.2012.339 [DOI] [PubMed] [Google Scholar]
  • 2.Barbarot S, Auziere S, Gadkari A, et al. . Epidemiology of atopic dermatitis in adults: results from an international survey. Allergy 2018;73:1284–93. 10.1111/all.13401 [DOI] [PubMed] [Google Scholar]
  • 3.GBD 2017 Disease and Injury Incidence and Prevalence Collaborators Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990-2017: a systematic analysis for the global burden of disease study 2017. Lancet 2018;392:1789–858. 10.1016/S0140-6736(18)32279-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.NHS Digital Adult psychiatric morbidity survey: survey of mental health and wellbeing, England, 2014. Available: https://digital.nhs.uk/data-and-information/publications/statistical/adult-psychiatric-morbidity-survey/adult-psychiatric-morbidity-survey-survey-of-mental-health-and-wellbeing-england-2014#key-facts [Accessed 21 Jan 2020].
  • 5.Chesney E, Goodwin GM, Fazel S. Risks of all-cause and suicide mortality in mental disorders: a meta-review. World Psychiatry 2014;13:153–60. 10.1002/wps.20128 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Eckert L, Gupta S, Amand C, et al. . Impact of atopic dermatitis on health-related quality of life and productivity in adults in the United States: an analysis using the National health and wellness survey. J Am Acad Dermatol 2017;77:274–9. 10.1016/j.jaad.2017.04.019 [DOI] [PubMed] [Google Scholar]
  • 7.Klokk M, Gotestam KG, Mykletun A. Factors accounting for the association between anxiety and depression, and eczema: the Hordaland health study (husk). BMC Dermatol 2010;10:3. 10.1186/1471-5945-10-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Schmitt J, Romanos M, Pfennig A, et al. . Psychiatric comorbidity in adult eczema. Br J Dermatol 2009;161:878–83. 10.1111/j.1365-2133.2009.09309.x [DOI] [PubMed] [Google Scholar]
  • 9.Ferreira BR, Pio-Abreu JL, Reis JP, et al. . Analysis of the prevalence of mental disorders in psoriasis: the relevance of psychiatric assessment in dermatology. Psychiatr Danub 2017;29:401–6. 10.24869/psyd.2017.401 [DOI] [PubMed] [Google Scholar]
  • 10.Kurd SK, Troxel AB, Crits-Christoph P. The risk of depression, anxiety, and suicidality in patients with psoriasis: a population-based cohort study. Arch Dermatol 2010;146:891–5. 10.1001/archdermatol.2010.186 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.HP T, CL Y, CCE L. Prevalence of schizophrenia in patients with psoriasis: a nationwide study. Dermatologica Sin 2017;35:1–6. [Google Scholar]
  • 12.Schonmann Y, Mansfield KE, Hayes JF, et al. . Atopic eczema in adulthood and risk of depression and anxiety: a population-based cohort study. J Allergy Clin Immunol Pract 2020;8:248–57. 10.1016/j.jaip.2019.08.030 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Drucker AM, Thiruchelvam D, Redelmeier DA. Eczema and subsequent suicide: a matched case-control study. BMJ Open 2018;8:e023776. 10.1136/bmjopen-2018-023776 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Sandhu JK, Wu KK, Bui T-L, et al. . Association between atopic dermatitis and suicidality: a systematic review and meta-analysis. JAMA Dermatol 2019;155:178–87. 10.1001/jamadermatol.2018.4566 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Bao Q, Chen L, Lu Z, et al. . Association between eczema and risk of depression: a systematic review and meta-analysis of 188,495 participants. J Affect Disord 2018;238:458–64. 10.1016/j.jad.2018.05.007 [DOI] [PubMed] [Google Scholar]
  • 16.Rønnstad ATM, Halling-Overgaard A-S, Hamann CR, et al. . Association of atopic dermatitis with depression, anxiety, and suicidal ideation in children and adults: a systematic review and meta-analysis. J Am Acad Dermatol 2018;79:448–56. 10.1016/j.jaad.2018.03.017 [DOI] [PubMed] [Google Scholar]
  • 17.Dowlatshahi EA, Wakkee M, Arends LR, et al. . The prevalence and odds of depressive symptoms and clinical depression in psoriasis patients: a systematic review and meta-analysis. J Invest Dermatol 2014;134:1542–51. 10.1038/jid.2013.508 [DOI] [PubMed] [Google Scholar]
  • 18.Ferreira BIRC, Abreu JLPDC, Reis JPGD, et al. . Psoriasis and associated psychiatric disorders: a systematic review on etiopathogenesis and clinical correlation. J Clin Aesthet Dermatol 2016;9:36–43 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4928455/ [PMC free article] [PubMed] [Google Scholar]
  • 19.Patel KR, Immaneni S, Singam V, et al. . Association between atopic dermatitis, depression, and suicidal ideation: a systematic review and meta-analysis. J Am Acad Dermatol 2019;80:402–10. 10.1016/j.jaad.2018.08.063 [DOI] [PubMed] [Google Scholar]
  • 20.Xie Q-W, Dai X, Tang X, et al. . Risk of mental disorders in children and adolescents with atopic dermatitis: a systematic review and meta-analysis. Front Psychol 2019;10:10. 10.3389/fpsyg.2019.01773 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Moher D, Shamseer L, Clarke M, et al. . Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1. 10.1186/2046-4053-4-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.U.S National Library of Medicine Fact sheet: Medline. Available: https://www.nlm.nih.gov/lstrc/jsel.html [Accessed 27 Jan 2020].
  • 23.Elsevier EMBASE: coverage and content. Available: https://www.elsevier.com/solutions/embase-biomedical-research/embase-coverage-and-content [Accessed 27 Jan 2020].
  • 24.Huser V, Cimino JJ. Evaluating adherence to the International Committee of medical Journal editors' policy of mandatory, timely clinical trial registration. J Am Med Inform Assoc 2013;20:e169–74. 10.1136/amiajnl-2012-001501 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Ouzzani M, Hammady H, Fedorowicz Z, et al. . Rayyan-a web and mobile APP for systematic reviews. Syst Rev 2016;5:210. 10.1186/s13643-016-0384-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Higgins J, Green S. Cochrane Handbook for systematic reviews of interventions: version 5.1.0 (updated March 2011), 2011. Available: www.handbook-5-1.cochrane.org [Accessed 21 Jan 2020].
  • 27.Hayden JA, van der Windt DA, Cartwright JL, et al. . Assessing bias in studies of prognostic factors. Ann Intern Med 2013;158:280–6. 10.7326/0003-4819-158-4-201302190-00009 [DOI] [PubMed] [Google Scholar]
  • 28.Guyatt GH, Oxman AD, Vist GE, et al. . Grade: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008;336:924–6. 10.1136/bmj.39489.470347.AD [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary data

bmjopen-2020-038324supp001.pdf (59.1KB, pdf)

Reviewer comments
Author's manuscript

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group

RESOURCES