Skip to main content
Medicine logoLink to Medicine
. 2018 Jun 15;97(24):e11094. doi: 10.1097/MD.0000000000011094

High-density lipoprotein-cholesterol functionality and metabolic syndrome

Protocol for review and meta-analysis

Leonardo Roever a,, Elmiro Santos Resende a, Angélica Lemos Debs Diniz a, Nilson Penha-Silva a, João Lucas O’Connell a, Paulo Fernando Silva Gomes a, Hugo Ribeiro Zanetti a,b, Anaisa Silva Roerver-Borges b, Fernando César Veloso a, Fernanda Rodrigues de Souza a, Poliana Rodrigues Alves Duarte a, Thiago Montes Fidale a, Antonio Casella-Filho c, Paulo Magno Martins Dourado c, Antonio Carlos Palandri Chagas c,d, Sadeq Ali-Hasan-Al-Saegh e, Paulo Eduardo Ocke Reis f, Rogério de Melo Costa Pinto a, Gustavo BF Oliveira g, Álvaro Avezum g, Mansueto Neto h, André Rodrigues Durães h, Rose Mary Ferreira Lisboa da Silva i, Antonio José Grande j, Celise Denardi k, Renato Delascio Lopes l, Nitesh Nerlekar m, Shahab Alizadeh n, Adrian V Hernandez o, Maria Inês da Rosa p, Giuseppe Biondi-Zoccai q, for the Brazilian Network of Research in Meta-analysis (BRAMETIS)
PMCID: PMC6023647  PMID: 29901625

Abstract

Introduction:

The prevalence of metabolic syndrome (MetS) and MetS-related stroke is set to increase dramatically in coming decades. MetS is a complex disease that includes endothelial dysfunction, insulin resistance, diabetes, hypertension, ectopic obesity, and dyslipidaemia and an increased risk of cardiovascular events. One function of high-density lipoprotein (HDL) cholesterol (HDL-C) is the cholesterol-efflux pathway, which is the pathway where cholesterol is removed from macrophages within the arterial walls back into the bloodstream and out to the liver. As one of the key functions of HDL, their hypothesis was that if they could measure HDL-C-efflux capacity, they would have a better handle on the role of HDL in atherosclerosis. However, there are no systematic analyses or well-conducted meta-analyses to evaluate the relationship between HDL-C functionality and MetS. The aim of this study is to examine this association of HDL-C functionality with MetS in different ages and sex.

Methods and analysis:

The update systematic review and meta-analysis will be conducted using published studies that will be identified from electronic databases (i.e., PubMed, EMBASE, Web of Science, and Google Scholar). Studies that examined the association between HDL-C functionality and MetS; focused on cohort, case-control, and cross-sectional studies; were conducted among in adults aged 40 to 70 years; provided sufficient data for calculating odds ratio or relative risk with a 95% confidence interval; were published as original articles written in English or other languages; and have been published until January 2018 will be included. Study selection, data collection, quality assessment, and statistical syntheses will be conducted based on discussions among investigators.

Ethics and dissemination:

Ethics approval was not required for this study because it was based on published studies. The results and findings of this study will be submitted and published in a scientific peer-reviewed journal.

Trial registration number: PROSPERO (CRD42018083465).

Keywords: lipids, metabolic syndrome, systematic review


Strengths and limitations of this study

This systematic review and meta-analysis will offer better understanding regarding the association between high-density lipoprotein-cholesterol (HDL-C) functionality and metabolic syndrome (MetS).

The findings from this study will be useful for assessing of HDL-C functionality and the risk factors in MetS, and determining approaches for prevention of MetS the future.

An improved understanding of this relationship may help to inform public health MetS prevention strategies.

Included studies may have substantially different methodologies, which could limit our ability to draw reliable conclusions from the existing evidence base. Depending on the results, confounding factors that were not adjusted for in the selected studies and low generalizability can be limitations. Individual patient data will not be available.

1. Background

The prevalence of MetS and MetS-related stroke is set to increase dramatically in coming decades. The MetS describes an association between endothelial dysfunction, insulin resistance, diabetes, hypertension, ectopic obesity, and dyslipidemia and an increased risk of cardiovascular disease and stroke.[17]

It is in large part the result of unbalanced diet, low socioeconomic and cultural level, stress, and sedentary lifestyle. One functions of HDL-C is the cholesterol-efflux pathway, which is the pathway wherein cholesterol is removed from macrophages within the arterial walls back into the bloodstream and out to the liver. As one of the key functions of HDL, their hypothesis was that if they could measure HDL-C-efflux capacity, they would have a better handle on the role of HDL in atherosclerosis.[110]

This study aims to systematically assess the association between HDL-C functionality and MetS in adults aged 34 to 70 years, and to provide a framework to further understand these factors to better target prevention strategies.

2. Objectives

The primary objective is to identify and summarize the association of HDL-C functionality with MetS in adults (34–70 years) in different ages and sex. The objective of this systematic review and meta-analysis was to explore the association between HDL-C functionality and the presence of MetS. The secondary objectives will be to assess whether the the HDL-C dysfunctionality is associated with an additional risk and is a predictor of cardiovascular events and mortality (cardiovascular [CV] - mortality, mortality, and all causes of mortality).

3. Methods/design

This systematic review of the literature will follow the PRISMA recommendations. The databases PubMed, Embase, Web of Science, Google scholar, and Cochrane were searched for articles. Our search will focus on cohort, case-control, and cross-sectional studies examining the association between very low HDL-C functionality and MetS. Two reviewers will independently screen articles, extract relevant data, and assess the quality of the studies.

MetS will be defined according to the unified definition of MetS based on a Joint Interim Statement of the International Diabetes Federation Task Force on Epidemiology and Prevention; National Heart, Lung, and Blood Institute; American Heart Association; World Heart Federation; International Atherosclerosis Society; and International Association for the Study of Obesity. We also consider the patients with the MetS diagnosis based on previous definitions, mainly based on the National Cholesterol Education Program's Adult Treatment Panel III. Individuals will be classified as having MetS if they have ≥ of the followings from UHS Visit: elevated BP (systolic BP ≥130 mmHg or diastolic BP ≥85 mmHg); elevated TG (≥150 mg/dL); low HDL-C (men <40 mg/dL, women <50 mg/dL); impaired fasting glucose (>100 mg/dL); and elevated waist circumference (men ≥94 cm, women ≥80 cm). Diabetes will be defined as a fasting plasma glucose level ≥126 mg/dL. Impaired fasting glucose will be defined as a fasting plasma glucose level of 100 to 125 mg/dL .[17]

The study is registered with PROSPERO (CRD42018083465). This protocol conforms to the PRISMA Protocols (PRISMA-P) guidelines.[13,14]

4. Systematic review registration

This protocol is registered in the PROSPERO registry of the University of York Reference number: (CRD42018083465).

5. Eligibility criteria

The PICOS strategy (population, intervention [changed to exposure for the purposes of this review of observational studies], comparator, outcome, study characteristics) was used to define the eligibility criteria for this study:

5.1. Inclusion criteria

Inclusion criterion is participants (men and women) aged ≥18 years. We are interested in both primary and secondary prevention studies, and so our inclusion criteria feature is both participants free of cardiovascular disease (CVD) at baseline, and populations of patients admitted with MetS. Exclusion criteria are participants aged 0 to 18 years and pregnant women.

Data items on the following 5 domains will be extracted:

  • 1.

    Population: characteristics of the study population (e.g., mean/median age, ethnic distribution), inclusion, and exclusion criteria.

  • 2.

    Exposure: definition and identification of HDL-C functionality. Both criteria must be met:

    • Measurement of HDL-C functionality.

    • Patients who have undergone an assessment of HDL functionality (cholesterol efflux capacity, anti-oxidative capacity, vasodilatory capacity, anti-inflammatory capacity, cell viability).

  • 3.

    Comparators: definition and identification of unexposed individuals, number of unexposed subjects.

  • 4.

    Outcomes: definition and identification of primary (CVD outcomes, and death (CV mortality, all-cause mortality) and secondary outcomes (MetS diagnostic).

  • 5.

    Study characteristics: authors, publication year, setting/source of participants, design, methods of recruitment and sampling, period of study, length of follow-up time (if relevant), aims, and objectives.

6. Outcomes

6.1. Primary outcomes

Patients with a diagnosis of MetS that present CVD outcomes, and death (CV mortality, all-cause mortality). The association of HDL-C functionality with the presence of MetS.

6.2. Secondary outcomes

The association of HDL-C functionality with MetS, by HDL-C functionality measurement method.

For studies meeting the inclusion criteria, we will additionally assess the following secondary outcomes: Transient ischemic attack (a transient episode of neurological dysfunction caused by focal brain, spinal cord or retinal ischaemia without acute infarction) and subtypes of stroke (ischaemic vs. haemorrhagic). Most strokes (approximately 85%) are ischemic (an episode of neurological dysfunction caused by focal, cerebral, spinal or retinal infarction), compared with hemorrhagic (neurological dysfunction caused by a focal collection of blood within or on the surface of the brain). Eligibility criteria may be further developed, in an iterative process, after preliminary searches.

6.3. Study design

This is a systematic review and meta-analysis protocol of prospective cohort studies, following the PRISMA-P guideline.[14] The systematic review and meta-analysis will be reported according to the PRISMA guideline.[15] The whole process of study selection is summarized in the PRISMA flow diagram (Fig. 1).

Figure 1.

Figure 1

Flow diagram of study selection process.

6.4. Search strategy

A systematic review of the literature will be conducted. A language restriction shall not be applied to the search. If there are relevant non-English abstracts, attempts shall be made to translate them wherever possible. The following bibliographic databases will be searched for articles published until January 2018: Embase, PubMed-MEDLINE, Web of Science, Cochrane Library, and Google Scholar.

Our search focuses on studies examining the association between HDL-C functionality and MetS risk in adults (34–70 years)[11]. At each step of the selection process, reasons for inclusion/exclusion will be recorded in the PRISMA Flowchart.[12,13]

6.5. Data collection

A record will be kept of all searches and search decisions to ensure reproducibility. Search results will be exported to a citation management program (EndNote ver. 7.0). Duplicates will be removed and retained separately. The resulting references will be exported separately to the 2 reviewers for independent review using Covidence.

6.6. Selection of studies

Two authors (LR, FCV) will independently screen all titles and abstracts identified through the literature searches and will exclude all records clearly not meeting inclusion criteria. Disagreements will be resolved by consensus. The selection process will be pilot tested to ensure a high degree of agreement between reviewers. Full text of the remaining studies will then be retrieved. The same 2 authors (LR, FCV) will independently assess the articles for fulfilment of inclusion criteria. In case of differences of opinion regarding study inclusion, a third review author (GBZ) will serve as arbiter. To avoid double counting, if multiple publications based on the same cohort of participants are retrieved, only the study reporting the largest sample size will be used. The reasons for excluding articles for which the full text was retrieved will be documented.

6.7. Data extraction and management

A data extraction form will be used to collect details from the included studies. The form includes information on study design, patient population, and presence of MetS. Two review authors (LR and FCV) will independently extract the data. The data extraction form will be pilot-tested on several articles to ensure consistency and that all relevant information is being captured. If necessary, a statistician will review the extraction of data to further ensure quality and reliability. Authors will be contacted for missing data.

Data will be extracted using a standardized template. We will use the PICOS (Population, Intervention, Comparator, Outcomes and Study design) framework, originally devised to formulate a research question, as a basis to develop data extraction criteria. As this is an etiological study, “exposure” will replace “intervention” and “study characteristics” will replace “study design.”

In terms of the study results, unadjusted and fully adjusted effect estimates for the association between HDL-C functionality and MetS will be recorded. Details of the confounders measured and adjusted for will also be noted. Results of any additional stratified analyses will also be recorded. Where possible, results from additional subgroup analyses with evidence regarding our non-primary objectives will also be recorded, for example, the association between HDL-C functionality and the secondary outcomes.

6.8. Assessment of methodological quality

Two investigators (LR and FCV) will independently assess each selected study for study quality using the Newcastle-Ottawa Quality Assessment Scale (NOS).[16] The NOS evaluates cohort studies based on 8 items categorized into the following 3 groups: selection of the study cases, comparability of the population, and ascertainment of whether the exposure or outcome includes any risk of bias (i.e., selection bias or bias from lost to follow-up). The NOS is scored ranging from 0 to 9, and studies with scores ≥7 are considered as high quality.[16] Discrepancy of quality assessment among the investigators will be solved by discussion and consensus among all authors.

6.9. Data synthesis and statistical analysis

We anticipate that there may be significant heterogeneity in the prevalence of HDL-C functionality features of MetS. There are several factors that could contribute to such heterogeneity. The relative risk and odds ratio are the way the result will be expressed statistically.

These factors include the following: differences in demographic and clinical features (e.g., age, hypertension, renal disease, smoking, duration, and severity of diabetes) among study cohorts; differences in definitions of HDL-C functionality. An I2 statistic will be calculated for the studies to be included in each proposed meta-analysis (i.e., for each neuroradiology correlate of interest) with values of 25%, 50%, and 75% suggesting low, moderate, or high degrees of heterogeneity, respectively, which report a dichotomized (i.e., present or absent) or categorical (i.e., absent, mild, moderate, severe) shall be harmonized for meta-analysis if deemed appropriate by our statistician. Other types of rating scales shall not be included in a meta-analysis and the data based on any such data scale would be presented in narrative form.

If significant heterogeneity between studies, as determined by consultation with our statistician, prevents meaningful pooling of the data, we will limit ourselves to providing a narrative description of observed trends. Given the heterogeneity of the populations studied, assumption of a fixed-effect size across populations would not be justified; thus, analyses would be performed using a random-effects model. Given the dichotomized (presence or absence) or categorical (severity measure) nature of our data, meta-analysis will be performed as random effects analysis. We will also add funnel graphs, publication bias analysis, and a meta-regression analysis.

If there are sufficient data to allow such analyses (in principle from as few as a single high quality study, but if possible by pooling data from multiple studies), we will perform subgroup analyses for participants with renal disease and participants with hypertension. In addition, if sufficient data are available, we shall perform subgroup analyses by age and diabetes duration. Funding sources and conflict of interest will be extracted from included studies. Statistical analysis will be performed using RevMan software.

6.10. Strategy for data synthesis

The data of interest presented as continuous (mean value and SD) will be used to perform meta-analysis to obtain the standardized mean difference and 95% confidence interval. Cochrane Q statistic and I2 test will be used to test for heterogeneity between the included studies. If an I2 value will be >50% or a P value of the Q test will be <0.05, indicating maximal heterogeneity among the included studies, a random-effect model will be put into use.

6.11. Analysis of subgroups or subsets

The subgroup meta-analyses will be conduct according to the prespecified study-level characteristics using a fixed-effects meta-analysis and if there is substantial heterogeneity, we will use the random-effects model. The sources included location, sex, age, method of HDL-C functionality assessment, and the definition of MetS. We also will conduct sensitivity analyses to evaluate the potential sources of heterogeneity in the analyses.

6.12. Summary of evidence

We will produce a narrative synthesis of the main results extracted from articles in full text. A summary of the included studies will provide information on the authors, study design, participants, number and age of the subjects, theoretical structure (if relevant), alcohol consumption (as primary outcome of interest), main findings, and study information. Special emphasis will be placed on the identification of HDL-C functionality and the risk of MetS. In the presentation of the results, we will try to separate the factors for which the evidence of causality is strong (from longitudinal studies) and factors for which the causal nature of the relationship is less secure (cross-sectional data). A graphical summary of all the data they represent will be provided and take into account the number of studies that provide evidence of a factor and the relative strength of the association presented based on study design and quality assessment. The membership level will be evaluated based on adjusted data.

7. Discussion

This systematic review will synthesize research evidence to establish whether the risk of developing MetS is relatively high in adults with high HDL-C functionality. Strengths and limitations will be highlighted in the identified evidence. Strength of observational data may include large sample size, high rate of follow-up, and frequency of METS more likely to be representative of the population at risk. Limitations may include the quality of data extracted, which may not allow studies to be combined in a meta-analysis. This may be overcome by presenting the findings in a descriptive manner. This review will conducted in collaboration with an experienced librarian who helped appraise the search criteria, refine the keywords and MeSH terms, and identify appropriate database(s). To the best of our knowledge, no reviews have been published exploring the study question; however, if a review addressing a similar question is published, it will be incorporated in this review and added in a meta-analysis if feasible.

7.1. Implications of results

This systematic review will provide an updated and quantifiable estimate of the risk of MetS in adults with high HDL-C functionality. Furthermore, the systematic search will identify where future research is required. For instance, this review may inform a prognostic study which may be useful in understanding the course and factors associated with MetS development.

7.2. Amendments

If it is necessary, we will update this protocol in the future. We will submit the original protocol, final protocol and summary of changes as a supplement.

Author contributions

LR, ASRB, ALDD, ACF, NPS, PMMD, RMLS, JLO, MN, AD, PARD, FRS, GBFO, GBZ, SAH, PEOR, AJG, RMP, ACF, PMMD, TMF, NN, SA, HRZ, CD, PFSG, AA, AVH, MIR, RDL, and FCV conceived the study idea and devised the study methodology. LR, ASRB, ACPC, and ESR participated in the design and coordination of the study. LR was primarily responsible for protocol writing and developed the search strategy. LR and FCV will screen identified literature, conduct data extraction and analyses the review findings. All authors read the drafts, provided comments and agreed on the final version of the manuscript.

Conceptualization: Leonardo Roever, Elmiro Santos Resende, Angélica Lemos Debs Diniz, Nilson Penha-Silva, João Lucas O’Connell, Paulo Fernando Silva Gomes, Hugo Ribeiro Zanetti, Anaisa Silva Roerver-Borges, Fernando César Veloso, Fernanda Rodrigues de Souza, Poliana Rodrigues Alves Duarte, Thiago Montes Fidale, Antonio Casella-Filho, Paulo Magno Martins Dourado, Antonio Carlos Palandri Chagas, Sadeq Ali-Hasan-Al-Saegh, Paulo Eduardo Ocke Reis, Rogério de Melo Costa Pinto, Gustavo B. F. Oliveira, Alvaro Avezum, Mansueto Neto, André Rodrigues Durães, Rose Mary Ferreira Lisboa da Silva, Antonio José Grande, Celise Denardi, Renato Delascio Lopes, Nitesh Nerlekar, Shahab Alizadeh, Adrian V. Hernadez, Maria Inês da Rosa, Giuseppe Biondi-Zoccai.

Methodology: Leonardo Roever.

Supervision: Leonardo Roever.

Visualization: Leonardo Roever.

Writing – original draft: Leonardo Roever, Elmiro Santos Resende, Angélica Lemos Debs Diniz, Nilson Penha-Silva, João Lucas O’Connell, Paulo Fernando Silva Gomes, Hugo Ribeiro Zanetti, Anaisa Silva Roerver-Borges, Fernando César Veloso, Fernanda Rodrigues de Souza, Poliana Rodrigues Alves Duarte, Thiago Montes Fidale, Antonio Casella-Filho, Paulo Magno Martins Dourado, Antonio Carlos Palandri Chagas, Sadeq Ali-Hasan-Al-Saegh, Paulo Eduardo Ocke Reis, Rogério de Melo Costa Pinto, Gustavo B. F. Oliveira, Alvaro Avezum, Mansueto Neto, André Rodrigues Durães, Rose Mary Ferreira Lisboa da Silva, Antonio José Grande, Celise Denardi, Renato Delascio Lopes, Nitesh Nerlekar, Shahab Alizadeh, Adrian V. Hernadez, Maria Inês da Rosa, Giuseppe Biondi-Zoccai.

Writing – review & editing: Leonardo Roever, Elmiro Santos Resende, Angélica Lemos Debs Diniz, Nilson Penha-Silva, João Lucas O’Connell, Paulo Fernando Silva Gomes, Hugo Ribeiro Zanetti, Anaisa Silva Roerver-Borges, Fernando César Veloso, Fernanda Rodrigues de Souza, Poliana Rodrigues Alves Duarte, Thiago Montes Fidale, Antonio Casella-Filho, Paulo Magno Martins Dourado, Antonio Carlos Palandri Chagas, Sadeq Ali-Hasan-Al-Saegh, Paulo Eduardo Ocke Reis, Rogério de Melo Costa Pinto, Gustavo B. F. Oliveira, Alvaro Avezum, Mansueto Neto, André Rodrigues Durães, Rose Mary Ferreira Lisboa da Silva, Antonio José Grande, Celise Denardi, Renato Delascio Lopes, Nitesh Nerlekar, Shahab Alizadeh, Adrian V. Hernadez, Maria Inês da Rosa, Giuseppe Biondi-Zoccai.

Footnotes

Abbreviations: CIs = Confidence Intervals, HDL = high-density lipoprotein, LDL = low-density lipoprotein, MD = mean difference, MetS = metabolic syndrome, RR = risk ratio.

Ethical issues: No ethical approval is required because this study includes no confidential personal data or interventions with the patients.

Publication plan: The procedures of this systematic review will be conducted in accordance with the PRISMA-compliant guideline. The results of this systematic review will be submitted to a peer-reviewed journal for publication.

The authors report no conflicts of interests.

References

  • [1].Basurto Acevedo L, Barrera Hernández S, Fernández Muñoz MJ, et al. An increase in epicardial fat in women is associated with thrombotic risk. Clin Investig Arterioscler 2018. 29.pii: S0214-9168(17)30134-1. [DOI] [PubMed] [Google Scholar]
  • [2].Oliveira GBF, Avezum A, Roever L. Cardiovascular disease burden: evolving knowledge of risk factors in myocardial infarction and stroke through population-based research and perspectives in global prevention. Front Cardiovasc Med 2015. 200032. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [3].Roever L, Biondi-Zoccai G, Chagas ACP. Non-HDL-C vs. LDL-C in predicting the severity of coronary atherosclerosis. Heart Lung Circ 2016;25:953–4. [DOI] [PubMed] [Google Scholar]
  • [4].Roever L, Resende ES, Veloso FC, et al. Abdominal obesity and association with atherosclerosis risk factors. Medicine (Baltimore) 2016;95:e1357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [5].Roever L, Resende ES, Diniz ALD, et al. Ectopic adiposopathy and association with cardiovascular disease risk factors: the Uberlândia Heart Study. Int J Cardiol 2015;190:140–2. [DOI] [PubMed] [Google Scholar]
  • [6].Roever L, Resende ES, Veloso FC, et al. Perirenal fat and association with metabolic risk factors. Medicine (Baltimore) 2015;94:e1105. [DOI] [PubMed] [Google Scholar]
  • [7].van Rooy MJ, Pretorius E. Metabolic syndrome, platelet activation and the development of transient ischemic attack or thromboembolic stroke. Thromb Res 2015;135:434–42. [DOI] [PubMed] [Google Scholar]
  • [8].Sarrafzadegan N, Gharipour M, Sadeghi M, et al. Metabolic syndrome and the risk of ischemic stroke. J Stroke Cerebrovasc Dis 2017;26:286–94. [DOI] [PubMed] [Google Scholar]
  • [9].Sánchez-Iñigo L, Navarro-González D, Fernández-Montero A, et al. Risk of incident ischemic stroke according to the metabolic health and obesity states in the Vascular-Metabolic CUN cohort. Int J Stroke 2017;12:187–91. [DOI] [PubMed] [Google Scholar]
  • [10].Chei CL, Yamagishi K, Tanigawa T, et al. Metabolic syndrome and the risk of ischemic heart disease and stroke among middle-aged Japanese. Hypertens Res 2008;31:1887–9. [DOI] [PubMed] [Google Scholar]
  • [11].Fang X, Liu H, Zhang X, et al. Metabolic syndrome, its components, and diabetes on 5-year risk of recurrent stroke among mild-to-moderate ischemic stroke survivors: a multiclinic registry study. J Stroke Cerebrovasc Dis 2016;25:626–34. [DOI] [PubMed] [Google Scholar]
  • [12].Glasziou P, Irwig L, Bain C, et al. Systematic reviews in health care: a practical guide. Cambridge: Cambridge University Press; 2001. [Google Scholar]
  • [13].Newcastle Ottawa Scale (The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses). Available at: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Accessed January 26, 2018. [Google Scholar]
  • [14].Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009. 339. [PMC free article] [PubMed] [Google Scholar]
  • [15].Shamseer L, Moher D, Clarke M, et al. PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015;349(jan02 1):g7647. [DOI] [PubMed] [Google Scholar]
  • [16].Wells GA, Shea B, O’Connell D, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomized studies in meta-analyses. Secondary The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomized studies in met analyses. Available at: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp (accessed on December 28, 2017). [Google Scholar]

Articles from Medicine are provided here courtesy of Wolters Kluwer Health

RESOURCES