Abstract
Background
Prediabetes is an asymptomatic, intermediate state between normoglycemia and the onset of type 2 diabetes mellitus. Recent reports indicate that during prediabetes, there are subclinical changes to immune cells and inflammatory markers. Therefore, this systematic review will provide a synthesis of the available data on the changes in the concentration of immune cells and selective inflammatory markers. It will also give evidence of a demographic impact on changes or complications in the prediabetes state.
Objective
The objectives of this study are to create a protocol that will be used to analyze the collected data of previously published research based on immune cells such as neutrophils, lymphocytes, monocytes, eosinophils, and basophils, as well as inflammatory markers such as C-reactive protein, tumor necrosis factor-alpha, interleukin-6, P-selectin, cluster of differentiation 40 ligand, and fibrinogen. Additionally, an impact of demographics will be determined using the previously published data collected.
Methods
This protocol was prepared through adhering to the PRISMA (Preferred Reporting Items for Systemic Reviews and Meta-Analysis) 2015 guidelines for reporting protocols. Published clinical studies that involve observational (cross-sectional, comparative cross-sectional, case-control, or cohort) study designs that include normal or nondiabetic and prediabetes reports will be used in this systematic review and meta-analysis. This will be accomplished by using clinical Medical Subject Headings to search on MEDLINE, Cochrane library, and African Journal Online. Reviewers (NCM, AMS, and AK) will screen all the results and select the studies that meet the eligibility criteria. Downs and Black Checklist will be used to check the risk of bias, and then a Review Manager v5.4 forest plot will be used for meta-analysis. Additionally, the forest plot will also be used for sensitivity analysis. The strength of evidence will then be assessed using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach.
Results
Since July 5, 2020, there are no participants recruited. Publicly available data will be used in the review and will be collected after this protocol publication. No ethics approval is required as no subjects will be used, and analysis will be based on reported data. Authors will be contacted if there was a misunderstanding related to reading their reported data.
Conclusions
The findings will clarify changes that might be observed in a study of interest based in the eThekwini district in South Africa.
Trial Registration
International Prospective Registry of Systematic Reviews (PROSPERO) CRD42020184828; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=184828
International Registered Report Identifier (IRRID)
PRR1-10.2196/31619
Keywords: systematic review, meta-analysis, prediabetes, immune cells, inflammatory markers, diabetes, inflammatory response, immunology, demographics, risk factors
Introduction
Type 2 diabetes (T2D) is a metabolic disorder characterized by chronic hyperglycemia, which gives rise to metabolic and signaling abnormalities [1-3]. According to Kayal and Graves [3], these metabolic and signaling abnormalities have been reported to cause dysregulated innate immunity. Chronic dysregulated immunity includes changes in immune cells such as neutrophils, lymphocytes, monocytes, eosinophils, and basophils [4-7]. Upon activation, these immune cells play a different role, including secretion of inflammatory markers such as C-reactive protein (CRP), tumor necrosis factor-alpha (TNF-α), interleukin-6 (IL-6), P-selectin, cluster of differentiation 40 ligand (CD40L), and fibrinogen [4,5,8-11]. The chronic immune activation in T2D results in a suppressed immune system [3,12]. According to Lam and LeRoith [13], a fundamental change in the population with T2D is witnessed by the health care communities. This was confirmed by the International Diabetes Federation statistics, reporting that in 2019, there were 19 million people with diabetes in Africa aged 20-79 years [1]. The International Diabetes Federation also reported that there were 12 million Africans aged 20-79 years living with undiagnosed diabetes in 2019 [1]. South Africa is the highest with 4.6 million adults with diabetes (20-79 years) [1]. In 2017, the Indian population was reported to have the highest prevalence of diabetes in South Africa by 11%-13%, followed by people of color by 8%-10%, then Black people by 5%-8%, and White being the lowest by 4% [14,15]. The Indian population among people with diabetes has been shown to be high due to their strong diabetes genetic predisposition [14,15]. However, the onset of T2D arises from the progression of prediabetes [16]. Prediabetes has been reported to be an asymptomatic state, creating a research complication in its documentation of the statistics and prevalence. There is less evidence on the changes in immune cells and selective inflammatory markers at the prediabetes stage [17-20]. However, in our laboratory, research has been conducted on animals in addition to the available research reporting the metabolic and signaling abnormalities, including immune activation during prediabetes [21-24]. This then raised a debatable issue if the same abnormalities occur during prediabetes in human individuals owing to limitations in the animal models, even though the research mimicked the human diet. From the search conducted, we found no report or evidence of the systematic review that reports on the changes in immune cell concentration and the level of secretion of selective inflammatory markers that occur during immune activation during prediabetes. Therefore, our research presents an opportunity to compile a systematic review that will yield an exhaustive synthesis obtained from the available studies that previously reported on immune cells and selective inflammatory markers of interest in prediabetes. Additionally, this systematic review will give reports on the impact of demographics on changes of immune cells and secretion of selective inflammatory markers during prediabetes.
The objectives of this study are as follows: (1) to determine the changes in concentration of immune cells, such as neutrophils, lymphocytes, monocytes, eosinophils, and basophils during prediabetes; (2) to investigate if there are changes in concentration on selected inflammatory markers, such as CRP, TNF-α, IL-6, P-selectin, CD40L, and fibrinogen, during prediabetes; and (3) to assess the variation of prediabetes-associated changes in immune function among different demographic groups.
Methods
This protocol was prepared by adhering to the PRISMA (Preferred Reporting Items for Systemic Reviews and Meta-Analysis) 2015 guidelines for reporting protocols [25].
Systematic Review Registration
The protocol has been registered with PROSPERO with registration number “CRD42020184828,” dated July 5, 2020.
Ethics Approval and Consent to Participate
The data analyzed will be those that have already been published, and there will be no data collection from individuals. The authors declare that there will be no informed consent required to be signed; therefore, no ethics approval is required for the systematic review and meta-analysis.
Eligibility Criteria for the Study
Studies with a minimum of 100 participants (N=100) and the studies that report community-based clinical cross-sectional study will be eligible. The inclusion and exclusion criteria will be as follows: inclusion—the information reported from nondiabetic adult patients aged 25-45 years from all ethnicities will be used; exclusion—information reported from people with a history of liver disease, kidney disease, heart disease, and depression will not be used. Information from pregnant women will also not be used. Additionally, no samples from professional sports athletes will be allowed in the study. Full-text articles or reports indicating that individuals who were used were free from all the mentioned criteria will then be eligible.
Prediabetes Diagnosis Criteria
Diagnostic criteria for prediabetes will be as follows (participants should meet 1 of the following diagnoses): fasting blood glucose—5.6 to 7.0 mmol/L; 2 hours postprandial blood glucose (2 hours oral glucose tolerance test)—7.8 to 11.0 mmol/L with glycated hemoglobin (5.7%‐6.4%).
Study Design
Participants
Intervention
These will be clinical studies that involve observational studies if they are cross-sectional, comparative cross-sectional, case-control, or cohort study designs that involve normal (nondiabetic) and prediabetes reports. The reported information that involves one or more immune cells (neutrophils, lymphocytes, monocytes, eosinophils, and basophils) in the prediabetic state will be eligible for this systematic review. Additionally, studies that report information that involves at least one or more inflammatory markers of interest, which are CRP, TNF-α, IL-6, P-selectin, CD40L, and fibrinogen, will also be eligible for this systematic review.
Comparators
In this systematic review, the eligible comparing control groups will be normal (nondiabetic) control and T2D control groups.
Outcomes
This systematic review is expected to show the following results: (1) the changes in concentration of immune cells such as neutrophils, lymphocytes, monocytes, eosinophils, and basophils during prediabetes (reported as odds ratio and 95% CI); (2) the changes in concentration of selected markers such as CRP, TNF-α, IL-6, P-selectin, CD40L, and fibrinogen during prediabetes (reported as odds ratio and 95% CI); and (3) variations in markers of immune function among different demographic groups based on gender, age, and race (reported as the mean).
Search Strategy
The electronic search strategy will be used as an identification for studies involving cohorts that have been studied that are related to the study of interest [26]. This strategy will be accomplished by search on MEDLINE (from 1963 to 2020), Cochrane library displaying results of trials from PubMed, CT.gov, Embase, ICTRP (from 1963 to 2020), as well as African Journal Online (from 1998 to 2020) [26]. In addition to these search strategies, clinical MeSH (Medical Subject Headings) and text will be applied to filter the available information. For all search conducted, the keywords to be used will be “pre-diabetes and immunity,” “pre-diabetes and immune cells,” “pre-diabetes and leucocytes,” and “pre-diabetes and inflammation.”
Identification of Eligible Studies
The title and abstracts of all the obtained results will be screened by reviewers (NCM, AMS, and AK), and the studies that meet the eligibility criteria will then be selected. Each reviewer will be responsible for screening all the selected study reports before the decision-making of the eligible reports. The PRISMA flowchart for selection of studies will then be provided in the reports from the systematic review.
Patient and Public Involvement
No patient was involved.
Data Management
Study Records and Data Extraction
The data of the study records that are selected as eligible reports will then be extracted and recorded in an Excel (Microsoft Corp) file. The predefined list of variables to be considered in each report will be used as categories in an Excel file. Considering the research of interest, the outcome of interest will mainly be the immune cell response and concentration of selected markers in both genders, at an age parameter of interest, and in all ethnicities. However, the value of the baseline characteristic of the data reported will also be considered. Therefore, the baseline characteristics of the eligible research reports obtained will be author, year of publication, country, and study setting. The methodology of the study reported will also be considered with categories including design, period, sampling strategy, and whether participants are from a normal or prediabetic population. Finally, the outcomes from different genders, ages, ethnicities, and immune cell changes or inflammatory markers will then be extracted.
Data Simplification
Studies that report on the immune cells (neutrophils, lymphocytes, monocytes, eosinophils, and basophils) will be combined into a single group. Additionally, the studies that report on selected inflammatory markers (CRP, TNF-α, IL-6, P-selectin, CD40L, and fibrinogen) will also be combined into a single group.
Risk of Bias
The potential risk of bias in individual studies will be obtained using the Downs and Black Checklist [27]. The scores will be rated as follows: excellent (25-26), good (20-24), moderate (14-19), poor (11-13), and very poor (<10). Three reviewers (NCM, AMS, and AK) will be responsible for the independent judgments, which will be based on the 4 domains of the Black and Downs checklist tool, which are reporting bias (10 items), external validity (3 items), internal validity (6 items), and selection bias (7 items). In a situation where there will be a difference of opinions between NCM, AMS, and AK, author PSN will be responsible for adjudication. In situations where the data are not clear, the investigator who reported the data will be contacted 3 times. If no response is obtained, data will be then excluded from the eligible report.
Data Synthesis
For the meta-analysis of reported data, a forest plot will be used from Review Manager software version 5.4 (RevMan) [28-30]. Using this forest plot, eligible data from all reported studies will be analyzed depending on their sample size and the mean of the concentration of immune cells or inflammatory markers in prediabetic and control groups. Additionally, an odds ratio and CI will be used to make the forest plot where the solid lines will represent the 95% CI. Each reported study will be represented as a horizontal line on the y-axis to list the primary author and year of study. The forest plot will also include the weight of the study results that will be automatically obtained using the Review Manager software.
Sensitivity Analysis
RevMan forest plot will also test for heterogeneity, where greater homogeneity will be indicated by a greater overlap between the CIs [30]. Using the forest plot, I2 will then be calculated where a value between 0% and 100% will be obtained. A value obtained less than 25% will be an indication of a strong homogeneity, and a value obtained greater than 75% will be an indication of a strong heterogeneity. However, a value of 50% will be considered as an average value.
Assessment of Strength of Evidence
NCM, AMS, and AK will then be responsible for the assessment of the strength of evidence. The studies included in the review will then be evaluated using the Grading of Recommendations Assessment, Development, and Evaluation approach (GRADE) [30-32]. Furthermore, the summary of findings table will then be created using a GRADEpro (McMaster University and Evidence Prime Inc) tool.
Results
As of July 5, 2020, no participants have been recruited as publicly available data will be used. These data will be collected when this protocol has been published. There will be no ethics approval required as the review is based on published data, and authors will be contacted if there is a misunderstanding from reading their reported data for clarity of their published work.
Discussion
Principal Findings
The synthesis of previous study reports obtained from this systematic review and meta-analysis will clarify the complications on the immune system at prediabetes such as the changes that have been reported on immune cells, which are neutrophils, lymphocytes, monocytes, eosinophils, and basophils. This systematic review and meta-analysis will also give an outstanding synthesis of data from previous reports based on selected inflammatory markers of interest.
Conclusion
The synthesis from this systematic review and meta-analysis will create a hallmark of association between demographics and prediabetes. This will clarify changes that might be observed in a study of interest based in the eThekwini district in South Africa.
Acknowledgments
The authors would like to express gratitude to the National Research Foundation (SA) for funding (grant number 106041).
Abbreviations
- CD40L
cluster of differentiation 40 ligands
- CRP
C-reactive protein
- GRADE
Grading of Recommendations Assessment, Development, and Evaluation
- IL-6
interleukin-6
- MeSH
Medical Subject Headings
- PRISMA
Preferred Reporting Items for Systemic Reviews and Meta-AnalysisT2d: type 2 diabetes
- TNF-α
tumor necrosis factor-alpha
Footnotes
Authors' Contributions: NCM, AMS, and AK were responsible for brainstorming, designing the study, and drafting the protocol. NCM, AMS, PS, and AK were responsible for reviewing the eligible study and final draft of the manuscript. Funders had no role in developing the protocol.
Conflicts of Interest: None declared.
References
- 1.IDF Diabetes Atlas. 2019. [2022-11-04]. https://diabetesatlas.org/
- 2.Grundy S. Pre-diabetes, metabolic syndrome, and cardiovascular risk. J Am Coll Cardiol. 2012 Feb 14;59(7):635–43. doi: 10.1016/j.jacc.2011.08.080. https://linkinghub.elsevier.com/retrieve/pii/S0735-1097(11)05036-4 .S0735-1097(11)05036-4 [DOI] [PubMed] [Google Scholar]
- 3.Graves D, Kayal R. Diabetic complications and dysregulated innate immunity. Front Biosci. 2008 Jan 01;13:1227–39. doi: 10.2741/2757. https://europepmc.org/abstract/MED/17981625 .2757 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Xia C, Rao X, Zhong J. Role of T Lymphocytes in type 2 diabetes and diabetes-associated inflammation. J Diabetes Res. 2017;2017:6494795. doi: 10.1155/2017/6494795. doi: 10.1155/2017/6494795. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hatanaka E, Monteagudo P, Marrocos M, Campa A. Neutrophils and monocytes as potentially important sources of proinflammatory cytokines in diabetes. Clin Exp Immunol. 2006 Dec;146(3):443–7. doi: 10.1111/j.1365-2249.2006.03229.x. https://academic.oup.com/cei/article-lookup/doi/10.1111/j.1365-2249.2006.03229.x .CEI3229 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Wu D, Molofsky A, Liang H, Ricardo-Gonzalez R, Jouihan H, Bando J, Chawla A, Locksley R. Eosinophils sustain adipose alternatively activated macrophages associated with glucose homeostasis. Science. 2011 Apr 08;332(6026):243–7. doi: 10.1126/science.1201475. https://europepmc.org/abstract/MED/21436399 .science.1201475 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Denzel A, Maus U, Rodriguez Gomez M, Moll C, Niedermeier M, Winter C, Maus R, Hollingshead S, Briles D, Kunz-Schughart L, Talke Y, Mack M. Basophils enhance immunological memory responses. Nat Immunol. 2008 Jul;9(7):733–42. doi: 10.1038/ni.1621. doi: 10.1038/ni.1621.ni.1621 [DOI] [PubMed] [Google Scholar]
- 8.Bembde A. A study of plasma fibrinogen level in type-2 diabetes mellitus and its relation to glycemic control. Indian J Hematol Blood Transfus. 2012 Jun;28(2):105–8. doi: 10.1007/s12288-011-0116-9. https://europepmc.org/abstract/MED/23730017 .116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Tilg H, Moschen A. Adipocytokines: mediators linking adipose tissue, inflammation and immunity. Nat Rev Immunol. 2006 Oct;6(10):772–83. doi: 10.1038/nri1937. doi: 10.1038/nri1937.nri1937 [DOI] [PubMed] [Google Scholar]
- 10.Seijkens T, Kusters P, Engel D, Lutgens E. CD40-CD40L: linking pancreatic, adipose tissue and vascular inflammation in type 2 diabetes and its complications. Diab Vasc Dis Res. 2013 Mar;10(2):115–22. doi: 10.1177/1479164112455817. doi: 10.1177/1479164112455817.1479164112455817 [DOI] [PubMed] [Google Scholar]
- 11.Pradhan A, Manson J, Rifai N, Buring J, Ridker P. C-reactive protein, interleukin 6, and risk of developing type 2 diabetes mellitus. JAMA. 2001 Jul 18;286(3):327–34. doi: 10.1001/jama.286.3.327. doi: 10.1001/jama.286.3.327.joc10096 [DOI] [PubMed] [Google Scholar]
- 12.Nikolajczyk B, Jagannathan-Bogdan M, Shin H, Gyurko R. State of the union between metabolism and the immune system in type 2 diabetes. Genes Immun. 2011 Jun;12(4):239–50. doi: 10.1038/gene.2011.14. https://europepmc.org/abstract/MED/21390053 .gene201114 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Lam D, LeRoith D. The worldwide diabetes epidemic. Curr Opin Endocrinol Diabetes Obes. 2012 Apr;19(2):93–6. doi: 10.1097/MED.0b013e328350583a. doi: 10.1097/MED.0b013e328350583a. [DOI] [PubMed] [Google Scholar]
- 14.Pheiffer C, Pillay-van Wyk V, Turawa E, Levitt N, Kengne AP, Bradshaw D. Prevalence of type 2 diabetes in South Africa: A systematic review and meta-analysis. Int J Environ Res Public Health. 2021 May 30;18(11):5868. doi: 10.3390/ijerph18115868. https://www.mdpi.com/resolver?pii=ijerph18115868 .ijerph18115868 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Motala A, Pirie F, Gouws E, Amod A, Omar M. High incidence of Type 2 diabetes mellitus in South African Indians: a 10-year follow-up study. Diabet Med. 2003 Jan;20(1):23–30. doi: 10.1046/j.1464-5491.2003.00782.x. doi: 10.1046/j.1464-5491.2003.00782.x.782 [DOI] [PubMed] [Google Scholar]
- 16.Mahat R, Singh N, Arora M, Rathore V. Health risks and interventions in prediabetes: A review. Diabetes Metab Syndr. 2019;13(4):2803–2811. doi: 10.1016/j.dsx.2019.07.041. doi: 10.1016/j.dsx.2019.07.041.S1871-4021(19)30442-4 [DOI] [PubMed] [Google Scholar]
- 17.Gokulakrishnan K, Deepa R, Mohan V, Gross M. Soluble P-selectin and CD40L levels in subjects with prediabetes, diabetes mellitus, and metabolic syndrome--the Chennai Urban Rural Epidemiology Study. Metabolism. 2006 Feb;55(2):237–42. doi: 10.1016/j.metabol.2005.08.019. doi: 10.1016/j.metabol.2005.08.019.S0026-0495(05)00341-0 [DOI] [PubMed] [Google Scholar]
- 18.Fadini G, Cappellari R, Mazzucato M, Agostini C, Vigili de Kreutzenberg S, Avogaro A. Monocyte-macrophage polarization balance in pre-diabetic individuals. Acta Diabetol. 2013 Dec;50(6):977–82. doi: 10.1007/s00592-013-0517-3. doi: 10.1007/s00592-013-0517-3. [DOI] [PubMed] [Google Scholar]
- 19.Al-Daghri NM, Al-Ajlan AS, Alfawaz H, Yakout S, Aljohani N, Kumar S, Alokail MS. Serum cytokine, chemokine and hormone levels in Saudi adults with pre-diabetes: a one-year prospective study. Int J Clin Exp Pathol. 2015;8(9):11587–93. https://europepmc.org/abstract/MED/26617895 . [PMC free article] [PubMed] [Google Scholar]
- 20.Grossmann V, Schmitt V, Zeller T, Panova-Noeva M, Schulz A, Laubert-Reh D, Juenger C, Schnabel R, Abt T, Laskowski R, Wiltink J, Schulz E, Blankenberg S, Lackner K, Münzel T, Wild P. Profile of the immune and inflammatory response in individuals with prediabetes and type 2 diabetes. Diabetes Care. 2015 Jul;38(7):1356–64. doi: 10.2337/dc14-3008. doi: 10.2337/dc14-3008.dc14-3008 [DOI] [PubMed] [Google Scholar]
- 21.Mzimela N, Ngubane P, Khathi A. The changes in immune cell concentration during the progression of pre-diabetes to type 2 diabetes in a high-fat high-carbohydrate diet-induced pre-diabetic rat model. Autoimmunity. 2019 Feb;52(1):27–36. doi: 10.1080/08916934.2019.1575820. doi: 10.1080/08916934.2019.1575820. [DOI] [PubMed] [Google Scholar]
- 22.Khathi A, Luvuno M, Mabandla M. Voluntary ingestion of a high-fat high-carbohydrate diet : A model for pre-diabetes. Ponte. 2018;74(5):A. doi: 10.21506/j.ponte.2018.5.11. doi: 10.21506/j.ponte.2018.5.11. [DOI] [Google Scholar]
- 23.Gamede M, Mabuza L, Ngubane P, Khathi A. The effects of plant-derived oleanolic acid on selected parameters of glucose homeostasis in a diet-induced pre-diabetic rat model. Molecules. 2018 Mar 29;23(4):794. doi: 10.3390/molecules23040794. https://www.mdpi.com/resolver?pii=molecules23040794 .molecules23040794 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Mabuza L, Gamede M, Maikoo S, Booysen I, Ngubane P, Khathi A. Cardioprotective effects of a ruthenium (II) Schiff base complex in diet-induced prediabetic rats. DMSO. 2019 Feb;Volume 12:217–223. doi: 10.2147/DMSO.5183811. doi: 10.2147/DMSO.5183811. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Alturkistani A, Greenfield G, Greaves F, Aliabadi S, Jenkins R, Costelloe C. Patient portal functionalities and uptake: Systematic review protocol. JMIR Res Protoc. 2020 Jul 31;9(7):e14975. doi: 10.2196/14975. doi: 10.2196/14975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Foley K, Alturkistani A, Carter A, Stenfors T, Blum E, Car J, Majeed A, Brindley D, Meinert E. Massive open online courses (MOOC) evaluation methods: Protocol for a systematic review. JMIR Res Protoc. 2019 Mar 07;8(3):e12087. doi: 10.2196/12087. doi: 10.2196/12087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Downs S, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. Journal of Epidemiology. 1998;52(6):377–384. doi: 10.1136/jech.52.6.377. doi: 10.1136/jech.52.6.377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Viechtbauer W. Publication bias in meta-analysis: Prevention, assessment and adjustments. Psychometrika. 2007 Feb 21;72(2):269–271. doi: 10.1007/s11336-006-1450-y. doi: 10.1007/s11336-006-1450-y. [DOI] [Google Scholar]
- 29.Borenstein M. Software for publication bias. Publication bias in meta-analysis: Prevention, assessment and adjustments. 2005:193–220. doi: 10.1002/0470870168.ch11. [DOI] [Google Scholar]
- 30.Ahn E, Kang H. Introduction to systematic review and meta-analysis. Korean J Anesthesiol. 2018 Apr;71(2):103–112. doi: 10.4097/kjae.2018.71.2.103. https://ekja.org/journal/view.php?doi=10.4097/kjae.2018.71.2.103 .kjae-2018-71-2-103 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Ryan R, Hill S. How to GRADE the quality of the evidence. Cochrane Consumers Communication Group. 2016. [2022-11-04]. https://colorectal.cochrane.org/sites/colorectal.cochrane.org/files/public/uploads/how_to_grade.pdf .
- 32.Gopalakrishna G, Mustafa R, Davenport C, Scholten R, Hyde C, Brozek J, Schünemann HJ, Bossuyt P, Leeflang M, Langendam M. Applying Grading of Recommendations Assessment, Development and Evaluation (GRADE) to diagnostic tests was challenging but doable. J Clin Epidemiol. 2014 Jul;67(7):760–8. doi: 10.1016/j.jclinepi.2014.01.006. https://linkinghub.elsevier.com/retrieve/pii/S0895-4356(14)00044-4 .S0895-4356(14)00044-4 [DOI] [PubMed] [Google Scholar]