Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2020 Jul 6;15(7):e0235637. doi: 10.1371/journal.pone.0235637

Effect of methotrexate use on the development of type 2 diabetes in rheumatoid arthritis patients: A systematic review and meta-analysis

Leena R Baghdadi 1,*
Editor: Michael Nurmohamed2
PMCID: PMC7337336  PMID: 32628710

Abstract

Background

The high risk of cardiovascular disease is well recognized in rheumatoid arthritis. Type 2 diabetes also attributes to this increase in risk. Rheumatoid arthritis is a chronic inflammatory condition, which aggravates insulin resistance, placing the patients at a higher risk of type 2 diabetes and subsequent cardiovascular outcomes. Methotrexate treatment, as a gold standard anti-inflammatory drug in the treatment of rheumatoid arthritis has shown beneficial effects on cardiovascular health. However, its impact on type 2 diabetes is still unknown.

Objective

To assess the strength of the association between exposure to methotrexate and the rate of development of type 2 diabetes in rheumatoid arthritis patients.

Methods

All rheumatoid arthritis studies reporting the use of methotrexate as an exposure and type 2 diabetes as an outcome were searched until March 2020 using MEDLINE, Cochrane and Scopus databases. Studies were included if the diagnosis of rheumatoid arthritis was made according to current guidelines or by a rheumatologist, and if there was information about methotrexate exposure and the type 2 diabetes outcome. The author and an independent assessor evaluated the articles for eligibility. Meta-analyses combined relative risk estimates from each study where raw counts were available.

Results

Sixteen studies reporting sufficient data for inclusion in the meta-analyses were identified. Methotrexate showed a promising effect on the risk of type 2 diabetes as this risk decreased in rheumatoid arthritis patients using methotrexate (Relative risk 0.48, 95% CI 0.16, 1.43).

Conclusion

Rheumatoid arthritis patients on methotrexate treatment had a lower risk of developing type 2 diabetes compared to rheumatoid arthritis patients not exposed to methotrexate. This finding highlights the need for future, randomized control trials to confirm the beneficial effect of methotrexate on type 2 diabetes in the rheumatoid arthritis population.

Introduction

Rheumatoid arthritis (RA) is a chronic inflammatory disease. It is usually complicated by local joint deformities and extra-articular manifestations including the renal, respiratory and cardiovascular (CV) systems [1]. Undeniably, CV disease is the most common and serious complication associated with RA [2]. Excess risk of CV morbidity and mortality among RA patients was recorded at 48% [3] and 60% [4], respectively. The burden of CV disease is increasing worldwide [5]. The excess CV risk among RA patients was argued to be triggered by the coexistence of systemic inflammation [69].

Until now, there is no definite evidence of the role of inflammation associated with RA and other CV risk factors in CV disease mortality and morbidity. However, a growing body of evidence demonstrates that the risk of developing CV disease increased with the presence of any of the traditional CV risk factors; which include high blood pressure, type 2 diabetes (T2D), obesity, hypercholesterolemia, smoking and physical inactivity [10]. This association indicates that the CV risk might, at least partially, be explained by the presence of CV risk factors. A former systematic review [10] reported that CV risk increased among RA patients with hypertension, T2D, smoking, hypercholesterolemia and obesity. The impact of T2D in increasing the CV risk among the RA population has been reported by several studies [1113]. Diabetic RA patients had almost twice the risk of developing CV disease compared to nondiabetic RA patients (Relative risk [RR] 1.94, 95% CI 1.58, 2.30) [10]. This higher CV risk among RA patients with T2D has been reported by several observational studies [1416]. Moreover, a higher risk of CV events was also reported in diabetic RA patients compared to the general population [15, 17].

RA is associated with chronic inflammation, which might, at least in part, trigger the development of T2D [18]. Thus, T2D might be a sequel of RA, which increases the risk of CV disease in this population. Although there is no clear mechanism of how T2D increases the CV risk in inflammatory diseases, there is emerging evidence that a substantial increase in insulin resistance (IR) associated with rheumatic diseases might play a part [19, 20]. A recent randomized controlled trial showed that conventional disease-modifying antirheumatic drugs (cDMARDs), mainly methotrexate (MTX) and infliximab, decrease IR. This improvement was greater among patients using MTX and infliximab together (42% reduction, p = 0.003) compared with other treatment groups [21]. Another study reported a similar reduction in the IR of patients using MTX for 3 months; however, the relationship did not reach statistical significance, which could be explained by the short duration of exposure to MTX [22].

Recent evidence suggests that MTX, an analogue of B-vitamin, folic acid, is the gold standard cDMARD used for treating RA patients, and exerts additional beneficial effects on CV health [23]. Emerging evidence suggests that the use of MTX might lower not only the overall risk of CV disease [24] but also the risk of individual CV risk factors such as hypertension [25]. RA patients commenced on MTX were found to have significantly lower peripheral and central blood pressure compared to those not using MTX. Although there are inconsistencies in the effect of MTX on other CV risk factors [19, 26], some studies have shown that the prevalence of T2D was reduced among patients using DMARDs [20, 21]. However, there is lack of conclusive evidence about this protective effect. Therefore, the aim of this systematic review and meta-analysis was to investigate the relative impact of MTX exposure on the development of T2D among RA patients by reviewing the literature systematically and carrying out a meta-analysis of eligible studies. Prevention of T2D development might decrease the risk of developing CV disease and in turn reduce associated mortalities.

Material and methods

Methodology

A literature search was conducted for all articles including abstracts published in English, and about the relationship between MTX and T2D among patients with RA. Pre-Medline, Medline, Cochrane and Scopus databases were searched until March 2020; the Pre-Medline and Medline databases were searched using PubMed. Controlled vocabulary terms (MeSH terms) and keywords were used to identify articles. The following search terms were used: ‘‘rheumatoid” or the MeSH terms ‘‘rheumatoid arthritis”, in combination with ‘‘methotrexate” or ‘‘anti-rheumatic”, combined with ‘‘diabetes” or ‘‘type 2 diabetes” (details in S3 Materials). The citation lists were handsearched for relevant articles in an effort to look for additional papers. There is no existing protocol for this systematic review.

Study selection and patient outcomes

The exposure of interest was RA patients on MTX monotherapy. The comparison group was RA patients not taking MTX (either MTX naïve, taking other antirheumatic drugs, i.e. cDMARDs, or biological disease-modifying antirheumatic drugs [bDMARDs]). MTX exposure was defined as taking an MTX drug for at least 8 weeks. The primary outcome was the rate of T2D, defined by the presence or absence of T2D. Per patient data was calculated as the number of RA patients that had T2D out of the total group studied over the follow-up period.

Articles were independently evaluated for eligibility by the author and an independent assessor (assistant professor and senior researcher, King Saud University). Inclusion criteria for studies in the meta-analyses were the diagnosis of RA in adult patients (≥18 years) made by a rheumatologist or according to the current RA guidelines (the European League Against Rheumatism [EULAR]/ or the American College of Rheumatology [ACR]); documentation of MTX exposure; assessment of the outcome of interest (T2D), and reported raw count data. Relevant studies were excluded, if this inclusion criteria were not fulfilled; no information about MTX exposure was available; no information about the outcome (T2D) was available, and the required raw count data was not available.

Data extraction

Data from each study was summarized in terms of the study design, participant characteristics, assessed MTX exposure, details of non-MTX antirheumatic medications, assessed outcome, assessment of other traditional CV risk factors and study quality score (Qi).

Quality scores of included studies

Included studies have different study designs with a variety of methodological approaches. Thus, considering the quality of the pooled studies was essential. A validated and reproducible checklist (S4 Materials) was used to critically evaluate selected studies; this tool was feasible and effective in differentiating papers with high precision and less bias from poor quality studies [27, 28]. It also enabled calculating a quality score (Qi) for each study. This checklist examines the quality of each study using 14 questions to evaluate the internal validity, external validity and statistical analysis of the study (S4 Materials) [27]. Each question in the checklist was given points to calculate the Qi score. One of the questions in the checklist accounting for prognostic factors (question 9 in S4 Materials) was tailored to accommodate the requirements of this study. The prognostic score was created to balance the indicators affecting T2D outcomes across exposure groups. These prognostic factors include the age, sex, hypertension, body mass index (BMI), dyslipidemia, family history of T2D and CV disease, physical inactivity, duration of RA, and medications used (folic acid, corticosteroids and cDMARDs and bDMARDs). If the study balanced ≥5 of these indicators among comparison groups, it was given a score of 1. On the other hand, if the study reported 3 or 4 indicators, it was given a score of 0.5; if the study balanced 1 or 2 of these factors or if there was no evidence of reporting any of these prognostic factors, it was given a score of 0. After critically reading each study and giving points for each question, the total points were summed up to obtain the Qi score. A Qi score of ≥10 was defined as a high-quality score and a Qi score ≤9 was defined as a low-quality score.

Statistical analysis

The association between exposure to MTX and development of T2D was assessed by conducting meta-analyses using MetaXL software version 5.3 (EpiGear International, Brisbane, Queensland, Australia). A quality-effects model (QE) was used for obtaining the meta-analyses and a random-effects model (RE) was used for comparison purposes. The QE model has an advantage over the RE model as it considers the quality of included studies by adjusting for the study-level risk of bias [29].

For the T2D outcome, raw counts for exposed and nonexposed, and event and nonevent RA groups were used to calculate the effect sizes and confidence intervals (CI). Incidental or prevalent T2D was considered an event. As the outcome of interest is binary (with T2D or without T2D), RR was used to measure the association between the exposure to MTX and the development of T2D in the RA population. While an RR of 1 indicates equivalence, an RR value <1 indicates that there is a reduced risk of developing T2D in RA patients exposed to MTX compared to RA patients not taking MTX.

Testing heterogeneity with statistical methods such as the Q-statistic and its variants has low statistical power. Therefore, adding another approach to the statistical methods is required when synthesizing the results of different studies. This additional approach includes applying prior biological knowledge, being vigilant and using common sense when testing for heterogeneity [30]. The presence of statistical heterogeneity was expected among study groups if the Q-statistic was significant (p <0.1) and/or tau-squared was less than zero.

The I2 statistic was used to assess statistical heterogeneity. This test quantifies the percentage of total variation across included studies, which resulted from heterogeneity rather than chance; a substantial level of heterogeneity is reported if the value of I2 is 50% or more [31]. When heterogeneity was documented, potential influential factors were assessed including the length of follow-up, age, methods of MTX assessment, methods of T2D assessment, usage of antirheumatic medications, number of recruited RA patients and the percentage of included males compared to females. In addition, the effect of MTX exposure on the development of T2D among RA patients was further analyzed by performing a subgroup analysis. The probable modifying effects of different characteristics of RA patients included in the study were examined. These include age, duration of RA, length of follow-up, status of T2D, RA disease activity measured by the Disease Activity Score 28 (DAS-28), year and country of publication. Subgroups were defined as mean age of RA patients, ≤60 years or >60 years; mean RA duration, ≤2 years or >2 years; time of follow-up, ≤5 years or >5 years; status of T2D, incident or prevalent T2D; RA disease activity measured by DAS-28, measured disease activity or unmeasured disease activity; year of publication, before or in 2010 or after 2010; country of publication, North America (the United states of America [USA]), Latin America, Asia Pacific and Europe. Potential publication bias was assessed by examining asymmetry in the funnel plot, which is created by plotting the effect measure against the inverse of its standard error, and with Egger’s test of the intercept [32]. The presence of asymmetry and p <0.05 indicate statistically significant publication bias.

Results

Search and screening

There were 4,310 studies found through searching electronic databases and an additional published study identified through handsearching. After removal of duplicates, there were 4,170 studies published between December 1974 and March 2020. After screening the abstracts of these studies, 4,076 were excluded as they did not meet the inclusion criteria, leaving a total of 94 studies (Fig 1). The full-texts of the remaining 94 articles were evaluated for eligibility. Seventy-eight studies were excluded because 75 articles had no information about MTX exposure and T2D, one publication was written in German and was difficult to translate, and two studies had no data for RA.

Fig 1. Flow diagram of the studies eligible for the review and meta-analysis.

Fig 1

Therefore, 16 studies that met the inclusion criteria, were included in the qualitative and quantitative analyses [11, 12, 1417, 19, 25, 3340]. There were five studies, which directly assessed the incident T2D in the RA population (16, 34, 35, 37, 40); however, these studies reported the effect of DMARDs (other than MTX) on T2D. Most included studies considered T2D as one of the CV risk factors in RA (n = 10). In one of the included studies, the occurrence of T2D was part of metabolic syndrome in RA patients commenced on DMARDs [36]. These studies were thoroughly examined to obtain appropriate data about MTX exposure and T2D outcomes in RA patients. After careful assessment of included studies, raw data for exposed and nonexposed groups, and event and nonevent groups were extracted from the 16 studies. They provided data on a total of 89,676 RA patients exposed to MTX and a total of 70,385 RA patients not exposed to MTX.

Characteristics of studies and subjects

Specific information from the eligible 16 studies included in this systematic review and meta-analysis is described in Table 1. These studies vary considerably in study design, methodological quality, patients’ age, disease duration, use of antirheumatic medications and ascertainment of the MTX exposure and outcome. All eligible articles were observational studies. Three studies had a cross-sectional design, one had a nested case-control design, eight were prospective cohorts and four were retrospective cohorts. The country of publication differed between the included studies. There were six studies conducted among RA patients in North America (the USA) [16, 19, 33, 34, 37, 40], two studies in Latin America (Mexico, Colombia, and Brazil) [12, 14], two in Asia Pacific (Australia and Taiwan) [25, 35] and six in Europe (France, Sweden and Netherlands) [11, 15, 17, 36, 38, 39].

Table 1. Overview of all included studies (n = 16), sorted by publication date in descending order.

Reference Number of patients Design Country Participants MTX exposure assessed Non- MTX DMARDs assessed T2D outcome Other traditional CV risk factors assessed Qi score
Agca et al., 2019 Total RA patients 326 (Females 212; Males 114) PCS Amsterdam, the Netherlands RA diagnosed according to the 1987 ACR classification criteria; mean age: 63±7 years; mean RA duration: 7±3 years; median follow-up time: 15 years; disease activity: measured by DAS-28 Exposure to MTX was assessed as one of the DMARDs in RA patients and diabetics; there was no information about the status of using MTX, its dose or duration cDMARDs: sulfasalazine, hydroxy-chloroquine and leflunomide. bDMARDs: no information about the drug names T2D was one of the assessed traditional CV risk factors; it was defined by the 1999 WHO criteria of glucose ≥7.0 mmol/L (≥126 mg/dL) or treated with glucose-lowering medications Hypertension, hypercholesterol-emia, smoking, BMI, family history of CVD, age and sex 10.5
Ruscitti et al., 2019 Total RA patients 841 (Females 691; Males = 150) PCS Italy RA diagnosed according to ACR/EULAR criteria for RA; median age: 60 years; median RA duration: 8.2 years; median follow-up time: 3 years; disease activity: measured by DAS-28 Exposure to MTX was assessed; no information about the status, dose or duration of using MTX cDMARDs: hydroxy-chloroquine, sulfasalazine and leflunomide. bDMARDs: TNFα inhibitors T2D was one of the assessed traditional CV risk factors; T2D defined by the ADA criteria or the use of antidiabetic medications Hypertension, hypercholesterol-emia, smoking, BMI, age and sex 11
Best et al., 2018 Total RA patients 44,190 (Females 33,809; Males 10,381) PCS USA RA diagnosed according to the ICD-9-CM; mean age: 58.9±13.4 years; median follow-up time: 1 year; disease activity: DAS-28 was not measured Exposure to MTX was assessed as one of the DMARDs in RA patients; the dosage of all the medications was based on the NDC; no information about the status of using MTX, its dose or duration cDMARDs: hydroxy-chloroquine, leflunomide and sulfasalazine. bDMARDs: etanercept, infliximab and adalimumab Prevalence of T2D was assessed; it was defined based on the ICD-9-CM code 250.X Age and sex 10
Gomes et al., 2018 Total RA patients 338 (Females 307; Males = 31) Cross-sectional study Fortaleza, Brazil RA diagnosed according to the ACR/EULAR 2010 criteria for RA; mean age: 53.5±12 years; mean RA duration: 2.2±8.7 years; median follow-up time: 1 year; disease activity: measured by DAS-28 Exposure to MTX was assessed as current use of the medication; there was no information about the dose or duration of MTX use cDMARDs: leflunomide. bDMARDs: no information about the drug names T2D was assessed as one of the components of metabolic syndrome. T2D defined by fasting blood glucose >100mg/dL or if the patient was taking any antidiabetes medications Hypertension, hypercholesterol-emia, smoking, BMI, family history of CVD, physical inactivity, age and sex 7.5
Chen et al., 2017 Total RA patients 33,112 RCS Taiwan RA diagnosis based on the ICD9 code 714.0 after at least 3 outpatient clinic visits and on holding a catastrophic illness certificate; mean age: 49.2±14.9 years; median follow-up time: 12 years; disease activity: DAS-28 was not measured Exposure to oral or injectable MTX was assessed; no information on the status of using MTX, its dose or duration cDMARDs: leflunomide, sulfasalazine, azathioprine, cyclosporine. bDMARDs: anti-TNF agents T2D diagnosed based on the ICD-9-CM code 250.X and the concurrent prescription of any antidiabetes medications Age and sex 9.5
Mangoni et al., 2017 Total RA patients 86 (Females 62; Males 24) Repeated cross-sectional study Australia RA diagnosed according to the 1987 ACR or the 2010 ACR/EULAR criteria for RA; mean age: 61±13 years; mean RA duration: 9±10.8 years; follow-up period: 8 months; disease activity: measured by DAS-28 Exposure to MTX was assessed as current use of MTX; defined as using MTX for ≥8 weeks; median MTX dose: 15 mg per week; median MTX duration: 75 months cDMARDs: hydroxy-chloroquine, leflunomide and sulfasalazine. bDMARDs: abatacept, rituximab, tocilizumab, adalimumab, etanercept, certolizumab pegol and golimumab T2D was one of the assessed traditional CV risk factors; its definition based on physician’s diagnosis or if patient reported treatment with glucose-lowering medications at the time of assessment Hypertension, hypercholesterol-emia, smoking, BMI, family history of CVD, physical inactivity, age and sex 12
Ozen et al., 2017 Total RA patients 13,669 (Females = 10,953; Males = 2,716) PCS USA RA was diagnosed based on rheumatologist’s diagnosis; mean age: 58.6±13.4 years; mean RA duration: 14.4±12.4 years; median follow-up time: 4.6 years; disease activity: DAS-28 was not measured Exposure to MTX was assessed as ever use of MTX; there was no information about the MTX dose or duration cDMARDs: hydroxy-chloroquine. bDMARDs: TNFα inhibitors, abatacept, rituximab and tocilizumab Incident T2D based on patients’ self-report of diagnosing new T2D or initiating antidiabetic medications Hypertension, smoking, BMI, age and sex 11
Amaya-Amaya et al., 2013 Total RA patients 800 (Females 647; Males 153) Cross-sectional Colombia RA diagnosed according to the 1987 ACR classification criteria for RA; mean age: 51.8±12.1 years; mean RA duration: 12.4±10.3 years; study period: between February 1996 and April 2012; disease activity: measured by DAS-28 Exposure to MTX was assessed as current or past use of MTX in the RA population; there was no information about the status of using MTX, its dose or duration cDMARDs: sulfasalazine, D-penicillamine, gold salts, leflunomide, azathioprine and cyclosporine. bDMARDs: etanercept, infliximab, adalimumab, abatacept, tocilizumab and rituximab T2D was one of the assessed traditional CV risk factors; definition based on fasting glucose ≥7.0 mmol/L (126 mg/dL) or if treated with glucose-lowering medications at the time of assessment Hypertension, hypercholesterol-emia, smoking, BMI, family history of CVD, abdominal obesity, physical inactivity, age and sex 9
Antohe et al., 2012 Total RA patients 1,587 (Females 1,150; Males 437) PCS Central Pennsylvania, USA RA diagnosed according to the 1987 ACR classification criteria for RA; median age: 57 years; median follow-up time: 3 years; disease activity: DAS-28 was not measured Exposure to MTX was assessed as continuous use of the medication; continuous use was defined as a discontinuation gap of <3 months; the start and the stop dates of using MTX were recorded during the observation period; there was no information about the dose of MTX cDMARDs: hydroxy-chloroquine bDMARDs: TNFα inhibitors including adalimumab, etanercept, golimumab and infliximab Incident T2D was the primary outcome; it was defined based on the physician-established diagnosis or using the 2010 ADA criteria, random glucose level of ≥200 mg/dl, HbA1c ≥6.5%, or ever use of any hypoglycemic or antidiabetic medications. BMI, age and sex 9
Bili et al., 2011 Total RA patients 1,127 (Females 823; Males 304) RCS Central Pennsylvania, USA RA diagnosed according to the 1987 ACR classification criteria for RA; mean age: 60.7±15.1 years; median follow-up time: 2 years; disease activity: DAS-28 was not measured Exposure to MTX was assessed as continuous use of the medication; continuous use was defined as a discontinuation gap of <3 months; the start and stop dates of using MTX were recorded during the observation period; there was no information about the dose of MTX cDMARDs: hydroxy-chloroquine. bDMARDs: TNFα inhibitors Incident T2D based on the 2010 ADA criteria: random glucose ≥200 mg/dL or HbA1c ≥6.5% or ever use of hypoglycemic/ antidiabetic medications BMI, age and sex 10
Innala et al., 2011 Total patients at entry 700 (Females 481; Males 219;); Total patients at end 442 (Females 301; Males 141;) PCS Sweden Early RA diagnosed by ARA criteria; patient records and self-reported questionnaire on comorbidity and local rheumatologist follow-up assessments were used; mean age: 55.2±14.3 years; mean disease duration: 3.3 months; median follow-up time: 5 years; disease activity: measured by DAS-28 Exposure to ever use of MTX was assessed; accumulated number of months of treatment was considered, there was no information about the MTX duration or its dose cDMARDs: sulfasalazine, chloroquine, azathioprine, mycopheno, atmophetil, myocrisine, auranofin, cyclosporine and leflunomid. bDMARDs: etanercept, adalimumab, infliximab, anakinra and rituximab T2D was one of the assessed traditional CV risk factors; there was no standardized definition for T2D, it was assessed based on patients’ self-reported questionnaire on comorbidity Hypertension, hypercholesterol-emia, smoking, BMI, age and sex 11
Solomon et al., 2011 Total RA patients 11,327 (Females 8,900; Males = 2,427) PCS USA RA diagnosed based on at least 2 visits to the rheumatologist using the ICD-9-CM 714.x criteria; mean age: 53.7±13.2 years; median follow-up time: 5.8 months; disease activity: DAS-28 was not measured Exposure to oral or injectable MTX was assessed; there was no information about the MTX status, dose or duration of use cDMARDs: hydroxy-chloroquine, sulfasalazine, leflunomide, cyclosporine, azathioprine, cyclo-phosphamide, mycophenolate mofetil, 6-thioguanine, acitretin, D-penicillamine, gold, auranofin, myochrysine, and solganol; bDMARDs: TNFα inhibitors including dalimumab, etanercept an infliximab Incident T2D defined by presence of at least 1 diagnosis of T2D based on ICD-9-CM250.x, and a new user of T2D-specific medications including all insulin preparations and oral antidiabetic agents Age and sex 10
Radovits et al., 2009 Total RA patients 222 (Females 145; Males 77) Nested case-control study Nijmegen, the Netherlands RA diagnosed according to the 1987 revised ACR criteria; random selection of controls from the PCS; mean age: 67.5±10 years; mean RA duration: 4.3±8.5 years;; disease activity: measured by DAS-28 Exposure to MTX was assessed among RA cases and controls; cumulative MTX dose among RA cases and controls: 1791.6 vs. 1943.9 mg; total MTX treatment duration among RA cases and controls: 152.9 vs. 161.9 weeks bDMARDs: TNFα inhibitors T2D was one of the assessed traditional CV risk factors; there was no standardized definition for T2D Hypertension, hypercholesterol-emia, smoking, BMI, family history of CVD, age and sex 11
Assous et al., 2007 Total RA patients 239 (Females 196; Males 43) RCS France RA diagnosed according to the 1987 revised ACR criteria; mean age: 56.3±15.7 years; mean RA duration: 11.6±8.8 years; mean follow-up time: 5.4±1.8 years; disease activity: DAS-28 was not measured Exposure to MTX was assessed as one of the DMARDs in RA patients; duration of use ≥1 month; there was no information about the status of using MTX or its dose bDMARDs: infliximab, etanercept, and adalimumab T2D was one of the assessed traditional CV risk factors; there was no standardized definition for T2D Hypertension, hypercholesterol-emia, smoking, BMI, age and sex 7
Wasko et al., 2007 Total RA patients 4,905 PCS USA RA diagnosed according to the 1987 ACR revised classification criteria for RA; mean age: 58.2±13.9 years; mean RA duration: 13±11.7 years; median follow-up time: 21.5 years; disease activity: DAS-28 was not measured Exposure to MTX was assessed as ever or never use of MTX; there was no information about the MTX dose, duration of MTX use (percentage of observation time): 39% cDMARDs: hydroxy-chloroquine Incident T2D based on patients’ self-report of the diagnosis or the new use of hypoglycemic medications Age and sex 10
del Rincon et al., 2001 Total RA patients 236 (Females 146; Males 90) RCS Mexico RA diagnosed according to 1987 ACR criteria; O´RALE cohort used; matched non-RA: SAHS cohort; median age: 56 years (range 22–80); median follow-up: time 7 years; disease activity: DAS-28 was not measured Exposure to MTX was current use of the medication. It was one of the DMARDs assessed in RA patients; there was no information about the duration of using MTX or its dose No information about DMARDs (MTX exposure, dose, or duration) T2D was one of the assessed traditional CV risk factors; it was defined based on the 1997 criteria of the ADA: glucose ≥7.0 mmol/L (≥126 mg/dL) or if treated with glucose-lowering medications at the time of assessment Systolic blood pressure, hypercholesterol-emia, cigarette smoking, BMI, age and sex 11

ACR = American College of Rheumatology; ADA = American Diabetes Association; ARA = American Rheumatism Association; bDMARDs = biological disease-modifying antirheumatic drugs; BMI = body mass index; CV = cardiovascular; CVD = cardiovascular diseases; DAS-28 = Disease Activity Score 28; EULAR = American College of Rheumatology/European League Against Rheumatism; HbA1c = glycosylated hemoglobin; ICD-9-CM = International Classification of Diseases, 9th Revision, Clinical Modification; MTX = methotrexate; NDC = national drug codes; O´RALE = Outcome of Rheumatoid Arthritis Longitudinal Evaluation (del Rincon et al 2001); PCS = prospective cohort study; Qi = quality score; RA = rheumatoid arthritis; RCS = retrospective cohort study; SAHS = San Antonio Heart Study cohort; T2D = type 2 diabetes; cDMARDs = conventional disease-modifying antirheumatic drugs; TNFα = tumor necrosis factor alpha; USA = United States of America; WHO = World Health Organization.

There was a noticeable variation in the methodological quality of included studies; the quality score (Qi score) ranged from 7 [17] to 12 [25] (S5 Materials). Additionally, the mean age of RA patients ranged between 49 [35] and 67 years [38]. Patients included in this systematic review had established RA (mean range of RA duration was 2.2±8.7 [36] and 14.4±12.4 [37] years). Although early RA (mean RA duration 3.3 months) was examined in one of studies [11], data were obtained during the follow-up period (5 years), which indicates that patients had established RA. Each study reported exposure to MTX, and the development of T2D in RA patients. However, no standard criteria were used when selecting the RA patients [37], ascertaining exposure to MTX [15, 39], or the occurrence of T2D [17, 25, 37, 38, 40]. Five studies recruited RA patients with incident T2D [16, 19, 34, 37, 40] while other studies included RA patients with prevalent T2D [11, 12, 14, 15, 17, 25, 33, 35, 36, 38, 39]. All included studies reported the use of DMARDs and provided details of the drug names except one study [12]. Traditional CV risk factors other than T2D were assessed in 12 studies [11, 12, 1417, 25, 34, 3639], namely, hypertension, hypercholesterolemia, smoking, BMI or/and obesity, family history of CV disease, physical inactivity, age and sex. However, four studies [19, 33, 35, 40] assessed only the age and sex of the RA patients (i.e. non-modifiable CV risk factors).

Risk of type 2 diabetes

All 16 studies were included in the meta-analyses. The effect size was in favor of a promising beneficial effect of MTX in reducing the risk of T2D in RA patients. The QE model RR for all these studies was 0.48 (95% CI 0.16, 1.43), implying that the risk of T2D among RA patients exposed to MTX was reduced by 52% compared to those RA patients not taking MTX (Fig 2). A similar effect was found by the RE model RR 0.13 (95% CI 0.08, 0.22), suggesting that there was an 87% reduction in the risk of T2D among RA patients taking MTX compared to those who were not taking MTX (Fig 3).

Fig 2. Relative risk of type 2 diabetes in rheumatoid arthritis patients on methotrexate versus those not taking methotrexate.

Fig 2

QE = quality effects model; RR = relative risk; T2D = type 2 diabetes.

Fig 3. Relative risk of type 2 diabetes in rheumatoid arthritis patients on methotrexate versus those not taking methotrexate.

Fig 3

RE = random effects model; RR = relative risk; T2D = type 2 diabetes.

Sensitivity analysis (Table 2) examined the possible effects of various factors deemed to influence T2D outcomes and assessed the degree of sensitivity of the obtained results to such changes. Possible factors, which might influence the T2D outcomes, were considered in the analysis. The pooled RR was recalculated after subgrouping the mean age of RA patients (≤60 years or >60 years), mean RA duration (≤2 years or >2 years), time of follow-up (≤5 years or >5 years), status of T2D (incident or prevalent T2D), RA disease activity measured by DAS-28 (measured disease activity or unmeasured disease activity), year and country of publication (before or in 2010 and after 2010). Results presented in Table 2 show that RA patients taking MTX had greater reduction in the development of T2D if they were older (>60 years); the duration of RA was shorter (≤2 years); the follow-up time was longer (>5 years); they had prevalent T2D and were reported in studies published before 2010; the RA disease activity was measured and adjusted in the study.

Table 2. Sensitivity analyses of methotrexate and type 2 diabetes in RA patients.

Parameters and type 2 diabetes [RR QE model (95% CI)]
Mean age of subjects (years)
≤60 (n = 9): 0.61 (95% CI 0.23, 1.61)
>60 (n = 7): 0.05 (95% CI 0.01, 0.26)
Mean duration of RA (years)
≤2 (n = 2): 0.09 (95% CI 0.03, 0.27)
>2 (n = 8): 0.57 (95% CI 0.06, 4.96)
Time of follow-up (years)
≤5 (n = 7): 0.57 (95% CI 0.05, 6.69)
>5 (n = 6): 0.51 (95% CI 0.03, 9.42)
Status of T2D
Incident T2D (n = 5): 0.77 (95% CI 0.43, 1.37)
Prevalent T2D (n = 11): 0.37 (95% CI 0.01, 9.95)
Disease activity
Measured disease actvity (n = 7): 0.06 (95% CI 0.02, 0.18)
Unmeasured disease activity (n = 9): 0.61 (95% CI 0.24, 1.58)
Year of publication
≤2010 (n = 4): 0.45 (95% CI 0.12, 1.64)
>2010 (n = 12): 0.47 (95% CI 0.14, 1.59)
Country of publication
North America (USA) (n = 6): 0.67 (95% CI 0.09, 5.00)
South America (n = 2): 0.08 (95% CI 0.00, 2.81)
Asia Pacific (n = 2): 0.65 (95% CI 0.37, 1.13)
Europe (n = 6): 0.07 (95% CI 0.02, 0.18)

n = number of studies involved in the analysis, USA = United States of America

Comparison of results after subgrouping the studies into different regions showed that the risk of T2D among MTX users decreased more in patients recruited for studies conducted in Latin America and Europe compared to those from North America (USA) and the Asia Pacific. In addition, a sensitivity analysis was carried out after excluding the study by Best et al. (2018) as its effect estimate showed an RR of zero. The pooled results for the T2D outcome were not significantly different from the original results; both RE and QE models showed a reduction in the T2D outcome among RA patients on MTX, reporting an RR of 0.19 (95% CI 0.12, 0.29) and an RR of 0.52 (95% CI 0.32, 1.21), respectively. Nevertheless, there was no significant variation in these results compared to the original findings. There is evidence of publication bias suggested by the funnel plot of the included 16 studies (S1 Fig); this finding is confirmed by Egger’s test, which shows significant asymmetry (p <0.05).

Discussion

To the best of our knowledge, this systematic review and meta-analysis is the first to explore the impact of MTX on the development of T2D in the RA population. It provides evidence for a significant positive effect of this drug on decreasing the risk of developing T2D.

High CV risk in the RA population is well documented. T2D is a well-known risk factor for CV disease not only in the general population [41], but also in the RA population. RA patients with T2D had almost twice the risk of developing CV disease compared to nondiabetic RA patients (RR 1.94, 95% CI 1.58, 2.30) [10]. This higher CV risk among diabetic RA patients has been reported by many observational studies [1416]. This two-fold increase in the CV risk among diabetic RA patients is similar to the risk observed in the general population [15, 17]. This indicates that T2D, as one of the traditional CV risk factors, increases the CV risk independent of inflammation. About 50% reduction in cardiovascular risk (RR 0.41, 95% CI 0.15, 0.96) was observed with a modest improvement in the glycemic status among T2D patients [42]. Hence, one of the recommendations introduced by the EULAR guidelines for CV risk management in patients with RA, is aggressive treatment to lower the inflammation associated with RA, and to modify the presence of CV risk factors such as T2D [43].

Although there is no conclusive evidence about the effect of MTX on the development of T2D, results from studies included in this meta-analysis showed that MTX decreases the risk of T2D in RA patients (RR 0.48, 95% CI 0.16, 1.43). This finding is consistent with several studies that reported a reduction in the incidence rate of T2D among patients with rheumatic diseases and using other cDMARDs including hydroxychloroquine (HCQ) [44] and TNF inhibitors (TNFi) [45]. An observational study examined the relationship between MTX and the glycemic level [26]. The latter study reported a slight reduction in the level of glycosylated hemoglobin (HbA1c), among diabetic RA patients. However, the results from this study might be underestimated, as the MTX sample size was small and not precisely powered to detect differences in the HbA1c levels among MTX users. Similarly, a smaller reduction in the T2D incidence among MTX users compared to other cDMARDs was reported by a larger observational study [19]. Once again, this finding might be underestimated and might be exposed to misclassification bias as about two-thirds of the RA cohort had been previously exposed to MTX drugs; however, it was classified with a non-MTX cohort. Thus, the greater reduction in T2D rates observed among other cDMARD users might be, at least partially, explained by the prior MTX exposure.

In line with the finding of this meta-analysis, MTX has shown a positive impact not only on T2D but also on other CV risks in the RA population [24, 25, 46, 47]. In contest to our findings, however, an observational study claims that the risk of T2D was higher among RA patients using MTX compared to other DMARDs (RR 1.46, 95% CI 1.26, 1.68) [37]. Similarly, the cardioprotective effect of low-dose MTX was not documented among patients with inflammatory diseases such as atherosclerosis [48]. The author of this study, has reported in previous observational data that the use of low-dose MTX had repeatedly shown an association with reduced vascular event rates in patients with RA [48]. This paradox might have resulted from different types of selection bias that occurred predominantly in research about rheumatic diseases. This form of bias has been termed ‘index event bias’ or ‘collider stratification bias’ [4951], and occurs as a result of conditioning on a common effect (the index event). This leads to an induction of spurious (perhaps opposite) association between the exposure and outcome. Therefore, this MTX paradox might be caused by index event bias in which MTX is associated with the improvement of the disease (RA ‘index event’) and the RA disease sequelae (T2D); resulting in conditioning of the index event of RA [50]. This conditioning may lead to a spurious association (incorrect effect estimate) between the exposure and outcome due to unknown or uncontrolled confounders associated with both, the index event and the events downstream of RA. One of the possible confounders in the study [37] is the use of other anti-inflammatory drugs. T2D risk reduction was observed among MTX users when exposure to other DMARDs was adjusted in the analyses, indicating that MTX monotherapy has a positive impact in decreasing the development of T2D among RA patients.

Potential factors that might influence the pooled results were studied in the subgroup analysis. A relatively lower risk of T2D was observed in patients aged >60 years, RR 0.05 compared to those ≤60 years of age, with RR 0.61. This lower risk among older RA patients could be explained by the longer duration of exposure to MTX. This finding is consistent with the results of a prospective cohort study, showing older RA patients using MTX had better survival outcomes and reduced cardiovascular mortality [52]. Similarly, a trend towards a decreased T2D risk was documented in RA patients with longer follow-up periods (>5 years). It is possible that this observed reduction in T2D was due to the longer duration of MTX exposure. As most of the RA patients have established RA and have been exposed to MTX for a long duration, it is possible that the observed reduction in the T2D risk is related, at least partially, to the long MTX exposure. This was supported by the decrease in T2D among prevalent cases of T2D compared to the incident cases of T2D. Although the dose of MTX is clinically important, we found in our previous studies that the concentration of MTX inside the red blood cells (RBCs) (i.e. MTX polyglutamate [MTXPG] concentration) is more accurate [25, 46]; as approximately 95% of the MTX dose is metabolised within 24 hr of administration. Additionally, these studies [25, 46] show that the RBC MTXPG concentration is influenced not only by genetic but also non-genetic factors. In line with this finding, increased age and a longer duration of MTX use were associated with higher MTX concentrations [53]. This study found another major non-genetic determinant of increased MTXPG concentration, which is a lower estimated glomerular filtration rate (GFR). Lower GFR is common among the elderly with chronic diseases, such as T2D and RA, and use of prednisolone and nonsteroidal anti-inflammatory drugs (NSAIDs). These drugs are commonly used by RA patients and induce the inhibition of prostaglandin production [54]. A longer duration of exposure to MTX [50] might also explain the lower risk, which decreased by about 50% among prevalent T2D patients compared with incident T2D patients (RR 0.77 vs. 0.37). Moreover, our finding of lower risk of T2D in patients with a shorter RA duration is consistent with other studies [35]. RA patients taking MTX, with a disease duration ≤2 years (i.e. early RA) had a greater reduction in their T2D risk (RR 0.09, 95% CI 0.03, 0.27). This reduction in the risk might be attributed to the beneficial effect of MTX as patients with early RA are usually commenced on MTX monotherapy as a first line treatment. Those RA patients with a good initial response to MTX continue to have excellent 2-year clinical outcomes [55] and improved CV risks [25]. Additionally, it is possible that many diabetic RA patients who had longer disease durations had undiagnosed T2D that went unmanaged. This explanation is supported by published evidence indicating that RA has been associated with a higher prevalence of undiagnosed T2D, particularly in patients with longer RA durations [56]. Additionally, it is well known that patients with long-standing RA had greater disease activity and severity, which is related to a higher risk of T2D [36]. This study found that RA patients taking MTX had greater significant reduction in the development of T2D, if the disease activity was measured and adjusted in the analysis (RR 0.06, 95% CI 0.02, 0.18). This indicates that MTX has an independent beneficial effect on T2D development in the RA population. The risk of T2D among MTX users was reduced further in patients recruited for studies conducted in Latin America and Europe compared to those from North America (USA) and Asia Pacific. The higher risk of T2D in the USA and Asia Pacific region might be partially explained by the differences in the social determinants of health influenced by geography, epidemiology of chronic diseases such as obesity, and type of lifestyle [57].

The pooled RR of one of the studies [33] was zero, implying that the exposure factor (MTX) might be an extremely protective factor [58]. There were seven cases of T2D out of the total MTX group (n = 20,873), indicating that T2D as an outcome is extremely rare among MTX users [33]. Regardless of that evidence, an additional sensitivity analysis was carried out without the study [33]. In this meta-analysis, the pooled result for T2D was still in favor of MTX exposure; both RE and QE models showed a reduction in the T2D outcome among RA patients on MTX drugs reporting RR 0.19 (95% CI 0.12, 0.29) and RR 0.52 (95% CI 0.32, 1.21), respectively.

Although there are variations in the reported evidence about the impact of DMARDs on T2D, there is emerging evidence supporting the favorable effect of HCQ [44], MTX [26] and TNFi [45] on altering glucose metabolism. The underlying mechanisms of T2D risk reduction with HCQ and TNFi are not fully established. However, one of the explanations, which is independent of the anti-inflammatory effect of HCQ and TNFi, is related to the improvement in insulin sensitivity and pancreatic β-cell functions, which decrease the risk of T2D [59, 60]. To our knowledge, the mechanism of MTX in improving IR and glucose homeostasis is still debatable. Nevertheless, emerging evidence shows that MTX reduces the level of HbA1c in RA and psoriasis [61]; after 6 months of MTX therapy, although the level of IR was unchanged, the concentration of HbA1c was reduced from 5.80 ± 0.29% to 5.51 ± 0.32%, p < 0.001. Even though the exact mechanism of such an improvement is not fully understood, MTX seems to offer long-lasting beneficial metabolic effects beyond its anti-inflammatory actions [37, 46, 61]. TNFi was found to have a long-lasting clinical effect on T2D, which lasted up to 6 months after cessation of the drug [37]. We, therefore, hypothesize that MTX improves the level of HbA1c and glucose homeostasis as the MTXPG inhibit 5-aminoimidazole-4-carboxamide ribonucleotide formyltransferase. The consequent accumulation of the substrate aminoimidazole carboxamide ribonucleotide (AICAR) and its metabolites inhibit adenosine deaminase and adenosine monophosphate (AMP) deaminase [62,63]. This leads to a rise in the intracellular concentrations of AICAR-monophosphate (ZMP) and AMP [64]. ZMP activates the adenosine monophosphate (AMP)-activated protein kinase (AMPK). Activation of AMPK ameliorates glucose homeostasis in T2D [65, 66]. Therefore, MTX may ameliorate glucose homeostasis by promoting ZMP accumulation and AMPK activation [67, 68]. Similar to metformin, which is an antihyperglycemic agent [69], MTX is able to decrease hepatic production and intestinal absorption of glucose and increase insulin sensitivity via the activation of AMPK.

This systematic review and meta-analysis has some limitations. Controlling for corticosteroid exposure was one of the limitations; although few RA patients had been exposed at some point of management to a small dose of prednisolone (i.e. ≤5 mg per day), there was no detailed information about the exposure. The EULAR task force concluded that a low dose of the glucocorticoid, prednisone (≤5 mg per day) is generally safe for RA patients [43]. However, there is no conclusive evidence about the effect of low dose corticosteroids (≤5mg per day) on developing T2D in the RA population. Most published studies reported a transient increase in blood glucose levels after taking a high to moderate dose of prednisolone, which usually resolves after drug discontinuation [43, 70]. Additionally, the duration of RA plays a vital role in RA management with corticosteroids. Commencing RA patients on corticosteroids is especially recommended by the ACR in early RA; based on the 2015 ACR and 2019 EULAR guidelines for the treatment of RA. Patients with early RA are usually started on low-dose corticosteroids (i.e. ≤5 mg of prednisolone or its equivalent); early RA is defined by the ACR as a disease duration ≤6 months [43, 71]. In this study, however, most of the RA patients were diagnosed with established RA as the mean RA duration ranged between 2.2±8.7 and 14.4±12.4 years.

Moreover, there is an indication for publication bias. Large studies and positive findings were published more frequently compared to small studies; usually, authors do not submit insignificant or negative results for publication. Additionally, papers with such findings are often rejected by reviewers and/or editors leading to publication bias. There was also a variation in the participants’ age at enrolment, duration of RA, duration of follow-up, country and time of the study.

Regardless of these limitations, numerous strengths should also be acknowledged. The impact of these factors (possible confounders affecting the effect estimates) was further examined by subgroup analysis that retained the trend of a lower risk of T2D in RA patients exposed to MTX. Considering the Qi score of included studies when calculating the effect estimates is another strength of this meta-analysis.

Conclusion

In conclusion, our meta-analysis indicates that MTX shows a promising effect in reducing the risk of T2D in the RA population. Short- and long-term effects of MTX on the development of not only T2D but also other CV risk factors need to be explored by controlled clinical trials. In addition, the effects of MTX can be compared to other DMARDs to confirm its CV protective effects and establish possible mechanisms. If this association is proven by conducting more randomized clinical trials, MTX could be used as a cardioprotective and/or antidiabetic drug in the RA population as they are at higher risk of CV morbidities and mortalities. Thus, careful recognition and diagnosis of RA patients at a higher risk of T2D is mandatory, to initiate appropriate management and reduce the risk of T2D and associated CV risk. Future experimental and human randomized clinical trials are needed to investigate the association between MTX and CV risks.

Supporting information

S1 Fig. Funnel plot meta-analysis type 2 diabetes using fixed effect model (Legend: FE = fixed effect model; RR = relative risk; T2D = type 2 diabetes).

(TIF)

S1 Materials. PRISMA 2009 flow diagram.

(DOC)

S2 Materials. PRISMA 2009 checklist.

(DOC)

S3 Materials. Appendix 1.

Data sources.

(DOCX)

S4 Materials. Appendix 2.

Checklist for assessing quality of included studies in the meta-analysis.

(DOCX)

S5 Materials. Appendix 3.

Quality assessment scores for studies included in the meta-analysis.

(PDF)

S1 Dataset

(PDF)

Acknowledgments

Special thanks for support by the College of Medicine Research Center, Deanship of Scientific Research, King Saud University Riyadh, Saudi Arabia. Many thanks to Dr Emad Mahmoud, assistant professor and senior researcher at King Saud University, for evaluating the eligibility of the articles for inclusion in this systematic review and meta-analysis.

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

The author received no specific funding for this work.

References

  • 1.Coutant F, Miossec P. Evolving concepts of the pathogenesis of rheumatoid arthritis with focus on the early and late stages. Curr Opin Rheumatol. 2020;32(1):57–63. 10.1097/BOR.0000000000000664 [DOI] [PubMed] [Google Scholar]
  • 2.Lau CS, Chia F, Harrison A, Hsieh TY, Jain R, Jung SM, et al. APLAR rheumatoid arthritis treatment recommendations. Int J Rheum Dis. 2015;18(7):685–713. 10.1111/1756-185X.12754 [DOI] [PubMed] [Google Scholar]
  • 3.Solomon DH, Karlson EW, Rimm EB, Cannuscio CC, Mandl LA, Manson JE, et al. Cardiovascular morbidity and mortality in women diagnosed with rheumatoid arthritis. Circulation. 2003;107(9):1303–1307. 10.1161/01.cir.0000054612.26458.b2 [DOI] [PubMed] [Google Scholar]
  • 4.Meune C, Touze E, Trinquart L, Allanore Y. Trends in cardiovascular mortality in patients with rheumatoid arthritis over 50 years: a systematic review and meta-analysis of cohort studies. Rheumatology (Oxford). 2009;48(10):1309–1313. 10.093/rheumatology/kep252 Epub 2009 Aug 20. [DOI] [PubMed] [Google Scholar]
  • 5.WHO. WHO-Global-Report: WHO; 2016 [Available from: http://www.who.int/diabetes/global-report/en/.
  • 6.Del Rincon I, Williams K, Stern MP, Freeman GL, O'Leary DH, Escalante A. Association between carotid atherosclerosis and markers of inflammation in rheumatoid arthritis patients and healthy subjects. Arthritis Rheum. 2003;48(7):1833–1840. 10.1002/art.11078 [DOI] [PubMed] [Google Scholar]
  • 7.Kaisa M, Maki-Petaja KM, Hall FC, Booth AD, Wallace SM, Yasmin. Rheumatoid arthritis is associated with increased aortic pulse-wave velocity, which is reduced by antitumor necrosis factor-alpha therapy. Circulation. 2006;114(11):1185–1192. 10.1161/CIRCULATIONAHA.105.601641 Epub 2006 Sep 4. [DOI] [PubMed] [Google Scholar]
  • 8.Kerekes G, Szekanecz Z, Der H, Sandor Z, Lakos G, Muszbek L, et al. Endothelial dysfunction and atherosclerosis in rheumatoid arthritis: a multiparametric analysis using imaging techniques and laboratory markers of inflammation and autoimmunity. J Rheumatol. 2008;35(3):398–406. Epub 2008 Jan 15. [PubMed] [Google Scholar]
  • 9.Rho YH, Oeser A, Chung CP, Milne GL, Stein CM. Drugs Used in the Treatment of Rheumatoid Arthritis: Relationship between Current Use and Cardiovascular Risk Factors. Arch Drug Inf. 2009;2(2):34–40. 10.1111/j.1753-5174.2009.00019.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Baghdadi LR, Woodman RJ, Shanahan EM, Mangoni AA. The impact of traditional cardiovascular risk factors on cardiovascular outcomes in patients with rheumatoid arthritis: a systematic review and meta-analysis. PLoS One. 2015;10(2):e0117952 10.1371/journal.pone.0117952 eCollection 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Innala L, Moller B, Ljung L, Magnusson S, Smedby T, Sodergren A, et al. Cardiovascular events in early RA are a result of inflammatory burden and traditional risk factors: a five year prospective study. Arthritis Res Ther. 2011;13(4):R131 10.1186/ar3442 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Del Rincon I, Williams K, Stern MP, Freeman GL, Escalante A. High incidence of cardiovascular events in a rheumatoid arthritis cohort not explained by traditional cardiac risk factors. Arthritis Rheum. 2001;44(12):2737–2745. [DOI] [PubMed] [Google Scholar]
  • 13.Gonzalez A, Maradit Kremers H, Crowson CS, Ballman KV, Roger VL, Jacobsen SJ, et al. Do cardiovascular risk factors confer the same risk for cardiovascular outcomes in rheumatoid arthritis patients as in non-rheumatoid arthritis patients? Ann Rheum Dis. 2008;67(1):64–69. 10.1136/ard.2006.059980 Epub 2007 May 21. [DOI] [PubMed] [Google Scholar]
  • 14.Amaya-Amaya J, Sarmiento-Monroy JC, Mantilla RD, Pineda-Tamayo R, Rojas-Villarraga A, Anaya JM. Novel risk factors for cardiovascular disease in rheumatoid arthritis. Immunol Res. 2013;56(2–3):267–286. 10.1007/s12026-013-8398-7 [DOI] [PubMed] [Google Scholar]
  • 15.Agca R, Hopman L, Laan KCJ, van Halm VP, Peters MJL, Smulders YM, et al. Cardiovascular Event Risk in Rheumatoid Arthritis is Higher than in Type 2 Diabetes: a 15 Year Longitudinal Study. J Rheumatol. 2019;15(180726):180726. [DOI] [PubMed] [Google Scholar]
  • 16.Antohe JL, Bili A, Sartorius JA, Kirchner HL, Morris SJ, Dancea S, et al. Diabetes mellitus risk in rheumatoid arthritis: reduced incidence with antitumor necrosis factor alpha therapy. Arthritis Care Res (Hoboken) 2012;64(2):215–221. 10.1002/acr.20657 [DOI] [PubMed] [Google Scholar]
  • 17.Assous N, Touze E, Meune C, Kahan A, Allanore Y. Cardiovascular disease in rheumatoid arthritis: single-center hospital-based cohort study in France. Joint Bone Spine. 2007;74(1):66–72. 10.1016/j.jbspin.2006.10.001 Epub Nov 17. [DOI] [PubMed] [Google Scholar]
  • 18.Lu MC, Yan ST, Yin WY, Koo M, Lai NS. Risk of rheumatoid arthritis in patients with type 2 diabetes: a nationwide population-based case-control study. PLoS One. 2014;9(7):e101528 10.1371/journal.pone.0101528 eCollection 2014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Solomon DH, Massarotti E, Garg R, Liu J, Canning C, Schneeweiss S. Association between disease-modifying antirheumatic drugs and diabetes risk in patients with rheumatoid arthritis and psoriasis. JAMA. 2011;305(24):2525–2531. 10.1001/jama.2011.878 [DOI] [PubMed] [Google Scholar]
  • 20.Bartels CM, Saucier JM, Thorpe CT, Kind AJ, Pandhi N, Hansen KE, et al. Monitoring diabetes in patients with and without rheumatoid arthritis: a Medicare study. Arthritis Res Ther. 2012;14(4):R166 10.1186/ar3915 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Toms TE, Panoulas VF, John H, Douglas KM, Kitas GD. Methotrexate therapy associates with reduced prevalence of the metabolic syndrome in rheumatoid arthritis patients over the age of 60- more than just an anti-inflammatory effect? A cross sectional study. Arthritis Res Ther. 2009;11(4):R110 10.1186/ar2765 Epub 009 Jul 16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Nicolau J, Lequerre T, Bacquet H, Vittecoq O. Rheumatoid arthritis, insulin resistance, and diabetes. Joint Bone Spine. 2017;84(4):411–416. 10.1016/j.jbspin.2016.09.001 Epub Oct 21. [DOI] [PubMed] [Google Scholar]
  • 23.Roubille C, Richer V, Starnino T, McCourt C, McFarlane A, Fleming P, et al. The effects of tumour necrosis factor inhibitors, methotrexate, nonsteroidal anti-inflammatory drugs and corticosteroids on cardiovascular events in rheumatoid arthritis, psoriasis and psoriatic arthritis: a systematic review and meta-analysis. Ann Rheum Dis. 2015;74(3):480–489. 10.1136/annrheumdis-2014-206624 Epub 2015 Jan 5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Micha R, Imamura F, Wyler von Ballmoos M, Solomon DH, Hernan MA, Ridker PM, et al. Systematic review and meta-analysis of methotrexate use and risk of cardiovascular disease. Am J Cardiol. 2011;108(9):1362–1370. 10.1016/j.amjcard.2011.06.054 Epub Aug 17. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Mangoni AA, Baghdadi LR, Shanahan EM, Wiese MD, Tommasi S, Elliot D, et al. Methotrexate, blood pressure and markers of arterial function in patients with rheumatoid arthritis: a repeated cross-sectional study. Ther Adv in Musculoskelet Dis. 2017;9(9):213–229. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Rekedal LR, Massarotti E, Garg R, Bhatia R, Gleeson T, Lu B, et al. Changes in glycosylated hemoglobin after initiation of hydroxychloroquine or methotrexate treatment in diabetes patients with rheumatic diseases. Arthritis Rheum. 2010;62(12):3569–3573. 10.1002/art.27703 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Baghdadi LR, Abu Hashim H, Amer SA, Palomba S, Falbo A, Al-Ojaimi E, et al. Impact of obesity on reproductive outcomes after ovarian ablative therapy in PCOS: a collaborative meta-analysis. Reprod Biomed Online. 2012;25(3):227–241. 10.1016/j.rbmo.2012.05.010 Epub May 30. [DOI] [PubMed] [Google Scholar]
  • 28.Doi SA, Thalib L. A quality-effects model for meta-analysis. Epidemiology. 2008;19(1):94–100. 10.1097/EDE.0b013e31815c24e7 [DOI] [PubMed] [Google Scholar]
  • 29.Al Khalaf MM, Thalib L, Doi SA. Combining heterogenous studies using the random-effects model is a mistake and leads to inconclusive meta-analyses. J Clin Epidemiol. 2011;64(2):119–123. 10.1016/j.jclinepi.2010.01.009 Epub Apr 20. [DOI] [PubMed] [Google Scholar]
  • 30.Takkouche B, Cadarso-Suarez C, Spiegelman D. Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis. Am J Epidemiol. 1999;150(2):206–215. 10.1093/oxfordjournals.aje.a009981 [DOI] [PubMed] [Google Scholar]
  • 31.Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–560. 10.1136/bmj.327.7414.557 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–634. 10.1136/bmj.315.7109.629 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Best JH, Kong AM, Lenhart GM, Sarsour K, Stott-Miller M, Hwang Y. Association Between Glucocorticoid Exposure and Healthcare Expenditures for Potential Glucocorticoid-related Adverse Events in Patients with Rheumatoid Arthritis. J Rheumatol. 2018;45(3):320–328. 10.3899/jrheum.170418 Epub 2018 Jan 15. [DOI] [PubMed] [Google Scholar]
  • 34.Bili A, Sartorius JA, Kirchner HL, Morris SJ, Ledwich LJ, Antohe JL, et al. Hydroxychloroquine use and decreased risk of diabetes in rheumatoid arthritis patients. J Clin Rheumatol. 2011;17(3):115–120. 10.1097/RHU.0b013e318214b6b5 [DOI] [PubMed] [Google Scholar]
  • 35.Chen HH, Chen DY, Lin CC, Chen YM, Lai KL, Lin CH. Association between use of disease-modifying antirheumatic drugs and diabetes in patients with ankylosing spondylitis, rheumatoid arthritis, or psoriasis/psoriatic arthritis: a nationwide, population-based cohort study of 84,989 patients. Ther Clin Risk Manag. 2017;13:583–592. 10.2147/TCRM.S130666 eCollection 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Gomes KWP, Luz AJP, Felipe MRB, Beltrao LA, Sampaio AXC, Rodrigues CEM. Prevalence of metabolic syndrome in rheumatoid arthritis patients from Northeastern Brazil: Association with disease activity. Mod Rheumatol. 2018;28(2):258–263. 10.1080/14397595.2017.1316813 Epub 2017 May 9. [DOI] [PubMed] [Google Scholar]
  • 37.Ozen G, Pedro S, Holmqvist ME, Avery M, Wolfe F, Michaud K. Risk of diabetes mellitus associated with disease-modifying antirheumatic drugs and statins in rheumatoid arthritis. Ann Rheum Dis. 2017;76(5):848–854. 10.1136/annrheumdis-2016-209954 Epub 2016 Nov 11. [DOI] [PubMed] [Google Scholar]
  • 38.Radovits BJ, Popa-Diaconu DA, Popa C, Eijsbouts A, Laan RF, van Riel PL, et al. Disease activity as a risk factor for myocardial infarction in rheumatoid arthritis. Ann Rheum Dis. 2009;68(8):1271–1276. 10.1136/ard.2008.089862 Epub 2008 Aug 13. [DOI] [PubMed] [Google Scholar]
  • 39.Ruscitti P, Cipriani P, Liakouli V, Iacono D, Pantano I, Margiotta DPE, et al. Subclinical and clinical atherosclerosis in rheumatoid arthritis: results from the 3-year, multicentre, prospective, observational GIRRCS (Gruppo Italiano di Ricerca in Reumatologia Clinica e Sperimentale) study. Arthritis Res Ther. 2019;21(1):204 10.1186/s13075-019-1975-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Wasko MC, Hubert HB, Lingala VB, Elliott JR, Luggen ME, Fries JF, et al. Hydroxychloroquine and risk of diabetes in patients with rheumatoid arthritis. JAMA. 2007;298(2):187–193. 10.1001/jama.298.2.187 [DOI] [PubMed] [Google Scholar]
  • 41.Yusuf S, Hawken S, Ounpuu S, Dans T, Avezum A, Lanas F, et al. Effect of potentially modifiable risk factors associated with myocardial infarction in 52 countries (the INTERHEART study): case-control study. Lancet. 2004;364(9438):937–952. 10.1016/S0140-6736(04)17018-9 [DOI] [PubMed] [Google Scholar]
  • 42.Araki S, Haneda M, Koya D, Hidaka H, Sugimoto T, Isono M, et al. Reduction in microalbuminuria as an integrated indicator for renal and cardiovascular risk reduction in patients with type 2 diabetes. Diabetes. 2007;56(6):1727–1730. 10.2337/db06-1646 Epub 2007 Mar 14. [DOI] [PubMed] [Google Scholar]
  • 43.Peters MJ, Symmons DP, McCarey D, Dijkmans BA, Nicola P, Kvien TK, et al. EULAR evidence-based recommendations for cardiovascular risk management in patients with rheumatoid arthritis and other forms of inflammatory arthritis. Ann Rheum Dis. 2010;69(2):325–331. 10.1136/ard.2009.113696 Epub 2009 Sep 22. [DOI] [PubMed] [Google Scholar]
  • 44.Penn SK, Kao AH, Schott LL, Elliott JR, Toledo FG, Kuller L, et al. Hydroxychloroquine and glycemia in women with rheumatoid arthritis and systemic lupus erythematosus. J Rheumatol. 2010;37(6):1136–1142. 10.3899/jrheum.090994 Epub 2010 May 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Gonzalez-Gay MA, De Matias JM, Gonzalez-Juanatey C, Garcia-Porrua C, Sanchez-Andrade A, Martin J, et al. Anti-tumor necrosis factor-alpha blockade improves insulin resistance in patients with rheumatoid arthritis. Clin Exp Rheumatol. 2006;24(1):83–86. [PubMed] [Google Scholar]
  • 46.Baghdadi LR, Woodman RJ, Shanahan EM, Wiese MD, Mangoni AA. Genetic polymorphism of the methotrexate transporter ABCG2, blood pressure and markers of arterial function in patients with rheumatoid arthritis: repeated cross-sectional study. Pharmgenomics Pers Med. 2018;11:205–210. 10.2147/PGPM.S170557 eCollection 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Woodman RJ, Baghdadi LR, Shanahan ME, Mangoni AA. The Temporal Relationship between Arterial Stiffening and Blood Pressure Is Modified by Methotrexate Treatment in Patients with Rheumatoid Arthritis. Front. Physiol. 2017;8(593). 10.3389/fphys.2017.00593 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Ridker PM, Everett BM, Pradhan A, MacFadyen JG, Solomon DH, Zaharris E, et al. Low-Dose Methotrexate for the Prevention of Atherosclerotic Events. N Engl J Med. 2019;380(8):752–62. 10.1056/NEJMoa1809798 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Dahabreh IJ, Kent DM. Index event bias as an explanation for the paradoxes of recurrence risk research. JAMA. 2011;305(8):822–823. 10.1001/jama.2011.163 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Choi HK, Nguyen US, Niu J, Danaei G, Zhang Y. Selection bias in rheumatic disease research. Nat Rev Rheumatol. 2014;10(7):403–412. 10.1038/nrrheum.2014.36 Epub Apr 1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.VanderWeele TJ, Mumford SL, Schisterman EF. Conditioning on intermediates in perinatal epidemiology. Epidemiology. 2012;23(1):1–9. 10.1097/EDE.0b013e31823aca5d [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Choi HK, Hernan MA, Seeger JD, Robins JM, Wolfe F. Methotrexate and mortality in patients with rheumatoid arthritis: a prospective study. Lancet. 2002;359(9313):1173–1177. 10.1016/S0140-6736(02)08213-2 [DOI] [PubMed] [Google Scholar]
  • 53.Stamp LK, O'Donnell JL, Chapman PT, Zhang M, Frampton C, James J, et al. Determinants of red blood cell methotrexate polyglutamate concentrations in rheumatoid arthritis patients receiving long-term methotrexate treatment. Arthritis Rheum. 2009;60(8):2248–56. 10.1002/art.24653 [DOI] [PubMed] [Google Scholar]
  • 54.Kremer JM, Hamilton RA. The effects of nonsteroidal antiinflammatory drugs on methotrexate (MTX) pharmacokinetics: impairment of renal clearance of MTX at weekly maintenance doses but not at 7.5 mg. J Rheumatol. 1995;22(11):2072–7. [PubMed] [Google Scholar]
  • 55.Rezaei H, Saevarsdottir S, Forslind K, Albertsson K, Wallin H, Bratt J, et al. In early rheumatoid arthritis, patients with a good initial response to methotrexate have excellent 2-year clinical outcomes, but radiological progression is not fully prevented: data from the methotrexate responders population in the SWEFOT trial. Ann Rheum Dis. 2012;71(2):186–91. 10.1136/annrheumdis-2011-200038 [DOI] [PubMed] [Google Scholar]
  • 56.Ursini F, Russo E, D'Angelo S, Arturi F, Hribal ML, D'Antona L, et al. Prevalence of Undiagnosed Diabetes in Rheumatoid Arthritis: an OGTT Study. Medicine (Baltimore). 2016;95(7):e2552 10.1097/MD.0000000000002552 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Jiwa M, Gudes O, Varhol R, Mullan N. Impact of geography on the control of type 2 diabetes mellitus: a review of geocoded clinical data from general practice. BMJ Open. 2015;5(12):e009504 10.1136/bmjopen-2015-009504 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. Cochrane Handbook for Systematic Reviews of Interventions. 2nd Edition. Chichester (UK): John Wiley & Sons, 2019. [Google Scholar]
  • 59.Mercer E, Rekedal L, Garg R, Lu B, Massarotti EM, Solomon DH. Hydroxychloroquine improves insulin sensitivity in obese nondiabetic individuals. Arthritis Res Ther. 2012;14(3):R135 10.1186/ar3868 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Wasko MC, McClure CK, Kelsey SF, Huber K, Orchard T, Toledo FG. Antidiabetogenic effects of hydroxychloroquine on insulin sensitivity and beta cell function: a randomised trial. Diabetologia. 2015;58(10):2336–2343. 10.1007/s00125-015-3689-2 Epub 2015 Jul 22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Thornton CC, Al-Rashed F, Calay D, Birdsey GM, Bauer A, Mylroie H, et al. Methotrexate-mediated activation of an—CREB-dependent pathway: a novel mechanism for vascular protection in chronic systemic inflammation. Ann Rheum Dis. 2016;75(2):439–448. 10.1136/annrheumdis-2014-206305 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Chan ES, Cronstein BN. Mechanisms of action of methotrexate. Bull Hosp Jt Dis (2013). 2013;71(Suppl 1):S5–S8. [PubMed] [Google Scholar]
  • 63.Mangoni AA, Zinellu A, Sotgia S, Carru C, Erre GL. Methotrexate and Cardiovascular Protection: Current Evidence and Future Directions. Clinical Medicine Insights: Therapeutics. 2017;9:1179559X17741289. [Google Scholar]
  • 64.Hardie DG. AMPK: a target for drugs and natural products with effects on both diabetes and cancer. Diabetes. 2013;62(7):2164–2172. 10.2337/db13-0368 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Long YC, Zierath JR. AMP-activated protein kinase signaling in metabolic regulation. J Clin Invest. 2006;116(7):1776–1783. 10.1172/JCI29044 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Pirkmajer S, Kulkarni SS, Tom RZ, Ross FA, Hawley SA, Hardie DG, et al. Methotrexate promotes glucose uptake and lipid oxidation in skeletal muscle via AMPK activation. Diabetes. 2015;64(2):360–369. 10.2337/db14-0508 Epub 2014 Oct 22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Russo GT, Minutoli L, Bitto A, Altavilla D, Alessi E, Giandalia A, et al. Methotrexate Increases Skeletal Muscle GLUT4 Expression and Improves Metabolic Control in Experimental Diabetes. J Nutr Metab. 2012;2012:132056 10.1155/2012/132056 Epub 2012 Jun 13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Viollet B, Guigas B, Sanz Garcia N, Leclerc J, Foretz M, Andreelli F. Cellular and molecular mechanisms of metformin: an overview. Clin Sci (Lond). 2012;122(6):253–270. 10.1042/CS20110386 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Diabetes Canada Clinical Practice Guidelines Expert Committee, Punthakee Z, Goldenberg R, Katz P. Definition, Classification and Diagnosis of Diabetes, Prediabetes and Metabolic Syndrome. Can J Diabetes. 2018;42 Suppl 1:S10-S15. 10.1016/j.jcjd.2017.10.003 [DOI] [PubMed]
  • 70.Da Silva JA, Jacobs JW, Kirwan JR, Boers M, Saag KG, Ines LB, et al. Safety of low dose glucocorticoid treatment in rheumatoid arthritis: published evidence and prospective trial data. Ann Rheum Dis. 2006;65(3):285–293. 10.1136/ard.2005.038638 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Smolen JS, Landewe RBM, Bijlsma JWJ, Burmester GR, Dougados M, Kerschbaumer A, et al. EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2019 update. Ann Rheum Dis. 2020;(79)6:685–99. [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Michael Nurmohamed

13 May 2020

PONE-D-20-08145

Effect of methotrexate use on the development of type 2 diabetes in rheumatoid arthritis patients: a systematic review and meta-analysis

PLOS ONE

Dear dr Baghdadi ,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Particularly the methodological aspects, indicated by all three reviewers, need attention

We would appreciate receiving your revised manuscript by Jun 27 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Michael Nurmohamed, MD, PhD

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements:

1.    Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Partly

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a very original systematic review, it was a very hard work. It is an important issue whether MTX would decrease the risk of T2DM or not.

1. The main result is actually not significant as 95%CI is 0.16-1.43. This is also shown in the forest plots, therefore the main conclusion is that MTX may non-significantly decrease T2DM risk but it is not at all sure. Author needs to change wording.

2. Significant effects were found at age above 60 and at disease duration less than 8 years. Author should further elaborate why elderly patients wouzld have better responses to MTX in terms of T2DM. Also, why was 8 years chosen as a cutoff for disease duration, Early RA (duration <2 years or so) could have been compared with long-term RA. 8 years of diease duration is already way long-term.

3. Even if it is not on T2DM, author could have cited the striking study of Ridker et al (NEJM 380: 752, 2019) showing that low dose MTX does not reduce CV risk. Author could compare inflammatory state like RA to non-inflammatory state. Would MTX work differently under inflammatory (e.g. RA) and non-inflammatory conditions?

Reviewer #2: The paper shows some limitations.

First: only one author revised all of the documents? In general in order to perform a systematic review is necessary three experts.

Second: I suggest to conventional DMARDs instead of instead of tDMARDs

The inclusion and exclusion criteria need to be clarified, in particular the languages and if the abstracts are included and which? EULAR? ACR?

Reviewer #3: Dear authors,

The impact of methotrexate use on type 2 diabetes is a very relevant subject, as the authors already point out in their introduction. In this meta-analysis, exposure and endpoint are both well defined in the method section. However, the studies included in this meta-analysis are very heterogeneous, and most of these studies do not define the exposure to methotrexate or the outcome of T2D that well. To me it is not clear if the authors accounted for the heterogeneity in methotrexate use, for example high or low dose, or longer or shorter exposure. Furthermore, it is not clear how the analysis accounted for the use other DMARDS. The authors have performed a set of sensitivity analyses, but data on disease activity is not mentioned, although it is hypothesized that this has a great influence on the development of T2D.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes: M Heslinga

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2020 Jul 6;15(7):e0235637. doi: 10.1371/journal.pone.0235637.r002

Author response to Decision Letter 0


26 May 2020

Response to the reviewers comments

All the references added to the manuscript in order to address the reviewers’ comments and improve the manuscript have been highlighted.

Reviewer #1: This is a very original systematic review; it was a very hard work. It is an important issue whether MTX would decrease the risk of T2DM or not.

1. The main result is actually not significant as 95%CI is 0.16-1.43. This is also shown in the forest plots, therefore the main conclusion is that MTX may non-significantly decrease T2DM risk but it is not at all sure. Author needs to change wording.

Thank you for highlighting this important point. Based on the Cochrane Handbook for Systematic Reviews, when there is a ‘positive’ but statistically non-significant trend, authors commonly describe this as ‘a promising’ effect.’(Schünemann HJ, Oxman AD, Vist GE, Higgins JPT, Deeks JJ, Glasziou P & Guyatt, GH. 2011. Chapter 12: Interpreting results and drawing conclusions. In: Higgins JPT & Green S (eds.) Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0. The Cochrane Collaboration). Therefore, the wording for the results was updated.

Page 2, lines 41-42

Methotrexate showed a promising effect on the risk of type 2 diabetes as this risk decreased in rheumatoid arthritis patients using methotrexate (Relative risk 0.48, 95% CI 0.16, 1.43).

Page 17, lines 247-248

The effect size was in favor of a promising beneficial effect of MTX in reducing the risk of T2D in RA patients.

Page 26, lines 439-440

In conclusion, our meta-analysis indicates that MTX shows a promising effect in reducing the risk of T2D in the RA population

2. Significant effects were found at age above 60 and at disease duration less than 8 years. Author should further elaborate why elderly patients would have better responses to MTX in terms of T2DM. Also, why was 8 years chosen as a cut off for disease duration, Early RA (duration <2 years or so) could have been compared with long-term RA. 8 years of disease duration is already way long-term.

Thank you for your kind comments. Regarding the age, MTX exposure and reduced risk of T2D and relatively lower risk of T2D was observed in patients aged >60 years. This has been explained as:

Page 22, lines 341-361

This lower risk among older RA patients could be explained by the longer duration of exposure to MTX. This finding is consistent with the results of a prospective cohort study, showing older RA patients using MTX had better survival outcomes and reduced cardiovascular mortality [52]. Similarly, a trend towards a decreased T2D risk was documented in RA patients with longer follow-up periods (>5 years). It is possible that this observed reduction in T2D was due to the longer duration of MTX exposure. As most of the RA patients have established RA and have been exposed to MTX for a long duration, it is possible that the observed reduction in the T2D risk is related, at least partially, to the long MTX exposure. This was supported by the decrease in T2D among prevalent cases of T2D compared to the incident cases of T2D. Although the dose of MTX is clinically important, we found in our previous studies that the concentration of MTX inside the red blood cells (RBCs) (i.e. MTX polyglutamate [MTXPG] concentration) is more accurate [25, 46]; as approximately 95% of the MTX dose is metabolized within 24 hr of administration. Additionally these studies [25, 46] show that the RBC MTXPG concentration is influenced not only by genetic but also non-genetic factors. In line with this finding, increased age and a longer duration of MTX use were associated with higher MTX concentrations [53]. This study found another major non-genetic determinant of increased MTX concentration, which is a lower estimated glomerular filtration rate (GFR). Lower GFR is common among the elderly with chronic diseases, such as T2D and RA, and use of prednisolone and nonsteroidal anti-inflammatory drugs (NSAIDs). These drugs are commonly used by RA patients and induce the inhibition of prostaglandin production [54]. A longer duration of exposure to MTX [50] might also explain the lower risk, which decreased by about 50% among prevalent T2D patients compared with incident T2D patients (RR 0.77 vs. 0.37).

Pages 22-23, lines 363-367

RA patients taking MTX, with a disease duration ≤2 years (i.e. early RA) had a greater reduction in their T2D risk (RR 0.09, 95% CI 0.03, 0.27). This reduction in the risk might be attributed to the beneficial effect of MTX as patients with early RA are usually commenced on MTX monotherapy as a first line treatment. Those RA patients with a good initial response to MTX continue to have excellent 2-year clinical outcomes [55] and improved CV risks [25].

Thus, the cut off for disease duration was changed from 8 years to 2 years (early RA: ≤2 years and established RA: >2 years). The main result is that RA patients taking MTX had greater reduction in the development of T2D if the duration of RA was shorter (≤2 years); sensitive analysis methods (page 9, lines 177-178), results (page 18, lines 266, 270), table 2 (pages 18-19), and discussion (pages 22-23, lines 363-367) were updated accordingly.

Page 9, lines 177-178

Subgroups were defined as mean age of RA patients, ≤60 years or >60 years; mean RA duration, ≤2 years or >2 years

Page 18, lines 266 and 270

…mean RA duration (≤2 years or >2 years),…

…the duration of RA was shorter (≤2 years);…

Pages 18-19 table 2

Mean duration of RA (years)

≤2 (n = 2): 0.09 (95% CI 0.03, 0.27)

>2 (n = 8): 0.57 (95% CI 0.06, 4.96)

Pages 22-23, lines 363-367

RA patients taking MTX, with a disease duration ≤2 years (i.e. early RA) had a greater reduction in their T2D risk (RR 0.09, 95% CI 0.03, 0.27). This reduction in the risk might be attributed to the beneficial effect of MTX as patients with early RA are usually commenced on MTX monotherapy as a first line treatment. Those RA patients with a good initial response to MTX continue to have excellent 2-year clinical outcomes [55] and improved CV risks [25].

3. Even if it is not on T2DM, author could have cited the striking study of Ridker et al (NEJM 380: 752, 2019) showing that low dose MTX does not reduce CV risk. Author could compare inflammatory state like RA to non-inflammatory state. Would MTX work differently under inflammatory (e.g. RA) and non-inflammatory conditions?

Thank you for mentioning this paper. The main finding of the recommended Ridker study (reference 48) is now included in the manuscript (page 21, lines 322-326).

Page 21, lines 322-326

Similarly, the cardioprotective effect of low-dose MTX was not documented among patients with inflammatory diseases such as atherosclerosis [48]. The author of this study, has reported in previous observational data that the use of low-dose MTX had repeatedly shown an association with reduced vascular event rates in patients with RA [24].

This randomised control trail (RCT) was not conducted among RA patients. RA is a chronic inflammatory condition associated with inflammatory disease flares. The management of RA patients includes aggressive treatment to control the inflammation and prevent further damage. MTX is the anchor drug to treat RA and almost all patients have been exposed to it at some stage of treatment. In fact, this RCT highlighted in the limitations that “our observational data had repeatedly shown an association of low-dose methotrexate use with reduced vascular event rates in patients with rheumatoid arthritis or psoriatic arthritis. The reported benefits in these observational studies may apply only to patients with existing systemic inflammatory conditions.”

Therefore, comparing inflammatory and non-inflammatory conditions and examining if MTX works differently in both groups is out of the scope of this meta-analysis, but it is a great idea and can be examined separately by a systematic review and meta-analysis.

Reviewer #2: The paper shows some limitations.

First: only one author revised all of the documents? In general, in order to perform a systematic review is necessary three experts.

Thank you for your valid comment. It is not a PRISMA requirement that a systematic review must have at least two authors, and the Cochrane Handbook For Systematic Reviews states that it does not "necessitate" it but encourages it. Despite these guidelines, for this systematic review, the articles were independently evaluated for eligibility by the author and an independent assessor (assistant professor and senior researcher). The assessor has been named and acknowledged in the manuscript.

Page 6, lines 113-114.

Articles were independently evaluated for eligibility by the author and an independent assessor (assistant professor and senior researcher at King Saud University).

Page 26, lines 454-456.

Many thanks to Dr Emad Mahmoud, assistant professor and senior researcher at King Saud University, for evaluating the eligibility of the articles for inclusion in this systematic review and meta-analysis.

Nevertheless, this systematic review could still represent an appropriate methodological shortcut (Cochrane Handbook), if it is conducted by an experienced reviewer. The author is an expert clinical epidemiologist herself, who has published a couple of systematic reviews where she was the first author and did most of the hard work herself (95% of the final manuscript). One of these systematic reviews was published in 2015 and reached 144 citations.

Second: I suggest to conventional DMARDs instead of instead of tDMARDs

The inclusion and exclusion criteria need to be clarified, in particular the languages and if the abstracts are included and which? EULAR? ACR?

The manuscript says conventional DMARDs (cDMARDs). This change has been made and highlighted throughout the manuscript beginning with:

Page 5, line 77

conventional disease-modifying antirheumatic drugs (cDMARDs),

The inclusion and exclusion criteria have been updated. The articles and abstracts published in English were included in the study (page 5, lines 97-98) and the RA diagnosis was updated to include EULAR/ ACR criteria (page 6, lines 114-121).

Page 5, lines 97-98

A literature search was conducted for all articles including abstracts published in English, and about the relationship between MTX and T2D among patients with RA.

Page 6, lines 114-121

Inclusion criteria for studies in the meta-analyses were the diagnosis of RA in adult patients (≥18 years) made by a rheumatologist or according to the current RA guidelines (the European League Against Rheumatism [EULAR]/ or the American College of Rheumatology [ACR]); documentation of MTX exposure; assessment of the outcome of interest (T2D), and reported raw count data. Relevant studies were excluded, if this inclusion criteria were not fulfilled; no information about MTX exposure was available; no information about the outcome (T2D) was available, and the required raw count data was not available.

Reviewer #3: Dear authors,

The impact of methotrexate use on type 2 diabetes is a very relevant subject, as the authors already point out in their introduction. In this meta-analysis, exposure and endpoint are both well defined in the method section.

1. However, the studies included in this meta-analysis are very heterogeneous, and most of these studies do not define the exposure to methotrexate or the outcome of T2D that well. To me it is not clear if the authors accounted for the heterogeneity in methotrexate use, for example high or low dose, or longer or shorter exposure.

Regarding heterogeneity, the author looked for explanations of heterogeneity by conducting several sensitivity analyses (i.e. sub-group analyses) based on a priori hypothesis. Potential factors, which might be possible sources of heterogeneity, were carefully considered to diminish spurious false-positive findings; these factors were then analysed separately to see whether heterogeneity in those subgroups decreases.

Even though most of the included studies did not define the exposure to methotrexate (including the dose) or the outcome of T2D that well, these methodological flaws were considered in calculating the quality score of each study and fitted in the QR model (i.e. the pooled RR is calculated considering the quality score for all studies). This was explained in detail as follows:

Page 7, lines 128-146.

Included studies have different study designs with a variety of methodological approaches. Thus, considering the quality of the pooled studies was essential. A validated and reproducible checklist (S4 Materials) was used to critically evaluate selected studies; this tool was feasible and effective in differentiating papers with high precision and less bias from poor quality studies [27, 28]. It also enabled calculating a quality score (Qi) for each study. This checklist examines the quality of each study using 14 questions to evaluate the internal validity, external validity and statistical analysis of the study (S4 Materials) [27]. Each question in the checklist was given points to calculate the Qi score. One of the questions in the checklist accounting for prognostic factors (question 9 in S4 Materials) was tailored to accommodate the requirements of this study. The prognostic score was created to balance the indicators affecting T2D outcomes across exposure groups. These prognostic factors include the age, sex, hypertension, body mass index (BMI), dyslipidemia, family history of T2D and CV disease, physical inactivity, duration of RA, and medications used (folic acid, corticosteroids and cDMARDs and bDMARDs). If the study balanced ≥5 of these indicators among comparison groups, it was given a score of 1. On the other hand, if the study reported 3 or 4 indicators, it was given a score of 0.5; if the study balanced 1 or 2 of these factors or if there was no evidence of reporting any of these prognostic factors, it was given a score of 0. After critically reading each study and giving points for each question, the total points were summed up to obtain the Qi score. A Qi score of ≥10 was defined as a high-quality score and a Qi score ≤9 was defined as a low-quality score.

Regarding the heterogeneity in methotrexate use, for example high or low dose, or longer or shorter exposure. The author specified the duration of exposure to MTX to be at least 8 weeks instead of the dose of MTX as stated on:

Page 6, lines 109-110.

MTX exposure was defined as taking an MTX drug for at least 8 weeks.

This is because the optimal clinical effect of MTX is usually seen after 8 weeks of commencing the drug. Most patients with rheumatoid arthritis are usually commenced on a low dose of methotrexate (i.e. ≤20mg), based on the EULAR guidelines (reference 71, Smolen et al. 2020). Although the dose of methotrexate is clinically important, we found in our previous studies that the concentration of methotrexate inside the RBCs (i.e. MTX polyglutamate [MTXPG] concentration) is more accurate (page 22, lines 349-354 and references 25 and 46); as approximately 95% of the MTX dose is metabolised within 24 hr of administration.

Page 22, lines 349-354

Although the dose of MTX is clinically important, we found in our previous studies that the concentration of MTX inside the red blood cells (RBCs) (i.e. MTX polyglutamate [MTXPG] concentration) is more accurate [25, 46]; as approximately 95% of the MTX dose is metabolised within 24 hr of administration. Additionally, these studies [25, 46] show that the RBC MTXPG concentration is influenced not only by genetic but also non-genetic factors.

2. Furthermore, it is not clear how the analysis accounted for the use other DMARDS. The authors have performed a set of sensitivity analyses, but data on disease activity is not mentioned, although it is hypothesized that this has a great influence on the development of T2D.

Unfortunately, the status of disease activity was not measured in most of the included studies. While a couple of these studies measured Disease Activity Score DAS-28, most included studies have not considered it. In addition, the disease activity score could not be differentiated between treatment groups. Again, this methodological issue was considered when calculating the quality score and pooled RR (as stated in response to question 1, on page 7, lines 128-146).

Nevertheless, an additional sensitivity analysis was conducted to examine whether disease activity had an impact on the pooled results. The main finding was that RA patients taking MTX had greater reduction in the development of T2D, if the disease activity was measured and adjusted in the study. Information about disease activity was added in table 1 (pages 11-16), sensitive analysis methods (pages 8 and 9 lines 176-180), results (page 18 lines 267-268 and 272), table 2 (page 19), and discussion (page 23, lines 372-375).

Table 1 can be found on pages 11-16 of the manuscript but has not been included in this response to reviewers as it is five pages long.

Pages 8 and 9, lines 176-177 and page 9, lines 179-180

…, RA disease activity measured by the Disease Activity Score 28 (DAS-28), year and country of publication. Subgroups were defined as mean age of RA patients, ≤60 years or >60 years; mean RA duration, ≤2 years or >2 years ; time of follow-up, ≤5 years or >5 years; status of T2D, incident or prevalent T2D; RA disease activity measured by DAS-28, measured disease activity or unmeasured disease activity;…

Page 18, lines 267-268 and 272

…RA disease activity measured by DAS-28 (measured disease activity or unmeasured disease activity)…

…the RA disease activity was measured and adjusted in the study.

Page 19, from table 2

Disease activity

Measured disease actvity (n= 7): 0.06 (95% CI 0.02, 0.18)

Unmeasured disease activity (n= 9): 0.61 (95% CI 0.24, 1.58)

Page23 line 372-375

This study found that RA patients taking MTX had greater significant reduction in the development of T2D, if the disease activity was measured and adjusted in the analysis (RR 0.06, 95% CI 0.02, 0.18). This indicates that MTX has an independent beneficial effect on T2D development in the RA population.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Michael Nurmohamed

19 Jun 2020

Effect of methotrexate use on the development of type 2 diabetes in rheumatoid arthritis patients: a systematic review and meta-analysis

PONE-D-20-08145R1

Dear Dr. Baghadi,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Michael Nurmohamed, MD, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I have no further comments. The issues raised are addressed sufficiently. I have no ethical or other concerns.

Reviewer #2: The paper is interesting and well written. I suggest to accept the paper in the actual form.

I have not further comment.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Acceptance letter

Michael Nurmohamed

23 Jun 2020

PONE-D-20-08145R1

Effect of methotrexate use on the development of type 2 diabetes in rheumatoid arthritis patients: a systematic review and meta-analysis

Dear Dr. Baghdadi:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof.Dr Michael Nurmohamed

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Funnel plot meta-analysis type 2 diabetes using fixed effect model (Legend: FE = fixed effect model; RR = relative risk; T2D = type 2 diabetes).

    (TIF)

    S1 Materials. PRISMA 2009 flow diagram.

    (DOC)

    S2 Materials. PRISMA 2009 checklist.

    (DOC)

    S3 Materials. Appendix 1.

    Data sources.

    (DOCX)

    S4 Materials. Appendix 2.

    Checklist for assessing quality of included studies in the meta-analysis.

    (DOCX)

    S5 Materials. Appendix 3.

    Quality assessment scores for studies included in the meta-analysis.

    (PDF)

    S1 Dataset

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES