Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Dec 21;16(12):e0261239. doi: 10.1371/journal.pone.0261239

Cardiovascular safety of celecoxib in rheumatoid arthritis and osteoarthritis patients: A systematic review and meta-analysis

Bai-Ru Cheng 1, Jia-Qi Chen 2,#, Xiao-Wen Zhang 3,#, Qin-Yang Gao 1, Wei-Hong Li 4,, Li-Jiao Yan 3,, Yu-Qiao Zhang 2, Chang-Jiang Wu 5, Jing-Li Xing 3, Jian-Ping Liu 3,*
Editor: Michael Nurmohamed6
PMCID: PMC8691614  PMID: 34932581

Abstract

Objective

To assess the cardiovascular safety of celecoxib compared to non-selective non-steroid anti-inflammatory drugs or placebo.

Methods

We included randomized controlled trials of oral celecoxib compared with a non-selective NSAID or placebo in rheumatoid arthritis and osteoarthritis patients. We conducted searches in EMBASE, Cochrane CENTRAL, MEDLINE, China National Knowledge Infrastructure, VIP, Wanfang, and Chinese Biomedical Literature Database. Study selection and data extraction were done by two authors independently. The risk of bias was assessed using Cochrane’s risk-of-bias Tool for Randomized Trials. The effect size was presented as a risk ratio with their 95% confidence interval.

Results

Until July 22nd, 2021, our search identified 6279 records from which, after exclusions, 21 trials were included in the meta-analysis. The overall pooled risk ratio for Antiplatelet Trialists Collaboration cardiovascular events for celecoxib compared with any non-selective non-steroid anti-inflammatory drugs was 0.89 (95% confidence interval: 0.80–1.00). The pooled risk ratio for all-cause mortality for celecoxib compared with non-selective non-steroid anti-inflammatory drugs was 0.81 (95% confidence interval: 0.66–0.98). The cardiovascular mortality rate of celecoxib was lower than non-selective non-steroid anti-inflammatory drugs (risk ratio: 0.75, 95% confidence interval: 0.57–0.99). There was no significant difference between celecoxib and non-selective non-steroid anti-inflammatory drugs or placebo in the risk of other cardiovascular events.

Conclusion

Celecoxib is relatively safe in rheumatoid arthritis and osteoarthritis patients, independent of dose or duration. But it remains uncertain whether this would remain the same in patients treated with aspirin and patients with established cardiovascular diseases.

Introduction

Rheumatoid arthritis (RA) is a chronic, inflammatory disease of which pathological mechanism remains unclear [1]. Osteoarthritis (OA) is the most common joint disease worldwide [2]. Compared with the general population, the mortality rate among rheumatoid arthritis patients is higher, which is largely attributable to cardiovascular disease, particularly (fatal and non-fatal) myocardial infarction due to coronary atherosclerosis [3]. Risks of both myocardial infarctions and strokes are amplified in individuals with rheumatoid arthritis, which may be the result of inflammation-associated vascular damage [4, 5]. Likewise, the risks of heart failure and ischemic heart disease increase in osteoarthritis patients [6]. It is necessary to control cardiovascular events, especially fatal cardiovascular events for rheumatoid arthritis and osteoarthritis patients.

Nonsteroidal anti-inflammatory drugs (NSAIDs) are often prescribed to relieve arthritis symptoms. Cyclo-oxygenase (COX)-2 inhibitors (coxibs), which were developed as alternative analgesics to minimize upper gastrointestinal toxicity of non-selective NSAIDs (nsNSAIDs), were believed to reduce cardiovascular risks [7]. Celecoxib (Celebrex®) was the first coxib introduced into clinical practice. At its recommended doses of 200 or 400 mg/day, it is as effective for symptomatic treatment as conventional NSAIDs and some other coxibs [8] and can significantly reduce upper gastrointestinal events [9]. However, the subsequent coxib, rofecoxib, was found to increase cardiovascular events, which led to its worldwide withdrawal in 2004 [10]. Another coxib, valdecoxib (Bextra®), was also withdrawn from the market in 2005 for its cardiovascular toxicity and serious skin reactions [11]. The withdrawal raised concern about the cardiovascular safety of coxibs. As a result, the use of many coxibs was restricted and, all coxibs and nonselective NSAIDs were recommended to be used with caution in patients with older age or established cardiovascular disease [12, 13].

Cardiovascular safety on NSAIDs is highly controversial. Although it has been confirmed that some NSAIDs are associated with a higher risk of cardiovascular events, the cardiovascular safety profile varies widely. Coxibs were associated with increased risks of myocardial infarction when compared against placebo or non-selective NSAIDs [14]. Salpeter et al. suggested nonselective NSAIDs had no significant effect on cardiovascular events or death in trials of joint disease and Alzheimer’s disease, and there was no significant adverse or cardioprotective effect of naproxen [15]. Kearny et al. found diclofenac and ibuprofen were associated with higher cardiovascular risk, while naproxen was not [16]. A meta-analysis by Coxib and traditional NSAID Trialists’ Collaboration indicated that the vascular risks of high-dose diclofenac, and possibly ibuprofen, were comparable to coxibs, whereas high-dose naproxen was associated with less vascular risk than other NSAIDs [7]. In OA patients, the risk of heart failure in the coxib group remained significant even when rofecoxib was removed from the analysis [17].

Also, the cardiovascular safety of celecoxib compared to other NSAIDs remains uncertain, especially among patients with established cardiovascular diseases [18]. One Cochrane review [19] suggested the risk of bias might be the reason for uncertainty about the rate of cardiovascular events between celecoxib and nsNSAIDs. Another factor was that most trials were small and short-term. It is also because mechanisms of the cardiovascular side effects are still controversial. One hypothesis is that coxibs have an impact on vasoactive endothelium-derived factors, particularly via inhibiting prostaglandin synthesis, which is important for the regulation of vascular tone and sodium excretion and may influence blood pressure, but it is not for certain yet. This systematic review and meta-analysis aimed to assess the cardiovascular safety of celecoxib compared to non-selective nonsteroidal anti-inflammatory drugs and placebo.

Methods

Our protocol was published on PROSPERO [CRD42020179936] with the title Cardiovascular Safety of Celecoxib for Rheumatoid Arthritis and Osteoarthritis: A Systematic Review and Meta-Analysis.

Search strategy

Publications were retrieved using computerized searches by EMBASE, CENTRAL, MEDLINE, CNKI, VIP, Wanfang, and the Chinese Biomedical Literature Database. No date or language limits were set. A re-run was done before the final analyses. The last search date was July 22nd, 2021.

Inclusion criteria

Patients with rheumatoid arthritis (diagnosed according to ACR 1987 criteria [20] or ACR/EULAR 2010 criteria [21]) or osteoarthritis (diagnosed according to ACR guidelines [22, 23]) were included, while patients with other rheumatic diseases such as systemic lupus erythematosus or Sjogren’s Syndromes were excluded. Only RCTs comparing celecoxib at any dose to non-selective NSAIDs or placebo were included.

Outcome measures

Primary outcomes: 1. all-cause mortality; 2. cardiovascular mortality; 3. fatal and non-fatal myocardial infarction; 4. fatal and non-fatal stroke. Secondary outcomes: 1. other cardiovascular events, including atrial fibrillation, arrhythmias, angina, revascularization, etc.; 2. total cholesterol (TC), triglycerides (TG), high-density lipoprotein (HDL), low-density lipoprotein (LDL); 3. systolic blood pressure (SBP) and diastolic blood pressure (DBP).

Study selection

Two reviewers (BR Cheng and JQ Chen) independently screened all titles and abstracts of the records. Full texts of potentially eligible studies were retrieved for further identification according to the eligibility criteria. Any uncertainty or discrepancy was resolved by discussion. We used Excel for recording decisions.

Data extraction

Two reviewers (BR Cheng and JQ Chen) independently extracted data following a predesigned data form using Excel (version Microsoft Excel 2016). Data were checked by an additional reviewer (XW Zhang). Disagreements were resolved by discussion.

Risk of bias assessment

Since only RCTs were included, the risk of bias was assessed through Cochrane’s risk-of-bias Tool for Randomized Trials (RoB 2) [24]. Two review authors (BR Cheng and QY Gao) independently assessed the risk of bias. Disagreements were resolved by discussion with an additional reviewer (XW Zhang). The risk of bias are assessed through the following five domains: (1) bias arising from the randomization process; (2) bias due to deviations from intended interventions; (3) bias due to missing outcome data; (4) bias in the measurement of the outcome; (5) bias in the selection of the reported result.

Data analysis and synthesis

A narrative synthesis of the findings from the included studies will be provided. We worked with the data within a meta-analysis, through Review Manager 5.3. Heterogeneity related to the results of the studies was assessed using both the chi-square test and the I2 statistic. If data were sufficiently homogenous, we would pool the results using a fixed-effect model, with standardized mean differences for continuous outcomes (in our review referring to TC, TG, HDL, LDL, systolic blood pressure, and diastolic blood pressure) and risk ratios for binary outcomes (in our review referring to all-cause mortality, cardiovascular mortality, fatal and non-fatal myocardial infarction, fatal and non-fatal stroke, and other cardiovascular events), and calculate 95% confidence intervals and two-sided P values for each outcome. We will provide summaries of intervention effects for each study by calculating risk ratios (for dichotomous outcomes) or standardized mean differences (for continuous outcomes). We considered an I2 value greater than 50% indicative of substantial heterogeneity. If there were high heterogeneity across included studies, we would use a random effect model or only provide a narrative synthesis of the findings from the included studies, structured around the type of intervention, target population characteristics, type of outcome, and intervention content.

Results

Study selection

Database searches initially identified 6279 records in languages including English, Chinese, German, Russian, Turkish and Spanish. The last search date was July 22nd, 2021. After removing duplications, 4312 articles were screened by their titles and abstracts. 166 full-texts were assessed for eligibility, but we failed to find 5 of them, as 3 were anonymous and the other 2, written in Russian and Turkish respectively, had no available resources online. A flowchart (Fig 1) with the number of included studies at each step was established, including reasons for excluding studies. 21 studies were included in qualitative and 20 in the quantitative synthesis.

Fig 1. Flowchart of the study selection process.

Fig 1

Study characteristics

Table 1 presents the characteristics of the studies included through the systematic review process. Except for basic study information, we also paid attention to if patients with cardiovascular risk were excluded and if aspirin was allowed to use for cardiovascular protection, which may affect the result of adverse events.

Table 1. Characteristics of randomized controlled trials included in the qualitative synthesis.

Study Condition Total Sample Size Comparators Celecoxib Doses and Frequency Duration
Bingham 2007 (Trial 1) [25] OA 599 Placebo 200mg Qd 26 weeks
Bingham 2007 (Trial 2) [25] OA 608 Placebo 200mg Qd 26 weeks
Birbara 2006 (Trial 1) [26] OA 395 Placebo 200mg Qd 6 weeks
Birbara 2006 (Trial 2) [26] OA 413 Placebo 200mg Qd 6 weeks
Cannon 2008 [27] OA 433 Placebo, Ibuprofen 200mg Bid 12 weeks
Clegg 2006 (GAIT) [28] OA 1583 Placebo 200mg/day 24 weeks
Conaghan 2012 [29] OA 1399 Placebo 100mg/day 12 weeks
Cryer 2012 (PROBE) [30] OA 8067 (1) (2) 6 months
Dahlberg 2009 [31] OA 925 Diclofenac 200mg Qd 1 year
Essex 2012 [32] OA 589 Naproxen 200mg Qd 6 months
Gibofsky 2003 [33] OA 477 Placebo 200mg/day 6 weeks
Hawel 2003 [34] OA 148 Dexiprofen 100mg/day 15 days
MacDonald 2017 (SCOT) [35] OA&RA 7297 Diclofenac, Ibuprofen and Naproxen 169.8±80.6mg/day (3)
McKenna 2001 [36] OA 182 Placebo 200mg Qd 6 weeks
Nissen 2016 (PRECISION) [37] OA&RA 24081 Naproxen and Ibuprofen 209±37mg/day 20 months (4)
Sampalis 2012 [38] OA 60 Placebo 200mg/day 90 days
Sawitzke 2010 [39] OA 662 Placebo 200mg/day 24 weeks
Schnitzer 2011 [40] OA 1262 Placebo 200mg Qd 13 weeks
Simon 1999 [41] RA 1149 Placebo and Naproxen 100mg, 200mg, or 400mg Bid 12 weeks
Smugar 2006 (Trial 1) [42] OA 1521 Placebo 200mg Qd 6 weeks
Smugar 2006 (Trial 2) [42] OA 1082 Placebo 200mg Qd 6 weeks
White 2002 (CLASS) [43] OA&RA 7968 Diclofenac and Ibuprofen 100 mg Bid in patients with OA and up to 200 mg Bid in patients with RA 13 weeks
Williams 2001 [44] OA 718 Placebo 100mg Bid or 200mg Qd 6 weeks
Wittenberg 2006 [45] OA 364 Placebo 200mg Bid 1 week

(1): The nsNSAID in the comparator group was any nsNSAID of the investigator’s choice, prescribed within the dosages allowed in the United States package insert.

(2): Celecoxib dosage could be adjusted within the United States prescribing guidelines.

(3): The median intention-to-treat follow-up for the primary outcome was 3.0 years (maximum 6.3 years, total 22 600 person-years)

(4): The mean duration of treatment was 20.3±16.0 months for all patients.

OA: Osteoarthritis; RA: Rheumatoid Arthritis; Qd: once per day; Bid: twice per day; GAIT: Glucosamine/chondroitin Arthritis Intervention Trial; PROBE: Prospective, Randomized, Open-label, Blinded Endpoint; SCOT: Standard care vs. Celecoxib Outcome Trial; PRECISION: Prospective Randomized Evaluation of Celecoxib Integrated Safety versus Ibuprofen Or Naproxen; mg: milligram; nsNSAID: non-selective Non-Steroidal Anti-Inflammatory Drug.

Risk of bias of individual studies

Fig 2 and Fig 3 include a summary of the risk of bias assessed for each study included in this systematic review. Overall, most included studies were of low or unclear risks. Six studies were of high risk, which was mostly contributed by lack of specific randomization process or high withdrawal rates due to adverse events.

Fig 2. Risk of bias summary: A review of authors’ judgements about each risk of bias item for each included study.

Fig 2

Fig 3. Risk of bias graph: A review of authors’ judgements about each risk of bias item presented as percentages across all included studies.

Fig 3

Primary outcomes

All-cause mortality

A total of 9 trials reported this outcome. The risk of all-cause mortality was decreased statistically significantly in celecoxib groups, compared with nsNSAIDs groups (RR 0.81, 95% CI 0.66–0.98, I2 = 21%). As for celecoxib versus placebo, four trials reported all-cause mortality cases, which showed no significant differences between the two treatments (RR 0.92, 95% CI 0.26–3.27, I2 = 0%).

Cardiovascular mortality

The cardiovascular mortality rate of the celecoxib groups was also lower than nsNSAIDs groups (RR 0.75, 95% CI 0.57–0.99, I2 = 0%). When compared with placebo, the risk was not significantly different (RR 3.02, 95% CI 0.36–25.27, I2 = 0%).

Myocardial infarction

The risk of myocardial infarction was not significant compared with both nsNSAIDs (RR 1.08, 95% CI = 0.88–1.33) and placebo (RR 1.87, 95% CI = 0.39–8.90) In the 4 trials which included placebo groups, the rate of myocardial infarction was zero, which could affect the result.

Stroke

The risk of stroke in the celecoxib group was also not significant compared with both nsNSAIDs and placebo (RR 0.94, 0.96, 95% CI = 0.71–1.24, 0.13–6.92).

Secondary outcomes

Secondary outcomes included dichotomous and continuous data. Dichotomous data were the numbers of atrial fibrillation, arrhythmias, angina, revascularization, and heart failure, of which some were only reported in single studies (atrial fibrillation, celecoxib versus nsNSAIDs and placebo; arrhythmias, celecoxib versus nsNSAIDs), some in no studies (arrhythmias, celecoxib versus placebo; revascularization, celecoxib versus placebo; heart failure, celecoxib versus placebo), and none of the results was statistically significant. More details are shown in Fig 4 and Fig 5.

Fig 4. Relative risk of dichotomous outcomes for celecoxib versus nsNSAIDs.

Fig 4

Fig 5. Relative risk of dichotomous outcomes for celecoxib versus placebo.

Fig 5

Continuous data included the levels of total cholesterol, triglycerides, high-density lipoprotein, low-density lipoprotein, systolic blood pressure, and diastolic blood pressure. Blood pressures were reported in 3 studies: Bingham 2007, Sampalis 2012, and Simon 1999, all of which compared the celecoxib and placebo groups. Sampalis 2012 did not present any data for meta-analysis, but in their study, no significant change of both systolic and diastolic blood pressures was seen in the celecoxib or placebo groups. Bingham 2007 reported the mean changes of systolic and diastolic blood pressures before and after the study, while Simon 1999 reported the average systolic and diastolic blood pressures before and after the study, so their data couldn’t be pooled, but their conclusions are the same: no differences were found between the celecoxib and placebo groups. As for the lipids and lipoproteins, only LDL-C levels were reported, in only one study [27], where the effects of celecoxib, placebo, and ibuprofen on LDL-C were comparable in patients with osteoarthritis.

Discussion

Overall, celecoxib does not significantly increase cardiovascular events compared with placebo and slightly decreases the risk of all-cause mortality and cardiovascular mortality compared with nsNSAIDs, which may prove it safe when used on rheumatoid arthritis and osteoarthritis patients. Our conclusion was basically in line with the result of the PRECISION trial, in which celecoxib was found to be non-inferior to naproxen or ibuprofen for cardiovascular death, nonfatal myocardial infarction, or nonfatal stroke [37], and also in line with a prospective observational study in Japan assessing the cardiovascular risk between celecoxib and nsNSAIDs in patients with rheumatoid arthritis and osteoarthritis [46].

The all-cause mortality rate of celecoxib decreases significantly than that of nsNSAIDs but not that of placebo. However, since these causes include car accidents, suicide, and other irrelevant causes, it is not of much importance to this study.

The cardiovascular mortality rate comparing celecoxib and nsNSAIDs was reported in five studies, three of them excluded patients with cardiovascular risk (Cryer 2012, Dahlberg 2009 and MacDonald 2017), and aspirin was allowed in three studies (Dahlberg 2009, Nissen 2016 and White 2002), which may decrease the number of adverse cardiovascular events. In the secondary analysis of the CLASS study, the subgroup of patients not taking aspirin was analyzed separately and no differences were observed between celecoxib and the nsNSAID groups in terms of myocardial infarction or stroke with the exception that celecoxib was associated with a lower incidence of sudden cardiac death than diclofenac [47].

As only 2 studies (Schnitzer 2011 and Williams 2001) were included in this primary outcome analysis, although it reported no differences in cardiovascular mortality rate between celecoxib and placebo, it is not considered to be persuasive. In a study on the cardiovascular safety of NSAIDs (patients’ conditions unlimited), celecoxib was found to be related to a higher risk of cardiovascular death, as well as myocardial infarction, stroke, death from any cause, and APTC composite outcome, but none of them was statistically significant [48]. Our results did not present any significant differences either.

The use of celecoxib on blood pressure seems to be safe. Sampalis et al. found that both celecoxib and placebo did not influence systolic blood pressure or diastolic blood pressure. Curtis E et al. also found no significant increase in hypertension in celecoxib and etoricoxib compared with placebo, albeit an increase in the risk of heart failure and edema [17].

But it remains uncertain if celecoxib is more beneficial in patients with established cardiovascular risk (stroke history, hypertension, etc.). As the mechanism of elevated cardiovascular risk in RA and OA remains unveiled, there has been uncertainty about the nature and magnitude of these risks. Vitamin B-6 could be a possible factor, as its metabolism can be impaired by clinical use of cyclooxygenase inhibitors [49], and it is associated with higher cardiovascular risks [50, 51]. Still, we could not know if the cardiovascular safety profile of celecoxib is the same in all patients with different cardiovascular risks. Whether it is more beneficial or more dangerous in patients with specific cardiovascular risk is still nowhere to know.

What’s more, there were discrepancies between real-world clinical practice and randomized clinical trials. Studies showed that the use of coxibs tended to be shorter, more variable, and at lower doses in clinical practice than in some clinical trials. As NSAIDs are always used as painkillers, so not every patient needs to take them every day at a specific dose. Therefore, most patients probably have been exposed to doses and duration sufficient to detect an increased cardiovascular risk [52]. This provided a basis for reconciling the apparent discrepancies between these trials and explained the findings from most non-experimental epidemiologic studies, which showed no increased risk with celecoxib, irrespective of dose [53].

Meanwhile, effective biomarkers to predict the cardiovascular risk associated with the use of anti-inflammatory drugs for RA and OA are in need to better provide cardiovascular protective prescriptions. NT-proBNP may be a useful marker for anticipating cardiovascular risk in OA patients [54].

Also, since valdecoxib is more selective for COX-2 than celecoxib in vitro, it is related to higher cardiovascular risk. However, there may well be some patients in whom celecoxib is the more selective inhibitor in vivo [55]. Therefore, better indications cannot be made until the mechanisms behind RA and OA patients’ elevated cardiovascular risk are unveiled.

Last, our research had some limitations. First, some of the studies included in this research were not intended to assess the cardiovascular risk of celecoxib, even though safety profiles were reported. Second, as the adverse cardiovascular events rate is relatively small, many studies included in full-text screening did not report any cardiovascular events. Some other studies that reported cardiovascular events were of small samples or of short duration, which may dilute the cardiovascular adverse effect of drugs. Also, publication bias couldn’t have been assessed properly due to the small number (most of them fewer than 5) of trials included in each meta-analysis, which added uncertainty to our conclusion.

However, despite a growing understanding of the mechanisms of RA and their interplay with cardiovascular risk factors, it also remains unclear the relationship between arthritis and increase cardiovascular events [56]. Discovering the mechanism is essential to pursue the specific treatment of this common comorbidity.

Conclusion

This meta-analysis found celecoxib does not increase the cardiovascular risk compared with common nsNSAIDs and placebo, and therefore confirmed celecoxib can be safely prescribed at approved doses in RA or OA patients as a first-line NSAID. But safety data are needed considering long duration or high dose usage. The result remains uncertain in patients treated with aspirin and patients with established cardiovascular diseases.

Supporting information

S1 Appendix. PRISMA 2020 flow diagram.

(DOCX)

S2 Appendix. PRISMA 2020 checklist.

(DOCX)

S3 Appendix. PROSPERO protocol.

(PDF)

S4 Appendix. Search strategy.

(DOCX)

S5 Appendix. Data extraction of study characteristics.

(XLS)

S6 Appendix. Data extraction of outcomes.

(XLS)

S7 Appendix. RoB assessment.

(XLSM)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

This review was supported by the National Natural Science Foundation project (No. 81830115), and partially supported by the NCCIH grant (AT001293 with sub-award No. 020468C).

References

  • 1.Scott DL, Wolfe F, Huizinga TWJ. Rheumatoid Arthritis. Lancet. 2010;376(9746):1094–108. doi: 10.1016/S0140-6736(10)60826-4 [DOI] [PubMed] [Google Scholar]
  • 2.Glyn-Jones S, Palmer AJR, Agricola R, Price AJ, Vincent TL, Weinans H, et al. Osteoarthritis. The Lancet. 2015;386(9991):376–87. [DOI] [PubMed] [Google Scholar]
  • 3.Barbhaiya M, Solomon DH. Rheumatoid arthritis and cardiovascular disease: an update on treatment issues. Curr Opin Rheumatol. 2013;25(3):317–24. doi: 10.1097/BOR.0b013e32835fd7f8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Lévy L, Fautrel B, Barnetche T, Schaeverbeke T. Incidence and risk of fatal myocardial infarction and stroke events in rheumatoid arthritis patients. A systematic review of the literature. Clinical and experimental rheumatology. 2008;26(4):673–9. [PubMed] [Google Scholar]
  • 5.Atzeni F, Turiel M, Caporali R, Cavagna L, Tomasoni L, Sitia S, et al. The effect of pharmacological therapy on the cardiovascular system of patients with systemic rheumatic diseases. Autoimmun Rev. 2010;9(12):835–9. doi: 10.1016/j.autrev.2010.07.018 [DOI] [PubMed] [Google Scholar]
  • 6.Hall AJ, Stubbs B, Mamas MA, Myint PK, Smith TO. Association between osteoarthritis and cardiovascular disease: Systematic review and meta-analysis. Eur J Prev Cardiol. 2016;23(9):938–46. doi: 10.1177/2047487315610663 [DOI] [PubMed] [Google Scholar]
  • 7.Collaboration CatNTC, Bhala N, Emberson J, Merhi A, Abramson S, Arber N, et al. Vascular and upper gastrointestinal effects of non-steroidal anti-inflammatory drugs: meta-analyses of individual participant data from randomised trials. The Lancet. 2013;382(9894):769–79. doi: 10.1016/S0140-6736(13)60900-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.McCormack PL. Celecoxib A Review of Its Use for Symptomatic Relief in the Treatment of Osteoarthritis, Rheumatoid Arthritis and Ankylosing Spondylitis. Drugs. 2011;71(18):2457–89. doi: 10.2165/11208240-000000000-00000 [DOI] [PubMed] [Google Scholar]
  • 9.Goldstein JL, Correa P, Zhao WW, Burr AM, Hubbard RC, Verburg KM, et al. Reduced incidence of gastroduodenal ulcers with celecoxib, a novel cyclooxygenase-2 inhibitor, compared to naproxen in patients with arthritis. Am J Gastroenterol. 2001;96(4):1019–27. doi: 10.1111/j.1572-0241.2001.03740.x [DOI] [PubMed] [Google Scholar]
  • 10.Sooriakumaran P. COX-2 inhibitors and the heart: are all coxibs the same? Postgrad Med J. 2006;82(966):242–5. doi: 10.1136/pgmj.2005.042234 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Atukorala I, Hunter DJ. Valdecoxib the rise and fall of a COX-2 inhibitor. Expert Opin Pharmacother. 2013;14(8):1077–86. doi: 10.1517/14656566.2013.783568 [DOI] [PubMed] [Google Scholar]
  • 12.Ray WA, Varas-Lorenzo C, Chung CP, Castellsague J, Murray KT, Stein CM, et al. Cardiovascular risks of nonsteroidal antiinflammatory drugs in patients after hospitalization for serious coronary heart disease. Circ Cardiovasc Qual Outcomes. 2009;2(3):155–63. doi: 10.1161/CIRCOUTCOMES.108.805689 [DOI] [PubMed] [Google Scholar]
  • 13.Amsterdam EA, Wenger NK, Brindis RG, Casey DE Jr., Ganiats TG, Holmes DR Jr., et al. 2014 AHA/ACC Guideline for the Management of Patients with Non-ST-Elevation Acute Coronary Syndromes: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. 2014;64(24):e139–e228. doi: 10.1016/j.jacc.2014.09.017 [DOI] [PubMed] [Google Scholar]
  • 14.Chen LC, Ashcroft DM. Risk of myocardial infarction associated with selective COX-2 inhibitors: meta-analysis of randomised controlled trials. Pharmacoepidemiol Drug Saf. 2007;16(7):762–72. doi: 10.1002/pds.1409 [DOI] [PubMed] [Google Scholar]
  • 15.Salpeter SR, Gregor P, Ormiston TM, Whitlock R, Raina P, Thabane L, et al. Meta-analysis: cardiovascular events associated with nonsteroidal anti-inflammatory drugs. Am J Med. 2006;119(7):552–9. doi: 10.1016/j.amjmed.2005.10.056 [DOI] [PubMed] [Google Scholar]
  • 16.Kearney PM, Baigent C, Godwin J, Halls H, Emberson JR, Patrono C. Do selective cyclo-oxygenase-2 inhibitors and traditional nonsteroidal anti-inflammatory drugs increase the risk of atherothrombosis Meta-analysis of randomised trials.pdf. BMJ. 2006;332(7553):1302–8. doi: 10.1136/bmj.332.7553.1302 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Curtis E, Fuggle N, Shaw S, Spooner L, Ntani G, Parsons C, et al. Safety of Cyclooxygenase-2 Inhibitors in Osteoarthritis: Outcomes of a Systematic Review and Meta-Analysis. Drugs Aging. 2019;36(Suppl 1):25–44. doi: 10.1007/s40266-019-00664-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Krasselt M, Baerwald C. Celecoxib for the treatment of musculoskeletal arthritis. Expert Opin Pharmacother. 2019;20(14):1689–702. doi: 10.1080/14656566.2019.1645123 [DOI] [PubMed] [Google Scholar]
  • 19.Fidahic M, Jelicic Kadic A, Radic M, Puljak L. Celecoxib for rheumatoid arthritis. Cochrane Database Syst Rev. 2017;6:CD012095. doi: 10.1002/14651858.CD012095.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Arnett FC, Edworthy SM, Bloch DA, McShane DJ, Fries JF, Cooper NS, et al. The American Rheumatism Association 1987 revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum. 1988;31(3):315–24. doi: 10.1002/art.1780310302 [DOI] [PubMed] [Google Scholar]
  • 21.Kay J, Upchurch KS. ACR/EULAR 2010 rheumatoid arthritis classification criteria. Rheumatology (Oxford). 2012;51 Suppl 6:vi5–9. doi: 10.1093/rheumatology/kes279 [DOI] [PubMed] [Google Scholar]
  • 22.Hochberg MC, Altman RD, Brandt KD, Clark BM, Dieppe PA, Griffin MR, et al. Guidelines for the medical management of osteoarthritis. Part I. Osteoarthritis of the hip. American College of Rheumatology. Arthritis Rheum. 1995;38(11):1535–40. doi: 10.1002/art.1780381103 [DOI] [PubMed] [Google Scholar]
  • 23.Hochberg MC, Altman RD, Brandt KD, Clark BM, Dieppe PA, Griffin MR, et al. Guidelines for the medical management of osteoarthritis. Part II. Osteoarthritis of the knee. American College of Rheumatology. Arthritis Rheum. 1995;38(11):1541–6. doi: 10.1002/art.1780381104 [DOI] [PubMed] [Google Scholar]
  • 24.Sterne JAC, Savovic J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898. doi: 10.1136/bmj.l4898 [DOI] [PubMed] [Google Scholar]
  • 25.Bingham CO 3rd, Sebba AI, Rubin BR, Ruoff GE, Kremer J, Bird S, et al. Efficacy and safety of etoricoxib 30 mg and celecoxib 200 mg in the treatment of osteoarthritis in two identically designed, randomized, placebo-controlled, non-inferiority studies. Rheumatology (Oxford). 2007;46(3):496–507. doi: 10.1093/rheumatology/kel296 [DOI] [PubMed] [Google Scholar]
  • 26.Birbara C, Ruoff G, Sheldon E, Valenzuela C, Rodgers A, Petruschke RA, et al. Efficacy and safety of rofecoxib 12.5 mg and celecoxib 200 mg in two similarly designed osteoarthritis studies. Curr Med Res Opin. 2006;22(1):199–210. doi: 10.1185/030079906X80242 [DOI] [PubMed] [Google Scholar]
  • 27.Cannon CP, Chen C, Curtis SP, Viscusi J, Ahmed T, Dibattiste PM. A Comparison of Cardiovascular Biomarkers in Patients Treated for Three Months with Etoricoxib, Celecoxib, Ibuprofen, and Placebo. Arch Drug Inf. 2008;1(1):4–13. doi: 10.1111/j.1753-5174.2007.00002.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Clegg DO, Reda DJ, Harris CL, Klein MA, O’Dell JR, Hooper MM, et al. Glucosamine, chondroitin sulfate, and the two in combination for painful knee osteoarthritis. N Engl J Med. 2006;354(8):795–808. doi: 10.1056/NEJMoa052771 [DOI] [PubMed] [Google Scholar]
  • 29.Conaghan PG, Dickson JD, Bolten W, Cevc G, Rother M. A large randomised, controlled trial comparing the efficacy and safety of topical ketoprofen in transfersome gel with oral celecoxib for osteoarthritis knee pain. Annals of the Rheumatic Disease Conference: Annual European Congress of Rheumatology of the European League Against Rheumatism, EULAR. 2012;71(SUPPL. 3). [Google Scholar]
  • 30.Cryer B, Li C, L SS, Singh G, Stillman MJ, Berger M. GI-REASONS: A novel 6-month, prospective, randomized, open-label, blinded end point (PROBE) trial. Arthritis Research and Therapy Conference: Proceedings of the 8th Global Arthritis Research Network, GARN Meeting and 1st Bio Rheumatology International Congress, BRIC Tokyo Japan Conference Publication:. 2012;14(SUPPL. 1). [Google Scholar]
  • 31.Dahlberg LE, Holme I, Høye K, Ringertz B. A randomized, multicentre, double-blind, parallel-group study to assess the adverse event-related discontinuation rate with celecoxib and diclofenac in elderly patients with osteoarthritis. Scand J Rheumatol. 2009;38(2):133–43. doi: 10.1080/03009740802419065 [DOI] [PubMed] [Google Scholar]
  • 32.Essex MN, Bhadra P, Sands GH. Efficacy and tolerability of celecoxib versus naproxen in patients with osteoarthritis of the knee: a randomized, double-blind, double-dummy trial. J Int Med Res. 2012;40(4):1357–70. doi: 10.1177/147323001204000414 [DOI] [PubMed] [Google Scholar]
  • 33.Gibofsky A, Williams GW, McKenna F, Fort JG. Comparing the efficacy of cyclooxygenase 2-specific inhibitors in treating osteoarthritis: appropriate trial design considerations and results of a randomized, placebo-controlled trial. Arthritis Rheum. 2003;48(11):3102–11. doi: 10.1002/art.11330 [DOI] [PubMed] [Google Scholar]
  • 34.Hawel R, Klein G, Singer F, Mayrhofer F, Kähler ST. Comparison of the efficacy and tolerability of dexibuprofen and celecoxib in the treatment of osteoarthritis of the hip. Int J Clin Pharmacol Ther. 2003;41(4):153–64. doi: 10.5414/cpp41153 [DOI] [PubMed] [Google Scholar]
  • 35.MacDonald TM, Hawkey CJ, Ford I, McMurray JJV, Scheiman JM, Hallas J, et al. Randomized trial of switching from prescribed non-selective non-steroidal anti-inflammatory drugs to prescribed celecoxib: the Standard care vs. Celecoxib Outcome Trial (SCOT). Eur Heart J. 2017;38(23):1843–50. doi: 10.1093/eurheartj/ehw387 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.McKenna F, Weaver A, Fiechtner JJ, Bello AE, Fort JG. COX-2 specific inhibitors in the management of osteoarthritis of the knee: a placebo-controlled, randomized, double-blind study. J Clin Rheumatol. 2001;7(3):151–9. doi: 10.1097/00124743-200106000-00004 [DOI] [PubMed] [Google Scholar]
  • 37.Nissen SE, Yeomans ND, Solomon DH, Lüscher TF, Libby P, Husni ME, et al. Cardiovascular Safety of Celecoxib, Naproxen, or Ibuprofen for Arthritis. N Engl J Med. 2016;375(26):2519–29. doi: 10.1056/NEJMoa1611593 [DOI] [PubMed] [Google Scholar]
  • 38.Sampalis JS, Brownell LA. A randomized, double blind, placebo and active comparator controlled pilot study of UP446, a novel dual pathway inhibitor anti-inflammatory agent of botanical origin. Nutr J. 2012;11:21. doi: 10.1186/1475-2891-11-21 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Sawitzke AD, Shi H, Finco MF, Dunlop DD, Harris CL, Singer NG, et al. Clinical efficacy and safety of glucosamine, chondroitin sulphate, their combination, celecoxib or placebo taken to treat osteoarthritis of the knee: 2-year results from GAIT. Ann Rheum Dis. 2010;69(8):1459–64. doi: 10.1136/ard.2009.120469 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Schnitzer TJ, Dattani ID, Seriolo B, Schneider H, Moore A, Tseng L, et al. A 13-week, multicenter, randomized, double-blind study of lumiracoxib in hip osteoarthritis. Clin Rheumatol. 2011;30(11):1433–46. doi: 10.1007/s10067-011-1776-4 [DOI] [PubMed] [Google Scholar]
  • 41.Simon LS, Weaver AL, Graham DY, Kivitz AJ, Lipsky PE, Hubbard RC, et al. Anti-inflammatory and upper gastrointestinal effects of celecoxib in rheumatoid arthritis: a randomized controlled trial. JAMA. 1999;282(20):1921‐8. doi: 10.1001/jama.282.20.1921 [DOI] [PubMed] [Google Scholar]
  • 42.Smugar SS, Schnitzer TJ, Weaver AL, Rubin BR, Polis AB, Tershakovec AM. Rofecoxib 12.5 mg, rofecoxib 25 mg, and celecoxib 200 mg in the treatment of symptomatic osteoarthritis: results of two similarly designed studies. Curr Med Res Opin. 2006;22(7):1353–67. doi: 10.1185/030079906X104876 [DOI] [PubMed] [Google Scholar]
  • 43.White WB, Faich G, Whelton A, Maurath C, Ridge NJ, Verburg KM, et al. Comparison of thromboembolic events in patients treated with celecoxib, a cyclooxygenase-2 specific inhibitor, versus ibuprofen or diclofenac. American Journal of Cardiology. 2002;89(4):425–30. [DOI] [PubMed] [Google Scholar]
  • 44.Williams GW, Hubbard RC, Yu SS, Zhao W, Geis GS. Comparison of once-daily and twice-daily administration of celecoxib for the treatment of osteoarthritis of the knee. Clin Ther. 2001;23(2):213–27. doi: 10.1016/s0149-2918(01)80004-7 [DOI] [PubMed] [Google Scholar]
  • 45.Wittenberg RH, Schell E, Krehan G, Maeumbaed R, Runge H, Schlüter P, et al. First-dose analgesic effect of the cyclo-oxygenase-2 selective inhibitor lumiracoxib in osteoarthritis of the knee: a randomized, double-blind, placebo-controlled comparison with celecoxib. Arthritis research & therapy. 2006;8(2):R35. doi: 10.1186/ar1854 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Hirayama A, Tanahashi N, Daida H, Ishiguro N, Chachin M, Sugioka T, et al. Assessing the cardiovascular risk between celecoxib and nonselective nonsteroidal antiinflammatory drugs in patients with rheumatoid arthritis and osteoarthritis. Circ J. 2014;78(1):194–205. doi: 10.1253/circj.cj-12-1573 [DOI] [PubMed] [Google Scholar]
  • 47.White WB, Faich G, Whelton A, Maurath C, Ridge NJ, Verburg KM, et al. Comparison of thromboembolic events in patients treated with celecoxib, a cyclooxygenase-2 specific inhibitor, versus ibuprofen or diclofenac. American Journal of Cardiology. 2002;89(4):425–30. [DOI] [PubMed] [Google Scholar]
  • 48.Trelle S, Reichenbach S, Wandel S, Hildebrand P, Tschannen B, Villiger PM, et al. Cardiovascular safety of non-steroidal anti-inflammatory drugs: network meta-analysis. BMJ. 2011;342:c7086. doi: 10.1136/bmj.c7086 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Chang HY, Tang FY, Chen DY, Chih HM, Huang ST, Cheng HD, et al. Clinical use of cyclooxygenase inhibitors impairs vitamin B-6 metabolism. Am J Clin Nutr. 2013;98(6):1440–9. doi: 10.3945/ajcn.113.064477 [DOI] [PubMed] [Google Scholar]
  • 50.Lotto V, Choi SW, Friso S. Vitamin B6: a challenging link between nutrition and inflammation in CVD. Br J Nutr. 2011;106(2):183–95. doi: 10.1017/S0007114511000407 [DOI] [PubMed] [Google Scholar]
  • 51.Friso S, Lotto V, Corrocher R, Choi SW. Vitamin B6 and cardiovascular disease. Subcell Biochem. 2012;56:265–90. doi: 10.1007/978-94-007-2199-9_14 [DOI] [PubMed] [Google Scholar]
  • 52.Arellano FM, Yood MU, Wentworth CE, Oliveria SA, Rivero E, Verma A, et al. Use of cyclo-oxygenase 2 inhibitors (COX-2) and prescription non-steroidal anti-inflammatory drugs (NSAIDS) in UK and USA populations. Implications for COX-2 cardiovascular profile. Pharmacoepidemiol Drug Saf. 2006;15(12):861–72. doi: 10.1002/pds.1343 [DOI] [PubMed] [Google Scholar]
  • 53.Hernandez-Diaz S, Varas-Lorenzo C, Rodriguez LAG. Non-steroidal antiinflammatory drugs and the risk of acute myocardial infarction.pdf. Basic Clin Pharmacol Toxicol. 2006;98(3):266–74. doi: 10.1111/j.1742-7843.2006.pto_302.x [DOI] [PubMed] [Google Scholar]
  • 54.Brune K, Katus HA, Moecks J, Spanuth E, Jaffe AS, Giannitsis E. N-terminal pro-B-type natriuretic peptide concentrations predict the risk of cardiovascular adverse events from antiinflammatory drugs: a pilot trial. Clin Chem. 2008;54(7):1149–57. doi: 10.1373/clinchem.2007.097428 [DOI] [PubMed] [Google Scholar]
  • 55.Grosser T, Fries S, FitzGerald GA. Biological basis for the cardiovascular consequences of COX-2 inhibition: therapeutic challenges and opportunities. J Clin Invest. 2006;116(1):4–15. doi: 10.1172/JCI27291 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.England BR, Thiele GM, Anderson DR, Mikuls TR. Increased cardiovascular risk in rheumatoid arthritis: mechanisms and implications. BMJ. 2018;361:k1036. doi: 10.1136/bmj.k1036 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Michael Nurmohamed

13 Sep 2021

PONE-D-21-23851Cardiovascular Safety of Celecoxib in Rheumatoid Arthritis and Osteoarthritis Patients: A Systematic Review and Meta-AnalysisPLOS ONE

Dear Dr. Liu,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================The reviewers made several important points that should be addressed, particularly the statistics require attention. Please consider to to seek advice from a biostatistician (preferably also including him/her as an author.

Furthermore, the English needs substantial improvement.

==============================

Please submit your revised manuscript by Oct 28 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Michael Nurmohamed, MD, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

3. Thank you for stating the following in the Acknowledgments Section of your manuscript: 

“This review was supported by the National Natural Science Foundation project (No. 81830115), and partially supported by the NCCIH grant (AT001293 with sub award No. 020468C).”

We note that you have provided additional information within the Acknowledgements Section that is not currently declared in your Funding Statement. Please note that funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. 

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: 

“The author(s) received no specific funding for this work.”

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

4. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

5. Please ensure that you refer to Figure 4, 5, 6, 7 and 8 in your text as, if accepted, production will need this reference to link the reader to the figure.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This is a timely manuscript which aims to provide some higher level of evidence in a relative arguable subject, namely the overall and in particular the cardiovascular safety profile of celecoxib and NSAIDs in patients with OA and/or RA. The authors performed a systematic review and a meta-analysis of available literature and found that celecoxib has a better CV profile than other NSAIDs in terms of all-cause mortality and CV mortality, whereas no differences have been observed for myocardial infarction and CVA. Similarly, no differences have been shown with respect to all analyzed outcomes when celecoxib has been compared to placebo. Some points could be made that should be addressed in order to improve the manuscript:

1. English language: please have the manuscript checked by a native English speaker or someone with highest qualifications in English language.

2. Methodologic issues/statistical issues: the study of Nissen (2016) and MacDonald (2017) are the largest studies and both of them provide data supporting a neutral/beneficial effect of celecoxib with respect to all-cause mortality and CV mortality. Likewise, it is of little surprise that the meta-analysis imbedding this two studies would come to the same conclusion, only now reaching statistical significance. My point is that we should still be caution when interpreting the results, because even this is a meta-analysis, it seems that these two studies are actually the ones determining the final outcome. Could the authors discuss this point?

3. Clinical relevance: from the clinician point of view it is of relevance to know if it is possible to safely prescribe NSAIDs to a patient, and which one fits the best with his clinical profile. Among the studies included in this meta-analysis a few investigated RA patients. Is it possible to perform separate analysis for the OA and RA patients respectively? While NSAIDs are often prescribed as painkillers in OA (where paracetamol represents an equally good alternative, given the low-inflammatory status in OA), their prescription in RA can sometimes be determined by an increasing of disease activity, thus working more as anti-inflammatory drugs, decreasing inflammation and consequently its detrimental cardiovascular effects. Therefore one may hypothesize that the same drug (celecoxib) might have different CV impact in RA and OA respectively because of different biological effects (more painkilling (OA) vs. more anti-inflammatory (RA)).

It would therefore be very useful if the authors would provide the readers with an answer to the following questions (based on their results):

a) Can I safely prescribe celecoxib in an OA patient? As a first NSAID? What if the patient has a history of CV events?

b) Can I safely prescribe celecoxib to an RA patient? As a first NSAID? What if the patient has a history of CV events?

Thank you.

Reviewer #2: Liu et al. have written a systematic review and meta-analysis about the use of celecoxib and its cardiovascular safety in patients with rheumatoid arthritis and osteoarthritis. This is a relevant topic for daily clinical practice. However, I have several concerns about the manuscript.

1. In the introduction, on page 2, line 47 and 48, the authors write about coronary atherosclerosis and non-fatal myocardial infarction. I think this sentence should be refrased. Now it reads as if coronary atherosclerosis and a myocardial infarction are different entities. It could be refrased to "particularly (fatal and non-fatal) myocardial infarction due to coronary atherosclerosis".

2. The authors write that there are no specific treatment strategies for CV disease in RA patients. However, the EULAR recommendations state that there is evidence (from mainly observational studies) that an optimal control of disease activity and treatment of CVD risk factors reduces the CVD risk in patients with an inflammatory joint disease.

3. Regarding the statistical analysis I would like to advise to discuss the methods with a statistician. Studies with zero events were included in the analyses. I wonder if this is the correct way to do these analyses. I wonder if you can conclude that all-cause mortality was decreased in the celecoxib group when there are 0-2 events in the studies included.

4. I could not find which non-selective NSAIDs the authors included in their search and comparison with celecoxib. I think this is relevant and should be added to the manuscript.

5. In general, I would advise to ask a native English speaker to review the manuscript.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Dec 21;16(12):e0261239. doi: 10.1371/journal.pone.0261239.r002

Author response to Decision Letter 0


24 Oct 2021

Reviewer #1: This is a timely manuscript which aims to provide some higher level of evidence in a relative arguable subject, namely the overall and in particular the cardiovascular safety profile of celecoxib and NSAIDs in patients with OA and/or RA. The authors performed a systematic review and a meta-analysis of available literature and found that celecoxib has a better CV profile than other NSAIDs in terms of all-cause mortality and CV mortality, whereas no differences have been observed for myocardial infarction and CVA. Similarly, no differences have been shown with respect to all analyzed outcomes when celecoxib has been compared to placebo. Some points could be made that should be addressed in order to improve the manuscript:

1. English language: please have the manuscript checked by a native English speaker or someone with highest qualifications in English language.

Response: We apologize for the insufficient quality of the original manuscript. This issue has been highly recognized by our team, and multiple times of revisions with great scrutiny have been performed. Some grammatical errors and expressions have been checked. We hope we have presented a better version. Thank you.

2. Methodologic issues/statistical issues: the study of Nissen (2016) and MacDonald (2017) are the largest studies and both of them provide data supporting a neutral/beneficial effect of celecoxib with respect to all-cause mortality and CV mortality. Likewise, it is of little surprise that the meta-analysis imbedding this two studies would come to the same conclusion, only now reaching statistical significance. My point is that we should still be caution when interpreting the results, because even this is a meta-analysis, it seems that these two studies are actually the ones determining the final outcome. Could the authors discuss this point?

Response: Thank you for your question. If the amount of included literature meta-analysis is small, such as two studies as you mentioned, there is often a serious bias. In principle, we can see whether there is publication bias through the funnel chart for more than 9 documents. Publication bias is an important aspect which should be considered because in many cases, articles with negative results are less likely to be published. As for other biases, we can only find out based on the evaluation of the quality of the literature (criteria and methodology). The available literature should be included in the study according to the PRISMA guidelines.

3. Clinical relevance: from the clinician point of view it is of relevance to know if it is possible to safely prescribe NSAIDs to a patient, and which one fits the best with his clinical profile. Among the studies included in this meta-analysis a few investigated RA patients. Is it possible to perform separate analysis for the OA and RA patients respectively? While NSAIDs are often prescribed as painkillers in OA (where paracetamol represents an equally good alternative, given the low-inflammatory status in OA), their prescription in RA can sometimes be determined by an increasing of disease activity, thus working more as anti-inflammatory drugs, decreasing inflammation and consequently its detrimental cardiovascular effects. Therefore one may hypothesize that the same drug (celecoxib) might have different CV impact in RA and OA respectively because of different biological effects (more painkilling (OA) vs. more anti-inflammatory (RA)).

It would therefore be very useful if the authors would provide the readers with an answer to the following questions (based on their results):

a) Can I safely prescribe celecoxib in an OA patient? As a first NSAID? What if the patient has a history of CV events?

b) Can I safely prescribe celecoxib to an RA patient? As a first NSAID? What if the patient has a history of CV events?

Thank you.

Response: Thank you for your question. Actually, before the submission, we tried to do this subgroup analysis you mentioned but failed because only 1 of the 24 trials included in our systematic review recruited only RA patients. 3 trials recruited both OA and RA patients, but data of OA and RA subgroups were not provided. Therefore, it is difficult to do this subgroup analysis. But based on the evidence we have so far, we consider it safe to prescribe celecoxib at an approved dose - 100, 200, and 400mg per day - in an OA patient, as a recommended NSAID. But we dare not say “a first NSAID” because naproxen also showed great safety and no statistical differences have been found between them in the study of Essex (2012)[1], MacDonald (2017)[2], Nissen (2016) [3] and Simon (1999)[4]. As for RA patients, although the participants were fewer, we still think it’s OK to draw the same conclusion because 1) any enhancement of CV risk with celecoxib or nsNSAID is modest[2]; and 2) trials with OA&RA patients presented the same results as those of trials with only OA patients. However, no subgroup analysis was reported considering patients with/without a history of CV events, so we cannot give a sound conclusion so far. We have added some related contents in the CONCLUSION.

Reviewer #2: Liu et al. have written a systematic review and meta-analysis about the use of celecoxib and its cardiovascular safety in patients with rheumatoid arthritis and osteoarthritis. This is a relevant topic for daily clinical practice. However, I have several concerns about the manuscript.

1. In the introduction, on page 2, line 47 and 48, the authors write about coronary atherosclerosis and non-fatal myocardial infarction. I think this sentence should be refrased. Now it reads as if coronary atherosclerosis and a myocardial infarction are different entities. It could be refrased to "particularly (fatal and non-fatal) myocardial infarction due to coronary atherosclerosis".

Response: Thank you for your advice and we apologize for the insufficient quality of the original manuscript. We value your opinion very much and have rephrased it as you suggested.

2. The authors write that there are no specific treatment strategies for CV disease in RA patients. However, the EULAR recommendations state that there is evidence (from mainly observational studies) that an optimal control of disease activity and treatment of CVD risk factors reduces the CVD risk in patients with an inflammatory joint disease.

Response: Thank you for your comments. Our purpose by saying “there were no specific treatment strategies” was that the relationship between RA and its raised CV risk remains unclear. Therefore, no specific treatments could have been found. We deeply agree with the EULAR recommendations that controlling disease activity and treatment of the risk factors reduces the CVD risk. To minimize misunderstanding, we deleted related lines.

3. Regarding the statistical analysis I would like to advise to discuss the methods with a statistician. Studies with zero events were included in the analyses. I wonder if this is the correct way to do these analyses. I wonder if you can conclude that all-cause mortality was decreased in the celecoxib group when there are 0-2 events in the studies included.

Response: Thanks for the advice. We discussed the methods with a statistician (Jingli Xing), and she found no mistakes in them. In a meta-analysis, when we want to calculate the rate of a specific event, the exact number of the event should be recorded, even though sometimes this event did not happen - meaning the rate is 0%. In Cochrane Handbook for Systematic Reviews of Interventions Version 6.2, Chapter 10.4.4.2: Studies with no events in either arm, it wrote: “Whilst the results of risk difference meta-analyses will be affected by non-reporting of outcomes with no events, odds and risk ratio based methods naturally exclude these data whether or not they are published, and are therefore unaffected”[5]. Therefore, we think it is appropriate to include studies with zero events.

4. I could not find which non-selective NSAIDs the authors included in their search and comparison with celecoxib. I think this is relevant and should be added to the manuscript.

Response: Thanks for your question. The details about which non-selective NSAIDs, if any, were included in each trial are concluded in “Table 1 Characteristics of randomized controlled trials included in qualitative synthesis”, which contains ibuprofen, diclofenac, naproxen, and dexiprofen. In the PROBE trial, the nsNSAID in the comparator group was any nsNSAID of the investigator’s choice, prescribed within the dosages allowed in the United States package insert. In most of the trials, celecoxib was compared with placebo. As the incidence of events decreases, the logarithmic conversion, logit conversion, and arcsine conversion methods can still maintain good performance.

5. In general, I would advise to ask a native English speaker to review the manuscript.

Response: We apologize for the insufficient quality of the original manuscript. This issue has been highly recognized by our team, and multiple times of revisions with great scrutiny have been performed this time. Some grammatical errors and expressions have been checked. We hope we have presented a better manuscript. Thank you.

References:

[1] ESSEX M N, BHADRA P, SANDS G H. Efficacy and tolerability of celecoxib versus naproxen in patients with osteoarthritis of the knee: a randomized, double-blind, double-dummy trial [J]. J Int Med Res, 2012, 40(4): 1357-70.

[2] MACDONALD T M, HAWKEY C J, FORD I, et al. Randomized trial of switching from prescribed non-selective non-steroidal anti-inflammatory drugs to prescribed celecoxib: the Standard care vs. Celecoxib Outcome Trial (SCOT) [J]. Eur Heart J, 2017, 38(23): 1843-50.

[3] NISSEN S E, YEOMANS N D, SOLOMON D H, et al. Cardiovascular Safety of Celecoxib, Naproxen, or Ibuprofen for Arthritis [J]. N Engl J Med, 2016, 375(26): 2519-29.

[4] SIMON L S, WEAVER A L, GRAHAM D Y, et al. Anti-inflammatory and upper gastrointestinal effects of celecoxib in rheumatoid arthritis: a randomized controlled trial [J]. JAMA, 1999, 282(20): 1921‐8.

[5] Deeks JJ, Higgins JPT, Altman DG (editors). Chapter 10: Analysing data and undertaking meta-analyses. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.2 (updated February 2021). Cochrane, 2021. Available from www.training.cochrane.org/handbook.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Michael Nurmohamed

22 Nov 2021

PONE-D-21-23851R1Cardiovascular Safety of Celecoxib in Rheumatoid Arthritis and Osteoarthritis Patients: A Systematic Review and Meta-AnalysisPLOS ONE

Dear Dr. Jian-Ping Liu .

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

 There are are some remaining methodological issues, raised by reviewer 1, that need to be addressed

Please submit your revised manuscript by Jan 06 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Michael Nurmohamed, MD, PhD

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I would like to ask the authors to address in the Discussion the issue of publication bias, as a important limitation to their meta-analysis.

Secondly, I would like to know if there is an explanation for the fact that 11 studies mentioned in Table 1 (references no. 25,26, 28, 29, 32, 34, 36, 38, 41, 42, 45) can not be found among the studies presented in the figures 4 - 8. Is the data from these 11 studies excluded from the meta-analysis?

Finally, I would like to ask the authors to sharpen their aim of the study at the end of the introduction and also to address in their discussion or conclusion the gain of knowledge for the scientific community resulting from their meta-analysis. Thank you.

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Dec 21;16(12):e0261239. doi: 10.1371/journal.pone.0261239.r004

Author response to Decision Letter 1


24 Nov 2021

Reviewer #1:

Q1: I would like to ask the authors to address in the Discussion the issue of publication bias, as an important limitation to their meta-analysis.

Response: Thanks for your advice. As the number of trials included in each meta-analysis was small (fewer than 10 trials), publication bias could not have been assessed properly, which makes it an important limitation to our work. We have addressed this issue in the Discussion (Line 275-276).

Q2: Secondly, I would like to know if there is an explanation for the fact that 11 studies mentioned in Table 1 (references no. 25,26, 28, 29, 32, 34, 36, 38, 41, 42, 45) can not be found among the studies presented in the figures 4 - 8. Is the data from these 11 studies excluded from the meta-analysis?

Response: Thanks for your question. Figures 4-8 presented part of the pooled results of the primary outcomes, which are all-cause mortality, cardiovascular mortality, myocardial infarction, and stroke. Some negative results were only shown in the text because we were trying to reduce the number of pictures. As for the secondary outcomes, which are atrial fibrillation, arrhythmias, angina, revascularization, and heart failure, there were no figures in our last edition of the manuscript because some were only reported in single studies, some in no studies, and none of the results was statistically significant. We value your opinion very much and agree with you that it’s improper that we did not give more details about the 11 studies you mentioned, so we combined all the results of dichotomous outcomes into 2 figures (figure 4 and 5 in our latest manuscript), where 19 of the 21 studies included can be found except Sampalis 2012[1] and Simon 1999[2] for following reasons: 1. Sampalis 2012 did not present any data capable for analysis, so we only described their results in the text; 2. Simon 1999 was the only study that presented blood pressures in the celecoxib group and placebo group before and after the study, so the results couldn’t be pooled and also couldn’t be shown in Fig 5. Relative risk of dichotomous outcomes for celecoxib versus placebo as they were continuous data. Therefore, we only described their findings in the text.

Q3: Finally, I would like to ask the authors to sharpen their aim of the study at the end of the introduction and also to address in their discussion or conclusion the gain of knowledge for the scientific community resulting from their meta-analysis. Thank you.

Response: Thanks for your advice. We also think doing so helps readers to better find their take-home messages, so some changes were made in the text (Line 84-86, and Line294-295) to address the aim and findings clearer.

Thank you again for all your precious comments! They’ve been really helpful to us and this article.

References:

[1] SAMPALIS J S, BROWNELL L A. A randomized, double blind, placebo and active comparator controlled pilot study of UP446, a novel dual pathway inhibitor anti-inflammatory agent of botanical origin [J]. Nutr J, 2012, 11(21.

[2] SIMON L S, WEAVER A L, GRAHAM D Y, et al. Anti-inflammatory and upper gastrointestinal effects of celecoxib in rheumatoid arthritis: a randomized controlled trial [J]. JAMA, 1999, 282(20): 1921‐8.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Michael Nurmohamed

26 Nov 2021

Cardiovascular Safety of Celecoxib in Rheumatoid Arthritis and Osteoarthritis Patients: A Systematic Review and Meta-Analysis

PONE-D-21-23851R2

Dear Dr. Jian-Ping Liu,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Michael Nurmohamed, MD, PhD

Academic Editor

PLOS ONE

Acceptance letter

Michael Nurmohamed

6 Dec 2021

PONE-D-21-23851R2

Cardiovascular Safety of Celecoxib in Rheumatoid Arthritis and Osteoarthritis Patients: A Systematic Review and Meta-Analysis

Dear Dr. Liu:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof.Dr Michael Nurmohamed

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. PRISMA 2020 flow diagram.

    (DOCX)

    S2 Appendix. PRISMA 2020 checklist.

    (DOCX)

    S3 Appendix. PROSPERO protocol.

    (PDF)

    S4 Appendix. Search strategy.

    (DOCX)

    S5 Appendix. Data extraction of study characteristics.

    (XLS)

    S6 Appendix. Data extraction of outcomes.

    (XLS)

    S7 Appendix. RoB assessment.

    (XLSM)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES