Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2022 Sep 29;17(9):e0273789. doi: 10.1371/journal.pone.0273789

Comparison of rheumatoid arthritis composite disease activity indices and residual activity in a Brazilian multicenter study- REAL study

Isabela Araújo Santos 1,*,#, Renê Donizeti Ribeiro de Oliveira 1,#, Sergio Couto Luna Almeida 1,#, Ana Beatriz Vargas-Santos 2,, Rodrigo Balbino Chaves Amorim 2,, Ana Paula Monteiro Gomides 3,, Cleandro Pires de Albuquerque 3, Manoel Barros Bertolo 4, Maria Fernanda Brandão Resende Guimarães 5,, Maria Raquel da Costa Pinto 5,, Gustavo Gomes Resende 5,, Rina Dalva Neubarth Giorgi 6,, Nathalia de Carvalho Saciloto 6,, Sebastião Cezar Radominski 7,, Fernanda Maria Borghi 8,, Karina Rossi Bonfiglioli 9,, Henrique Carrico da Silva 9,, Maria de Fatima L da Cunha Sauma 10,, Ivanio Alves Pereira 11,, Glaucio Ricardo Werner de Castro 12,, Claiton Viegas Brenol 13,, Ricardo Machado Xavier 13,, Licia Maria Henrique Mota 3,, Paulo Louzada-Junior 1,#, Geraldo da Rocha Castelar-Pinheiro 2,
Editor: Masataka Kuwana14
PMCID: PMC9521837  PMID: 36174077

Abstract

Introduction

Rheumatoid arthritis (RA) composite disease activity indices have become handy tools in daily clinical practice and crucial in defining remission or low disease activity, the main target of the RA treatment. However, there is no definition of the best index to assess disease activity in clinical practice.

Objectives

To compare the residual activity among the indices with the ACR/EULAR remission criteria (Boolean method) to identify the most feasible for assessing remission in daily practice, also considering correlation and concordance, sensibility, and specificity.

Patients and methods

We selected 1116 patients with established RA from the real-life rheumatoid arthritis study database—REAL. The composite disease activity indices—DAS28-ESR, DAS28-CRP, SDAI, and CDAI–and their components were compared to the Boolean method to identify residual activity using binomial regression. The indices were analyzed for correlation and agreement using the Spearman index and weighted kappa. The chi-square test evaluated sensibility and specificity for remission based on the Boolean method.

Results

DAS28-CRP overestimated remission and confirmed higher residual activity than SDAI and CDAI. The indices showed good correlation and agreement, with a better relationship between SDAI and CDAI (k:0,88). CDAI and SDAI showed higher sensitivity and specificity for remission based on the Boolean method. CDAI was performed in 99% of patients, while DAS28 and SDAI were completed in approximately 85%.

Conclusions

Although all composite indices of activity can be used in clinical practice and showed good agreement, CDAI and SDAI have better performance in evaluating remission based on the Boolean method, showing less residual activity and higher sensibility and specificity. In addition, CDAI seems to be more feasible for disease activity evaluation in daily clinical practice, especially in developing countries.

Introduction

Rheumatoid arthritis (RA) is a systemic inflammatory disease characterized by erosive peripheral joint involvement that can lead to structural damage, deformities, functional impairment, and poor quality of life. The worldwide prevalence is 0.2 to 1%, concordant with Brazilian data [14].

In the past decades, RA treatment has undergone a significant transformation. The use of disease-modifying anti-rheumatic drugs (DMARDs) under a strict treatment regimen (treat-to-target or T2T) reduced the loss of function, improved quality of life, and reduced radiographic progression compared to previous strategies [5].

The composite disease activity indices, better than individual variables, became crucial in achieving remission, the primary treatment target of RA [68]. The 28-joint Disease Activity Score (DAS28) was validated in 1995 with an erythrocyte sedimentation rate (ESR) as an inflammatory marker. In 2004, C-reactive protein (CRP) was included in the formula [9, 10]. Nevertheless, they were more associated with significant residual activity disease activity. On the other hand, the Simplified Activity Index (SDAI) and the Clinical Activity Index (CDAI) became better alternatives for evaluating inflammatory activity and classification of remission with a more simplified calculation [11, 12].

In 2011, the ACR/EULAR provided Boolean and index-remission criteria for trials and clinical practice [13]. Characterized by a state of absence or minimal inflammatory activity, remission can be achieved by two methods: (1) Boolean method, defined by painful joint count (TJC) ≤1, swollen joint count (SJC) ≤1, CRP (mg/dL) ≤ 1 and global patient assessment (PtGA; 0–10 cm scale) ≤ 1; or (2) SDAI ≤ 3,3 [13]. Furthermore, remission should define a state of minimal residual disease activity with no more than two involved joints, swollen and/or tender [13].

In daily practice, all of the four indices can be used to assess inflammatory activity. Although the increased evidence of residual activity over the years, DAS28 is still the most common and well-established index in clinical practice. It also has a significant difference in weight among the variables in the formula and influences comorbidities that can contribute to inadequate remission status or low disease activity [14]. On the other hand, SDAI and CDAI show less residual activity, more accessible formulas, and greater agility and treatment definition [1517]. SDAI shows higher agreement when compared to magnetic resonance image (MRI), and CDAI allows guiding the treatment even when laboratory tests are not available [18, 19]. Balsa et al. already proposed the superiority of SDAI over DAS28 to predict ultrasound remission in patients with RA and found that SDAI was the index closest to remission by the absence of a signal at power doppler [20]. As a result, SDAI and CDAI have been more recommended in the classification of remission, with evidence of less residual activity and higher agreement with imaging methods [2022].

The objectives of this study were to compare the residual activity among indices based on the Boolean method of remission in a real-life setting and evaluate the most feasible for assessing remission in daily practice, also considering correlation and concordance, sensibility, and specificity.

Material and methods

This study was part of a multicenter prospective observational cohort study—Rheumatoid Arthritis in Real Life (REAL). The objectives were to describe the demographic, clinical, and therapeutic characteristics of Brazilian patients with RA and evaluate adherence to treatment, the safety of pharmacologic therapy, and its impact on physical function and quality of life [23].

Thirteen tertiary public healthcare centers specialized in RA management were selected to represent the five geographic regions of Brazil, but only eleven from four areas were enrolled in the program. Patients were followed for 12 months with systematic data collection at the initial visit (baseline), intermediate visit (6 months ± 1 month), and final visit (12 months ± 1 month). The recruitment period started on 12 August 2015 and ended on 15 April 2016. The sample selection was by convenience. The present article is a cross-sectional evaluation of the baseline data. The study was approved by the National Commission of Ethics in Research—Ministry of Health (number 45781015810015259) and by the Research Ethics Committee of Ribeirão Preto Clinical Hospital, Ribeirão Preto Medical School of the University of São Paulo (number 45781015820015440). Each of the centers also obtained approval from the respective Institutional Review Boards. All participants signed the written consent form.

The inclusion criteria were: (1) patients with RA who fulfilled the 1987 American Rheumatism Association (ARA) or the 2010 American College of Rheumatology (ACR)/ European League Against Rheumatism (EULAR) classification criteria for rheumatoid arthritis [24, 25]; (2)18 years or older; (3) documented medical record data of at least six months of follow-up in their healthcare center before study enrollment; (4) good adherence to drug treatment; (5) adequate intellectual and communication levels to answer the questionnaires. Exclusion criteria were comorbidities that compromised the evaluation of the variables, such as stroke, chronic renal dialysis, malignant neoplasia, or major depression.

Each center enrolled about 100 patients consecutively, evaluated by the same rheumatologist. Most data were collected during medical appointments, with medical records used as secondary sources. The clinical assessment consisted of the examination of the number of tender (TJC) and swollen joints (SJC), a global health assessment (GH), a visual analog scale of disease activity by the patient (PtGA) and the physician (PhGA), and markers of inflammatory activity—erythrocyte sedimentation rate (ESR) or C-reactive protein (CRP)- to calculate the composite disease activity indices. The exams were collected with a maximum three-month interval between the visits, and qualitative values were not considered.

The patients were classified according to demographic and clinical data (time from symptom onset to diagnosis, disease duration, lifestyle habits, comorbidities, presence of erosive disease, and laboratory tests, including rheumatoid factor and anti-citrullinated protein antibody). These variables were listed in the descriptive statistical analysis. Other variables and clinical data were detailed in separate articles [23, 2629].

The composite disease activity indices evaluated were DAS28-ESR, DAS28-CRP, SDAI, and CDAI. The indices definitions and formulas are shown in Tables 1 and 2.

Table 1. Composite disease activity indices and classifications [9, 11, 30, 31].

Indices Components Disease Activity
Remission Low Moderated Elevated
DAS28-ESR SJC (28)
TJC (28) < 2,6 2,6 to 3,2 ˃ 3,2 to ≤ 5,1 ˃ 5,1
ESR (mm)
GH (mm)
DAS28-CRP SJC(28)
TJC (28) < 2,6 2,6 to 3,2 ˃ 3,2 to ≤ 5,1 ˃ 5,1
CRP (mg/L)
GH (mm)
SDAI SJC (28) + TJC (28) +
CRP (mg/dL) + PtGA (cm) + PhGA (cm) ≤ 3,3 ˃ 3,3 to 11 ˃ 11 to ≤ 26 ˃ 26
CDAI SJC (28) + TJC (28) +
PtGA (cm) + PhGA (cm) ≤ 2,8 ˃ 2,8 to 10 ˃ 10 to ≤ 22 ˃22
ACR/EULAR SDAI ≤ 3,3
Boolean: OR
SJC / TJC/ PtGA(cm)/ CRP (mg/dL) ≤1

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index; SJC: swollen joint count; TJC: tender joint count; GH: global health assessment (0–100 mm); PtGA: patient global assessment (0–10 cm); PhGA: physician global assessment (0–10 cm); ESR: erythrocyte sedimentation rate; CRP: C reactive protein.

Table 2. Composite disease activity indices formulas.

Composite Disease Activity Index Formula
DAS28-ESR 0,56 x √TJC28 + 0,28 x √SJC28 + 0,70 x lnESR + 0,014 x GH
DAS28-CRP 0,56 x √TJC28 + 0,28 x √SJC28 + 0,36 x ln(CRP+1) + 0,014 x GH + 0,96
SDAI SJC + TJC+ PtGA + PhGA + CRP (mg/dL)
CDAI SJC + TJC+ PtGA + PhGA

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index; SJC: swollen joint count; TJC: tender joint count; GH: global health assessment (0–100 mm); PtGA: patient global assessment (0–10 cm); PhGA: physician global assessment (0–10 cm; ESR: erythrocyte sedimentation rate; CRP: C reactive protein.

The epidemiological data were analyzed using descriptive statistics, and the results are presented as mean and standard deviation or median and interquartile range, as appropriate.

The indices were compared to the Boolean method using binomial regression with identity link function and random effects since the same patient could be in remission for more than one index simultaneously. Residual activity was characterized by the proportion of patients with off-target components. Although residual activity is not only characterized by activity disease scores, and symptoms like fatigue, sleep disturbances, and pain are recognized as necessary for measuring residual activity, they were not evaluated in this article.

Correlation between pairs of indices was evaluated using the Spearman index since the indices were not normally distributed. The agreement was assessed by kappa and weighted Kappa coefficient, and the indices were transformed into ordinal categoric variables, including remission, low, moderate, and elevated activity.

The indices were compared for sensibility and specificity for remission based on the Boolean method by the chi-square test. Values of p<0.05 were considered significant for all analyses. Data were analyzed using SAS software, version [9.2].

Results

One thousand one hundred and sixteen (1116) patients were enrolled in the present cohort. Their demographics and clinical and laboratory characteristics are shown in Table 3.

Table 3. Baseline clinical data of patients with RA in the REAL study (n = 1116).

Clinical data Absolute value or % (n)
Age, years (mean ± SD) 56.7 ± 11.4
Female gender (%) 998 (89.5%)
Study time, years (mean ± SD) 8 ± 4.2
Ethnicity/race/color (%)
 • White 634 (56.8%)
 • Black 122 (10.9%)
 • Pardoa 349 (31.2%)
Symptom’s duration, years (mean ± SD) 14.75 ± 7.8
Diagnostic time interval, months (mean ± SD) [median (IQR)] 32 ±51 12 (6–36)
Disease duration, years (mean ± SD) [median (IQR)] 12.6 ± 7.6 12.7 (0.7–56.9)
Positive rheumatoid factor (%) 78.5% (n = 1098)
Positive anti-citrullinated peptide antibody (%) 76.8% (n = 479)
Erosive disease (%) 54.9 (n = 1095)
Fibromyalgia (%) 154 (13.7%)
Current smoking (%) 121 (10.8%)
Medications:
 • Synthetic DMARD 1031 (90,9%)
 • Biological DMARD 398 (35.7%)
 • Biological DMARD monotherapy 62 (5.6%)
 • Glucocorticoids 528 (47,4%)
Painb (0–100) [median (IQR)] 40 (0–100) (n = 1116)
Fatigue (0–100) [median (IQR)] 40 (0–100) (n = 1116)
Global health assessment (0–100) 38 (0–100) (n = 1116)
ESR median (IQR) 21 (10–40) (n = 925)
CRP median (IQR) 0.67 (0.25–1.78) (n = 947)
HAQ median (IQR) 0.875 (0.25–1.5) (n = 1112)
DAS28-CRP median (IQR) 3.04 (2.23–4.21) (n = 937)
DAS28-ESR median (IQR) 3.52 (2.55–4.51) (n = 925)
SDAI median (IQR) 10.59 (4.47–20.20) (n = 943)
CDAI median (IQR) 9 (3.7–18.89) (n = 1114)

a Mixed white and black ethnicities.

b Patient global assessment.

DMARDS: disease -modifying anti-rheumatic drugs; ERS: erythrocyte sedimentation rate; CRP: C- reactive protein; HAQ: health assessment questionnaire; DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index.

Approximately 90% of patients were female, with a mean age of 56.7 years and a median disease duration of 12.7 years. Most patients were white (56.8%), with a median educational time of 8 years. The seropositivity rate was almost 80% for both rheumatoid factor and ACPA. A low rate of smoking (10.8%) and fibromyalgia (13,7%) was observed. Median HAQ-DI was 0.875, with mild functional loss. DAS28-ESR median was 3.5 and DAS28-CRP 3.04, SDAI 10.5, and CDAI 9, all representing low disease activity but revealing approximately 50% of patients presenting moderate to high disease activity.

By classifying patients according to disease activity, approximately 50% had low activity or remission, except for DAS28-ESR, whose rate was around 40% (Table 4). Although 50,8% of patients (567) presented remission in at least one index, this rate decreases substantially, achieving only 12.4% (139) when considering the Boolean remission criteria. This value is similar to 10,4% (117), the rate of patients with remission in all the indices simultaneously.

Table 4. Classification of disease activity according to composite indices.

RA Activity DAS28-ESR DAS28-CRP SDAI CDAI
High 156 (16.8%) 110 (11,7%) 145 (15.4%) 214 (19.2%)
Moderated 387 (41.8%) 327 (34.9%) 310 (32.9%) 307 (27.6%)
Low 139 (15%) 147 (15.7%) 308 (32.7%) 370 (33.2%)
Remission 243 (26.4%) 353 (37.7%) 180 (19%) 223 (20%)
Total 925 (100%) 937 (100%) 943 (100%) 1114(100%)
Losses 191 179 173 2

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index.

However, there is a difference in activity classification, and the indices disagreed when classifying low activity and remission, with a higher rate of low activity status by SDAI and CDAI than remission and a higher percentage of remission status by DAS28, both ESR and CRP (Fig 1).

Fig 1. Distribution of patients according to disease activity.

Fig 1

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28—erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index.

The components of the indices were evaluated according to residual activity, which was characterized as the proportion of patients that did not meet the Boolean remission criteria and presented values superior to 1 in all components of the latter (Table 5). The estimated difference rates between each index were analyzed according to each component and described in Table 6.

Table 5. Residual activity according to various remission activity states.

Residual Activity—Boolean parameters DAS28-ESR (n = 243) DAS28- CRP (N = 353) SDAI (n = 180) CDAI (n = 223)
TJC> 1, n (%) 16 (6.5%) 11 (3.1%) 2 (1.1%) 1 (0.4%)
SJC> 1, n (%) 14 (5.7%) 34 (9.6%) 2 (1.1%) 3 (1.3%)
CRP> 1mg/dL, n (%) 41 (17.9%) 64 (18.1%) 26 (14.4%) 52 (26.3%)
GH > 1 cm, n (%) 117 (48.1%) 182 (51.5%) 61 (33.8%) 72 (32.2%)
PtGA >1 cm, n (%) 111 (45.6%) 165 (46.7%) 26 (14.4%) 33(14.7%)
PhGA >1 cm, n (%) * 71 (29.2%) 120 (33.9%) 18 (10%) 22 (10%)

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index; TJC: tender joint count; SJC: swollen joint count; CRP: C reactive protein; GH: global health assessment; PtGA: patient’s global assessment; PhGA: physician’s global assessment.

* PhGA is not part of Boolean criteria

Table 6. Component estimated difference according to the composite activity indices.

Boolean parameters Estimated difference (%) CI (95%) p
CRP> 1
CDAI vs. DAS28-CRP 8.27 3.87;12.66 <0.01
CDAI vs. DAS28-ESR 8.49 2.98;14.01 <0.01
CDAI vs. SDAI 11.95 7.84-;16.06 <0.01
DAS28-CRP vs. SDAI 3,69 -0,49; 7,86 0,08
DAS28-ESR vs. SDAI 3,46 -1,89;8,81 0,21
SJC> 1
CDAI vs. DAS28-CRP -8.29 -11.42; -5.16 <0.01
CDAI vs. DAS28-ESR -4.42 -7.48;-1.35 <0.01
CDAI vs. SDAI 0.23 -0.69; 1.16 0.62
DAS28-CRP vs. SDAI 8.52 5.45;11.59 <0.01
DAS28-ESR vs. SDAI 4.65 1.62; 7.68 <0.01
TJC > 1
CDAI vs. DAS28-CRP -2.67 -4.68; -0.66 <0.01
CDAI vs. DAS28-ESR -6.14 -9.37; -2.91 <0.01
CDAI vs. SDAI -0.66 -1.76;0.44 0.24
DAS28-CRP vs. SDAI 2.1 -0.35;4.36 0.10
DAS28-ESR vs. SDAI 5.47 2.02;8.92 <0.01
PtGA>1
CDAI vs. DAS28-CRP -3.19 -3.71,-2.67 <0.01
CDAI vs. DAS28-ESR -3.08 -3.70; -2.47 <0.01
CDAI vs. SDAI 0.03 -0.33; 0.41 0.85
DAS28-CRP vs. SDAI 3,23 2,71; 3,75 <0,01
DAS28-ESR vs. SDAI 3,12 2,49; 3,75 <0,01
PhGA >1
CDAI vs. DAS28-CRP -2.41 -2.88; -1.94 <0.01
CDAI vs. DAS28-ESR -1.93 -2.49;1.37 <0.01
CDAI vs. SDAI -0.01 -0.30;0.27 0.93
DAS28-CRP vs. SDAI 2,39 1,90; 2,89 <0,01
DAS28-ESR vs. SDAI 1,92 1,35; 2,48 <0,01
GH > 1
CDAI vs. DAS28-CRP -1.70 -2.21; -1.18 <0.01
CDAI vs. DAS28-ESR -1.36 -1.97; -0.74 <0.01
CDAI vs. SDAI 0.06 -0.33; 0.46 0.75
DAS28-CRP vs. SDAI 1,76 1,23; 2,3 <0,01
DAS28-ESR vs. SDAI 1,42 7,81; 2,07 <0,01

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index; TJC: tender joint count; SJC: swollen joint count; CRP: C reactive protein; GH: global health assessment; PtGA: patient’s global assessment; PhGA: physician’s global assessment

The proportion of patients with swollen and painful joint counts out of target is higher for DAS28-ESR and DAS28-CRP when compared to SDAI and CDAI. While the former two have 3% to 10% of patients with > 1 joint involvement, the latter two have only 1%.

Patient assessment (GH and PtGA) was elevated in all indices, including SDAI and CDAI. But, in the latter two, the rate was lower than DAS28-ESR and DAS28-CRP. While DAS28-CRP and DAS28-ESR showed patient pain assessment rates between 40 to 50%, SDAI and CDAI showed around 14% (14,4% and 14,7%, respectively). Although not part of the Boolean method, physician assessment showed higher rates in DAS28 and less residual activity in SDAI and CDAI (10%). SDAI and CDAI had a lower proportion of patients who did not fulfill the Boolean remission criteria in all components (Table 5).

Finally, the estimated difference rates between each index showed statistical significance between DAS28-CRP and DAS28-ESR when compared to CDAI and SDAI (p<0.01), confirming a higher residual activity by DAS28, especially DAS28-CRP. No statistical difference was observed between CDAI and SDAI (Table 6).

When considering the absolute values of components, the minimum and maximum were described in Table 7.

Table 7. Minimum and maximum values of components at remission and low activity.

Remission–Components DAS28-ESR (n = 243) DAS28-CRP (N = 353) SDAI (n = 180) CDAI (n = 223)
TJC 0–8 0–8 0–3 0–2
SJC 0–8 0–8 0–2 0–2
CRP NA 0.01–8.7 0–3.0 NA
ESR 1–41 NA NA NA
GH 0–92 0–92 NA NA
PtGA NA NA 0–3 0–2.7
PhGA NA NA 0–2 0–2
SCORE 0–2.59 0,96–2.59 0–3.3 0–2.8
Low activity–Components DAS28-ESR (n = 139) DAS28-CRP (n = 147) SDAI (n = 308) CDAI (n = 370)
TJC 0–9 0–8 0–7 0–7
SJC 0–20 0–13 0–8 0–8
CRP NA 0.01–25 0–25 NA
ESR 2–95 NA NA NA
GH 0–84 0–100 NA NA
PtGA NA* NA 0–9,6 0–10
PhGA NA NA 0–6 0–6
SCORE 2.61–3.18 2.6–3.19 3.35–11 2.8–10

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index; TJC: tender joint count; SJC: swollen joint count; CRP: C reactive protein; GH: global health assessment; PtGA: patient’s global assessment; PhGA: physician’s global assessment.

*NA: not applicable

Although DAS28-CRP had 90% (319) and 96.8% (342) of the patients with up to 1 swollen joint and 1 tender joint, respectively, 10% (34) had up to 8 swollen joints in remission. CRP ≤ 1.0 mg/dL was found in 80.4% (289) of the patients, and almost one-fifth showed values greater than 1. Considering DAS28-ESR, 94% (229) of the patients had up to 1 tender joint, and 93.4% (227) had up to 1 swollen joint. Nevertheless, approximately 6% had up to 8 both swollen and tender joints.

When considering SDAI and CDAI, 98.8% (178) and 98.6% (220) of the patients presented up to 1 swollen joint, respectively. The maximum tender joint count was 3 for SDAI and 2 for CDAI. CRP was ≤ 1 mg /dL in 85.5% (154) of patients evaluated by SDAI. CRP > 1mg/dL was observed in similar proportions in SDAI and DAS28-CRP (14,5% and 19,6% of patients, respectively). CRP was the only component that has shown more residual activity in CDAI compared to DAS28, but it is important to note that CRP is not part of the CDAI.

When considering the low activity, a more significant number of affected joints was observed by DAS28-ESR, pointing up to 20 swollen joints and 13 by DAS28-CRP, while SDAI and CDAI showed a maximum of 8 swollen joints. But it is also important to note there were no newer validated criteria for low activity other than the indices themselves (Table 7).

Correlation among the indices was shown in Fig 2, with the strongest correlation between CDAI and SDAI ( 0.971, p <0.001).

Fig 2. Correlation among the composite disease activity indices.

Fig 2

Table 8 shows the agreement between the indices. The best agreement occurred between SDAI and CDAI (k = 0.88; CI 95% 0.86–0.90).

Table 8. Agreement among disease activity indices.

Agreement between indices according to disease classification
Weighted Kappa (CI 95%)
DAS28 ESR X DAS28 CRP 0.63 (0.59–0.67)
DAS28 ESR X SDAI 0.60 (0.57–0.64)
DAS28 ESR X CDAI 0.60 (0.57–0.64)
DAS28 CRP X SDAI 0.70 (0.67–0.73)
DAS28 CRP X CDAI 0.66 (0.63–0.69)
SDAI X CDAI 0.88 (0.86–0.90)

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index.

When comparing sensibility and specificity to achieve remission by the Boolean method, CDAI and SDAI presented higher sensitivity, specificity, and accuracy when compared to other indices (Table 9).

Table 9. Comparison of sensitivity and specificity among indices.

Remission Sensibility CI 95% Specificity CI 95% Accuracy p
DAS28-ESR 73% 0.65;0.80 82% 0.80;0.85 81% <0.001
DAS28-CRP 97% 0.93;0,99 72% 0.69;0.75 76% <0.001
CDAI 90% 0.84–0.94 90% 0.88–0.91 90% <0.001
SDAI 92% 0.91–0.96 93% 0.91–0.95 93% <0.001

DAS28-CRP: Disease Activity Score 28- C reactive protein; DAS28-ESR: Disease Activity Score 28 -erythrocyte sedimentation rate; SDAI: Simplified Activity Index; CDAI: Clinical Activity Index.

Discussion

This report is the first large Brazilian cohort study with patients with RA, representing almost all regions of the country that describes demographic, clinical, and therapeutics features of patients with RA and allows comparison of disease activity indices in a real-life setting. Although several studies support the importance of composite disease activity indices, there are limited data related to Brazil. This is the first national study with more than one thousand patients that demonstrates the presence of higher residual activity by DAS28-CRP and DAS28-ESR and encourages the use of SDAI and CDAI as indices for daily practice as an alternative to DAS28.

In this study, considering remission, only 117 of the 1116 patients (10.4%) analyzed were concordant for remission by the four indices simultaneously, and 139 (13.4%) were in remission by the Boolean method. These findings differ from other studies, in which remission may be possible in up to 50% of patients with RA with the appropriate treatment strategy [32]. According to Aga et al., remission could be achieved in 75 to 80% of patients treated with T2T and early diagnosis [33]. In the present cohort, around 50% of patients showed remission in at least one index, which is a low percentage compared to previously published studies. Although, it is essential to consider that it is a real-world study not intended to properly apply the T2T strategy, despite the management remaining aligned with the goal of remission or low disease activity. In addition, the patients have established disease with more than ten years of symptoms, worse prognosis factors, including antibody positivity, delay in starting therapy, and several previous treatment regimens that contribute to lower remission rates [23].

Based on the Boolean method of remission, residual activity was present in all indices evaluated but lesser in SDAI and CDAI. The estimated difference rate in each component was superior in DAS28-CRP and DAS28-ESR when compared with CDAI and SDAI (p < 0,05), with no difference between the latter. In this study, up to 8 tender or swollen joints were observed by DAS28 remission status, a much higher value than the threshold for remission by the Boolean method, which is a concerning result once swollen joint count is directly related to structural and irreversible damage progression in the longer term [34].

Therefore, several studies of composite disease activity indices have already suggested overestimated remission by DAS28, especially DAS28-CRP, even considering stricter cut-offs [17, 35]. According to Aletaha et al., even a cut-off value lower than 2.6 can allow up to 12 swollen joints and disease activity [6, 3538]. CDAI and SDAI are more stringent and reliable than DAS28 remission criteria, and different types of therapies do not influence them [39, 40]. In a recent paper, Schoels et al. analyzed three clinical trials of tocilizumab to describe residual activity by DAS28. The cut-off of DAS28-PCR and DAS28-ESR was reduced to <1,9 and < 2,2, respectively, and residual activity was still detected in DAS28-CRP, mainly based on swollen joints, an important component to predict radiologic progression [6]. This evidence suggests not only problems with the cut-off points or weight of inflammatory markers but with the formula [6].

Interestingly, pain assessment parameters, especially the global health assessment, are elevated in all indices at remission; however, PtGA used in SDAI and CDAI can better classify these patients and show less residual activity. The established disease with irreversible joint damage, comorbidities, and polypharmacy in these patients may contribute to higher pain scores and activity status [26]. On the other hand, PhGA parameters are lower in SDAI and CDAI when compared to DAS28-ESR and DAS28-CRP and demonstrate a significant estimated difference rate. In addition, they can suggest discordance between patient and physician with the first overlapping the second, which can occur in 18 to 49% of cases [29].

Although residual symptoms were not evaluated, it is noteworthy that pain, fatigue, and global health assessment described in Table 4 are present in this population at considerable rates (median 40), consistent with higher disease activity levels found in the study.

This study showed good correlation and concordance among indices, supporting the literature data, which already recognized the positive correlation and agreement among indices, especially between SDAI and CDAI [36, 4143]. SDAI became part of the remission criteria of ACR/EULAR and an important tool for clinical trials, while CDAI has been more recommended for clinical practice [13]. Since they consider the same variables in the formula, a good correlation was expected, as well as good agreement, especially between SDAI and CDAI (k:0,88), which correspond to the linear sum and have the same component weight [36, 4143].

Finally, SDAI and CDAI were closer to the Boolean remission concept, and both showed lower residual activity when compared with DAS28-ESR and DAS28-CRP. DAS28 and SDAI were performed in approximately 85%. In comparison, CDAI was performed in 99% of patients and presented a maximum of two joints affected in remission, favoring the latter use routinely when laboratory tests are unavailable and considering its performance in almost the totality of patients [36, 4143]. SDAI and CDAI showed higher sensitivity and specificity for remission based on the Boolean method. CDAI can be more attractive in developing countries with social and economic limitations, especially given its better adherence in a real-life setting [14, 22, 4448].

The study presents several limitations, including the impossibility of comparison of the indices with the gold standard imaging method, classification of residual activity only by disease activity scores, no control of variables, and no standardization of laboratory tests. However, this real-world study can recognize local challenges and allow rational allocation of resources and the development of strategies that better adjust to the local reality.

Conclusions

Although all composite disease activity indices can be used in clinical practice and showed good agreement, CDAI and SDAI showed less residual activity, higher sensibility, and specificity for remission based on the Boolean method. In developing countries, the availability of a low-cost and readily accessible index such as CDAI may be better for public health planning strategy. This study encourages using SDAI and CDAI indices for daily practice as an alternative to DAS28.

Acknowledgments

We thank the Rheumatology team of Ribeirão Preto, Clinical Hospital, University of São Paulo, for supporting this project.

Data Availability

All relevant data are within the paper.

Funding Statement

This project was supportedby th Brazilian Society of Rehumatology (BSR). BSR received support from following companies: Bristol-Myers Squibb FamaceuticaLtda; Llilly do Brasil Ltda; Janssen -Cilag Farmaceuticos Ltda; Laboratórios PfizerLtda; Pordutos Roche Quimicos e Farmacêuticos S.a; UCB Biopharma. The funding body or the companies hadno rolein the designof the study.

References

  • 1.Smolen JS, Aletaha D, McInnes IB. Rheumatoid arthritis. Lancet. 2016;388: 2023–2038. doi: 10.1016/S0140-6736(16)30173-8 [DOI] [PubMed] [Google Scholar]
  • 2.Smolen JS, Aletaha D, Barton A, Burmester GR, Emery P, Firestein GS, et al. Rheumatoid arthritis. Nat Rev Dis Prim. 2018;4: 1–23. doi: 10.1038/nrdp.2018.1 [DOI] [PubMed] [Google Scholar]
  • 3.Marques-Neto JF, Gonçalves ET, Langen LFOB, Cunha Mfl, Radominski S OS et al. Multicentric study of the prevalence of adult rheumatoid arthritis in Brazilian population samples. Rev Bras Reum. 1993;33: 167–73. Available: http://www.scielo.br/scielo.php?script=sci_nlinks&ref=000223&pid=S0482-5004201200020000200002&lng=pt [Google Scholar]
  • 4.Cross M, Smith E, Hoy D, Carmona L, Wolfe F, Vos T, et al. The global burden of rheumatoid arthritis: Estimates from the Global Burden of Disease 2010 study. Ann Rheum Dis. 2014;73: 1316–1322. doi: 10.1136/annrheumdis-2013-204627 [DOI] [PubMed] [Google Scholar]
  • 5.de Andrade NPB, da Silva Chakr RM, Xavier RM, Viecceli D, Correa RHB, de Oliveira Filho CM, et al. Long-term outcomes of treat-to-target strategy in established rheumatoid arthritis: a daily practice prospective cohort study. Rheumatol Int. 2017;37: 993–997. doi: 10.1007/s00296-017-3695-4 [DOI] [PubMed] [Google Scholar]
  • 6.Schoels M, Alasti F, Smolen JS, Aletaha D. Evaluation of newly proposed remission cut-points for disease activity score in 28 joints (DAS28) in rheumatoid arthritis patients upon IL-6 pathway inhibition. Arthritis Res Ther. 2017;19. doi: 10.1186/s13075-017-1346-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Smolen JS, Aletaha D, Bijlsma JWJ, Breedveld FC, Boumpas D, Burmester G, et al. Treating rheumatoid arthritis to target: recommendations of an international task force. Ann Rheum Dis. 2010;69: 631–7. doi: 10.1136/ard.2009.123919 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Van der Heijde DMFM, Van’t Hof MA, Van Riel PLCM, Van Leeuwen MA, Van Rijswijk MH, Van de Putte LBA. Validity of single variables and composite indices for measuring disease activity in rheumatoid arthritis. Ann Rheum Dis. 1992;51: 177–181. doi: 10.1136/ard.51.2.177 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Prevoo MLL, Van’T Hof MA, Kuper HH, Van Leeuwen MA, Van De Putte LBA, Van Riel PLCM. Modified disease activity scores that include twenty-eight-joint counts development and validation in a prospective longitudinal study of patients with rheumatoid arthritis. Arthritis Rheum. 1995;38: 44–48. doi: 10.1002/art.1780380107 [DOI] [PubMed] [Google Scholar]
  • 10.Fransen J, Welsing P, De Keijzer RM, Riel P. Disease activity scores using C-reactive protein: CRP may replace ESR in the assessment of RA disease activity. Ann Rheum Dis. 2004;62. [Google Scholar]
  • 11.Aletaha D, Smolen J. The Simplified Disease Activity Index (SDAI) and the Clinical Disease Activity Index (CDAI): A review of their usefulness and validity in rheumatoid arthritis. Clinical and Experimental Rheumatology. 2005. pp. S100–8. http://sci-hub.tw/http://www.clinexprheumatol.org/article.asp?a=2694 [PubMed] [Google Scholar]
  • 12.Smolen JS, Aletaha D. Scores for all seasons: SDAI and CDAI. Clin Exp Rheumatol. 2014;32: S75–S79. [PubMed] [Google Scholar]
  • 13.Felson DT, Smolen JS, Wells G, Zhang B, Van Tuyl LHD, Funovits J, et al. American College of Rheumatology/European League Against Rheumatism provisional definition of remission in rheumatoid arthritis for clinical trials. Ann Rheum Dis. 2011;70: 404–413. doi: 10.1136/ard.2011.149765 [DOI] [PubMed] [Google Scholar]
  • 14.Dale J, Purves D, McConnachie A, McInnes I, Porter D. Tightening Up? Impact of Musculoskeletal Ultrasound Disease Activity Assessment on Early Rheumatoid Arthritis Patients Treated Using a Treat to Target Strategy. Arthritis Care Res (Hoboken). 2014;66: 19–26. doi: 10.1002/acr.22218 [DOI] [PubMed] [Google Scholar]
  • 15.Leung YY, Cheung P, Canhão H, Rodrigues AM, Gregório MJ, Dias SS, et al. common evaluations of Disease activity in rheumatoid arthritis reach Discordant classifications across Different Populations. 2018;5. doi: 10.3389/fmed.2018.00040 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Yoo H. Simplified disease activity changes in real-world practice: a nationwide observational study of seropositive rheumatoid arthritis patients with moderate-to-high disease activity. Korean J Intern Med. 2019; 1226–3303. doi: 10.3904/kjim.2018.137 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Mierau M, Schoels M, Gonda G, Fuchs J, Aletaha D, Smolen JS. Assessing remission in clinical practice. Rheumatology. 2007;46: 975–979. doi: 10.1093/rheumatology/kem007 [DOI] [PubMed] [Google Scholar]
  • 18.Rubin DA. MRI and ultrasound of the hands and wrists in rheumatoid arthritis. I. Imaging findings. Skeletal Radiology. Springer; Verlag; 2019. pp. 677–695. [DOI] [PubMed] [Google Scholar]
  • 19.Mathew AJ, Danda D, Conaghan PG. MRI and ultrasound in rheumatoid arthritis. Current Opinion in Rheumatology. Lippincott Williams and Wilkins; 2016. pp. 323–329. [DOI] [PubMed] [Google Scholar]
  • 20.Balsa A, de Miguel E, Castillo C, Peiteado D, Martín-Mola E. Superiority of SDAI over DAS-28 in assessment of remission in rheumatoid arthritis patients using power Doppler ultrasonography as a gold standard. Rheumatology (Oxford). 2010;49: 683–90. doi: 10.1093/rheumatology/kep442 [DOI] [PubMed] [Google Scholar]
  • 21.Olmez MO, Gunal EK, Ureyen SB, Keskin H, Ozturk AB, Yeter G, et al. Comparison of composite indices with global synovitis score on ultrasound for detecting remission. Clin Rheumatol. 2018;37: 1111–1114. doi: 10.1007/s10067-017-3925-x [DOI] [PubMed] [Google Scholar]
  • 22.Barczyńska TA, Dura M, Blumfield E, Węgierska M, Żuchowski P, Wilińska-Jankowska A, et al. DAS28 score vs. ultrasound examination for assessment of rheumatoid arthritis disease activity: comparison and discussion of pros and cons. Reumatologia. 2015;53: 213–218. doi: 10.5114/reum.2015.53999 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.da Rocha Castelar-Pinheiro G, Vargas-Santos AB, de Albuquerque CP, Bértolo MB, Júnior PL, Giorgi RDN, et al. The REAL study: a nationwide prospective study of rheumatoid arthritis in Brazil. Adv Rheumatol (London, England). 2018;58: 9. doi: 10.1186/s42358-018-0017-9 [DOI] [PubMed] [Google Scholar]
  • 24.Arnett FC, Edworthy SM, Bloch DA, McShane DJ, Fries JF, Cooper NS, et al. The American Rheumatism Association revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum. 1988;31: 315–324. [DOI] [PubMed] [Google Scholar]
  • 25.Aletaha D, Neogi T, Silman AJ, Funovits J, Felson DT, Bingham CO, et al. 2010 Rheumatoid arthritis classification criteria: an American College of Rheumatology/European League Against Rheumatism collaborative initiative. Ann Rheum Dis. 2010;69: 1580–1588. doi: 10.1136/ard.2010.138461 [DOI] [PubMed] [Google Scholar]
  • 26.Gomides APM, Albuquerque CP, Santos ABV, Amorim RBC, Bértolo MB, Júnior PL, et al. High Levels of Polypharmacy in Rheumatoid Arthritis—A Challenge Not Covered by Current Management Recommendations: Data From a Large Real-Life Study. J Pharm Pract. 2021;34: 365–371. doi: 10.1177/0897190019869158 [DOI] [PubMed] [Google Scholar]
  • 27.Gomides APM, De Albuquerque CP, Santos ABV, Bértolo MB, Júnior PL, Giorgi RDN, et al. Rheumatoid artrhitis treatment in Brazil: Data from a large real-life multicenter study. Adv Rheumatol. 2020;60: 1–7. doi: 10.1186/s42358-020-0119-z [DOI] [PubMed] [Google Scholar]
  • 28.Gomides APM, de Albuquerque CP, Santos ABV, Amorim RBC, Bértolo MB, Júnior PL, et al. Causes of synthetic disease-modifying drug discontinuation in rheumatoid arthritis: Data from a large real-life cohort. PLoS One. 2019;14: 1–7. doi: 10.1371/journal.pone.0213219 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Guimarães MFBR, Da Costa Pinto MR, Resende GG, MacHado CJ, Vargas-Santos AB, Vargas-Amorim RBC, et al. Discordance between the patient’s and physician’s global assessment in rheumatoid arthritis: Data from the REAL study-Brazil. Navarini L, editor. PLoS One. 2020;15: 1–12, e0230317. doi: 10.1371/journal.pone.0230317 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Fransen J. Remission in rheumatoid arthritis: agreement of the disease activity score (DAS28) with the ARA preliminary remission criteria. Rheumatology. 2004;43: 1252–1255. doi: 10.1093/rheumatology/keh297 [DOI] [PubMed] [Google Scholar]
  • 31.Baker JF, Conaghan PG, Smolen JS, Aletaha D, Shults J, Emery P, et al. Development and Validation of Modified Disease Activity Scores in Rheumatoid Arthritis: Superior Correlation With Magnetic Resonance Imaging-Detected Synovitis and Radiographic Progression. Arthritis Rheumatol. 2014;66: 794–802. doi: 10.1002/art.38304 [DOI] [PubMed] [Google Scholar]
  • 32.Aletaha D, Smolen JS. Achieving clinical remission for patients with rheumatoid arthritis. JAMA—Journal of the American Medical Association. 2019. pp. 457–458. doi: 10.1001/jama.2018.21249 [DOI] [PubMed] [Google Scholar]
  • 33.Aga AB, Lie E, Uhlig T, Olsen IC, Wierød A, Kalstad S, et al. Time trends in disease activity, response and remission rates in rheumatoid arthritis during the past decade: Results from the NOR-DMARD study 2000–2010. Ann Rheum Dis. 2015;74: 381–388. doi: 10.1136/annrheumdis-2013-204020 [DOI] [PubMed] [Google Scholar]
  • 34.Navarro-Compán V, Gherghe AM, Smolen JS, Aletaha D, Landewé R, van der Heijde D. Relationship between disease activity indices and their individual components and radiographic progression in RA: a systematic literature review. Rheumatology (Oxford). 2014; 1–14. doi: 10.1093/rheumatology/keu413 [DOI] [PubMed] [Google Scholar]
  • 35.Fleischmann R, van der Heijde D, Koenig AS, Pedersen R, Szumski A, Marshall L, et al. How much does Disease Activity Score in 28 joints ESR and CRP calculations underestimate disease activity compared with the Simplified Disease Activity Index? Ann Rheum Dis. 2015;74: 1132–1137. doi: 10.1136/annrheumdis-2013-204920 [DOI] [PubMed] [Google Scholar]
  • 36.Aletaha D, Nell VP, Stamm T, Uffmann M, Pflugbeil S, Machold K, et al. Acute phase reactants add little to composite disease activity indices for rheumatoid arthritis: validation of a clinical activity score. Arthritis Res Ther. 2005;7: 796–806. doi: 10.1186/ar1740 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Medeiros MMDC, De Oliveira BMGB, De Cerqueira JVM, Quixadá RTDS, De Oliveira ÍMX. Correlação dos índices de atividade da artrite reumatoide (Disease Activity Score 28 medidos com VHS, PCR, Simplified Disease Activity Index e Clinical Disease Activity Index) e concordância dos estados de atividade da doença com vários pontos de corte nu. Rev Bras Reumatol. 2015;55: 1–8. doi: 10.1016/j.rbr.2014.12.005 [DOI] [PubMed] [Google Scholar]
  • 38.Fleischmann RM, van der Heijde D, Gardiner P V, Szumski A, Marshall L, Bananis E. DAS28-CRP and DAS28-ESR cut-offs for high disease activity in rheumatoid arthritis are not interchangeable. [cited 20 Jun 2018]. doi: 10.1136/rmdopen-2016-000382 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Aletaha D, Smolen JS. Remission in rheumatoid arthritis: missing objectives by using inadequate DAS28 targets. Nat Rev Rheumatol. 2019;15: 633–634. doi: 10.1038/s41584-019-0279-6 [DOI] [PubMed] [Google Scholar]
  • 40.Aletaha D, Smolen JS. Joint damage in rheumatoid arthritis progresses in remission according to the Disease Activity Score in 28 joints and is driven by residual swollen joints. Arthritis Rheum. 2011;63: 3702–3711. doi: 10.1002/art.30634 [DOI] [PubMed] [Google Scholar]
  • 41.Dhaon P, Das SK, Srivastava R, Dhakad U. Performances of Clinical Disease Activity Index (CDAI) and Simplified Disease Activity Index (SDAI) appear to be better than the gold standard Disease Assessment Score (DAS-28-CRP) to assess rheumatoid arthritis patients. Int J Rheum Dis. 2017. [cited 25 Jan 2018]. doi: 10.1111/1756-185X.13110 [DOI] [PubMed] [Google Scholar]
  • 42.Hodkinson B, Musenge E, Tikly M. Tight control of rheumatoid arthritis in a resource-constrained setting: A randomized controlled study comparing the clinical disease activity index and simplified disease activity index. Rheumatol (United Kingdom). 2015;54: 1033–1038. doi: 10.1093/rheumatology/keu443 [DOI] [PubMed] [Google Scholar]
  • 43.Aletaha D, Ward MM, Machold KP, Nell VPK, Stamm T, Smolen JS. Remission and active disease in rheumatoid arthritis: Defining criteria for disease activity states. Arthritis Rheum. 2005;52: 2625–2636. doi: 10.1002/art.21235 [DOI] [PubMed] [Google Scholar]
  • 44.Kumar BS, Suneetha P, Mohan A, Kumar DP, Sarma KVS. Comparison of disease activity score in 28 joints with ESR (DAS28), clinical disease activity index (CDAI), health assessment questionnaire disability index (HAQ-DI) & routine assessment of patient index data with 3 measures (RAPID3) for assessing disease. Indian J Med Res. 2017;146: 57–62. doi: 10.4103/ijmr.IJMR_701_15 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Padovano I, Costantino F, Breban M, D’Agostino MA. Prevalence of ultrasound synovial inflammatory findings in healthy subjects. Ann Rheum Dis. 2016;75: 1819–1823. doi: 10.1136/annrheumdis-2015-208103 [DOI] [PubMed] [Google Scholar]
  • 46.Hammer HB, Terslev L. Role of Ultrasound in Managing Rheumatoid Arthritis. Curr Rheumatol Rep. 2012;14: 438–444. doi: 10.1007/s11926-012-0266-2 [DOI] [PubMed] [Google Scholar]
  • 47.D’Agostino M, Boers M, Wakefield RJ, Emery P, Conaghan PG. Is it time to revisit the role of ultrasound in rheumatoid arthritis management? Ann Rheum Dis. 2017;76: 7–8. doi: 10.1136/annrheumdis-2016-210453 [DOI] [PubMed] [Google Scholar]
  • 48.Caporali R, Smolen JS. Back to the future: forget ultrasound and focus on clinical assessment in rheumatoid arthritis management. Ann Rheum Dis. 2017; annrheumdis-2017-211458. doi: 10.1136/annrheumdis-2017-211458 [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

All relevant data are within the paper.


Articles from PLoS ONE are provided here courtesy of PLOS

RESOURCES