Abstract
Objectives
To compare the Vasculitis Damage Index (VDI) with the Combined Damage Assessment Index (CDA) as measures of damage from vasculitis.
Methods
A total of 283 patients with vasculitis from 11 European centres were evaluated in a cross-sectional study using the VDI and CDA.
Results
Wegener’s granulomatosis (58.4%) and microscopic polyangiitis (11.0%) were the most common diagnoses. Agreement between VDI and CDA scores (Spearman’s correlation) was 0.90 (95% CI 0.87 to 0.92). There was good correlation between individual comparably evaluated organ systems (Spearman’s correlation 0.70–0.94). Interobserver reliability (assessed by intraclass correlation coefficient (ICC)) was 0.94 (95% CI 0.89 to 0.98) for VDI and 0.78 (95% CI 0.63 to 0.93) for CDA. Intraobserver reliability was 0.92 (95% CI 0.83 to 1.00) for VDI and 0.87 (95% CI 0.75 to 1.00) for CDA. A total of 13 items were not used in the VDI compared to 23 in the CDA. Observers agreed that the CDA covered the full spectrum of damage attributable to vasculitis but was more time consuming and thus possibly less feasible for clinical and research purposes.
Conclusions
The VDI and CDA capture reliable data on damage among patients with vasculitis. The CDA captures more detail but is more complex and less practical than the VDI. Further evolution of damage assessment in vasculitis is likely to include key elements from both instruments.
INTRODUCTION
The prognosis for a patient with systemic vasculitis has improved with treatment.1–6 However, the long-term outlook is characterised by morbidity from recurrent flares, low-grade grumbling disease and/or accumulation of damage from previous disease activity or treatment.6–9 Systematic recording and quantification of damage allows recording of the natural history of the disease, provides distinction from disease activity and can be used as an outcome measure for clinical trials.10
The Vasculitis Damage Index (VDI) is a validated11 method for measuring damage sustained from vasculitis or its treatment. It was developed by consensus by a group of vasculitis experts and is widely used in clinical trials.4,12–14 However, the VDI may not adequately capture all damage caused by small and medium vessel vasculitis or treatment.10 A group of international experts in vasculitis from Europe and the USA constructed a new tool to measure damage called the Combined Damage Assessment Index (CDA). It is based on the VDI,10 and includes additional items of damage that were recorded in the Wegener’s Granulomatosis Etanercept Trial (WGET) but not captured by individual items on the VDI.9,10
The VDI comprises 64 items grouped into 11 categories. The CDA has 135 individual items in 17 categories, and includes some bilaterality for items involving the eyes and ears; 8 items assign gradation. The VDI and the CDA measure damage that has occurred since the onset of vasculitis; pre existing comorbidity is not counted.
The Outcome Measures in Rheumatology (OMERACT) filter consists of the following criteria. (1) Truth: does it measure what it intends to measure? (2) Discrimination: does it discriminate from situations of interest? (3) Feasibility: can the measure be easily applied given the constraints of time, money and interpretability?15
The objective of this study was to: (1) compare the performance of the CDA to the VDI in a cross-sectional study of patients with vasculitis, (2) begin to evaluate the CDA with respect to the OMERACT filter and (3) review the use of individual items in VDI and CDA.
METHODS
Consecutive patients (inpatient and outpatients) with new or existing diagnoses of vasculitis were recruited from 11 European centres. Local medical ethics requirements were met by each participating site. Participants gave their written informed consent before participating in the study.
Basic demographics, type of vasculitis, duration of disease, C reactive protein (CRP) and anti-neutrophil cytoplasmic antibody (ANCA) results were obtained on each patient. Patients were assessed for disease activity using the Birmingham Vasculitis Activity Score version 3 (BVAS v3)16 and disease damage using the VDI and CDA by an observer at each site (total of 11 observers). All forms were completed in English. For the purpose of this study any damage scored had to be present following the onset of vasculitis and be present for at least 3 months. The total VDI score and the total CDA score are each represented by the cumulative number of items that are recorded, respectively. The VDI and CDA scores can stay the same or worsen over time, but cannot improve. Each item in CDA or VDI contributes 1 point to the total score.17
Convergent validity measures the extent to which assessments that are theoretically related to each other are actually related. In this case VDI and CDA should be closely correlated. Convergent validity was assessed by comparing overall VDI and CDA scores as well as individual organ scores. To evaluate discrimination we assessed the relationship between the damage assessment tools with the BVAS v3, CRP and ANCA result. In addition, interobserver and intraobserver reliability was investigated. A total of 28 (9.9%) patients were scored by 2 different observers at the same time point and 14 (4.9%) by the same observer at 2 different time points within 3 months of each other. This was the total number achieved during the study and not specifically chosen, but our expectation was that using trained observers would demonstrate good agreement based on previous experience with the VDI.11
In addition to real patients, a VDI and CDA were completed on up to 20 different paper cases by an independent group of specialist doctors, fellows and research nurses with an interest in vasculitis. The paper cases were used to assess feasibility only. The paper cases were designed on real cases seen by RL and CM but modified in order to encompass the range of items recorded in the VDI and CDA. The observers were provided with written instructions on how to complete the assessment. All observers who completed a CDA and a VDI on patients or paper cases were invited to complete a feasibility questionnaire for each of the damage assessment tools. The feasibility questionnaire was a series of 10 statements or questions that the respondents had to rate or answer on a 4-point Likert scale.
We identified unused items in VDI from the current study and combined data published on damage assessment in the WGET trial9 and from unpublished 5-year follow-up results from the European Vasculitis Study Group (EUVAS) cohorts4,13,18,19 to provide a large sample of patients to determine the potential redundancy of VDI items.
Statistical analysis
Stata V.10, (StataCorp, College Station Texas, USA) was used for analysis. The distributions of the BVAS v3, VDI and CDA scores were not normally distributed so we used a nonparametric approach based on ranks to measure their correlation. Spearman’s rank correlation coefficient was calculated by independently ranking the VDI and CDA scores, then calculating the Pearson correlation between the ranks rather than the original measurements. We used the intraclass correlation coefficient (ICC) to calculate interobserver and intraobserver reliability for overall VDI and CDA scores. This method estimates the average correlation between all possible orderings of pairs and was calculated using a one-way analysis of variance. To assess interobserver reliability between observers for each of the categories in the VDA and CDA a linear-weighted κ statistic was calculated, in which observed and expected proportions of agreement are modified to include partial agreements by assigning a weight between 0 (complete disagreement) and 1 (complete agreement) to each category. The 17 subcategories of the CDA were collapsed into the same 11 categories of the VDI for this analysis.
RESULTS
A total of 283 patients (51% women, 49% men) with vasculitis were evaluated. Disease duration ranged from 0 to 480 months. A summary of the range of diagnosis, VDI and CDA scores and disease duration is shown in table 1. Wegener’s granulomatosis (58.4%) and microscopic polyangiitis (11.0%) were the most common diagnoses. The remaining patients were a mixture of other primary and secondary vasculitis. The scores ranged from 0 to 12 for the VDI and 0 to 26 for the CDA, with the largest range seen in patients with Wegener’s granulomatosis with renal involvement. Table 2 shows organ system involvement as recorded by each of the damage tools. Of the 192 patients with a disease duration of at least 12 months, 170 (89%) had some damage recorded on the VDI compared to 176 (92%) on the CDA (as determined by a score >0 on each tool, respectively).
Table 1.
Diagnosis | n (%) | Median disease duration in months (range) | VDI median score (range) | CDA median score (range) | BVAS v3 median score (range) |
---|---|---|---|---|---|
Wegener’s granulomatosis (with renal involvement) | 104 (36.8) | 36 (0–396) | 2 (0–12) | 4 (0–26) | 1 (0–36) |
Wegener’s granulomatosis (without renal involvement) | 61 (21.6) | 60 (1–300) | 3 (0–8) | 4 (0–21) | 1 (0–39) |
Microscopic polyangiitis | 31 (11.0) | 18.5 (0–252) | 2 (0–7) | 3 (0–12) | 0 (0–25) |
Churg–Strauss syndrome | 24 (8.5) | 38 (2–240) | 3 (0–12) | 3 (0–15) | 2 (0–22) |
Other vasculitis* | 17 (6.0) | 20.5 (0–228) | 1 (0–9) | 2 (0–16) | 2 (0–17) |
Henoch–Schönlein purpura | 11 (3.9) | 39 (2–360) | 1 (0–5) | 1 (0–11) | 2 (0–15) |
Mixed essential cryoglobulinaemia | 11 (3.9) | 49 (3–420) | 2 (0–6) | 4.5 (0–10) | 6.5 (0–26) |
Behçet’s disease | 9 (3.2) | 60 (7–480) | 3 (0–7) | 5 (1–8) | 4 (0–18) |
Takayasu’s arteritis | 7 (2.5) | 109 (36–264) | 3 (0–4) | 4 (0–7) | 0 (0–4) |
Isolated skin vasculitis | 4 (1.4) | 20.5 (4–78) | 0 (0–4) | 0.5 (0–9) | 3.5 (2–5) |
Polyarteritis nodosa (not HBV associated) | 2 (0.7) | 160 (114–206) | 0.5 (0–1) | 1 (0–2) | 0.5 (0–1) |
Systemic rheumatoid vasculitis | 2 (0.7) | 40 (32–48) | 1.5 (1–2) | 2 (2–2) | 1 (1–1) |
Other vasculitis comprised of: ANCA positive vasculitis not fitting any specific diagnosis (four patients); unspecified small vessel vasculitis (three patients); CNS vasculitis (three patients); not further specified (two patients); SLE vasculitis (one patient); giant cell arteritis (one patient); hypocomplementemic urticarial vasculitis (one patient), drug-induced vasculitis (one patient), Goodpasture’s syndrome (one patient).
ANCA, anti-neutrophil cytoplasmic antibody; BVAS v3, Birmingham Vasculitis Activity Score version 3; CDA, Combined Damage Assessment Index; CNS, central nervous system; HBV, hepatitis B virus; SLE, systemic lupus erythematosus; VDI, Vasculitis Damage Index.
Table 2.
Score | Frequency of organ damage as determined by VDI, n (%) | Median VDI score (range) for each organ | Frequency of organ damage as determined by CDA, n (%) | Median CDA score (range) for each organ | Spearman’s rank correlation coefficient for total score in each organ system (95% CI) |
---|---|---|---|---|---|
Total score | 213 (76.6) | 2 (0–12) | 212 (76.3) | 3 (0–26) | 0.90 (0.87 to 0.92) |
Musculoskeletal | 46 (16.6) | 0 (0–3) | 45 (16.2) | 0 (0–4) | 0.86 (0.83 to 0.89) |
Skin/mucous membranes* | 20 (7.2) | 0 (0–3) | 76 (27.3) | 0 (0–4) | 0.47 (0.38 to 0.56) |
Ocular | 46 (16.6) | 0 (0–3) | 52 (18.7) | 0 (0–6) | 0.94 (0.93 to 0.96) |
ENT† | 110 (39.6) | 0 (0–5) | 108 (38.9) | 0 (0–13) | 0.89 (0.86 to 0.91) |
Pulmonary | 42 (15.1) | 0 (0–3) | 43 (15.5) | 0 (0–3) | 0.94 (0.92 to 0.95) |
Cardiovascular | 50 (18.0) | 0 (0–3) | 67 (24.1) | 0 (0–5) | 0.77 (0.72 to 0.82) |
Peripheral vascular disease | 13 (4.7) | 0 (0–3) | 20 (7.2) | 0 (0–4) | 0.81 (0.77 to 0.85) |
Gastrointestinal | 1 (0.4) | 0 (0–1) | 2 (0.7) | 0 (0–1) | 0.71 (0.64 to 0.76) |
Renal | 61 (21.9) | 0 (0–3) | 67 (24.1) | 0 (0–7) | 0.89 (0.86 to 0.91) |
Neuropsychiatric‡ | 74 (26.6) | 0 (0–2) | 92 (33.1) | 0 (0–4) | 0.75 (0.70 to 0.80) |
Endocrine | NA | NA | 30 (10.8) | 0 (0–2) | |
Haematology/oncology§ | NA | NA | 4 (1.4) | 0 (0–1) | |
Other¶ | 59 (21.2) | 0 (0–2) | 69 (24.8) | 0 (0–2) |
The p value for all Spearman’s correlations is less than 0.001.
The main reason for discrepancy is the inclusion of skin bruising and scaring on the CDA; items not present on the VDI. When these two items were removed from the analysis the Spearman’s ρ was 0.70 (95% CI 0.64 to 0.76).
ENT is composed of four separate categories on the CDA: ears, nose, sinuses and subglottic stenosis.
More than 80% of this organ system involvement was accounted for by peripheral neuropathy.
Haematology and oncology items are captured under ‘other’ in the VDI.
Weight gain >10 lbs/4.4 kg was the main item captured under ‘other’ on the CDA (14.8%). Weight gain is not present as an individual item on the VDI. CDA, Combined Damage Assessment Index; ENT, ear, nose and throat; VDI, Vasculitis Damage Index.
Convergent validity
Measurements taken in an individual patient on the same date for VDI and CDA scores were paired together. In instances where more than one paired observation was available in a single patient (ie, patients assessed twice to calculate interobserver or intraobserver reliability), one of the paired observations was randomly chosen. For the total VDI and CDA scores there was a high positive correlation (ρ=0.90, p<0.001); a graphical representation of this is shown in figure 1. There was a high positive correlation between the organ system scores, except for ‘skin/mucous membrane’, where there was a moderate correlation (ρ=0.47, p<0.001). When the two skin-related items found in CDA but not VDI, ‘easy bruising’ (15.8% of patients) and ‘cutaneous scarring’ (9.0%) in the CDA, were removed from the analysis, the correlation was 0.70 (p<0.001). A complete list of the correlations between the organ systems between the VDI and CDA is provided in table 2.
Discrimination
The correlation (Spearman’s ρ) with BVAS 2003 was −0.17 (95% CI −0.28 to −0.05) and −0.19 (95% CI −0.30 to −0.07); CRP −0.09 (95% CI −0.21 to 0.04) and −0.12 (95% CI −0.24 to 0.01); ANCA −0.26 (95% CI −0.45 to −0.06) and −0.32 (95% CI −0.49 to −0.12), for VDI and CDA, respectively. This shows that there was no correlation between the two measures of disease damage with measures of disease activity or items considered unrelated to disease damage.
Reliability
The interobserver reliability using the ICC was 0.94 (95% CI 0.89 to 0.98) for the VDI and 0.78 (95% CI 0.63 to 0.93) for the CDA. The interobserver reliability was better for patients with short compared with long disease duration: ICC was 0.99 (95% CI 0.97 to 1.00) and 0.87 (95% CI 0.74 to 0.99) for disease duration ≤3 years versus 0.90 (95% CI 0.79 to 1.0) and 0.67 (95% CI 0.33 to 1.0) for disease duration >3 years on the VDI and CDA, respectively. Observations for intraobserver reliability were restricted to patients who were reassessed by the same observer within 3 months (14 patients for the VDI, 15 patients the CDA). The intraobserver reliability was 0.92 (95% CI 0.83 to 1.00) for the VDI and 0.87 (95% CI 0.75 to 1.00) for the CDA. There were not enough patients to determine intraobserver reliability stratified by disease duration. The κ statistics for the individual systems for interobserver and intraobserver reliability (table 3) demonstrated fair to good agreement, although CIs were wide due to small numbers (only 3/28 patients had any items recorded in the musculoskeletal system). No individual musculoskeletal item could account for the wide CIs.
Table 3.
Organ system | Interobserver reliability, κ (95% CI)
|
Intraobserver reliability, κ (95% CI)
|
||
---|---|---|---|---|
VDI (n=28 paired observations) | CDA (n=28 paired observations) | VDI (n=14 paired observations) | CDA (n=15 paired observations) | |
Musculoskeletal | 0.65 (0.02 to 1.00) | 0.65 (0.02 to 1.00) | – | – |
Skin/mucous membrane | 0.78 (0.59 to 1.00) | 0.59 (0.32 to 0.83) | 1.00 (1.00 to 1.00) | 0.41 (0.00 to 0.65) |
Ocular | 1.00 | 1.00 | 1.00 (1.00 to 1.00) | 1.00 (1.00 to 1.00) |
ENT | 0.77 (0.46 to 1.00) | 0.59 (0.23 to 0.84) | 0.79 (0.46 to 1.00) | 0.78 (0.50 to 0.96) |
Pulmonary | 1.00 | 0.78 (0.37 to 1.00) | 1.00 (1.00 to 1.00) | 0.76 (0.32 to 1.00) |
Cardiovascular | 0.83 (0.60 to 1.00) | 0.63 (0.42 to 0.84) | 1.00 (1.00 to 1.00) | 0.77 (−0.07 to 1.00) |
Peripheral vascular | 1.00 | 0.31 (−0.82 to 1.00) | – | – |
Gastrointestinal | – | – | – | – |
Renal | 0.80 (0.19 to 1.00) | 0.70 (0.40 to 0.88) | 0.82 (0.45 to 1.00) | 0.45 (0.00 to 0.88) |
Neuropsychiatric | 0.52 (0.11 to 0.92) | 0.46 (0.00 to 0.92) | 0.76 (0.32 to 1.00) | 0.58 (0.07 to 1.00) |
1.00, complete agreement; –, No patients had damage in this organ system; CDA, Combined Damage Assessment Index; ENT, ear, nose and throat; VDI, Vasculitis Damage Index.
The use of individual items
Table 4 shows the 10 most commonly used items for each of the damage assessment tools. The items mainly comprised upper respiratory tract, renal, auditory features and peripheral neuropathy (in keeping with Wegener’s granulomatosis being the most common diagnosis). Items frequently used in the CDA, but not captured by the VDI were easy skin bruising (15.8%), weight gain >10 lbs/4.4 kg (14.8%) and cutaneous scarring (9.0%). Due to the increase number of options for recording damage on the CDA this has resulted in discrepancy in scoring items on the CDA compared to the VDI. For example, the proportion of patients with glomerular filtration rate <50% is different between the two assessment tools, primarily because there are other options on the CDA for recording renal impairment.
Table 4.
VDI | % | CDA | % |
---|---|---|---|
Nasal blockage/crusting | 22.3 | Chronic rhinitis/crusting | 26.6 |
Peripheral neuropathy | 21.9 | Hypertension* | 21.6 |
Hearing loss | 19.1 | Sensory neuropathy† | 21.6 |
Hypertension | 16.6 | Proteinuria <3 g/24 h | 17.6 |
Proteinuria | 16.6 | Easy bruising | 15.8 |
GFR<50% | 15.1 | Weight gain >10 lbs/4 kg | 14.8 |
Osteoporosis | 11.9 | Conductive hearing loss | 13.7 |
Chronic sinusitis | 11.5 | GFR<50% | 13.3 |
Nasal bridge collapse | 9.7 | Chronic kidney disease | 12.6 |
Cataract | 9.0 | Osteoporosis | 12.6 |
This includes patients with prehypertension, or stage 1 or stage 2 hypertension.
Includes patients with mild, moderate or severe sensory neuropathy.
CDA, Combined Damage Assessment Index; GFR, glomerular filtration rate; VDI, Vasculitis Damage Index.
A total of 13 items of damage were not used in the VDI; 11 additional items were used less than 1% of the time. In comparison, the CDA had 23 items of damage, 4 gradations of severity and 2 items attributing causality that were not used. There were an additional 45 items that were used less than 1% of the time. Table 5 shows a list of the least used items in both damage tools.
Table 5.
Items not used | Items used <1% |
---|---|
VDI: | |
Second episode fresh loss of pulses in one limb*† | Deforming/erosive arthritis* |
Second cerebrovascular accident* | Cardiomyopathy |
Blindness other eye | Claudication |
Chronic peritonitis*† | Gut infarction/resection |
Major psychosis*† | Major tissue loss† |
Mesenteric insufficiency/pancreatitis* | Marrow failure |
Minor tissue loss | Myocardial infarction* |
Oesophageal stricture/upper GI surgery*† | Pleural fibrosis |
Osteomyelitis† | Pulmonary infarction |
Pericarditis ≥3 months/pericardectomy*† | Seizures*† |
Pulmonary hypertension† | Transverse myelitis* |
Subsequent major tissue loss*† | |
Subsequent myocardial infarction*† | |
CDA: | |
Auricular cartilage deformity left | Auricular cartilage deformity right |
Cervical cancer | Bladder cancer |
Cholesteatoma left | Continuous oxygen dependency |
Cholesteatoma right | Gangrene with permanent tissue loss |
Chronic peritonitis | Gut infarction/resection |
Haematopoetic malignancy | Hepatic fibrosis |
Mesenteric insufficiency/pancreatitis | Impaired fasting glucose |
Myelodysplastic syndrome | Optic nerve oedema left |
Oesophageal stricture/surgery | Pericarditis or pericardiectomy |
Optic nerve oedema right | Pleural fibrosis |
Osteomyelitis | Pseudotumour left eye |
Percutaneous coronary intervention | Pseudotumour right eye |
Pulmonary hypertension | Pulmonary infarction |
Refractory cytopenia | Retinal artery occlusion left |
Retinal artery occlusion right | Retinal changes left |
Retinal vein occlusion right | Retinal vein occlusion left |
Scleral perforation left | Scleral thinning left |
Scleral perforation right | Scleral thinning right |
Second cerebrovascular accident | Second episode of absent pulses in one limb |
Subsequent major tissue loss | Tissue loss (includes major and minor) |
Third degree AV block | |
Transverse myelitis | |
Vena caval filter |
For VDA, items used <1%. For CDA, items used <0.05%
Items not used in the WGET trial cohort, n=180 patients.9
Items not used in the long-term follow-up (5 year VDI) of the EUVAS cohorts, n=339 patients (EUVAS trial physicians, unpublished results).
AV, atrioventricular; CDA, Combined Damage Assessment Index; EUVAS, European Vasculitis Study Group; GI, gastrointestinal; VDI, Vasculitis Damage Index; WGET, Wegener’s Granulomatosis Etanercept Trial.
Redundant items on the VDI
Combining our study population with the WGET trial and patients with 5 years of follow-up in the EUVAS cohorts represent a total of 804 patients. The following seven items of damage were not used in the VDI in this combined population: second episode of fresh loss of pulses in one limb, chronic peritonitis, major psychosis, oesophageal stricture/upper gastrointestinal surgery, pericarditis ≥3 months/pericardectomy, subsequent major tissue loss and subsequent myocardial infarction.
Feasibility
In all, 12 observers completed the feasibility questionnaire (including 7/11 observers who scored the VDI and CDA in real patients and 5 who completed paper cases only). The five observers who completed the paper cases only were new users to both tools. Completion time was 5–10 min (range: <5–10 min) for VDI compared to 10–15 min (<5–20 min) for CDA. Experienced users completed both assessments in <5 min. In all, 10 observers (83%) reported that the VDI and CDA were useful to record the natural history of vasculitis. All observers stated that the CDA covered the full spectrum of damage attributable to vasculitis compared to 7/12 (58%) for the VDI. In all, 8 (67%) observers said that the VDI was a practical tool for clinical use compared to 5/12 (42%) for the CDA; however, only 7/12 (58%) and 3/12 (25%), respectively, would use it in clinical practice. Nine (75%) observers found the VDI easy to complete compared to five (42%) for the CDA. All observers stated that the VDI was a useful tool to measure outcomes in clinical trials whereas two disagreed with this statement for the CDA. Overall preference for the tools was mixed; 8/12 (67%) favoured the VDI. The CDA was preferred by some experienced observers, especially by those individuals who could complete both tools in a similar timeframe.
DISCUSSION
Damage assessment represents the permanent cumulative burden of disease morbidity from vasculitis or its treatment. It records the disease course, identifies the manifestations that do not warrant further immunosuppressive treatment and serves as an outcome measure in clinical trials.17 Both tools evaluated in this study serve this function well but have contrasting benefits and drawbacks.
The level of damage detected is consistent with previous reports; 89% of patients with at least 12 months of disease duration had ≥1 item of damage captured by VDI and 92% by CDA. This compares to 89% in the WGET trial.9 A Norwegian study of Wegener’s granulomatosis showed 100% of patients having damage by the end of follow-up (mean 4.7 years)20; and a UK series with systemic vasculitis demonstrated 96% with a VDI score of ≥1 by the end of follow-up (mean 6.1 years).21 The median disease duration of 39 months in this study may have been too short to detect some items of damage such as malignancy which was recorded in only 1.4% of patients. However, the relationship between vasculitis and malignancy is complex.8,22–25
The advantages of the VDI are that it is simple to complete, has very good reliability and is a widely accepted outcome measure in clinical trials,4,9,13 with proven prognostic value. A score ≥1 at diagnosis predicts increased mortality and future organ damage.20 The VDI was preferred by the majority of observers in this study, mainly due to its relative simplicity, especially by less experienced users, which is of key importance if it is to be used infrequently in clinical practice. However, the main application of the VDI is in clinical trials, where it functions as a generic damage assessment tool for all types of vasculitis, thereby enabling widespread use, which facilitates familiarity, accuracy and completion speed.
The CDA is intended for use in clinical trials of ANCA associated vasculitis. The CDA is more comprehensive than the VDI, and may be more sensitive in detecting damage. In addition, the ranges of scores are larger and may be better at detecting change, although this was not tested in the current study. The CDA takes longer to complete than the VDI in less experienced observers, but the difference was minimal among experienced investigators. In a clinical trial setting where more investment in training is available and there is less time pressure, the increased level of data capture by the CDA may be more desirable. There is disagreement among experts as to whether or not we should move towards disease-specific assessment tools in vasculitis clinical trials (ie, whether specific forms should be used for specific types of vasculitis, or if VDI could apply to types of vasculitis).10,26 The benefit of increased sensitivity of a disease-specific tool such as the CDA has to be balanced against more limited application (ie, confined to use only in ANCA vasculitis). In addition, if multiple tools are developed for different forms of vasculitis, it reduces the ability for comparison between broadly similar conditions. Ultimately it may be useful to discuss a damage form that has a generic component and a specific component.
Gradations of severity and weighting of items are not adequately captured by existing damage tools. Intuitively, some forms of damage or gradations of severity may have more impact on a patient’s quality of life or prognosis than others. The future weights applied to individual items on the CDA or VDI should improve the correlation between mortality and quality of life.17 Efforts are underway to address this.27 In addition, there are redundant items in both tools; the seven unused items on the VDI (from WGET and EUVAS studies) could be omitted from any future damage tools that are specific for ANCA associated vasculitis in order to simplify the forms. Even if these items are removed from the main form, they will be retained in the glossary under ‘other items’ so these less common items can be recorded and contribute to the index. However, unused items such as cardiomyopathy or loss of pulses may be important for some diseases (eg, Takayasu’s disease) therefore should be retained in generic damage assessment tools.
There are limitations in this study. Study observers were already familiar with the VDI from previous clinical or trial experience whereas for most investigators, this study was the first time they used the CDA. This may explain the lower interobserver and intraobserver reliability of the CDA. Further training and more experience with the CDA could improve its reliability and acceptability. The current study is cross-sectional, and therefore cannot demonstrate changes to the CDA over time. Grading severity of individual items and allowing resolution of items may influence its correlation with quality of life indices and mortality. The classification of patients with less well defined forms of disease is difficult and there may be overlap between the categories listed in table 1. This is the real-life setting and therefore inclusion of these heterogeneous patients allows for the generalisability of our results.
In summary, this is the first study to test the CDA as a measure of damage in vasculitis. We have started evaluating the CDA with respect to the OMERACT filter, but more experience, especially in a longitudinal setting is required. The VDI remains the standard for damage assessment in vasculitis, and this study further validates its use. If there is move toward disease-specific damage assessment, then future revisions including a weighting system are likely to serve as outcome measures for trials in ANCA associated vasculitis.
Supplementary Material
Acknowledgments
We thank Drs M Chan, A Miller, J Robson, A Soni and R Waller, for completing paper cases and answering the feasibility questionnaire. RS was supported by the Rose Hellaby Medical Scholarship, New Zealand. CM received support from the European League Against Rheumatism via a project grant held by RL. AJ was supported by NIHR BRU Musculoskeletal Research Group, University of Oxford. DRWJ was supported by the Cambridge Biomedical Research Centre. MAL was supported by a HEFCE new blood Senior Lecturer grant.
Funding This study was substantially funded by a project grant from the European League Against Rheumatism (EULAR) with additional support from the US National Institutes of Health (grants U54 RR019497, U54AR057319 and U01 AR1874).
Footnotes
Competing interests None.
Ethics approval Local ethics requirements were met by each of the 11 sites.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplementary materials are published online only. To view these files please visit the journal online (http://ard.bmj.com).
References
- 1.Zeek PM. Periarteritis nodosa; a critical review. Am J Clin Pathol. 1952;22:777–90. doi: 10.1093/ajcp/22.8.777. [DOI] [PubMed] [Google Scholar]
- 2.Godman GC, Churg J. Wegener’s granulomatosis: pathology and review of the literature. AMA Arch Pathol. 1954;58:533–53. [PubMed] [Google Scholar]
- 3.Guillevin L, Mahr A, Cohen P, et al. Short-term corticosteroids then lamivudine and plasma exchanges to treat hepatitis B virus-related polyarteritis nodosa. Arthritis Rheum. 2004;51:482–7. doi: 10.1002/art.20401. [DOI] [PubMed] [Google Scholar]
- 4.Jayne DR, Gaskin G, Rasmussen N, et al. Randomized trial of plasma exchange or high-dosage methylprednisolone as adjunctive therapy for severe renal vasculitis. J Am Soc Nephrol. 2007;18:2180–8. doi: 10.1681/ASN.2007010090. [DOI] [PubMed] [Google Scholar]
- 5.Jayne D. Challenges in the management of microscopic polyangiitis: past, present and future. Curr Opin Rheumatol. 2008;20:3–9. doi: 10.1097/BOR.0b013e3282f370d1. [DOI] [PubMed] [Google Scholar]
- 6.Mukhtyar C, Flossmann O, Hellmich B, et al. Outcomes from studies of anti-neutrophil cytoplasm antibody associated vasculitis: a systematic review by the European League Against Rheumatism systemic vasculitis task force. Ann Rheum Dis. 2008;67:1004–10. doi: 10.1136/ard.2007.071936. [DOI] [PubMed] [Google Scholar]
- 7.Gayraud M, Guillevin L, le Toumelin P, et al. Long-term followup of polyarteritis nodosa, microscopic polyangiitis, and Churg-Strauss syndrome: analysis of four prospective trials including 278 patients. Arthritis Rheum. 2001;44:666–75. doi: 10.1002/1529-0131(200103)44:3<666::AID-ANR116>3.0.CO;2-A. [DOI] [PubMed] [Google Scholar]
- 8.Guillevin L, Jarrousse B, Lok C, et al. Longterm followup after treatment of polyarteritis nodosa and Churg-Strauss angiitis with comparison of steroids, plasma exchange and cyclophosphamide to steroids and plasma exchange. A prospective randomized trial of 71 patients. The cooperative study group for polyarteritis nodosa. J Rheumatol. 1991;18:567–74. [PubMed] [Google Scholar]
- 9.Seo P, Min YI, Holbrook JT, et al. Damage caused by Wegener’s granulomatosis and its treatment: prospective data from the Wegener’s granulomatosis etanercept trial (WGET) Arthritis Rheum. 2005;52:2168–78. doi: 10.1002/art.21117. [DOI] [PubMed] [Google Scholar]
- 10.Seo P, Luqmani RA, Flossmann O, et al. The future of damage assessment in vasculitis. J Rheumatol. 2007;34:1357–71. [PubMed] [Google Scholar]
- 11.Exley AR, Bacon PA, Luqmani RA, et al. Development and initial validation of the vasculitis damage index for the standardized clinical assessment of damage in the systemic vasculitides. Arthritis Rheum. 1997;40:371–80. doi: 10.1002/art.1780400222. [DOI] [PubMed] [Google Scholar]
- 12.Etanercept plus standard therapy for Wegener’s granulomatosis. N Engl J Med. 2005;352:351–61. doi: 10.1056/NEJMoa041884. [DOI] [PubMed] [Google Scholar]
- 13.Jayne D, Rasmussen N, Andrassy K, et al. A randomized trial of maintenance therapy for vasculitis associated with antineutrophil cytoplasmic autoantibodies. N Engl J Med. 2003;349:36–44. doi: 10.1056/NEJMoa020286. [DOI] [PubMed] [Google Scholar]
- 14.Langford CA, Talar-Williams C, Barron KS, et al. Use of a cyclophosphamide-induction methotrexate-maintenance regimen for the treatment of Wegener’s granulomatosis: extended follow-up and rate of relapse. Am J Med. 2003;114:463–9. doi: 10.1016/s0002-9343(03)00077-9. [DOI] [PubMed] [Google Scholar]
- 15.Boers M, Brooks P, Strand CV, et al. The OMERACT filter for outcome measures in Rheumatology. J Rheumatol. 1998;25:198–9. [PubMed] [Google Scholar]
- 16.Flossmann O, Bacon P, de Groot K, et al. Development of comprehensive disease assessment in systemic vasculitis. Ann Rheum Dis. 2007;66:283–92. doi: 10.1136/ard.2005.051078. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Merkel PA, Herlyn K, Mahr AD, et al. Progress towards a core set of outcome measures in small-vessel vasculitis. Report from OMERACT 9. J Rheumatol. 2009;36:2362–8. doi: 10.3899/jrheum.090373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.de Groot K, Harper L, Jayne DR, et al. Pulse versus daily oral cyclophosphamide for induction of remission in antineutrophil cytoplasmic antibody-associated vasculitis: a randomized trial. Ann Intern Med. 2009;150:670–80. doi: 10.7326/0003-4819-150-10-200905190-00004. [DOI] [PubMed] [Google Scholar]
- 19.De Groot K, Rasmussen N, Bacon PA, et al. Randomized trial of cyclophosphamide versus methotrexate for induction of remission in early systemic antineutrophil cytoplasmic antibody-associated vasculitis. Arthritis Rheum. 2005;52:2461–9. doi: 10.1002/art.21142. [DOI] [PubMed] [Google Scholar]
- 20.Koldingsnes W, Nossent H. Predictors of survival and organ damage in Wegener’s granulomatosis. Rheumatology (Oxford) 2002;41:572–81. doi: 10.1093/rheumatology/41.5.572. [DOI] [PubMed] [Google Scholar]
- 21.Exley AR, Carruthers DM, Luqmani RA, et al. Damage occurs early in systemic vasculitis and is an index of outcome. QJM. 1997;90:391–9. doi: 10.1093/qjmed/90.6.391. [DOI] [PubMed] [Google Scholar]
- 22.Faurschou M, Sorensen IJ, Mellemkjaer L, et al. Malignancies in Wegener’s granulomatosis: incidence and relation to cyclophosphamide therapy in a cohort of 293 patients. J Rheumatol. 2008;35:100–5. [PubMed] [Google Scholar]
- 23.Knight A, Askling J, Granath F, et al. Urinary bladder cancer in Wegener’s granulomatosis: risks and relation to cyclophosphamide. Ann Rheum Dis. 2004;63:1307–11. doi: 10.1136/ard.2003.019125. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Koldingsnes W, Gran JT, Omdal R, et al. Wegener’s granulomatosis: long-term follow-up of patients treated with pulse cyclophosphamide. Br J Rheumatol. 1998;37:659–64. doi: 10.1093/rheumatology/37.6.659. [DOI] [PubMed] [Google Scholar]
- 25.Wooten MD, Jasin HE. Vasculitis and lymphoproliferative diseases. Semin Arthritis Rheum. 1996;26:564–74. doi: 10.1016/s0049-0172(96)80044-8. [DOI] [PubMed] [Google Scholar]
- 26.Merkel PA, Seo P, Aries P, et al. Current status of outcome measures in vasculitis: focus on Wegener’s granulomatosis and microscopic polyangiitis. Report from OMERACT 7. J Rheumatol. 2005;32:2488–95. [PubMed] [Google Scholar]
- 27.Seo P, Jayne D, Luqmani R, et al. Assessment of damage in vasculitis: expert ratings of damage. Rheumatology (Oxford) 2009;48:823–7. doi: 10.1093/rheumatology/kep103. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.