Abstract
Background
Cartilage morphometry based on magnetic resonance images (MRIs) is an emerging outcome measure for clinical trials among patients with knee osteoarthritis (KOA). However, current methods for cartilage morphometry take many hours per knee and require extensive training on the use of the associated software. In this study we tested the feasibility, reliability, and construct validity of a novel osteoarthritis cartilage damage quantification method (Cartilage Damage Index [CDI]) that utilizes informative locations on knee MRIs.
Methods
We selected 102 knee MRIs from the Osteoarthritis Initiative that represented a range of KOA structural severity (Kellgren Lawrence [KL] Grade 0 – 4). We tested the intra- and inter-tester reliability of the CDI and compared the CDI scores against different measures of severity (radiographic joint space narrowing [JSN] grade, KL score, joint space width [JSW]) and static knee alignment, both cross-sectionally and longitudinally.
Results
Determination of the CDI took on average14.4 minutes (s.d. 2.1) per knee pair (baseline and follow-up of one knee). Repeatability was good (intra- and inter-tester reliability: intraclass correlation coefficient >0.86). The mean CDI scores related to all four measures of osteoarthritis severity (JSN grade, KL score, JSW, and knee alignment; all p values < 0.05). Baseline JSN grade and knee alignment also predicted subsequent 24-month longitudinal change in the CDI (p trends <0.05). During 24 months, knees with worsening in JSN or KL grade (i.e. progressors) had greater change in CDI score.
Conclusions
The CDI is a novel knee cartilage quantification method that is rapid, reliable, and has construct validity for assessment of medial tibiofemoral osteoarthritis structural severity and its progression. It has the potential to addresses the barriers inherent to studies requiring assessment of cartilage damage on large numbers of knees, and as a biomarker for knee osteoarthritis progression.
Keywords: Osteoarthritis, Cartilage, Quantitative measurements, Informative locations, Magnetic resonance imaging
Background
Measurement of hyaline cartilage damage is viewed as a primary endpoint in the assessment of structural progression of knee osteoarthritis (OA). However, the traditional radiographic measurement approach provides only indirect visualization of cartilage and is limited by poor reproducibility and sensitivity to change [1]. Magnetic resonance (MR) imaging is a noninvasive technology that can generate 3-dimensional images of intra-articular soft-tissue structures, including hyaline cartilage. Quantification of knee cartilage morphology (e.g., thickness, volume) is highly reliable and provides potential surrogate endpoints for epidemiologic studies and clinical trials of interventions with potential for structure modification [2-6]. However, the process of measuring cartilage morphology on MR images is time-consuming and burdensome. Each 3-dimensional (3D) knee MR sequence may take many hours for a reader to manually segment. Furthermore, operators who use cartilage segmentation software often need extensive training [7] which further contributes to the time and cost.
Over the past decade, researchers have deployed several approaches to reduce the burden of measuring knee cartilage on MR images. These have included segmenting alternate MR slices or confining measurements to partial regions of cartilage [8-10]. Computer-aided algorithms (e.g., active contours, B-splines) have also been developed to assist with cartilage segmentation [11-15]. Unfortunately, these methods lack sufficient accuracy and reliability to detect small cartilage changes [2]. Thus, there remains a need among researchers for a quantification method that can be rapidly computed and has good reproducibility, validity, and sensitivity to change.
The work in this paper is motivated by the observation that some articular cartilage locations are more susceptible to occurrence of OA damage and thus may be more informative in the measurement of its progression [16,17]. Thus, focusing effort on measuring these locations in a reproducible manner may improve the efficiency and sensitivity to change. Therefore, the goal of this study was to develop an efficient cartilage quantification method leveraging informative locations in the medial tibia and femur, and to test its reliability, construct validity, and sensitivity to change. We focused on the medial tibiofemoral compartment because medial OA is more common than lateral OA [18,19].
Methods
Rapid knee cartilage damage index quantification method
We developed a rapid knee cartilage damage quantification method using knee MR images from three datasets (263 knees). Underlying this methodology is a 2-dimensional, rectangular, universal coordinate systems to represent the articular surface of the distal femur and proximal tibia. Using previously manually segmented knees [20], we projected the denuded cartilage area on our coordinate system to identify the areas in the joint surface that are most frequently denuded of cartilage. Based on the results of that analysis, we then selected nine locations within the region of the most commonly denuded areas on the medial femur and tibia (Figure 1). A full description of the developmental methodology and related data is provided in the Additional file 1.
Validation dataset
For this validation study we used data and MR images from the Osteoarthritis Initiative (OAI), which was initiated to promote the evaluation of OA biomarkers as potential surrogate endpoints [4]. The OAI has institutional review board approval (IRB) from the coordinating centers and the four clinical centers (University of Maryland and John’s Hopkins comprise a single recruitment center, Brown University, Ohio State University, University of Pittsburgh). All participants provided informed consent to participate in the OAI. The four OAI clinical centers recruited approximately 4800 men and women (ages 45–79 years) with or at risk for knee OA. The OAI participants had weight-bearing posterior-anterior fixed-flexion knee radiographs obtained at the baseline and 24-month visits. We obtained a convenience sample of 102 pairs of knee (baseline and 24-month MR scans) not included in our developmental datasets that had complete data (i.e., clinical, static knee alignment, semi-quantitative radiographic grading, and joint space width). We selected our sample to represent the range of radiographic OA severity (Kellgren-Lawrence [KL] scores 0 to 4) enriched with knees that showed radiographic worsening over time. We randomly selected 40 knees with KL = 2, among whom 20 knees had worsening of their KL grade over 24 months, and 20 knees that did not. We also randomly included 35 knees with KL = 3, among whom 15 knees increased KL grade over 24 months and 20 knees did not change. We included all of the knees with KL grades 0, 1, and 4 that had complete data and were not included in our developmental datasets.
MR image assessments
Our validation analyses used the OAI 3D sagittal water-excitation dual-echo steady state (DESS) images with field of view = 140 mm, slice thickness = 0.7 mm, skip = 0 mm, flip angle = 25 degrees, echo time = 4.7 ms, recovery time = 16.3 ms, 307 × 384 matrix, phase encode ant/post. X resolution = 0.365 mm, and y resolution = 0.456 mm. All OAI images were obtained using one of four identical Siemens Trio 3-Tesla MR systems and a USA Instruments quadrature transmit-receive knee coil at one of four OAI clinical sites [21]. The OAI MR images are publicly available upon request at http://oai.epi-ucsf.org.
Measurement of cartilage damage on MR images
One investigator (MZ), who was blinded to the outcome measures, performed the CDI measurement on paired baseline and 24-month follow-up MR images. The investigator was not blinded to the order of images (baseline or follow-up). The investigator used customized software to (1) translate an articular surface into a 2-dimensional coordinate matrix, (2) localize 9 pre-defined informative locations (characterized by a greater propensity to exhibit cartilage loss), and (3) measure cartilage thickness at those locations (Figure 1). To co-locate the corresponding informative locations on baseline and follow-up images, we used dual screens to permit simultaneous visual comparison of the MR image sets.In the first step the reader indicated the most medial and lateral MR image slices within the knee. These images designated the minimum and maximum values of the medial-to-lateral axis on the 2-dimensional coordinate system. Next, the software automatically determined the MR image slices that contained the informative locations. On each of these slices the investigator manually traced the bone-cartilage boundary using predefined segmentation rules. The software then translated the length of the bone-cartilage boundary to a standardized anterior-to-posterior axis and indicated the predefined informative locations so that the investigator could measure the cartilage thickness at those points (Figure 2). The software then computed the cartilage damage index (CDI) by summing the products of cartilage thickness, cartilage length (anterior-posterior), and voxel size from each informative location.
Assessment of reliability
To evaluate the intra- and inter-tester reliability we selected 20 pairs of knees (baseline and follow-up MR scans) representative of a full range of disease severity in the sample. Two investigators (MZ and DH) independently measured the CDI on two occasions, separated by at least 72 hours. We evaluated intra-tester and inter-tester reliability with intraclass correlation coefficients (ICC) [22]. Specifically, we used an ICC 3,1 model for intra-tester reliability and an ICC 2,1 model for inter-tester reliability. To explore if the reliability was consistent across levels of OA severity we conducted secondary analyses to explore ICCs among knees with no-mild medial joint space narrowing (JSN; medial JSN score = 0 or 1; n = 13) and more severe medial JSN (JSN score = 2 or 3; n = 7). We selected this JSN cut-point because it provided a sufficient sample size in each group to estimate ICCs.
Assessment of measurement time
We recorded the measurement time for 20 pairs of knees (baseline and follow-up MR scans) and calculated the mean and standard deviation time to measure the 20 knees. The investigator started the timer when he started to load the MR images and stopped the timer after saving the quantification data.
Radiographic assessments
To assess construct validity of the CDI we compared it with three radiographic measures of knee OA (JSN, KL grade, and JSW), that have been extensively reported in the past to be associated with cartilage damage [23-27]. The semi-quantitative and quantitative knee radiographic measurements have been previously described in detail [6,28-30]. Briefly, semi-quantitative assessments of radiographic knee OA severity were performed using the weight-bearing posterior-anterior fixed-flexion knee radiographs from the baseline and 24-month OAI visit. The central readers determined semi-quantitative scores [6] for KL grade and modified OARSI-atlas based assessment of medial JSN scores (0 to 3), which defined definite progression within an OARSI grade [31]. KL progression was defined as any worsening of the KL score from 0 to 24 months. A different group performed central measurements of joint space width (JSW) at fixed-locations in the medial tibiofemoral compartment. We selected JSW at one fixed location (x = 0.250) because it is one of the most responsive locations for assessing JSW change [28]. These data and descriptions of the methods are publicly available on the OAI website (kxr_sq_bu_00 [version 0.5] and kxr_sq_bu_03 [version 3.5], kxr_qjsw_duryea_00 [version 0.5] and kxr_qjsw_duryea_03 [version 3.4]; http://oai.epi-ucsf.org/; ICC > 0.93).
Static alignment
To further assess construct validity of the CDI we tested its association with static knee alignment, a well-established risk factor for medial cartilage damage [23,27,32,33]. One reader measured static alignment, hip-knee-ankle (HKA) angle on standing full-limb radiographs that were collected at either the 12- or 24-month OAI visit using a semi-automated program (developed by Jeff Duryea, ICC > 0.99).
Analytic approach
We calculated descriptive characteristics for the sample. To account for different skeletal sizes, we adjusted the CDI by dividing the raw data by the participant’s height. Change in height-adjusted CDI was calculated as follow-up minus baseline. To explore the construct validity of the new cartilage quantification method we tested for a linear trend of baseline and change in CDI across higher baseline grades of JSN and KL. Linear trend was tested using linear regression and treating JSN and KL grades as continuous variables. We also used independent sample t-tests to determine if CDI change was different between knees with and without radiographic OA progression (based on changes in JSN and KL grades). Spearman correlations were used to assess the relationship between baseline and change in CDI to static alignment, baseline and 24-month change of JSW. P-values < 0.05 were considered statistically significant. To assess responsiveness among knees with and without radiographic OA progression we calculated absolute standardized response mean (SRM) values (SRM = mean change divided by standard deviation of change). All analyses were performed in SAS 9.3 (SAS Institute Inc., Cary, NC) with the exception of the ICCs, which were performed in SPSS 19 (IBM Co., NY).
Results
Validation dataset characteristics
The descriptive characters of 102 participants are in Table 1. There were 25 knees with medial JSN progression (different JSN grade at baseline and follow-up) and 39 knees with KL progression (different KL grade at baseline and follow-up). The overall SRMs for the CDI were −0.78 in the medial femur, −0.64 in the medial tibia, and −0.87 in the medial tibiofemoral compartment.
Table 1.
Age, mean (SD) years | 61.61 (8.74) | |
---|---|---|
Female, n (%) |
56 (54.37) |
|
JSN grade, n (%) |
Baseline |
24-month follow-up |
0 |
43 (42.16) |
42 (41.18) |
1 |
31 (30.39) |
25 (24.51) |
2 |
25 (24.51) |
20 (19.61) |
3 |
3 (2.94) |
15 (14.71) |
KL score, n (%) |
Baseline |
24-month follow-up |
0 |
4 (3.92) |
3 (2.94) |
1 |
19 (18.63) |
15 (14.71) |
2 |
40 (39.22) |
25 (24.51) |
3 |
34 (33.33) |
40 (39.22) |
4 | 5 (4.90) | 19 (18.63) |
Note: n = number; SD = standard derivation; JSN = joint space narrowing; KL = Kellgren-Lawrence.
Measurement time
The average CDI measurement time of 20 knees was 14.4 minutes (SD = 2.1) per pair of knees (baseline and 24 month scans).
Assessment of reliability
Intra-tester (ICC3,1) reliability for both investigators ranged from 0.94 to 0.99. The good intra-tester reliability was consistent among knees with no-mild medial JSN (ICC3,1 = 0.93 to 0.99) and more severe JSN (ICC3,1 = 0.80 to 0.99). Inter-tester (ICC2,1) reliability for medial femur, medial tibia, and total medial tibiofemoral ranged from 0.86 to 0.95. The good inter-tester reliability was consistent among knees with no-mild medial JSN (ICC2,1 = 0.78 to 0.92) and more severe JSN (ICC2,1 = 0.87 to 0.93).
Relationship of baseline CDI to baseline radiographic severity
Medial JSN
Knees with greater JSN score (i.e. greater OA severity) had lower mean medial femur, tibia, and tibiofemoral CDIs (indicating more cartilage damage; Table 2, all p for linear trend < 0.01).
Table 2.
|
Baseline medial JSN Grade |
||||
---|---|---|---|---|---|
Cartilage measure | JSN = 0 (n = 43) mean (SD) | JSN = 1 (n = 31) mean (SD) | JSN = 2 (n = 25) mean (SD) | JSN = 3 (n = 3) mean (SD) | p-value for trend |
|
Cross-sectional |
||||
Femur CDI (Baseline) |
825.14 (148.42) |
754.71 (125.54) |
529.29 (130.35) |
325.89 (324.51) |
<0.01 |
Tibia CDI (Baseline) |
352.29 (72.47) |
328.96 (60.91) |
233.45 (68.77) |
95.83 (99.73) |
<0.01 |
Tibiofemoral CDI (Baseline) |
1177.40 (198.78) |
1083.70 (173.17) |
762.74 (183.50) |
421.72 (420.65) |
<0.01 |
|
Longitudinal |
||||
Femur CDI (Change) |
−31.06 (46.40) |
−49.67 (61.65) |
−78.55 (66.81) |
−185.4 (170.07) |
<0.01 |
Tibia CDI (Change) |
−12.17 (25.16) |
−23.27 (33.83) |
−46.18 (52.46) |
−42.41 (41.07) |
<0.01 |
Tibiofemoral CDI (Change) | −43.23 (57.65) | −72.94 (76.02) | −124.70 (97.47) | −227.80 (208.59) | <0.01 |
Notes: change = follow-up minus baseline; SD = standard deviation.
JSW measurement
The baseline medial femur, tibia, and tibiofemoral CDI scores were significantly correlated with baseline JSW (Table 3; all p < 0.05).
Table 3.
Spearman correlation | ||
---|---|---|
|
HKA |
JSW baseline |
Femur CDI (Baseline) |
0.34* |
0.84* |
Tibia CDI (Baseline) |
0.21* |
0.77* |
Tibiofemoral CDI (Baseline) |
0.31* |
0.87* |
HKA JSW change | ||
Femur CDI (Change) |
0.29* |
0.30* |
Tibia CDI (Change) |
0.34* |
0.40* |
Tibiofemoral CDI (Change) | 0.36* | 0.43* |
Notes: *p < 0.05; HKA = hip-knee-ankle; JSW = joint space width change = follow-up minus baseline.
KL grade
There was generally a lower CDI across increasing KL, with the exception that knees with KL grade 2 had a greater CDI compared to those with KL grade 1 (Table 4, all p for linear trend < 0.01).
Table 4.
Cartilage measure | KL = 0 (n = 4) mean (SD) | KL = 1 (n = 19) mean (SD) | KL = 2 (n = 40) mean (SD) | KL = 3 (n = 34) mean (SD) | KL = 4 (n = 5) mean (SD) | p-value for trend |
---|---|---|---|---|---|---|
|
Cross-sectional |
|||||
Femur CDI (Baseline) |
771.99 (157.40) |
750.75 (159.50) |
781.47 (114.73) |
634.00 (218.90) |
583.92 (434.01) |
<0.01 |
Tibia CDI (Baseline) |
363.07 (103.74) |
314.96 (60.46) |
343.96 (66.72) |
272.83 (94.26) |
199.81 (163.56) |
<0.01 |
Tibiofemoral CDI (Baseline) |
1135.1 (257.41) |
1065.7 (207.06) |
1125.4 (155.11) |
906.83 (304.59) |
783.73 (595.54) |
<0.01 |
|
Longitudinal |
|||||
Femur CDI (Change) |
−81.06 (46.06) |
−30.35 (43.25) |
−36.72 (59.38) |
−72.92 (62.13) |
−109.4 (159.37) |
0.02 |
Tibia CDI (Change) |
−56.37 (43.48) |
−17.85 (32.13) |
−15.14 (26.74) |
−35.36 (49.33) |
−30.86 (33.75) |
0.40 |
Tibiofemoral CDI (Change) | −137.40 (80.56) | −48.19 (61.81) | −51.86 (69.27) | −108.30 (90.93) | −140.20 (190.81) | 0.03 |
Notes: change = follow-up minus baseline; SD = standard deviation.
Knee alignment
Baseline CDI was positively associated with baseline static knee alignment (Table 3). In other words, a lower CDI was associated with varus alignment.
Relationship of longitudinal change in CDI to baseline radiographic severity
Medial JSN
Knees with greater baseline JSN score generally had greater subsequent change in the CDI (reflecting greater longitudinal cartilage loss; Table 2, all p for linear trend < 0.01). This trend plateaued at JSN = 2 for change in tibia CDI, but increased in a linear fashion for femur and tibiofemoral CDI change.
KL grade
There were less pronounced linear trends of change in the femur and tibiofemoral CDI across baseline KL scores. There was not a statistically significant trend found for change in tibia CDI (Table 4).
Knee alignment
There was a statistically significant relationship between longitudinal CDI over 24 months and baseline static alignment (Table 3); all p < 0.05, such that those with more varus alignment had more medial cartilage damage longitudinally.
Relationship of longitudinal change in CDI to longitudinal change in radiographic severity
Medial JSN and KL grades
Knees with radiographic progression over the 24 month observation period, as indicated by an increase in JSN or KL grade, had greater change in CDI scores compared with knees with no progression (Table 5). The SRM values for the CDI among knees with JSN or KL change (i.e. those with structural progression) were 12% to 300% greater than knees without JSN or KL change (e.g., SRM = −1.39 for tibia JSN progression knees; SRM = −0.45 for tibia JSN non-progression knees).
Table 5.
|
Joint Space Narrowing (JSN) |
||||||||
---|---|---|---|---|---|---|---|---|---|
|
No structural progression |
Structural progression |
p-value |
||||||
n | Mean | SD | SRM | n | Mean | SD | SRM | ||
Femur CDI (Change) |
74 |
−35.73 |
50.14 |
−0.71 |
25 |
−87.82 |
68.62 |
−1.28 |
<0.0001 |
Tibia CDI (Change) |
74 |
−10.86 |
23.99 |
−0.45 |
25 |
−63.83 |
46.02 |
−1.39 |
<0.0001 |
Tibiofemoral CDI (Change) |
74 |
−46.58 |
57.48 |
−0.81 |
25 |
−151.7 |
90.95 |
−1.67 |
<0.0001 |
|
Kellgren-Lawrence (KL) |
||||||||
|
No structural progression |
Structural progression |
p-value |
||||||
|
n |
Mean |
SD |
SRM |
n |
Mean |
SD |
SRM |
|
Femur CDI (Change) |
58 |
−40.53 |
49.84 |
−0.81 |
39 |
−64.06 |
70.06 |
−0.91 |
0.060 |
Tibia CDI (Change) |
58 |
−15.86 |
33.21 |
−0.48 |
39 |
−37.23 |
43.34 |
−0.86 |
0.007 |
Tibiofemoral CDI (Change) | 58 | −56.39 | 64.12 | −0.88 | 39 | −101.3 | 96.68 | −1.05 | 0.007 |
Notes: Structural Progression, JSN/KL has different grade at baseline and follow- up; N = number of knees (the numbers were excluded JSN = 3 and KL = 4 since both of them are the highest grade, no grade change happens); SD = standard deviation; SRM = standardized response mean.
JSW measurement
The 24-month change of medial femur, tibia, and tibiofemoral CDI scores were significantly correlated with 24-month change of JSW (Table 3; all p < 0.05)
Discussion
This study demonstrates that the MR-based CDI can be rapidly and reliably applied in the medial tibiofemoral compartment, and has construct validity as an aggregate measure of cartilage damage in knee OA. The predicate of the development of the CDI was that a focus on locations that have increased susceptibility to cartilage loss would shorten measurement time and increase sensitivity to change [16,34], a notion that our results appear to corroborate. As a method that can be rapidly deployed, it offers the potential to address the current barriers that measuring OA cartilage damage on large numbers of knee MR images. With apparently good discriminative validity for worsening of knee OA structural severity, it may also have usefulness as a proxy biomarker of OA progression.
We found that the CDI can be measured in the medial tibiofemoral compartment by a trained technician within about 14 minutes for a pair of knee images. While future development of the methodology will need to expand the CDI into the lateral tibiofemoral and patellofemoral compartments, the total measurement time will likely remain substantially shorter than for other MR-based cartilage measurement methods.
We tested the construct validity of the CDI by comparing it with other established radiographic measures of knee OA severity including medial tibiofemoral JSN (a semi-quantitative scale), JSW (continuous), KL grade (a global semi-quantitative score), and knee alignment. Radiographic JSN and JSW are generally attributed to loss of articular cartilage among knees with OA [35]. One study found that knees with JSN = 2 and JSN = 3 have 27% and 56% less cartilage thickness in the central medial tibiofemoral region compared with a contralateral knee with no JSN [23]. While we only used 18 informative locations, our CDI detected a similar trend with 35% and 64% less medial tibiofemoral CDI among knees with JSN = 2 and 3 (Table 2) compared with knees without JSN. Furthermore, prior studies have found similar correlations to ours for medial JSW and medial tibiofemoral cartilage morphology (r = 0.46 to 0.71) [27,36,37] and changes in these measures (r = 0.21 to 0.48) [24,25]. Overall, we consistently found relationships between the CDI and the severity of radiographic OA except that knees with KL grade 2 had a greater baseline CDI and less apparent progression compared with those with KL grade 1 (i.e., suggesting less damage; Table 4). However, others have observed that knees with KL grade 2 often have thicker cartilage and less cartilage loss, which is attributed it to cartilage swelling -- an early feature of cartilage damage [26,27]. Despite the CDI being based on only 18 locations, these informative locations are sufficient to calculate a CDI that agrees with pre-established associations between cartilage damage and radiographic OA severity.
In addition to verifying that the CDI was associated with radiographic OA severity we also demonstrated that the CDI is related to knee alignment (baseline CDI: r = 0.21 to 0.33, CDI change: r = 0.29 to 0.36), which is a strong risk factor for knee OA progression [27,32]. Our correlations are comparable to other MR-based cartilage measures (cross-sectional r = 0.20 to 0.22; change in cartilage r = 0.10 to 0.40) [23,33]. These findings further support that not only is the CDI associated with other measures of disease severity but also an important risk factor.
In a recent meta-analysis of articular cartilage quantitative assessments that provided SRMs to reflect responsiveness, measures of the medial tibia had SRMs that ranged from −0.63 to −0.34, medial femur: −0.74 to −0.28, and medial tibiofemoral: −1.26 to −0.46 [38]. The SRMs for the CDI (Table 5) were comparable to those reported in this recent systematic review. This was true even among knees without structural progression with the exception of the medial tibia. These findings suggest that the CDI performs well on cartilage measurements; however, additional studies are needed to directly compare these methods.
There are a number of limitations to our study including that that the 3D DESS sequence in the OAI utilized a low flip angle of 25°, which is not optimal for contrasting fluid and cartilage signal [39]. However, the OAI DESS sequence is well validated [4,40], and has been successfully used to measure cartilage volume many studies using traditional manual segmentation methods [4,23,26,41-44]. Therefore, the OAI was a reasonable data set in which to develop the CDI measurement and it is quite possible that the CDI may perform even better in other data sets. Another limitation to our study was that our validation data set did not include total cartilage segmentation values. The CDI, however, was developed using manual cartilage segmentation (see Additional file 1) where we found a good correlation (r > 0.60, Additional file 1: Table S3) between baseline CDI and cartilage volume (manual segmentation). It may be advantageous to test the association between CDI and manual segmentation in a different dataset to verify that the CDI is related to cartilage volume beyond the OAI. Another limitation was that we did not quantify the accuracy of placing the informative locations. We believe that the placement of informative locations on baseline and follow-up images was accurate because we used a robust coordinate system, trained the reader to detect errors, found good construct validity, and detected large measures of responsiveness. Future studies should quantify the accuracy of placing the informative locations and strive to minimize any error since this may further enhance the performance of the CDI. We would also point out that at present the CDI is only applicable to the medial tibiofemoral compartment. However, findings from this study reinforce the need to propagate the CDI approach to the lateral tibiofemoral and patellofemoral compartments. Finally, a potential drawback to the CDI is the possibility of failing to quantify cartilage damage at locations that were not identified as informative locations. This limitation is similar to other approaches that focus on specific regions of the articular surface (e.g., central weight-bear medial femur) [8-10]. Despite this limitation, the CDI performed well in these analyses, which may suggest that only a small number of knees, if any, experience considerable cartilage damage in regions not covered by the informative locations.
Conclusions
In summary, this cartilage-damage quantification method, which is based on informative locations, is relatively easy to implement, provides reliable measurements, has good construct and discriminative validity, and is sensitive to change in the state of osteoarthritis. This method has the potential to address the current barriers that measuring OA cartilage damage on large numbers of knee MR images, such as the Osteoarthritis Initiative and other large epidemiologic investigations. Furthermore, with apparently good discriminative validity for worsening of knee OA structural severity, it may also have usefulness as a proxy biomarker of OA progression.
Abbreviations
3D: 3-dimensional; CDI: Cartilage damage index; DESS: Dual-echo steady state; HKA: Hip-knee-ankle; ICC: Intraclass correlation coefficients; JSN: Joint space narrowing; JSW: Joint space width; KL: Kellgren Lawrence; MR: Magnetic resonance; MRIs: Magnetic resonance images; OA: Osteoarthritis; OAI: Osteoarthritis initiative; SD: Standard derivation; SRM: Standardized response mean.
Competing interests
The authors have no competing interests that could potentially and inappropriately influence this work.
Authors’ contributions
MZ participated in the conception and design of the study, acquisition of data, analysis, interpretation of data, drafting/revisions of the article, as well as final approval of the article. JBD participated in the conception and design of the study, acquisition of data, analysis and interpretation of data, drafting/revisions of the article, as well as final approval of the article. LLP participated in the conception and design, acquisition of data, analysis, interpretation of data, drafting/revisions of the article, as well as final approval of the article. DH participated in intra- and inter-tester reliability test. GHL participated in interpretation of data, drafting/revisions of the article, as well as final approval of the article.. EM participated in the conception and design, drafting/revisions of the article, as well as final approval of the article. RW participated in developing the cartilage segmentation rule, drafting/revisions of the article, as well as final approval of the article. TEM participated in the conception and design, analysis and interpretation of data, drafting/revisions of the article, as well as final approval of the article. All authors read and approved the final manuscript.
Pre-publication history
The pre-publication history for this paper can be accessed here:
Supplementary Material
Contributor Information
Ming Zhang, Email: mzhang@tuftsmedicalcenter.org.
Jeffrey B Driban, Email: Jeffrey.Driban@tufts.edu.
Lori Lyn Price, Email: lprice1@tuftsmedicalcenter.org.
Daniel Harper, Email: dharper3@tuftsmedicalcenter.org.
Grace H Lo, Email: ghlo@bcm.edu.
Eric Miller, Email: elmiller@ece.tufts.edu.
Robert J Ward, Email: rward@tuftsmedicalcenter.org.
Timothy E McAlindon, Email: tmcalindon@tuftsmedicalcenter.org.
Acknowledgements
This work was supported in part by The Role of Bone in Knee Osteoarthritis Progression (NIH/NIAMS grant 1R01AR054938). The OAI is a public-private partnership comprised of five contracts (N01-AR-2-2258; N01-AR-2-2259; N01-AR-2-2260; N01-AR-2-2261; N01-AR-2-2262) funded by the National Institutes of Health, a branch of the Department of Health and Human Services, and conducted by the OAI Study Investigators. Private funding partners include Pfizer, Inc.; Novartis Pharmaceuticals Corporation; Merck Research Laboratories; and GlaxoSmithKline. Private sector funding for the OAI is managed by the Foundation for the National Institutes of Health.
There were 82 knees are from the progression subcohort having kindly been provided for public access by iMorphics (performed these image segmentations). Thanks John Lynch and Felix Liu for giving us the images. Jeffrey Duryea contributed to the JSW and HKA data.
References
- Roemer FW, Crema MD, Trattnig S, Guermazi A. Advances in imaging of osteoarthritis and cartilage. Radiology. 2011;260:332–354. doi: 10.1148/radiol.11101359. [DOI] [PubMed] [Google Scholar]
- Eckstein F, Wirth W. Quantitative cartilage imaging in knee osteoarthritis. Arthritis. 2011;2011:1–19. doi: 10.1155/2011/475684. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Frobell RB, Le Graverand MP, Buck R, Roos EM, Roos HP, Tamez-Pena J, Totterman S, Lohmander LS. The acutely ACL injured knee assessed by MRI: changes in joint fluid, bone marrow lesions, and cartilage during the first year. Osteoarthritis Cartilage. 2009;17:161–167. doi: 10.1016/j.joca.2008.06.020. [DOI] [PubMed] [Google Scholar]
- Eckstein F, Hudelmaier M, Wirth W, Kiefer B, Jackson R, Yu J, Eaton CB, Schneider E. Double echo steady state magnetic resonance imaging of knee articular cartilage at 3 Tesla: a pilot study for the Osteoarthritis Initiative. Ann Rheum Dis. 2006;65:433–441. doi: 10.1136/ard.2005.039370. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hernandez-Molina G, Guermazi A, Niu J, Gale D, Goggins J, Amin S, Felson DT. Central bone marrow lesions in symptomatic knee osteoarthritis and their relationship to anterior cruciate ligament tears and cartilage loss. Arthritis Rheum. 2008;58:130–136. doi: 10.1002/art.23173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Felson DT, Nevitt MC, Yang M, Clancy M, Niu J, Torner JC, Lewis CE, Aliabadi P, Sack B, Mcculloch C, Zhang Y. A new approach yields high rates of radiographic progression in knee osteoarthritis. J Rheumatol. 2008;34:2047–2054. [PMC free article] [PubMed] [Google Scholar]
- Jaremko JL, Cheng RW, Lambert RG, Habib AF, Ronsky JL. Reliability of an efficient MRI-based method for estimation of knee cartilage volume using surface registration. Osteoarthritis Cartilage. 2006;14:914–922. doi: 10.1016/j.joca.2006.03.004. [DOI] [PubMed] [Google Scholar]
- Steines D, Lang P. Book U.S. Patent 6,799,066. USA: United States Patent; 2004. U.S. Patent 6,799,066. [Google Scholar]
- Wirth W, Nevitt M, Hellio Le Graverand MP, Benichou O, Dreher D, Davies R, Lee J, Picha K, Gimona A, Maschek S, Hudelmaier M, Eckstein F. OAI investigators. Sensitivity to change of cartilage morphometry using coronal FLASH, sagittal DESS, and coronal MPR DESS protocols--comparative data from the Osteoarthritis Initiative (OAI. Osteoarthritis Cartilage. 2009;18:547–554. doi: 10.1016/j.joca.2009.12.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duryea J, Ratzlaff C, Iranpour-Boroujeni T, Collins J, Losina E, Vanwynngaarden C, Gu A. Responsiveness of a semi-automated novel method of measuring cartilage loss in knee osteoarthritis over two years using 3.0 T Dess 3D MRI. Osteoarthritis Cartilage. 2012;20:S54–S296. [Google Scholar]
- Cashman PMM, Kitney RI, Gariba MA, Carter ME. Automated techniques for visualization and mapping of articular cartilage in MR images of the osteoarthritic knee: a base technique for the assessment of microdamage and submicro damage. Trans NanoBioscience. 2002;1:42–51. doi: 10.1109/tnb.2002.806916. [DOI] [PubMed] [Google Scholar]
- Hussain ZT, Usha SS. Automated image processing and analysis of cartilage MRI: enabling technology for data mining applied to osteoarthritis. AIP Conference Proceedings. 2007. pp. 262–276. [DOI] [PMC free article] [PubMed]
- Vincent G, Wolstenholme C, Scott I, Bowes M. Fully Automatic Segmentation of the Knee Joint using Active Appearance Models. Medical Image Analysis for the Clinic: A Grand Challenge. 2010.
- Yin Y, Zhang X, Williams R, Wu X, Anderson D, Sonka M. LOGISMOS - Layered Optimal Graph Image Segmentation of Multiple Objects and Surfaces: cartilage segmentation in the knee joint. IEEE Trans Med Imaging. 2010;29:2023–2037. doi: 10.1109/TMI.2010.2058861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fripp J, Crozier S, Warfield S, Ourselin S. Automatic segmentation and quantitative analysis of the articular cartilages from magnetic resonance images of the knee. IEEE Trans Med Imaging. 2010;29:55–64. doi: 10.1109/TMI.2009.2024743. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Arno S, Walker PS, Bell CP, Krasnokutsky S, Samuels J, Abramson SB, Regatte R, Recht M. Relation between cartilage volume and meniscal contact in medial osteoarthritis of the knee. Knee. 2012;19:896–901. doi: 10.1016/j.knee.2012.04.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bae WC, Payanal MM, Chen AC, Hsieh-Bonassera ND, Ballard BL, Lotz MK, Coutts RD, Bugbee WD, Sah RL. Topographic patterns of cartilage lesions in knee osteoarthritis. Cartilage. 2010;1:10–19. doi: 10.1177/1947603509354991. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bennett LD, Buckland-Wright JC. Meniscal and articular cartilage changes in knee osteoarthritis: a cross-sectional double-contrast macroradiographic study. Rheumatology. 2002;41:917–923. doi: 10.1093/rheumatology/41.8.917. [DOI] [PubMed] [Google Scholar]
- Sharma L, Song J, Dunlop D, Felson D, Lewis CE, Segal N, Torner J, Cooke TD, Hietpas J, Lynch J, Nevitt M. Varus and valgus alignment and incident and progressive knee osteoarthritis. Ann Rheum Dis. 2010;69:1940–1945. doi: 10.1136/ard.2010.129742. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McAlindon T, LaValley M, Schneider E, Nuite M, Le J, Price L, Lo G, Dawson-Hughes B. Effect of vitamin D supplementation on progression of knee pain and cartilage volume loss in patients with symptomatic osteoarthritis: a randomized controlled trial. JAMA. 2012;309:155–162. doi: 10.1001/jama.2012.164487. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peterfy CG, Schneider E, Nevitt M. The osteoarthritis initiative: report on the design rationale for the magnetic resonance imaging protocol for the knee. Osteoarthritis Cartilage. 2008;16:1433–1441. doi: 10.1016/j.joca.2008.06.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Patrick ES, Joseph LF. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86:420–428. doi: 10.1037//0033-2909.86.2.420. [DOI] [PubMed] [Google Scholar]
- Eckstein F, Wirth W, Hudelmaier M, Stein V, Lengfelder V, Cahue S, Marshall M, Prasad P, Sharma L. Patterns of femorotibial cartilage loss in knees with neutral, varus, and valgus alignment. Arthritis Rheum. 2008;59:1563–1570. doi: 10.1002/art.24208. [DOI] [PubMed] [Google Scholar]
- Pelletier J-P, Raynauld J-P, Berthiaume M-J, Abram F, Choquette D, Haraoui B, Beary JF, Cline GA, Meyer JM, Martel-Pelletier J. Risk factors associated with the loss of cartilage volume on weight-bearing areas in knee osteoarthritis patients assessed by quantitative magnetic resonance imaging: a longitudinal study. Arthritis Res Ther. 2007;9:R74. doi: 10.1186/ar2272. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ding C, Garnero P, Cicuttini F, Scott F, Cooley H, Jones G. Knee cartilage defects: association with early radiographic osteoarthritis, decreased cartilage volume, increased joint surface area and type II collagen breakdown. Osteoarthritis Cartilage. 2005;13:198–205. doi: 10.1016/j.joca.2004.11.007. [DOI] [PubMed] [Google Scholar]
- Eckstein F, Wirth W, Hunter DJ, Guermazi A, Kwoh CK, Nelson DR, Benichou O. Magnitude and regional distribution of cartilage loss associated with grades of joint space narrowing in radiographic osteoarthritis–data from the Osteoarthritis Initiative (OAI) Osteoarthritis Cartilage. 2010;18:760–768. doi: 10.1016/j.joca.2009.12.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunter DJ, Zhang W, Conaghan PG, Hirko K, Menashe L, Li L, Reichmann WM, Losina E. Systematic review of the concurrent and predictive validity of MRI biomarkers in OA. Osteoarthritis Cartilage. 2011;19:557–588. doi: 10.1016/j.joca.2010.10.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duryea J, Zaim S, Genant HK. New radiographic-based surrogate outcome measures for osteoarthritis of the knee. Osteoarthritis Cartilage. 2003;11:102–110. doi: 10.1053/joca.2002.0866. [DOI] [PubMed] [Google Scholar]
- Neumann G, Hunter D, Nevitt M, Chibnik LB, Kwoh K, Chen H, Harris T, Satterfield S, Duryea J, Study HA. Location specific radiographic joint space width for osteoarthritis progression. Osteoarthritis Cartilage. 2009;17:761–765. doi: 10.1016/j.joca.2008.11.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Duryea J, Neumann G, Niu J, Totterman S, Tamez J, Dabrowski C, Graverand MPL, Luchi M, Beals CR, Hunter DJ. Comparison of radiographic joint space width with magnetic resonance imaging cartilage morphometry: analysis of longitudinal data from the Osteoarthritis Initiative. Arthritis Care Res. 2010;62:932–937. doi: 10.1002/acr.20148. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Altman RD, Gold GE. tlas of individual radiographic features in osteoarthritis, revised. Osteoarthritis Cartilage. 2007;15 Suppl A:A1–56. doi: 10.1016/j.joca.2006.11.009. [DOI] [PubMed] [Google Scholar]
- Sharma L, Song J, Felson TD, Cahue S, Shamiyeh E, Dunlop DD. The role of knee alignment in disease progression and functional decline in knee osteoarthritis. JAMA. 2001;286:188–195. doi: 10.1001/jama.286.2.188. [DOI] [PubMed] [Google Scholar]
- Cicuttini F, Wluka A, Hankin J, Wang Y. Longitudinal study of the relationship between knee angle and tibiofemoral cartilage volume in subjects withknee osteoarthritis. Rheumatol. 2004;43:321–324. doi: 10.1093/rheumatology/keh017. [DOI] [PubMed] [Google Scholar]
- Iranpour-Boroujeni T, Watanabe A, Bashtar R, Yoshioka H, Duryea J. Quantification of cartilage loss in local regions of knee joints using semi-automated segmentation software: analysis of longitudinal data from the Osteoarthritis Initiative (OAI) Osteoarthritis Cartilage. 2011;19:309–314. doi: 10.1016/j.joca.2010.12.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chan WP, Huang G-S, Hsu S-M, Chang Y-C, Ho W-P. Radiographic joint space narrowing in osteoarthritis of the knee: relationship to meniscal tears and duration of pain. Skeletal Radiol. 2008;37:917–922. doi: 10.1007/s00256-008-0530-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beattie KA, Duryea J, Pui M, O’Neill J, Boulos P, Webber CE, Eckstein F, Adachi JD. Minimum joint space width and tibial cartilage morphology in the knees of healthy individuals: A cross-sectional study. BMC Musculoskelet Disord. 2008;9:119. doi: 10.1186/1471-2474-9-119. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hunter D, Buck R, Vignon E, Eckstein F, Brandt K, Mazzuca SA, Wyman BT, Otterness I, Hellio Le Graverand MP. Relation of regional articular cartilage morphometry and meniscal position by MRI to joint space width in kneeradiographs. Osteoarthritis Cartilage. 2009;17:1170–1176. doi: 10.1016/j.joca.2009.04.001. [DOI] [PubMed] [Google Scholar]
- Hunter DJ, Zhang W, Conaghan PG, Hirko K, Menashe L, Reichmann WM, Losina E. Responsiveness and reliability of MRI in knee osteoarthritis: a meta-analysis of published evidence. Osteoarthritis Cartilage. 2011;19:589–605. doi: 10.1016/j.joca.2010.10.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Moriya S, Miki Y, Matsuno Y, Okada M. Three-dimensional double-echo steady-state (3D-DESS) magnetic resonance imaging of the knee: establishment of flip angles for evaluation of cartilage at 1.5 T and 3.0 T. Acta Radiol. 2012;53:790–794. doi: 10.1258/ar.2012.110532. [DOI] [PubMed] [Google Scholar]
- Roemer FW, Kwoh CK, Hannon MJ, Crema MD, Moore CE, Jakicic JM, Green SM, Guermazia A. Semiquantitative assessment of focal cartilage damage at 3 T MRI: A comparative study of dual echo at steady state (DESS) and intermediate-weighted (IW) fat suppressed fast spin echo sequences. Eur J Radiol. 2011;80:e126–e131. doi: 10.1016/j.ejrad.2010.07.025. [DOI] [PubMed] [Google Scholar]
- Bloecker K, Wirth W, Hunter DJ, Duryea J, Guermazi A, Kwoh CK, Resch H, Eckstein F. Contribution of regional 3D meniscus and cartilage morphometry by MRI to joint space width in fixed flexion knee radiography–a between-knee comparison in subjects with unilateral joint space narrowing. Eur J Radiol. 2013;82:e832–839. doi: 10.1016/j.ejrad.2013.08.041. [DOI] [PubMed] [Google Scholar]
- Wirth W, Nevitt M, Hellio Le Graverand MP, Lynch J, Maschek S, Hudelmaier M, Eckstein F. Group ftOII. Lateral and medial joint space narrowing predict subsequent cartilage loss in the narrowed, but not in the non-narrowed femorotibial compartment - data from the Osteoarthritis Initiative. Osteoarthritis Cartilage. 2013;S1063–4584:00984–00989. doi: 10.1016/j.joca.2013.10.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eckstein F, Maschek S, Maschek S. One year change of knee cartilage morphology in the first release of participants from the Osteoarthritis Initiative progression subcohort: association with sex, body mass index, symptoms and radiographic osteoarthritis status. Ann Rheum Dis. 2009;68:674–679. doi: 10.1136/ard.2008.089904. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bloecker K, Guermazi A, Wirth W, Benichou O, Kwoh CK, Hunter DJ, Englund M, Resch H, Eckstein F. OAI investigators. Tibial coverage, meniscus position, size and damage in knees discordant for joint space narrowing - data from the Osteoarthritis Initiative. Osteoarthritis Cartilage. 2013;21:419–427. doi: 10.1016/j.joca.2012.11.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.