Abstract
Current assessment of cartilage is primarily based on identification of indirect markers such as joint space narrowing and increased subchondral bone density on x-ray images. In this context, phase contrast CT imaging (PCI-CT) has recently emerged as a novel imaging technique that allows a direct examination of chondrocyte patterns and their correlation to osteoarthritis through visualization of cartilage soft tissue. This study investigates the use of topological and geometrical approaches for characterizing chondrocyte patterns in the radial zone of the knee cartilage matrix in the presence and absence of osteoarthritic damage. For this purpose, topological features derived from Minkowski Functionals and geometric features derived from the Scaling Index Method (SIM) were extracted from 842 regions of interest (ROI) annotated on PCI-CT images of healthy and osteoarthritic specimens of human patellar cartilage. The extracted features were then used in a machine learning task involving support vector regression to classify ROIs as healthy or osteoarthritic. Classification performance was evaluated using the area under the receiver operating characteristic (ROC) curve (AUC). The best classification performance was observed with high-dimensional geometrical feature vectors derived from SIM (0.95 ± 0.06) which outperformed all Minkowski Functionals (p < 0.001). These results suggest that such quantitative analysis of chondrocyte patterns in human patellar cartilage matrix involving SIM-derived geometrical features can distinguish between healthy and osteoarthritic tissue with high accuracy.
Keywords: phase contrast imaging, Minkowski functionals, scaling index method, texture analysis, support vector regression, osteoarthritis
1. MOTIVATION/PURPOSE
Osteoarthritis is widely recognized as representing one of the leading causes of disability worldwide. This disease is characterized by progressive damage to the articular cartilage and subchondral bone. In this research context, phase-contrast computed tomography (PCI-CT) recently emerged as a novel imaging approach that provides soft-tissue discrimination in cartilage tissue at a micrometer scale resolution [1]. Previous work has shown the ability of PCI-CT to visualize differences between healthy and osteoarthritic patellar cartilage matrix specimens [1]. In this work, we explore the use of topological and geometrical approaches to quantify such differences.
We specifically investigate the use of topological features derived from Minkowski Functionals and geometric features derived from the Scaling Index Method (SIM) for purposes of characterizing chondrocyte patterns annotated in the radial zone of knee cartilage matrix, as visualized on PCI-CT images of both healthy and osteoarthritic specimens. In this work, Minkowski Functionals are used to capture global topological properties of the underlying gray-level patterns. SIM, on the other hand provides a detailed geometrical description of the underlying gray-level patterns within the ROI, specifically through estimation of local scaling properties. Both methods have been previously applied to other pattern recognition tasks in medical imaging, such classifying between healthy and pathological lung tissue on CT [2], estimating the bone strength through analysis of trabecular micro-architecture [3], classification of malignant and benign tumors on dynamic breast MRI [4] etc. We also note that these methods have been previously investigated in the context of classifying healthy and osteoarthritic cartilage on PCI-CT images [5–6].
The goal of this work is evaluate and compare the ability of such topological and geometrical descriptors to characterize chondrocyte patterns in the radial zone of the cartilage matrix and adequately discriminate between healthy and osteoarthritic cartilage. For this purpose, such features are extracted from regions of interest (ROI) placed on PCI-CT images and used in a machine learning task that attempts to predict the class of the ROI, as discussed in the following sections. Sample ROIs used in this study are shown in figure 1. This work is embedded in our group’s endeavor to expedite ‘big data’ analysis in biomedical imaging by means of advanced pattern recognition and machine learning methods for computational radiology, e.g. [7–23].
Figure 1.
Regions of interest extracted from the radial zone of healthy and osteoarthritic knee cartilage matrix. The goal here is to classify these ROIs as belonging to either class based on quantitative analysis of the difference observed in chondrocyte patterns.
2. DATA
Two osteochondral cylindrical samples of diameter 7 mm and height 12 mm were extracted from the lateral facet of the patella of 2 patients, one healthy and one osteoarthritic, within 48 hours post-mortem. These samples were subject to PCI-CT with an analyzer-based imaging (ABI) technique, where a parallel monochromatic beam of synchrotron radiation (X-rays of energy 26keV) was used to irradiate the sample. In an inversion of traditional computed tomography setup, each bone-cartilage sample was irradiated by the stationary source while rotating about an axis perpendicular to the incident beam, and a projection image was acquired at each angular step. Vertical displacement of the sample at the end of each rotation facilitated scanning of its entire volume. An analyzer crystal was positioned between the sample and the detector to convert the tiny X-ray refraction angles into observable intensity differences. The images were acquired at the ID17 biomedical beamline of the European Synchrotron Radiation Facility (ESRF, France). Further details about the experimental setup used to acquire these images can be found in [1,24].
Axial images of dimensions 1124×1124 and in-plane resolution of 8µm × 8µm were reconstructed by using a direct Hamming filtered-back projection algorithm. 805 such images were obtained from each specimen and reformatted to yield slices in the coronal plane. 404 regions of interest (ROI) of dimensions 51×51 pixels, capturing chondrocyte patterns, were annotated by an experienced radiologist in the radial zone of the cartilage matrix on these coronal slices. 233 of these ROIs were healthy while the remaining 171 were osteoarthritic. Examples of ROIs extracted from the radial zone of cartilage matrix and subsequently used for extraction of features are shown in Figure 1.
3. METHODS
3.1 Feature analysis
Minkowski Functionals (MF) are used to characterize morphological properties of binary images i.e. shape (geometry) and connectivity (topology) [25]. Three MF features i.e. area, perimeter and Euler characteristic can be calculated from binary images as follows -
where “ns“ is the total number of white pixels, “ne“ is the total number of edges and “nv“ is the number of vertices. The area feature records the number of white pixels in the binary image, the perimeter measure calculates the length of the boundary of white pixel areas and the Euler characteristic is a measure of connectivity between the white pixel regions. It has been shown that morphological properties of objects in an image can be fully specified in terms of Minkowski Functionals.
Binary images were generated from PCI-CT ROIs by subjecting them to a gray-level threshold; the three MF features specified above were subsequently extracted from these binary ROIs. In this study, ROIs were subjected to multiple thresholds, as illustrated in Figure 2, and the resulting MF features computed were stored in high-dimensional vectors. The behavior of MF features as a function of the gray-level threshold was then used to differentiate between healthy and osteoarthritic chondrocyte patterns observed in PCI-CT ROIs. Twenty such gray-level thresholds were used in this work, resulting in a 20-D feature vector for each MF.
Figure 2.
A sample osteoarthritic ROI is shown on the extreme left. Images to the right are obtained by binarizing the ROI at 3 different gray-level thresholds. Each Minkowski Functional is computed at every binary image created and the resulting values are combined into a feature vector.
Scaling Index Method (SIM) characterizes the structure observed in a ROI through geometric features that estimate the local dimension [26]. The 2D ROI is treated as a 3D volume where the gray-level intensity is treated as the third dimension. Now, for each pixel xi in the ROI, the local dimension is calculated as –
where dij is the distance between the ith pixel (centre) and the jth pixel (neighbor), r is the neighborhood radius and N is the number of pixels contained in the neighborhood. This transform essentially assigns each pixel a local scaling property α(xi,r) in a neighborhood determined by the radius r.
The resulting distribution of α values, as seen in the SIM transformation and SIM histogram shown in Figure 3, characterizes the underlying gray-level structure and could be used to distinguish between healthy and osteoarthritic ROIs. We represent this distribution of α values with its 9 quantiles, stored in a 9-D feature vector which is subsequently processed in a classification task.
Figure 3.
LEFT: A sample osteoarthritic ROI. MIDDLE: ROIs after being processed with SIM (r = 5); color-coded based on local dimension estimates. RIGHT: SIM histogram of the ROI.
3.2 Classification
The extracted vectors were divided into training and testing datasets, and support vector regression [27] with a radial basis function kernel was used for the machine learning task. SVR is an extension of support vector machines (SVM) [28], which is a supervised learning model that is widely used in different machine learning tasks. SVM presents a computationally efficient approach for identifying a hyper-plane that imposes a maximum separation between two classes of data points in a high-dimension feature space.
The training phase employed a sub-sampling cross-validation strategy; the free parameters of the classifier (cost parameter and shape parameter of radial basis function) were optimized using the training set. Then, during the testing phase, the trained classifier was used to evaluate the character of the ROIs in the test set. An ROC curve was generated and used to compute the area under the curve (AUC). This process was repeated 50 times and a Wilcoxon signed rank was used to compare two AUC distributions. Significance thresholds were adjusted for multiple comparisons using the Holm-Bonferroni correction to achieve an overall type I error rate (significance level) less than α (where α = 0.05) [29–30].
Texture feature extraction, classification and statistical analysis were implemented using Matlab 2010a (The MathWorks, Natick, MA).
4. RESULTS
Table 1 shows the classifier performance obtained when both Minkowski Functionals and SIM feature vectors are used characterize chondrocyte patterns in ROIs placed on the radial zone of the knee cartilage matrix. The highest AUC was observed with the SIM feature vector (0.95 ± 0.06). Such geometric features significantly outperformed all topological feature vectors derived from Minkowski Functionals (p < 0.001). Among the three Minkowski Functionals, the best performance was achieved by Euler Characteristic (0.88 ± 0.09) which outperformed the others. The worst performance was noted with Minkowski Functional Area (0.61 ± 0.07).
Table 1.
Classification performance (mean ± std) achieved with features derived from Minkowski Functionals and SIM.
| Features | AUC |
|---|---|
| Area | 0.61 ± 0.07 |
| Perimeter | 0.85 ± 0.09 |
| Euler Char. | 0.88 ± 0.09 |
| SIM | 0.95 ± 0.06 |
5. NEW AND BREAKTHROUGH WORK
PCI-CT has been demonstrated as a novel technique for visualizing the cartilage matrix in ex vivo specimens of human patellar cartilage at a micro-meter scale resolution [1]. However, this has also showcased the need quantitative measures to consistently capture differences observed in the chondrocyte patterns in the radial zone of the cartilage matrix in the presence or absence of osteoarthritis. This investigation compares the performance achieved by previously proposed topological [5] and geometrical [6] approaches in quantitatively discriminating between ROIs extracted from healthy and osteoarthritic cartilage matrix. As observed in this work, features that characterize these chondrocyte patterns through local geometry (SIM) outperform those that capture global topological properties (Minkowski Functionals). Such features have significant potential for serving as imaging markers in PCI-CT for diagnosing and monitoring disease progression of osteoarthritis in human patellar cartilage.
As shown in this work, quantitative features can be used in combination with machine learning algorithms to predict the label (healthy or osteoarthritic) of an ROI extracted from the radial zone of the cartilage matrix visualized on PCI-CT with high accuracy. The best classification performance was observed with the 9-D geometrical feature vector extracted using SIM. The effectiveness of SIM in distinguishing between healthy and osteoarthritic ROIs can be attributed to its capturing geometrical properties of local neighborhoods. As seen in Figure 3, the chondrocytes are more clustered in the radial zone of osteoarthritic cartilage leading smaller local dimensions being evaluated at most pixels. This is further reflected in the corresponding SIM histogram which represents the α value distribution in the ROI. However, since chondrocytes in healthy cartilage are less clustered and are instead aligned in a specific pattern radiating outward from the tidemark, a high local dimension is evaluated at a larger number of pixels corresponding to the extracellular matrix.
The poorer performance of topological texture features derived from Minkowski Functionals could indicate that global characterization of chondrocyte organization in these ROIs is not enough for accurate classification, specifically at small ROI sizes. Thus, local characterization of chondrocyte patterns in the radial zone of patellar cartilage matrix, such as that provided by SIM-derived geometrical features, could be more useful for the task of classifying healthy and osteoarthritic ROIs. Among the topological feature vectors derived from Minkowski Functionals, the best classification performance was achieved with Euler characteristic, which suggests that connectivity is the strongest distinguishing characteristic between healthy and osteoarthritic ROIs.
While our preliminary study suggests that quantitative features, such as those discussed here, can classify healthy and osteoarthritic cartilage patterns on PCI-CT images, future studies will need to address certain drawbacks. The current setup includes only two specimens, one extracted from a healthy donor and the other one from an osteoarthritic donor (post-mortem). It is desirable to include more cartilage specimens in future studies as having ROIs from the same patient in the training and testing phase of the machine learning step could lead to some bias in the results. Further improvements to textural characterization of chondrocyte organization could include volumetric analysis as both SIM and Minkowski Functionals can be computed for 3D volumes of interest (VOI). Finally, the choice of ROI size in this study was arbitrary; the impact of ROI size on the classification performance achieved with these features should be investigated in future studies.
6. CONCLUSION
This study compared geometrical and topological approaches to characterizing chondrocyte patterns in the radial zone of cartilage matrix on PCI-CT images acquired from ex vivo human patellar cartilage specimens. Our results show that geometrical features derived from SIM outperform topological features derived from Minkowski Functionals at the task of classifying ROIs annotated on these PCI-CT images as healthy or osteoarthritic. We hypothesize that such features could offer significant potential as imaging markers in PCI-CT for diagnosing and monitoring disease progression of osteoarthritis in human patellar cartilage.
Acknowledgments
This research was funded in part by the National Institute of Health (NIH) Award R01-DA-034977, the Harry W. Fischer Award of the University of Rochester, the Clinical and Translational Science Award 5-28527 within the Upstate New York Translational Research Network (UNYTRN) of the Clinical and Translational Science Institute (CTSI), University of Rochester, the Center for Emerging and Innovative Sciences (CEIS), a NYSTAR-designated Center for Advanced Technology, and by the cluster of excellence "Munich-centre for Advanced Photonics"' (MAP), Munich, Germany.. This work was performed as a practice quality improvement (PQI) project for maintenance of certificate (MOC) of Axel Wismüller’s American Board of Radiology (ABR) certification. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute of Health. The authors would like to thank the ESRF for providing the experimental facilities and the ESRF ID17 team for assistance in operating the facilities. The following individuals are also acknowledged for their assistance with this work – Dr. Christian Glaser for his efforts in characterizing the patellar cartilage specimens and general support, Dr. Emmanuel Brun for his assistance with the data sharing process, Benjamin Mintz for his assistance in developing the annotation tool used in this study, Dr. Annie Horng for her clinical insights and assistance with preparing this manuscript, and Prof. Dr. Maximilian Reiser, FACR, FRCR of the Department of Radiology, Ludwig Maximilians University, for his continued support.
Footnotes
This work is not being and has not been submitted for publication or presentation elsewhere.
References
- 1.Coan P, Bamberg F, Diemoz PC, Bravin A, Timpert K, Mützel E, Raya JG, Adam-Neumair A, Reiser MF, Glaser C. Characterization of Osteoarthritic and Normal Human Patella Cartilage by Computed Tomography X-ray Phase-Contrast Imaging: A Feasibility Study. Investigative Radiology. 2010;45:437–444. doi: 10.1097/RLI.0b013e3181e193bd. [DOI] [PubMed] [Google Scholar]
- 2.Huber MB, Nagarajan MB, Leinsinger G, Eibel R, Ray LA, Wismüller A. Performance of topological texture features to classify fibrotic interstitial lung disease patterns. Medical Physics. 2011;38(4):2035–2044. doi: 10.1118/1.3566070. [DOI] [PubMed] [Google Scholar]
- 3.Boehm HF, Raeth C, Monetti RA, Mueller D, Newitt D, Majumdar S, Rummeny E, Morfill G, Link TM. Local 3D Scaling Properties for the Analysis of Trabecular Bone Extracted from High-Resolution Magnetic Resonance Imaging of Human Trabecular Bone: Comparison with Bone Mineral Density in the Prediction of Biomechanical Strength In Vitro. Investigative Radiology. 2003;38(5):269–280. doi: 10.1097/01.RLI.0000064782.94757.0f. [DOI] [PubMed] [Google Scholar]
- 4.Nagarajan MB, Huber MB, Schlossbauer T, Leinsinger G, Krol A, Wismüller A. Classification of small lesions in dynamic breast MRI: Eliminating the need for precise lesion segmentation through spatio-temporal analysis of contrast enhancement. Machine Vision and Applications. 2013;24(7):1371–1381. doi: 10.1007/s00138-012-0456-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Nagarajan MB, Coan P, Huber MB, Diemoz PC, Glaser C, Wismüller A. Computer-Aided Diagnosis in Phase Contrast Imaging X-ray Computed Tomography for Quantitative Characterization of ex vivo Human Patellar Cartilage. IEEE Transactions on Biomedical Engineering. 2013;60(10):2896–2903. doi: 10.1109/TBME.2013.2266325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Nagarajan MB, Coan P, Huber MB, Diemoz PC, Glaser C, Wismüller A. Computer-Aided Diagnosis for Phase Contrast X-ray Computed Tomography: Quantitative Characterization of Human Patella Cartilage with High-Dimensional Geometric Features. Journal of Digital Imaging. 2013 doi: 10.1007/s10278-013-9634-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Meyer-Bäse A, Pilyugin S, Wismüller A, Foo S. Local exponential stability of competitive neural networks with different time scales. Engineering Applications of Artificial Intelligence. 2004;17(3):227–232. [Google Scholar]
- 8.Wismüller A, Meyer-Bäse A, Lange O, Schlossbauer T, Kallergi M, Reiser MF. Segmentation and classification of dynamic breast magnetic resonance image data. Journal of Electronic Imaging. 2006;15(1) 013020-1:12. [Google Scholar]
- 9.Wismüller A. Ph. D. thesis. Technical University of Munich; Munich Germany: 2006. Exploratory Morphogenesis (XOM): a novel computational framework for self-organization. [Google Scholar]
- 10.Wismüller A, Dersch DR, Lipinski B, Hahn K, Auer D. A neural network approach to functional MRI pattern analysis—clustering of time-series by hierarchical vector quantization. ICANN. 1998;98:857–862. [Google Scholar]
- 11.Wismüller A, Dersch DR. Neural network computation in biomedical research: chances for conceptual cross-fertilization. Theory in Biosciences. 1997;116(3):229–240. [Google Scholar]
- 12.Wismüller A, Vietze F, Dersch DR, Behrends J, Hahn K, Ritter H. The deformable feature map-a novel neurocomputing algorithm for adaptive plasticity in pattern analysis. Neurocomputing. 2002;48(1):107–139. [Google Scholar]
- 13.Bunte K, Hammer B, Villmann T, Biehl M, Wismüller A. Exploratory Observation Machine (XOM) with Kullback-Leibler Divergence for Dimensionality Reduction and Visualization. ESANN. 2010;10:87–92. [Google Scholar]
- 14.Wismüller A, Vietze F, Dersch DR, Hahn K, Ritter H. The deformable feature map—adaptive plasticity for function approximation. ICANN. 1998;98:123–128. [Google Scholar]
- 15.Wismüller A. A computational framework for nonlinear dimensionality reduction and clustering. Advances in Self-Organizing Maps in Lecture Notes in Computer Science Volume. 2009;5629:334–343. [Google Scholar]
- 16.Wismüller A. The exploration machine–a novel method for data visualization. Advances in Self-Organizing Maps in Lecture Notes in Computer Science Volume. 2009;5629:344–352. [Google Scholar]
- 17.Bunte K, Hammer B, Villmann T, Biehl M, Wismüller A. Neighbor embedding XOM for dimension reduction and visualization. Neurocomputing. 2011;74(9):1340–1350. [Google Scholar]
- 18.Meyer-Bäse A, Jancke K, Wismüller A, Foo S, Martinetz T. Medical image compression using topology-preserving neural networks. Engineering Applications of Artificial Intelligence. 2005;18(4):383–392. [Google Scholar]
- 19.Yang C-C, Nagarajan MB, Huber MB, Carballido-Gamio J, Bauer JS, Baum T, Eckstein F, Lochmüller E, Link TM, Wismüller A. Automated Biomechanical Strength Prediction of Proximal Femur Specimens through Geometrical Characterization of Trabecular Bone Micro-architecture. Accepted for publication in Journal of Electronic Imaging. 2014 doi: 10.1117/1.JEI.23.1.013013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Nagarajan MB, Huber MB, Schlossbauer T, Leinsinger G, Krol A, Wismüller A. Classification of small lesions on dynamic breast MRI: Integrating dimension reduction and out-of-sample extension into CADx methodology. Artificial Intelligence in Medicine. 2013 doi: 10.1016/j.artmed.2013.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Nagarajan MB, Huber MB, Schlossbauer T, Leinsinger G, Krol A, Wismüller A. Classification of small lesions on breast MRI: Evaluating the role of dynamically extracted texture features through feature selection. Journal of Medical and Biological Engineering. 2013;33(1):59–68. doi: 10.5405/jmbe.1183. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Huber MB, Bunte K, Nagarajan MB, Biehl M, Ray LA, Wismüller A. Texture feature ranking with relevance learning to classify interstitial lung disease patterns. Artificial Intelligence in Medicine. 2012;56(2):91–97. doi: 10.1016/j.artmed.2012.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Huber MB, Lancianese SL, Nagarajan MB, Ikpot IZ, Lerner AL, Wismüller A. Prediction of Biomechanical Properties of Trabecular Bone in MR Images with Geometric Features and Support Vector Regression. IEEE Transactions on Biomedical Engineering. 2011;58(6):1820–1826. doi: 10.1109/TBME.2011.2119484. [DOI] [PubMed] [Google Scholar]
- 24.Bravin A, Coan P, Suortti P. X-ray phase-contrast imaging: from pre-clinical applications towards clinics. Physics in Biology and Medicine. 2013;58(1):R1–35. doi: 10.1088/0031-9155/58/1/R1. [DOI] [PubMed] [Google Scholar]
- 25.Michielsen K, Raedt H. Integral-geometry morphological image analysis. Physics Reports. 2001;347(6):461–538. [Google Scholar]
- 26.Jamitzky F, Stark W, Bunk W, Thalhammer S, Raeth C, Aschenbrenner T, Morfill G, Heckl W. Scaling-index method as an image processing tool in scanning-probe microscopy. Ultramicroscopy. 2000;86:241–246. doi: 10.1016/s0304-3991(00)00111-x. [DOI] [PubMed] [Google Scholar]
- 27.Drucker H, Burges C, Kaufman L, Smola A, Vapnik V. Support vector regression machines. Advances in Neural Information Processing Systems. 1996;9:155–161. [Google Scholar]
- 28.Cortes C, Vapnik V. Support-vector networks. Machine Learning. 1995;20:273–297. [Google Scholar]
- 29.Wright SP. Adjusted P-values for simultaneous inference. Biometrics. 1992;48(4):1005–1013. [Google Scholar]
- 30.Holm S. A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics. 1979;6(2):65–70. [Google Scholar]



