Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2017 Nov 21.
Published in final edited form as: Proc SPIE Int Soc Opt Eng. 2014 Apr 9;9038:903822. doi: 10.1117/12.2042397

Investigating the use of texture features for analysis of breast lesions on contrast-enhanced cone beam CT

Xixi Wang 1,*, Mahesh B Nagarajan 1, David Conover 2,3, Ruola Ning 2,3, Avice O’Connell 2, Axel Wismüller 1,2
PMCID: PMC5697793  NIHMSID: NIHMS887993  PMID: 29170583

Abstract

Cone beam computed tomography (CBCT) has found use in mammography for imaging the entire breast with sufficient spatial resolution at a radiation dose within the range of that of conventional mammography. Recently, enhancement of lesion tissue through the use of contrast agents has been proposed for cone beam CT. This study investigates whether the use of such contrast agents improves the ability of texture features to differentiate lesion texture from healthy tissue on CBCT in an automated manner. For this purpose, 9 lesions were annotated by an experienced radiologist on both regular and contrast-enhanced CBCT images using two-dimensional (2D) square ROIs. These lesions were then segmented, and each pixel within the lesion ROI was assigned a label – lesion or non-lesion, based on the segmentation mask. On both sets of CBCT images, four three-dimensional (3D) Minkowski Functionals were used to characterize the local topology at each pixel. The resulting feature vectors were then used in a machine learning task involving support vector regression with a linear kernel (SVRlin) to classify each pixel as belonging to the lesion or non-lesion region of the ROI. Classification performance was assessed using the area under the receiver-operating characteristic (ROC) curve (AUC). Minkowski Functionals derived from contrast-enhanced CBCT images were found to exhibit significantly better performance at distinguishing between lesion and non-lesion areas within the ROI when compared to those extracted from CBCT images without contrast enhancement (p < 0.05). Thus, contrast enhancement in CBCT can improve the ability of texture features to distinguish lesions from surrounding healthy tissue.

Keywords: contrast-enhanced cone beam CT, breast imaging, texture analysis, Minkowski Functionals, support vector regression

1. MOTIVATION/PURPOSE

Breast cancer is the most frequently diagnosed cancer among women and the second leading cause of cancer-related mortality among women [1]. In this research context, cone-beam CT (CBCT) has found use in mammography owing to its ability to extract three-dimensional (3D) image data, thus resulting in improved visualization of structures and while eliminating the hard compression of breasts [2]. This imaging modality also provides better coverage of the inferior, posterior, medial and lateral portions of the breast [3]. Finally, we note that the average radiation dose from cone-beam breast CT is generally within the range of that from conventional mammography [3].

This study was conducted to investigate the use of texture features in distinguishing between lesion and surrounding healthy tissue on CBCT images in the presence and absence of contrast enhancement. For this purpose, texture features derived from Minkowski Functionals were used to characterize both lesion and non-lesion areas by capturing local topological properties. Such Minkowski Functionals have been previously used for pattern recognition problems in medical imaging, such as classifying between healthy and pathological lung tissue on CT [4], estimating the bone strength through analysis of trabecular micro-architecture [5], classifying benign and malignant lesions on dynamic breast MRI [6], characterizing healthy and osteoarthritic patellar cartilage on phase contrast x-ray computed tomography [7], etc.

The goal of this work is evaluate the use of such topological descriptors in characterizing gray-level patterns corresponding to lesion and non-lesion areas in the presence and absence of contrast enhancement on CBCT. For this purpose, such features are extracted on a pixel-wise basis within regions of interest (ROI) placed on regular and contrast-enhanced CBCT images. Such features are subsequently used in a machine learning task that attempts to predict the label pixels within the ROI, as discussed in the following sections. This work is embedded in our group’s endeavor to expedite ‘big data’ analysis in biomedical imaging by means of advanced pattern recognition and machine learning methods for computational radiology, e.g. [825].

2. DATA

The CBCT for breast imaging system employed a horizontally oriented gantry beneath a subject support table, which incorporated an x-ray tube with a 0.3 mm focal spot at one end and a high-resolution, 40×30 cm real-time flat panel detector (FPD) (Rad-70, PaxScan 4030CB, respectively, Varian Medical Systems, Salt Lake City, Utah) at the opposite end. The gantry rotated 360° around the subject’s breast, acquiring 300 pulsed projection images at ~8 ms each. The system was designed and built in compliance with the national and international safety standards for medical equipment.

After acquisition of pre-contrast CBCT data, a bolus injection of 1ml/kg body weight of low osmolar, nonionic, 300–350 mgI/ml iodinated contrast agent was administered for acquisition of contrast-enhanced CBCT images. Specialized 3D visualization software constructed a 3D model of the breast from the acquired images taken during the rotational x-ray sequence.

In the manner described above, pre-contrast and post-contrast CBCT exams from 9 female patients were analyzed as part of this IRB-approved study. Two of the patients had benign lesions while the rest had malignant lesions; the primary lesion in each study was annotated with volumes of interest (VOI) by an experienced radiologist. Following annotation, the central slice of each lesion was chosen for further analysis. For the extraction of local volumetric features at every pixel on the central slice, the 4 slices above and below the central slice were also used. In 7 of the VOIs, this central slice consisted of an 83×83 square ROI that encapsulated the lesion; the 2 remaining cases had ROI of 103×103 pixels encapsulating the lesion. The voxel resolution of the image data analyzed was 0.27×0.27×0.27mm3.

3. METHODS

3.1 Feature analysis

Minkowski Functionals (MFs) are used to characterize morphological properties of binary images i.e. shape (geometry) and connectivity (topology) [26]. Four such features i.e. volume, surface, mean breadth and Euler characteristic can be calculated from binary volumes as follows –

MFvolume=nc
MFsurface=6nc+2nf
MFbreadth=3nc2nf+ne
MFeuler=nc+nfne+nv

where “nc“ is the total number of white voxels, “nf“ is the total number of faces, “ne“ is the total number of edges and “nv“ is the number of vertices. It has been shown in literature that morphological properties of objects in an image can be fully specified in terms of Minkowski Functionals [9,27]. Such features can be extracted from gray-level images by binarizing them with several thresholds and computing Minkowski Functionals on the resulting black & white images. In this work, the gray level distributions in each VOI was first quantized and then used as thresholds to calculate the 3D MF features. The results are shown in Figure 1.

Figure 1.

Figure 1

The central slice of an example benign and a malignant lesion; the original contrast-enhanced CBCT images are shown on the left, the binarized images are shown on the right.

In this study, such topological texture features were extracted locally through binarization of the 9×9×9 pixel3 neighborhood surrounding each pixel on the central slice of the lesion with 5 thresholds. This yields four 5-D feature vectors for each voxel, one vector per Minkowski Functional.

3.2 Classification

Once feature vectors were extracted for every pixel on the 9 lesion slices from both pre-contrast and contrast-enhanced images, the goal was then to use them in a machine learning task to predict their label as lesion or non-lesion in each case. Support vector regression [28] with a linear kernel (SVRlin) was used for the machine learning task. In order to characterize unknown VOIs, models are created based on known labeled data in the training set. The goal is to optimize classifier parameters so that they can model the best hyperplane and margins between the lesion and non-lesion classes.

In order to generalize the classification performance, the classifier was optimized using a training set of labeld VOIs and the accuracy was calculated on an independent test set. For each iteration, the feature vectors were divided into a 70% training set and a 30% test set. To ensure that feature vectors from the same patient did not serve in both training and test sets simultaneously, the 70–30 split was applied to the patients that the feature vectors were extracted from.

The training phase employed a sub-sampling cross-validation strategy where the cost parameter of the classifier was optimized using the training set. Then, during the testing phase, the trained classifier was used to evaluate the label of the feature vectors in the test set. An ROC curve was generated and used to compute the area under the curve (AUC). This process was repeated 50 times resulting in an AUC distribution for each feature (Minkowski Functional). A Wilcoxon signed rank was used to compare the AUC distributions of different features extracted from pre-contrast and contrast-enhanced images.

The SVRlin classifier was taken from LIBSVM library and implemented in MATLAB R2008b. The statistical analysis was also implemented using MATLAB R2008b (The MathWorks, Natick, MA).

4. RESULTS

Figure 2 shows the classification performance of different Minkowski Functionals at distinguishing between lesion and non-lesion regions within ROIs annotated on pre-contrast and contrast-enhanced CBCT images. As seen, here, the best classification results were obtained by using Minkowski Functionals that were extracted from contrast-enhanced CBCT images. In fact, the classification performance with support vector regression when Minkowski Functionals were extracted from contrast-enhanced CBCT images was significantly better than when they were extracted from non-enhanced CBCT images (p < 0.05). The highest accuracy was found for the Minkowski Functional Euler characteristic for both contrast-enhanced and pre-contrast CBCT images.

Figure 2.

Figure 2

Classification performance of Minkowski Functionals extracted from pre-contrast (blue) and contrast-enhanced (red) CBCT images. For each distribution, the central mark corresponds with the median and the edges are the 25th and 75th percentile. As seen here, Minkowski Functionals extracted from contrast-enhanced CBCT images are significantly better at distinguishing between lesion and non-lesion regions (p < 0.05).

5. DISCUSSION

Cone beam computed tomography (CBCT) has been recently investigated for use in mammography for its ability to acquire volumetric image data of the entire breast with sufficient spatial resolution at a radiation dose comparable to that of conventional mammography. The primary goal of this study was to investigate whether contrast injection on CBCT images could increase lesion detection accuracy. To address this problem, this study investigated and quantified the ability of topological texture features derived from Minkowski Functionals to distinguish between lesion and healthy tissue on CBCT images in the presences and absence of contrast enhancement.

As observed in this work, the ability of such features to accurately identify pixels as belonging to lesion or non-lesion (healthy tissue) regions is significantly improved in the presence of contrast enhancement. This is likely due to the lesion tissue enhancement provided by such contrast, which allows imaging markers such as texture features to capture lesion characteristics and distinguish them from non-enhancing healthy tissue. Such features have significant potential to contribute to automatic lesion detection in contrast-enhanced CBCT exams. The improvement in classification performance noted with texture features in this study could also be attributed to higher contrast resolution and the reduced tissue overlap in CBCT imaging.

The results presented in this work suggest that characterizing lesion morphology on contrast enhanced CBCT breast images using topological texture features can significantly improve the performance in determining the potential lesion areas. These results have significant clinical implications in the sense that such a topological characterization of the contrast-enhanced lesion pattern can contribute to automatic lesion detection.

We acknowledge that the inclusion of only nine datasets was a limiting factor of this study. A larger collection of datasets will be required in future studies for validating the clinical applicability of our approach.

6. CONCLUSION

This study investigated the ability of topological texture features derived from Minkowski Functionals to differentiate between lesion and healthy tissue on CBCT images in the presence and absence of contrast enhancement. Our results show that such imaging markers are best able to distinguish between lesion and healthy tissue regions when contrast-enhanced CBCT images are used.

Acknowledgments

This research was funded in part by the National Institute of Health (NIH) Award R01-DA-034977, the Harry W. Fischer Award of the University of Rochester, the Clinical and Translational Science Award 5-28527 within the Upstate New York Translational Research Network (UNYTRN) of the Clinical and Translational Science Institute (CTSI), University of Rochester, and by the Center for Emerging and Innovative Sciences (CEIS), a NYSTAR-designated Center for Advanced Technology. This work was performed as a practice quality improvement (PQI) project for maintenance of certificate (MOC) of Axel Wismüller’s American Board of Radiology (ABR) certification. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute of Health. We would also like to thank Koning Corporation for providing the design of the cone beam breast CT imaging modality.

Footnotes

This work is not being and has not been submitted for publication or presentation elsewhere.

References

  • 1.Jemal A, Siegel R, Ward E, Murray T, Xu J, Thun MJ. Cancer statistics, 2007. CA: A Cancer Journal for Clinicians. 2007;57(1):43–66. doi: 10.3322/canjclin.57.1.43. [DOI] [PubMed] [Google Scholar]
  • 2.Chen B, Ning R. Cone-beam volume CT breast imaging: feasibility study. Medical Physics. 2002;29(5):755–770. doi: 10.1118/1.1461843. [DOI] [PubMed] [Google Scholar]
  • 3.O'Connell A, Conover DL, Zhang Y, Seifert P, Logan-Young W, Lin CF, Sahler L, Ning R. Cone-beam CT for breast imaging: Radiation dose, breast coverage, and image quality. American Journal of Roentgenology. 2010;195(2):496–509. doi: 10.2214/AJR.08.1017. [DOI] [PubMed] [Google Scholar]
  • 4.Huber MB, Nagarajan MB, Leinsinger G, Eibel R, Ray LA, Wismüller A. Performance of topological texture features to classify fibrotic interstitial lung disease patterns. Medical Physics. 2011;38(4):2035–2044. doi: 10.1118/1.3566070. [DOI] [PubMed] [Google Scholar]
  • 5.Boehm HF, Raeth C, Monetti RA, Mueller D, Newitt D, Majumdar S, Rummeny E, Morfill G, Link TM. Local 3D Scaling Properties for the Analysis of Trabecular Bone Extracted from High-Resolution Magnetic Resonance Imaging of Human Trabecular Bone: Comparison with Bone Mineral Density in the Prediction of Biomechanical Strength In Vitro. Investigative Radiology. 2003;38(5):269–280. doi: 10.1097/01.RLI.0000064782.94757.0f. [DOI] [PubMed] [Google Scholar]
  • 6.Nagarajan MB, Huber MB, Schlossbauer T, Leinsinger G, Krol A, Wismüller A. Classification of small lesions in dynamic breast MRI: Eliminating the need for precise lesion segmentation through spatio-temporal analysis of contrast enhancement. Machine Vision and Applications. 2013;24(7):1371–1381. doi: 10.1007/s00138-012-0456-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Nagarajan MB, Coan P, Huber MB, Diemoz PC, Glaser C, Wismüller A. Computer-Aided Diagnosis in Phase Contrast Imaging X-ray Computed Tomography for Quantitative Characterization of ex vivo Human Patellar Cartilage. IEEE Transactions on Biomedical Engineering. 2013;60(10):2896–2903. doi: 10.1109/TBME.2013.2266325. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Meyer-Bäse A, Pilyugin S, Wismüller A, Foo S. Local exponential stability of competitive neural networks with different time scales. Engineering Applications of Artificial Intelligence. 2004;17(3):227–232. [Google Scholar]
  • 9.Wismüller A, Meyer-Bäse A, Lange O, Schlossbauer T, Kallergi M, Reiser MF. Segmentation and classification of dynamic breast magnetic resonance image data. Journal of Electronic Imaging. 2006;15(1):013020–1. 12. [Google Scholar]
  • 10.Wismüller A. Ph. D. thesis. Technical University of Munich; Munich Germany: 2006. Exploratory Morphogenesis (XOM): a novel computational framework for self-organization. [Google Scholar]
  • 11.Wismüller A, Dersch DR, Lipinski B, Hahn K, Auer D. A neural network approach to functional MRI pattern analysis—clustering of time-series by hierarchical vector quantization. ICANN. 1998;98:857–862. [Google Scholar]
  • 12.Wismüller A, Dersch DR. Neural network computation in biomedical research: chances for conceptual cross-fertilization. Theory in Biosciences. 1997;116(3):229–240. [Google Scholar]
  • 13.Wismüller A, Vietze F, Dersch DR, Behrends J, Hahn K, Ritter H. The deformable feature map-a novel neurocomputing algorithm for adaptive plasticity in pattern analysis. Neurocomputing. 2002;48(1):107–139. [Google Scholar]
  • 14.Bunte K, Hammer B, Villmann T, Biehl M, Wismüller A. Exploratory Observation Machine (XOM) with Kullback-Leibler Divergence for Dimensionality Reduction and Visualization. ESANN. 2010;10:87–92. [Google Scholar]
  • 15.Wismüller A, Vietze F, Dersch DR, Hahn K, Ritter H. The deformable feature map—adaptive plasticity for function approximation. ICANN. 1998;98:123–128. [Google Scholar]
  • 16.Wismüller A. A computational framework for nonlinear dimensionality reduction and clustering. Advances in Self-Organizing Maps in Lecture Notes in Computer Science Volume. 2009;5629:334–343. [Google Scholar]
  • 17.Wismüller A. The exploration machine–a novel method for data visualization. Advances in Self-Organizing Maps in Lecture Notes in Computer Science Volume. 2009;5629:344–352. [Google Scholar]
  • 18.Bunte K, Hammer B, Villmann T, Biehl M, Wismüller A. Neighbor embedding XOM for dimension reduction and visualization. Neurocomputing. 2011;74(9):1340–1350. [Google Scholar]
  • 19.Meyer-Bäse A, Jancke K, Wismüller A, Foo S, Martinetz T. Medical image compression using topology-preserving neural networks. Engineering Applications of Artificial Intelligence. 2005;18(4):383–392. [Google Scholar]
  • 20.Yang C-C, Nagarajan MB, Huber MB, Carballido-Gamio J, Bauer JS, Baum T, Eckstein F, Lochmüller E, Link TM, Wismüller A. Automated Biomechanical Strength Prediction of Proximal Femur Specimens through Geometrical Characterization of Trabecular Bone Micro-architecture. Accepted for publication in Journal of Electronic Imaging. 2014 doi: 10.1117/1.JEI.23.1.013013. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Nagarajan MB, Huber MB, Schlossbauer T, Leinsinger G, Krol A, Wismüller A. Classification of small lesions on dynamic breast MRI: Integrating dimension reduction and out-of-sample extension into CADx methodology. Artificial Intelligence in Medicine. 2013 doi: 10.1016/j.artmed.2013.11.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Nagarajan MB, Coan P, Huber MB, Diemoz PC, Glaser C, Wismüller A. Computer-Aided Diagnosis for Phase Contrast X-ray Computed Tomography: Quantitative Characterization of Human Patella Cartilage with High-Dimensional Geometric Features. Journal of Digital Imaging. 2013 doi: 10.1007/s10278-013-9634-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Nagarajan MB, Huber MB, Schlossbauer T, Leinsinger G, Krol A, Wismüller A. Classification of small lesions on breast MRI: Evaluating the role of dynamically extracted texture features through feature selection. Journal of Medical and Biological Engineering. 2013;33(1):59–68. doi: 10.5405/jmbe.1183. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Huber MB, Bunte K, Nagarajan MB, Biehl M, Ray LA, Wismüller A. Texture feature ranking with relevance learning to classify interstitial lung disease patterns. Artificial Intelligence in Medicine. 2012;56(2):91–97. doi: 10.1016/j.artmed.2012.07.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Huber MB, Lancianese SL, Nagarajan MB, Ikpot IZ, Lerner AL, Wismüller A. Prediction of Biomechanical Properties of Trabecular Bone in MR Images with Geometric Features and Support Vector Regression. IEEE Transactions on Biomedical Engineering. 2011;58(6):1820–1826. doi: 10.1109/TBME.2011.2119484. [DOI] [PubMed] [Google Scholar]
  • 26.Michielsen K, Raedt H. Integral-geometry morphological image analysis. Physics Reports. 2001;347(6):461–538. [Google Scholar]
  • 27.Mecke K, Wagner H. Euler characteristic and related measures for random geometric sets. Journal of Statistical Physics. 1991;64(3):843–850. [Google Scholar]
  • 28.Drucker H, Burges C, Kaufman L, Smola A, Vapnik V. Support vector regression machines. Advances in Neural Information Processing Systems. 1996;9:155–161. [Google Scholar]

RESOURCES