Abstract
Delineation of organs at risk (OARs) is important but time consuming for radiotherapy planning. Automatic segmentation of OARs based on convolutional neural network (CNN) has been established for lung cancer patients at our institution. The aim of this study is to compare automatic segmentation based on CNN (AS-CNN) with automatic segmentation based on atlas (AS-Atlas) in terms of the efficiency and accuracy of OARs contouring.
The OARs, including the lungs, esophagus, heart, liver, and spinal cord, of 19 non-small cell lung cancer patients were delineated using three methods: AS-CNN, AS-Atlas in the Pinnacle3-software, and manual delineation (MD) by a senior radiation oncologist. MD was used as the ground-truth reference, and the segmentation efficiency was evaluated by the time spent per patient. The accuracy was evaluated using the Mean surface distance (MSD) and Dice similarity coefficient (DSC). The paired t-test or Wilcoxon signed-rank test was used to compare these indexes between the 2 automatic segmentation models.
In the 19 testing cases, both AS-CNN and AS-Atlas saved substantial time compared with MD. AS-CNN was more efficient than AS-Atlas (1.6 min vs 2.4 min, P < .001). In terms of the accuracy, AS-CNN performed well in the esophagus, with a DSC of 73.2%. AS-CNN was better than AS-Atlas in segmenting the left lung (DSC: 94.8% vs 93.2%, P = .01; MSD: 1.10 cm vs 1.73 cm, P < .001) and heart (DSC: 89.3% vs 85.8%, P = .05; MSD: 1.65 cm vs 3.66 cm, P < .001). Furthermore, AS-CNN exhibited superior performance in segmenting the liver (DSC: 93.7% vs 93.6%, P = .81; MSD: 2.03 cm VS 2.11 cm, P = .66). The results obtained from AS-CNN and AS-Atlas were similar in segmenting the right lung. However, the performance of AS-CNN in the spinal cord was inferior to that of AS-Atlas (DSC: 82.1% vs 86.8%, P = .01; MSD: 0.87 cm vs 0.66 cm, P = .01).
Our study demonstrated that AS-CNN significantly reduced the contouring time and outperformed AS-Atlas in most cases. AS-CNN can potentially be used for OARs segmentation in patients with pathological N2 (pN2) non-small cell lung cancer.
Keywords: automatic segmentation based on atlas, automatic segmentation based on convolutional neural network, non-small cell lung cancer, organs at risk, postoperative radiation therapy
1. Introduction
Lung cancer is the leading cause of cancer-related death not only in China but also around the world,[1] with non-small cell lung cancer (NSCLC) constituting 85% of the total cases. Surgery is the first choice for patients diagnosed with NSCLC. Postoperative radiation therapy (PORT) is a necessary consideration for patients with operable pathological N2 (pN2) NSCLC,[2] as it has been demonstrated to decrease local recurrence and improve survival significantly.[3–5]
Radiotherapy technology has witnessed tremendous advancements in recent years, with the increasing utilization of intensity modulated radiation therapy,[6] volumetric modulated arc therapy,[7] image guided radiation therapy[8] and proton therapy.[9] The main goals of modern radiation therapy (RT) are to maximize tumor control and minimize RT-related toxicity, which are achieved by delivering curative doses to tumor targets while sparing the irradiation of organs at risk (OARs). However, optimizing the delivery of reduced dose to normal tissues requires accurate delineation of the interest (ROI). As a result, accurate OARs contouring is of vital importance to RT planning, which is closely related to the quality and outcome in lung cancer care.
OARs Delineation is a tedious and time-consuming process for the radiation oncologist. Furthermore, the quality of delineation depends on the expertise level of the individual observer. Even though they delineated ROI according to the radiation therapy oncology group (RTOG) guidelines, considerable inter-observer and intra-observer variations still exist.[10,11] Automatic segmentation software has the potential to improve efficiency, accuracy, and consistency between observers.
Software of automatic segmentation based on atlas (AS-Atlas) has been commonly used in radiotherapy treatment planning,[12–14] which applies deformable image registration methods to propagate the labeled structures in the atlas image onto the target image automatically.[15] However, two time-consuming procedures of dividing patients into different groups according to their size and registering the computed tomography (CT) images to their atlas images have limited the use of AS-Atlas in clinical practice.
Recently, automatic segmentation based on convolutional neural network (AS-CNN) has gained popularity in RT.[16,17] AS-CNN can discover the informative representations in a self-taught manner, use hierarchical layers to learn abstraction, and accomplish high-level tasks efficiently. However, a comparison between AS-CNN and AS-Atlas for RT has been rarely reported. In the case of lung cancer, only one study has compared the automatic segmentation of OARs between AS-CNN and AS-Atlas.[18]
Our group has previously established several AS-CNN models for target segmentation or OARs segmentation in rectal,[19] nasopharyngeal,[20] and breast[15] cancers. In this study, the AS-CNN model is used for the segmentation of OARs in lung cancer. Concurrently, the new AS-CNN model is compared with the AS-Atlas contour in specific patients with pN2 NSCLC, who can gain more benefit from PORT among all stages of NSCLC. The aim of this study is to improve the utility of AS-CNN in clinical practice to relieve the radiation oncologists of the labor-intensive contouring work and increase the accuracy, consistency and efficiency of ROI segmentation.
2. Patients and methods
2.1. Patient selection
A total of 250 patients with pN2 NSCLC who received PORT after R0 resection from January 2005 to December 2014 at our department were retrospectively selected to build the AS-CNN model, of which 200 cases were randomly assigned to the training set and 50 cases to the validation set. An additional 19 patients diagnosed with NSCLC from December 2016 to July 2018 at our department were selected as the testing group for the automatic delineation of OARs. The Ethics Committee of Cancer Institute and Hospital Board Affiliation of Chinese Academy of Medical Sciences approved the study, and all patients provided informed consent before enrollment. All patients were simulated at the supine position with both forearms crossed above the forehead. Simulation contrast computed CT data were acquired on a Somatom Definition AS 40 (Siemens Healthcare, Best, the Netherlands) system set to the helical scan mode. The CT images were reconstructed using a matrix size of 512 × 512 and thickness of 5.0 mm. The OARs, including the left lung, right lung, heart, spinal cord, esophagus, and liver, were delineated by multiple experimental radiation oncologists of our department with specialization in the thoracic region.
2.2. AS-CNN model for segmentation
In this study, an AS-CNN model based on ResNet-101[21] is introduced for segmenting the OARs in PORT patients. The dilated model could extract original information from the CT images by introducing different dilation factors. The input to deep AS-CNN model was 2D CT images and the output was the corresponding labels of the OARs. A total of 200 randomly selected thoracic and abdominal CT images, including manual segmentation labels of the OARs, were used as the training test to adjust the parameters of the network. The remaining50 cases were assigned to the validation set to test the stability of the AS-CNN model.
2.3. Contour methods
Each of 19 patients in the testing group was delineated into 3 sets of OARs using manual delineation (MD), AS-CNN and AS-Atlas respectively. All manual contours were drawn on a software used in clinical practice (Pinnacle3software, Version: 9.10, Fitchburg, WI) by a single radiation oncologist specialized in the thoracic region according to the radiation therapy oncology group guidelines to prevent any inter-observer variability. All atlas-based contours were automatically segmented using the commercial AS-Atlas software in Pinnacle. To obtain the AS-CNN contours, the observers imported the CT images to the CNN model established by our group, and then the OARs were automatically generated. The time spent per patient was recorded, with an accuracy of the seconds.
2.4. Accuracy assessment
The performances of the proposed two automatic methods were evaluated in terms of the Dice similarity coefficient (DSC) and Mean surface distance (MSD), MD was used as the ground-truth reference.
The DSC is defined as:
where V1 denotes the volume of manually delineated organ, and V2 represents the volume of the automatically segmented organ. V1∩V2 corresponds to the common volume between V1 and V2. The DSC value ranges between 0 and 1 (0 = no overlap, 1 = complete overlap).
The MSD is the mean distance between the surfaces of two volumes. As the MSD decreases, the overlap between two volumes increases.
2.5. Statistical analysis
To evaluate the DSC, MSD, and delineation time between different contouring methods, the pared t-test or Wilcoxon signed-rank test was performed according to the normality of the data. These analyses were all performed using the SPSS version 23.0 software (SPSS, Inc. IBM, Armonk, NY). A value of P < .05 was considered statistically significant.
3. Results
3.1. Efficiency
For the chest and abdomen CT images of 19 cases in the testing set, the average time acquired for MD was 25.4 minutes, whereas the average time required by AS-CNN and AS-Atlas was 1.6 minutes and 2.4 minutes, which accounted for only 7% and 10% of time spent on MD, respectively. AS-CNN was more efficient than AS-Atlas (P < .001, Wilcoxon signed-rank test).
3.2. Accuracy
The DSC values are listed in Table 1 and Figure 1. The MSD values are listed in Table 1 and Figure 2. AS-CNN performed well in segmenting the esophagus, with an average DSC value of 73.2%, while that of the AS-Atlas for the esophagus was unavailable. AS-CNN performed better in segmenting the left lung (DSC: 94.8% vs 93.2%, P = .01, Wilcoxon signed-rank test; MSD: 1.10 cm vs 1.73 cm, P < .001, Wilcoxon signed-rank test) and heart (DSC: 89.3% vs 85.8%, P = .05, Wilcoxon signed-rank test; MSD: 1.65 cm vs 3.66 cm, P < .001, Wilcoxon signed-rank test). In addition, AS-CNN exhibited a trend of superior performance in segmenting the liver compared with AS-Atlas (DSC: 93.7% vs 93.6%, P = .81, pared t test; MSD: 2.03 cm vs 2.11 cm, P = .66, paired t test). The results obtained from AS-CNN and AS-Atlas were similar for the contouring of the right lung (DSC: 94.3% vs 94.3%, P = .44, Wilcoxon signed-rank test; MSD: 2.23 cm vs 2.17 cm, P = .31, paired t test). However, the performance of AS-CNN for the spinal cord was inferior compared with that of AS-Atlas (DSC: 82.1% vs 86.8%, P = .01, Wilcoxon signed-rank test; MSD: 0.87 cm vs 0.66 cm, P = .01, paired t test). The contours of one representative case generated by the 3 segmentation models are shown in Figure 3.
Table 1.
3.3. Contour volume
The average volumes of all OARs, including the left lung, right lung, heart, spinal cord, liver, and esophagus, produced by MD, AS-Atlas, and AS-CNN, are listed in Figure 4 and Table 2. The average volumes of the liver, left lung, right lung and heart were greater than 500 cm3 whereas those of the spinal cord and esophagus were less than 100 cm3. The average volumes of 4 organs, namely the left lung, right lung heart and spinal cord segmented by AS-CNN were comparable to the volumes contoured by MD. In contrast, the average volume of one organ, namely the liver, segmented by AS-Atlas was comparable to the volume delineated by MD.
Table 2.
4. Discussion
In this study, the OARs segmented by AS-CNN and AS-Atlas were compared. Following training and validation, the AS-CNN can be used to segment normal organs in the 2D CT images accurately and efficiently. Zijdenbos et al suggested that a DSC value >70% represented good overlap.[22] In this study, the average DSC values of AS-CNN were 94.8%, 94.3%, 89.3%, 93.7%, 82.1%, and 73.2% for the left lung, right lung, heart, liver, spinal cord, and esophagus, respectively. All OARs had DSC values above 70%, suggesting that AS-CNN achieved high accuracy in OARs segmentation.
Among the 6 organs, the left and right lungs had the highest DSC values of 94.8%, and 94.3% respectively. This superior performance can be attributed to the large size and high soft tissue contrast of the lungs in the CT images.
Compared with AS-Atlas, AS-CNN had an additional function for contouring the esophagus that was not available in AS-Atlas. In addition, AS-CNN performed significantly better in the segmentation of the left lung (DSC 94.8% vs 93.2%; MSD 1.10 cm vs 1.73 cm) and heart (DSC 89.3% vs 85.8%; MSD 1.65 cm vs 3.66 cm) compared with AS-Atlas. AS-CNN exhibited superior trends for the DSC (93.7% vs 93.6%) and MSD (2.03 cm vs 2.11 cm) in the liver segmentation. These data suggest that the proposed AS-CNN outperformed AS-Atlas in most cases of OARs delineation for lung cancer. However, in the segmentation of the spinal cord, AS-CNN underperformed compared with AS-Atlas, indicating that there might be room for further improvement, and adjustments to AS-CNN might be required. For the automatic segmentation of the spinal cord, DSC values of 0.8,[23] 0.71,[24] 0.74,[25] and 0.76[18] have been reported in other literatures. The AS-CNN performed better in segmenting the spinal cord compared with models mentioned in other studies.
Other groups have also established various automatic segmentation models to contour OARs. Schreibmann et al[25] assessed the performance of their multi-atlas segmentation software. They reported an average DSC of 0.958, 0.912, and 0.740 for the lung, liver, and spinal cord, respectively. Zhu et al[18] compared their deep convolutional neural network-based technique with atlas-based technique. They reported an average DSC of 0.95, 0.91, 0.89, 0.76, and 0.64 for the lung, heart, liver, spinal cord, and esophagus, respectively. Here, our AS-CNN approach performed better in the heart, spinal cord, esophagus, and liver, and showed similar performance for the lung compared with other models from published literatures.
The DSC value has been generally used to evaluate the efficiency of automatic ROI segmentation, whereas the MSD has been rarely reported in other studies. Zhu et al[18] reported an average MSD of 1.93, 3.21, 2.92, 1.81, and 2.65 for the lung, liver, heart, spinal cord, and esophagus, respectively. However, in our study, the average MSD is 1.10, 2.23, 2.03, 1.65, 0.87, and 1.38 for the left lung, right lung, liver, heart, spinal cord, and esophagus. Here, our AS-CNN model showed superior performance in all OARs segmentations compared with other published models.
For the 19 test cases, the average time taken for delineating the six organs by MD was 25.4 minutes, whereas the average time required by AS-CNN was 1.6 minutes, which only accounted for 7% of the MD time. Compared with AS-Atlas that required an average time of 2.4 minutes, AS-CNN was more efficient (P < .001). This was because the process of transforming the CT images into atlas images consumed considerable time in AS-Atlas,[15] whereas the trained AS-CNN could quickly segment the ROI without requiring any changes to the CT images.
This work was not pioneering with regard to using a CNN model to segment organs in lung cancer. However, this work was the first attempt to apply CNN to for the segmentation of OARs in patients with operable pN2 NSCLC, who could gain more benefit during PORT. A comparing between the performances of AS-CNN and AS-Atlas revealed that AS-CNN was more efficient and accurate in contouring organs. AS-CNN can potentially be used in clinical practice to relieve radiation oncologists of the labor-intensive contouring work. However, the segmentation accuracy can be further improved by increasing the amount of training and validation data, optimizing the AS-CNN algorithm, replacing the CT images with MRI images with high soft tissue contrast, and combining AS-CNN and AS-Atlas.
5. Conclusion
In this study, an AS-CNN model was established for segmenting six OARs in chest and abdominal CT images of patients with pN2 NSCLC. In addition, the performance of AS-CNN was compared with AS-Atlas. The results demonstrated that the proposed AS-CNN outperformed AS-Atlas in most cases. Therefore, AS-CNN has the potential to segment OARs in patients with pN2 NSCLC who require PORT.
Author contributions
Conceptualization: Tao Zhang, Nan Bi
Data curation: Yin Yang, Jingbo Wang, Kuo Men
Formal analysis: Tao Zhang, Yin Yang
Resources: Tao Zhang, Xin Wang, Lei Deng
Software: Tao Zhang, Kuo Men, Nan Bi
Writing – original draft: Yin Yang, Tao Zhang
Writing – review & editing: Tao Zhang, Nan Bi
Footnotes
Abbreviations: AS-Atlas = automatic segmentation based on atlas, AS-CNN = automatic segmentation based on CNN, CNN = convolutional neural network, CT = computed tomography, DSC = dice similarity coefficient, MD = manually delineated, MSD = mean surface distance, NSCLC = non-small cell lung cancer, OARs = organs at risk, pN2 = pathological N2, PORT = postoperative radiation therapy, ROI = region of interest, RT = radiation therapy.
How to cite this article: Zhang T, Yang Y, Wang J, Men K, Wang X, Deng L, Bi N. Comparison between atlas and convolutional neural network based automatic segmentation of multiple organs at risk in non-small cell lung cancer. Medicine. 2020;99:34(e21800).
The authors report no conflicts of interest.
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
This study was supported by grants of CAMS Innovation Fund for Medical Sciences (No. 2017-I2M-1-009) and the Beijing Municipal Science & Technology Commission (No. Z181100001918002)
References
- [1].Bray F, Ferlay J, Soerjomataram I, et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: A Cancer J Clin 2018;68:394–424. [DOI] [PubMed] [Google Scholar]
- [2].National Comprehensive Cancer Netvork. Non-Small Cell Lung Cancer (Version 1. 2020). http://www.nccn.org/professionals/physician_gls/pdf/nscl.pdf. [access date November 6, 2019]. [DOI] [PubMed] [Google Scholar]
- [3].Douillard JY, Rosell R, De Lena M, et al. Impact of postoperative radiation therapy on survival in patients with complete resection and stage I, II, or IIIA non-small-cell lung cancer treated with adjuvant chemotherapy: the adjuvant Navelbine International Trialist Association (ANITA) Randomized Trial. Int J Radiat Oncol Biol Phys 2008;72:695–701. [DOI] [PubMed] [Google Scholar]
- [4].Wang S, Ma Z, Yang X, et al. Choice of postoperative radiation for stage IIIA pathologic N2 non-small cell lung cancer: impact of metastatic lymph node number. Radiat Oncol (London, England) 2017;12:207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [5].Lally BE, Zelterman D, Colasanto JM, et al. Postoperative radiotherapy for stage II or III non-small-cell lung cancer using the surveillance, epidemiology, and end results database. J Clin Oncol V 24 2006;2998–3006. [DOI] [PubMed] [Google Scholar]
- [6].Liao ZX, Komaki RR, Thames HD, Jr, et al. Influence of technologic advances on outcomes in patients with unresectable, locally advanced non-small-cell lung cancer receiving concomitant chemoradiotherapy. Int J Radiat Oncol Biol Phys 2010;76:775–81. [DOI] [PubMed] [Google Scholar]
- [7].Xu Y, Deng W, Yang S, et al. Dosimetric comparison of the helical tomotherapy, volumetric-modulated arc therapy and fixed-field intensity-modulated radiotherapy for stage IIB-IIIB non-small cell lung cancer. Sci Rep 2017;7:14863. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [8].Kilburn JM, Soike MH, Lucas JT, et al. Image guided radiation therapy may result in improved local control in locally advanced lung cancer patients. Pract Radiat Oncol 2016;6:e73–80. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [9].Chang JY, Verma V, Li M, et al. Proton beam radiotherapy and concurrent chemotherapy for unresectable stage III non-small cell lung cancer: Final results of a phase 2 study. JAMA Oncol 2017;3:e172032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [10].Li XA, Tai A, Arthur DW, et al. Variability of target and normal structure delineation for breast cancer radiotherapy: an RTOG multi-institutional and multiobserver study. Int J Radiat Oncol Biol Phys 2009;73:944–51. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [11].Wennstig AK, Garmo H, Hallstrom P, et al. Inter-observer variation in delineating the coronary arteries as organs at risk. Radiother Oncol 2017;122:72–8. [DOI] [PubMed] [Google Scholar]
- [12].Ayyalusamy A, Vellaiyan S, Subramanian S, et al. Auto-segmentation of head and neck organs at risk in radiotherapy and its dependence on anatomic similarity. Radiat Oncol J 2019;37:134–42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [13].Lee H, Lee E, Kim N, et al. Clinical evaluation of commercial atlas-based auto-segmentation in the head and neck region. Front Oncol 2019;9:239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [14].Delpon G, Escande A, Ruef T, et al. Comparison of automated atlas-based segmentation software for postoperative prostate cancer radiotherapy. Front Oncol 2016;6:178. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [15].Men K, Zhang T, Chen X, et al. Fully automatic and robust segmentation of the clinical target volume for radiotherapy of breast cancer using big data and deep learning. Phys Med 2018;50:13–9. [DOI] [PubMed] [Google Scholar]
- [16].Ibragimov B, Toesca D, Chang D, et al. Combining deep learning with anatomical analysis for segmentation of the portal vein for liver SBRT planning. Phys Med Biol 2017;62:8943–58. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [17].Ibragimov B, Xing L. Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 2017;44:547–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [18].Zhu J, Zhang J, Qiu B, et al. Comparison of the automatic segmentation of multiple organs at risk in CT images of lung cancer between deep convolutional neural network-based and atlas-based techniques. Acta Oncolog (Stockholm, Sweden) 2019;58:257–64. [DOI] [PubMed] [Google Scholar]
- [19].Men K, Dai J, Li Y. Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks. Med Phys 2017;44:6377–89. [DOI] [PubMed] [Google Scholar]
- [20].Men K, Chen X, Zhang Y, et al. Deep deconvolutional neural network for target segmentation of nasopharyngeal cancer in planning computed tomography images. Front Oncol 2017;7:315. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [21].Bi N, Wang J, Zhang T, et al. Deep learning improved clinical target volume contouring quality and efficiency for postoperative radiation therapy in non-small cell lung cancer. Front Oncol 2019;9:1192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [22].Zijdenbos AP, Dawant BM, Margolin RA, et al. Morphometric analysis of white matter lesions in MR images: method and validation. IEEE Trans Med Imaging 1994;13:716–24. [DOI] [PubMed] [Google Scholar]
- [23].Wardman K, Prestwich RJ, Gooding MJ, et al. The feasibility of atlas-based automatic segmentation of MRI for H&N radiotherapy planning. J Appl Clin Med Phys 2016;17:146–54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [24].Wittenstein O, Hiepe P, Sowa LH, et al. Automatic image segmentation based on synthetic tissue model for delineating organs at risk in spinal metastasis treatment planning. Strahlenther Onkol 2019;195:1094–103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- [25].Schreibmann E, Marcus DM, Fox T. Multiatlas segmentation of thoracic and abdominal anatomy with level set-based local search. J Appl Clin Med Phys 2014;15:4468. [DOI] [PMC free article] [PubMed] [Google Scholar]