Abstract
Entropy is a promising quantitative imaging biomarker for characterizing cancer imaging phenotype. Entropy has been associated with tumor gene expression, tumor metabolism, tumor stage, patient prognosis, and treatment response. Our hypothesis states that tumor-specific biomarkers such as entropy should be correlated between synchronous metastases. Therefore, a significant proportion of the variance of entropy should be attributed to the malignant process. We analyzed 112 patients with matched/paired synchronous metastases (SM#1 and SM#2) prospectively enrolled in the MOSCATO-01 clinical trial. Imaging features were extracted from Regions Of Interest (ROI) delineated on CT-scan using TexRAD software. We showed that synchronous metastasis entropy was correlated across 5 Spatial Scale Filters: Spearman’s Rho ranged between 0.41 and 0.59 (P = 0.0001, Bonferroni correction). Multivariate linear analysis revealed that entropy in SM#1 is significantly associated with (i) primary tumor type; (ii) entropy in SM#2 (same malignant process); (iii) ROI area size; (iv) metastasis site; and (v) entropy in the psoas muscle (reference tissue). Entropy was a logarithmic function of ROI area in normal control tissues (aorta, psoas) and in mathematical models (P < 0.01). We concluded that entropy is a tumor-specific metric only if confounding factors are corrected.
Introduction
Tumors exhibit an extensive genetic and phenotypic variation. This translates to a heterogeneity that can be observed at different scales: between patients, across metastases from the same primary tumor, or within a single metastasis. Importantly, intra and inter-tumor heterogeneity also undergoes temporal variation due to genomic instability and is recognized as a prominent factor leading to cancer treatment failure and poor prognosis1–6. Spatial and temporal heterogeneity can be accurately estimated through sophisticated genomic analyses, but these approaches typically require invasive tumor biopsies and are also limited to the sampling site1–6.
Recent progress in the medical image-computing field has allowed for the extraction of advanced quantitative imaging biomarkers without any additional examinations or costs. These noninvasive biomarkers describe the tumor’s imaging phenotype and extract metrics that measure in vivo the inner organization of any visible metastasis (i.e. virtual biopsies). They can evaluate the spatial dissemination of the malignant process as well as the surrounding tissue (i.e. host). Additionally, they can assess the temporal evolution of the malignancy since medical imaging procedures are performed regularly across the treatment sequence in most cancer patients (i.e. diagnosis, staging, and treatment monitoring). Medical imaging could thus measure the heterogeneity of the tumor imaging phenotype along the treatment sequence or course of disease and provide valuable new information.
First order statistics provide the most widely used metrics for the quantification of imaging phenotype. Imaging biomarkers are often extracted from a single two-dimensional CT-scan slice. The delineation of the entire three-dimensional tumor volume is indeed difficult to routinely perform in clinical practice. The research community has developed several ready-to-fit solutions such as TexRAD (Cambridge, United Kingdom), the key advantage of which is the apparent simplicity of the process. The tumor is segmented on CT-scan (an ROI or Region Of Interest is defined) and the signal intensity in each voxel is calculated. This corresponds to the attenuation of X-ray beam photons, which in turn is represented by the density in Hounsfield Units of the tissue (difference of density in comparison to water). Different spatial scale filters (SSFs) will ultimately modify all of these outputs (Fig. 1). Finally, the software computes Shannon’s entropy and other low order textural features. Beyond TexRAD, the radiomics community has developed a wide range of solutions allowing for the extraction of those metrics and an even larger dataset of imaging features through simple pipelines. The extraction is based on open-source and free solutions with inter-operable locked docker containers (e.g. Radiomics.io using 3D-Slicer7, IBEX8, LIFEX9) or home-grown robust algorithms10.
An increasing body of studies in the literature are proving the potential clinical value of Shannon’s entropy calculated after a Laplacian of Gaussian transformation using the settings included in the TexRAD software11–19. These studies have depicted that entropy is associated with staging11, 12, outcome13–16, expression of molecular pathways such as tumor metabolism11, 12, and treatment response11–15, 17–19 in esophageal, lung, colorectal, and head and neck cancers. These articles have received very positive feedback from the oncology and radiology communities, especially considering the critical need for alternative imaging biomarkers. This need has arisen with the advent of precision medicine and new drugs associated with atypical patterns of response that get misclassified by conventional response criteria20–28.
The quantification of spatial or temporal heterogeneity in the cancer imaging phenotype requires the identification of robust tumor-specific quantitative metrics. Recent studies in radiomics, however, have raised awareness about the importance of properly setting imaging acquisition parameters10. Indeed, any valid imaging biomarker changes should be attributed to changes in tumor biological characteristics and not to confounding factors. As entropy is one of the most promising metrics according to the current literature, we further explored its significance.
Our underlying assumption is that tumor-specific quantitative metrics can be identified by a comparison of paired synchronous metastases (SM) issued from the same primary tumor, developing at the same time and in the same organ of a given patient. These SM are indeed expected to share important phenotypic similarities (genomic and radiomic), as they are seeds spreading at the same time and in the same soil29. Our hypothesis states that entropy should be correlated between matched and paired biopsy-proven SM, and that a significant proportion of the variance of entropy should be attributed to the malignant process and not to confounding factors. To this end, we used a large series of patients prospectively enrolled in the MOSCATO-01 precision medicine trial.
Results
Patient characteristics
We screened a cohort of 525 pts. The most frequent primary tumor types were lung (n = 102 pts, 19%), head and neck (n = 65 pts, 12%), colorectal (n = 64 pts, 12%) and urothelium (n = 99 pts, 19%).
We included 112 pts with paired synchronous biopsy proven metastases (SM#1 and SM#2) in a single organ. The most frequent primary tumor types in this group were lung (n = 28 pts, 25%), head and neck (n = 15 pts, 13%), colorectal (n = 14 pts, 12%), urothelium (n = 7 pts, 6%), prostate (n = 7 pts, 6%), and liver and bile duct (n = 6 pts, 5%). The sites of the biopsies were lung (n = 36 pts, 32%), liver (n = 35 pts, 31%), lymph nodes (n = 25 pts, 22%) and viscera (n = 16 pts, 14%).
Lesion characteristics
The average ± standard deviation of entropy in the 112 patients was 4.36 ± 0.62 in SM#1, 4.15 ± 0.85 in SM#2, 4.09 ± 0.53 in the psoas muscle, and 4.42 ± 0.52 in the aorta. The average ± standard deviation of ROI area (pixels) in the 112 patients was 978 ± 1727 in SM#1, 723 ± 1510 in SM#2, 452 ± 350 in the psoas muscle and 1492 ± 1210 in the aorta.
Comparison of the imaging phenotype of synchronous metastases
We explored the similarity of imaging phenotype between 112 pairs of biopsy-proven synchronous metastases occurring at the same time and in the same organ of a given patient (Fig. 1). To this end, we computed the Spearman’s rho correlation coefficient between entropy in SM#1 vs. entropy in SM#2. The Spearman’s rho was 0.59-0.57-0.55-0.41-0.41 at spatial scale filters (SSF) 2-3-4-5-6, respectively (P = 0.0001, Bonferroni correction, Fig. 2).
The Spearman’s rho coefficient between SM#1 vs. SM#2 (n = 112 pairs) was calculated for Mean (r = 0.68*), Standard Deviation (r = 0.43*), Mean Positive Pixels (r = 0.43*), Skewness (r = 0.24) and Kurtosis (r = −0.02). Some correlations were statistically significant after Bonferonni correction (*), however none of them outperformed entropy. The intra and inter-tumor (#1 vs. #1, #2 vs. #2) Spearman’s rho correlation coefficients are displayed as supplemental material.
Multivariate linear analysis
We explored the proportion of the variance of entropy attributable to the malignant process as opposed to confounding factors. To this end, we fitted a multivariate linear analysis. Entropy in SM#1 was significantly associated with (Table 1): (i) the primary tumor type (e.g. lung adenocarcinoma, colorectal adenocarcinoma, head and neck squamous cell carcinoma, etc), (ii) the entropy in SM#2 (malignant pattern recognition), (iii) the SM#1 ROI area, (iv) the anatomical metastasis site (e.g. liver, lymph node, lung, etc), and (v) the entropy in the psoas muscle (normal control tissue). We obtained the same results at each SSF (2-3-4-5-6) independently. Table 1 pools all of the SSFs. Consequently, the primary tumor type and the malignant process explain a significant portion of the variance of entropy but there are confounding variables that alter the output.
Table 1.
Variable | Coefficient (estimate) | Significance (P Value) |
---|---|---|
Intercept (reference) | 1.96 | <10−5 |
Entropy of synchronous metastasis #2 (malignant process) | 0.06 | <10−3 |
ROI area of synchronous metastasis #1 (volume-dependence) | 0.65 | <10−5 |
Entropy of psoas muscle (acquisition protocol) | 0.15 | <10−5 |
Site of the metastasis | ||
Lymph node | ||
Liver | 0.12 | 0.03 |
Lung | −0.08 | 0.17 |
Viscera | 0.14 | 0.03 |
Primary Tumor | ||
Prostate | ||
Urothelium | −0.15 | 0.08 |
Lung or pleura | −0.20 | 0.02 |
Digestive tract | −0.04 | 0.68 |
Liver and bile ducts | 0.07 | 0.50 |
ENT and thymus | −0.22 | 0.01 |
Ovary, Uterus, Testicle | -0.11 | 0.22 |
Breast | −0.15 | 0.19 |
Pancreas | −0.23 | 0.03 |
Other | −0.21 | 0.03 |
Multivariate linear analysis shows that entropy in SM#1 is a function of the ROI area of SM#1 (volume-dependence), the entropy of SM#2 (malignant pattern recognition), the entropy of the psoas muscle (acquisition protocol), the site of metastasis, and the primary tumor.
Association between ROI area and entropy
Since the ROI area size explains a significant portion of the variance of entropy, we further explored the association between the entropy and the ROI area in three different settings: (i) malignant tissues, (ii) normal tissues and (iii) mathematical models.
First, we computed the association in the entire set of synchronous metastases (n = 224 lesions). We observed that entropy was directly correlated with ROI area when the ROI was smaller than 200 pixels and reached a plateau when the ROI was larger than 200 pixels (Fig. 3). There was a strong linear association between log10 (ROI area in pixels) and entropy: spearman rho = 0.8 (P < 1e-5).
Second, we explored the association in normal control tissues (i.e. non-malignant tissues). We showed the same strong association of ROI area and entropy in the psoas muscle (P < 0.001) and the aorta (P < 0.001).
Third, we calculated Shannon’s entropy in function of the number of repetitions of the same 690 pixel image (Fig. 4). The same trend was observed.
Consequently, the strong association between the entropy and the ROI area was demonstrated in all models, whichever tissue was considered.
Association between ROI area and entropy in SM#1 vs. SM#2
We investigated if the difference in entropy between SM could be explained by the difference in tumor ROI area. We thus computed the distribution of entropy in SM#1 and SM#2 in function of the ROI area (Figs 3 and 4). The inter-tumor difference in entropy appeared to be a linear function of inter-tumor difference in ROI area (P < 0.01). We observed that tumors exhibiting the higher correlations in terms of entropy were also those with the most similar ROI area (Fig. 3).
Normal control tissue
We explored whether the entropy from SM#1 was correlated with the entropy in a normal control tissue: the psoas muscle. We observed a significant correlation: Spearman Rho = 0.41 (P < 1e-5).
Prognostic value of entropy for overall survival
Since entropy was similar between synchronous metastases and could be a tumor-specific imaging biomarker, we computed the prognostic value for overall survival analysis. To this end, we calculated the association between entropy within biopsy-proven SM#1 and overall survival in the entire cohort of screened patients (n = 525 pts).
The comparison between groups could not be analyzed with the Kaplan Meier method because the curves crossed each other many times across SSFs, therefore violating the condition for use of the log-rank test (Fig. 5). Strikingly, the sign of the associations tended to reverse from SSF2 (High entropy = 7.17 months, Low entropy = 11.40 months) to SSF6 (High entropy = 9.53 months, Low entropy = 7.79 months). Consequently, the effect of SSF is substantial, and influences the association between entropy and survival.
The lower and upper estimation of concordance index were 0.39 and 0.53 respectively. The concordance index was not significant (P-value > 0.19) which suggests that entropy does not predict overall survival.
Discussion
Entropy has received special attention from the medical imaging community9, 11–19, 31–34. Our study proposed a methodology for exploration of the biological meaning of the entropy imaging feature as measured on clinical CT-scans. We demonstrated that entropy is specific to a given malignant process, but is also influenced by confounding factors.
We compared tumors sharing important biological similarities: paired biopsy-proven synchronous metastases. Synchronous metastases are indeed issued from the same primary tumor and are defined by simultaneous development in the cancer history of a given patient29. We compared the imaging phenotype of paired synchronous metastases occurring in the same organ as viewed by single time point CT-scan acquisitions. We showed that similar biological characteristics translated to similar entropy. By pooling data from multiple tumor types and sites, we showed that entropy is a function of the primary tumor type, the site of tumor growth (lymph node, lung, liver), and the specific malignant process (all P < .001). The complete comparison of paired synchronous metastasis imaging phenotypes and the stability of the imaging biomarkers across SSFs are shown in the supplemental materials (Supplemental Figs 1–2 and Supplemental Table 1–3).
The current mainstream hypothesis is that high entropy is instrumental to the appraisal of intra and inter-tumor heterogeneity through the radiomic approach. However, the present study sheds light on the potential caveats and biases in such a claim. We indeed found a significant impact from multiple confounding factors such as the ROI area size, the acquisition protocol, and the anatomical site of metastasis (Table 1). Taking these confounding variables into account is crucial if we are to revisit previously published results and robustly translate radiomic analysis into the clinical setting.
ROI area size is the most significant confounding factor that we need to take into account when computing Shannon entropy on CT-scans. According to our results, a proper measurement of the entropy within a tumor requires a minimum ROI area of 200 pixels in all tissue types (tumor, psoas muscle, aorta). The 200 pixel threshold should be applied prior to calculation of the entropy feature. This strong area-dependence constitutes a major technical challenge and caveat that might be partially explained by the finite sample size effect35. The pixel intensity distribution is indeed a continuous variable that is transformed into the probability of a discrete state: the continuous original intensity values are replaced by a single value representative of an interval (M = number of bins used for signal processing). This discretization leads to an expected systematic underestimation of entropy (because statistical fluctuations tend to decrease the distribution uniformity), that is only approximately calculable36–38: True entropy = observed entropy + (M−1)/2 N with N being the number of pixels analyzed within the ROI. In our experiment, the number of bins was the same in all patients but the number of pixels within ROIs was variable and thus smaller ROIs are expected to have greater underestimation. For example, the mean number of pixels within SM#1 was 978 leading to a theoretical underestimation of entropy from 3% to 13% if the bins are 64 and 256, respectively.
The demonstration of entropy’s dependence on logarithmic area is crucial13 because it may have biased the previous associations of entropy with: (i) staging, (ii) outcome, (iii) pathology, and (iv) treatment response11–19, 31, 32. First, entropy has been associated with clinical T-stage11, 12 but T-stage is defined by the size of the primary tumor. Second, entropy has predicted patient survival13–16 but tumor burden is a predictor of outcome39. Third, entropy was correlated with tumor glycolytic metabolism11, 12 but partial volume effect on PET is associated with lesion volume. Finally, in a wide range of cancer types11–15, 17–19, 31, 32, entropy is correlated with treatment response that is defined by variation in tumor diameter. Therefore, further studies will have to tackle this area/volume-dependence problem by investigating solutions such as sampling ROIs with a standardized area, defining a new variable such as an area-corrected entropy, or by reporting a posteriori the expected error bars.
Tumor heterogeneity is associated with poor prognosis and resistance to anticancer treatment across various tumor types1–6 and could be instrumental in predicting the efficacy of treatment with atypical patterns of response24, 40–42. We therefore explored the association between entropy and overall survival6. We showed the strong impact of signal processing (i.e. spatial scale filters) on entropy-outcome association in a large series of 525 patients. Since the SSFs (i.e. Laplacian of Gaussian transformation or spatial scale filters) are looking at different size features of the tumor (1–2 mm for fine and 5–6 mm for coarse), these conflicting results could be explained by the fact that they are evaluating different features or processes within the tumor. This needs to be explored and is beyond the scope of our study.
We showed that the entropy in a normal control tissue (psoas muscle) was associated with the entropy within the metastases. Although a full explanation of this association is beyond the scope of this paper, the inherent variability in image acquisition could explain this association. First, the intensity of the signal within voxels might be influenced by slight variations in the acquisition protocol. Second, the Laplacian of Gaussian kernel can be sensitive to the image noise and therefore affect the edge detection by the filter. Third, the contrast enhancement of the psoas muscle tissue and the metastases on CT-scan is subject to slight variability due to contrast enhancement product injection variability (increased volume, output, concentration) and to individual patient characteristics (decreased patient weight or cardiac output). The final hypothesis is that there is an association between the metastatic process and the skeletal muscle index39. Of note, it is difficult to find a perfect normal control tissue in sick and deconditioned cancer patients, especially since previous chemotoxic therapy has the potential to alter all types of tissue.
The caveat of Shannon’s entropy (used in TexRAD) should not be mistaken as a caveat of entropy itself. There are different models for the estimation of entropy and while Shannon’s is the most popular model, it is also the earliest and simplest model36, 43. Shannon’s entropy indeed systematically considerably overestimates entropy35 due to the erroneous underlying assumption that all pixels are independent (from their neighbor) and identically distributed. Consequently, a simple refinement could involve its measure at different scales of observation.
Similarly, the caveat of entropy should not be mistaken as caveat of Radiomics. Shannon’s entropy is indeed a first order statistic based only on the image histogram, which collapses the information regarding the spatial organization of voxels in the image to one dimension. As a comparison, second order features could be referred to as textural features because they investigate the spatial relationships between voxels such as distance, size zone matrix, and run length. Alternatives should be brought in for comparison in future imaging heterogeneity quantification: (i) Markov Random Fields are models emphasizing the dependencies between neighboring pixels44, 45 but face inherent computational complexity; (ii) simple and promising metrics are emerging from the field of geographical analysis43, 46 and allow for computation of the spatial configuration of pixels; (iii) the very active fields of Deep Learning and Deep Neural Networks are becoming increasingly efficient for tasks such as object and/or pattern recognition47–50.
Finally, our methodology could ultimately allow for the identification of new tumor-specific quantitative imaging metrics. The potential for identification of a radiomic signature specific to a given malignant process creates enticing research perspectives for virtual biopsy by imaging16, 51–53: (i) quantification of intra/inter-patient intra/inter-tumor spatial and temporal heterogeneity of the cancer imaging phenotype; (ii) deciphering the tumor microenvironment; (iii) computer-aided prediction of treatment efficacy or diagnosis of a malignant process.
In conclusion, the broad communities of radiology, oncology, and radiotherapy should be aware of the need to take into account the effects of ROI area size, metastatic site, and the individual characteristics of image acquisitions when quantifying and interpreting radiomic-based entropy as a tumor-specific surrogate for intra and inter-tumor heterogeneity. Only the proper evaluation and rigorous testing of nascent radiomic-biomarkers will allow their final implementation into the clinic.
Methods
Patients
We screened 525 consecutive patients prospectively enrolled in the MOSCATO-01 precision medicine trial (Gustave Roussy, Villejuif, France, NCT01566019). Patients were included after informed consent. The experimental protocol of the MOSCATO trial was carried out in accordance with guidelines and regulations and was approved by our institutional review board (Gustave Roussy, Villejuif, France). In this trial, each patient had a targeted tumor biopsy (synchronous metastases SM#1) to determine its molecular profile and was subsequently prescribed a molecular targeted therapy adapted to the molecular profile. The sample size was derived from power calculation, which is provided as a supplementary material.
Synchronous metastases
Senior radiologists selected 112 patients out of 525 patients screened in MOSCATO trial presenting synchronous metastases (SM). Inclusion criteria were: (i) SM are within the same organ during the same acquisition; (ii) SM developed at the same time in the cancer history of a given patient; (iii) SM showed similarity in imaging phenotype according to visual analysis; (iv) SM have a minimal diameter of 1 cm (short axis). The main focus of this methodology is ensuring identical CT acquisition characteristics to minimize acquisition parameters as a source of intra-patient variability. To this end, using single acquisitions also ensures that: (i) the same contrast agent was injected at the same volume and rate; (ii) the contrast enhancement was identical (acquisition time was at the portal venous phase).
Image acquisition
Whole body CT-scan acquisitions were obtained using a 64 HiSpeed spiral scanner (GE Medical Systems, Milwaukee, WI) after monophasic injection of monoionic contrast agent (Xenetix® 300; Guerbet, France). The typical CT parameters were: smooth convolution Kernel, 2 mm slice thickness, 1.4 mm slice interval, 0.7 s exposure time per rotation, tube current of 225 mAs, and 120 kVP.
Radiomic feature extraction
TexRAD allows for the extraction of imaging features within a region of interest (ROI). Accordingly, four ROIs were delineated by senior radiologists in each patient: the largest cross section of the lesion considered for biopsy by the radiologist (SM#1), the largest cross section of the next largest synchronous metastasis in that same organ (SM#2), an ROI within the psoas muscle (delineated at the level of vertebra L3), and an ROI in the thoracic descending aorta. The first step was a filtering of signal intensity within the ROI, which defines the level and windows (minimum and maximum) in Hounsfield Units that would be considered for histogram analysis. Identical TexRAD filters designed for the analysis of soft tissue with contrast enhancement were used for the paired synchronous metastases (min: + 40HU: max: + 400HU). The second step was a filtering technique using a Laplacian of Gaussian band-pass filter. Five spatial scale filters (SSF2 to SSF6) evaluated the ROI at different scales with object radii of different sizes (2, 3, 4, 5, 6 mm) which are not dependent (invariant) on the pixel size (SSF2: 2 mm in radius to SSF6: 6 mm in radius) thus allowing evaluation of different imaging features (from fine to coarse features).
Entropy was defined as previously described54 by the equation: with k indicates grey-level from 1 to k, I reflects the intensity of the pixel value and p(I) the probability of the occurrence of that pixel intensity value. To note, in the literature this formula is also known as the Shannon entropy. It is considered, according to information theory, as a statistical measure of randomness and of the homogeneity of the number of voxels per level that corresponded to the amount of information that is needed to specify the full microstate of the system.
Statistical methods
Descriptive statistics were performed using conventional metrics (mean, median, range). First, we compared the imaging phenotype of synchronous metastases by Spearman’s rho correlation coefficient with P-value corrected for multiple tests. Second, we evaluated if there was an association between confounding factors and entropy in SM#1 by multivariate linear regression model. Third, we evaluated the influence of the ROI area on the estimation of entropy by univariate regression model and non-parametric Spearman test. Fourth, we computed the difference in entropy between synchronous metastases as a function of the difference in ROI area by univariate regression model. Fifth, we explored whether the entropy from the SM#1 was associated with the entropy assessed in a ROI delineated in a reference non-tumoral tissue by univariate regression model and non-parametric Spearman test. Finally, we computed the prognostic value of entropy for overall survival analysis. We compared the overall survival in two groups: high entropy when entropy is above the median, and low entropy otherwise. Overall survival medians within these groups were estimated with the Kaplan Meier method. We computed the concordance index for validating the predictive ability of a model based on the increase in entropy for the prediction of overall survival. For this we used the package survcomp from Bioconductor30. Statistical analyses were performed using R version 3.3.0 and SPSS 24.0.
Data Availability
The datasets generated and analyzed during the current study are available from the corresponding author.
Electronic supplementary material
Acknowledgements
The authors want to thank Philip Lichtenstein, MD for his thorough comments in editing the final version of the manuscript. L Dercle work is funded by a grant from the Philanthropia Foundation, Geneva, Switzerland and the foundation ARC, Villejuif, France.
Author Contributions
S.A. and L.D. extracted the imaging features. C.F., L.D., P.B.D. and M.B. performed the statistical analysis. L.D. prepared figures. J.C.S., C.M., A.V., E.D. were involved in the recruitment of patients in the clinical parent MOSCATO trial. L.D. and C.F. designed the study. All authors reviewed the manuscript.
Competing Interests
The authors declare that they have no competing interests.
Footnotes
Electronic supplementary material
Supplementary information accompanies this paper at doi:10.1038/s41598-017-08310-5
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Laurent Dercle, Email: laurent.dercle@gmail.com.
Charles Ferté, Email: charles.ferte@gustaveroussy.fr.
References
- 1.Ogino S, Stampfer M. Lifestyle factors and microsatellite instability in colorectal cancer: the evolving field of molecular pathological epidemiology. J Natl Cancer Inst. 2010;102:365–367. doi: 10.1093/jnci/djq031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Ogino S, Goel A. Molecular classification and correlates in colorectal cancer. J Mol Diagn. 2008;10:13–27. doi: 10.2353/jmoldx.2008.070082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Ogino S, Chan AT, Fuchs CS, Giovannucci E. Molecular pathological epidemiology of colorectal neoplasia: an emerging transdisciplinary and interdisciplinary field. Gut. 2011;60:397–411. doi: 10.1136/gut.2010.217182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Marusyk A, Almendro V, Polyak K. Intra-tumour heterogeneity: a looking glass for cancer? Nat Rev Cancer. 2012;12:323–334. doi: 10.1038/nrc3261. [DOI] [PubMed] [Google Scholar]
- 5.Brock A, Chang H, Huang S. Non-genetic heterogeneity–a mutation-independent driving force for the somatic evolution of tumours. Nat Rev Genet. 2009;10:336–342. doi: 10.1038/nrg2556. [DOI] [PubMed] [Google Scholar]
- 6.Burrell RA, McGranahan N, Bartek J, Swanton C. The causes and consequences of genetic heterogeneity in cancer evolution. Nature. 2013;501:338–345. doi: 10.1038/nature12625. [DOI] [PubMed] [Google Scholar]
- 7.Fedorov A, et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magn Reson Imaging. 2012;30:1323–1341. doi: 10.1016/j.mri.2012.05.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Zhang L, et al. IBEX: an open infrastructure software platform to facilitate collaborative work in radiomics. Med Phys. 2015;42:1341–1353. doi: 10.1118/1.4908210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Orlhac F, et al. Tumor texture analysis in 18F-FDG PET: relationships between texture parameters, histogram indices, standardized uptake values, metabolic volumes, and total lesion glycolysis. J Nucl Med. 2014;55:414–422. doi: 10.2967/jnumed.113.129858. [DOI] [PubMed] [Google Scholar]
- 10.Zhao B, et al. Reproducibility of radiomics for deciphering tumor phenotype with imaging. Sci Rep. 2016;6:23428. doi: 10.1038/srep23428. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ganeshan B, Skogen K, Pressney I, Coutroubis D, Miles K. Tumour heterogeneity in oesophageal cancer assessed by CT texture analysis: preliminary evidence of an association with tumour metabolism, stage, and survival. Clin Radiol. 2012;67:157–164. doi: 10.1016/j.crad.2011.08.012. [DOI] [PubMed] [Google Scholar]
- 12.Ganeshan B, Abaleke S, Young RC, Chatwin CR, Miles KA. Texture analysis of non-small cell lung cancer on unenhanced computed tomography: initial evidence for a relationship with tumour glucose metabolism and stage. Cancer Imaging. 2010;10:137–143. doi: 10.1102/1470-7330.2010.0021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ng F, Kozarski R, Ganeshan B, Goh V. Assessment of tumor heterogeneity by CT texture analysis: can the largest cross-sectional area be used as an alternative to whole tumor analysis? Eur J Radiol. 2013;82:342–348. doi: 10.1016/j.ejrad.2012.10.023. [DOI] [PubMed] [Google Scholar]
- 14.Ganeshan B, Panayiotou E, Burnand K, Dizdarevic S, Miles K. Tumour heterogeneity in non-small cell lung carcinoma assessed by CT texture analysis: a potential marker of survival. Eur Radiol. 2012;22:796–802. doi: 10.1007/s00330-011-2319-8. [DOI] [PubMed] [Google Scholar]
- 15.Ng F, Ganeshan B, Kozarski R, Miles KA, Goh V. Assessment of primary colorectal cancer heterogeneity by using whole-tumor texture analysis: contrast-enhanced CT texture as a biomarker of 5-year survival. Radiology. 2013;266:177–184. doi: 10.1148/radiol.12120254. [DOI] [PubMed] [Google Scholar]
- 16.Miles KA, et al. Multifunctional imaging signature for V-KI-RAS2 Kirsten rat sarcoma viral oncogene homolog (KRAS) mutations in colorectal cancer. J Nucl Med. 2014;55:386–391. doi: 10.2967/jnumed.113.120485. [DOI] [PubMed] [Google Scholar]
- 17.Zhang H, et al. Locally advanced squamous cell carcinoma of the head and neck: CT texture and histogram analysis allow independent prediction of overall survival in patients treated with induction chemotherapy. Radiology. 2013;269:801–809. doi: 10.1148/radiol.13130110. [DOI] [PubMed] [Google Scholar]
- 18.Yip C, et al. Assessment of changes in tumor heterogeneity following neoadjuvant chemotherapy in primary esophageal cancer. Dis Esophagus. 2015;28:172–179. doi: 10.1111/dote.12170. [DOI] [PubMed] [Google Scholar]
- 19.Yip C, et al. Primary esophageal cancer: heterogeneity as potential prognostic biomarker in patients treated with definitive chemotherapy and radiation therapy. Radiology. 2014;270:141–148. doi: 10.1148/radiol.13122869. [DOI] [PubMed] [Google Scholar]
- 20.Schwartz LH, et al. RECIST 1.1 - Standardisation and disease-specific adaptations: Perspectives from the RECIST Working Group. Eur J Cancer. 2016;62:138–145. doi: 10.1016/j.ejca.2016.03.082. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Schwartz LH, et al. RECIST 1.1-Update and clarification: From the RECIST committee. Eur J Cancer. 2016;62:132–137. doi: 10.1016/j.ejca.2016.03.081. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Choi H, et al. CT evaluation of the response of gastrointestinal stromal tumors after imatinib mesylate treatment: a quantitative analysis correlated with FDG PET findings. AJR Am J Roentgenol. 2004;183:1619–1628. doi: 10.2214/ajr.183.6.01831619. [DOI] [PubMed] [Google Scholar]
- 23.Choi H, et al. Correlation of computed tomography and positron emission tomography in patients with metastatic gastrointestinal stromal tumor treated at a single institution with imatinib mesylate: proposal of new computed tomography response criteria. J Clin Oncol. 2007;25:1753–1759. doi: 10.1200/JCO.2006.07.3049. [DOI] [PubMed] [Google Scholar]
- 24.Dercle L, et al. Nonsurgical giant cell tumour of the tendon sheath or of the diffuse type: Are MRI or F-FDG PET/CT able to provide an accurate prediction of long-term outcome? Eur J Nucl Med Mol Imaging. 2014 doi: 10.1007/s00259-014-2938-9. [DOI] [PubMed] [Google Scholar]
- 25.Hodi FS, et al. Evaluation of Immune-Related Response Criteria and RECIST v1.1 in Patients With Advanced Melanoma Treated With Pembrolizumab. J Clin Oncol. 2016 doi: 10.1200/JCO.2015.64.0391. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Wolchok JD, et al. Guidelines for the evaluation of immune therapy activity in solid tumors: immune-related response criteria. Clin Cancer Res. 2009;15:7412–7420. doi: 10.1158/1078-0432.CCR-09-1624. [DOI] [PubMed] [Google Scholar]
- 27.Hoos A, et al. Improved endpoints for cancer immunotherapy trials. J Natl Cancer Inst. 2010;102:1388–1397. doi: 10.1093/jnci/djq310. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Dercle L, et al. 18F-FDG PET and CT-scan Detect New Imaging Patterns of Response and Progression in Patients with Hodgkin Lymphoma Treated by Anti-PD1 Immune Checkpoint Inhibitor. J Nucl Med. 2017 doi: 10.2967/jnumed.117.193011. [DOI] [PubMed] [Google Scholar]
- 29.Fidler, I. J. The pathogenesis of cancer metastasis: the’seed and soil’hypothesis revisited. Nature Reviews Cancer3, 453–458%@ 1474–1175X (2003). [DOI] [PubMed]
- 30.Schröder MS, Culhane AC, Quackenbush J, Haibe-Kains B. survcomp: an R/Bioconductor package for performance assessment and comparison of survival models. Bioinformatics. 2011;27:3206–3208. doi: 10.1093/bioinformatics/btr511. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Tixier F, et al. Correlation of intra-tumor 18F-FDG uptake heterogeneity indices with perfusion CT derived parameters in colorectal cancer. PLoS One. 2014;9:e99567. doi: 10.1371/journal.pone.0099567. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Tixier F, et al. Intratumor heterogeneity characterized by textural features on baseline 18F-FDG PET images predicts response to concomitant radiochemotherapy in esophageal cancer. J Nucl Med. 2011;52:369–378. doi: 10.2967/jnumed.110.082404. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Hatt M, et al. 18F-FDG PET uptake characterization through texture analysis: investigating the complementary nature of heterogeneity and functional tumor volume in a multi-cancer site patient cohort. J Nucl Med. 2015;56:38–44. doi: 10.2967/jnumed.114.144055. [DOI] [PubMed] [Google Scholar]
- 34.Brooks FJ, Grigsby PW. The effect of small tumor volumes on studies of intratumoral heterogeneity of tracer uptake. J Nucl Med. 2014;55:37–42. doi: 10.2967/jnumed.112.116715. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Shannon CE. A mathematical theory of communication. ACM SIGMOBILE Mobile Computing and Communications Review. 2001;5:3–55. doi: 10.1145/584091.584093. [DOI] [Google Scholar]
- 36.Razlighi, Q. & Kehtarnavaz, N. In IS&T/SPIE Electronic Imaging. 72571X-72571X-72510 (International Society for Optics and Photonics).
- 37.Miller GA. Note on the bias of information estimates. Information theory in psychology: Problems and methods. 1955;2:95–100. [Google Scholar]
- 38.Wolpert DH, Wolf DR. Estimating functions of probability distributions from a finite set of samples. Physical Review E. 1995;52:6841. doi: 10.1103/PhysRevE.52.6841. [DOI] [PubMed] [Google Scholar]
- 39.Dercle L, et al. Rapid and objective CT scan prognostic scoring identifies metastatic patients with long-term clinical benefit on anti-PD-1/-L1 therapy. Eur J Cancer. 2016;65:33–42. doi: 10.1016/j.ejca.2016.05.031. [DOI] [PubMed] [Google Scholar]
- 40.Michot JM, et al. Abscopal effect in a Hodgkin lymphoma patient treated by an anti-programmed death 1 antibody. Eur J Cancer. 2016;66:91–94. doi: 10.1016/j.ejca.2016.06.017. [DOI] [PubMed] [Google Scholar]
- 41.Limkin EJ, et al. Promises and challenges for the implementation of computational medical imaging (radiomics) in oncology. Ann Oncol. 2017 doi: 10.1093/annonc/mdx034. [DOI] [PubMed] [Google Scholar]
- 42.Champiat S, et al. Hyperprogressive disease (HPD) is a new pattern of progression in cancer patients treated by anti-PD-1/PD-L1. Clin Cancer Res. 2016 doi: 10.1158/1078-0432.CCR-16-1741. [DOI] [PubMed] [Google Scholar]
- 43.Razlighi QR, Kehtarnavaz N, Nosratinia A. Computation of image spatial entropy using quadrilateral Markov random field. IEEE transactions on image processing. 2009;18:2629–2639. doi: 10.1109/TIP.2009.2029988. [DOI] [PubMed] [Google Scholar]
- 44.Tupin, F., Sigelle, M. & Maitre, H. In Image Processing, 2000. Proceedings. 2000 International Conference on. 725–728 (IEEE).
- 45.Herzel H, Schmitt A, Ebeling W. Finite sample effects in sequence analysis. Chaos, Solitons & Fractals. 1994;4:97–113. doi: 10.1016/0960-0779(94)90020-5. [DOI] [Google Scholar]
- 46.Claramunt, C. In International Conference on Spatial Information Theory. 218–231 (Springer).
- 47.Krizhevsky, A., Sutskever, I. & Hinton, G. E. In Advances in neural information processing systems. 1097–1105.
- 48.Sirinukunwattana K, et al. Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE transactions on medical imaging. 2016;35:1196–1206. doi: 10.1109/TMI.2016.2525803. [DOI] [PubMed] [Google Scholar]
- 49.Havaei, M. et al. Brain tumor segmentation with deep neural networks. Medical Image Analysis (2016). [DOI] [PubMed]
- 50.Basu, S. et al. A Theoretical Analysis of Deep Neural Networks for Texture Classification. arXiv preprint arXiv:1605.02699 (2016).
- 51.Weiss GJ, et al. Noninvasive image texture analysis differentiates K-ras mutation from pan-wildtype NSCLC and is prognostic. PLoS One. 2014;9:e100244. doi: 10.1371/journal.pone.0100244. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Skogen K, Ganeshan B, Good C, Critchley G, Miles K. Measurements of heterogeneity in gliomas on computed tomography relationship to tumour grade. J Neurooncol. 2013;111:213–219. doi: 10.1007/s11060-012-1010-5. [DOI] [PubMed] [Google Scholar]
- 53.Ganeshan B, et al. Non-small cell lung cancer: histopathologic correlates for texture parameters at CT. Radiology. 2013;266:326–336. doi: 10.1148/radiol.12112428. [DOI] [PubMed] [Google Scholar]
- 54.Ganeshan B, Miles KA, Young RC, Chatwin CR. Texture analysis in non-contrast enhanced CT: impact of malignancy on texture in apparently disease-free areas of the liver. Eur J Radiol. 2009;70:101–110. doi: 10.1016/j.ejrad.2007.12.005. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets generated and analyzed during the current study are available from the corresponding author.