Abstract
Simple Summary
Immune checkpoint inhibitors can be effective drugs to treat cancer. However, only a minority of patients derive benefits. An important determinant of treatment success is the abundance of CD8-expressing tumour-infiltrating lymphocytes (CD8+ TILs) in target tumours. The measurement of CD8+ TIL density in the clinical setting relies on tissue sampling. Radiomics, the process of extracting a large number of features from radiological images, may offer a non-invasive alternative. The premise of radiomics is that features on medical images are linked to the underlying molecular, physiological, and structural properties of the tumour. In this systematic review, we address available evidence linking imaging features of tumours with levels of CD8+ TILs.
Abstract
The tumour immune microenvironment influences the efficacy of immune checkpoint inhibitors. Within this microenvironment are CD8-expressing tumour-infiltrating lymphocytes (CD8+ TILs), which are an important mediator and marker of anti-tumour response. In practice, the assessment of CD8+ TILs via tissue sampling involves logistical challenges. Radiomics, the high-throughput extraction of features from medical images, may offer a novel and non-invasive alternative. We performed a systematic review of the available literature reporting radiomic signatures associated with CD8+ TILs. We also aimed to evaluate the methodological quality of the identified studies using the Radiomics Quality Score (RQS) tool, and the risk of bias and applicability with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. Articles were searched from inception until 31 December 2021, in three electronic databases, and screened against eligibility criteria. Twenty-seven articles were included. A wide variety of cancers have been studied. The reported radiomic signatures were heterogeneous, with very limited reproducibility between studies of the same cancer group. The overall quality of studies was found to be less than desirable (mean RQS = 33.3%), indicating a need for technical maturation. Some potential avenues for further investigation are also discussed.
Keywords: radiomics, cancer, systematic review, immunotherapy, immune cells, lymphocytes
1. Introduction
Immune checkpoint inhibitors (ICIs) leverage the high specificity of the immune system to selectively attack tumour cells. They can be highly effective [1]. However, only a small proportion of patients meaningfully benefit from treatment, with typical response rates of under 15% for most eligible cancer types [2,3,4]. Therefore, markers that can distinguish between responsive and non-responsive patients are necessary.
The efficacy of ICIs is biologically governed by cancer–immune system interactions in the tumour immune microenvironment (TIME) [5,6]. Important within this microenvironment are the CD8 glycoprotein-expressing (CD8+) tumour-infiltrating lymphocytes (TILs), which play a key role in destroying cancer cells [7]. Given this role after the administration of ICIs (Figure 1), it follows that the presence of CD8+ TILs may predict treatment response. Studies have shown that lesions with higher numbers of CD8+ TILs tend to be more sensitive to ICIs [8,9], and there is mounting evidence supporting the clinical utility of CD8+ TILs as a biomarker in various cancers [10,11,12,13,14,15]. Circulating CD8+ T cells in peripheral blood have been used to predict ICI response [16], but it remains elusive whether systemic measurements accurately reflect the local tumour microenvironment [9]. The gold standard for CD8+ TIL quantification is the assessment of biopsy specimens via immunohistochemistry [17]; this approach, however, is limited by its invasiveness, unrepeatability, and inability to reflect intra- and intertumoural heterogeneity. These shortcomings demonstrate a need for innovation in the form of dynamic and less invasive biomarkers.
The emerging field of radiomics centres on the premise that quantitative features observed in medical images may have biological underpinnings. Tumour regions with distinct radiomic phenotypes have been postulated to be representative of different tumour microenvironments [18,19] and various TIL gene expression patterns [20]. Tumours manifesting shape and texture irregularities have also been reported to show better ICI response [21]. The identification of a constellation of imaging features (“radiomic signature”) linked to CD8+ TILs is desirable: it could create a novel way of evaluating treatment outcomes in a manner that is non-invasive and complementary to routine patient management, as the collection of imaging data is undertaken as part of existing standards of care. Furthermore, radiomics-based biomarkers can be computed repeatedly, and permit the 3D evaluation of the entire investigated tumour lesion. While promising, it is also worth highlighting that radiomics research is characterised by substantial methodological heterogeneity [22]. Many have called for the adoption of rigorous, transparent, and standardised workflows to ensure the reproducibility of radiomic signatures [23,24,25,26,27].
Based on the ever-increasing advances in computational power and the recent clinical adoption of ICIs [28], we hypothesised that several radiomics studies involving CD8+ TILs have likely materialised. Moreover, little is known about the methodological robustness of these studies. In this systematic review, our objectives were three-fold: (i) to provide an overview of the general characteristics of radiomics studies involving CD8+ TILs, (ii) to collate radiomic signatures associated with CD8+ TILs reported so far, and (iii) to evaluate the methodological quality of these studies. We also discuss avenues for future investigation. The scope of this review includes radiomics studies from three diagnostic imaging modalities: computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET).
2. Materials and Methods
This review was conducted in adherence to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guidelines [29] (Supplementary Table S1). The protocol for this review is registered with PROSPERO (CRD42021284332).
2.1. Literature Search
We developed our search strategy following a preliminary literature review. Identified common terms were truncated or expanded, where necessary, to account for derivational affixes and abbreviations; these were then organised into a Boolean search (Figure 2). Peer-reviewed journal articles were searched from inception until 31 December 2021, and collected from three electronic databases: Ovid MEDLINE, Embase, and Web of Science. We also included articles beyond our search that were retrieved manually, i.e., articles cited within examined literature, referred to us by experts, or encountered during previous reading.
2.2. Literature Selection
The shortlisted articles were initially evaluated for duplicates; the remaining were screened against eligibility criteria designed around the PICOS (Population, Intervention, Comparison, Outcomes, and Study) framework (Table 1). In summary, we sought to include only primary sources that investigated both imaging/radiomics features and CD8 data on human tumour lesions. To this end, articles were evaluated systematically at the title-, abstract-, and full-text levels, and reasons for exclusions were documented. To minimise subjectivity, screens were completed independently by two reviewers (S.R. and D.H.), and discrepancies in relevance assessment were resolved via consensus or adjudicated by a third independent reviewer (K.B.).
Table 1.
Inclusion Criteria | Exclusion Criteria | |
---|---|---|
Participant(s) |
|
|
Intervention(s) |
|
|
Comparator(s) |
|
|
Outcome(s) |
|
|
Study design |
|
|
2.3. Literature Analysis
To address review objectives (i) and (ii), we carried out data extraction on all selected records. Relevant study parameters (e.g., disease, cohort size, and imaging modality) and reported radiomic signatures were tabulated (Supplementary Table S2). Extraction forms were first piloted on three studies chosen at random, then completed for all records by one reviewer (S.R.) and validated by a second reviewer (K.B.) to ensure a level of accuracy. Qualitative summaries of the general study characteristics were presented. We found no a priori reason to believe CD8+ TIL-associated radiomic signatures for one disease site will be similar for others. Thus, in meeting objective (ii), publications were first grouped according to the organ (or organ system) where the investigated cancer originated. Within groups, relationships between signatures were explored where possible.
To address review objective (iii), articles were assessed using the Quality Assessment of Diagnostic Accuracy Studies version 2 (QUADAS-2) [30] and Radiomics Quality Score (RQS) [25] tools. In accordance with QUADAS-2 scoring design, we evaluated potential risks of bias and/or the applicability of the included studies in four domains: patient selection, index test, reference standard, and flow and timing. On the other hand, the RQS assigns an overall score that is reflective of the methodological quality of a radiomics study. This score, which can range from −8 to 36, is derived from the summation of ratings for 16 dimensions. Each dimension represents a key component in the radiomics pipeline (e.g., imaging protocol quality). Both tools have their own strengths: the QUADAS-2 tool is more well-established in systematic reviews, while the RQS is more specific to radiomics. We used both tools to ensure a spectrum.
Quality assessments were completed by two reviewers (S.R. and D.H.) and the inter-rater agreement was assessed. For every QUADAS-2 domain, the percentage of absolute agreement of ratings between the two reviewers was measured. The inter-rater agreement of the overall RQS was calculated using an intraclass correlation coefficient (ICC) estimate based on a mean-rating, absolute agreement, two-way, mixed-effects model [31]. For each of the RQS dimensions, the agreement of ratings between reviewers was assessed by means of a linearly weighted Gwet’s AC2 statistic for ordinal data [32]. This inter-rater reliability measure was chosen to circumvent known paradoxical behaviours associated with the more commonly used Kappa statistics [33,34]. Results were then arbitrated between reviewers. Analysis was performed using the “irr” and “irrCAC” packages in R software (R Foundation for Statistical Computing, Vienna, Austria, https://www.R-project.org/) (accessed on 16 June 2022) (v4.0.5).
3. Findings
3.1. Literature Selection
The study selection process is presented in Figure 3. Our search yielded 1044 articles, of which 2 were manually retrieved from other sources; 297 articles were initially removed on the basis of duplication, and 611 were excluded upon evaluation at the title level, 70 at the abstract level, and 39 at the full-text level, culminating into a final 27 publications for analysis in this review. The results from our literature search and individual screens are available in Supplementary Tables S3 and S4. The majority of the selected studies were published in the last two years, confirming our initial hypothesis that radiomics involving CD8+ TILs is a new research avenue.
3.2. General Characteristics of Included Studies
The main characteristics of the included articles are presented in Table 2 and a typical study workflow has been illustrated in Figure 4. Technical radiomics terminology used in this review has been defined in Supplementary Table S5.
Table 2.
Disease | Study [Ref] | Total Cohort # |
Validation | CD8 Evaluation |
Joint Analysis |
Imaging Modality | Radiomics Software |
Features Extracted |
Tumour Region |
Relevant Radiomic Signatures |
Modelling | End Point | ||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
R | S | SQ | # | Features | ||||||||||||
Lung | NSCLC | Lopci et al. [47] | 55 | N | IHC | N | PET ([18F]-FDG) | NA | N | N | Y | Intratumoural | 2 | SQ: SUVmean, SUVmax | Cox regression | DFS |
NSCLC | Castello et al. [48] | 44 | N | IHC | N | PET ([18F]-FDG) | LIFEx | Y | N | Y | Intratumoural | 5 | R: First-order SQ: SUVmax, SUVpeak, SUVmean, MTV |
Cox regression | DFS | |
NSCLC | Mazzaschi et al. [42] | 100 | Y | IHC | Y (CD3, PD-1) |
CT | SlicerRadiomics | Y | Y | N | Intratumoural | 11 | R: First-order, GLCM, GLRLM, GLDM S: Texture, effect (parenchyma reaction), margins |
Cox regression | OS, DFS | |
NSCLC | Mitchell et al. [49] | 59 | N | IHC | N | PET ([18F]-FDG) | NA | N | N | Y | Intratumoural | 0 | None significant | Cox regression | OS, DFS | |
NSCLC | Zhou et al. [45] | 91 | N | IHC | Y (PD-L1) |
PET ([18F]-FDG) | NA | N | N | Y | Intratumoural | 5 | SQ: SUVmax, SUVmean, TLG | Logistic regression | Tumour immuno- phenotype |
|
NSCLC | Min et al. [37] | 97 | Y | FACS | N | CT | PyRadiomics | Y | Y | N | Intratumoural | 4 | R: GLCM, GLDM S: Boundary type, lymphatic metastasis |
Neural network-based | High/low CD8 levels | |
NSCLC | Zhou et al. [46] | 103 | Y | IHC | Y (PD-L1) |
PET/CT ([18F]-FDG) | LIFEx | Y | N | Y | Intratumoural | 1 | R: NGLDM | Logistic regression | Tumour immuno-phenotype | |
Hepatobiliary | PDAC | Li et al. [54] | 184 | Y | IHC | N | CE-CT | PyRadiomics | Y | Y | N | Intratumoural | 11 | R: First-order, GLSZM S: Tumour size |
Logistic regression, XGBoost | High/low CD8 levels |
PDAC | Bian et al. [55] | 156 | Y | IHC | N | MRI (T1W, T2W, post-contrast [AP PPP, PVP]) | PyRadiomics | Y | Y | N | Intratumoural | 14 | R: First-order, GLCM, GLRLM, GLSZM, NGTDM S: Lesion location, tumour size |
Linear regression, XGBoost | High/low CD8 levels | |
PDAC | Bian et al. [56] | 144 | Y | IHC | N | MRI (T1W, T2W) | PyRadiomics | Y | Y | N | Intratumoural | 13 | R: First-order, GLCM, GLRLM, GLSZM | LDA classifier | High/low CD8 levels | |
HCC | Chen et al. [43] | 207 | Y | IHC | Y (CD3) |
MRI (CE) | Analysis Kit (GE Healthcare) | Y | N | N | Intratumoural, peritumoural, combined | 70 | R: Shape, GLCM, GLRLM, GLSZM | Extra-Trees, logistic regression | Immunoscore prediction | |
HCC | Liao et al. [57] | 142 | Y | IHC | N | CE-CT | Analysis Kit (GE Healthcare) | Y | N | N | Intratumoural | 7 | R: GLCM, GLRLM | Elastic-net | OS, DFS | |
ICC | Zhang et al. [58] | 78 | N | IHC | N | MRI (T1W, T2W, post-contrast [AP, PVP], DW) | PyRadiomics | Y | N | N | Intratumoural | 4 | R: Shape, first-order, GLSZM | Logistic regression, Cox regression | Tumour immuno-phenotype, OS | |
Brain | LGG | Zhang et al. [38] | 107 | Y | TIMER | N | MRI (T1W, T1CE, T2W, T2-FLAIR) | CaPTK | Y | N | Y | Multiple subregions | 3 | R: Shape, GLRLM | Cox regression | OS |
GBM | Hsu et al. [59] | 116 | Y | RNA-seq | N | MRI (T1CE, DW) | ND | Y | N | N | Intratumoural | 15 | R: First-order, GLRLM | Logistic regression | High/low CD8 levels | |
HGG | Kim et al. [36] | 51 | N | FACS | Y (CD4) |
MRI (T1W, T1CE, T2W, T2-FLAIR, DW, DSC) | PyRadiomics | Y | N | N | Intratumoural | 5 | R: GLCM, GLRLM, GLSZM, GLDM | sPLS-DA | OS | |
Glioma | Chaddad et al. [40] | 151 | Y | CIBERSORT | N | MRI (T1W, T1CE, FLAIR, T2W) | MATLAB | Y | Y | N | Intratumoural | 3 | R: GLSZM | Neural network-based | High/low CD8 levels | |
Gastrointestinal | Gastric cancer | Jiang et al. [44] | 1778 | Y | IHC | Y (CD3, CD45RO, CD66b) |
CE-CT | MATLAB | Y | N | N | Intratumoural, peritumoural | 13 | R: Shape, GLCM, GLRLM, GLSZM, NGTDM | Logistic regression, Cox regression | Immunoscore prediction, DFS, OS |
ESCC | Wen et al. [60] | 220 | Y | IHC | N | CE-CT | IBEX | Y | N | N | Intratumoural | 8 | R: First-order, GLCM, GLRLM | Logistic regression | High/low CD8 levels | |
Rectal cancer | Jeon et al. [61] | 113 | Y | IHC | N | MRI (T2W) | MATLAB | Y | N | N | Intratumoural | 6 | R: First-order, GLCM, GLRLM, GLSZM | Linear regression | Chemoradiotherapy-induced changes | |
Head and neck | HNSCC | Katsoulakis et al. [52] | 160 | Y | RNA-seq | N | CE-CT | Radiomics Toolbox in CERR | Y | N | N | Intratumoural | 67 | R: First-order, GLCM, GLRLM, GLSZM, NGTDM, NGLDM | Random forest | High/low CD8 levels |
HNSCC | Wang et al. [41] | 71 | Y | Chemokine gene expression | N | CE-CT | SlicerRadiomics | Y | N | N | Intratumoural | 8 | R: GLCM, GLSZM, GLDM, NGTDM | Logistic regression | Tumour immuno-phenotype | |
Multiple | Multiple | Sun et al. [51] | 491 | Y | RNA-seq | N | CE-CT | LIFEx | Y | Y | N | Intratumoural, peritumoural | 8 | R: First-order, GLRLM S: Lesion location (adenopathy; head and neck), CT parameters (kVp) |
Elastic-net | Objective response, OS |
Multiple | Ligero et al. [53] | 198 | Y | IHC | N | CE-CT | PyRadiomics | Y | Y | N | Intratumoural | 16 | R: Shape, first-order, GLCM, GLDM S: Lesion location (liver; other) |
Elastic-net, Cox regression | Objective response, OS | |
Others | Breast cancer | Arefan et al. [39] | 73 | Y | MCP-Counter | N | MRI (DCE) | PyRadiomics | Y | N | Y | Intratumoural | 2 | R: Shape SQ: Tumour mean peak enhancement |
XGBoost | High/low CD8 levels |
UPS | Toulmonde et al. [62] | 14 | N | IHC; RNA-seq | N | MRI (T1CE) | OleaSphere® Software | Y | N | N | Intratumoural | 9 | R: First-order, GLRLM | Cox regression | OS, MFS | |
Melanoma | Aoude et al. [50] | 52 | N | RNA-seq; mIF; Histomorphometry | N | PET/CT ([18F]-FDG) | NA | Y | N | Y | Intratumoural | 1 | R: First-order | Cox regression | OS, PFS |
Acronyms: AP = arterial phase; CaPTK = cancer imaging phenomics toolkit; CE = contrast-enhanced; CE-CT = contrast-enhanced CT; CERR = computational environment for radiological research; CIBERSORT = cell-type identification by estimating relative subsets of RNA transcript; DCE = dynamic contrast-enhanced; DFS = disease-free survival; DSC = dynamic susceptibility contrast-enhanced; ESCC = esophageal squamous cell carcinoma; Extra-Trees = extremely randomized tree algorithm; FACS = fluorescence-activated cell sorting; GBM = glioblastoma; HCC = hepatocellular cancer; HGG = high-grade glioma; HNSCC = head and neck squamous cell carcinoma; ICC = intrahepatic cholangiocarcinoma; IHC = immunohistochemistry; kVp = peak kilovoltage; LDA = linear discriminant analysis; LGG = lower-grade glioma; MCP-counter = microenvironment cell populations-counter; MFS = metastasis-free survival; mIF = multiplex immunofluorescence; N = no; NA = not available/applicable; ND = not declared; NSCLC = non-small cell lung cancer; OS = overall survival; PDAC = pancreatic ductal adenocarcinoma; PFS = progression-free survival; PPP = pancreatic parenchymal phase; PVP = portal venous phase; R = radiomic features; RNA-seq = RNA sequencing; S = semantic features; sPLS-DA = sparse partial least squares discriminant analysis; SQ = semi-quantitative features; SSF = spatial scaling factor; T1-FLAIR = T1-weighted fluid attenuated inversion recovery; T1CE = T1-weighted contrast-enhanced; T1W = T1-weighted; T2-FLAIR = T2-weighted fluid attenuated inversion recovery; T2W = T2-weighted; TIMER = tumour immune estimation resource; UPS = undifferentiated pleomorphic sarcoma; XGBoost = binary logistic extreme gradient boosting framework; Y = yes.
Studies have so far focused on cancers of the lung (7/27), hepatobiliary system (6/27), brain (4/27), gastrointestinal tract (3/27), and head and neck (2/27). Two articles investigated multiple cancers (2/27). Single studies were found on breast cancer, melanoma, and undifferentiated pleomorphic sarcoma (UPS). The median total number of patients investigated was 105 (range: 14–1778). No studies declared the use of prospectively acquired datasets; datasets tend to be sourced locally from a single institution (18/27) and/or downloaded from public repositories (such as The Cancer Genome Atlas/The Cancer Imaging Archive [35]) (6/27).
To assess the CD8 marker on tumour samples, immunohistochemistry (IHC) was performed more commonly than RNA sequencing (RNA-seq) (17/27 vs. 5/27). CD8+ TILs were enumerated via fluorescence-activated cell sorting (FACS) in two papers [36,37]. Three articles estimated CD8+ TILs via cell type quantification tools on bulk tumour transcriptome data [38,39,40]. One article used a chemokine gene expression signature as a surrogate marker for CD8+ TILs [41]. We highlight six studies that did not investigate CD8+ cells as an exclusive biological correlate; these articles instead interlaced CD8+ TILs with other immune variables to perform joint analyses (e.g., with CD3 [42,43,44], CD4 [36], PD-L1 [45,46] markers).
Studies analysing MRI and CT images were represented almost equally (11/27 vs. 10/27). Contrast-enhanced images predominated both modalities (9/11 and 8/10). The remaining six studies analysed PET images with fluorine-18-labelled fluorodeoxyglucose ([18F]-FDG) tracers ([18F]-FDG-PET) [45,46,47,48,49,50]. To extract intratumoural imaging features, lesion boundaries were annotated mainly via manual (15/27) or semi-automatic (10/27) means. In addition, we located three studies where the tumour periphery was considered a separate entity and the extraction of peritumoural features was carried out [43,44,51]. The software platform for radiomic feature computations was inconsistent, with at least eight different packages identified. PyRadiomics was the most commonly used software platform (8/27).
There was remarkable diversity in the types of imaging features extracted. We distinguished them into three classes. The first of these classes represents conventional radiomic features, where studies extracted the following feature families: size- or shape-based (21/27), first-order (25/27), second-order (22/27), and higher-order (9/27). Broadly, second-order families have been calculated from various matrices that describe how homogeneous or heterogeneous an image is. These matrices include the grey-level co-occurrence matrix (GLCM) (22/27), grey-level run-length matrix (GLRLM) (21/27), grey-level size zone matrix (GLSZM) (20/27), neighbouring grey-tone difference matrix (NGTDM) (16/27), grey-level dependence matrix (GLDM) (12/27), and neighbouring grey-level dependence matrix (NGLDM) (2/27). Higher-order families refer to the extraction of features from images pre-processed with various mathematical filters.
The second feature class corresponds to semi-quantitative features, examined in eight articles. These features differ from conventional radiomics in their calculation and are more directly interpretable (e.g., total lesion glycolysis calculated from PET image intensities). The final feature class describes semantic features, studied in nine articles. These are features perceived qualitatively by radiologists (e.g., tumour location). Brief descriptions of each feature class, family, texture, and their hierarchy are provided in Supplementary Table S5.
Radiomic signatures associated with CD8+ TILs were determined in one of two ways, as illustrated in Figure 4. In the predominant approach (Pipeline A), imaging features were subjected to association analysis with different CD8+ TIL levels, in order to single out features that are statistically different between lesions exhibiting distinct CD8+ TIL levels. Alternatively, radiomic signatures could also be developed by assessing the association of features with clinical variables, before being evaluated for their biological significance, i.e., link to CD8+ TILs (Pipeline B). Regardless of which approach was taken, most studies also employed a further feature selection step to remove features that were redundant and/or sensitive to other parameters in the radiomics workflow (23/27). Details of derived radiomics signatures have been summarised in Table 2 and discussed in the sections that follow; a more detailed list is also available in Supplementary Table S6.
Statistical tests and threshold values were marked by heterogeneity and were highly dependent on individual study context, objectives, and end points. Study end points include using radiomic signatures to build models that could predict high or low CD8+ TIL levels in lesions, TIME phenotypes, survival (overall, disease-free, metastasis-free, or progression-free), and/or treatment response (Table 2). In approximately two-thirds of the papers, the predictive capacity of radiomics signatures was validated (19/27). Validation patient cohorts were mainly sourced internally, i.e., using a portion of the same patient cohort (set aside at the beginning of the study) for testing (15/19). In this case, the mean proportion of patients between training and validation was found to be 5:2. In contrast, only four articles performed external validation with datasets originating outside the researching institution [44,51,52,53].
3.3. Radiomic Signatures
3.3.1. Lung Cancers
In lung cancer, all seven studies examined non-small cell lung carcinoma (NSCLC). The earliest two papers hypothesised [18F]-FDG-PET features could reveal a link between metabolic activity and the presence of CD8+ TILs in neoplastic tissue [47,48]. The authors demonstrated that semi-quantitative [18F]-FDG-PET features (maximum and mean standardised uptake values) and a first-order feature (entropy) were associated with CD8+ TIL expression. Later studies, however, showed indefinite or weaker correlations [45,46,49]. The association between [18F]-FDG-PET features and CD8+ TILs, therefore, remains poorly defined.
In CT, a study reported that CD8+ TILs were significantly correlated with measures of texture heterogeneity (NGLDM contrast) [46]. In another paper, TIL levels co-expressing the CD8 and CD103 marker could be predicted by measures of homogeneity and high grey-level values (validation AUC = 0.753, 95% CI: NA) [37]. Higher-order CT radiomic features, generally describing the distribution of grey-level voxels (grey-level range, high emphasis, long run lengths), were significantly correlated with TIME parameters estimated from relative levels of CD8+, CD3+, and PD-1+ TILs [42]. Across the studies, no features were reproducible.
3.3.2. Hepatobiliary Cancers
A series of pancreatic ductal adenocarcinoma (PDAC) studies published by Bian, Y. and colleagues analysed images acquired via contrast-enhanced CT [54], contrast-enhanced MRI [55], and non-contrast MRI [56]. All three studies were aimed at predicting lesion CD8+ TIL levels. Validation AUCs were similar at 0.705–0.790. Notably, a higher-order feature (wavelet-filtered first-order median) was associated with CD8+ TILs in both T2-weighted and contrast-enhanced T1-weighted MR images. This remains the only reproducible feature that we could identify in the entirety of this review.
Two teams of investigators examined hepatocellular carcinoma (HCC) in different imaging contexts (MRI vs. CT) [43,57]. In both studies, GLCM and GLRLM textures appear to be important constituents of derived radiomic signatures. High grey-level values on CT (short and long run lengths) were good determinants of CD8+ TIL levels (validation AUC = 0.705, 95% CI 0.547–0.863) [57]. Measures of fine textures (short and irregular run lengths) with deep texture grooves (contrast/inertia) on MRI could predict the density of CD8+ and CD3+ TILs in the tumour centre and invasive margins [43]. Notably, predictive performance improved when peritumoural features were added into models (validation AUC = 0.899 vs. 0.640).
In the context of intrahepatic cholangiocarcinoma (ICC), tumour flatness and higher-order radiomic families (variability of size zone volumes and first-order medians) in preoperative MR images could predict CD8+ TILs [58]. The AUC was 0.919 but a validation study was not performed.
3.3.3. Brain Cancers
The standard of care modality for the radiographic evaluation of neurologic diseases is MRI. Accordingly, all four studies on brain cancer analysed MR images. In two of these papers, high-grade gliomas (HGGs) were investigated in apparent diffusion coefficient (ADC) maps obtained from diffusion-weighted MRI. In this context, radiomic signatures between studies were dissimilar: first- and second-order GLRLM features (short runs) were good predictors of different cytotoxic TIL levels in glioblastoma (AUC = 0.710; 95% CI: NA) [59], while second-order GLSZM features (variance of grey-levels within size zone volumes) could determine CD8+ TIL-dominant HGG lesions [36].
Two HGG studies interrogated contrast-enhanced MR images and produced radiomic signatures that were also discordant: only first-order features were correlated with CD8+ TILs in one study [59] and second-order features in the other [36]. When considering only lower-grade gliomas (LGGs), second-order features (GLRLM long grey-level runs) and volume-based features have been reported to predict CD8+ TILs [38]. However, when LGGs and HGGs were pooled together, no features from contrast-enhanced MRI were significantly different between low and high groups of CD8+ TILs (p > 0.05) [40]. Here, authors instead demonstrated that fine textures and large size zones with high grey-levels were significant predictors of CD8+ TILs in non-contrast MR images.
3.3.4. Gastrointestinal Cancers
The study focusing on esophageal squamous cell carcinoma (ESCC) revealed that first-, second-, and higher-order features describing grey-level distribution (e.g., interquartile range, entropy, cluster prominence) and fine textures (short runs) could predict CD8+ TILs (validation AUC = 0.728, 95% CI: 0.562−0.894) [60].
Jiang et al. analysed the utility of intratumoural and peritumoural radiomic features to predict tumour and/or invasive margin levels of CD8+, CD3+, CD45RO+, and CD66b+ immune cells in gastric cancer (validation AUC = 0.766, 95% CI: 0.669–0.863) [44]. The radiomic signature was mainly composed of heterogeneity measures (from second- and higher-order radiomic families).
Distinct from all the other articles we reviewed, Jeon et al. performed a delta-radiomics [25] MRI study on rectal cancer to predict chemoradiotherapy (CRT)-induced changes in CD8+ TILs (AUC = 0.824, 95% CI: 0.674–0.974) [61]. The radiomic signature was in part defined by homogeneity measures (large areas with low grey-levels and short runs with high grey-levels). The net change in radiomic feature values between pre-CRT and post-CRT datasets was correlated with a higher longitudinal fold change in CD8+ TIL density (p = 0.001).
3.3.5. Head and Neck Cancers
Radiomic signatures from contrast-enhanced CT images could only moderately predict levels of CD8+ TILs in head and neck squamous cell carcinoma (HNSCC) [41,52]. Second-order features describing texture heterogeneity (contrast, coarseness, small grey-level dependence) had a modest validation AUC of 0.643 (95% CI: 0.340–0.946) in one study [41], while a radiomic cluster of 67 features could only classify lesion CD8+ TIL levels with an accuracy of 65.7% [52].
3.3.6. Multiple Cancers
Both Sun et al. and Ligero et al. used contrast-enhanced CT images to predict ICI response in datasets composed of a mixture of advanced solid tumours [51,53]. Prediction performances using derived radiomic signatures were similar, achieving good validation AUCs of 0.67–0.76. Both signatures contained lesion location (semantic feature) to account for the heterogeneity in the cancer type or organ region analysed. Additionally, in both studies, tumour homogeneity measures were associated with high CD8+ TIL levels or responses to ICIs. However, the included parameters were calculated from different second-order matrices (GLRLM vs. GLCM and GLDM). There was little overlap in other respects; no features were reproducible between studies, while Sun et al. accounted for and retained peritumoural features.
3.3.7. Other Cancers
In the remaining evidence, a contrast-enhanced MRI study with fourteen UPS patients reported that first-order features and fine textures (abundance of short runs, especially with high grey-levels) could predict lesion CD8+ TIL densities (accuracy = 93%) [62]. In a [18F]-FDG-PET/CT study on melanoma, only a CT first-order feature (mean value of positive pixels) could significantly identify lesion groups with distinct CD8+ TIL expressions (p = 0.017) [50]. The last study, by Arefan et al., identified that semi-quantitative features (tumour volume, mean peak enhancement of the tumour) from dynamic contrast-enhanced MRI could only moderately predict CD8+ TILs (validation AUC = 0.62, 95% CI: NA) [39].
3.4. Study Quality of Included Articles
The results from our arbitrated QUADAS-2 assessments are summarised in Figure 5A. Most papers had low risk of bias in the index test and reference standard domains due to the adequate reporting of radiomics procedures and how the CD8 marker was interrogated. That said, the risk of bias for patient selection was high, which we attribute to the intrinsic selection biases of retrospectively acquired data in the included publications. Similarly, applicability concerns for the radiomics signatures were mainly high or unclear due to the absence of a validation step or the reliance on internal validation cohorts, respectively. In the patient flow and timing domain, the majority of studies failed to report the temporal delay between imaging and pathology.
Studies reached a mean ± standard deviation RQS of 11.81 ± 6.69 and a percentage RQS of 33.3 ± 17.5% (scores of −8 to 0 were treated as 0% and 36 treated as 100%). The RQS ranged from −2 to 22 (or 0% to 61.1%). The distribution of total scores is reflected in Figure 5B. Average ratings for each item of the RQS can be seen in Figure 5C. In summary, given that the CD8 assessment formed a criteria for literature selection, the vast majority of studies performed well in the following dimensions: multivariable analysis with non-radiomic features (27/27); discussing the potential clinical utility of findings (26/27); comparison to other or gold standard approaches (23/27), such as by assessing the added value of radiomics in clinical data-only models; performing cut-off analyses (23/27), such as by dichotomising samples into high or low CD8+ TIL groups based on a measured median; and discussing detected biological correlates (20/27). Most studies performed a feature selection or robustness step in the analysis (23/27). In contrast, less than half of the studies documented a comprehensive imaging protocol (11/27) (e.g., unknown voxel sizes, vendor names, tube current, and field strength). Only one study assessed the temporal variability of features by means of scanning at multiple time points [45]. Finally, we observed no phantom calibration, cost-effectiveness analysis, or provision of complete open access data (e.g., scripts, volumes of interest (VOIs), and images) in all publications reviewed.
Full quality assessments from each reviewer are available in Supplementary Figures S1 and S2. The absolute agreement between reviewers was above 70% for most of the QUADAS-2 domains (Supplementary Table S7). Poor rating agreement was only seen for the risk of bias in flow and timing (37.0%) and applicability of the index test (40.7%). The ICC for the total RQS score was 0.969 (95% CI: 0.932–0.986), reflecting high agreement between reviewers. The inter-rater agreement for the dimensions of the RQS was generally good, with AC2 values of above 0.7 for 13 out of the 16 domains (Supplementary Table S7).
4. Discussion
CD8+ TILs are an important biomarker of ICI response. However, their assessment necessitates tumour biopsies, which are invasive and prone to sampling bias. Radiomics promises to overcome these challenges. The basic assumption of radiomics is that medical imaging features that are otherwise invisible to the naked eye could reveal underlying tumour biology. Such an assumption prompted us to systematically review and analyse studies investigating radiomic signatures associated with CD8+ TILs.
We found that most studies on this topic were only published in the last two years. Still, we identified a variety of investigated tumours, many of which are established indications for ICI therapy [63]. The most studied malignancy was NSCLC [37,42,45,46,47,48,49], which was as expected given that ICIs have shifted treatment paradigms for these cancers [64]. Other cancers eligible for ICI treatment, herein, were melanoma [50], ESCC [60], gastric [44], and breast [39] cancer; yet, we have only been able to locate single papers for these to date. Some avenues currently unexplored include renal and ovarian lesions, where nomograms associated with CD8+ TILs have been developed in a non-radiomics context [65,66].
Our systematic review indicated radiomic signatures associated with CD8+ TILs are predominantly heterogeneous, despite some degree of overlap at the feature family level. Even between studies of the same cancer group, the reproducibility of radiomic features was limited. The only exception to this was a higher-order radiomic feature (wavelet-filtered first-order median), which appeared to be reproducible between two PDAC studies using different MRI protocols [55,56]. However, we highlight that both studies originated from the same institution. It would therefore be desirable to explore whether this reproducibility holds with broader datasets obtained using scanners of varying manufacturers and across multiple institutions. To complicate things further, the power of radiomic signatures in predicting CD8+ TILs was variable, with reported validation AUCs ranging between 0.643 and 0.899. In some papers, there does not seem to be a consensus on the association of [18F]-FDG-PET imaging features with CD8+ TILs [45,46,49].
We believe the lack of reproducible or definitive radiomic signatures could, at least in part, be explained by insufficiently developed and heterogeneous study methodologies. Using RQS scoring criteria, our quality assessments of included studies indicate that the study methodologies were overall less than desirable (mean RQS = 33.3%). This builds upon findings of other published radiomics systematic reviews utilising the RQS tool, wherein it was determined that radiomics research has not yet matured technically [67,68,69,70]. However, we emphasise that the low RQS scores do not necessarily devalue the impact of the reviewed articles, and merely indicate a need for more methodologically rigorous research in the future. In our review, the major reasons for the observed low scores were the use of retrospectively acquired data and the lack of results validated on external datasets. We believe these may have introduced selection biases, which was also reflected in our QUADAS-2 appraisals. To mitigate this bias and improve the generalisability of radiomic signatures, future researchers should ideally focus on validating results in large-sample, multi-institutional, and prospective settings.
Our review has revealed a remarkable diversity as regards the methods used in the included studies. This could also be evidenced by the heterogeneity of RQS scores, which range from 0% to 61.1%. Indeed, radiomic pipelines should be more harmonised to allow the better comparability of radiomic signatures between studies, and for us to reach more meaningful conclusions. A prime example illustrating the methodological variation between studies is the wide selection of software platforms used for radiomic computations. Recently, it has been reported that different software platforms could yield non-identical radiomic feature calculations and, thus, variable radiomic signatures [71,72,73]. Fortunately, community-wide efforts are ongoing to standardise feature calculations through the Imaging Biomarker Standardisation Initiative (IBSI) [26], and prospective investigators should therefore aim to use IBSI-compliant software.
Deriving reproducible radiomic signatures is recognised as one of the major challenges to the translation of radiomics into the clinic [74,75]. Image acquisition and post-processing standardisation strategies to improve the reproducibility and clinical translatability of radiomic features have been discussed extensively in review articles by Park et al. and Vallières et al. [76,77]. For instance, the batch effect correction method “ComBat” has recently been demonstrated to substantially reduce inter-scanner biases [78,79], thus allowing for the large-scale harmonisation and pooling of inhomogeneous cohorts [80]. Furthermore, efforts to simplify radiomics workflows, in particular by automating lesion segmentation and feature processing steps via deep learning, promise to minimise the effect of variable clinical practices on radiomic signatures [81,82]. Ultimately, we again highlight the importance of high-powered prospective studies, with the expectation that a large enough sample size could overcome the inherent heterogeneities in clinical imaging [83]. Therefore, wide-reaching collaborations in the form of multi-institutional and/or multi-national consortia that offer federated imaging platforms and curated data (e.g., the EuCanImage project [84] and UK National Cancer Imaging Translational Accelerator network [85]) are also critical to facilitate the translation of imaging biomarkers into clinical practice [83].
In the following paragraphs, we describe some supplemental lines of inquiry that could be addressed by future investigators, as also illustrated in Figure 6.
First, a limited number of papers analysed features from the tumour periphery. Signatures from peritumoural regions appear to be important, or have made a positive impact on predictive modelling in the cases we reviewed [43,44,51]. Elsewhere, a growing number of studies have reported the utility of peritumoural features in their radiomics analyses [86,87,88,89]. It is also known that the response to ICI is partly dependent on the degree and localisation of CD8+ T-cells in the tumour margins [8,90,91]. All of this evidence, taken together, creates a strong rationale for prospective investigators to carry out radiomic interrogations of the peritumoural regions.
Second, only a single report has so far compared features between pre- and post-treatment scans [61]. If data from multiple time points are available, prospective investigators could explore how radiomic features evolve with an underlying marked change in lesion CD8+ TIL density.
Third, in the reviewed studies, associations between radiomic features and CD8+ TILs often completely disregard intratumoural spatial heterogeneity. A standard radiomics extraction pipeline computes a single average value for a given feature type, and relies on the assumption that this value is representative of the phenotype of the entire investigated lesion. Similarly, histological assessments of CD8+ TILs are carried out on tissue samples, which ultimately capture only a snippet of lesion biology. Fortunately, ways to address the loss of information on intratumoural spatial heterogeneity are emerging. New radiomic extraction methods can generate spatial radiomic maps that identify tumour regions presenting distinct or similar radiomic features (radiomic “habitats”) [83,92,93,94]. Meanwhile, other studies have investigated the possibility of aligning in vivo images and ex vivo samples to biologically validate radiomic signatures in space [95,96,97].
Novel molecular imaging tools with CD8-targeted PET imaging agents are currently being investigated [98], and may permit the non-invasive and specific imaging of CD8+ cells. These tools allow the spatiotemporal characterisation of CD8+ cell-rich tumour tissues vis-à-vis voxels in the PET images. These images could be used to study relationships between radiomic habitats and CD8+ TIL expression patterns in vivo. Such a relationship then opens up the possibility of developing surrogate radiomic markers of CD8+ TIL distribution using more conventional imaging methods. This could be especially useful for centres where next-generation imaging tools are not widely available.
Our review carries some limitations. First, the broad utility of CD8 as a marker across cancer types has led to heterogeneity in the included articles. This has ultimately precluded us from pooling data and completing a formal meta-analysis. Second, the CD8 marker is widely reputed to be a hallmark of cytotoxic T lymphocytes; this was assumed to be true in this present review, and by the authors of many of the included studies. However, CD8 can be expressed in other cell populations (e.g., natural killer cells [99]), and subsets of mature CD8+ TILs that do not exhibit the cytotoxic function also exist (e.g., regulatory or suppressor T cells [100,101,102]). How these populations influence the generalisability of findings remains to be elucidated. Third, because of the relatively small number of reviewed papers, deeper or more meaningful comparisons could not be drawn in every instance. Finally, we chose not to exclude studies with low-quality scores from our review given the limited number of papers, the emerging nature of this field, and in the interest of completeness. Thus, not all results from the publications we reviewed are free from uncertainty.
5. Conclusions
In conclusion, studies deriving radiomic signatures associated with CD8+ TILs have recently materialised for several cancers. Observations from the reviewed studies have so far indicated that radiomic features are heterogeneous, with very limited reproducibility between studies. High-level evidence, in the form of more methodologically sound and harmonised studies, is urgently needed to generate definitive radiomic signatures and to allow the translation of radiomics into clinical practice.
Supplementary Materials
The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/cancers14153656/s1, Figure S1: QUADAS-2 and RQS assessments by the first reviewer; Figure S2: QUADAS-2 and RQS assessments by the second reviewer; Table S1: PRISMA checklist; Table S2: Data extraction table for studies included in systematic review; Table S3: Study eligibility decision trail (for systematically searched and manually included articles) from the first reviewer; Table S4: Study eligibility decision trail (for systematically searched and manually included articles) from the second reviewer; Table S5: Description of technical radiomics terminology used in this systematic review; Table S6: List of relevant radiomics signatures from studies included in this systematic review; Table S7: Inter-rater agreement statistics for QUADAS-2 and RQS ratings.
Author Contributions
Conceptualization, S.R.; methodology, S.R. and D.H.; screening, S.R. and D.H.; resources, S.R.; data extraction, S.R.; data validation, K.B.; formal analysis, S.R., D.H. and K.B.; writing—original draft preparation, S.R.; visualization, S.R.; writing—review and editing, D.H., K.B., R.P.-L., E.S. and L.A.; supervision, L.A. and E.S. All authors have read and agreed to the published version of the manuscript.
Conflicts of Interest
The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.
Funding Statement
This work was supported by the Cancer Research UK (CRUK) Cambridge Centre (CTRQQR-2021\100012) and the CRUK National Cancer Imaging Translational Accelerator (NCITA) (C22479/A28667); additional support was also provided by the National Institute for Health and Care Research (NIHR) Cambridge Biomedical Research Centre (BRC-1215-20014); the views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care; S.R. is supported by the Brunei “Sultan’s Scholar” scholarship from the Sultan Haji Hassanal Bolkiah Foundation; D.H. is supported by the Immune-Image: Specific Imaging of Immune Cell Dynamics Using Novel Tracer Strategies project (RG96994 and 831514); K.B. is supported by MSCA COFUND Beatriu de Pinós Grant (2019BP/00182); R.P.L. is supported by LaCaixa Foundation, a CRIS Foundation Talent Award (TALENT19-05), the FERO Foundation, the Instituto de Salud Carlos III-Investigacion en Salud (PI18/01395 and PI21/01019) and the Prostate Cancer Foundation (18YOUN19).
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Robert C. A decade of immune-checkpoint inhibitors in cancer therapy. Nat. Commun. 2020;11:3801. doi: 10.1038/s41467-020-17670-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Haslam A., Prasad V. Estimation of the Percentage of US Patients with Cancer Who Are Eligible for and Respond to Checkpoint Inhibitor Immunotherapy Drugs. JAMA Netw. Open. 2019;2:e192535. doi: 10.1001/jamanetworkopen.2019.2535. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Pilard C., Ancion M., Delvenne P., Jerusalem G., Hubert P., Herfs M. Cancer immunotherapy: It’s time to better predict patients’ response. Br. J. Cancer. 2021;125:927–938. doi: 10.1038/s41416-021-01413-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ventola C.L. Cancer Immunotherapy, Part 3: Challenges and Future Trends. Pharm. Ther. 2017;42:514–521. [PMC free article] [PubMed] [Google Scholar]
- 5.Thorsson V., Gibbs D.L., Brown S.D., Wolf D., Bortone D.S., Ou Yang T.H., Porta-Pardo E., Gao G.F., Plaisier C.L., Eddy J.A., et al. The Immune Landscape of Cancer. Immunity. 2018;48:812–830.e14. doi: 10.1016/j.immuni.2018.03.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Blank C.U., Haanen J.B., Ribas A., Schumacher T.N. CANCER IMMUNOLOGY. The “cancer immunogram”. Science. 2016;352:658–660. doi: 10.1126/science.aaf2834. [DOI] [PubMed] [Google Scholar]
- 7.Reiser J., Banerjee A. Effector, Memory, and Dysfunctional CD8(+) T Cell Fates in the Antitumor Immune Response. J. Immunol. Res. 2016;2016:8941260. doi: 10.1155/2016/8941260. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Tumeh P.C., Harview C.L., Yearley J.H., Shintaku I.P., Taylor E.J., Robert L., Chmielowski B., Spasic M., Henry G., Ciobanu V., et al. PD-1 blockade induces responses by inhibiting adaptive immune resistance. Nature. 2014;515:568–571. doi: 10.1038/nature13954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Li F., Li C., Cai X., Xie Z., Zhou L., Cheng B., Zhong R., Xiong S., Li J., Chen Z., et al. The association between CD8+ tumor-infiltrating lymphocytes and the clinical outcome of cancer immunotherapy: A systematic review and meta-analysis. EClinicalMedicine. 2021;41:101134. doi: 10.1016/j.eclinm.2021.101134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lee J.S., Ruppin E. Multiomics Prediction of Response Rates to Therapies to Inhibit Programmed Cell Death 1 and Programmed Cell Death 1 Ligand 1. JAMA Oncol. 2019;5:1614–1618. doi: 10.1001/jamaoncol.2019.2311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Geukes Foppen M.H., Donia M., Svane I.M., Haanen J.B. Tumor-infiltrating lymphocytes for the treatment of metastatic cancer. Mol. Oncol. 2015;9:1918–1935. doi: 10.1016/j.molonc.2015.10.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Sato E., Olson S.H., Ahn J., Bundy B., Nishikawa H., Qian F., Jungbluth A.A., Frosina D., Gnjatic S., Ambrosone C., et al. Intraepithelial CD8+ tumor-infiltrating lymphocytes and a high CD8+/regulatory T cell ratio are associated with favorable prognosis in ovarian cancer. Proc. Natl. Acad. Sci. USA. 2005;102:18538–18543. doi: 10.1073/pnas.0509182102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Pages F., Berger A., Camus M., Sanchez-Cabo F., Costes A., Molidor R., Mlecnik B., Kirilovsky A., Nilsson M., Damotte D., et al. Effector memory T cells, early metastasis, and survival in colorectal cancer. N. Engl. J. Med. 2005;353:2654–2666. doi: 10.1056/NEJMoa051424. [DOI] [PubMed] [Google Scholar]
- 14.Ye S.L., Li X.Y., Zhao K., Feng T. High expression of CD8 predicts favorable prognosis in patients with lung adenocarcinoma: A cohort study. Medicine. 2017;96:e6472. doi: 10.1097/MD.0000000000006472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kim S.H., Go S.I., Song D.H., Park S.W., Kim H.R., Jang I., Kim J.D., Lee J.S., Lee G.W. Prognostic impact of CD8 and programmed death-ligand 1 expression in patients with resectable non-small cell lung cancer. Br. J. Cancer. 2019;120:547–554. doi: 10.1038/s41416-019-0398-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Gnjatic S., Bronte V., Brunet L.R., Butler M.O., Disis M.L., Galon J., Hakansson L.G., Hanks B.A., Karanikas V., Khleif S.N., et al. Identifying baseline immune-related biomarkers to predict clinical outcome of immunotherapy. J. Immunother. Cancer. 2017;5:44. doi: 10.1186/s40425-017-0243-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Hendry S., Salgado R., Gevaert T., Russell P.A., John T., Thapa B., Christie M., van de Vijver K., Estrada M.V., Gonzalez-Ericsson P.I., et al. Assessing Tumor-Infiltrating Lymphocytes in Solid Tumors: A Practical Review for Pathologists and Proposal for a Standardized Method from the International Immuno-Oncology Biomarkers Working Group: Part 2: TILs in Melanoma, Gastrointestinal Tract Carcinomas, Non-Small Cell Lung Carcinoma and Mesothelioma, Endometrial and Ovarian Carcinomas, Squamous Cell Carcinoma of the Head and Neck, Genitourinary Carcinomas, and Primary Brain Tumors. Adv. Anat. Pathol. 2017;24:311–335. doi: 10.1097/PAP.0000000000000161. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Gatenby R.A., Grove O., Gillies R.J. Quantitative imaging in cancer evolution and ecology. Radiology. 2013;269:8–15. doi: 10.1148/radiol.13122697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Jimenez-Sanchez A., Cybulska P., Mager K.L., Koplev S., Cast O., Couturier D.L., Memon D., Selenica P., Nikolovski I., Mazaheri Y., et al. Unraveling tumor-immune heterogeneity in advanced ovarian cancer uncovers immunogenic effect of chemotherapy. Nat. Genet. 2020;52:582–593. doi: 10.1038/s41588-020-0630-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Aerts H.J.W.L., Velazquez E.R., Leijenaar R.T.H., Parmar C., Grossmann P., Carvalho S., Bussink J., Monshouwer R., Haibe-Kains B., Rietveld D., et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat. Commun. 2014;5:4006. doi: 10.1038/ncomms5006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Trebeschi S., Drago S.G., Birkbak N.J., Kurilova I., Cǎlin A.M., Delli Pizzi A., Lalezari F., Lambregts D.M.J., Rohaan M.W., Parmar C., et al. Predicting response to cancer immunotherapy using noninvasive radiomic biomarkers. Ann. Oncol. 2019;30:998–1004. doi: 10.1093/annonc/mdz108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Kumar V., Gu Y., Basu S., Berglund A., Eschrich S.A., Schabath M.B., Forster K., Aerts H.J., Dekker A., Fenstermacher D., et al. Radiomics: The process and the challenges. Magn. Reson. Imaging. 2012;30:1234–1248. doi: 10.1016/j.mri.2012.06.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Papanikolaou N., Matos C., Koh D.M. How to develop a meaningful radiomic signature for clinical use in oncologic patients. Cancer Imaging. 2020;20:33. doi: 10.1186/s40644-020-00311-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Zhao B. Understanding Sources of Variation to Improve the Reproducibility of Radiomics. Front. Oncol. 2021;11:633176. doi: 10.3389/fonc.2021.633176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Lambin P., Leijenaar R.T.H., Deist T.M., Peerlings J., de Jong E.E.C., van Timmeren J., Sanduleanu S., Larue R., Even A.J.G., Jochems A., et al. Radiomics: The bridge between medical imaging and personalized medicine. Nat. Rev. Clin. Oncol. 2017;14:749–762. doi: 10.1038/nrclinonc.2017.141. [DOI] [PubMed] [Google Scholar]
- 26.Zwanenburg A., Vallieres M., Abdalah M.A., Aerts H., Andrearczyk V., Apte A., Ashrafinia S., Bakas S., Beukinga R.J., Boellaard R., et al. The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. Radiology. 2020;295:328–338. doi: 10.1148/radiol.2020191145. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Fournier L., Costaridou L., Bidaut L., Michoux N., Lecouvet F.E., de Geus-Oei L.-F., Boellaard R., Oprea-Lager D.E., Obuchowski N.A., Caroli A., et al. Incorporating radiomics into clinical trials: Expert consensus endorsed by the European Society of Radiology on considerations for data-driven compared to biologically driven quantitative biomarkers. Eur. Radiol. 2021;31:6001–6012. doi: 10.1007/s00330-020-07598-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.O’Connor J.M., Fessele K.L., Steiner J., Seidl-Rathkopf K., Carson K.R., Nussbaum N.C., Yin E.S., Adelson K.B., Presley C.J., Chiang A.C., et al. Speed of Adoption of Immune Checkpoint Inhibitors of Programmed Cell Death 1 Protein and Comparison of Patient Ages in Clinical Practice vs Pivotal Clinical Trials. JAMA Oncol. 2018;4:e180798. doi: 10.1001/jamaoncol.2018.0798. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Page M.J., McKenzie J.E., Bossuyt P.M., Boutron I., Hoffmann T.C., Mulrow C.D., Shamseer L., Tetzlaff J.M., Akl E.A., Brennan S.E., et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Syst. Rev. 2021;10:89. doi: 10.1186/s13643-021-01626-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Whiting P.F., Rutjes A.W., Westwood M.E., Mallett S., Deeks J.J., Reitsma J.B., Leeflang M.M., Sterne J.A., Bossuyt P.M., Group Q. QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Ann. Intern. Med. 2011;155:529–536. doi: 10.7326/0003-4819-155-8-201110180-00009. [DOI] [PubMed] [Google Scholar]
- 31.Koo T.K., Li M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016;15:155–163. doi: 10.1016/j.jcm.2016.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Gwet K.L. Computing inter-rater reliability and its variance in the presence of high agreement. Pt 1Br. J. Math. Stat. Psychol. 2008;61:29–48. doi: 10.1348/000711006X126600. [DOI] [PubMed] [Google Scholar]
- 33.Feinstein A.R., Cicchetti D.V. High agreement but low kappa: I. The problems of two paradoxes. J. Clin. Epidemiol. 1990;43:543–549. doi: 10.1016/0895-4356(90)90158-L. [DOI] [PubMed] [Google Scholar]
- 34.Sim J., Wright C.C. The kappa statistic in reliability studies: Use, interpretation, and sample size requirements. Phys. Ther. 2005;85:257–268. doi: 10.1093/ptj/85.3.257. [DOI] [PubMed] [Google Scholar]
- 35.Clark K., Vendt B., Smith K., Freymann J., Kirby J., Koppel P., Moore S., Phillips S., Maffitt D., Pringle M., et al. The Cancer Imaging Archive (TCIA): Maintaining and operating a public information repository. J. Digit Imaging. 2013;26:1045–1057. doi: 10.1007/s10278-013-9622-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Kim A.R., Choi K.S., Kim M.S., Kim K.M., Kang H., Kim S., Chowdhury T., Yu H.J., Lee C.E., Lee J.H., et al. Absolute quantification of tumor-infiltrating immune cells in high-grade glioma identifies prognostic and radiomics values. Cancer Immunol. Immunother. 2021;70:1995–2008. doi: 10.1007/s00262-020-02836-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Min J., Dong F., Wu P., Xu X., Wu Y., Tan Y., Yang F., Chai Y. A Radiomic Approach to Access Tumor Immune Status by CD8(+)TRMs on Surgically Resected Non-Small-Cell Lung Cancer. Onco. Targets Ther. 2021;14:4921–4931. doi: 10.2147/OTT.S316994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Zhang X., Liu S., Zhao X., Shi X., Li J., Guo J., Niedermann G., Luo R., Zhang X. Magnetic resonance imaging-based radiomic features for extrapolating infiltration levels of immune cells in lower-grade gliomas. Strahlenther. Onkol. 2020;196:913–921. doi: 10.1007/s00066-020-01584-1. [DOI] [PubMed] [Google Scholar]
- 39.Arefan D., Hausler R.M., Sumkin J.H., Sun M., Wu S. Predicting cell invasion in breast tumor microenvironment from radiological imaging phenotypes. BMC Cancer. 2021;21:370. doi: 10.1186/s12885-021-08122-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Chaddad A., Daniel P., Zhang M., Rathore S., Sargos P., Desrosiers C., Niazi T. Deep radiomic signature with immune cell markers predicts the survival of glioma patients. Neurocomputing. 2022;469:366–375. doi: 10.1016/j.neucom.2020.10.117. [DOI] [Google Scholar]
- 41.Wang C.Y., Ginat D.T. Preliminary Computed Tomography Radiomics Model for Predicting Pretreatment CD8+ T-Cell Infiltration Status for Primary Head and Neck Squamous Cell Carcinoma. J. Comput. Assist. Tomogr. 2021;45:629–636. doi: 10.1097/RCT.0000000000001149. [DOI] [PubMed] [Google Scholar]
- 42.Mazzaschi G., Milanese G., Pagano P., Madeddu D., Gnetti L., Trentini F., Falco A., Frati C., Lorusso B., Lagrasta C., et al. Integrated CT imaging and tissue immune features disclose a radio-immune signature with high prognostic impact on surgically resected NSCLC. Lung Cancer. 2020;144:30–39. doi: 10.1016/j.lungcan.2020.04.006. [DOI] [PubMed] [Google Scholar]
- 43.Chen S., Feng S., Wei J., Liu F., Li B., Li X., Hou Y., Gu D., Tang M., Xiao H., et al. Pretreatment prediction of immunoscore in hepatocellular cancer: A radiomics-based clinical model based on Gd-EOB-DTPA-enhanced MRI imaging. Eur. Radiol. 2019;29:4177–4187. doi: 10.1007/s00330-018-5986-x. [DOI] [PubMed] [Google Scholar]
- 44.Jiang Y., Wang H., Wu J., Chen C., Yuan Q., Huang W., Li T., Xi S., Hu Y., Zhou Z., et al. Noninvasive imaging evaluation of tumor immune microenvironment to predict outcomes in gastric cancer. Ann. Oncol. 2020;31:760–768. doi: 10.1016/j.annonc.2020.03.295. [DOI] [PubMed] [Google Scholar]
- 45.Zhou J., Zou S., Cheng S., Kuang D., Li D., Chen L., Liu C., Yan J., Zhu X. Correlation Between Dual-Time-Point FDG PET and Tumor Microenvironment Immune Types in Non-Small Cell Lung Cancer. Front. Oncol. 2021;11:559623. doi: 10.3389/fonc.2021.559623. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Zhou J., Zou S., Kuang D., Yan J., Zhao J., Zhu X. A Novel Approach Using FDG-PET/CT-Based Radiomics to Assess Tumor Immune Phenotypes in Patients with Non-Small Cell Lung Cancer. Front. Oncol. 2021;11:769672. doi: 10.3389/fonc.2021.769272. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Lopci E., Toschi L., Grizzi F., Rahal D., Olivari L., Castino G.F., Marchetti S., Cortese N., Qehajaj D., Pistillo D., et al. Correlation of metabolic information on FDG-PET with tissue expression of immune markers in patients with non-small cell lung cancer (NSCLC) who are candidates for upfront surgery. Eur. J. Nucl. Med. Mol. Imaging. 2016;43:1954–1961. doi: 10.1007/s00259-016-3425-2. [DOI] [PubMed] [Google Scholar]
- 48.Castello A., Grizzi F., Toschi L., Rossi S., Rahal D., Marchesi F., Russo C., Finocchiaro G., Lopci E. Tumor heterogeneity, hypoxia, and immune markers in surgically resected non-small-cell lung cancer. Nucl. Med. Commun. 2018;39:636–644. doi: 10.1097/MNM.0000000000000832. [DOI] [PubMed] [Google Scholar]
- 49.Mitchell K.G., Amini B., Wang Y., Carter B.W., Godoy M.C.B., Parra E.R., Behrens C., Villalobos P., Reuben A., Lee J.J., et al. (18)F-fluorodeoxyglucose positron emission tomography correlates with tumor immunometabolic phenotypes in resected lung cancer. Cancer Immunol. Immunother. 2020;69:1519–1534. doi: 10.1007/s00262-020-02560-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Aoude L.G., Wong B.Z.Y., Bonazzi V.F., Brosda S., Walters S.B., Koufariotis L.T., Naeini M.M., Pearson J.V., Oey H., Patel K., et al. Radiomics Biomarkers Correlate with CD8 Expression and Predict Immune Signatures in Melanoma Patients. Mol. Cancer Res. 2021;19:950–956. doi: 10.1158/1541-7786.MCR-20-1038. [DOI] [PubMed] [Google Scholar]
- 51.Sun R., Limkin E.J., Vakalopoulou M., Dercle L., Champiat S., Han S.R., Verlingue L., Brandao D., Lancia A., Ammari S., et al. A radiomics approach to assess tumour-infiltrating CD8 cells and response to anti-PD-1 or anti-PD-L1 immunotherapy: An imaging biomarker, retrospective multicohort study. Lancet Oncol. 2018;19:1180–1191. doi: 10.1016/S1470-2045(18)30413-3. [DOI] [PubMed] [Google Scholar]
- 52.Katsoulakis E., Yu Y., Apte A.P., Leeman J.E., Katabi N., Morris L., Deasy J.O., Chan T.A., Lee N.Y., Riaz N., et al. Radiomic analysis identifies tumor subtypes associated with distinct molecular and microenvironmental factors in head and neck squamous cell carcinoma. Oral Oncol. 2020;110:104877. doi: 10.1016/j.oraloncology.2020.104877. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Ligero M., Garcia-Ruiz A., Viaplana C., Villacampa G., Raciti M.V., Landa J., Matos I., Martin-Liberal J., Ochoa-de-Olza M., Hierro C., et al. A CT-based Radiomics Signature Is Associated with Response to Immune Checkpoint Inhibitors in Advanced Solid Tumors. Radiology. 2021;299:109–119. doi: 10.1148/radiol.2021200928. [DOI] [PubMed] [Google Scholar]
- 54.Li J., Shi Z., Liu F., Fang X., Cao K., Meng Y., Zhang H., Yu J., Feng X., Li Q., et al. XGBoost Classifier Based on Computed Tomography Radiomics for Prediction of Tumor-Infiltrating CD8(+) T-Cells in Patients with Pancreatic Ductal Adenocarcinoma. Front. Oncol. 2021;11:671333. doi: 10.3389/fonc.2021.671333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Bian Y., Liu Y.F., Jiang H., Meng Y., Liu F., Cao K., Zhang H., Fang X., Li J., Yu J., et al. Machine learning for MRI radiomics: A study predicting tumor-infiltrating lymphocytes in patients with pancreatic ductal adenocarcinoma. Abdom. Radiol. 2021;46:4800–4816. doi: 10.1007/s00261-021-03159-9. [DOI] [PubMed] [Google Scholar]
- 56.Bian Y., Liu C., Li Q., Meng Y., Liu F., Zhang H., Fang X., Li J., Yu J., Feng X., et al. Preoperative Radiomics Approach to Evaluating Tumor-Infiltrating CD8(+) T Cells in Patients with Pancreatic Ductal Adenocarcinoma Using Noncontrast Magnetic Resonance Imaging. J. Magn. Reson. Imaging. 2022;55:803–814. doi: 10.1002/jmri.27871. [DOI] [PubMed] [Google Scholar]
- 57.Liao H., Zhang Z., Chen J., Liao M., Xu L., Wu Z., Yuan K., Song B., Zeng Y. Preoperative Radiomic Approach to Evaluate Tumor-Infiltrating CD8+ T Cells in Hepatocellular Carcinoma Patients Using Contrast-Enhanced Computed Tomography. Ann. Surg. Oncol. 2019;26:4537–4547. doi: 10.1245/s10434-019-07815-9. [DOI] [PubMed] [Google Scholar]
- 58.Zhang J., Wu Z., Zhao J., Liu S., Zhang X., Yuan F., Shi Y., Song B. Intrahepatic cholangiocarcinoma: MRI texture signature as predictive biomarkers of immunophenotyping and survival. Eur. Radiol. 2021;31:3661–3672. doi: 10.1007/s00330-020-07524-y. [DOI] [PubMed] [Google Scholar]
- 59.Hsu J.B., Lee G.A., Chang T.H., Huang S.W., Le N.Q.K., Chen Y.C., Kuo D.P., Li Y.T., Chen C.Y. Radiomic Immunophenotyping of GSEA-Assessed Immunophenotypes of Glioblastoma and Its Implications for Prognosis: A Feasibility Study. Cancers. 2020;12:3039. doi: 10.3390/cancers12103039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Wen Q., Yang Z., Zhu J., Qiu Q., Dai H., Feng A., Xing L. Pretreatment CT-Based Radiomics Signature as a Potential Imaging Biomarker for Predicting the Expression of PD-L1 and CD8+TILs in ESCC. Onco Targets Ther. 2020;13:12003–12013. doi: 10.2147/OTT.S261068. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Jeon S.H., Lim Y.J., Koh J., Chang W.I., Kim S., Kim K., Chie E.K. A radiomic signature model to predict the chemoradiation-induced alteration in tumor-infiltrating CD8(+) cells in locally advanced rectal cancer. Radiother. Oncol. 2021;162:124–131. doi: 10.1016/j.radonc.2021.07.004. [DOI] [PubMed] [Google Scholar]
- 62.Toulmonde M., Lucchesi C., Verbeke S., Crombe A., Adam J., Geneste D., Chaire V., Laroche-Clary A., Perret R., Bertucci F., et al. High throughput profiling of undifferentiated pleomorphic sarcomas identifies two main subgroups with distinct immune profile, clinical outcome and sensitivity to targeted therapies. EBioMedicine. 2020;62:103131. doi: 10.1016/j.ebiom.2020.103131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.FDA Approval Timeline of Active Immunotherapies. [(accessed on 6 April 2022)]. Available online: https://www.cancerresearch.org/en-us/scientists/immuno-oncology-landscape/fda-approval-timeline-of-active-immunotherapies.
- 64.Dawe D.E., Harlos C.H., Juergens R.A. Immuno-oncology-the new paradigm of lung cancer treatment. Curr. Oncol. 2020;27((Suppl. 2)):S78–S86. doi: 10.3747/co.27.5183. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Dai D., Liu L., Huang H., Chen S., Chen B., Cao J., Luo X., Wang F., Luo R., Liu J. Nomograms to Predict the Density of Tumor-Infiltrating Lymphocytes in Patients with High-Grade Serous Ovarian Cancer. Front. Oncol. 2021;11:590414. doi: 10.3389/fonc.2021.590414. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Wu X., Zhao Z., Khan A., Cai C., Lv D., Gu D., Liu Y. Identification of a Novel Signature and Construction of a Nomogram Predicting Overall Survival in Clear Cell Renal Cell Carcinoma. Front. Genet. 2020;11:1017. doi: 10.3389/fgene.2020.01017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Park J.E., Kim D., Kim H.S., Park S.Y., Kim J.Y., Cho S.J., Shin J.H., Kim J.H. Quality of science and reporting of radiomics in oncologic studies: Room for improvement according to radiomics quality score and TRIPOD statement. Eur. Radiol. 2020;30:523–536. doi: 10.1007/s00330-019-06360-z. [DOI] [PubMed] [Google Scholar]
- 68.Ursprung S., Beer L., Bruining A., Woitek R., Stewart G.D., Gallagher F.A., Sala E. Radiomics of computed tomography and magnetic resonance imaging in renal cell carcinoma-a systematic review and meta-analysis. Eur. Radiol. 2020;30:3558–3566. doi: 10.1007/s00330-020-06666-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Sanduleanu S., Woodruff H.C., de Jong E.E.C., van Timmeren J.E., Jochems A., Dubois L., Lambin P. Tracking tumor biology with radiomics: A systematic review utilizing a radiomics quality score. Radiother. Oncol. 2018;127:349–360. doi: 10.1016/j.radonc.2018.03.033. [DOI] [PubMed] [Google Scholar]
- 70.Ugga L., Perillo T., Cuocolo R., Stanzione A., Romeo V., Green R., Cantoni V., Brunetti A. Meningioma MRI radiomics and machine learning: Systematic review, quality score assessment, and meta-analysis. Neuroradiology. 2021;63:1293–1304. doi: 10.1007/s00234-021-02668-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Fornacon-Wood I., Mistry H., Ackermann C.J., Blackhall F., McPartlin A., Faivre-Finn C., Price G.J., O’Connor J.P.B. Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform. Eur. Radiol. 2020;30:6241–6250. doi: 10.1007/s00330-020-06957-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Foy J.J., Robinson K.R., Li H., Giger M.L., Al-Hallaq H., Armato S.G., 3rd Variation in algorithm implementation across radiomics software. J. Med. Imaging. 2018;5:044505. doi: 10.1117/1.JMI.5.4.044505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Liang Z.G., Tan H.Q., Zhang F., Rui Tan L.K., Lin L., Lenkowicz J., Wang H., Wen Ong E.H., Kusumawidjaja G., Phua J.H., et al. Comparison of radiomics tools for image analyses and clinical prediction in nasopharyngeal carcinoma. Br. J. Radiol. 2019;92:20190271. doi: 10.1259/bjr.20190271. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.van Timmeren J.E., Cester D., Tanadini-Lang S., Alkadhi H., Baessler B. Radiomics in medical imaging-”how-to” guide and critical reflection. Insights Imaging. 2020;11:91. doi: 10.1186/s13244-020-00887-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Traverso A., Wee L., Dekker A., Gillies R. Repeatability and Reproducibility of Radiomic Features: A Systematic Review. Int. J. Radiat. Oncol. Biol. Phys. 2018;102:1143–1158. doi: 10.1016/j.ijrobp.2018.05.053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Park J.E., Park S.Y., Kim H.J., Kim H.S. Reproducibility and Generalizability in Radiomics Modeling: Possible Strategies in Radiologic and Statistical Perspectives. Korean J. Radiol. 2019;20:1124–1137. doi: 10.3348/kjr.2018.0070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Vallieres M., Zwanenburg A., Badic B., Cheze Le Rest C., Visvikis D., Hatt M. Responsible Radiomics Research for Faster Clinical Translation. J. Nucl. Med. 2018;59:189–193. doi: 10.2967/jnumed.117.200501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Eshaghzadeh Torbati M., Minhas D.S., Ahmad G., O’Connor E.E., Muschelli J., Laymon C.M., Yang Z., Cohen A.D., Aizenstein H.J., Klunk W.E., et al. A multi-scanner neuroimaging data harmonization using RAVEL and ComBat. Neuroimage. 2021;245:118703. doi: 10.1016/j.neuroimage.2021.118703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Orlhac F., Eertink J.J., Cottereau A.S., Zijlstra J.M., Thieblemont C., Meignan M., Boellaard R., Buvat I. A Guide to ComBat Harmonization of Imaging Biomarkers in Multicenter Studies. J. Nucl. Med. 2022;63:172–179. doi: 10.2967/jnumed.121.262464. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Ligero M., Jordi-Ollero O., Bernatowicz K., Garcia-Ruiz A., Delgado-Munoz E., Leiva D., Mast R., Suarez C., Sala-Llonch R., Calvo N., et al. Minimizing acquisition-related radiomics variability by image resampling and batch effect correction to allow for large-scale data analysis. Eur. Radiol. 2021;31:1460–1470. doi: 10.1007/s00330-020-07174-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Papadimitroulas P., Brocki L., Christopher Chung N., Marchadour W., Vermet F., Gaubert L., Eleftheriadis V., Plachouris D., Visvikis D., Kagadis G.C., et al. Artificial intelligence: Deep learning in oncological radiomics and challenges of interpretability and data harmonization. Phys. Med. 2021;83:108–121. doi: 10.1016/j.ejmp.2021.03.009. [DOI] [PubMed] [Google Scholar]
- 82.Zhang X., Zhang Y., Zhang G., Qiu X., Tan W., Yin X., Liao L. Deep Learning with Radiomics for Disease Diagnosis and Treatment: Challenges and Potential. Front. Oncol. 2022;12:773840. doi: 10.3389/fonc.2022.773840. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Sala E., Mema E., Himoto Y., Veeraraghavan H., Brenton J.D., Snyder A., Weigelt B., Vargas H.A. Unravelling tumour heterogeneity using next-generation imaging: Radiomics, radiogenomics, and habitat imaging. Clin. Radiol. 2017;72:3–10. doi: 10.1016/j.crad.2016.09.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.EuCanImage: Towards a European Cancer Imaging Platform for Enhanced Artificial Intelligence in Oncology. [(accessed on 21 July 2022)]. Available online: https://eucanimage.eu.
- 85.McAteer M.A., O’Connor J.P.B., Koh D.M., Leung H.Y., Doran S.J., Jauregui-Osoro M., Muirhead N., Brew-Graves C., Plummer E.R., Sala E., et al. Introduction to the National Cancer Imaging Translational Accelerator (NCITA): A UK-wide infrastructure for multicentre clinical translation of cancer imaging biomarkers. Br. J. Cancer. 2021;125:1462–1465. doi: 10.1038/s41416-021-01497-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Braman N.M., Etesami M., Prasanna P., Dubchuk C., Gilmore H., Tiwari P., Plecha D., Madabhushi A. Intratumoral and peritumoral radiomics for the pretreatment prediction of pathological complete response to neoadjuvant chemotherapy based on breast DCE-MRI. Breast Cancer Res. 2017;19:57. doi: 10.1186/s13058-017-0846-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87.Xu H., Liu J., Chen Z., Wang C., Liu Y., Wang M., Zhou P., Luo H., Ren J. Intratumoral and peritumoral radiomics based on dynamic contrast-enhanced MRI for preoperative prediction of intraductal component in invasive breast cancer. Eur. Radiol. 2022;32:4845–4856. doi: 10.1007/s00330-022-08539-3. [DOI] [PubMed] [Google Scholar]
- 88.Pérez-Morales J., Tunali I., Stringfield O., Eschrich S.A., Balagurunathan Y., Gillies R.J., Schabath M.B. Peritumoral and intratumoral radiomic features predict survival outcomes among patients diagnosed in lung cancer screening. Sci. Rep. 2020;10:10528. doi: 10.1038/s41598-020-67378-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Dou T.H., Coroller T.P., van Griethuysen J.J.M., Mak R.H., Aerts H. Peritumoral radiomics features predict distant metastasis in locally advanced NSCLC. PLoS ONE. 2018;13:e0206108. doi: 10.1371/journal.pone.0206108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Liu R., Yang F., Yin J.Y., Liu Y.Z., Zhang W., Zhou H.H. Influence of Tumor Immune Infiltration on Immune Checkpoint Inhibitor Therapeutic Efficacy: A Computational Retrospective Study. Front. Immunol. 2021;12:685370. doi: 10.3389/fimmu.2021.685370. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Raskov H., Orhan A., Christensen J.P., Gogenur I. Cytotoxic CD8(+) T cells in cancer and cancer immunotherapy. Br. J. Cancer. 2021;124:359–367. doi: 10.1038/s41416-020-01048-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Bernatowicz K., Grussu F., Ligero M., Garcia A., Delgado E., Perez-Lopez R. Robust imaging habitat computation using voxel-wise radiomics features. Sci. Rep. 2021;11:20133. doi: 10.1038/s41598-021-99701-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Cherezov D., Goldgof D., Hall L., Gillies R., Schabath M., Müller H., Depeursinge A. Revealing Tumor Habitats from Texture Heterogeneity Analysis for Classification of Lung Cancer Malignancy and Aggressiveness. Sci. Rep. 2019;9:4500. doi: 10.1038/s41598-019-38831-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Beer L., Martin-Gonzalez P., Delgado-Ortet M., Reinius M., Rundo L., Woitek R., Ursprung S., Escudero L., Sahin H., Funingana I.G., et al. Ultrasound-guided targeted biopsies of CT-based radiomic tumour habitats: Technical development and initial experience in metastatic ovarian cancer. Eur. Radiol. 2021;31:3765–3772. doi: 10.1007/s00330-020-07560-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Martin-Gonzalez P., Crispin-Ortuzar M., Rundo L., Delgado-Ortet M., Reinius M., Beer L., Woitek R., Ursprung S., Addley H., Brenton J.D., et al. Integrative radiogenomics for virtual biopsy and treatment monitoring in ovarian cancer. Insights Imaging. 2020;11:94. doi: 10.1186/s13244-020-00895-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Dwivedi D.K., Chatzinoff Y., Zhang Y., Yuan Q., Fulkerson M., Chopra R., Brugarolas J., Cadeddu J.A., Kapur P., Pedrosa I. Development of a Patient-specific Tumor Mold Using Magnetic Resonance Imaging and 3-Dimensional Printing Technology for Targeted Tissue Procurement and Radiomics Analysis of Renal Masses. Urology. 2018;112:209–214. doi: 10.1016/j.urology.2017.08.056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Baldi D., Aiello M., Duggento A., Salvatore M., Cavaliere C. MR Imaging-Histology Correlation by Tailored 3D-Printed Slicer in Oncological Assessment. Contrast Media Mol. Imaging. 2019;2019:1071453. doi: 10.1155/2019/1071453. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Pandit-Taskar N., Postow M.A., Hellmann M.D., Harding J.J., Barker C.A., O’Donoghue J.A., Ziolkowska M., Ruan S., Lyashchenko S.K., Tsai F., et al. First-in-Humans Imaging with (89)Zr-Df-IAB22M2C Anti-CD8 Minibody in Patients with Solid Malignancies: Preliminary Pharmacokinetics, Biodistribution, and Lesion Targeting. J. Nucl. Med. 2020;61:512–519. doi: 10.2967/jnumed.119.229781. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Morice W.G. The immunophenotypic attributes of NK cells and NK-cell lineage lymphoproliferative disorders. Am. J. Clin. Pathol. 2007;127:881–886. doi: 10.1309/Q49CRJ030L22MHLF. [DOI] [PubMed] [Google Scholar]
- 100.Pfannenstiel L.W., Diaz-Montero C.M., Tian Y.F., Scharpf J., Ko J.S., Gastman B.R. Immune-Checkpoint Blockade Opposes CD8(+) T-cell Suppression in Human and Murine Cancer. Cancer Immunol. Res. 2019;7:510–525. doi: 10.1158/2326-6066.CIR-18-0054. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Filaci G., Fravega M., Negrini S., Procopio F., Fenoglio D., Rizzi M., Brenci S., Contini P., Olive D., Ghio M., et al. Nonantigen specific CD8+ T suppressor lymphocytes originate from CD8+CD28- T cells and inhibit both T-cell proliferation and CTL function. Hum. Immunol. 2004;65:142–156. doi: 10.1016/j.humimm.2003.12.001. [DOI] [PubMed] [Google Scholar]
- 102.Mishra S., Srinivasan S., Ma C., Zhang N. CD8(+) Regulatory T Cell—A Mystery to Be Revealed. Front. Immunol. 2021;12:708874. doi: 10.3389/fimmu.2021.708874. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.