Skip to main content
Journal of Translational Medicine logoLink to Journal of Translational Medicine
. 2019 Oct 7;17:337. doi: 10.1186/s12967-019-2073-2

Bringing radiomics into a multi-omics framework for a comprehensive genotype–phenotype characterization of oncological diseases

Mario Zanfardino 1,✉,#, Monica Franzese 1,#, Katia Pane 1, Carlo Cavaliere 1, Serena Monti 1, Giuseppina Esposito 2, Marco Salvatore 1, Marco Aiello 1
PMCID: PMC6778975  PMID: 31590671

Abstract

Genomic and radiomic data integration, namely radiogenomics, can provide meaningful knowledge in cancer diagnosis, prognosis and treatment. Despite several data structures based on multi-layer architecture proposed to combine multi-omic biological information, none of these has been designed and assessed to include radiomic data as well. To meet this need, we propose to use the MultiAssayExperiment (MAE), an R package that provides data structures and methods for manipulating and integrating multi-assay experiments, as a suitable tool to manage radiogenomic experiment data. To this aim, we first examine the role of radiogenomics in cancer phenotype definition, then the current state of radiogenomics data integration in public repository and, finally, challenges and limitations of including radiomics in MAE, designing an extended framework and showing its application on a case study from the TCGA-TCIA archives. Radiomic and genomic data from 91 patients have been successfully integrated in a single MAE object, demonstrating the suitability of the MAE data structure as container of radiogenomic data.

Keywords: Radiogenomics, MultiAssayExperiment, Radiomics, Cancer, TCGA, TCIA

Background

Diseases are governed by complex biological mechanisms requiring different levels of analyses for a comprehensive interpretation of the underlying pathology. Today, the progress in genomics, transcriptomics, epigenomics and their combination, enables the incorporation of different biological layers of information to predict phenotypic conditions (tumor/normal, early/late stage, survival, etc.). Multi-omics data integration is, therefore, one of the major challenges in the era of precision medicine, particulary in oncology. With the huge increase in genomic data production, the need for specific models and methods for storing and analyzing those data has arisen; an example is MultiAssayExperiment (MAE) [1]. MAE handles multiple and heterogeneous data types for a set of samples of multi-assay genomic experiments (transcript counts, DNA variants or methylation status of genes or regions, etc.). However, these structures consider only data produced by molecular biology experiments and neglect the impact of other ‘omics which also deserve consideration. The progress that has been made in medical imaging techniques and the development of high-throughput algorithms to extract quantitative features from medical images has led to the development of radiomics. In clinical research, radiomics is becoming a meaningful tool and might be considered as an additional and complementary source of ‘omic information, not achievable in a multi-omics biological environment. In this scenario, the growing impact of non-invasive imaging techniques for disease definition, in parallel with the evolution of next-generation sequencing (NGS) tools, provides powerful methods for investigating the phenotype through the combination of imaging characteristics (radiomic features) into a multi-omics biological framework. Indeed, in recent years, correlation of radiomic features with genomic features, rise to a new field of study defined “radiogenomics” [2]. The increasing scale and availability of a high volume of health data requires new and efficient strategies for data management, data linkage and data integration. These types of datasets are defined “multimodal” [3] since multimodal signals are managed together. In this context, there are many challenges to overcome: identifying relationships between data from different modalities, joining multimodal information to execute prediction, learning information to help understand limited data of another modality and, crucial in our case, representing, integrating and summarizing multimodal data. Thus, in order to optimize data management and analysis, it is necessary to reshape the existing information systems into innovative multi-layer data systems by combining statistical and computational methods. So far, no tools integrating genomic and radiomic data have been designed; therefore, consolidating single-omic datasets from different domains in a meaningful manner is an ambitious undertaking. Here, we investigated the role of the MAE structure as a possible bridge for integrating radiomics into a multi-omics framework. To this end, we evaluated the potential of MAE as a structure for storing and managing both imaging and biological ‘omic data derived from different type of experiments, while keeping the coordinated representation of data and ensuring consistency between a single assay and clinical patient data during data subsetting and analysis intact. The extended multi-omics framework proposed here allows researchers to simplify the management of radiogenomic data. In this article, (i) we will first introduce the state of the art of both radiomics and biological ‘omics in the field of cancer research; (ii) we will then summarize the role of radiogenomics in cancer phenotype definition; (iii) we will discuss the current state of radiogenomic public repositories, their limits, challenges and limitations of including radiomics in a multi-omics framework; (iv) finally, we will demonstrate the feasibility of our approach with a case study using The Cancer Genome Atlas (TCGA), for biological data, and The Cancer Imaging Archive (TCIA), for public medical images.

Radiomics and biological ‘omics in the field of cancer research: state of the art

Radiomics framework

Radiomics arises from the increasing interest in the development of non-invasive diagnostic tools for disease characterization and monitoring, especially in cancer research [4, 5]. Diagnostic images are able to provide information on the entire tumor volume, reducing inaccuracy due to sampling errors in histopathological analyses. In this scenario, radiomics, i.e. the extraction of a large number of quantitative features from medical images [6], has proved to be a key way to study the cancer imaging phenotypes, reflecting underlying gene expression patterns [7, 8] and revealing heterogeneous tumor metabolism and anatomy [9, 10]. This high-throughput feature extraction is typically preparatory to a data mining process [11] in order to associate or predict different clinical outcomes [12], giving important prognostic information about the disease. Radiomics has the potential to extensively characterize the intratumoral heterogeneity, and it has shown promise in predicting treatment response and outcome, differentiating benign and malignant tumors and assessing the relationship with genetics in many cancer types [1319]. The radiomic approach can be applied to any imaging modality, even on more modalities acquired at the same time point, providing multi-parametric features. Once the images are collected, the radiomic approach involves two main steps: the segmentation of Region Of Interest (ROI) and the estimation of descriptive features. ROI segmentation consists of the identification of target regions of prognostic value, which can be performed according to different strategies. After ROI segmentation, an automated process extracts quantitative features (descriptors) from each ROI. The descriptors are designed to provide information, related to the tumor phenotype and the microenvironment. Radiomic features can be divided into four groups: shape-based (geometric characteristics), first-order and second-order statistics features (texture characteristics) and higher-order features (impose filter grids on an image to extract repetitive or non-repetitive patterns to compute first- or second-order statistic features from). As a result, up to hundreds of features are obtained from a single image (Fig. 1). Finally, the extracted features, together with clinical or pathologic outcomes, are fed into machine-learning procedures to construct classification, predictive, or prognostic models [20].

Fig. 1.

Fig. 1

Radiomics workflow. Radiomics features can be calculated from one or more imaging modalities, e.g. computed tomography (CT), magnetic resonance (MR), positron emission tomography (PET), for each time point acquired. Then, regions of interest (ROIs) are segmented from the acquired multi-parametric images, e.g. T2 weighted MR image, Contrast Enhanced T1 weighted MR image, FDG PET image, as shown from left to right in the figure in a case of breast lesion. Finally, the radiomic features are estimated, providing hundreds of features that can be categorized as shape, first order, second order and higher order features, for each segmented ROI, for each patient in the study and for each acquired image

Biological multi-omics integration tools

In the past several years, various methods, data structures and tools, related to multi-omics data integration have been developed. For an exhaustive review of multi-omics data integration methods and a list of packages using these methods see Huang et al. [21]. In order to ensure structured relations between different layers of biological data, data containers are a necessary requirement. Some existing data structures for multi-omic assays have been utilized to meet this demand. Two of the most recent are MultiDataSet [22] and MultiAssayExperiment (MAE) [1] (R/Bioconductor packages). These packages manage several sets of biological experiments and facilitate the coordination of different types of operations, such as data visualization, data manipulation, subsetting, data integration and reshaping. Moreover, these data containers enable subsetting of data by different items, such as clinical or pathologic variables, genes, genomic ranges and assays. Additionally, data warehouses that enable users to dynamically interrogate clinico-pathologic data in a multidimensional manner are developed in this context. One such example is the Data Warehouse for Translational Research (DW4TR) [23].

We have chosen to test MAE as radiogenomic data container because of the extensive documentation, very frequent updating, integration of several R and Bioconductor data classes, ample set of data manipulation methods and a simplified graphical interface including many R/Bioconductor packages. Moreover, many of the available datasets, which include both radiomic and genomic data, are provided by TCGA and TCIA databases and the whole genomic part is already available as an MAE object. The structure of the MAE object makes possible coordinated operations through three main functions: i) reporting the property of sample units, such as clinical, pathological, and biospecimen data; ii) containing the experimental data for the samples forming part of the study; iii) containing the representation of the relationship between sample units and experimental data. Another class of fundamental tools are visualization and analysis tools. Table 1 summarizes the main characteristics of these resources. For a deeper list of tools, see Kannan L [34, 35].

Table 1.

Multiple cancer data type visualization and/or integration resources

Name Description Data type Software type/Programming language Key task Operating system Latest update
Caleydo StratomeX [24] Tools allowing exploration of relationship among multiple datasets Multi-omic Application/Java Data visualization Windows Unix/Linux Mac OS 2018
CAS-viewer [25] Visualization of Cancer Alternatively Splicing (CAS) is a dynamic interface providing an integrated knowledge of alternative mRNA splicing patterns along with multi-cancer omic data from 33 TCGA cancer types DNA methylation, miRNAs, and SNPs Web Application/- Data visualization and basic analysis Windows Unix/Linux Mac OS 2018
cBio Cancer Genomic Portal [26, 27] The cBioPortal for Cancer Genomics provides visualization, analysis and download of large-scale cancer genomics data sets from The Cancer Genome Atlas as well as many carefully curated published data sets Transcriptomic, DNA methylation, CNVs, SNPs and clinical data Web Application/Python, Java, Perl, R, MatLab Data visualization and basic analysis

Windows

Unix/Linux Mac OS

2018
Genboree Workbench [28] Genboree is a web-based platform for multi-omic research and data analysis using the latest bioinformatics tools. Transcriptomic and epigenomic data Web Application/- Data visualization and basic analysis Windows Unix/Linux Mac OS 2014
MARIO [29] MArkov Random fields to Integrate Omics variables (MARIO) is a hierarchical Bayesian model approach for the parallel, integrative analysis of data from several genomic types Multi-omic and beyond BUGS software/- Data integration/analytics Unix/Linux 2017
mixOmics [30] mixOmics offers exploration and integration of biological data and allows multivariate statistical approaches to identify similarities between two heterogeneous datasets Multi-omic and beyond Bioconductor Package/R Data integration/analytics Windows Unix/Linux Mac OS 2018
ModulOmics [31] ModulOmics identifies cancer driver pathways, or modules, by integrating multiple data types on the basis of DNA and RNA cancer patient data, integrated with PPI networks and known regulatory connections Multi-omic and beyond Package/R or Python Data integration/analytics Unix/Linux Mac OS 2018
Omics Integrator [32] Omics Integrator provides integration of proteomic data, gene expression data and/or epigenetic data using a protein–protein interaction network. It is comprised of two modules, Garnet and Forest Multi-omic and beyond Package/Python Data integration/analytics Unix/Linux 2018
XENA UCSC browser [33] It offers interactive visualization and exploration of TCGA genomic, phenotypic, and clinical data, as produced by the Cancer Genome Atlas Research Network Multi-omic Web client Data visualization Windows Unix/Linux Mac OS 2017

Challenges of radiomics in multi-omics framework

A crucial aspect in radiogenomic data analysis is the very large dimensionality of the feature space; therefore the analyses of these data are often unreliable and have a high overfitting and curse of dimensionality . For these reasons, radiogenomic studies need a robust data structure in order to reduce difficulty and make the analyses efficient, scalable and reproducible. In this context, some data integration and data processing challenges need to be addressed [36]. One challenge regards data acquisition of ‘omic experiments, since biological processes may be assessed in different spatial and/or temporal scales. Indeed there is a greater complexity in some type of ‘omics, such as transcriptomics (alteration of gene expression over time), compared to, for example, genomic experiments (executed on a temporal/spatial static substrate) [37]. Obviously, in radiogenomic data integration, the different and specific spatial/temporal multi-dimensionality introduces an additional level of complexity. For instance, in patient with cancer, imaging is usually performed multiple times during the course of disease and therapy whereas only one time and at one location genomics or transcriptomics profiling is not performed systematically [38]. Another crucial aspect in radiogenomic data analysis is the management of multi-sample and multi-parameters storage from different lesions or sub-regions of a lesion, for each patient. Spatial multi-dimensionality is a common event for both radiomic and biological ‘omics but, here too, there are cases of uniqueness. For example, in a proteomic experiment, which analyzes the abundance of proteins, their post-translational modifications and subcellular compartments location, does not have a  corresponding dimensionality in radiomic experiments. Another intrinsic problem of multi-omics analyses is missing data, which may occur due to reasons such as data filtering (for example, low coverage of a detected variant) or non-execution of a specific analysis on a subset of samples deriving from different laboratory. Different machine learning approaches are used to handling missing data [39] but a preliminary overview and quantification of these data is crucial to set a multi-omics analysis. Therefore, from a data structure point of view, the challenge is to ensure structured relations between patient data and experiments/assays features. One way to ensure the alignment of data is to take into account: the different scales of dimensionality of heterogenous data, missing data and data storage. Despite the challenges and the limitations described above, one of the biggest advantages of radiogenomic studies is the opportunity to assess the relationships between genotype features (such as genomic variants), intermediate phenotype features (such as transcriptomics and epigenetic variables), radiomic features (image phenotype) and phenotypic clinical outcome. Adding radiomic features means adding phenotypic descriptors, which differ from phenotypic outcome, but in relation with them and with the multi-omic biological features.

Role of radiogenomics in cancer phenotype definition

Radiogenomic analyses are generally used for two main purposes: identifying features that might be related to genetic or molecular outcomes and correlating imaging and genomic data to identify suitable markers or predictors of a particular disease. Tipically, a radiogenomic dataset contains genomic (for example, gene expression) and imaging data, without outcomes data. A well-known correlation between specific imaging features and an outcome could enable the discovery of relationship between those features and specific tumor molecular characteristics.  Similarly, investigating a well-known correlation of tumor molecular characteristics related to an outcome may allow the detection of imaging features related with that outcome. Several studies, based on these approaches, have been published. Gevaert et al. [40] tested how well the imaging features, based on specific genomic characteristics, predicted patient survival in non–small-cell lung cancer using sets of imaging and genomic (gene expression) data without outcomes. Other examples are radiogenomic studies in which correlations have been detected between imaging features and tumor subtypes, especially in breast cancer and in glioblastoma multiforme. Mazurowski et al. [41] demonstrated that imaging features describing tumor enhancement dynamics can differentiate breast cancer luminal B molecular subtype from other subtypes. Therefore, an imaging feature might be predictive of outcomes and might not necessitate a genomic analysis. However, in another study, Guo et al. [42] describe that a combination of imaging and genomic features could be useful for better breast tumor characterization. Indeed, they demonstrated that imaging features such as tumor size outperformed genomic features in predicting tumor pathological stage, whereas genomic features outperformed imaging features in predicting breast cancer estrogen receptor (ER) and progesterone receptor (PR) status such as tumor molecular characteristics. Another approach was used in Karlo et al. [43], where correlations between imaging features and mutation of genes (related with stage and diminished survival prognosis) were identified. Through this evidence, imaging features, potentially predictive of outcomes, have been identified. Furthermore, in Glioblastoma Multiforme, 1p/19q co-deletion, a widely used prognostic biomarker for brain tumors, and epidermal growth factor receptor (EGFR) mutations, have been correlated with a wide array of MRI features [44, 45]. Finally, radiogenomics could potentially have an important role in targeted therapies and in improving the performance in cancer outcomes prediction. In order to identify complex phenotypes from a radiogenomics approach, a number of challenges need to be addressed. The introduction of more complex models combining multiple heterogeneous data sources could overcome many of these challenges. For further insights on state of the art of radiogenomics studies see [6, 46, 47].

Radiomics in multi-omics framework: limits, challenges and limitations

Existing integrated databases

Integrated databases share data across multiple data types ranging from clinical to ‘omics and medical imaging relative to specific research area. In Table 2, we provide a list of discipline-specific databases covering oncological, neurological, neurodegenerative and cardiovascular field or multiple-diseases. So far, multi-omic profiles are primarily available in the oncological field. Indeed, Genomic Data Commons (GDC) portal, which includes the TCGA database, and TCIA are an unprecedented source of biomedical data for a broad range of cancer diseases. Although each database possesses its own organization, overall, they store data sets with multiple data types available at different levels. In addition to multi-omic and imaging data, supporting data related to the images such as patient outcomes, treatment details, genomics, pathology, and expert analyses are also provided when available. Clinical, multi-omic and pathological data stored on the GDC can be associated to the imaging data, stored on TCIA. Although both data portals allow an interactive navigation through different projects and their multiple data types, using matched TCGA patient identifiers, it is possible to explore the TCGA/TCIA databases without the ability to automatically correlate tissue genotype, radiological phenotype and patient outcomes. For example, many TCGA/TCIA studies [7072] have published their radiomic data (radiomic features, radiologist features or also segmentations) on the TCIA website. These data are in a simple table format, such as xls format, and at present there is no way to automatically explore the radiomic data together with the genome data available on TCGA portal. The current workflow consists of downloading imaging and genomic features separately, integrating the data through a non standard way and finally performing a cleaning and subsetting operation. The results of this process are likely to result in a situation in which there is either little or no suitable omic data. Thus, there is an urgent need to link radiomic and genomic data globally such that data integration in achieved, facilitating scientists to uncover genotype–phenotype associations/correlations. In the following section, we provide a case study based on breast cancer data from TCGA/TCIA database to illustrate an example of data integration and utilization of MAE data structure for multi-omics data management.

Table 2.

Integrated Database of oncological, neurological/neurodegenerative, cardiovascular and multiple diseases

Name Description Data type Data access Data download Latest update
Oncological disease
 CPTAC [48] https://cptac-data-portal.georgetown.edu/cptacPublic/ The Data Portal represents the NCI’s largest public repository of proteogenomic comprehensive sequence datasets MS proteomic and phosphoproteomic data and gene expression Open/controlled user account (open use studies) or request access by data use application (controlled use studies) Web based, web client and programmatic 2018
 GDC [49] https://portal.gdc.cancer.gov/ The Cancer Genome Atlas is a large cancer genomics data collection covering 43 projects with normal-control. Patient outcomes, treatment details, pathology, and expert analyses are also provided when available. Many subjects possess corresponding imaging data on The Cancer Imaging Archive (TCIA) Gene expression, DNA methylation, germline and somatic mutations, clinical data Open/controlled user account (open use studies) or request access by data use application (controlled use studies) Web-based, web client and Programmatic 2018
 ICGC [50] https://dcc.icgc.org/ The International Cancer Genome Consortium archives large number of datasets with molecular data from more than 20,000 donors including the Pan cancer Analysis of Whole Genomes (PCAWG) study Germline and somatic mutations, gene expression, DNA methylation Open/controlled user account (open use studies) or request access by data use application (controlled use studies) Web based, web client and programmatic 2018
 TCIA [51] http://https://www.cancerimagingarchive.net/ The Cancer Imaging Archive collects medical cancer images accessible for public download. Data include 78 collections and different image modalities. Many subjects possess corresponding genomics data on the GDC (ex TCGA) Medical images in DICOM format, clinical data Open/controlled user account (open use studies) or request access by data use application (controlled use studies) Web based, web client and Programmatic 2018
Neurological and neurodegenerative disorders
 1000 Functional Connectomes Project/INDI International NeuroImaging Data-sharing Initiative [52] and curse of dimensionality [4]. https://www.nitrc.org/projects/fcon_1000/ It provides the broader imaging community complete access to a large-scale functional imaging dataset such as prospective, retrospective dataset Imaging and clinical data NITRC account for some public datasets and some controlled dataset Amazon Web Services S3 and CyberDuke web client and command line 2018
 LONI Database (The Laboratory of Neuroimaging at University of Southern California) [53] https://loni.usc.edu/about_loni Repository for sharing and long-term preservation of neuroimaging and biomedical research data especially on neurological, neurodegenerative and psychiatric diseases. Some studies ongoing are: ADNI, ENIGMA, GAAIN, PPMI Clinical, imaging (MRI, PET, MRA, DTI and other imaging modalities), genetic and behavioral data from multisite longitudinal study Open use data required account controlled access by Image and Data Archive (IDA) request otherwise data use application request Web-based Image and Data Archive (IDA)* 2018
 LRRK2 Cohort consortium (The Michael J. Fox Foundation (MJFF) for Parkinson’s Research) [54] https://https://www.michaeljfox.org/page.html?lrrk2-cohort-consortium The LRRK2 Cohort Consortium (LCC) comprises three closed studies: the LRRK2 Cross-sectional Study, LRRK2 Longitudinal Study and the 23 and Me Blood Collection Study Clinical data and biospecimens (blood, urine and cerebrospinal fluid) from PD and control volunteers Account controlled access data LONI (IDA) repositorya 2018
 National Institute of Neurological Disorders and Stroke/The Michael J. Fox Foundation (MJFF) for Parkinson’s Research BioFIND [55] http://biofind.loni.usc.edu/ BioFIND is a cross-sectional clinical study designed to discovery new Parkinson’s disease biomarker Clinical data and biospecimens (blood, urine and cerebrospinal fluid) from PD and control volunteers Account controlled access data LONI (IDA) repository* 2018

 The National Institute of Mental Health (NIMH)/NIMH Repository and Genomic resources (RGR) [56] https://https://www.nimhgenetics.org/

http://ndar.nih.gov/

The NIMH Repository is an infrastructure for sharing data collected by hundreds of research projects in concerns clinical and genetic analysis of mental health disorders (e.g. schizophrenia, bipolar disorder, depression, Alzheimer’s disease, autism, obsessive–compulsive disorder, etc.). For instance the National Database for Autism Research (NDAR) website is the primary point of entry for Autism Research Imaging Genetic and Clinical data NIMH account approval Web-based and web client Open Database License (ODbL) 2018
 The National Institute of Neurological Disorders and Stroke (NINDS) [57] https://https://www.ninds.nih.gov/, https://pdbp.ninds.nih.gov/ The NINDS is divided into basic, clinical and translational research projects to advance the study of neurological disorders to both academic and industry investigators. One dataset is the PDBP DMR Parkinson’s Disease Biomarkers Program Data Management Resource Gene expression, clinical data NINDS account approval Web-based and web-client Open Database License (ODbL) 2018
 The National Institute on Aging (NIA)/AMP-AD Knowledge Portal Accelerating Medicines Partnership-Alzheimer’s Disease [58] https://http://www.synapse.org/#!Synapse:syn2580853/wiki/409840 The AMP-AD Knowledge Portal is the NIA-designated repository for distribution of data from multiple NIA-supported programs on Alzheimer’s disease Various types of molecular data from human, cell-based and animal model biosamples Account controlled access data Synapse web browser and web client 2018
 The National Institute on Aging Genetics of Alzheimer’s Disease (Data Storage Site NIAGADS) [59] https://http://www.niagads.org/ The NIAGADS provides access to publicly available NIAGADS summary statistics datasets for Alzheimer’s Disease and related neuropathologies Multi-omic GWAS, whole genome (WGS) and whole exome (WES), expression, RNA Seq, and CHIP Seq analyses Open to investigators return secondary analysis data to the database Web-based (NIAGADS genome browser) and web-client Open Database License (ODbL) 2018
Cardiovascular disease
 Cardiac Atlas Project [60] http://http://www.cardiacatlas.org/ A multi-center cardiac MRI data sets with the most robust manual contours defined by the consensus of 7 independent expert readers from 7 world-class core labs. Datasets related to 6 different studies Imaging (MRI data) and clinical data Controlled CAP data access request Web client 2018
 National Heart, Lung, and Blood Institute (BioLINCC) [61] https://biolincc.nhlbi.nih.gov/home/ NHLBI is the NIH center devoted to research, training, and education of heart, lung, blood and sleep disorders. It provides teaching datasets and public use datasets Clinical data and sometimes corresponding biospecimens Open and controlled data on request Web-based user interface (BioLINCC) 2018
 The Cardiovascular Research Grid (CVRG) [62] http://cvrgrid.org/ The CardioVascular Research Grid (CVRG) project is supported by the National Heart Lung & Blood Institute for creating an infrastructure for sharing cardiovascular data and data analysis tools Imaging (ex vivo DWI and in vivo heart CT) and clinical data Open/Controlled Web-based 2018
 The Qatar Cardiovascular Biorepository (QCBio) [63] http://http://www.qcbio.org/

Cases include patients needing percutaneous intervention for symptomatic coronary heart disease (CHD) or admitted with an acute coronary syndrome (myocardial infarction or unstable angina). Controls are individuals identified from the Hamad Medical Corp. blood bank who have no history of CHD.

The goal of QCBio is to archive plasma and DNA of 1000 Qatari patients with coronary heart disease and 1000 controls, who are matched on age, sex and ethnicity

Biospecimens (plasma and DNA) and clinical data Open to Qatari investigators and controlled access data for others Web-based and web client 2018
 Vascular Diseases Biorepository [63] https://http://www.mayo.edu/research/labs/atherosclerosis-lipid-genomics/research-projects/vascular-diseases-biorepository Biorepository for common vascular diseases, including: (PAD) Peripheral artery disease, aortic aneurysm, (CAD) carotid artery stenosis, fibromuscular dysplasia. These samples are linked with demographic information, conventional cardiovascular risk factors, and comorbidities ascertained from Mayo Clinic’s electronic health record using EHR-based electronic phenotyping algorithms Biospecimens (DNA, serum and plasma) and clinical data Open/controlled Web-based and web client 2018
Multiple diseases
 DAA [64] http://ageing-map.org/atlas/ The Digital Aging Data is a portal of age-related changes covering different biological levels. It integrates to create an interactive portal that serves as the first centralised collection of human ageing changes and pathologies Gene expression and proteomic, psychological and pathological age-related data Publicly available by DAA account approval DAA account approval for open 2017
 dbGaP [65] https://https://www.ncbi.nlm.nih.gov/gap/ The database of Genotypes and Phenotypes (dbGaP) was developed to archive and distribute the data and results from studies that have investigated the interaction of genotype and phenotype in Humans. Over 150 NCI studies are registered in dbGaP Genome wide studies and clinical data Open/controlled NCBI account approval Web client and programmatic 2018
 EGA [66] https://https://www.ebi.ac.uk/ega/ The European Genome-phenome Archive collects human biomedical data across Europe. It allows authorised users to search sequenced material, patient samples stored in biobanks, patients illnesses, treatments, outcomes Imaging Gene expression, genome wide studies and clinical data Controlled data use application request, then EGA account approval Web client and programmatic 2018
 GEO [67] https://https://www.ncbi.nlm.nih.gov/geo Gene Expression Omnibus provides multiple level datasets (4348 in total) related to cancer and other diseases Gene expression, genome wide studies and clinical data Most data are publicly available, sometimes data use on request Web client and programmatic 2018
 HGAR [68] http://genomics.senescence.info/ The Human Ageing Genomic Resources (HAGR) is a collection of databases and tools designed to help researchers study the genetics of human ageing using modern approaches such as functional genomics, network analyses, systems biology and evolutionary analyses Gene expression and clinical data Publicly available raw data, processed data on request Web based download (zip, csv files) 2018
 JGA [69] https://https://www.ddbj.nig.ac.jp/jga/index-e.html Japanese Genotype-phenome Archive is a service for archiving and sharing of all types of individual-level genetic and de-identified phenotypic data Imaging, gene expression, genome wide studies and clinical data NBDC Human Database approval Web client and programmatic 2018

aLONI (IDA) repository of multiple projects

Statistical challenges

The increasing interest in the development of statistical methodologies for multi-layers integration is due to the complexity of biological systems and data heterogeneity. In particular, to integrate heterogeneous data several methodological challenges must be addressed must:

  1. different technical platforms;

  2. different modalities and techniques used to acquire and measure data;

  3. different numerical data types and scales;

  4. large differences in the number of measured features for each data type.

In a multi-assay context, these factors make it difficult to choose the appropriate statistical approaches for data processing and the integration method. Each technical platform has its own noise level and sensitivity and, generally, it is associated with ad-hoc protocols for normalization and batch effects, depending on ‘omics/radiomics data type. Heterogeneous data integration includes the following statistical issues: dimension reduction, data integration or data fusion and causal inference:

Dimension reduction

In multi-assays integration context, heterogeneous data usually increase the dimensionality and, consequently, increase the chance to produce false positive hypothesis testing results. To solve this problem, the first step is to identify and combine relevant features from each data modality, keeping known the biological dependencies. Dimension reduction approaches decompose data into a few new variables (called components) that explain most of the differences in observations. Dimension reduction approaches, widely used in exploratory analysis of single omics datasets, are emerging also to simultaneous exploratory analyses of multiple datasets. These methods extract the linear relationships that better explain the correlated structure across datasets, the variability both within and between variables (or observations) and may highlight data issues such as batch effects or outliers. In the literature for integrated ‘omics, dimension reduction methods have presented several variations from Principal Component Analysis (PCA) and Factor Analysis. These variations include Multiple Factor Analysis (MFA), consensus PCA (CPCA), multiple-block PCA (MBPCA) and non-negative matrix factorization (NMF). As ‘omics datasets tend to have high dimensionality it is often useful to reduce the number of variables. In fact, several recent extensions of PCA include variable selection, often via a regularization step or L1 penalization (e.g. Least Absolute Shrinkage and Selection Operator, LASSO).

Data integration or data fusion

Two main approaches to multi-omics data integration can be considered: linear or simultaneous integration. The linear approach to multi-omics data leads to an oversimplified view of biology, basing on already known biological processes. This is possible, in particular, when only two data types are considered. The complexity of the phenotypes suggests that they can be better explored by the combination of simultaneous changes across all ‘omics data. The linear multi-omics integration does not consider unknown inter-omics relationships. Instead, simultaneous approach provides a complete and realistic characterization of phenotype from exploring the inter-omics interactions. Statistical methodologies for simultaneous integration can be classified into supervised and unsupervised approaches. Unsupervised methods explore biological profiles from input datasets and assign objects into different subgroups (clusters) without labeled response variables. Conversely, supervised methods consider the available known phenotype information from samples (for example disease-normal, treatment–control) and use this information to discover genotype–phenotype interactions and investigate biological processes. In multi-omics data integration field, there are different statistical approaches that can be classified as multivariate, concatenation-based and transformation-based methods. Multivariate methods are usually based on Partial Least Square Regression (PLS) or Canonical Correspondence Analysis (CCA). Many of them were developed and integrated in multi-omics bioinformatics tools (Table 1). Concatenation-based integration methods are performed by combining multiple data matrices of different multi-omics data types into a single combined matrix, used as input for constructing a predictive model. Finally, the transformation-based methods, such as Similarity Network Fusion, before constructing a model, convert multi-omics data types into intermediate and common form and integrate them into a large input matrix. The main advantage of a transformation step is to preserve individual ‘omics characteristics that can be lost otherwise.

Causal inference

A vital piece in understanding of the disease mechanisms. In genomic data analysis, we can consider different types of associations, such as association of discrete variables (DNA variations) with continuous variables (phenotypes, gene expression), association of discrete variables (DNA variations) with binary trait (disease status). In the integrated ‘omics literature, the regression strategies are used for explaining inter- or intra-system relations and interactions. One of the approaches is the parallel regression, used to explain intersystem responses simultaneously. Another possible approach is represented by Bayesian networks (BNs), belonging to the family of graphical models. BNs maintain high interpretability via graphical outputs and represent a way to identify possible causal relationships between measured variables depending on their conditional dependencies and independence. BNs explicitly model conditional statistical dependencies among random variables. In the biological context, each random variable represents one molecular feature. Integration of different ‘omics data modalities can be performed by using a primary data source, for example gene expression and employing further data (i.e., histone modifications or combinations of several sources) to construct informative network priors, which facilitate the identification of the true biological network from data. Networks represent a powerful tool in the context of multi-omics data integration, since they are able to contain heterogeneous and high-dimensional information. Networks can characterize complex interactions, thus identifying the mechanism linked to different types of information and associated to the phenotype of interest. In radiogenomics, a weighted network fusion that takes into account the importance of each layer could be considered. This approach can be applied to multi-omic genome-scale models where layers represent transcriptomic and phenotypic information. The weight measures the relative importance of each layer. Then each condition is associated with a point in a multi-dimensional phenotypic space. In order to address knowledge from the dynamic nature of molecular networks under various disease conditions, an unsupervised method, called DIABLO [73], was developed. DIABLO is an integrative classification method building predictive multi-omics models that can be applied to multi-omics data from new samples to determine their phenotype. This approach includes sparse generalized canonical correlation analysis (sGCCA) [74], multi-omics factor analysis (MOFA) [75], and Joint and Individual Variation Explained (JIVE) [76]. The latter is a component-based method: it transforms each ‘omic dataset into latent components and maximizes the sum of pairwise correlations between latent components and a phenotype of interest.

MAE framework design: a case study

As described in the previous sections, we propose the use of MultiAssayExperiment (MAE) object as data structure to integrate genomic, radiomic and clinical data, providing coordinated representation, operations on multiple and heterogeneous data and focusing on two fundamental aspects of data at stake: multisampling and data longitudinality. We tested this solution at first studying existing MAE objects of TCGA unrestricted data of different cancer tissue obtained through curatedTCGA R package [77] and then creating a new MAE based on the TCGA breast cancer data and the respective radiomic features, extracted from T1 weighted Dynamic Contrast Enhanced (DCE) MRI images of TCIA [71].

Objects from curated TCGA contain data from different ‘omic experiments carried out on the same patient. Each experiment may contain different sample types for the same patient (for example, primary solid tumor and metastatic samples). To manage these data, in the TCGA project, a barcode is used as primary identifier. The TCGA barcode consists of a sequence of values associated to labels, each of which specifically identifies a TCGA data element. For example, the “Sample” label describes the sample type of a particular collection of data related to a patient and may take different value corresponding to a sample type according to Sample Type Codes table [78]. The barcode TCGA-A1-A0SB-01A example indicates Primary Solid Tumor data (Sample Type Code: 01) of the patient A0SB belonging to TCGA project on breast invasive carcinoma (Tissue Source Site Codes: A1) (Fig. 2). This nomenclature was also used by curated TCGA in the construction of the TCGA data MAE object. In more detail, the barcode is used as value of colname column of MAE sampleMap (a DataFrame that relates the “primary” data - that describes the biological unit, which can refer to specimens, patients, etc.—to the experimental assays—for example, RNAseqGene). This DataFrame allows an unambiguous map from every experimental observation to one and only one biological unit, such as a patient, and allows different technical and biological replication for each assay. Moreover, identifiers allow consistency between data during subsetting and re-ordering. We propose to use both MAE data structure and a TCGA-barcodes-like structure to manage radiomic experiment data, together with biological omic data, in a single data structure. Typically, in a radiomic workflow, each single ROI, and the respective features, may represent a different lesion, or a region of a lesion, and, therefore, may exist in multiple samples for each patient of a radiomic experiment. According to our proposal, this multi-sampling feature can be managed by using MAE data structure and a specific barcode, in the same way as genomic data. In this scenario, a key role is played by the ExperimentList component of MAE, which contains all experimental data. This component can contain different type of elements, two of which are Matrix (a base element used for ID-Based dataset) and SummarizedExperiment [79]. The latter may contain one or more assays (a matrix-like element that store the data). For each assay, rows represent features of interest and columns represent samples. For example in a genomic experiment, the rows of an assay represent genes or transcript, the columns represent the patients and each different assay in a Copy Number Alterations experiment may represent the values of segment mean and number of probes (Fig. 3). A radiomic experiment differs substantially from a genomic experiment in that it consists of one level of data complexity less than a genomic experiment. The latter is performed on a set of samples (the columns of the assay) and the analysis is performed on a set of genes, transcripts or protein (the rows of the assay). Finally, the experiment produces different results from the various assays. A radiomic experiment, instead, is performed on a set of samples without analysing of the molecular sub-level and therefore, from data structure point of view, we have two options:

  • Use assays of a summarizedExperiment to store the matrix-like data of each time-point. In this case, multiple time-point data are associated to a single experiment, for example BRCA_T1_weighted_DCE_MRI, with as many assays as time-points (BRCA indicates breast cancer data) (Fig. 3).

  • Use different summarizedExperiment to store different time-point data. In this case two experiments may be, for example, BRCA_T1_weighted_DCE_MRI_TP1 and BRCA_T1_weighted_DCE_MRI_TP2 (TP indicates Time Point) (Fig. 4).

Fig. 2.

Fig. 2

A barcode example. An example of a The Cancer Genome Atlas barcode with a focus on the Sample Type Codes table. Some of the identifiers, such as Vial, Portion, Analyte and Plate, are specific for biological experiments and obviously are not usable for radiomic experiments

Fig. 3.

Fig. 3

SummarizedExperiment object schema. In yellow: a classic use of summarizedExperiment object to store biological ‘omic experiment data. Each assay contains data for a result of the experiment (in this case segment mean, no probes and Log X from a Copy Number Alterations experiment). The rows of SE represent the genes and the columns represent the samples. Data describing the samples are stored in ColData object. In red: a summarizedExperiment with Magnetic Resonance Time Points as different assays. Each assay of the summarizedExperiment contains data of a single time-point and the rows represent radiomic features

Fig. 4.

Fig. 4

MultiAssayExperiment object schema with Magnetic Resonance Time Points as different Experiments. The second option described to store temporal multi-dimensionality of a radiomic experiment. Each element of Experiments (in this case a SummarizedExperiments) object of the MultiAssayExperiment contains data of a single time-point. TRhe radiomic features are also contained in the rows of SummarizedExperiment

In both cases, the rows of each assay stored radiomic features.

As shown in our case study, this data organization enables the use of MAE to collect, manage and then analyze radiomic data together with genomic and clinical data. In our case study the TCIA data consist of 36 quantitative radiomic features extracted from primary tumor images of 91 patients of the BRCA study, each acquired at a single time point. TCGA data consist of a MAE object composed of several experiments. We selected RNA-seq (expression quantification of 20,502 genes from 878 samples) and miRNA-seq (expression quantification of 1046 miRNA from 849 samples) experiments and integrated it together with TCIA data in a single MAE object. To do this, we first downloaded TCGA experiments, using curated TCGA, and TCIA features released. Subsequently, we created two R objects: one for TCGA and one for TCIA data. In the case of TCGA data we have directly obtained a MAE object through curated TCGA while in the case of TCIA, we first converted an xls file in an R dataframe and then in a summarizedExperiment object. This experiment contains two assays that represent two time point data, one of which is simulated. The radiomic experiment was subsequently integrated with the two pre-existing summarizedExperiment (RNA-seq and miRNA-seq experiment extracted from the downloaded MAE) using the workflow described in MAE vignettes on Bioconductor [80]. Figure 5 shows a generalized Venn diagram for sample membership in multiple assays. The visualization of set intersections was performed using the UpSet matrix design using UpSetR package [81]. The script code to reproduce above described procedure is available at https://gitlab.com/Zanfardino/radiogenomics-mae-case-study. We also propose an architecture, shown in Fig. 6, for a modular integration platform. Through a graphic interface, the users are able to (i) create or upload a MAE object, (ii) summarize MAE data through basic statistics and plots, (iii) manage and subset the uploaded data and (iv) execute different type of analyses (through independent modules). All the functions allow to work with highly complex data in an intuitive and simplified way. One way to manage and understand the meaning of large dimensional data is to place it in a visual context such as we have done here (Fig. 7).

Fig. 5.

Fig. 5

A generalized Venn diagram for sample membership in multiple assays. The visualization of set intersections was performed using the UpSet matrix design using UpSetR package

Fig. 6.

Fig. 6

Architecture of the modular integration platform. The architecture herein proposed follows three separate modules. The first module, based on data uploading of a MultiAssayExperiment or from its construction from multiple SummarizedEXperiment or matrix-like data. The second module allows to execute different selections of data (by clinical data, such as pathological stage or histological type of cancer, by experiment/assay and features). Then selected data are the input of different and/or integrate data analysis module. This modular architecture simplify expansion and redesign of a single implementation and allow simple adding of a personal module of data preparation and/or analysis for specific tasks. Moreover, all modules may provide visualization of data to support the different operations (see an example of data visualization in Fig. 6)

Fig. 7.

Fig. 7

A screenshot of summary tab of the graphic interface prototype. The summary tab shows the MAE data of the described case study. In the top table the name of all MAE experiments are listed and for each of them are reported the assays (timepoint_1 and timepoint_2 in the case of BRCA_T1_weighted_DCE_MRI) and the sample types. For each sample type, the number of patients is specified. The number of features and patients for each experiment are also represented as histogram (for a simple graphic representation the number of features was limited to 36 for all experiments)

Conclusions

The high-throughput production of ‘omics data has led to an increase of data sets of different types that need to be integrated in order to better understand disease mechanisms and how these multiple molecular data generate the observed phenotypes in complex diseases. Merging imaging phenotypes with multi-omic biological data may lead to new prognostic cancer  models, new support for patient treatment strategy and development of improved survival predictors. Accordingly, increased attention is paid to statistical methods and algorithms to analyze and correlate multivariate imaging, clinical and molecular data for disease diagnosis and prognosis. Bringing these datasets together in a meaningful manner is the main goal of this study. Here, we identified three main challenges to overcome: the management of missing data caused by data filtering or non-execution of a specific analysis on a subset of samples, different spatial and temporal scales of imaging data and the need to manage radiomic features related to multiple lesions or sub-regions of a lesion. Our proposal to use MAE as data structure to combine radiogenomic data aims to integrate and facilitate the use and the exploration of heterogeneous and complex data derived from these deeply distant domains. Our integrated design enables regular operations of MAE on all experiments of a radiogenomic dataset, including radiomic data. With our MAE design, operations like: (i) selecting complete cases or subsettings, (ii) selecting samples with information in all dataset and/or in all ‘omics of a set of experiments (crucial to set a multi-omics analysis when more samples with missing data exist) and (iii) selecting subjects with specific phenotypes and clinical outcomes, may be carried out in order to ensure correct alignment of assays and patients, making radiogenomic integrative analysis more attainable. Moreover, the MAE structure, and the ability to organize data of different experiments in different interlinked data objects, has facilitated the handling of the additional spatial and temporal scales added by radiomic data. All of these operations and, therefore, our selection of the MultiAssayExperiment as the radiogenomic data container have been successfully tested with the integration of TCGA-BRCA data of 91 patients with radiomic features available on TCIA for the same patients. Despite the existence of specific software that make some of these functions available, such as TCGAbiolinks, RTCGA Toolbox and mixOmics (Table 1), none of these tools was designed to work on radiogenomic data. Conversely, our proposal facilitates radiogenomic studies since it allows user exploration across genomic as well as imaging datasets in data type independent manner. For example, the use of the TCGA barcode is clearly suitable for biological ‘omics data description but not for radiomic data, except for “Patient ID”, “Sample” and “Center” labels. The latter represents an open challenge and, therefore, a possible future direction might be the development of a unique nomenclature for a new type of barcode to specifically describe radiogenomic data. Moreover, for data different from TCGA, also a custom id can be used as colName in SampleMap. In conclusion, understanding the relationships among genomic profiles, imaging phenotypes and outcomes has great potential to improve cancer treatment and management. In this context, genomic features are closely related to genetic and molecular profile of a cancer and, consequently, to outcomes like receptor status, while, radiomic features characterize tumor phenotypes and, consequently, outcomes like tumor stage. Bringing radiomics and genomic data together into a single data structure is the first step to achieve effective radiogenomic analysis, integrating information arising from different aspects of the tumor. The use of the current version of MAE by an interdisciplinary research community can pave the way to further development of extended MAE object for implementing new functionalities specific to radiogenomic domain in order to correlate phenotype and genotype features.

Acknowledgements

Not applicable.

Abbreviations

MAE

MultiAssayExperiment

NGS

next generation sequencing

TCGA

The Cancer Genome Atlas

TCIA

The Cancer Imaging Archive

DNA

deoxyribonucleic acid

ROI

region of interest

DW4TR

Data Warehouse for Translational Research

ER

estrogen receptor

PR

progesterone receptor

EGFR

epidermal growth factor receptor

GDC

genomic data commons

PCA

principal component analysis

MFA

multiple factor analysis

CPCA

consensus PCA

MBPCA

multiple-Block PCA

NMF

non-negative matrix factorization

LASSO

Least Absolute Shrinkage and Selection Operator

PLS

partial least square

CCA

Canonical Correspondence Analysis

BNs

Bayesian networks

sGCCA

sparse generalized canonical correlation analysis

MOFA

multi-omics factor analysis

JIVE

Joint and Individual Variation Explained

DCE

dynamic contrast enhanced

BRCA

breast related cancer antigens

MRI

magnetic resonance imaging

RNAseq

ribonucleic acid sequencing

Authors’ contributions

MZ, MF and KP searched for the literature and extracted the information. MZ, MF, KP, SM and MA wrote the draft; MF, MS and MA conceived and supervised the study. MZ and MA collected radiomic data for MAE. MZ designed and analyzed the case study; CC and GE critically reviewed the manuscript. All authors read and approved the final manuscript.

Funding

This work was partially funded by “Ricerca corrente” funding from Ministry of Health and “POR Regione Campania, progetto eMORFORAD”.

Availability of data and materials

Data supporting the findings of this study are available from GDC data portal https://www.cancer.gov/about-nci/organization/ccg/research/structural-genomics/tcga and from TCIA web site http://doi.org/10.7937/K9/TCIA.2014.8SIPIY6G.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Mario Zanfardino and Monica Franzese contributed equally to this work

References

  • 1.Ramos M, Schiffer L, Re A, et al. Software for the integration of multiomics experiments in Bioconductor. Cancer Res. 2017;77:e39–e42. doi: 10.1158/0008-5472.CAN-17-0344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Hariri AR, Weinberger DR. Imaging genomics. Br Med Bull. 2003;65:259–270. doi: 10.1093/bmb/65.1.259. [DOI] [PubMed] [Google Scholar]
  • 3.Baltrušaitis T, Ahuja C, Morency LP. Multimodal machine learning: a survey and taxonomy. IEEE Trans Pattern Anal Mach Intell. 2018 doi: 10.1109/TPAMI.2018.2798607. [DOI] [PubMed] [Google Scholar]
  • 4.Aiello M, Cavaliere C, D'Albore A, et al. The Challenges of Diagnostic Imaging in the Era of Big Data. J Clin Med. 2019;8(3):316. doi: 10.3390/jcm8030316. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Gatenby RA, Grove O, Gillies RJ. Quantitative imaging in cancer evolution and ecology. Radiology. 2013;1:8–15. doi: 10.1148/radiol.13122697. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Incoronato M, Aiello M, Infante T, et al. Radiogenomic analysis of oncological data: a technical survey. Int J Mol Sci. 2017;18(4):805. doi: 10.3390/ijms18040805. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Gillies RJ, Anderson AR, Gatenby RA, et al. The biology underlying molecular imaging in oncology: from genome to anatome and back again. Clin Radiol. 2010;65(7):517–521. doi: 10.1016/j.crad.2010.04.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Aerts HJ, Velazquez ER, Leijenaar RT, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006. doi: 10.1038/ncomms5006. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Diehn M, Nardini C, Wang DS, et al. Identification of noninvasive imaging surrogates for brain tumor gene-expression modules. Proc Natl Acad Sci USA. 2008;105(13):5213–5218. doi: 10.1073/pnas.0801279105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Segal E, Sirlin CB, Ooi C, et al. Decoding global gene expression programs in liver cancer by noninvasive imaging. Nat Biotechnol. 2007;25(6):675–680. doi: 10.1038/nbt1306. [DOI] [PubMed] [Google Scholar]
  • 11.Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology. 2016;278(2):563–577. doi: 10.1148/radiol.2015151169. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Li H, Zhu Y, Burnside ES, et al. Quantitative MRI radiomics in the prediction of molecular classifications of breast cancer subtypes in the TCGA/TCIA data set. NPJ Breast Cancer. 2016;2(1):16012. doi: 10.1038/npjbcancer.2016.12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Yip SSF, Aerts HJWL. Applications and limitations of radiomics. Phys Med Biol. 2016;61(13):R150–R166. doi: 10.1088/0031-9155/61/13/R150. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Monti S, Aiello M, Incoronato M, et al. DCE-MRI pharmacokinetic-based phenotyping of invasive ductal carcinoma: a radiomic study for prediction of histological outcomes. Contrast Media Mol Imaging. 2018;17:5076269. doi: 10.1155/2018/5076269. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kirienko M, Cozzi L, Antunovic L, et al. Prediction of disease-free survival by the PET/CT radiomic signature in non small cell lung cancer patients undergoing surgery. Eur J Nucl Med Mol Imaging. 2017;45(2):1–11. doi: 10.1007/s00259-017-3837-7. [DOI] [PubMed] [Google Scholar]
  • 16.Blanc-Durand P, Van Der Gucht A, Jreige M, et al. 18F-FDG PET-based radiomics score predicts survival in patients treated with Yttrium-90 transarterial radioembolization for unresectable hepatocellular carcinoma. J Nucl Med. 2017;58(460):2017. [Google Scholar]
  • 17.Wang J, Wu CJ, Bao ML, et al. Machine learning-based analysis of MR radiomics can help to improve the diagnostic performance of PI-RADS v2 in clinically relevant prostate cancer. Eur Radiol. 2017;27:4082–4090. doi: 10.1007/s00330-017-4800-5. [DOI] [PubMed] [Google Scholar]
  • 18.Jochems A, Hoebers F, De Ruysscher D, et al. Deep learning of radiomics features for survival prediction in NSCLC and Head and Neck carcinoma. Radiother Oncol. 2017;123:S866. [Google Scholar]
  • 19.Ingrisch M, Schneider MJ, Nörenberg DN, et al. Radiomic analysis reveals prognostic information in T1-weighted baseline magnetic resonance imaging in patients with glioblastoma. Investig Radiol. 2017;52(6):360–366. doi: 10.1097/RLI.0000000000000349. [DOI] [PubMed] [Google Scholar]
  • 20.Keek SA, Leijenaar RT, Jochems A, et al. A review on radiomics and the future of theranostics for patient selection in precision medicine. Br J Radiol. 2018;91(1091):20170926. doi: 10.1259/bjr.20170926. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Huang S, Chaudhary K, Garmire LX. More Is better: recent progress in multi-omics data integration methods. Front Genet. 2017;8:84. doi: 10.3389/fgene.2017.00084. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Hernandez-Ferrer C, Ruiz-Arenas C, Beltran-Gomila A, et al. MultiDataSet: an R package for encapsulating multiple data sets with application to omic data integration. BMC Bioinform. 2017;18(1):36. doi: 10.1186/s12859-016-1455-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Hu H, Correll M, Kvecher L, et al. DW4TR: a Data Warehouse for Translational Research. J Biomed Inform. 2011;44(6):1004–1019. doi: 10.1016/j.jbi.2011.08.003. [DOI] [PubMed] [Google Scholar]
  • 24.Streit M, Gratzl S, Stitz H, et al. Ordino: visual analysis tool for ranking and exploring genes, cell lines, and tissue samples. bioRxiv. 2018 doi: 10.1093/bioinformatics/btz009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Han S, Kim D, Kim Y, et al. CAS-viewer: web-based tool for splicing-guided integrative analysis of multi-omics cancer data. BMC Med Genomics. 2018;11:25. doi: 10.1186/s12920-018-0348-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Gao J, Aksoy BA, Dogrusoz U, et al. Integrative analysis of complex cancer genomics and clinical profiles using the cBioPortal. Sci Signal. 2013;6(269):pl1. doi: 10.1126/scisignal.2004088. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Cerami E, Gao J, Dogrusoz U, et al. The cBio cancer genomics portal: an open platform for exploring multidimensional cancer genomics data. Cancer Discov. 2012;2(5):401–404. doi: 10.1158/2159-8290.CD-12-0095. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Coarfa C, Pichot C, Jackson A, et al. Analysis of interactions between the epigenome and structural mutability of the genome using Genboree Workbench tools. BMC Bioinform. 2014;15:S2. doi: 10.1186/1471-2105-15-S7-S2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Schäfer M, Klein HU, Schwender H. Integrative analysis of multiple genomic variables using a hierarchical Bayesian model. Bioinformatics. 2017;33(20):3220–3227. doi: 10.1093/bioinformatics/btx356. [DOI] [PubMed] [Google Scholar]
  • 30.Rohart F, Gautier B, Singh A, et al. mixOmics: an R package for ‘omics feature selection and multiple data integration. PLoS Comput Biol. 2017;13(11):e1005752. doi: 10.1371/journal.pcbi.1005752. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Silverbush D, Cristea S, Yanovich G, et al. ModulOmics: integrating multi-omics data to identify cancer driver modules. bioRxiv. 2018 [Google Scholar]
  • 32.Tuncbag N, Gosline SJ, Kedaigle A, et al. Network-based interpretation of diverse high-throughput datasets through the omics integrator software package. PLoS Comput Biol. 2016;12(4):e1004879. doi: 10.1371/journal.pcbi.1004879. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Cline MS, Craft B, Swatloski T, et al. Exploring TCGA pan-cancer data at the UCSC cancer genomics browser. Sci Rep. 2013;3:2652. doi: 10.1038/srep02652. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Kannan L, Ramos M, Re A, et al. Public data and open source tools for multi-assay genomic investigation of disease. Brief Bioinform. 2016;17:603–615. doi: 10.1093/bib/bbv080. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Silva TC, Colaprico A, Olsen C, et al. TCGA workflow: analyze cancer genomics and epigenomics data using Bioconductor packages. F1000Res. 2016;5:1542. doi: 10.12688/f1000research.8923.2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Bodalal Z, Trebeschi S, Nguyen-Kim TDL, Schats W, Beets-Tan R. Radiogenomics: bridging imaging and genomics. Abdom Radiol. 2019;44(6):1960–1984. doi: 10.1007/s00261-019-02028-w. [DOI] [PubMed] [Google Scholar]
  • 37.Haas R, Zelezniak A, Iacovacci J, et al. Designing and interpreting ‘multi-omic’ experiments that may change our understanding of biology. Curr Opin Struct Biol. 2017;6:37–45. doi: 10.1016/j.coisb.2017.08.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Chakraborty S, Hosen MI, Ahmed M, et al. Onco-multi-OMICS approach: a new frontier in cancer research. Biomed Res Int. 2018;2018:9836256. doi: 10.1155/2018/9836256. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Mirza B, Wang W, Wang J, et al. Machine learning and integrative analysis of biomedical big data. Genes. 2019;10:87. doi: 10.3390/genes10020087. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Gevaert O, Xu J, Hoang CD, et al. Non–small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data—methods and preliminary results. Radiology. 2012;264:387–396. doi: 10.1148/radiol.12111607. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Mazurowski MA, Zhang J, Grimm LJ, Yoon SC, Silber JI. Radiogenomic analysis of breast cancer: luminal B molecular subtype is associated with enhancement dynamics at MR imaging. Radiology. 2014;273:365–372. doi: 10.1148/radiol.14132641. [DOI] [PubMed] [Google Scholar]
  • 42.Guo W, Li H, Zhu Y, et al. Prediction of clinical phenotypes in invasive breast carcinomas from the integration of radiomics and genomics data. J Med Imaging. 2015;2(4):041007. doi: 10.1117/1.JMI.2.4.041007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Karlo CA, Di Paolo PL, Chaim J, et al. Radiogenomics of clear cell renal cell carcinoma: associations between CT imaging features and mutations. Radiology. 2014;270:464–471. doi: 10.1148/radiol.13130663. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Shofty B, Artzi M, Ben Bashat D, Liberman G, Haim O, Kashanian A, Bokstein F, Blumenthal DT, Ram Z, Shahar T. MRI radiomics analysis of molecular alterations in low-grade gliomas. Int J Comput Assist Radiol Surg. 2018;13(4):563–571. doi: 10.1007/s11548-017-1691-5. [DOI] [PubMed] [Google Scholar]
  • 45.Li Y, Liu X, Xu K, Qian Z, Wang K, Fan X, Li S, Wang Y, Jiang T. MRI features can predict EGFR expression in lower grade gliomas: a voxel-based radiomic analysis. Eur Radiol. 2008;28(1):356–362. doi: 10.1007/s00330-017-4964-z. [DOI] [PubMed] [Google Scholar]
  • 46.Mazurowski MA. Radiogenomics: what it is and why it is important. J Am Coll Radiol. 2015;12:862–866. doi: 10.1016/j.jacr.2015.04.019. [DOI] [PubMed] [Google Scholar]
  • 47.Meng C, Zeleznik OA, Thallinger GG, et al. Dimension reduction techniques for the integrative analysis of multi-omics data. Brief Bioinform. 2016;17:628–641. doi: 10.1093/bib/bbv108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Edwards NJ, Oberti M, Thangudu RR, et al. The CPTAC data portal: a resource for cancer proteomics research. J Proteome Res. 2015;14(6):2707–2713. doi: 10.1021/pr501254j. [DOI] [PubMed] [Google Scholar]
  • 49.Wilson S, Fitzsimons M, Ferguson M, et al. Developing cancer informatics applications and tools using the NCI genomic data commons API. Cancer Res. 2017;77:e15–e18. doi: 10.1158/0008-5472.CAN-17-0598. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Zhang J, Baran J, Cros A, et al. International Cancer Genome Consortium Data Portal—a one-stop shop for cancer genomics data. Database. 2011;19:bar026. doi: 10.1093/database/bar026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Clark K, Vendt B, Smith K, et al. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository. J Digit Imaging. 2013;26:1045–1057. doi: 10.1007/s10278-013-9622-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Zheng-Bradley X, Flicek P. Applications of the 1000 Genomes Project resources. Brief Funct Genomics. 2017;16(3):163–170. doi: 10.1093/bfgp/elw027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Katako A, Shelton P, Goertzen AL, et al. Machine learning identified an Alzheimer’s disease-related FDG-PET pattern which is also expressed in Lewy body dementia and Parkinson’s disease dementia. Sci Rep. 2018;8:13236. doi: 10.1038/s41598-018-31653-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Pont-Sunyer C, Tolosa E, Caspell-Garcia C, et al. The prodromal phase of leucine-rich repeat kinase 2-associated Parkinson disease: clinical and imaging Studies. Mov Disord. 2017;32:726–738. doi: 10.1002/mds.26964. [DOI] [PubMed] [Google Scholar]
  • 55.Kang UJ, Goldman JG, Alcalay RN, et al. The BioFIND study: characteristics of a clinically typical Parkinson’s disease biomarker cohort. Mov Disord. 2016;31:924–932. doi: 10.1002/mds.26613. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Payakachat N, Tilford JM, Ungar WJ. National Database for Autism Research (NDAR): big data opportunities for health services research and health technology assessment. Pharmacoeconomics. 2016;34:127–138. doi: 10.1007/s40273-015-0331-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Gwinn K, David KK, Swanson-Fischer C, et al. Parkinson’s disease biomarkers: perspective from the NINDS Parkinson’s Disease Biomarkers Program. Biomark Med. 2017;11:451–473. doi: 10.2217/bmm-2016-0370. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Hodes RJ, Buckholtz N. Accelerating Medicines Partnership: Alzheimer’s Disease (AMP-AD) knowledge portal aids Alzheimer’s drug discovery through open data sharing. Expert Opin Ther Targets. 2016;20:389–391. doi: 10.1517/14728222.2016.1135132. [DOI] [PubMed] [Google Scholar]
  • 59.Butkiewicz M, Blue EE, Leung YY, et al. Functional annotation of genomic variants in studies of late-onset Alzheimer’s disease. Bioinformatics. 2018;34:2724–2731. doi: 10.1093/bioinformatics/bty177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Fonseca CG, Backhaus M, Bluemke DA, et al. The Cardiac Atlas Project—an imaging database for computational modeling and statistical atlases of the heart. Bioinformatics. 2011;27:2288–2295. doi: 10.1093/bioinformatics/btr360. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Giffen CA, Carroll LE, Adams JT, et al. Providing Contemporary Access to Historical Biospecimen Collections: development of the NHLBI Biologic Specimen and Data Repository Information Coordinating Center (BioLINCC) Biopreserv Biobank. 2015;13:271–279. doi: 10.1089/bio.2014.0050. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Liu B, Madduri RK, Sotomayor B, et al. Cloud-based bioinformatics workflow platform for large-scale next-generation sequencing analyses. J Biomed Inform. 2014;49:119–133. doi: 10.1016/j.jbi.2014.01.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Ye Z, Kalloo FS, Dalenberg AK, et al. An electronic medical record-linked biorepository to identify novel biomarkers for atherosclerotic cardiovascular disease. Glob Cardiol Sci Pract. 2013;2013:82–90. doi: 10.5339/gcsp.2013.10. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Craig T, Smelick C, Tacutu R, et al. The Digital Ageing Atlas: integrating the diversity of age-related changes into a unified resource. Nucleic Acids Res. 2015;43:D873–D878. doi: 10.1093/nar/gku843. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Tryka KA, Hao L, Sturcke A, et al. NCBI’s database of genotypes and phenotypes: dbGaP. Nucleic Acids Res. 2014;42:D975–D979. doi: 10.1093/nar/gkt1211. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Lappalainen I, Almeida-King J, Kumanduri V, et al. The European Genome-phenome Archive of human data consented for biomedical research. Nat Genet. 2015;47:692–695. doi: 10.1038/ng.3312. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Barrett T, Wilhite SE, Ledoux P, et al. NCBI GEO: archive for functional genomics data sets—update. Nucleic Acids Res. 2012;41:D991–D995. doi: 10.1093/nar/gks1193. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Tacutu R, Thornton D, Johnson E, et al. Human Ageing Genomic Resources: new and updated databases. Nucleic Acids Res. 2018;46:D1083–D1090. doi: 10.1093/nar/gkx1042. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Kodama Y, Mashima J, Kosuge T, et al. DNA Data Bank of Japan: 30th anniversary. Nucleic Acids Res. 2018;46:D30–D35. doi: 10.1093/nar/gkx926. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Bakas S, Akbari H, Sotiras A, Bilello M, et al. Segmentation labels and radiomic features for the pre-operative scans of the TCGA-LGG collection. Cancer Imaging Archiv. 2017 [Google Scholar]
  • 71.Morris E, Burnside E, Whitman G, et al. Using computer-extracted image phenotypes from tumors on breast mri to predict stage. Cancer Imaging Archiv. 2014 doi: 10.1002/cncr.29791. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Bakas S, Akbari H, Sotiras A, Bilello M, et al. Segmentation labels and radiomic features for the pre-operative Scans of the TCGA-GBM collection. Cancer Imaging Archiv. 2017 [Google Scholar]
  • 73.Singh A, Gautier B, Shannon CP. DIABLO: from multi-omics assays to biomarker discovery, an integrative approach. bioRxiv. 2018 [Google Scholar]
  • 74.Tenenhaus A, Philippe C, Guillemot V, et al. Variable selection for generalized canonical correlation analysis. Biostatistics. 2014;15(3):569–583. doi: 10.1093/biostatistics/kxu001. [DOI] [PubMed] [Google Scholar]
  • 75.Argelaguet R, Velten B, Arnol D, et al. Multi-omics factor analysis—a framework for unsupervised integration of multi-omics data sets. Mol Syst Biol. 2018;14(6):e8124. doi: 10.15252/msb.20178124. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Lock EF, Hoadley KA, Marron JS, et al. Joint and individual variation explained (JIVE) for integrated analysis of multiple data types. Ann Appl Stat. 2013;7(1):523–542. doi: 10.1214/12-AOAS597. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Ramos M. curatedTCGA Data: Curated Data From The Cancer Genome Atlas (TCGA) as MultiAssayExperiment Objects. R package version 1.3.5.
  • 78.GDC Sample Type Codes. https://gdc.cancer.gov/resources-tcga-users/tcga-code-tables/sample-type-codes. Accessed 5 July 2019.
  • 79.Morgan M, Obenchain V, Hester J et al. SummarizedExperiment: SummarizedExperiment container. R package version 1.10.1.
  • 80.Bioconductor page of MultiAssayExperiment. http://bioconductor.org/packages/release/bioc/html/MultiAssayExperiment.html. Accessed 5 July 2019.
  • 81.Lex A, Gehlenborg N, Strobelt H, et al. UpSet: visualization of Intersecting Sets. IEEE Trans Visual Comput Graphics. 2014;20:1983–1992. doi: 10.1109/TVCG.2014.2346248. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Data supporting the findings of this study are available from GDC data portal https://www.cancer.gov/about-nci/organization/ccg/research/structural-genomics/tcga and from TCIA web site http://doi.org/10.7937/K9/TCIA.2014.8SIPIY6G.


Articles from Journal of Translational Medicine are provided here courtesy of BMC

RESOURCES