Abstract
Precision treatment of cancer requires knowledge on active tumor driving signal transduction pathways to select the optimal effective targeted treatment. Currently only a subset of patients derive clinical benefit from mutation based targeted treatment, due to intrinsic and acquired drug resistance mechanisms. Phenotypic assays to identify the tumor driving pathway based on protein analysis are difficult to multiplex on routine pathology samples. In contrast, the transcriptome contains information on signaling pathway activity and can complement genomic analyses. Here we present the validation and clinical application of a new knowledge-based mRNA-based diagnostic assay platform (OncoSignal) for measuring activity of relevant signaling pathways simultaneously and quantitatively with high resolution in tissue samples and circulating tumor cells, specifically with very small specimen quantities. The approach uses mRNA levels of a pathway’s direct target genes, selected based on literature for multiple proof points, and used as evidence that a pathway is functionally activated. Using these validated target genes, a Bayesian network model has been built and calibrated on mRNA measurements of samples with known pathway status, which is used next to calculate a pathway activity score on individual test samples. Translation to RT-qPCR assays enables broad clinical diagnostic applications, including small analytes. A large number of cancer samples have been analyzed across a variety of cancer histologies and benchmarked across normal controls. Assays have been used to characterize cell types in the cancer cell microenvironment, including immune cells in which activated and immunotolerant states can be distinguished. Results support the expectation that the assays provide information on cancer driving signaling pathways which is difficult to derive from next generation DNA sequencing analysis. Current clinical oncology applications have been complementary to genomic mutation analysis to improve precision medicine: (1) prediction of response and resistance to various therapies, especially targeted therapy and immunotherapy; (2) assessment and monitoring of therapy efficacy; (3) prediction of invasive cancer cell behavior and prognosis; (4) measurement of circulating tumor cells. Preclinical oncology applications lie in a better understanding of cancer behavior across cancer types, and in development of a pathophysiology-based cancer classification for development of novel therapies and precision medicine.
Keywords: oncology precision medicine, treatment prediction, signaling pathway activity, mRNA profiling, low input analytes
Introduction
Cellular mechanisms of cancer can be described in terms of abnormal activity of a discrete number of signal transduction pathways that control crucial cellular functions and play important roles in both physiology (e.g., embryonic development, immune response) and pathophysiology. They can be categorized as hormone driven pathways [e.g., estrogen receptor (ER), androgen receptor (AR), progesterone receptor (PR), and glucocorticoid receptor (GR) pathways], growth factor pathways (e.g., PI3K, MAPK-AP1, JAK-STAT1/2 and JAK-STAT3), the inflammatory pathway (NFκB), and developmental pathways [e.g., Wnt, Hedgehog (HH), TGFβ, and Notch pathways].
Signal transduction pathways drive tumor growth and metastasis, either as a single active pathway (e.g., the ER pathway in luminal A breast cancer) or through cooperation or crosstalk between signaling pathways (e.g., the MAPK and TGFβ pathways) (Sundqvist et al., 2013). Abnormal pathways are at the core of cancer pathophysiology and are frequently caused by molecular aberrations in the cancer genome in interaction with the cancer cell microenvironment (Hanahan and Weinberg, 2011; Bose et al., 2013). Signaling pathway activity can either be increased to drive growth or metastasis of a tumor, as is frequently the case for the PI3K pathway, or decreased in case of a signaling pathway that normally serves as a tumor suppressor. Some pathways, such as the TGFβ pathway, can exert tumor promoting and suppressive effects depending on the cancer type. A drug can either target the signal transduction pathway at the receptor, for example trastuzumab to target the HER2 receptor, or at downstream nodes, for example a PI3K inhibitor to target the PIK3CA signaling molecule or everolimus targeting the mTOR protein (Baudino, 2015; Sieuwerts et al., 2020). Many targeted drugs, such as those which target the ER, PI3K and MAPK signaling pathways, have been clinically approved based on evidence of clinical benefit and are being used to treat various cancer types (Massard et al., 2017; Dugger et al., 2018; Marquart et al., 2018; National Cancer Institute, 2021). Emerging evidence suggests that activity of specific signaling pathways are involved in response and resistance to a variety of therapies including targeted therapy, immunotherapy, and chemotherapy.
A Major Challenge in Oncology Diagnostics and Treatment Decisions: Identification of the Tumor Driving Signaling Pathway Activity in Cancer
Traditionally, the selection of targeted drugs has been based in immunohistochemistry (IHC, i.e., staining for ER, PR and HER2 protein expression in breast cancer) and can be applied to formalin fixed paraffin embedded (FFPE) tissue samples. IHC staining is currently semi-quantitative, however, and multiplexing staining remains a major challenge. Correct normalization of staining signals can be inconsistent, and sample preparation and staining protocols can vary substantially among pathology departments. Expression levels of signaling proteins do not provide information on their functional activity and activity of the associated signaling pathway (Hemert et al., 2020). The presence of ER in the cell nucleus is required for ER pathway activity, but ER expression alone is not sufficient as the estrogen ligand is necessary to activate ER and consequently the ER signaling pathway (Katzenellenbogen et al., 1993; Hemert et al., 2020). This explains the variations in ER pathway activity in an evenly distributed ER positive tumor (Yang et al., 2019; Inda et al., 2020). The functional state of signaling proteins can be determined by complex and dynamic alterations of the protein structure, which require quantitative measurement of a variety of post-translational modifications which affect protein activity. Staining methods using antibodies that recognize a specific phosphorylation state of a protein have been investigated extensively, but are not always sufficiently reliable (Mandell, 2008). Mass spectrometry proteomics approaches can be used to measure post-translational modifications of a range of receptor, signaling and transcription factor proteins (Mnatsakanyan et al., 2018), but diagnostic applications can be complicated since the analysis is limited to fresh frozen (FF) tissue samples and requires a relatively large amount of tissue to obtain a reliable result. An alternative means to measure activity of a signaling protein is to provide a substrate to the protein to measure enzymatic activity, but this method is similarly limited to fresh frozen, non-denatured samples (Shi et al., 2018). Directly measuring transcription factor activity is even more complex and requires fresh cells or tissue (Browning et al., 2009). Protein analysis approaches have been of limited help to measure the activation state of a signaling pathway and as a method to predict therapy response.
The availability of Next Generation Sequencing (NGS) techniques has enabled identifying tumor-driving gene mutations in many histologies of cancer. This has resulted in a number of therapeutic successes, as evident from FDA approved companion diagnostic assays based on identification of a specific gene mutation to predict therapy response (FDA, 2020). FDA approval was recently obtained for the use of the PI3K inhibitor drug alpelisib in breast cancer patients with a PIK3CA mutation, based on the results of the SOLAR-1 trial (André et al., 2019). Other mutations may be clinically used independent of FDA approval, for example activating mutations in the ESR1 gene coding for the estrogen receptor and associated with resistance to hormonal therapy (Jeselsohn et al., 2015). For many mutations in signaling pathway-related genes, for example in the Notch genes, it remains hard to establish the clinical relevance of the mutation. A clear link between the mutation and activity of the corresponding signaling pathway can often not be made reliably (Janku, 2017; van de Stolpe, 2019; Martin et al., 2020). An important factor, partially explaining this disappointing result, is that the cancer cell phenotype is determined not only by genomic mutations, but also by epigenetic dysregulations and by interactions with cells in the tumor microenvironment, e.g., fibroblasts and a variety of immune cells (Hanahan and Weinberg, 2011). This makes it essential to measure functional signaling pathway activity in a cancer tissue sample, while taking into account the challenge to distinguish between the phenotypes of cancer cells and cell types in the microenvironment.
Measuring Phenotypic Signaling Pathway Activity in a Cancer Tissue Sample From mRNA Expression
RNA-based methods to measure signaling pathway activity have advanced during the past decade to provide information on signaling pathway activity based on mRNA expression data of a tumor sample. However, using mRNA expression levels as a proxy for the presence of corresponding activated signaling molecules or transcription factors can be inaccurate. First, mRNA expression levels are unreliable indicators of corresponding protein levels because their production and turnover rates are frequently not matched. Second, signaling protein levels are in general not related to the functional activity state of the protein, which is determined by post-translational modifications, such as specific phosphorylations. Nevertheless, mRNA expression levels can provide information on activity of the transcription factors that produce them, and indirectly on activity of signaling pathways that lead to activation of such transcription factors.
A number of RNA-based pathway analysis tools are available, such as Ingenuity Pathway Analysis (Qiagen), Gene Set Enrichment Analysis (GSEA) (Subramanian et al., 2005) and DAVID (Huang et al., 2009). They use pathway information from databases such as KEGG1, and WikiPathways2. The term “pathways” there usually refers to a variety of intracellular molecular mechanisms, not specifically to activity of signal transduction pathways (Subramanian et al., 2005; Huang et al., 2009). These tools are mostly used to discover which “pathways” differ between two groups of samples, by looking at the differentially expressed genes between the two groups, and identifying the “pathways” in which these differentially expressed genes are overrepresented. A drawback of such methods is that typically analysis starts unbiased, with thousands of “pathways” being evaluated for their difference between the two groups of samples. On the one hand, such a discovery setup may be limited by testing corrections, while many findings may emerge that are not reflections of the tumor driving pathway. For instance, when comparing normal tissue to cancer tissue, “pathways” involved in cell cycling may appear, and can signify an effect rather than a driver. In addition, pathways known to drive certain tumors in some cases may not be identified or identified incorrectly. A GSEA experiment analyzing canonical pathways between 32 colon adenoma vs. 32 normal colon samples from GSE8671, shown in Table 1, failed to identify the Wnt pathway as being upregulated in colon adenomas, while it is known to be the first activated pathway in practically all adenomas. The first occurrence of a Wnt pathway was on position 257 of the result list, with a corrected p-value of 0.91. Some Wnt pathways were reported to be up-regulated in the normal samples instead of the adenomas. A major cause of such findings is the inclusion of genes encoding for signaling proteins in “pathways,” which are only very loosely coupled to protein levels and activation.
TABLE 1.
Up in | Position | Name | nom.p | fdr.q | fwer.q |
A | |||||
Adenoma | 1 | PID_FOXM1_PATHWAY | 0.000 | 0.224 | 0.133 |
Adenoma | 2 | PID_AURORA_A_PATHWAY | 0.000 | 0.211 | 0.222 |
Adenoma | 3 | REACTOME_CHROMOSOME_MAINTENANCE | 0.000 | 0.193 | 0.262 |
Adenoma | 4 | KEGG_CELL_CYCLE | 0.002 | 0.151 | 0.271 |
Adenoma | 5 | REACTOME_G2_M_CHECKPOINTS | 0.002 | 0.141 | 0.303 |
Adenoma | 6 | REACTOME_CELLULAR_RESPONSE_TO_HEAT_STRESS | 0.002 | 0.121 | 0.306 |
Adenoma | 7 | REACTOME_REGULATION_OF_TP53_ACTIVITY_THROUGH_PHOSPHORYLATION | 0.000 | 0.105 | 0.312 |
Adenoma | 8 | PID_MYC_ACTIV_PATHWAY | 0.000 | 0.093 | 0.314 |
Adenoma | 9 | REACTOME_CELL_CYCLE_CHECKPOINTS | 0.002 | 0.083 | 0.314 |
Adenoma | 10 | REACTOME_REGULATION_OF_HSF1_MEDIATED_HEAT_SHOCK_RESPONSE | 0.002 | 0.088 | 0.352 |
Adenoma | 11 | REACTOME_BASE_EXCISION_REPAIR | 0.000 | 0.085 | 0.364 |
Adenoma | 12 | BIOCARTA_G2_PATHWAY | 0.000 | 0.081 | 0.374 |
Adenoma | 13 | REACTOME_DNA_REPAIR | 0.000 | 0.079 | 0.384 |
Adenoma | 14 | REACTOME_RHO_GTPASES_ACTIVATE_FORMINS | 0.014 | 0.077 | 0.397 |
Adenoma | 15 | REACTOME_METABOLISM_OF_NUCLEOTIDES | 0.000 | 0.072 | 0.397 |
Adenoma | 16 | REACTOME_REGULATION_OF_RAS_BY_GAPS | 0.002 | 0.068 | 0.403 |
Adenoma | 17 | REACTOME_PROTEIN_FOLDING | 0.002 | 0.065 | 0.409 |
Adenoma | 18 | SA_G1_AND_S_PHASES | 0.002 | 0.063 | 0.412 |
Adenoma | 19 | REACTOME_TELOMERE_MAINTENANCE | 0.000 | 0.061 | 0.419 |
Adenoma | 20 | REACTOME_TP53_REGULATES_TRANSCRIPTION_OF_GENES_INVOLVED_IN_G2_CELL_CYCLE_ARREST | 0.000 | 0.059 | 0.421 |
B | |||||
Adenoma | 125 | REACTOME_DEGRADATION_OF_BETA_CATENIN_BY_THE_DESTRUCTION_COMPLEX | 0.018 | 0.036 | 0.724 |
Adenoma | 257 | REACTOME_TCF_DEPENDENT_SIGNALING_IN_RESPONSE_TO_WNT | 0.015 | 0.046 | 0.914 |
Adenoma | 387 | REACTOME_SIGNALING_BY_WNT | 0.055 | 0.179 | 1.000 |
Adenoma | 482 | PID_BETA_CATENIN_DEG_PATHWAY | 0.227 | 0.363 | 1.000 |
Adenoma | 496 | PID_BETA_CATENIN_NUC_PATHWAY | 0.244 | 0.393 | 1.000 |
Adenoma | 507 | REACTOME_FORMATION_OF_THE_BETA_CATENIN_TCF_TRANSACTIVATING_COMPLEX | 0.324 | 0.420 | 1.000 |
Adenoma | 540 | WNT_SIGNALING | 0.330 | 0.463 | 1.000 |
Adenoma | 546 | KEGG_WNT_SIGNALING_PATHWAY | 0.334 | 0.475 | 1.000 |
Adenoma | 561 | REACTOME_DEACTIVATION_OF_THE_BETA_CATENIN_TRANSACTIVATING_COMPLEX | 0.405 | 0.483 | 1.000 |
Adenoma | 568 | BIOCARTA_WNT_PATHWAY | 0.425 | 0.487 | 1.000 |
Adenoma | 652 | REACTOME_SIGNALING_BY_WNT_IN_CANCER | 0.792 | 0.764 | 1.000 |
C | |||||
Normal | 1 | KEGG_NITROGEN_METABOLISM | 0.000 | 0.178 | 0.095 |
Normal | 2 | KEGG_ALDOSTERONE_REGULATED_SODIUM_REABSORPTION | 0.000 | 0.242 | 0.209 |
Normal | 3 | KEGG_PROXIMAL_TUBULE_BICARBONATE_RECLAMATION | 0.006 | 0.216 | 0.263 |
Normal | 4 | KEGG_LEUKOCYTE_TRANSENDOTHELIAL_MIGRATION | 0.002 | 0.260 | 0.351 |
Normal | 5 | REACTOME_NITRIC_OXIDE_STIMULATES_GUANYLATE_CYCLASE | 0.000 | 0.241 | 0.380 |
Normal | 6 | REACTOME_PLATELET_HOMEOSTASIS | 0.000 | 0.206 | 0.383 |
Normal | 7 | KEGG_VASCULAR_SMOOTH_MUSCLE_CONTRACTION | 0.000 | 0.183 | 0.391 |
Normal | 8 | REACTOME_DIGESTION | 0.000 | 0.181 | 0.412 |
Normal | 9 | REACTOME_GLUCAGON_LIKE_PEPTIDE_1_GLP1_REGULATES_INSULIN_SECRETION | 0.000 | 0.163 | 0.415 |
Normal | 10 | REACTOME_DIGESTION_AND_ABSORPTION | 0.000 | 0.148 | 0.418 |
Normal | 11 | REACTOME_GLUCAGON_SIGNALING_IN_METABOLIC_REGULATION | 0.000 | 0.147 | 0.433 |
Normal | 12 | REACTOME_SUMOYLATION_OF_INTRACELLULAR_RECEPTORS | 0.000 | 0.144 | 0.444 |
Normal | 13 | REACTOME_FCGR3A_MEDIATED_IL10_SYNTHESIS | 0.004 | 0.137 | 0.451 |
Normal | 14 | REACTOME_AQUAPORIN_MEDIATED_TRANSPORT | 0.000 | 0.131 | 0.455 |
Normal | 15 | REACTOME_STIMULI_SENSING_CHANNELS | 0.000 | 0.131 | 0.470 |
Normal | 16 | REACTOME_FOXO_MEDIATED_TRANSCRIPTION | 0.004 | 0.140 | 0.495 |
Normal | 17 | REACTOME_RHO_GTPASES_ACTIVATE_PAKS | 0.002 | 0.151 | 0.533 |
Normal | 18 | NABA_ECM_GLYCOPROTEINS | 0.006 | 0.154 | 0.547 |
Normal | 19 | REACTOME_BINDING_AND_UPTAKE_OF_LIGANDS_BY_SCAVENGER_RECEPTORS | 0.002 | 0.152 | 0.558 |
Normal | 20 | REACTOME_CREATION_OF_C4_AND_C2_ACTIVATORS | 0.006 | 0.151 | 0.573 |
D | |||||
Normal | 406 | PID_WNT_CANONICAL_PATHWAY | 0.200 | 0.401 | 1.000 |
Normal | 672 | PID_WNT_SIGNALING_PATHWAY | 0.534 | 0.619 | 1.000 |
Normal | 783 | REACTOME_BETA_CATENIN_PHOSPHORYLATION_CASCADE | 0.777 | 0.804 | 1.000 |
Normal | 791 | REACTOME_WNT_LIGAND_BIOGENESIS_AND_TRAFFICKING | 0.852 | 0.837 | 1.000 |
Normal | 792 | REACTOME_WNT5A_DEPENDENT_INTERNALIZATION_OF_FZD4 | 0.829 | 0.836 | 1.000 |
(A) 20 most upregulated pathways in colonadenomas. (B) Canonical Wnt-related pathways upregulated in colon adenomas. (C) 20 most upregulated pathways in normal colon samples. (D) Canonical Wnt-related pathways upregulated in normal colon samples. Per pathway the rank is given in the list of upregulated pathways (position), the nominal p-value (nom.p), false-discovery-rate corrected p-value (fdr.q), and the family-wise error corrected p-value (fwer.q).
Even if above pathway analysis approaches yield relevant “pathways” that are differentially expressed, then a step is to be made to translate them into a gene expression profile or a classifier that can be applied on an individual test sample. This requires a training step on samples with known ground truth pathway status. Since many of these “pathway” gene sets have been derived in a data-driven manner, one should be cautious when applying them on test samples of a different nature than the original discovery set. Data-driven discovery approaches are difficult to properly assess functional activity of tumor-driving pathways. Here we will present a novel approach that focuses on specific pathway activations that are distinct from traditional gene enrichment set analysis.
Methods: Design of a New Highly Sensitive Assay Platform to Quantitatively Measure Activity of Signal Transduction Pathways Across Cell and Tissue Types and Validation
Starting from the opportunities provided by the transcriptome, we have developed an assay (OncoSignal) to quantitatively measure activity of signal transduction pathways across cell and tissue types. At the core of the approach is a mathematical Bayesian model which quantitatively infers activity of signal transduction pathways from mRNA measurements of a small number of selected direct target genes of the respective signaling pathway-associated transcription factor (Verhaegh and van de Stolpe, 2014; Verhaegh et al., 2014; van Ooijen et al., 2018; van de Stolpe, 2019; van de Stolpe et al., 2019a). By selecting for high evidence direct target genes of the transcription factor, this approach builds on knowledge obtained on mechanisms of signal transduction and gene transcription regulation (van Hartskamp et al., 2019).
A Bayesian Model of Target Gene Activation
We have employed a Bayesian network model that describes the causal relation between transcription factor activation of a certain pathway and the mRNA expression levels of the corresponding direct target genes (Verhaegh et al., 2014), as shown in Figure 1A. The model contains three types of nodes: (1) a transcription factor complex (TF), (2) high evidence direct target genes (TG), and (3) measurement nodes representing the corresponding probes or probe sets (PS) of each of the target genes. Based on an elaborate literature study, we selected genes as direct target genes if they were supported by multiple types of evidence, such as motif analysis on the transcription factor, its actual binding to promotor regions (e.g., ChIP-seq experiments), and differential expression experiments, and supported by ongoing clinical trials. By choosing direct target genes, we ensure maximum specificity of the models. Furthermore, this reduces dependency on specific tissue-dependent contexts, making that the models can be used across different tissue types.
Given the network structure, we subsequently define parameters describing (a) the relation between the transcription factor complex and the direct target genes, and (b) the relation between each target gene and its corresponding measurements. The parameters of the first layer (a) are based on literature insights, whereas those of the second layer (b) are calibrated based on measurements on samples with a known ground truth status for activity of the respective signal transduction pathway, from which typical measurement levels are deduced in an inactive or an active state. These ground truth samples may come from patient studies, such as for the Wnt pathway, which is known to be activated in colon adenomas and inactive in normal colon samples, or from controlled cell line experiments in which a default inactive pathway is activated by adding ligands, or a constitutively activated pathway is blocked by means of blocking compounds.
Biological Validation
After building and calibrating Bayesian pathway models as described above, the models can be applied on subsequent individual test samples by taking such a sample’s measurements and feeding them into the model after which Bayesian inference is used to re-engineer the odds that the transcription factor must have been activated compared to those that are not activated. These odds are represented on a log2 scale, with a positive value indicating that there is more evidence for an active pathway, and a negative value indicating more evidence of an inactive pathway. For ease of comparison, these log2 values are further normalized to a 0–100 scale.
We have developed Bayesian network models to assess the phenotypic activity of the PI3K, MAPK-AP1, JAK-STAT1/2 and JAK-STAT3, NFκB, ER, AR, Notch, TGFβ, Wnt and HH signaling pathways using Affymetrix expression microarray data (HG-U133Plus2.0 arrays), and we tested each of them extensively on data sets from publicly available sources such as the Gene Expression Omnibus to show that they give a correct read-out of activity in samples with known ground truth pathway status (Verhaegh et al., 2014; Creemers et al., 2018; van de Stolpe et al., 2018; van Ooijen et al., 2018; Bouwman et al., 2020; Canté-Barrett et al., 2020; Inda et al., 2020). Some validation data for Wnt, ER, FOXO, and TGFβ is shown in Figures 1B–G, illustrating that the tests accurately indicate pathway activity known from disease etiology (1B) or mutation information (1C), and represent changes in activity due to treatment (1D and 1E). Pathway activity is assessed not only in a qualitative manner, but differences in effect from various treatment compounds or time series can even be observed quantitatively (1F and 1G).
The signal transduction pathway (STP) assays have been biologically validated on a variety of cell types and are in principle applicable to all healthy and diseased cell and tissue types. The major reason for this broad applicability is the focus on transcription factor target genes. This maximally eliminates influences of cell type-specific proteins on the target gene levels. Another feature of the Bayesian computational network model is that it can deal well with variability in input data, including conflicting data such as target genes that are not expressed in a specific sample despite the transcription factor being active, or target genes that are expressed despite an inactive transcription factor. Third, target genes were not selected based on relevance for a specific disease or tissue type, but solely as reliable readout for transcription factor activity. When expression levels of individual pathway target genes vary between samples and between different cell types, the Bayesian reasoning principle allows robust interpretation of these mRNA levels. This explains why the STP assays can deliver reliable pathway activity measurements across patient samples in spite of the variation that is inherent to such samples. The same signal transduction pathways that play a role in cancer, also determine activity or immunosuppression of the many cell types that together generate the innate and adaptive immune response, and as a consequence STP tests are being studied to measure activity of the immune system (van de Stolpe et al., 2019b).
Pathway Assays for Routine Clinical Samples
Our STP assays were first built and tested on Affymetrix expression microarray data, having the advantage of access to publicly available datasets from the GEO database, enabling model validation on multiple independent preclinical and clinical datasets (GEO database, 2021). To facilitate clinical use and enable assay performance on FFPE tissue samples, assays for MAPK-AP1, PI3K, ER, AR, Notch, TGFβ, and HH pathways have recently been adapted to RT-qPCR measurements of mRNA. Additional advantages of qPCR-based tests are “in house” use on regular PCR equipment for a short time-to-result (typically within 3 h) and use on small or low quality FFPE samples.
To build these RT-qPCR pathway assays, we first reduced the number of target genes used per pathway to around 12. This still enables robust behavior of the assays, while maintaining specificity, and all validation results were confirmed with these reduced gene lists. Next, we used the very same calibration samples to determine the model parameters with the only difference that we measured them again with RT-qPCR. In this way, we ensure compatibility between the microarray-based and RT-qPCR based STP assays.
Comparing Pathway Scores to Reference Distributions
When performing an STP analysis on an individual patient sample to help guide the decision on targeted therapy, it will be necessary to know whether and to which extent a specific signaling pathway activity is considered abnormal, and if increased, whether it is likely to be tumor driving and targetable. This requires the definition of a normal pathway activity range including a pathway activity threshold. To obtain this, STP activity analysis was performed on healthy tissue samples, and the 95th percentile of normal was defined as threshold above which the signaling pathway activity in tumor tissue is considered to be abnormal (Martin et al., 2020). When the pathway activity score on an individual sample is defined as increased, it can be considered as a potential tumor driving signaling pathway. To increase the likelihood that the identified pathway is indeed tumor driving, it is of value to know whether this pathway is more often activated in the analyzed cancer type. For this purpose, sets of cancer tissue samples have been compared with the reference pathway activity range for different cancer types, and frequently activated signaling pathways were defined as likely tumor driving pathways for the respective cancer types. To illustrate this, for the ER and AR pathways, the average pathway activity score was observed abnormally high in luminal breast cancer and primary prostate cancer, respectively, indicating a role as tumor driving pathway in these cancer types (Verhaegh et al., 2014; van de Stolpe et al., 2019a; Inda et al., 2020). If an abnormal ER pathway activity is measured in an ER positive breast cancer sample, this can be considered as a tumor driving pathway and can be designated as a therapy target, and it may be inferred that a patient can be a good candidate for hormonal therapy (see Figure 2B, left). If despite an ER positive IHC result, the ER pathway appears to be not abnormally active, the patient may have another tumor driving pathway active, for example the PI3K pathway (Figure 2B, right) which may be of importance for therapy choice. Once the normal reference values are known for a specific tissue type, for each patient sample a patient report can be produced containing information for all analyzed signaling pathways (Figure 2A) and evaluated as potential targets.
Results: Application of Findings
The Advantage of Adding RNA-Based Information on Signaling Pathway Activity to DNA-Based Genomic Mutation Analysis
Our findings have shown that STP analysis of a cancer tissue sample may assist in functionally characterizing a gene mutation; for example, an unknown mutation in a gene encoding a signaling protein is more likely to be a functional mutation if the corresponding pathway was found active (Figure 3). We show that Wnt pathway activity scores were measured in tissue samples from human ovarian and breast cancer PDX (xenograft) mice. Loss of APC and gain of β-catenin (CTNNB1 gene) protein function are known to result in increased Wnt pathway activity. Wnt pathway activity scores were normal in the reference (WT), increased in loss-of-function APC-mutated ovary cancer and in gain-of-function CTNNB1 Asp32Tyr mutated breast cancer, and normal in non-functionally mutated CTNNB1 Asp665Glu breast cancer (Figure 3).
STP activity analysis is also expected to facilitate the search for tumor driving mutations in a tumor, which can be focused on genes known to be related to the activated signaling pathway. Performing DNA and RNA sequencing simultaneously on the same sample is expected to provide highly complementary information. RNA sequencing data provide information on mutated genes that are actually expressed and likely to be functionally relevant and can be used to better link genomic mutations to abnormal STP activity. To apply this in the PACMAN study (PACMAN, 2021), STP activity analysis is performed retrospectively on samples across histologies of cancer which had been treated with targeted drugs guided by mutation analysis, resulting in targeted drug treatment for 19% of patients and a 7% increase in treatment response (Massard et al., 2017). Interim study results showed that addition of information on signaling pathway activity increased the percentage of breast and prostate cancers for which a targeted drug could be identified to nearly all cases (Martin et al., 2020).
The Advantage of Assaying Low Input Analytes, Including Circulating Tumor Cells
Some clinical sample types are unavoidably associated with a minimal cancer cell content or low quality. Performing STP analysis on such samples in a standard manner tends to be associated with high technical noise (Inda et al., 2020). Obtaining tumor biopsies from difficult to access cancer types, such as lung cancer, or measuring pathway activity in circulating tumor cells (CTCs) may be clinically very relevant to obtain information on signaling pathway activity in the sample to decide on a targeted therapy choice. Furthermore, the pathways involved in epithelial to mesenchymal transition important for cell and CTC migration are reflected in our assay. Measuring targets in CTCs has high potential as a liquid biopsy of otherwise unattainable metastatic tumors and analyzed as single cells (van de Stolpe et al., 2011; van de Stolpe and den Toonder, 2014; Massagué and Obenauf, 2016).
STP analysis of very small samples may be possible using either RNA sequencing or qPCR to measure the required mRNA levels. RNA sequencing on single cells has recently developed into a feasible technology (Hedlund and Deng, 2018; Hwang et al., 2018; Chen et al., 2019). Using the STP analysis technology, measurement of activity of the Wnt pathway on a single (circulating tumor) cell using RNA sequencing data has already been reported, underscoring the highly sensitive nature of the pathway analysis approach (van Strijp et al., 2017). Initial results using the qPCR-based STP analysis similarly indicated the feasibility of measuring pathway activity on only a few cells, using an adaptation of the protocol to include a pre-amplification method (Figure 4). Incorporating the RNA pre-amplification step is expected to enable performance of multiple STP analyses on a single CTC.
Application of the mRNA-Based Assay Platform to Measure Activity of Signaling Pathways
Initial results have been published on a number of different cancer types using the above described assay platform, in which the potential of STP analysis was explored to provide insight in cancer pathophysiology and to predict prognosis and response to therapy (Verhaegh et al., 2014; van Boxtel et al., 2019; Inda et al., 2020; Sieuwerts et al., 2020; van Weelden et al., 2020). A few key results are summarized below, centered around the role of the different signaling pathways in the various cancer types.
The estrogen receptor (ER) pathway is a tumor driving signaling pathway in breast cancer, and can also be active in ovarian and endometrium cancer although its role in those malignancies is less clear. Adjuvant tamoxifen treatment of ER positive breast cancer patients was associated with significantly lower recurrence rate in patients with an ER pathway active primary tumor, compared to patients with an ER-inactive tumor (Verhaegh et al., 2014). Pathway analysis in three independent clinical studies (performed using both Affymetrix microarray- and qPCR-based pathway analysis) showed that in primary ER positive breast cancer patients, the ER pathway activity score predicted response to neoadjuvant treatment with an aromatase inhibitor (Inda et al., 2020). In ER positive breast cancer patients who developed metastatic disease and were subsequently treated with first line tamoxifen, an active ER pathway was associated with a better prognosis (Sieuwerts et al., 2020). In both ovarian cancer and endometrial cancer, loss of ER pathway activity was associated with higher grade cancer type and worse prognosis (van Lieshout et al., 2020; van Weelden et al., 2020). Results suggest that for all three cancer types, ER pathway activity reflects a more differentiated cancer type associated with a better prognosis, and measuring ER pathway activity may predict response to hormonal therapy in ER positive breast cancer.
The AR pathway is another important hormonal pathway and positive IHC staining has been described for different cancer types (Munoz et al., 2015). While, as expected, the AR pathway was universally measured as active in primary prostate cancer, AR pathway activity remained high in some castrate-resistant metastatic prostate cancers, possibly reflecting emergence of AR activating mutations (van de Stolpe et al., 2019a). In breast cancer patients, the highest average AR pathway activity score was found in the HER2 subtype (van de Stolpe et al., 2020). The ratio between AR and ER IHC staining has been suggested to be informative as to the functional role of the AR pathway in breast cancer (Rangel et al., 2018, 2020). STP analysis enabled calculation of an AR over ER pathway activity ratio instead of the AR over ER protein expression ratio, revealing a relatively low ratio in luminal A/B and a high ratio in higher grade HER2 and basal breast cancer subtypes. This is in line with reported AR/ER expression ratios per subtype, and suggestive of a potential benefit of anti-androgen therapy for breast cancer with a high AR/ER pathway activity ratio (van de Stolpe et al., 2020). In luminal breast cancer patients who had all developed metastatic disease and therefore constituted a bad prognosis patient subset, high AR pathway activity was associated with worse outcome (Sieuwerts et al., 2020). In advanced salivary duct cancer with positive AR IHC staining, the AR pathway activity score predicted response to androgen deprivation therapy (van Boxtel et al., 2019). Currently, a second independent clinical study is in progress aiming at confirmation of the predictive value of AR pathway activity for response to anti-androgen therapy.
The PI3K pathway is a major growth factor pathway, sometimes called a “survival” pathway, and the frequent pathway activity can be caused by for example mutations in the PIK3CA gene or amplification of the HER2 gene (van de Stolpe, 2019). In line with this, PI3K pathway activity was found to be associated with higher grade and worse prognosis in breast cancer, high grade serous ovarian cancer, prostate cancer, and esophageal cancer (Verhaegh et al., 2014; Creemers et al., 2018; van de Stolpe et al., 2019a; Sieuwerts et al., 2020; van Lieshout et al., 2020). Novel PI3K inhibitors including B591 and IBL-302 are in various stages of development.
Activity of developmental signaling pathways, such as the TGFβ, Hedgehog, Notch and Wnt pathways, is a typical characteristic of stem cells and was found in a variety of tumors including medulloblastomas and gliomas (Verhaegh et al., 2014; Holtzer et al., 2017; van de Stolpe et al., 2019a). Some of these pathways, such as the TGFβ pathway, may play either a tumor suppressive or tumor promoting role in cancer, depending on cellular context (Alinger et al., 2009; Katoh and Katoh, 2009; Massagué, 2012; Sundqvist et al., 2013; Liu et al., 2015; Aster et al., 2017). In breast cancer and colon cancer, high TGFβ pathway activity was associated with worse prognosis (Wesseling-Rozendaal et al., 2019a). In contrast, activity of the TGFβ pathway was frequently lost in advanced prostate cancer and in esophageal cancer, suggestive of a tumor suppressive role in the corresponding healthy tissue (Creemers et al., 2018; van de Stolpe et al., 2019a). Various anti-TGFβ small molecule inhibitors or antibodies are in various stages of development and include the compounds SAR439459 and galunisertib.
The Wnt pathway is well known for its tumor initiating role in colon adenoma and cancer, and Wnt pathway activity was confirmed in these tumors (Bienz and Clevers, 2000; Verhaegh et al., 2014). The role of Wnt pathway activity in some other cancers may be more complex (Kypta and Waxman, 2012; Schneider and Logan, 2018). In primary lower grade prostate cancer, Wnt pathway activity was associated with the TMPRSS2:ERG fusion protein, known to be able to activate the Wnt pathway, but in advanced disease Wnt pathway activity was frequently lost, suggesting a tumor-suppressive rather than tumor-promoting role under this condition (Wu et al., 2013). In primary breast cancer and in ovarian cancer, Wnt pathway activity seemed to be associated with less aggressive tumors (Sieuwerts et al., 2020; van Lieshout et al., 2020).
Notch pathway activity was associated with improved prognosis in T cell-acute lymphoblastic lymphoma (Canté-Barrett et al., 2020). Activity of the Hedgehog pathway was found in primary metastasized breast cancer and was associated with worse prognosis in luminal breast cancer patients who developed metastatic disease, and pathway activity was increased in higher compared to lower grade ovarian cancer (Beachy et al., 2018; Sieuwerts et al., 2020; van Lieshout et al., 2020). Signaling pathways frequently crosstalk to orchestrate specific cellular functions (Cantley et al., 2014). Simultaneous measurement of multiple signaling pathway activities on the same sample enabled exploration of cooperation between signaling pathways (Sieuwerts et al., 2020). Interaction between the SMAD2/3 transcription factor of the TGFβ pathway and the FOXO transcription factor (inversely related to PI3K pathway activity) has been described in detail, and can serve a tumor suppressive role (Massagué, 2012; Sundqvist et al., 2013). Activation of the PI3K pathway, reflected by loss of FOXO activity, is frequently associated with loss of TGFβ pathway activity (van Ooijen et al., 2018). In esophageal cancer treated with neoadjuvant chemoradiation, combined FOXO plus TGFβ pathway activity was associated with favorable outcome, while loss of FOXO and TGFβ pathway activity was associated with increased recurrence rate (Creemers et al., 2018). Cooperative activity of tumor driving signaling pathways may also be associated with resistance to a drug that targets a single pathway. This is explored in the PACMAN study, in which pathway analysis is performed on a variety of cancer types that were treated with targeted drugs (Martin et al., 2020). Multiple clinical studies are in progress to further explore the relation between single or combined signaling pathway activity and cancer progression, and to investigate clinical value of measuring signaling pathway activity to predict response and resistance to targeted treatment.
Discussion: Future Applications With Therapy Selection
Characterization of the Immune Microenvironment and Blood Samples
For many diseases, including cancer, the immune response is a major determinant of progression, response to therapy, and clinical outcome. Immunotherapy has emerged as a high potential curative treatment for many cancer types, and checkpoint inhibitor therapy is becoming standard of care for cancer types for a variety of tumors including melanoma, lung cancer, head and neck cancers (Havel et al., 2019). Various types of immunotherapy are available and being developed, mainly directed at breaking the immunotolerance against cancer or at inducing novel anti-cancer immunity by various vaccination approaches, and either as a monotherapy or in combination with radiotherapy, chemotherapy or targeted therapy (Emens and Middleton, 2015; Romero et al., 2016; Van Limbergen et al., 2017). While initially late-stage cancer has been the focus of immunotherapy, adjuvant use in an earlier clinical phase, and even in a neoadjuvant setting to exploit the tumor as a source of neo-antigen, is being explored (Moujaess et al., 2019). Aside from sporadic successes, such as microsatellite instability or mismatch repair-deficiency biomarkers to reliable predict checkpoint inhibitor response, challenges in predicting response to immunotherapy remain and currently used parameters such as tumor type, its neoantigen profile, histopathology of the tumor infiltrate (TIL) (e.g., inflammatory or immune excluded), and CD3+/CD8+ and PD1 and PD-L1 IHC do not perform sufficiently well (Chang et al., 2018; Hegde and Chen, 2020; Kennedy and Salama, 2020). As a consequence there is a high need for tests to improve response prediction and assessment, and also to predict who is at high risk for immune-mediated severe side effects (Duffy and Crown, 2019). Failure to successfully select responder patients for immunotherapy may ultimately endanger further clinical implementation of this high potential therapy.
The immune response is determined by coordinated activity of many immune cell types belonging to the innate and adaptive immune system. The functional state of immune cells is determined by coordinated activity of the same signal transduction pathways that have been described above as potential tumor driving signaling pathways (Newton and Dixit, 2012; Cantrell, 2015). Immune cells communicate through a variety of free (e.g., cytokines) or membrane-bound molecules that bind to specific cellular receptors to activate the signaling pathways that determine their function in mounting an immune response, such as T cell clonal expansion, cytotoxic functions and antigen presentation (Platanias, 2005; Li et al., 2007; Goodman et al., 2011; Lee et al., 2011; Han et al., 2012; Oh and Ghosh, 2013). Combined JAK-STAT1/2 and JAK-STAT3 pathway analysis in blood samples of patients with a variety of viral infections was shown to quantitatively measure the cellular immune response to viruses (Bouwman et al., 2020). With respect to cancer, measurement of STP activity in a tumor infiltrate (TIL), or possibly in blood samples, may be similarly informative on the immune-active versus immune-tolerant state of the immune response. Initial results suggest that in primary breast cancer the adaptive T cell response has already been switched off, while in vitro study results suggest that this may be mediated by soluble factors from cancer tissue (e.g., TGFβ) that reduce effector immune pathway activity (PI3K, JAK-STAT, NFκB pathways) and increase activity of the immune suppressive TGFβ pathway (Gu-Trantien et al., 2013; van de Stolpe et al., 2019b). Investigation of the value of STP analysis to predict response to checkpoint inhibitor immunotherapy is underway. New technologies are becoming available to separately analyze different cell types in cancer tissue, including immune cell subsets in the TIL (e.g., multiplex IHC, laser microdissection of selected regions for STP analysis). This may facilitate STP activity profiling in specific immune cell types in the TIL to investigate the relation with immunotherapy response (Gu-Trantien et al., 2018; Garaud et al., 2019; Solinas et al., 2019).
Choosing a Targeted Drug for an Individual Patient Based on Identification of a Targetable Signal Transduction Pathway
Choosing a targeted drug with the highest chance at clinical response requires characterization and consideration of a number of important factors. Since targeted drugs are specifically directed toward a component of a signaling pathway, a functionally active signaling pathway can be a prerequisite for response (Verhaegh et al., 2014; van Boxtel et al., 2019; Wesseling-Rozendaal et al., 2019b; Inda et al., 2020). In the presence of a pathway activating mutation in the gene for a signaling protein, the drug needs to target downstream of the activated protein in the signaling pathway to be effective. This is illustrated in Figure 5 in which anti-EGFR inhibitors (cetuximab, gefitinib, and afatinib) had been used to treat breast cancer cells containing mutations in genes coding for proteins that play a direct or indirect role (through crosstalk between pathways) in the PI3K pathway. All TKIs inhibited PI3K pathway activity in wild type cells and cells with overexpressed Epidermal Growth Factor Receptor (EGFR). Inhibition was maximal with the dual EGFR/HER2 inhibitor afatinib. Of the two EGFR TKI inhibitors, gefitinib was most effective, possibly because it targets EGFR intracellularly (Bardelli and Jänne, 2012). Only minor inhibitory effects were observed in HRAS- and PIK3CA-mutant cells because these mutations are located downstream of the TKI drug targets and therefore confer resistance.
A third factor to take into account in deciding on a targeted drug treatment is whether more than one tumor driving signaling pathway is active, potentially conferring drug resistance. This was a frequently encountered issue in the analyzed cancer types to date (Martin et al., 2020). Activity of the PI3K growth factor pathway in ER positive breast cancer was associated with primary resistance to endocrine therapy (Ciruelos Gil, 2014). Targeting of both pathways simultaneously may be tested to overcome resistance and improve clinical response. Inhibition of one signaling pathway may lead to activation of a resistance-conferring pathway. An in vitro example for the latter was identified in fulvestrant resistant breast cancer cell lines that unexpectedly had gained MAPK pathway activity in addition to loss of ER pathway activity (Wesseling-Rozendaal et al., 2019b).
Dealing With Intra-Tumor Heterogeneity
Similar to heterogeneity with respect to mutations within a tumor, functional pathway activity levels may vary within a tumor. The amount of variation to expect probably depends on cancer type as well as the signaling pathway. In a clinical study on intra-tumor heterogeneity in breast cancer, ER pathway activity was the least variable and PI3K pathway activity the most variable within a tumor (van de Stolpe et al., 2018). Results of this study suggested that measuring pathway activity at two locations in a single primary breast cancer biopsy generally provided sufficient information on overall intra-tumor heterogeneity (van de Stolpe et al., 2018). Upon further confirmation, a repeat STP analysis on multiple parts of a biopsy may further underpin the choice for a targeted therapy. STP analysis is expected to also provide a novel tool, complementary to genome sequencing and methylation analysis, to investigate mechanisms of tumor evolution (Sottoriva et al., 2015; Sun et al., 2018; Roerink et al., 2018).
Conclusion
Using the described STP analysis tests, activity of twelve relevant signaling pathways (PI3K, MAPK, JAK-STAT1/2, JAK-STAT3, NFκB, ER, AR, PR, Notch, TGFβ, Wnt and HH) can be measured simultaneously and quantitatively on individual patient cancer tissue samples from different cancer types. As illustrated above, this pathway analysis approach reveals commonalities with respect to pathway activities across different cancer types, potentially enabling an alternative cancer classification system based on signaling pathway activity profiles, complementary to the conventional classification based on the organ location. Developing a molecular fingerprint of tumors with respect to signaling pathway activities is expected to provide new insights into the pathophysiology of the many cancer types, including discovery of novel mechanisms for tumorigenesis and metastasis. STP analysis may also contribute to identification of novel drug targets and development of therapies that are more generalizable across cancer types including rare cancers.
Clinical diagnostic applications of STP analysis for prediction of prognosis and response to therapy, including identification of resistance pathways, are currently being further developed in clinical studies. Prospective clinical validation studies in various cancer types and basket studies are being initiated with clinical partners, predominantly making use of RT-qPCR-based STP analysis on FFPE tissue samples with considerations toward low quantity specimens including circulating tumor cells.
In the future, an important focus will lie on measuring the host immune response to cancer, both in blood as well as in cancer tissue samples. Taken together, measurement of STP activity in cancer, complementary to DNA mutation analysis, is expected to enable development of novel therapies, improve prediction of therapy response and resistance, and improve clinical outcome for a variety of tumor types and treatments, including targeted drugs and immunotherapy.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors upon request, without undue reservation.
Ethics Statement
As far as data did not come from public data repositories, the studies involving human participants were reviewed and approved by local IRBs, and the patients/participants provided their written informed consent to participate.
Author Contributions
HH and AS: conception and design, writing, review and comments. J-YB, CM, PP, MP, HP, DDR, NS, SS, and KW-G: review and comments. WV: modeling, writing, review and comments. All authors contributed to the article and approved the submitted version.
Conflict of Interest
WV is an employee of Philips Research. J-YB, CM, PP, MP, HP, DDR, NS, SS, KW-G, and HH are on the advisory board of Philips MPDx.
Acknowledgments
We acknowledge Aditya Bardia (Massachusetts General Hospital, Harvard Medical School, Boston), Fabien Calvo (Institut Gustave Roussy, France), Henk Verheul (Radboud UMC, Nijmegen, Netherlands), Carla van Herpen (Radboud UMC, Nijmegen, Netherlands), and Cristina Saura (Vall d’Hebron University Hospital, Barcelona) for critically reading the manuscript and providing valuable comments. We also acknowledge Martijn Akse for creating the patient reports shown in Figure 2 and Wessel Beekmans and Dianne van Strijp for development of the pathway analysis on small samples.
Funding. The PACMAN study has received funding from EIT Health. EIT Health is supported by the European Institute of Innovation and Technology (EIT), a body of the European Union receiving support from the European Union’s Horizon 2020 Research and Innovation Program.
References
- Alinger B., Kiesslich T., Datz C., Aberger F., Strasser F., Berr F., et al. (2009). Hedgehog signaling is involved in differentiation of normal colonic tissue rather than in tumor proliferation. Virchows Arch. 454 369–379. 10.1007/s00428-009-0753-7 [DOI] [PubMed] [Google Scholar]
- André F., Ciruelos E., Rubovszky G., Campone M., Loibl S., Rugo H. S., et al. (2019). Alpelisib for PIK3CA-mutated, hormone receptor-positive advanced breast cancer. N. Engl. J. Med. 380 1929–1940. 10.1056/NEJMoa1813904 [DOI] [PubMed] [Google Scholar]
- Aster J. C., Pear W. S., Blacklow S. C. (2017). The varied roles of Notch in cancer. Annu. Rev. Pathol. 12 245–275. 10.1146/annurev-pathol-052016-100127 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bardelli A., Jänne P. A. (2012). The road to resistance: EGFR mutation and cetuximab. Nat. Med. 18 199–200. 10.1038/nm.2646 [DOI] [PubMed] [Google Scholar]
- Baudino T. A. (2015). Targeted cancer therapy: the next generation of cancer treatment. Curr. Drug Discov. Technol. 12 3–20. 10.2174/1570163812666150602144310 [DOI] [PubMed] [Google Scholar]
- Beachy P., Cai S., Ma Y., Hatakeyama J., Zhao C., Stoffels M., et al. (2018). Abstract P5-03-11: targeted disruption of transcriptional effector GLI2 attenuates breast tumor growth and metastasis. Cancer Res. 78 P5-03-11–P5-03-11. 10.1158/1538-7445.SABCS17-P5-03-11 [DOI] [Google Scholar]
- Bienz M., Clevers H. (2000). Linking colorectal cancer to Wnt signaling. Cell 103 311–320. 10.1016/S0092-8674(00)00122-7 [DOI] [PubMed] [Google Scholar]
- Bose R., Kavuri S. M., Searleman A. C., Shen W., Shen D., Koboldt D. C., et al. (2013). Activating HER2 mutations in HER2 gene amplification negative breast cancer. Cancer Discov. 3 224–237. 10.1158/2159-8290.CD-12-0349 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bouwman W., Verhaegh W., Holtzer L., van de Stolpe A. (2020). Measurement of cellular immune response to viral infection and vaccination. Front. Immunol. 19:575074. 10.3389/fimmu.2020.575074 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Browning D., Savery N., Kolb A., Busby S. (2009). Assays for transcription factor activity. Methods Mol. Biol. 543 369–387. 10.1007/978-1-60327-015-1_23 [DOI] [PubMed] [Google Scholar]
- Canté-Barrett K., Holtzer L., van Ooijen H., Hagelaar R., Cordo V., Verhaegh W., et al. (2020). A molecular test for quantifying functional Notch signaling pathway activity in human cancer. Cancers 12:3142 10.3390/cancers12113142 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cantley L. C., Hunter T., Sever R., Thorner J. W. (2014). Signal Transduction: Principles, Pathways, and Processes. Cold Spring Harbor, NY: Cold Spring Harbor Laboratory Press. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cantrell D. (2015). Signaling in lymphocyte activation. Cold Spring Harb. Perspect. Biol. 7:a018788. 10.1101/cshperspect.a018788 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chang L., Chang M., Chang H. M., Chang F. (2018). Microsatellite instability: a predictive biomarker for cancer Immunotherapy. Appl. Immunohistochem. Mol. Morphol. 26 e15–e21. [DOI] [PubMed] [Google Scholar]
- Chen G., Ning B., Shi T. (2019). Single-cell RNA-seq technologies and related computational data analysis. Front. Genet. 10:317. 10.3389/fgene.2019.00317 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ciruelos Gil E. M. (2014). Targeting the PI3K/AKT/mTOR pathway in estrogen receptor-positive breast cancer. Cancer Treat. Rev. 40 862–871. 10.1016/j.ctrv.2014.03.004 [DOI] [PubMed] [Google Scholar]
- Creemers A., Meijer S. L., Stoffels M., Hooijer G. K. J., Holtzer H., van Ooijen H., et al. (2018). 628P Signal transduction pathway activity during neoadjuvant treatment in esophageal adenocarcinomas. Ann. Oncol. 29(Suppl.8):viii211 10.1093/annonc/mdy282.012 [DOI] [Google Scholar]
- Duffy M. J., Crown J. (2019). Biomarkers for predicting response to immunotherapy with immune checkpoint inhibitors in cancer patients. Clin. Chem. 65 1228–1238. 10.1373/clinchem.2019.303644 [DOI] [PubMed] [Google Scholar]
- Dugger S. A., Platt A., Goldstein D. B. (2018). Drug development in the era of precision medicine. Nat. Rev. Drug Discov. 17 183–196. 10.1038/nrd.2017.226 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Emens L. A., Middleton G. (2015). The interplay of immunotherapy and chemotherapy: harnessing potential synergies. Cancer Immunol. Res. 3 436–443. 10.1158/2326-6066.CIR-15-0064 [DOI] [PMC free article] [PubMed] [Google Scholar]
- FDA (2020). List of Cleared or Approved Companion Diagnostic Devices (In Vitro and Imaging Tools). Available at: www.fda.gov/medical-devices/vitro-diagnostics/list-cleared-or-approved-companion-diagnostic-devices-vitro-and-imaging-tools (accessed January 4, 2021). [Google Scholar]
- Fertig E., Ozawa H., Thakar M., Howard J. D., Kagohara L. T., Krigsfeld G., et al. (2016). CoGAPS matrix factorization algorithm identifies transcriptional changes in AP-2alpha target genes in feedback from therapeutic inhibition of the EGFR network. Oncotarget 7 73845–73864. 10.18632/oncotarget.12075 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garaud S., Buisseret L., Solinas C., Gu-Trantien C., de Wind A., Van den Eynden G., et al. (2019). Tumor infiltrating B-cells signal functional humoral immune responses in breast cancer. JCI Insight 5:e129641. 10.1172/jci.insight.129641 [DOI] [PMC free article] [PubMed] [Google Scholar]
- GEO database (2021). Available online at: https://www.ncbi.nlm.nih.gov/geo (accessed January 4, 2021). [Google Scholar]
- Goodman W. A., Young A. B., McCormick T. S., Cooper K. D., Levine A. D. (2011). Stat3 phosphorylation mediates resistance of primary human T cells to regulatory T cell suppression. J. Immunol. 186 3336–3345. 10.4049/jimmunol.1001455 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gu-Trantien C., Garaud S., Migliori E., Solinas C., Lodewyckx J. N., Willard-Gallo K., et al. (2018). Quantifying tertiary lymphoid structure-associated genes in formalin-fixed paraffin-embedded breast cancer tissues. Methods Mol. Biol. 1845 139–157. 10.1007/978-1-4939-8709-2_9 [DOI] [PubMed] [Google Scholar]
- Gu-Trantien C., Loi S., Garaud S., Equeter C., Libin M., de Wind A., et al. (2013). CD4+ follicular helper T cell infiltration predicts breast cancer survival. J. Clin. Invest. 123 2873–2892. 10.1172/JCI67428 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Han J. M., Patterson S. J., Levings M. K. (2012). The role of the PI3K signaling pathway in CD4+ T cell differentiation and function. Front. Immunol. 3:245. 10.3389/fimmu.2012.00245 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hanahan D., Weinberg R. A. (2011). Hallmarks of cancer: the next generation. Cell 144 646–674. 10.1016/j.cell.2011.02.013 [DOI] [PubMed] [Google Scholar]
- Havel J. J., Chowell D., Chan T. A. (2019). The evolving landscape of biomarkers for checkpoint inhibitor immunotherapy. Nat. Rev. Cancer 19 133–150. 10.1038/s41568-019-0116-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hedlund E., Deng Q. (2018). Single-cell RNA sequencing: technical advancements and biological applications. Mol. Aspects Med. 59 36–46. 10.1016/j.mam.2017.07.003 [DOI] [PubMed] [Google Scholar]
- Hegde P. S., Chen D. S. (2020). Top 10 challenges in cancer immunotherapy. Immunity 52 17–35. 10.1016/j.immuni.2019.12.011 [DOI] [PubMed] [Google Scholar]
- Hemert F., van Veen C. D., Konings S., van der Ven J., van de Stolpe A. (2020). A novel dual antibody staining assay to measure estrogen receptor transcriptional activity. bioRxiv [Preprint]. 10.1101/2020.04.14.021782 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Holtzer L., Verhaegh W., de Stolpe A. V. (2017). Abstract 705: elucidating pediatric brain tumor pathophysiology by assessing signal transduction pathway activation. Cancer Res. 77 705–705. 10.1158/1538-7445.AM2017-705 [DOI] [Google Scholar]
- Huang D. W., Sherman B. T., Lempicki R. A. (2009). Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat. Protoc. 4 44–57. 10.1038/nprot.2008.211 [DOI] [PubMed] [Google Scholar]
- Hwang B., Lee J. H., Bang D. (2018). Single-cell RNA sequencing technologies and bioinformatics pipelines. Exp. Mol. Med. 50:96. 10.1038/s12276-018-0071-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Inda M. A., Blok E., Kuppen P. J. K., Charehbili A., den Biezen E., van Brussel A., et al. (2020). Estrogen Receptor pathway activity score to predict clinical response or resistance to neo-adjuvant endocrine therapy in primary breast cancer. Mol. Cancer Ther. 19 680–689. 10.1158/1535-7163.MCT-19-0318 [DOI] [PubMed] [Google Scholar]
- Janku F. (2017). Phosphoinositide 3-kinase (PI3K) pathway inhibitors in solid tumors: from laboratory to patients. Cancer Treat. Rev. 59 93–101. 10.1016/j.ctrv.2017.07.005 [DOI] [PubMed] [Google Scholar]
- Jeselsohn R., Buchwalter G., De Angelis C., Brown M., Schiff R. (2015). ESR1 mutations: a mechanism for acquired endocrine resistance in breast cancer. Nat. Rev. Clin. Oncol. 12 573–583. 10.1038/nrclinonc.2015.117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Katoh Y., Katoh M. (2009). Hedgehog target genes: mechanisms of carcinogenesis induced by aberrant hedgehog signaling activation. Curr. Mol. Med. 9 873–886. 10.2174/156652409789105570 [DOI] [PubMed] [Google Scholar]
- Katzenellenbogen B. S., Bhardwaj B., Fang H., Ince B. A., Pakdel F., Reese J. C., et al. (1993). Hormone binding and transcription activation by estrogen receptors: analyses using mammalian and yeast systems. J. Steroid Biochem. Mol. Biol. 47 39–48. 10.1016/0960-0760(93)90055-2 [DOI] [PubMed] [Google Scholar]
- Kennedy L. B., Salama A. K. S. (2020). A review of cancer immunotherapy toxicity. CA Cancer J. Clin. 70 86–104. 10.3322/caac.21596 [DOI] [PubMed] [Google Scholar]
- Kypta R. M., Waxman J. (2012). Wnt/β-catenin signalling in prostate cancer. Nat. Rev. Urol. 9 418–428. 10.1038/nrurol.2012.116 [DOI] [PubMed] [Google Scholar]
- Lee H., Pal S. K., Reckamp K., Figlin R. A., Yu H. (2011). STAT3: a target to enhance antitumor immune response. Curr. Top. Microbiol. Immunol. 344 41–59. 10.1007/82_2010_51 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li M. O., Wan Y. Y., Flavell R. A. (2007). T cell-produced transforming growth factor-β1 controls T cell tolerance and regulates Th1- and Th17-cell differentiation. Immunity 26 579–591. 10.1016/j.immuni.2007.03.014 [DOI] [PubMed] [Google Scholar]
- Liu H., Yin J., Wang H., Jiang G., Deng M., Zhang G., et al. (2015). FOXO3a modulates WNT/β-catenin signaling and suppresses epithelial-to-mesenchymal transition in prostate cancer cells. Cell. Signal. 27 510–518. 10.1016/j.cellsig.2015.01.001 [DOI] [PubMed] [Google Scholar]
- Mandell J. W. (2008). Immunohistochemical assessment of protein phosphorylation state: the dream and the reality. Histochem. Cell Biol. 130 465–471. 10.1007/s00418-008-0474-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- Marquart J., Chen E. Y., Prasad V. (2018). Estimation of the percentage of US patients with cancer who benefit from genome-driven oncology. JAMA Oncol. 4 1093–1098. 10.1001/jamaoncol.2018.1660 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Martin P., Neerken S., De Stolpe A. V., den Biezen-Timmermans E., Akse M., Ngocamus M., et al. (2020). EIT PACMAN study preliminary results: OncoSignal pathway analysis identifies actionable cancer targets. JCO 38:e15606 10.1200/JCO.2020.38.15_suppl.e15606 [DOI] [Google Scholar]
- Massagué J. (2012). TGFβ signalling in context. Nat. Rev. Mol. Cell Biol. 13 616–630. 10.1038/nrm3434 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Massagué J., Obenauf A. C. (2016). Metastatic colonization by circulating tumour cells. Nature 529 298–306. 10.1038/nature17038 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Massard C., Michiels S., Ferté C., Le Deley M. C., Lacroix L., Hollebecque A., et al. (2017). High-throughput genomics and clinical outcome in hard-to-treat advanced cancers: results of the MOSCATO 01 Trial. Cancer Discov. 7 586–595. 10.1158/2159-8290.CD-16-1396 [DOI] [PubMed] [Google Scholar]
- Mnatsakanyan R., Shema G., Basik M., Batist G., Borchers C. H., Sickmann A., et al. (2018). Detecting post-translational modification signatures as potential biomarkers in clinical mass spectrometry. Expert Rev. Proteomic. 15 515–535. 10.1080/14789450.2018.1483340 [DOI] [PubMed] [Google Scholar]
- Moujaess E., Haddad F. G., Eid R., Kourie H. R. (2019). The emerging use of immune checkpoint blockade in the adjuvant setting for solid tumors: a review. Immunotherapy 11 1409–1422. 10.2217/imt-2019-0087 [DOI] [PubMed] [Google Scholar]
- Munoz J., Wheler J. J., Kurzrock R. (2015). Androgen receptors beyond prostate cancer: an old marker as a new target. Oncotarget 6 592–603. 10.18632/oncotarget.2831 [DOI] [PMC free article] [PubMed] [Google Scholar]
- National Cancer Institute (2021). Available online at: https://www.cancer.gov/about-cancer/treatment/types/targeted-therapies/targeted-therapies-fact-sheet (accessed January 4, 2021). [Google Scholar]
- Newton K., Dixit V. M. (2012). Signaling in innate immunity and inflammation. Cold Spring Harb. Perspect. Biol. 4:a006049. 10.1101/cshperspect.a006049 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Oh H., Ghosh S. (2013). NF-κB: roles and regulation in different CD4+ T cell subsets. Immunol. Rev. 252 41–51. 10.1111/imr.12033 [DOI] [PMC free article] [PubMed] [Google Scholar]
- PACMAN (2021). Available online at: https://www.eithealth.eu/pacman (accessed January 4, 2021). [Google Scholar]
- Platanias L. C. (2005). Mechanisms of type-I- and type-II-interferon-mediated signalling. Nat. Rev. Immunol. 5 375–386. 10.1038/nri1604 [DOI] [PubMed] [Google Scholar]
- Rangel N., Rondon-Lagos M., Annaratone L., Aristizábal-Pachon A. F., Cassoni P., Sapino A., et al. (2020). AR/ER ratio correlates with expression of proliferation markers and with distinct subset of breast tumors. Cells 9:1064 10.3390/cells9041064 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rangel N., Rondon-Lagos M., Annaratone L., Osella-Abate S., Metovic J., Mano M. P., et al. (2018). The role of the AR/ER ratio in ER-positive breast cancer patients. Endocr. Relat. Cancer 25 163–172. 10.1530/ERC-17-0417 [DOI] [PubMed] [Google Scholar]
- Roerink S. F., Sasaki N., Lee-Six H., Young M. D., Alexandrov L. B., Behjati S., et al. (2018). Intra-tumour diversification in colorectal cancer at the single-cell level. Nature 556 457–462. 10.1038/s41586-018-0024-3 [DOI] [PubMed] [Google Scholar]
- Romero P., Banchereau J., Bhardwaj N., Cockett M., Disis M. L., Dranoff G., et al. (2016). The human vaccines project: a roadmap for cancer vaccine development. Sci. Transl. Med. 8:334s9. 10.1126/scitranslmed.aaf0685 [DOI] [PubMed] [Google Scholar]
- Schneider J. A., Logan S. K. (2018). Revisiting the role of Wnt/β-catenin signaling in prostate cancer. Mol. Cell. Endocrinol. 462 3–8. 10.1016/j.mce.2017.02.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shi J., Ruijtenbeek R., Pieters R. J. (2018). Demystifying O-GlcNAcylation: hints from peptide substrates. Glycobiology 28 814–824. 10.1093/glycob/cwy031 [DOI] [PubMed] [Google Scholar]
- Sieuwerts A. M., Inda M. A., Smid M., van Ooijen H., van de Stolpe A., Martens J. W. M., et al. (2020). ER and PI3K pathway activity in primary ER positive breast cancer is associated with progression-free survival of metastatic patients under first-line tamoxifen. Cancers 12:802. 10.3390/cancers12040802 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Solinas C., Aiello M., De Silva P., Gu-Trantien C., Migliori E., Willard-Gallo K., et al. (2019). Targeting PD-1 in cancer: biological insights with a focus on breast cancer. Crit. Rev. Oncol. Hematol. 142 35–43. 10.1016/j.critrevonc.2019.07.011 [DOI] [PubMed] [Google Scholar]
- Sottoriva A., Kang H., Ma Z., Graham T. A., Salomon M. P., Zhao J., et al. (2015). A Big Bang model of human colorectal tumor growth. Nat. Genet. 47 209–216. 10.1038/ng.3214 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Subramanian A., Tamayo P., Mootha V. K., Mukherjee S., Ebert B. L., Gillette M. A., et al. (2005). Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc. Natl. Acad. Sci. U.S.A. 102 15545–15550. 10.1073/pnas.0506580102 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sun R., Hu Z., Curtis C. (2018). Big bang tumor growth and clonal evolution. Cold Spring Harb. Perspect. Med. 8:a028381. 10.1101/cshperspect.a028381 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sundqvist A., Zieba A., Vasilaki E., Hidalgo C. H., Söderberg O., Koinuma D., et al. (2013). Specific interactions between Smad proteins and AP-1 components determine TGFβ-induced breast cancer cell invasion. Oncogene 32 3606–3615. 10.1038/onc.2012.370 [DOI] [PubMed] [Google Scholar]
- van Boxtel W., Verhaegh G. W., van Engen-van Grunsven I. A., van Strijp D., Kroeze L. I., Ligtenberg M. J., et al. (2019). Prediction of clinical benefit from androgen deprivation therapy in salivary duct carcinoma patients. Int. J. Cancer 146 3196–3206. 10.1002/ijc.32795 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van de Stolpe A. (2019). Quantitative measurement of functional activity of the PI3K signaling pathway in cancer. Cancers 11:293. 10.3390/cancers11030293 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van de Stolpe A., den Toonder J. M. J. (2014). Circulating tumor cells: what is in it for the patient? A vision towards the future. Cancers 6 1195–1207. 10.3390/cancers6021195 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van de Stolpe A., Holtzer L., van Ooijen H., de Inda M. A., Verhaegh W. (2019a). Enabling precision medicine by unravelling disease pathophysiology: quantifying signal transduction pathway activity across cell and tissue types. Sci. Rep. 9:1603. 10.1038/s41598-018-38179-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- van de Stolpe A., Pantel K., Sleijfer S., Terstappen L. W., den Toonder J. M. J. (2011). Circulating tumor cell isolation and diagnostics: toward routine clinical use. Cancer Res. 71 5955–5960. 10.1158/0008-5472.CAN-11-1254 [DOI] [PubMed] [Google Scholar]
- van de Stolpe A., Wesseling-Rozendaal Y., de Inda M. A., van Ooijen H., Verhaegh W. (2020). Abstract P5-02-08: androgen receptor pathway activity and the ratio between androgen and estrogen receptor pathway activity in breast cancer subtypes. Cancer Res. 80 P5-02-08–P5-02–08. 10.1158/1538-7445.SABCS19-P5-02-08 [DOI] [Google Scholar]
- van de Stolpe A., van Brussel A., Inda M. A., Verhaegh W., den Biezen E., van Diest P., et al. (2018). Abstract 3690: measuring functional signal transduction pathway activity on breast cancer tissue samples to determine intra-tumor heterogeneity and heterogeneity between primary and metastatic tumors. Cancer Res. 78 3690–3690. 10.1158/1538-7445.AM2018-3690 [DOI] [Google Scholar]
- van de Stolpe A., Verhaegh W., van Doorn A., Noël G., Gu-Trantien C., Willard-Gallo K., et al. (2019b). Abstract 2371: breast cancer induces tolerogenic state of healthy activated CD4+ lymphocytes, characterized by reduced PI3K, NFκB, JAK-STAT, Notch, and increased TGFβ pathway activity. Cancer Res. 79 2371–2371. 10.1158/1538-7445.AM2019-2371 [DOI] [Google Scholar]
- van Hartskamp M., Consoli S., Verhaegh W., Petkovic M., van de Stolpe A. (2019). Artificial intelligence in clinical healthcare applications: viewpoint. Interact. J. Med. Res. 8:e12100. 10.2196/12100 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Lieshout L., van de Stolpe A., van der Ploeg P., Bowtell D., de Hullu J., Piek J. (2020). Signal transduction pathway activity in high-grade serous ovarian carcinoma reveals a more favorable prognosis in tumors with low PI3K and high NFkB pathway activity: a novel approach to a long-standing enigma. Cancers 12:2660. 10.3390/cancers12092660 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Limbergen E. J., De Ruysscher D. K., Olivo Pimentel V., Marcus D., Berbee M., Hoeben A., et al. (2017). Combining radiotherapy with immunotherapy: the past, the present and the future. Br. J. Radiol. 90:20170157. 10.1259/bjr.20170157 [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Ooijen H., Hornsveld M., Dam-de Veen C., Velter R., Dou M., Verhaegh W., et al. (2018). Assessment of functional phosphatidylinositol 3-kinase pathway activity in cancer tissue using forkhead box-O target gene expression in a knowledge-based computational model. Am. J. Pathol. 188 1956–1972. [DOI] [PubMed] [Google Scholar]
- van Strijp D., Vulders R. C. M., Larsen N. A., Schira J., Baerlocher L., van Driel M. A., et al. (2017). Complete sequence-based pathway analysis by differential on-chip DNA and RNA extraction from a single cell. Sci. Rep. 7:11030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- van Weelden W. J., van der Putten L. J. M., Inda M. A., van Brussel A., Snijders M. P. L. M., Schriever L. M. M., et al. (2020). Oestrogen receptor pathway activity is associated with outcome in endometrial cancer. Br. J. Cancer 123 785–792. 10.1038/s41416-020-0925-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Verhaegh W., van de Stolpe A. (2014). Knowledge-based computational models. Oncotarget 5 5196–5197. 10.18632/oncotarget.2276 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Verhaegh W., van de Stolpe A., Caushaj N., Landesfeind M., Zaremba A. (2018). Abstract 1052: identification of signal transduction pathway activity in patient-derived xenograft models in comparison with their originating clinical samples of a variety of human cancer types. Cancer Res. 78 1052–1052. 10.1158/1538-7445.AM2018-1052 [DOI] [Google Scholar]
- Verhaegh W., van Ooijen H., Inda M. A., Hatzis P., Versteeg R., Smid M., et al. (2014). Selection of personalized patient therapy through the use of knowledge-based computational models that identify tumor-driving signal transduction pathways. Cancer Res. 74 2936–2945. [DOI] [PubMed] [Google Scholar]
- Wesseling-Rozendaal Y., van de Stolpe A., Holtzer L., de Inda M. A., van de Wiel P. (2019b). Abstract A131: fulvestrant resistance in an MCF-7 model for breast cancer is associated with complete loss of ER pathway activity and gain of MAPK-AP1 pathway activity. Mol. Cancer Ther. 18:A131. [Google Scholar]
- Wesseling-Rozendaal Y., van Swinderen P., Gil J., Neerken S., van de Stolpe A. (2019a). Abstract C020: quantitative measurements of functional activity of the TGFβ and MAPK-AP1 pathways in colon cancer provides information on their role in cancer development and metastasis. Mol. Cancer Ther. 18 C020–C020. [Google Scholar]
- Wu L., Zhao J. C., Kim J., Jin H. J., Wang C. Y., Yu J., et al. (2013). ERG is a critical regulator of Wnt/LEF1 signaling in prostate cancer. Cancer Res. 73 6068–6079. 10.1158/0008-5472.CAN-13-0882 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yang S.-R., Stolpe A. V. D., van Brussel A., van Ooijen H., Galimzianova A., Beca F., et al. (2019). Abstract P5-11-06: does hormone expression by IHC predict ER pathway activity? An analysis in a metastatic breast cancer patient cohort. Cancer Res. 79 P5-11-06–P5-11-06. 10.1158/1538-7445.SABCS18-P5-11-06 [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors upon request, without undue reservation.