Abstract
Background
Regorafenib and other multikinase inhibitors may enhance antitumor efficacy of anti-program cell death-1 (anti-PD1) therapy in hepatocellular carcinoma (HCC). Its immunomodulatory effects, besides anti-angiogenesis, were not clearly defined.
Methods
In vivo antitumor efficacy was tested in multiple syngeneic liver cancer models. Murine bone marrow–derived macrophages (BMDMs) were tested in vitro for modulation of polarization by regorafenib and activation of cocultured T cells. Markers of M1/M2 polarization were measured by quantitative reverse transcription PCR (RT-PCR), arginase activity, flow cytometry, and ELISA. Knockdown of p38 kinase and downstream Creb1/Klf4 signaling on macrophage polarization were confirmed by using knockdown of the upstream MAPK14 kinase, chemical p38 kinase inhibitor, and chromatin immunoprecipitation.
Results
Regorafenib (5 mg/kg/day, corresponding to about half of human clinical dosage) inhibited tumor growth and angiogenesis in vivo similarly to DC-101 (anti-VEGFR2 antibody) but produced higher T cell activation and M1 macrophage polarization, increased the ratio of M1/M2 polarized BMDMs and proliferation/activation of cocultured T cells in vitro, indicating angiogenesis-independent immunomodulatory effects. Suppression of p38 kinase phosphorylation and downstream Creb1/Klf4 activity in BMDMs by regorafenib reversed M2 polarization. Regorafenib enhanced antitumor efficacy of adoptively transferred antigen-specific T cells. Synergistic antitumor efficacy between regorafenib and anti-PD1 was associated with multiple immune-related pathways in the tumor microenvironment.
Conclusion
Regorafenib may enhance antitumor immunity through modulation of macrophage polarization, independent of its anti-angiogenic effects. Optimization of regorafenib dosage for rational design of combination therapy regimen may improve the therapeutic index in the clinic.
Keywords: immunomodulation, immunotherapy, tumor microenvironment
Introduction
The program cell death-1 (PD-1)/program death ligand-1 (PD-L1) pathway has been extensively studied for its role in regulation of antitumor immunity.1 Single-agent anti-PD-1 or anti-PD-L1 immune checkpoint inhibitor (ICI) therapy has been approved for more than 10 types of advanced cancers, and combination regimens with other immunomodulatory agents, targeted therapy, or cytotoxic chemotherapy may further improve overall survival (OS) or progression-free survival (PFS) in different cancer types. For patients with advanced hepatocellular carcinoma (HCC), the combination of atezolizumab (anti-PD-L1 ICI) and bevacizumab (anti-angiogenic agent) demonstrated superior OS, PFS, and objective tumor response, compared with the multikinase inhibitor sorafenib, and establishes a new standard of first-line systemic therapy for advanced HCC.2
The immune modulatory effects of anti-angiogenic therapy has been extensively studied by both preclinical models and clinical trials.3–5 For HCC, anti-angiogenic effect via inhibition of vascular endothelial growth factor (VEGF) pathway is a common antitumor mechanism of all the approved MKIs (sorafenib and lenvatinib in the first line; regorafenib and cabozantinib in the second line), and combination of these MKIs with ICI for HCC therapy is extensively studied.6 A caveat of developing this type of combination regimens is the safety issue, as dose reduction of MKI and treatment discontinuation due to adverse events are common and have led to discontinuation of development of some ICI plus anti-angiogenic combinations.7–10 Moreover, preclinical studies suggested that higher dosage of MKI may paradoxically induce immunosuppression through induction of hypoxia and recruitment of tumor-associated macrophages (TAMs) or other suppressive cells.11 Identification of the optimal immune modulatory effects of targeted agents is thus critical for development of combination immunotherapy both to improve the therapeutic index and to tailor the use of targeted agents to their biologically effective and clinically relevant dosage.
The MKI regorafenib has been approved as second-line therapy for advanced HCC, as well as refractory colorectal cancer and gastrointestinal stromal tumor, but its use at the recommended dosage (160 mg per day for 21 days followed by 7-day rest) is frequently limited by prominent treatment-related adverse events, including hand-foot skin reaction, diarrhea, and hypertension. Combination of regorafenib and the anti-PD-1 agent nivolumab demonstrated an objective response rate of 40% in 50 patients with heavily pretreated advanced gastric or colorectal cancers, for whom the response rates of either regorafenib or nivolumab alone were lower than 10%.12 Regorafenib at 80 mg/day was well tolerated in this combination, while the recommended dosage (160 mg/day) produced prominent skin toxicity and other adverse events without increase in efficacy. We and other investigators have demonstrated that regorafenib at sub-micromolar range may induce M1 macrophage polarization and increased proliferation and activation of CD8+ T cells. In vivo studies using low-dose regorafenib 3–5 mg/kg/day, corresponding to about 50% of the single-agent recommended dosage, demonstrated synergistic antitumor efficacy with anti-PD-1 therapy.13 14 The above observations indicate that the optimal immune modulatory dosage of regorafenib may be lower than recommended for single-agent therapy and should be optimized to improve its safety profile and facilitate development in combination therapy.
This study sought to establish relevant preclinical models to characterize the immune modulatory effects of regorafenib and to explore the biologically effective dosage of regorafenib for HCC. Low-dose regorafenib (≤1 µM in vitro, 5 mg/kg/day in vivo) may increase cytotoxic T cell function and antitumor immunity through polarization of macrophages toward the M1 phenotype. Furthermore, the p38 mitogen-activated protein kinase (p38MAPK) pathway was identified as one molecular mechanism mediating the immune modulatory effects of regorafenib.
Materials and methods
Murine liver cancer models, cell lines, and reagents
The protocol for the animal experiments was approved by the Institutional Animal Care and Use Committee (IACUC) of the College of Medicine, National Taiwan University, and conformed to the criteria outlined in the Guide for the Care and Use of Laboratory Animals (BALB/c and C57BL/6 mice from National Laboratory Animal Center, Taiwan; P14 transgenic mice (C57BL/6J background) from Jackson Laboratories were housed and kept under specific pathogen-free conditions at the laboratory animal center in National Taiwan University College of Medicine).
The details of human and murine liver cancer and macrophage cell lines were listed in the supplemental file. In vitro cell viability was measured using an MTT (3-(4,5-dimethylthiazol-2-yl)-2,5-diphenyltetrazolium bromide) assay or sub-G1 fraction analysis (for apoptotic cells) using flow cytometry as previously described.15 For the subcutaneous model (Hepa1-6 cell line/C57BL/6 mice), about 2×106 cells were injected subcutaneously into the right flank, and drug treatment was started when tumor volume was about 100 mm3 (calculated by the formula 0.5×length×width2) and the mice were randomized into each treatment group. For the orthotopic model (BNL cell line/BALB/c mice), about 2×105 cells were injected into the subcapsular area of the left liver lobe, and the mice were randomized to each treatment group 5 days after tumor cell injection, based on our previous study.16 The schema of animal experiments was provided in the supplemental file.
The antitumor efficacy and safety of drug treatment were measured by change in tumor volume, body weight, and animal survival.
To measure antigen-specific antitumor immunity, Hepa1-6 liver cancer cells were transfected with a vector that overexpressed a glycoprotein epitope (GP33) of the lymphocytic choriomeningitis virus (a generous gift from Professor Dr Hanspeter Pircher, University of Freiburg).17 Lymphocytes from P14 transgenic mice, which specifically recognized GP33 expressed on Hepa1-6 cells, were used in experiments of adoptive transfer.
Regorafenib was provided by Bayer (Bayer AG, Berlin, Germany). Details of other reagents were listed in the supplemental file. In animal studies, regorafenib was dissolved in polypropylene glycol, PEG400, Pluronic F68, water (34:34:12:20) and given orally by gavage.18 The anti-VEGFR antibody DC-101 was given by intraperitoneal injection.
In vitro modulation of macrophage polarization
Mouse BMDMs were prepared as described in the supplemental file. BMDMs or J774A.1 cells were polarized with interferon-γ (IFN-γ, 20 ng/mL, R&D)+lipopolysaccharide (LPS, 50 ng/mL, Sigma) or interleukin-4 (IL4) (20 ng/mL, R&D) for 24 hours to induce M1 or M2 phenotypes, respectively. Markers of M1 (TNF-α, IL-6, MHC II) or M2 (Arginase-1, CD206) phenotypes were measured by quantitative reverse transcription PCR (RT-PCR), arginase activity, flow cytometry, and ELISA (Invitrogen) analysis. Murine splenocytes were cocultured with BMDMs, and CD8+/CD4+ T cell function modulated by macrophages with or without drug treatment was measured by T cell proliferation (carboxyfluorescein succinimidyl ester (CFSE) staining, Invitrogen) and IFN-γ secretion (Mouse IFN-γ ELISA kit, Invitrogen).
The key signaling pathways in BMDMs modulated by regorafenib were screened by the phospho-kinase array (R&D systems) according to the manufacturer’s instructions and confirmed by western blotting. Knockdown of p38 kinase was performed using lentivirus transduction of green fluorescence protein (GFP) control and MAPK14 clones (from the National RNAi Core Facility, Academia Sinica, Taiwan) into J774A.1 cells. The GFP+ cells were sorted by fluorescence-activated cell sorting (FACS) to increase the proportion of successfully transduced cells and the changes in relevant signaling molecules in sorted cells were measured by western blotting. The modulatory effects on signaling and associated downstream transcriptional regulation of the immune regulatory factor Krupple-like factor 4 (Klf4) by cAMP responsive element binding protein 1 (Creb1) by regorafenib was further measured by chromatin immunoprecipitation (ChIP, see the supplemental file for detailed primer design and experiment procedures).
RNA-sequencing and bioinformatics analysis
Expression of immune-related genes was measured by RNA sequencing using the Illumina Nextseq 500 system (Illumina), with a read length of 2×100 bases (Genomics, Taipei, Taiwan). Initial quality control was performed using FastQC (V.0.11.8) and removal of adaptors was performed using cutadapt (V.2.4). The qualified reads were mapped to the mouse genome (GRCm38) using STAR (V.2.7.2a). Gene-level read counts were obtained using STAR with parameter ‘—quantMode GeneCounts’ based on the gene definition of Gencode (V.M19).
Read counts were normalized by Trimmed Mean of M-values (TMM) method implemented by edgeR (V.3.28.0). If the datasets had biological replicates, differential expression analysis was performed by R package limma (V.3.42.2), otherwise by NOISeq (V.2.30.0) with no replicate mode. Gene-set enrichment analysis (GSEA) and over-representation analyses were performed using the functions implemented by clusterProfiler (V.3.14.3). The gene sets were collected from MSigDB (V.7.0) including the category C2 and C5, as well as manually curated from the literature (online supplemental table S1). The ranking metrics of signal to noise and log2 ratio were used for dataset with/without biological replicates, respectively. The enrichment map was constructed as previously described.19 The gene sets were linked if the arithmetic mean of Jaccard and overlap coefficients of two gene sets is larger than 0.3.
jitc-2020-001657supp001.xlsx (246.9KB, xlsx)
Regulation of tumor microenvironment by regorafenib in vivo
The immune microenvironment of murine tumors (orthotopic or heterotopic) after drug treatment was evaluated by changes in immune regulatory genes (RNA-seq and GSEA) and immune cell composition (flow cytometry, immunohistochemistry, and multiplex immunofluorescence staining). Fresh tumor samples were used for RNA-seq (using the procedures described above) and flow cytometry analysis. For flow cytometry analysis of tumor-infiltrating immune cells, tumor tissue was dissociated using gentleMACS Dissociator (Miltenyi Biotec) and isolated by density gradient centrifugation. Cell suspensions were stained with antibodies against surface markers or, for intracellular staining, stained with antibodies against intracellular markers after permeation and fixation. The results were analyzed by LSRFortessa (BD Bioscience) flow cytometry and the FlowJo V.10 software.
Formalin-fixed, paraffin-embedded (FFPE) tumor sections were used to measure the levels of tumor-infiltrating T cells, angiogenesis, cell proliferation (by immunohistochemical staining), and apoptosis (by terminal deoxynucleotidyl transferase dUTP nick end labeling (TUNEL) assay (Promega)). The Polaris system (PerkinElmer, Waltham, Massachusetts, USA) and the Opal 4-Color Manual IHC Kit (PerkinElmer, NEL810001KT) were used to detect F4/80, MHC II, and CD206 expression in FFPE sections (see the supplemental file for detailed procedures and the antibody list). Multispectral images for each tumor tissue section were acquired using the Phenochart and the inForm software (PerkinElmer). To train the phenotype classifier and create a tissue segmentation algorithm by the inForm software, 10 representative tumor images were selected as the training set and manually annotated for M1 (F4/80+MHC II+CD206-) or M2 (F4/80+MHCII-CD206+) macrophages. Cell segmentation was performed based on the nuclear DAPI (4′,6-diamidino-2-phenylindole) staining. Tissue and cell segmentation algorithms were then established for cell phenotyping and measurement of immune cell composition through machine-learning by the inForm software.
The potential effects of regorafenib on antigen-specific antitumor immunity were evaluated using adoptive transfer of lymphocytes from P14 transgenic mice to treat tumors established by GP33-expressing Hepa1-6 cells. CD8+ T cells isolated from P14 transgenic mice, using the EasySep Mouse CD8a Positive Selection Kit II (STEMCELL), were activated using anti-CD3 (2 µg/mL), anti-CD28 (2 µg/mL), and LCMV gp33-41 (1 µM) for 72 hours following CFSE labeling. About 1×107 CFSE-labeled P14 CD8+ T cells or phosphate-buffered saline (PBS) were injected, via orbital vascular plexus, into control or regorafenib-treated C57BL/6 mice bearing Hepa1-6-gp33 cells. Regorafenib (5 mg/kg/day) was administrated for 5 days before adoptive transfer. Treatment with anti-mouse PD1 antibody (clone RMP1–14), or isotype control antibody (clone 2A3) (Bio X Cell, West Lebanon, New Hampshire, USA), 0.2 mg per dose, was given on days 5, 6, 9, 12, and 15 after tumor implantation by intraperitoneal injection.
Statistical analysis
All data were representative of at least three independent experiments. Quantitative data were represented as mean±SD or SE of the mean (SEM), as indicated in the legend. Two-tailed Student’s t-test with equal variance was performed to compare two experimental groups. One-way analysis of variance (ANOVA) with Tukey’s post hoc test was performed to evaluate the difference between multiple groups. Repeated-measures ANOVA was performed to evaluate the tumor growth curves, and survival analysis was measured using the Kaplan-Meier method and analyzed by log-rank test. All the statistical analyses were performed using SPSS V.21 or Office Excel V.2019. The raw data of RNA-seq were all available in GEO (accession number GSE148950).
Results
The immune modulatory effects of regorafenib contribute to its in vivo antitumor efficacy
Regorafenib 5 mg/kg/day, corresponding to about 50% of the recommended dosage for human based on clinical and preclinical pharmacokinetic data,20 exerted antitumor efficacy in both orthotopic and subcutaneous immune-competent liver cancer models (figure 1A). The difference in tumor growth measured at the end of the animal study may reflect the combined effects of decreased cell proliferation (Ki67 staining), decreased tumor angiogenesis (CD31 staining), and increased tumor cell apoptosis (TUNEL assay) by regorafenib (figure 1B). Regorafenib increased CD4+ and CD8+ T cell infiltration into tumors, increased expression of genes related to T cell activation, antigen presentation, and macrophage activation, and suppressed genes related to angiogenesis (figure 1B, C,online supplemental table S2). While regorafenib induce cancer cell apoptosis dose dependently (online supplemental figure S1A, B), higher dosage of regorafenib inhibited T cell proliferation and activation in vitro (figure 1D, online supplemental figure S1C), suggesting that higher dosage of regorafenib may not be associated with better immune modulatory effects.
jitc-2020-001657supp002.pdf (2.3MB, pdf)
The antitumor effects of regorafenib were then compared with those of DC-101, a murine anti-VEGFR2 antibody, in an orthotopic liver cancer model to identify possible immune modulatory effects independent of anti-VEGFR2 effects. While both regorafenib and DC-101 inhibited tumor angiogenesis, regorafenib induced more T cell infiltration into the tumors and was associated with better antitumor effects (figure 2A, supplementary figure S2A). Regorafenib regulated multiple immune-related pathways that were relatively unaffected by VEGFR2 inhibition, such as those related to defense response and leukocyte migration (figure 2B, C, online supplemental table S3, S4), and increased activated CD8+ T cells in the tumors (figure 2D, supplementary figure S2B-D). Regorafenib decreased the total number of TAMs in vivo (figure 2D) and induced apoptosis of M1/M2 macrophages similarly in vitro (online supplemental figure S3). However, both flow cytometry and multiplex immunofluorescence staining studies disclosed increased M1/M2 ratio (figure 2D, E). By contrast, DC-101 increased the total numbers of TAMs and did not affect macrophage polarization.
We thus hypothesized that regulation of macrophage polarization may account for the immune modulatory effects of regorafenib, independent of its VEGFR2 inhibitory effects. This hypothesis was supported by the differential effects of regorafenib and DC-101 on regulation of key signaling pathways for macrophage function. Regorafenib induced more prominent changes in the M1 signature,21 IL-12 pathways, response to IFN-γ, and targets of tumor necrosis factors (TNFs) (figure 2F, online supplemental table S5).22 Effects of regorafenib and DC-101 did not differ significantly in other immune cells analyzed, such as dendritic cells, regulatory T cells, or myeloid-derived suppressor cells (online supplemental figure S2C).
Regorafenib increased proliferation and activation of CD8+ T cells via regulation of macrophage polarization
To measure the effects of regorafenib on macrophage polarization and T cell function in vitro, BMDMs were pretreated with regorafenib for 1 hour and then polarized by IFN-γ+lipopolysaccharides (LPS) (M1 phenotype) or by interleukin-4 (IL4) (M2 phenotype), respectively, for 24 hours (figure 3A). Regorafenib at sub-micromolar dosages increased M1 markers (TNFα, IL6, MHC II) in M1 macrophages and suppressed M2 markers (Arg1, CD206) in M2 macrophages (figure 3B). Coculture of regorafenib-treated BMDMs (figure 3C) increased T cell proliferation and IFN-γ secretion (figure 3D, E). The above data suggested that regulation of macrophage function, especially suppression of M2 polarization, may play key roles in the immune modulatory effects of regorafenib.
To further elucidate the molecular mechanisms by which regorafenib may suppress M2 macrophage polarization, RNA expression and activity of representative cellular kinases in BMDMs treated with regorafenib were analyzed by RNA-seq and phosphokinase array, respectively. Regorafenib increased gene expression related to M1 phenotype and suppressed multiple mediators of M2 polarization (figure 4A, B,online supplemental figure S4A, B, online supplemental table S6, S7) and may inhibit multiple cellular kinases that may involve in immune regulation (figure 4C, online supplemental figure S4C). Among the regorafenib-regulated kinases, p38MAPK was of particular interest since p38MAPK activation was recently found to promote M2 macrophage polarization23 in addition to its well-established roles in regulating apoptosis24 25 and response to oxidative stress.26 The colony-stimulating factor-1 (CSF-1) receptor (CSF-1R) pathway has been reported as a critical mechanism by which regorafenib exerted its immune modulatory effects,14 27 but this kinase was not included in the phosphokinase array we used. In both BMDMs and the J774A.1 macrophage cell line, regorafenib may inhibit CSF-1R phosphorylation at concentration of 1 µM. However, no significant changes in the expression patterns of CSF-1 response genes28 in BMDM were found. On the other hand, suppression of p38MAPK signaling29 and the downstream CREB1-responsive genes30 was consistent with the suppression of IL-4-responsive genes,31 which play critical roles in regulating M2 polarization of TAMs (online supplemental figure S4D). Therefore, p38MAPK was selected for further mechanistic exploration.
Although decreased phosphorylation of kinases such as src, EGFR, AMPK, ERK, and AKT were found by the kinase array, these kinases had much higher Kd by in vitro kinase assay with treatment of regorafenib or its active metabolites,32 33 suggesting that effects of regorafenib on these kinases may be secondary to the interaction in the complex signaling network in macrophages.
We next used the upstream regulator analysis tool of ingenuity pathway analysis to analyze the downregulated genes in regorafenib-treated macrophages in order to seek the potential mediator(s) regulated by regorafenib. The results revealed that multiple transcriptional factors were potentially regulated by regorafenib (online supplemental table S8), including Klf4 and cAMP response element binding protein 1 (Creb1), which have been known to be crucial in macrophage activity/survival.34–36 Intriguingly, p38MAPK has been noted to regulate Creb1 phosphorylation.37 We therefore hypothesized that regorafenib represses M2 polarization of macrophages through inhibiting p38MAPK activity, which suppresses p38MAPK-regulated Creb1 phosphorylation to downregulate Klf4 transcription (figure 4D). Treatment of regorafenib in murine BMDMs and the J774A.1 macrophage cell line suppressed p38MAPK and Creb1 phosphorylation, as well as the expression of Klf4 and Ccl7 (a cytokine associated with M2 polarization) (figure 4E). Inhibition of the p38MAPK-Creb1-Klf4 pathway by shRNA knockdown of MAPK14 (online supplemental figure S4E, F) or the p38MAPK inhibitor SB202190 (figure 4F) showed similar effects on modulation of M2 markers. Suppression of Creb1 binding to the cAMP responsive elements of Klf4 promoter by regorafenib validated the regulation of Creb1 binding on Klf4 promoter by regorafenib (figure 4G).
The effects of regorafenib on adaptive antitumor immunity were further explored by adoptive transfer of antigen-specific cytotoxic T cells and by combination with anti-PD-1 therapy. Regorafenib significantly enhanced the antitumor efficacy of the adoptively transferred CD8 T cells (figure 5A), which was associated with increased CD8 T cells in the tumors (figure 5B). On the other hand, the distribution of the adoptively transferred CD8+ T cells in peripheral blood, spleen, or lymph nodes of tumor-bearing mice did not differ with the addition of regorafenib (figure 5C). The combination of regorafenib and anti-PD1 therapy demonstrated synergistic antitumor efficacy in the liver cancer models in terms of tumor growth (figure 6A) and animal survival (figure 6B) as compared with either monotherapy. Regorafenib alone or regorafenib plus anti-PD treatment regulated multiple genes associated with leukocyte proliferation and migration in our animal models (online supplemental figure S5). Moreover, the regorafenib-anti-PD1 combination induced a distinctive pattern of gene expression, compared with treatment with either regorafenib or anti-PD1 alone (figure 6C, online supplemental table S9), and multiple immune-related pathways were involved (figure 6D, online supplemental table S10). The above data support our proposed mechanisms by which regorafenib regulates antitumor immunity (figure 6E).
Discussion
In this study, we demonstrated that regorafenib modulates macrophage polarization and enhances antitumor immunity independent of its anti-angiogenic effects. The p38MAPK/Creb1/Klf4 signaling pathway may play a critical role in the regorafenib-induced M2 to M1 TAM polarization and subsequent T cell activation by the polarized M1 macrophages. Our study provides rationale of combining regorafenib at biologically effective dosage with other immunotherapeutic agents to improve the therapeutic index in the clinic.
While many of the immune modulatory effects of these MKIs may be linked to their VEGFR-inhibitory properties, multiple other cellular factors in the tumor microenvironment may be involved, such as increasing the M1 polarization of TAMs,14 38–41 enhancing CD4+ and CD8+ T cell infiltration and function,42–45 suppressing the number of regulatory T cells,44 46–48 or reversing the function of myeloid-derived suppressive cells.40 49 50 In this study, we demonstrated the regorafenib dosage required for immune modulation may be lower than recommended as single-agent therapy for advanced HCC treatment. The biologically effective dosage for regorafenib and other MKIs in future development of combination regimens should be clarified based on clearer understandings of molecular mechanisms.
The p38MAPK pathway is crucial for stress responses and has been implicated in a variety of pathological conditions including inflammation, aberrant apoptosis, and cancer metastasis.51 The Creb1 transcription factor may be responsible for many anti-inflammatory responses induced by various growth factors and inflammatory signals upstream of the p38MAPK pathway.52 Interaction of Creb1 and its downstream effector protein Klf4 in regulating macrophage function, particularly promoting M2 polarization, has also been described previously.53 54 The present study demonstrated that the p38MAPK/Creb1/Klf4 pathway may play a critical role in mediating the antitumor immunity induced by regorafenib. This approach may help characterize the biologically effective dosage of other MKIs and improve their therapeutic index in combination therapy. p38MAPK may also play vital roles in regulating immune modulatory effects in other cell types, such as dendritic cells,55 which provides additional avenues of mechanistic exploration and new target identification.
The combination of anti-PD-1/anti-PD-L1 ICI and anti-angiogenic agents has been extensively studied in multiple cancer types. In addition to advanced HCC, this strategy has also been approved for the treatment of advanced renal cell carcinoma and endometrial carcinoma.56 57 Multikinase inhibitors (MKIs) like regorafenib may possess VEGFR-independent effects that may contribute to antitumor immunity, at the price of higher incidence of adverse events. Although questions remain on the comparability of the immune microenvironment between preclinical models and human tumors, our study supports the feasibility of using preclinical models to identify critical immune mediators for specific MKIs and to provide mechanistic rationale of combining regorafenib at a lower dosage with anti-PD-1 ICI to improve the therapeutic index.
Many issues regarding the mechanistic regulation and functional outcome of macrophage activation/polarization require further investigation. First, in this study, macrophage polarization was identified as an angiogenesis-independent mechanism by which regorafenib exerts its antitumor immunity effects. In fact, activation of TAMs incorporates diverse and dynamic proinflammatory and anti-inflammatory signals in the tumor microenvironment, and tumor angiogenesis plays an integral part of its regulation.58 Therefore, regorafenib may regulate macrophage polarization in the tumor microenvironment via both angiogenesis-dependent and angiogenesis-independent mechanisms. Second, the dichotomous classification of macrophage activation (M1 vs M2) may be oversimplified. Technical advances in high-resolution analysis of macrophage phenotypes may clarify the impact of TAMs ontogeny and tissue-specific stress signals on activation and function of TAMs.59 Third, regorafenib may indirectly inhibit the activity of multiple kinases that regulate TAM function. For example, inhibition of adenosine 5′-monophosphate-activated protein kinase (AMPK) signaling may promote M1 polarization via metabolic reprogramming.60 Inhibition of AKT signaling, on the other hand, may have discrepant effects on macrophage polarization depending on the AKT isoforms involved.61 The CREB family of transcriptional factors may also regulate TAMs function via other targets, such as ATF4.62 While the complexity of TAMs activation poses formidable challenges for mechanistic exploration, it also provides enormous opportunity to find out novel immune modulatory strategy for better antitumor efficacy.
In conclusion, regorafenib may enhance antitumor immunity for HCC through modulation of macrophage polarization. This safer and biologically effective dosage of regorafenib will provide better therapeutic index for combination therapy. Optimization of preclinical models should be pursued to facilitate rational design of ICI-based combination regimens and mechanistic exploration of potential antitumor synergy among different immune modulatory agents.
Acknowledgments
This work was financially supported by the Cancer Biology Research Group, Center of Precision Medicine, National Taiwan University, Taipei, Taiwan. The authors thank Liver Disease Prevention & Treatment Foundation, Taiwan, for logistic support. The authors thank Taiwan Liver Cancer Network for providing the HCC tissue samples and related clinical data, the National Center for High-performance Computing for computer time and facilities as well as the second Core Lab, Department of Medical Research, National Taiwan University Hospital for providing laboratory facilities.
Footnotes
Contributors: D-L Ou, C-W Chen, and C-L Hsu contributed equally to this work. Study concept and design: D-L Ou, C-L Hsu, M-H Yang, and C Hsu. Methodology and technical support: C-W Chen, C-H Chung, Z-R Feng, and B-S Lee. Analysis and interpretation of data: D-L Ou, C-W Chen, C-L Hsu, C-H Chung, M-H Yang, and C Hsu. Writing, review, and/or revision of the manuscript: D-L Ou, C-L Hsu, M-H Yang, and C Hsu. Study supervision: A-L Cheng, M-H Yang, and C Hsu. Approval of the manuscript: All authors.
Funding: This study was supported by the following research grants: NTU-107L9014, NTU-108L901403, NTU-109L901403 (from Ministry of Education, Taiwan), MOST 105-2314-B-002-189-MY3, MOST 105-2314-B-002-199, MOST 106-2314-B-002-229-MY3, MOST 107-3017 F-002-002, MOST 107-2314-B-002-210-MY3, MOST 108-2314-B-002-075-MY3, MOST 108-3017 F-002-004, MOST 109-2314-B-002-229-MY3, MOST 109-2634 F-002-043 (from Ministry of Science and Technology, Taiwan), YongLin Chair Grant S-01 (from National Taiwan University), NTUH-107-S3837, UN108-010, UN109-051 (from National Taiwan University Hospital), Taipei Veterans General Hospital-National Taiwan University Hospital joint grant (VN-109-13).
Competing interests: Dr A-L Cheng is a consultant for and a member of the speaker’s bureau of Bayer-Schering Pharma. Dr A-L Cheng is a consultant of Novartis, Merck Serono, Eisai, Merck Sharp & Dohme (MSD) Corp., ONXEO, Bayer HealthCare Pharmaceuticals Inc., Bristol-Myers Squibb (BMS) Company, and Ono Pharmaceutical Co., Ltd. Dr C Hsu received research grants from BMS/ONO, Roche, and Ipsen and received honorarium from the following pharmaceutical companies: AstraZeneca, Bayer, BMS/ONO, Eisai, Eli Lilly, Ipsen, Merck Serono, MSD, Novartis, Roche, and TTY Biopharm.
Patient consent for publication: Not required.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement: Data are available in a public, open access repository. The raw data of RNA-seq were all available in GEO (accession number GSE148950).
Author note: Dr D-L Ou is a National Taiwan University YongLin Scholar since 2018.
Supplemental material: This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
References
- 1.Sun C, Mezzadra R, Schumacher TN. Regulation and function of the PD-L1 checkpoint. Immunity 2018;48:434–52. 10.1016/j.immuni.2018.03.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Finn RS, Qin S, Ikeda M, et al. Atezolizumab plus bevacizumab in unresectable hepatocellular carcinoma. N Engl J Med 2020;382:1894–905. 10.1056/NEJMoa1915745 [DOI] [PubMed] [Google Scholar]
- 3.Huang Y, Yuan J, Righi E, et al. Vascular normalizing doses of antiangiogenic treatment reprogram the immunosuppressive tumor microenvironment and enhance immunotherapy. Proc Natl Acad Sci U S A 2012;109:17561–6. 10.1073/pnas.1215397109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Huang Y, Goel S, Duda DG, et al. Vascular normalization as an emerging strategy to enhance cancer immunotherapy. Cancer Res 2013;73:2943–8. 10.1158/0008-5472.CAN-12-4354 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Hegde PS, Wallin JJ, Mancao C. Predictive markers of anti-VEGF and emerging role of angiogenesis inhibitors as immunotherapeutics. Semin Cancer Biol 2018;52:117–24. 10.1016/j.semcancer.2017.12.002 [DOI] [PubMed] [Google Scholar]
- 6.Cheng A-L, Hsu C, Chan SL, et al. Challenges of combination therapy with immune checkpoint inhibitors for hepatocellular carcinoma. J Hepatol 2020;72:307–19. 10.1016/j.jhep.2019.09.025 [DOI] [PubMed] [Google Scholar]
- 7.Amin A, Plimack ER, Ernstoff MS, et al. Safety and efficacy of nivolumab in combination with sunitinib or pazopanib in advanced or metastatic renal cell carcinoma: the CheckMate 016 study. J Immunother Cancer 2018;6:109. 10.1186/s40425-018-0420-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Xu J, Zhang Y, Jia R, et al. Anti-Pd-1 antibody SHR-1210 combined with apatinib for advanced hepatocellular carcinoma, gastric, or esophagogastric junction cancer: an open-label, dose escalation and expansion study. Clin Cancer Res 2019;25:515–23. 10.1158/1078-0432.CCR-18-2484 [DOI] [PubMed] [Google Scholar]
- 9.Yau T, Zagonel V, Santoro A, et al. Nivolumab (NIVO) + ipilimumab (IPI) + cabozantinib (Cabo) combination therapy in patients (PTS) with advanced hepatocellular carcinoma (aHCC): results from CheckMate 040. Journal of Clinical Oncology 2020;38:478–78. 10.1200/JCO.2020.38.4_suppl.478 [DOI] [Google Scholar]
- 10.Finn RS, Ikeda M, Zhu AX, et al. Phase Ib study of lenvatinib plus pembrolizumab in patients with unresectable hepatocellular carcinoma. J Clin Oncol 2020;38:Jco2000808:2960–70. 10.1200/JCO.20.00808 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lin Y-Y, Tan C-T, Chen C-W, et al. Immunomodulatory effects of current targeted therapies on hepatocellular carcinoma: implication for the future of immunotherapy. Semin Liver Dis 2018;38:379–88. 10.1055/s-0038-1673621 [DOI] [PubMed] [Google Scholar]
- 12.Fukuoka S, Hara H, Takahashi N, et al. Regorafenib plus nivolumab in patients with advanced gastric or colorectal cancer: an open-label, dose-escalation, and Dose-Expansion phase Ib trial (REGONIVO, EPOC1603). J Clin Oncol 2020;38:2053–61. 10.1200/JCO.19.03296 [DOI] [PubMed] [Google Scholar]
- 13.Chen C-W, Ou D-L, Hsu C-L, et al. FRI-471-Regorafenib may enhance efficacy of anti-program cell death-1 therapy in hepatocellular carcinoma through modulation of macrophage polarization. J Hepatol 2019;70:e605–6. 10.1016/S0618-8278(19)31207-1 [DOI] [Google Scholar]
- 14.Hoff S, Grünewald S, Röse L, et al. Immunomodulation by regorafenib alone and in combination with anti PD1 antibody on murine models of colorectal cancer. Annals of Oncology 2017;28:1198P 10.1093/annonc/mdx376.060 [DOI] [Google Scholar]
- 15.Hsu C, Lin L-I, Cheng Y-C, et al. Cyclin E1 inhibition can overcome sorafenib resistance in hepatocellular carcinoma cells through Mcl-1 suppression. Clin Cancer Res 2016;22:2555–64. 10.1158/1078-0432.CCR-15-0499 [DOI] [PubMed] [Google Scholar]
- 16.Ou D-L, Lin Y-Y, Hsu C-L, et al. Development of a PD-L1-Expressing orthotopic liver cancer model: implications for immunotherapy for hepatocellular carcinoma. Liver Cancer 2019;8:155–71. 10.1159/000489318 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Prévost-Blondel A, Zimmermann C, Stemmer C, et al. Tumor-Infiltrating lymphocytes exhibiting high ex vivo cytolytic activity fail to prevent murine melanoma tumor growth in vivo. J Immunol 1998;161:2187–94. [PubMed] [Google Scholar]
- 18.Kissel M, Berndt S, Fiebig L, et al. Antitumor effects of regorafenib and sorafenib in preclinical models of hepatocellular carcinoma. Oncotarget 2017;8:107096–108. 10.18632/oncotarget.22334 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Merico D, Isserlin R, Stueker O, et al. Enrichment map: a network-based method for gene-set enrichment visualization and interpretation. PLoS One 2010;5:e13984. 10.1371/journal.pone.0013984 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Mross K, Frost A, Steinbild S, et al. A phase I dose-escalation study of regorafenib (BAY 73-4506), an inhibitor of oncogenic, angiogenic, and stromal kinases, in patients with advanced solid tumors. Clin Cancer Res 2012;18:2658–67. 10.1158/1078-0432.CCR-11-1900 [DOI] [PubMed] [Google Scholar]
- 21.Mantovani A, Marchesi F, Malesci A, et al. Tumour-Associated macrophages as treatment targets in oncology. Nat Rev Clin Oncol 2017;14:399–416. 10.1038/nrclinonc.2016.217 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Sana TR, Janatpour MJ, Sathe M, et al. Microarray analysis of primary endothelial cells challenged with different inflammatory and immune cytokines. Cytokine 2005;29:256–69. 10.1016/j.cyto.2004.11.003 [DOI] [PubMed] [Google Scholar]
- 23.Suarez-Lopez L, Sriram G, Kong YW, et al. Mk2 contributes to tumor progression by promoting M2 macrophage polarization and tumor angiogenesis. Proc Natl Acad Sci U S A 2018;115:E4236–44. 10.1073/pnas.1722020115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Seisenbacher G, Hafen E, Stocker H. Mk2-Dependent p38b signalling protects Drosophila hindgut enterocytes against JNK-induced apoptosis under chronic stress. PLoS Genet 2011;7:e1002168. 10.1371/journal.pgen.1002168 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Wu R, Kausar H, Johnson P, et al. Hsp27 regulates Akt activation and polymorphonuclear leukocyte apoptosis by scaffolding MK2 to Akt signal complex. J Biol Chem 2007;282:21598–608. 10.1074/jbc.M611316200 [DOI] [PubMed] [Google Scholar]
- 26.Jackson RM, Garcia-Rojas R. Kinase activity, heat shock protein 27 phosphorylation, and lung epithelial cell glutathione. Exp Lung Res 2008;34:245–62. 10.1080/01902140802022500 [DOI] [PubMed] [Google Scholar]
- 27.Cannarile MA, Weisser M, Jacob W, et al. Colony-Stimulating factor 1 receptor (CSF1R) inhibitors in cancer therapy. J Immunother Cancer 2017;5:53. 10.1186/s40425-017-0257-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Hu X, Chung AY, Wu I, et al. Integrated regulation of Toll-like receptor responses by Notch and interferon-gamma pathways. Immunity 2008;29:691–703. 10.1016/j.immuni.2008.08.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Schaefer CF, Anthony K, Krupa S, et al. PID: the pathway interaction database. Nucleic Acids Res 2009;37:D674–9. 10.1093/nar/gkn653 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.McClung CA, Nestler EJ. Regulation of gene expression and cocaine reward by CREB and DeltaFosB. Nat Neurosci 2003;6:1208–15. 10.1038/nn1143 [DOI] [PubMed] [Google Scholar]
- 31.Szanto A, Balint BL, Nagy ZS, et al. Stat6 transcription factor is a facilitator of the nuclear receptor PPARγ-regulated gene expression in macrophages and dendritic cells. Immunity 2010;33:699–712. 10.1016/j.immuni.2010.11.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Wilhelm SM, Dumas J, Adnane L, et al. Regorafenib (BAY 73-4506): a new oral multikinase inhibitor of angiogenic, stromal and oncogenic receptor tyrosine kinases with potent preclinical antitumor activity. Int J Cancer 2011;129:245–55. 10.1002/ijc.25864 [DOI] [PubMed] [Google Scholar]
- 33.Zopf D, Fichtner I, Bhargava A, et al. Pharmacologic activity and pharmacokinetics of metabolites of regorafenib in preclinical models. Cancer Med 2016;5:3176–85. 10.1002/cam4.883 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Ghaleb AM, Yang VW. Krüppel-Like factor 4 (KLF4): what we currently know. Gene 2017;611:27–37. 10.1016/j.gene.2017.02.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Liao X, Sharma N, Kapadia F, et al. Krüppel-Like factor 4 regulates macrophage polarization. J Clin Invest 2011;121:2736–49. 10.1172/JCI45444 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Park JM, Greten FR, Wong A, et al. Signaling pathways and genes that inhibit pathogen-induced macrophage apoptosis--CREB and NF-kappaB as key regulators. Immunity 2005;23:319–29. 10.1016/j.immuni.2005.08.010 [DOI] [PubMed] [Google Scholar]
- 37.Di Giacomo V, Sancilio S, Caravatta L, et al. Regulation of CREB activation by p38 mitogen activated protein kinase during human primary erythroblast differentiation. Int J Immunopathol Pharmacol 2009;22:679–88. 10.1177/039463200902200313 [DOI] [PubMed] [Google Scholar]
- 38.Wei X, Tang C, Lu X, et al. Mir-101 targets DUSP1 to regulate the TGF-β secretion in sorafenib inhibits macrophage-induced growth of hepatocarcinoma. Oncotarget 2015;6:18389–405. 10.18632/oncotarget.4089 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Sprinzl MF, Reisinger F, Puschnik A, et al. Sorafenib perpetuates cellular anticancer effector functions by modulating the crosstalk between macrophages and natural killer cells. Hepatology 2013;57:2358–68. 10.1002/hep.26328 [DOI] [PubMed] [Google Scholar]
- 40.Farsaci B, Donahue RN, Coplin MA, et al. Immune consequences of decreasing tumor vasculature with antiangiogenic tyrosine kinase inhibitors in combination with therapeutic vaccines. Cancer Immunol Res 2014;2:1090–102. 10.1158/2326-6066.CIR-14-0076 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Patnaik A, Swanson KD, Csizmadia E, et al. Cabozantinib eradicates advanced murine prostate cancer by activating antitumor innate immunity. Cancer Discov 2017;7:750–65. 10.1158/2159-8290.CD-16-0778 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Romero AI, Chaput N, Poirier-Colame V, et al. Regulation of CD4(+)NKG2D(+) Th1 cells in patients with metastatic melanoma treated with sorafenib: role of IL-15Rα and NKG2D triggering. Cancer Res 2014;74:68–80. 10.1158/0008-5472.CAN-13-1186 [DOI] [PubMed] [Google Scholar]
- 43.Sunay MME, Foote JB, Leatherman JM, et al. Sorafenib combined with HER-2 targeted vaccination can promote effective T cell immunity in vivo. Int Immunopharmacol 2017;46:112–23. 10.1016/j.intimp.2017.02.028 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Chuang H-Y, Chang Y-F, Liu R-S, et al. Serial low doses of sorafenib enhance therapeutic efficacy of adoptive T cell therapy in a murine model by improving tumor microenvironment. PLoS One 2014;9:e109992. 10.1371/journal.pone.0109992 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Kato Y. Upregulation of memory T cell population and enhancement of Th1 response by lenvatinib potentiate anti-tumor activity of PD-1 signaling blockade: lenvatinib and PD-1 mAb combination. Cancer Res 2017;77:4614. [Google Scholar]
- 46.Chen M-L, Yan B-S, Lu W-C, et al. Sorafenib relieves cell-intrinsic and cell-extrinsic inhibitions of effector T cells in tumor microenvironment to augment antitumor immunity. Int J Cancer 2014;134:319–31. 10.1002/ijc.28362 [DOI] [PubMed] [Google Scholar]
- 47.Cao M, Xu Y, Youn J-in, et al. Kinase inhibitor sorafenib modulates immunosuppressive cell populations in a murine liver cancer model. Lab Invest 2011;91:598–608. 10.1038/labinvest.2010.205 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Cabrera R, Ararat M, Xu Y, et al. Immune modulation of effector CD4+ and regulatory T cell function by sorafenib in patients with hepatocellular carcinoma. Cancer Immunol Immunother 2013;62:737–46. 10.1007/s00262-012-1380-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Chang C-J, Yang Y-H, Chiu C-J, et al. Targeting tumor-infiltrating Ly6G+ myeloid cells improves sorafenib efficacy in mouse orthotopic hepatocellular carcinoma. Int J Cancer 2018;142:1878–89. 10.1002/ijc.31216 [DOI] [PubMed] [Google Scholar]
- 50.Heine A, Schilling J, Grünwald B, et al. The induction of human myeloid derived suppressor cells through hepatic stellate cells is dose-dependently inhibited by the tyrosine kinase inhibitors nilotinib, dasatinib and sorafenib, but not sunitinib. Cancer Immunology, Immunotherapy 2016;65:273–82. 10.1007/s00262-015-1790-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Martínez-Limón A, Joaquin M, Caballero M, et al. The p38 pathway: from biology to cancer therapy. Int J Mol Sci 2020;21:1913. 10.3390/ijms21061913 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Wen AY, Sakamoto KM, Miller LS. The role of the transcription factor CREB in immune function. J Immunol 2010;185:6413–9. 10.4049/jimmunol.1001829 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Luan B, Yoon Y-S, Le Lay J, et al. Creb pathway links PGE2 signaling with macrophage polarization. Proc Natl Acad Sci U S A 2015;112:15642–7. 10.1073/pnas.1519644112 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Stavri S, Simionescu M, Kardassis D, et al. Krüppel-Like factor 4 synergizes with CREB to increase the activity of apolipoprotein E gene promoter in macrophages. Biochem Biophys Res Commun 2015;468:66–72. 10.1016/j.bbrc.2015.10.163 [DOI] [PubMed] [Google Scholar]
- 55.Lu Y, Zhang M, Wang S, et al. P38 MAPK-inhibited dendritic cells induce superior antitumour immune responses and overcome regulatory T-cell-mediated immunosuppression. Nat Commun 2014;5:4229. 10.1038/ncomms5229 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Arora S, Balasubramaniam S, Zhang W, et al. FDA approval summary: pembrolizumab plus lenvatinib for endometrial carcinoma, a collaborative international review under project Orbis. Clin Cancer Res 2020;26:5062–7. 10.1158/1078-0432.CCR-19-3979 [DOI] [PubMed] [Google Scholar]
- 57.Hirsch L, Flippot R, Escudier B, et al. Immunomodulatory roles of VEGF pathway inhibitors in renal cell carcinoma. Drugs 2020;80:1169–81. 10.1007/s40265-020-01327-7 [DOI] [PubMed] [Google Scholar]
- 58.Ramirez-Pedraza M, Fernández M. Interplay between macrophages and angiogenesis: a double-edged sword in liver disease. Front Immunol 2019;10:2882. 10.3389/fimmu.2019.02882 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Ginhoux F, Schultze JL, Murray PJ, et al. New insights into the multidimensional concept of macrophage ontogeny, activation and function. Nat Immunol 2016;17:34–40. 10.1038/ni.3324 [DOI] [PubMed] [Google Scholar]
- 60.Wang S, Liu R, Yu Q, et al. Metabolic reprogramming of macrophages during infections and cancer. Cancer Lett 2019;452:14–22. 10.1016/j.canlet.2019.03.015 [DOI] [PubMed] [Google Scholar]
- 61.Arranz A, Doxaki C, Vergadi E, et al. Akt1 and Akt2 protein kinases differentially contribute to macrophage polarization. Proc Natl Acad Sci U S A 2012;109:9517–22. 10.1073/pnas.1119038109 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Halaby MJ, Hezaveh K, Lamorte S, et al. GCN2 drives macrophage and MDSC function and immunosuppression in the tumor microenvironment. Sci Immunol 2019;4:eaax8189. 10.1126/sciimmunol.aax8189 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
jitc-2020-001657supp001.xlsx (246.9KB, xlsx)
jitc-2020-001657supp002.pdf (2.3MB, pdf)