Abstract
Arming oncolytic adenoviruses with therapeutic transgenes is a well-established strategy for multimodal tumour attack. However, this strategy sometimes leads to unexpected attenuated viral replication and a loss of oncolytic effects, preventing these viruses from reaching the clinic. Previous work has shown that altering codon usage in viral genes can hamper viral fitness. Here, we have analysed how transgene codon usage impacts viral replication and oncolytic activity. We observe that, although transgenes with optimized codons show high expression levels at the first round of infection, they impair viral fitness and are therefore not expressed in a sustained manner. Conversely, transgenes encoded by suboptimal codons do not compromise viral replication and are thus stably expressed over time, allowing a greater oncolytic activity both in vitro and in vivo. Altogether, our work shows that fine-tuning codon usage leads to a concerted optimization of transgene expression and viral replication paving the way for the rational design of more efficacious oncolytic therapies.
INTRODUCTION
Cancer is the second leading cause of death globally, accounting for over 9 million deaths per year (https://www.who.int/health-topics/cancer). The standard of care for tumours still includes, in most cases, chemotherapies in combination with surgery and radiation. For many patients, these therapeutic strategies are associated with important side effects and, unfortunately, are not always effective. An alternative treatment, able to selectively self-amplify the therapeutic effect in the tumour while not affecting healthy tissues, represents an attractive clinical approach.
Lytic viruses replicate and expand killing the infected cells. These properties of self-amplification and cell-lysis make them, theoretically, ideal for antitumour therapies. Nevertheless, for many viruses, their replication has not evolved to target tumours, so their selectivity and efficacy need to be rationally engineered. Oncolytic virotherapy is a therapeutic approach consisting in the use of genetically modified lytic viruses, engineered to replicate in cancer cells in order to selectively kill them. Adenoviruses constitute an attractive option as oncolytic viruses, as their replication cycle is well known and they have potent lytic activity, can be produced at high titres and are easily genetically modified. In the past 20 years, multiple preclinical and clinical trials have used these viruses as therapeutic agents in the treatment of different tumours (1–6). Despite the encouraging results in terms of safety, the efficacy of adenoviral treatments still needs to be improved in order to increase the clinical usefulness of this strategy (7).
Arming oncolytic adenoviruses (OAds) with therapeutic transgenes is an attractive approach to increase their efficacy. OAds are a highly versatile therapeutic platform that allows oncoselective expression of a wide range of therapeutic molecules such as cytokines (8), extracellular matrix modulators (6,9), immune checkpoint blockades (IBCs) (10), bi-specific T-cell engagers (BiTEs) (11) or prodrug converting enzymes (12), allowing a multimodal tumour attack, from direct cell lysis to tumour microenvironment modulation. Moreover, expressing therapeutic molecules through OAds provides the unique opportunity to attain targeting tumours using therapeutic agents with unacceptable systemic toxicity profiles (13,14).
A standard strategy to maximize protein production in gene therapy is the adaptation of the transgene codon usage to match that of the host cells. Although this could be an intuitive strategy to maximize the expression of therapeutic genes in OAds, previous results have shown that adenoviral replication is tightly regulated through a balanced codon usage. In this way, viral genes avoid intergenic competition to adequately exploit translational resources for efficient replication (15). This fact appears to be particularly important at a late phase of infection, when viral genes become highly expressed using the same finite pool of available cellular resources (16).
In this work, we have assessed how this codon balance can be affected by transgene expression, thus impacting OAds' therapeutic efficacy. This has been prompted by the observation that the codon usage of late expressed therapeutic genes in OAds currently in the clinic is in fact suboptimal when compared to host codon usage. The systematic study of the codon usage of therapeutic transgenes presented in this work shows how transgene codon usage has not only significant cis effects but also trans effects on other viral proteins. We provide evidence on the importance of studying armed OAds as a holistic system rather than considering the virus and its transgenes as separate elements. We highlight the importance of developing codon usage models to reduce transgene–viral intergenic competition, thus not only maximizing transgene expression but also ensuring adequate OAd replication. In this way, concerted optimization of transgene expression and viral replication through balanced codon usage results in more efficacious viral therapies.
MATERIALS AND METHODS
Cell lines
Cell lines PANC-1 and MIA PaCa-2 (human pancreatic carcinoma), A549 (human lung carcinoma), Jurkat (T-cell leukaemia) and HEK293 (embryonic kidney) were obtained from the American Type Culture Collection (ATCC, Manasas, VA); human pancreatic adenocarcinoma cell line NP18 was established and kindly provided by Dr Gabriel Capellà (ICO-IDIBELL, Barcelona, Spain). All cell lines were maintained in Dulbecco’s modified Eagle’s medium (Gibco-BRL) supplemented with 10% foetal bovine serum, penicillin (100 μg/ml) and streptomycin (100 μg/ml) (Gibco-BRL), and maintained in a humidified atmosphere of 5% CO2 at 37°C except Jurkat cells that were maintained in RPMI-1640 medium.
Expression plasmid generation and transfection
EGFP and LGFP genes were amplified using the primers with BamHI and EcoRI restriction sites (Supplementary Table S1, primer sets 1 and 2), and amplified fragments were digested with the corresponding restriction enzymes. Digested fragments were resolved in agarose gels and purified with the QIAquick Gel Extraction Kit (Qiagen), according to the manufacturer's instructions. CH1, CH2 and CH3 genes were purchased in the form of gBlock (IDT). The corresponding fragments were inserted in miRVec expression plasmid (restricted with the same enzymes) by ligation with T4 ligase (Roche), according to the manufacturer’s instructions. All constructs were tested by Sanger DNA sequencing at Beckman Coulter Genomics. HEK 293T was transfected with CalPhos (Clontech) following the manufacturer’s instructions.
Similarly, PH20 and BWT genes were amplified and flanked with AgeI and NotI restriction sites with corresponding primers (Supplementary Table S1, primer sets 3 and 4). The amplicons were digested with AgeI and NotI enzymes, and the subsequent digested fragments were resolved by agarose electrophoresis and purified with Monarch DNA Gel Extraction Kit (New England Biolegends), according to the manufacturer’s protocol. The corresponding fragments were inserted in pGT4082 expression plasmid (restricted with the same enzymes) by ligation with T4 ligase (New England Biolegends), according to the manufacturer’s instructions.
Codon usage analysis
Codon usage frequencies were analyzed using the Sequence Manipulation Suite (17). The relative codon usage was obtained normalizing the codon usage of each codon by every synonymous codon for each amino acid. The Codon Adaptation Index (CAI) of each sequence and the percentage of codons with G or C at the third base position (GC3%) were calculated using the CAIcal server from http://ppuigbo.me/programs/CAIcal/ (18). Homo sapiens codon usage was extracted from the Codon Usage Database available at http://www.kazusa.or.jp/codon/. The human genes analysed were selected from the Tissue-specific Gene Expression And Regulation database at the Johns Hopkins University. Available transgene sequences from the virus in clinical trials were obtained from the corresponding patents: VCN-01 (EP2428229B1), NG-641 (WO2018041838A1), NG-350A (WO2018220207A1), LoAd703 (WO2015155174A1), Ad5-yCD/mutTKSR39rep-hIL12 (WO2007087462A2), ONCOS-102 (WO2010072900) and CG0070 (WO2010072900). PCA, CAI and GC3% analysis were represented using R v3.2.3 software.
Adenovirus generation and titration
Adwt and ICO15K backbones were previously generated as described in (19,20). GFP, hyaluronidase and FAP-targeting Bispecific T cell engager (FBiTE) transgenes were introduced after fibre (L5 gene) under an IIIa splicing acceptor (IIIaSA) (21) in the corresponding backbones (19,20) to generate adenoviral genomes with transgenes inserted as late units (L6). Adenoviral genomes with GFPs inserted as an early gene were generated introducing the transgenes under the control of the constitutive cytomegalovirus promoter (CMV) in the region between the E4 gene and the right ITR. In all cases, transgenes were incorporated following an adapted recombineering protocol based on homologous recombination in bacteria (22,23). Recombination fragments were obtained amplifying the transgenes with primers with the corresponding homologous sequences (Supplementary Table S1, primer sets 5 to 8). BHU transgene was purchased as a gBlock (IDT) flanked with the corresponding homologous regions. FBiTE adenoviral genome was previously generated (11). FBiTEHU transgene was synthesized (ProteoGenix) and recombination fragments were obtained by transgene amplification with listed primer sequences (Supplementary Table S1, primer set 13). Plasmids were transfected into HEK293 cells to obtain the first round of viral particles. All viruses were propagated in A549 cells and purified using cesium chloride double-gradients following standard techniques (24). Adenoviral titres were calculated based on optical density (using viral particles [vp]/ml) and on viral infectious units (IFU/ml) as previously described (15).
Viral genomes quantification
Viral DNA was obtained from the supernatants of infected cells using Norgen’s Blood DNA Isolation Mini Kit (NORGEN BIOTEK CORP.). Adenoviral DNA content was quantified by qPCR using LightCycler 480SYBER Green I Master Mix (Roche Diagnostics), (Supplementary Table S1, primer set 9). All qPCR reactions were done in a ViiA 7 Real-Time PCR System (Applied Biosystems).
cDNA synthesis and real-time qPCR
Total and viral RNA were obtained from infected cells using RNeasy Mini Kit (Qiagen), 500 ng were reverse transcribed using PrimeScript RT-PCR Kit (Takara), and the qRT-PCR analysis was performed using LightCycler 480SYBER Green I Master Mix (Roche Diagnostics; Supplementary Table S1, primer sets 10 and 11). qRT-PCR results were normalized to the beta-actin expression (Supplementary Table S1, primer set 12). qPCR reactions were done in a ViiA 7 Real-Time PCR System (Applied Biosystems).
Western blot analyses
Total protein extracts were obtained using a lysis buffer (50 mM Tris-HCl [pH 6.8], 2% SDS and 10% glycerol) containing 1% Complete Mini Protease Inhibitor (Roche). Cell lysates were boiled (10 min at 98ºC) and centrifuged (5 min at 16 000 g) to eliminate insoluble cellular debris. Protein concentration was determined by BCA Protein Assay Kit (ThermoFisher Scientific). Fifteen micrograms of protein were resolved by electrophoresis on a 10% acrylamide gel and transferred to a nitrocellulose membrane by standard methods. Membranes were incubated with Anti-Adenovirus Type 5 Capsid antibody (1:1000; Abcam) for hexon, penton, IIIa and V proteins detection and with Adenovirus Fiber [4D2] antibody (1:200; GeneTex) for fiber detection. Protein labeling was detected using HRP-conjugated antibodies and visualized in the image reader LAS4000 (Fujifilm). All protein expression data were normalized to GAPDH protein expression (Supplementary Figure S8).
For hyaluronidase quantification, supernatants from HEK293 cells were collected 5 days after transfection with pGT4082-hyaluronidase expressing plasmids. Equivolumes of respective transfections (30 μl) were resolved in a 12% acrylamide gel together with a standard curve of commercial purified recombinant His-tagged hPH20 (Acro Biosystems, PH0-H5225). The gel was transferred to nitrocellulose membrane, and overnight incubation with Anti-HisTag antibody (1:4000, Dianova) was performed. Then, a secondary antibody anti-mouse-IgG HRP (1/2000, Dako) was used to reveal and subsequent visualization of the western blot in the Chemi-doc (BioRad).
Cytotoxicity
Cells were seeded in triplicate and infected with serial dilutions of each virus. At 4 h post infection, the virus-containing medium was replaced with fresh medium. Cell viability was measured at the indicated days post-infection by a colorimetric assay, following the manufacturer’s instructions (MTT Ultrapure; USB).
Flow cytometry
Evaluation of fluorescence intensity by flow cytometry was performed using Attune Acoustic Focusing Cytometer (Applied Biosystems) and analyzed using FlowJo 8.7 for Macintosh.
Histological analysis
PANC-1 and MIA PaCa-2 tumours were fixed in a 4% paraformaldehyde solution overnight and embedded in paraffin. Standard Masson, and hematoxylin and eosin staining were performed in 5 μm sections. For hyaluronic acid staining, permeabilization and blockade were done using PBS with 0.3% triton, 10% FBS and 1% BSA. HABP (Sigma) at 5 μg/ml was incubated overnight, and the HA labelling was detected using Vectastain® ABC Kit (Vector Laboratories) and DAB (Vector Laboratories). Hematoxylin counterstaining was performed for 2 min at room temperature (RT).
Hyaluronidase activity detection—turbidimetric assay
Supernatants from infected or transfected cells were mixed with a HA (Sigma, St Louis, MO) solution in phosphate buffer (pH 6.0) and incubated for 14 h at 37°C. Standards with known concentrations of hyaluronidase were incubated in parallel to generate standard curves. Five volumes of acid albumin (24 mM sodium acetate, 79 mM acetic acid, 0.1% bovine albumin [pH 3.75]) were added to all samples and incubated for 10 min at RT. The hyaluronidase activity was measured by light absorbance at 600 nm. Absorbance values of supernatants were used to calculate hyaluronidase activity by extrapolation to the standard curves.
FBiTE binding assay
A549 cells (5 × 106) were infected at MOI of 5 IFU/cell with ICO15K-FBiTEHU or ICO15K-FBiTE. Seventy-two hours post-infection, supernatants were collected and centrifuged for 5 min at 1200 g to remove cellular debris. Supernatants from uninfected cells were used as a mock control. The binding assay was performed with CD3+ Jurkat cells. A total of 1 × 105 cells were incubated on ice for 1 h with 1 ml of the different supernatants. FBiTE binding was determined by flow cytometry using anti-FLAG M2-FITC monoclonal antibody (Sigma Aldrich). Flow cytometry analysis was performed on a Gallios cytometer (Beckman Coulter), and data were processed with FlowJo v7.6.5 (Tree Star).
Antitumoural in vivo study
Subcutaneous tumours were generated in 6- to 7-week-old male Athymic Nude Foxn1nu/nu mice (ENVIGO) by injecting 2 × 106 MIA PaCa-2 or PANC-1 cells embedded in Matrigel 1:1 (BD Biosciences) into each flank. Tumours were measured at least twice weekly, and the tumoural volumes calculated using the formula, V = D × d2 × π ÷ 6 V. Mice were randomly assigned to either group for treatment. Viruses (4 × 1010 vp/animal) were administered intravenously in physiological saline solution once tumours achieved a median volume of 100 mm3. The experiment remained blinded until the conclusion of the study. Animals were euthanized 45–48 days after virus administration, and tumours were collected and flash-freezed in liquid nitrogen. All animal procedures met the guidelines of European Community Directive 86/609/EEC and were approved by the ethical committee (CEEA-University of Barcelona) and by the local authorities of the Generalitat de Catalunya.
Statistical analysis
Statistical analysis was performed on GraphPad Prism v8.0.1 (GraphPad Software). Unless specified, statistical differences were evaluated using a two-tailed non-parametric Mann–Whitney test. The level of significance was set as P < 0.05.
The in vivo tumour growth statistical analysis was evaluated using a linear mixed-effect model with the lme4 package in R v3.2.3. We associated a random-effects term with the day of measurement (25). Statistical differences were evaluated using a multiple comparison of means by Tukey’s contrasts.
Web tool
ONATRY is a graphical user interface for analysing adenoviral transgene codon usage suitability. ONATRY represents transgenes in the context of viral genes, according to their GC content and codon usage via principal component analysis (PCA). It is implemented in R (version 3.6.3) and encapsulated in a Shiny application (https://shiny.rstudio.com/). Users can access the tool via a web interface (https://toolsr.fcrb.es/sample-apps/ONATRY/).
Our Shiny application pipeline provides two different ways to input data for analysis. First, a file in fasta format can be uploaded (through a ‘Choose FASTA file’ button). Second, there is the possibility to paste sequences in fasta format (via ‘paste FASTA’). ONATRY provides two visualization tools: a density plot and a PCA representation for exploratory analysis. The current implementation depends on the following R packages: shiny, coRdon, dplyr, rgl and progress.
RESULTS
Transgene codon usage impacts oncolytic adenoviral replication
Adenoviral genes display a fine-tuned codon usage, in which highly abundant late structural proteins present codons frequently used in the human host (optimal codons) in comparison to early regulatory proteins. However, not all structural proteins have optimal codon usage. Unlike the rest, the adenoviral fibre displays a suboptimal codon usage, which is necessary for codon balance and efficient viral replication (15). Notably, analysis of the codon usage of transgenes expressed in OAds currently in clinical trials shows that most transgenes also use suboptimal codons, as compared to the overall codon usage in human genes (i.e. they have a codon adaptation index [CAI] (26), a measure of directional synonymous codon usage bias, lower than the average human gene, Supplementary Figure S1A). This would contradict the general paradigm that recommends using optimal host codons in transgenes to maximize gene expression, and suggest that this strategy could have a negative impact for therapeutic OAd fitness.
To investigate the impact of the transgene codon usage on the oncolytic viral fitness, we selected two reporter genes: the enhanced green fluorescent protein (EGFP), a broadly used GFP codon optimized to maximize its translation in human cells, and the low codon-optimized GFP (LGFP), which mimics the CAI of the transgenes expressed by the OAds in clinical trials (Supplementary Figure S1B). Both transgenes encode the same GFP amino acid sequence, but with different codon usage (Figure 1A and Supplementary Data S1). EGFP uses mainly codons with G or C at the third base position (human optimal codons) while LGFP uses more frequently codons with A or T at the third base position (human non-optimal codons). The PCA of the relative codon usage of both EGFP and LGFP in relation to the adenoviral genes shows that EGFP gene clusters in the vicinity of the late structural and replication-related genes in the first principal component (PC1), while LGFP gene clusters with the early regulatory viral genes. (Figure 1B). PC1 discriminates viral genes according to their relative use of codons with G or C at the third base position (GC3). Positive PC1 values correlate with genes with low GC3 content (and high AT3), while negative PC1 values correlate with genes with high GC3 content (and low AT3). It has been recently reported that GC3 codons are associated with human mRNA stability and with higher translation efficiency, thereby increasing protein production (27).
Figure 1.
Viral fitness is affected by late transgenes in a codon-dependent manner. (A) Schematic model of GFP transgenes: the enhanced green fluorescent protein (EGFP, 96.7% of GC3 content) and the low codon-optimized GFP (LGFP, 44.8% of GC3 content). (B) Transgene codon usage evaluation by PCA: loadings in the left panel show codons coloured according to the third nucleotide composition and scores in the right panel show the distribution of all viral genes as well as EGFP and LGFP transgenes in the first two principal components (PC1 and PC2). Early adenovirus regulatory genes are represented in light grey with an increased usage of AT3 codons (orange and red spheres). Late structural and replication genes are represented in dark grey, with an increased usage of GC3 codons (grey and blue spheres). (C) Schematic representation of the whole adenoviral genome armed with EGFP or LGFP transgenes under the MLP control. (D) Intracellular viral genomes at 4, 8, 12 and 36 hpi in A549 cells infected with 10 IFU of Adwt-EGFP_late or Adwt-LGFP_late. Each dot represents an independent experimental replicate. (E) Fluorescence expression time course assay in A549 cells infected with Adwt-EGFP_late or Adwt-LGFP_late at 5 IFU and analysed by IncuCyte (Essen Bioscience) live cell motorization during a period of 100 h. Data are represented as the mean ± SEM of five independent experimental replicates. (F) Relative viral hexon and fibre mRNA content analysed by RT-qPCR at 36 hpi. Data are represented as the mean ± SEM; each dot corresponds to an independent experimental replicate. (G) Adenoviral late structural protein expression analysis by WB at 36 hpi. Left and central panels show representative WB. The right panel shows WB quantification. Data are represented as the mean ± SEM; each dot corresponds to an independent experimental replicate. (H) Quantification of the relative extracellular viral particles released to the supernatants of A549 cells infected with 10 IFU of Adwt-EGFP_late or Adwt-LGFP_late at 36 hpi. Data are represented as the mean ± SEM; each dot corresponds to an independent experimental replicate. (I) Proliferation assay of A549 cells infected with 5 IFU of Adwt-EGFP_late, Adwt-LGFP_late or Adwt, analysed by IncuCyte live cell motorization during a period of 100 h. Data are represented as the mean ± SEM of four experimental replicates. (J) Fluorescence analysis by flow cytometry at 48 hpi of A549 cells infected with 0.5 IFU of Adwt-EGFP_late, Adwt-LGFP_late or Adwt-GFPCH_late. (K) Relative extracellular viral particle release analysed by qPCR at 48 hpi. Data are represented as the mean ± SEM; each dot corresponds to an independent experimental replicate.*P< 0.05 (two-tailed Mann–Whitney test); n.s., non-significant differences.
To investigate the impact of codon usage in transgene expression, EGFP and LGFP were armed as late genes under the control of the major late promoter (MLP) in the wild-type adenovirus 5 (Adwt) genome, generating Adwt-EGFP_late and Adwt-LGFP_late, respectively (Figure 1C). No differences were found in the intracellular viral DNA replication at first round of infection when infecting cells at equal viral dosage (Figure 1D), while live-cell fluorescence imaging of Awt-EGFP_late and Adwt_LGFP_late revealed that EGFP transgene expression was two orders of magnitude higher in relation to LGFP, as expected considering its higher GC3 content (i.e. its optimal codon usage; Figure 1E). Next, we assessed whether the transgene codon usage had any effect on viral gene expression. Analysis of the mRNA levels of the late-phase structural hexon gene, a gene with a high percentage of GC3 codons, showed a 50% decrease in the mRNA content in cells infected with Adwt-EGFP_late in comparison with the ones infected with Adwt-LGFP_late. Interestingly, no differences in mRNA levels were found in the structural fibre gene, the only late structural gene with low GC3 content (Figure 1F). Western blot analysis of late-phase hexon, penton, IIIa, V and fibre proteins further showed that Adwt-EGFP_late infected cultures displayed lower expression of structural proteins with high GC3 content, while fiber protein levels were similar between viruses (Figure 1G). As a result of the impaired expression of many late-phase proteins, Adwt-EGFP_late infected cultures showed six times less viral release than the Adwt-LGFP late infected ones (Figure 1H). This difference in viral replication resulted in the impairment of Adwt-EGFP_late virus to control A549 cell proliferation (Figure 1I). The reported differences with Adwt-EGFP_late and Adwt-LGFP_late were not observed in parallel studies conducted with transgenes inserted as early genes Adwt-EGFP_early and Adwt-LGFP_early (Supplementary Figure S2). These results are in line with the concept of an intergenic competition for cellular resources in transgenes engineered to be expressed in the late phase of viral infection but not during the early phase, when the host resources are not yet monopolized by the virus. Altogether, these observations point out that, at the late phase of infection, transgene codon usage would not only have cis effects on its own expression but also trans effects on other viral proteins expressed.
For an effective therapeutic output, it is necessary to properly balance the viral lytic activity and therapeutic transgene expression. Therefore, we next evaluated whether tuning transgene codon usage could allow a better transgene expression without compromising viral replication. We designed three new chimeric transgenes encoding GFP (CH1, CH2 and CH3) by combining EGFP and LGFP sequences (Supplementary Figure S3A and B) to achieve intermediate codon usage optimization (Supplementary Figure S3C–F). GFP expression analysis upon transfection evidenced that the levels of fluorescence of the different transgenes were highly dependent on their GC3 content (Supplementary Figure S3F–D). CH1 transgene was selected and armed under the MLP, generating Adwt-GFPCH_late. Importantly, Adwt-GFPCH_late infected cultures presented higher transgene expression capacity than cell cultures infected with Adwt-LGFP_late (Figure 1J) without impairing viral fitness (Figure 1K). In this way, our results suggest that oncolytic activity and late transgene expression can be optimized through the balancing of codon usage.
Sustained therapeutic transgene expression depends on viral fitness
To assess the importance of balancing the lytic activity of the virus and the transgene expression in a therapeutic context, we evaluated the impact of transgene codon usage in the design of oncolytic viruses. We selected two versions of the bee (Apis mellifera) hyaluronidase, with different codon usages, as therapeutic transgenes (Supplementary Data S2). Previous oncolytic virus armed with the human hyaluronidase (PH20 gene expressed by the VCN-01 virus) showed that the expression of this enzyme allows tumour microenvironment remodeling, making tumour cells more accessible to antitumour treatments (6). Since bee hyaluronidase presents higher enzymatic activity than its human orthologue (Supplementary Figure S4), we reasoned that arming oncolytic viruses with bee hyaluronidase could enhance their antitumour activity. We selected a humanized version of the bee hyaluronidase (BHU), modified following standard codon humanization algorithms (performed by Genscript) (Supplementary Figure S5) displaying high GC3 content (Figure 2A), and the wild-type bee hyaluronidase (BWT) with a suboptimal codon usage for its expression in human cells (Supplementary Figure S5) and a GC3 content similar to that of the CH1 gene (Figure 2A). We used the viral platform ICO15K (the same one of the VCN-01 virus, currently in clinical trials) to express the Apis mellifera hyaluronidase transgenes with different codon usages (Figure 2B). ICO15K is a E1-Δ24 engineered adenovirus with four E2F and one sp-1 binding sites in the E1A promoter and the RGDK motif replacing the KKTK glycosaminoglycan binding domain in the fibre shaft (6,19).
Figure 2.
Transgene optimization to human codon usage negatively affects viral replication and oncolysis. (A) principal component analysis of the relative codon usage per amino acid of bee hyaluronidase transgenes: the left panel shows the loadings, codons characterized according to the third nucleotide composition, the right panel shows the hyaluronidase transgenes in relation to adenoviral genes. (B) Schematic representation of ICO15K-BHU and ICO15K-BWT virus, armed with codon humanized bee hyaluronidase (BHU) and codon wild-type bee hyaluronidase (BWT), respectively. (C) qPCR relative quantitation of the extracellular viral particles released to the supernatants of PANC-1 cells infected with 5 IFU of VCN-01, ICO15K-BHU or ICO15K-BWT at 72 hpi,. The dashed line represents VCN-01 values. Data are represented as the mean ± SEM; each dot corresponds to an independent experimental replicate; **P< 0.01 (two-tailed Mann–Whitney test). (D) qPCR relative quantification of viral release in the supernatants of PANC-1 cells infected with ICO15K-BHU, ICO15K-BWT or ICO15K-BAd at several rounds of infection. The dashed line represents VCN-01 values. Data are represented as mean ± SEM of four independent experiments. Differences between slopes were analysed using F-test for nonlinear models; ***P< 0.001. (E) Hexon protein analysis by Western Blot at passage 5. Upper panel: representative WB. Lower panel: WB quantification of four independent replicates. The dashed line represents VCN-01 values. (F) Turbidimetric quantification of hyaluronidase activity in the supernatants of PANC-1 cells infected with ICO15K-BHU and ICO15K-BWT at passages p0 and p5. (G) In vitro oncolytic activity assay in PANC-1 cells. Cells were infected with a dose range of ICO15K-BHU and ICO15K-BWT and their viability was measured 7 days PI by MTT assay. Viability curves are represented in the left panel as mean ± SEM of at least four independent experiments. The right panel represents IC50 values as a box plot of four independent experiments. *P< 0.05 (two-tailed Mann–Whitney test).
As expected, the virus expressing the human optimized bee hyaluronidase, ICO15K-BHU, showed a significant impairment of viral fitness, similar to the one of the Adwt-EGFP_late virus (Figure 2C and Supplementary Figure S6A). Viral replication impairment was further evidenced after several rounds of infection (Figure 2D). Indeed, after five rounds of consecutive infections, the ICO15K-BHU virus became extinct (Figure 2D and E). Consequently, BHU transgene hyaluronidase activity was not detected at passage 5, despite displaying the highest enzymatic activity at passage 0 (Figure 2F). Cytotoxicity assays carried out in pancreatic ductal adenocarcinoma (PDAC) cell models PANC-1 (Figure 2G), MIA PaCa-2 and NP18 (Supplementary Figure S6B and C) evidenced a significant decrease in the oncolytic capacity of ICO15K-BHU compared to ICO15K-BWT, in concordance with its impaired viral replication.
These effects were also confirmed when analysing an oncolytic adenovirus engineered to express another therapeutically relevant transgene. The FAP-targeting Bispecific T cell engager (FBiTE) gene has been engineered into the oncolytic adenovirus ICO15K to improve the antitumoral effects by retargeting T cells to cancer-associated fibroblasts (11). To analyse the impact of this transgene codon usage on viral replication, transgene expression and cytotoxic effects, we compared the oncolytic adenovirus ICO15K-FBiTE and a new virus armed with a codon-optimized transgene ICO15K-FBiTEHU (Supplementary Figure S7A and B). Again, we observed that the virus expressing the optimized version of the transgene showed impairment in viral replication, whereas expression of the transgene was remarkably higher 72 h post infection (Supplementary Figure S7C and D). Consequently, ICO15K-FBiTEHU cytotoxicity was reduced when compared to ICO15K-FBiTE (Supplementary Figure S7D).
Collectively, our results show that arming oncolytic adenoviruses with canonically humanized transgenes negatively impacts viral replication. However, the therapeutic activity of the virus can be rescued through a codon optimization that takes into account the effect of the transgene on virus replication.
Preserving viral lytic activity is key to maximize antitumoural efficacy
To investigate how the interplay between transgene codon optimization and viral lytic capacity impacts therapeutic efficacy, we treated athymic mice bearing subcutaneous PANC-1 and MIA PaCa-2 tumours with a collection of OAds armed with different hyaluronidases. Both pancreatic cell lines generate tumours with a high density of stroma, mimicking pancreatic tumours. In these conditions, viral spread is impaired and the antitumoural activity of OAds is limited. Therefore, arming OAds with potent hyaluronidase transgenes should boost the therapeutic activity of these viruses. However, we observed that the virus expressing the human optimized bee hyaluronidase, ICO15K-BHU, was the least efficient in reducing tumour growth, size and weight (Figure 3A–C and Supplementary Figure S8A–C). Thus, despite displaying the highest hyaluronidase activity, which led to a notable decrease of hyaluronic acid (Figure 3D and Supplementary Figure S8D), tumours treated with this virus maintained high cellularity (Figure 3E and Supplementary Figure S8E) demonstrating that prioritizing high transgene activity is insufficient for controlling tumour progression if the viral lytic activity is impaired. This is consistent with the results from our previous in vitro analyses (Figure 2). On the contrary, treatment with the virus expressing the bee hyaluronidase gene with sub-optimal codon usage, ICO15K-BWT, resulted in the highest antitumour activity (Figure 3A-C and Supplementary Figure S8A–C). When comparing the therapeutic activity of ICO15K-BWT with the VCN-01 virus, which expresses the human hyaluronidase and is currently in clinical trials, the virus with the bee hyaluronidase showed increased antitumour activity, both by efficiently remodelling the tumoural microenvironment (Figure 3D–E) and by controlling tumoural growth (Figure 3A–C). In tumours derived from a cell line with reduced viral sensitivity (i.e. MIA PaCa-2 and Supplementary Figure S6B), ICO15K-BWT treatment controlled tumour growth (similarly to VCN-01) (Supplementary Figure S8A–C) and enhanced tumoural microenvironment remodelling (Supplementary Figure S8D), although it was not capable of reducing cellularity in the remaining tumour mass (Supplementary Figure S8E). The fact that all viruses expressing Apis Mellifera hyaluronidase showed a significant decrease of hyaluronic acid, when compared to the VCN-01 virus expressing the human hyaluronidase (Figure 3D and Supplementary Figure S8D) is in line with our observations that bee hyaluronidase has a superior enzymatic activity (Supplementary Figure S3). Altogether our results reveal that preserving viral lytic activity is key to maximize the therapeutic output of the virus and highlight the importance of adequately balance viral fitness and transgene expression to optimize treatment efficacy.
Figure 3.
Balanced virus and transgene expression lead to optimal therapeutic index response. (A) In vivo tumour growth assay in mice bearing subcutaneous PANC-1 tumours. Animals were intravenously treated with saline solution or 4 × 1010 vp/animal of either VCN-01, ICO15K-BHU or ICO15K-BWT (n≥ 6 animals/group). Follow-up of tumour volumes is represented as the mean of percentage of growth ± SEM. (B) Tumour weight at end point. (C) Tumour volume at end point. (D) HA acid staining quantitation of deparaffinized tumour sections with HABP; scale bar: 100 μm. Left panels: representative images of HA staining. Right panels: HA acid quantification representing the stained area in at least 5 fields from the tumour sections of at least three different mice. (E) Tumour cellularity measured by Masson staining; scale bar: 100 μm. Left panels: representative images of HA staining. Right panels: HA acid quantification; *P< 0.05, **P< 0.01, ***P< 0.001, #P< 0.05, ##P< 0.01, $P< 0.05, $$P< 0.01, $$$P< 0.001. * represents statistical differences in relation to the saline group; # represents statistical differences in relation to saline VCN-01 group; $ represents statistical differences in relation to ICO15K-BHU group.
DISCUSSION
Oncolytic virotherapy depends on the viral capacity to successfully replicate, lyse the tumour cell and generate new viral particles by taking advantage of cellular resources. Arming oncolytic viruses with therapeutic transgenes is required to enhance the antitumour efficacy of viral therapies. Surprisingly, our analysis shows that the therapeutic genes that have been armed in OAds currently in clinical trials have a codon usage that is not optimized to maximize their expression in human cells. Considering that codon optimization is a commonly used strategy to maximize gene expression, we speculated that the bias towards non-optimized transgenes in armed OAds reaching the clinic was not random but response to a biological mechanism not yet known. With the aim to understand it, we systematically studied the impact of the codon usage of therapeutic transgenes in OAd antitumour activity. Using both reporter genes and transgenes of therapeutic interest, we found that their codon usage severely impacts viral replication and that viral replication impairment is directly correlated to the expression of the transgene. The viral–transgene competition diminishes viral replication over time thereby extinguishing the virus in as few as five replication cycles, and consequently abrogating therapeutic transgene expression. We found that preserving viral lytic activity over transgene expression is the key element to maximize the antitumour efficacy of the OAds.
Interestingly, we found that the viral–transgene competition is less important when expressing the transgenes during the early stages of viral replication (Supplementary Figure S2). This would be explained because the adenoviral early regulatory genes have an AT3-biased codon usage that may prevent the competition with GC3-rich optimized transgenes. Moreover, we speculate that differences in competition could be due to the ability of the cell to adapt to different translational demands in the early stages of infection, while during the late phases of the viral replication cycle, the cellular machinery is barely able to satisfy viral demand. In fact, we have recently shown that during the late phase of infection, cellular translational machinery is extensively and exclusively exploited by the virus, leading to a fine-tuned balance between the supply and demand of a limited pool of cellular resources (15). In the same line, the data presented in our work suggest that interfering with this fine-tuned translational equilibrium by expressing therapeutic transgenes could generate a translational imbalance with a dramatic effect on the therapeutic activity of OAds. Even if this could suggest that the expression of transgenes in the early phases of infection could be preferable, this strategy is not always possible. Transgenes encoding toxic proteins can impact viral replication or affect viral DNA synthesis (7,28). Moreover, if the transgene length is close to the viral encapsidation limit, the usage of exogenous promoters, required for early expression, will further increase the length of the construct, and further hinder viral assembly. Arming therapeutic transgenes under the control of the viral major late promoter can overcome or at least attenuate these effects. However, in that case, the intergenic competition of the virus and transgene observed in our work has to be considered. To facilitate so, we have created the web tool ONATRY (Oncolytic Adenovirus Transgene analYzer) that recapitulates two key analyses: transgene GC3 content analysis in human host context and codon usage PCA in relation to adenoviral genes. The tool is available at https://toolsr.fcrb.es/sample-apps/ONATRY/. We think that the web tool we have developed could contribute to identify incompatible transgene codon usages and thus help to improve the viral design.
Traditionally, due to the limited packaging capacity of viruses, transgene length has been considered as the main constraint when designing armed OAds. Our data prompt us to reconsider this strategy to design oncolytic viruses. In particular, it highlights the need to consider the interplay between adenoviral replication and transgene expression. This would require a paradigm change in which OAds and transgenes are no longer seen as two separate elements that can be simply combined, and instead consider them as a holistic system. Thus, apparent poor transgene expression as a result of a suboptimal codon usage can paradoxically end up maximizing transgene expression over time, due to a better viral replication combined with the inherent auto-amplification of the treatment (Figure 4). Altogether, our results suggest that oncolytic virus design should abandon the traditional dogma of enhancing transgene expression as much as possible and consider the efficacy of oncolytic therapies as the combined effect of transgene expression and viral replication, where preserving viral lytic activity is key to maximize antitumour efficacy.
Figure 4.
Transgene codon usage drives therapeutic efficacy of armed oncolytic adenoviruses. Graphical representation of transgene codon usage impact on viral fitness and oncolytic virotherapy therapeutic efficacy. This figure was created with Biorender.com.
In more general terms, our work points to the intriguing hypothesis that many oncolytic viruses may have never reached clinical trials because the deleterious effect of the expression of a codon-optimized transgene could have prevented correct viral replication. We think that by fine-tuning the codon usage of the therapeutic transgene, many of these viruses could be rescued, directly impacting the efficacy and availability of novel OAds for cancer treatment. In parallel, our results suggest that codon optimization may be a successful strategy in cases where transgene expression has to be maximized and viral replication needs to be attenuated. This could provide an attractive strategy for vaccine development. In this scenario, optimization of the transgenic antigen would result in attenuation of viral replication together with an increase in epitope expression boosting a specific antigen immune response (29).
Altogether, our findings represent a new step forward in the understanding of the interplay between transgenes and therapeutic viruses and could guide new strategies fostering the use of oncolytic adenoviruses in the clinic.
DATA AVAILABILITY
Supplementary Material
ACKNOWLEDGEMENTS
We are indebted to the Banc de Tumours-Biobank core facility of the Hospital-Clínic-IDIBAPS for technical help (work supported by the Xarxa de Bancs de Tumours de Catalunya, XBTC). We would like to thank Dr Maria Marti-Solano for her feedback during the manuscript writing process. We also thank Davide Lorenzoli for informatic support. This work was developed at the Centro Esther Koplowitz, Barcelona, Spain. CIBER de Enfermedades Raras is an initiative of the ISCIII.
Contributor Information
Estela Núñez-Manchón, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), 08036-Barcelona, Spain.
Martí Farrera-Sal, Cancer Virotherapy Group, Oncobell Program, Institut d’Investigació Biomèdica de Bellvitge—IDIBELL, 08907-L’Hospitalet de Llobregat, Spain; VCN Biosciences S.L., 08172-Sant Cugat, Spain.
Marc Otero-Mateo, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), 08036-Barcelona, Spain.
Giancarlo Castellano, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), 08036-Barcelona, Spain.
Rafael Moreno, Cancer Virotherapy Group, Oncobell Program, Institut d’Investigació Biomèdica de Bellvitge—IDIBELL, 08907-L’Hospitalet de Llobregat, Spain; Virotherapy and Immunotherapy Group, ProCURE Program, Catalan Institute of Oncology—ICO, 08907-L’Hospitalet de Llobregat, Spain.
David Medel, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), 08036-Barcelona, Spain.
Ramon Alemany, Cancer Virotherapy Group, Oncobell Program, Institut d’Investigació Biomèdica de Bellvitge—IDIBELL, 08907-L’Hospitalet de Llobregat, Spain; Virotherapy and Immunotherapy Group, ProCURE Program, Catalan Institute of Oncology—ICO, 08907-L’Hospitalet de Llobregat, Spain.
Eneko Villanueva, Cambridge Centre for Proteomics, Department of Biochemistry, University of Cambridge, Cambridge, CB2 1GA, UK.
Cristina Fillat, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), 08036-Barcelona, Spain; Centro de Investigación Biomédica en Red de Enfermedades Raras (CIBERER), 08036-Barcelona, Spain; Facultat de Medicina i Ciències de la Salut. Universitat de Barcelona (UB), 08036-Barcelona, Spain.
SUPPLEMENTARY DATA
Supplementary Data are available at NAR Cancer Online.
FUNDING
Ministerio de Economía y Competitividad [BIO2017–89754-C2–1R and 2R to C.F., R.A.]; Spanish Adenovirus Network (AdenoNet, BIO2015-68990-REDT) and the CERCA Programme/Generalitat de Catalunya. Generalitat de Catalunya [SGR17/861, 2017SGR449 (in part)].
Conflict of interest statement. None declared.
REFERENCES
- 1. Freytag S.O., Zhang Y., Siddiqui F. Preclinical toxicology of oncolytic adenovirus-mediated cytotoxic and interleukin-12 gene therapy for prostate cancer. Mol. Ther. Oncolytics. 2015; 2:15006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Kiyokawa J., Wakimoto H. Preclinical and clinical development of oncolytic adenovirus for the treatment of malignant glioma. Oncolytic Virother. 2019; 8:27–37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Kuryk L., Vassilev L., Ranki T., Hemminki A., Karioja-Kallio A., Levälampi O., Vuolanto A., Cerullo V., Pesonen S. Toxicological and bio-distribution profile of a GM-CSF-expressing, double-targeted, chimeric oncolytic adenovirus ONCOS-102: support for clinical studies on advanced cancer treatment. PLoS One. 2017; 12:e0182715. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Machiels J.-P., Salazar R., Rottey S., Duran I., Dirix L., Geboes K., Wilkinson-Blanc C., Pover G., Alvis S., Champion B. et al. A phase 1 dose escalation study of the oncolytic adenovirus enadenotucirev, administered intravenously to patients with epithelial solid tumors (EVOLVE). J. Immunother. Cancer. 2019; 7:20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Ranki T., Pesonen S., Hemminki A., Partanen K., Kairemo K., Alanko T., Lundin J., Linder N., Turkki R., Ristimäki A. et al. Phase I study with ONCOS-102 for the treatment of solid tumors—an evaluation of clinical response and exploratory analyses of immune markers. J. Immunother. Cancer. 2016; 4:17. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Rodríguez-García A., Giménez-Alejandre M., Rojas J.J., Moreno R., Bazan-Peregrino M., Cascalló M., Alemany R. Safety and efficacy of VCN-01, an oncolytic adenovirus combining fiber HSG-binding domain replacement with RGD and hyaluronidase expression. Clin. Cancer Res. 2015; 21:1406–1418. [DOI] [PubMed] [Google Scholar]
- 7. Harrington K., Freeman D.J., Kelly B., Harper J., Soria J.-C. Optimizing oncolytic virotherapy in cancer treatment. Nat. Rev. Drug Discov. 2019; 18:689–706. [DOI] [PubMed] [Google Scholar]
- 8. Cervera-Carrascon V., Siurala M., Santos J.M., Havunen R., Tähtinen S., Karell P., Sorsa S., Kanerva A., Hemminki A. TNFa and IL-2 armed adenoviruses enable complete responses by anti-PD-1 checkpoint blockade. Oncoimmunology. 2018; 7:e1412902. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Jung K.H., Choi I.-K., Lee H.-S., Yan H.H., Son M.K., Ahn H.M., Hong J., Yun C.O., Hong S.S. Oncolytic adenovirus expressing relaxin (YDC002) enhances therapeutic efficacy of gemcitabine against pancreatic cancer. Cancer Lett. 2017; 396:155–166. [DOI] [PubMed] [Google Scholar]
- 10. Huang H., Liu Y., Liao W., Cao Y., Liu Q., Guo Y., Lu Y., Xie Z. Oncolytic adenovirus programmed by synthetic gene circuit for cancer immunotherapy. Nat. Commun. 2019; 10:1–15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. de Sostoa J., Fajardo C.A., Moreno R., Ramos M.D., Farrera-Sal M., Alemany R. Targeting the tumor stroma with an oncolytic adenovirus secreting a fibroblast activation protein-targeted bispecific T-cell engager. J. Immunother. Cancer. 2019; 7:19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Freytag S., Barton K., Zhang Y. Efficacy of oncolytic adenovirus expressing suicide genes and interleukin-12 in preclinical model of prostate cancer. Gene Ther. 2013; 20:1131–1139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. de Graaf J.F., de Vor L., Fouchier RaM, van den Hoogen B.G. Armed oncolytic viruses: a kick-start for anti-tumor immunity. Cytokine Growth Factor Rev. 2018; 41:28–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Maroun J., Muñoz-Alía M., Ammayappan A., Schulze A., Peng K.-.W., Russell S. Designing and building oncolytic viruses. Future Virol. 2017; 12:193–213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Villanueva E., Martí-Solano M., Fillat C. Codon optimization of the adenoviral fiber negatively impacts structural protein expression and viral fitness. Sci. Rep. 2016; 6:27546. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Crisostomo L., Soriano A.M., Mendez M., Graves D., Pelka P. Temporal dynamics of adenovirus 5 gene expression in normal human cells. PLoS One. 2019; 14:e0211192. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Stothard P. The sequence manipulation suite: JavaScript programs for analyzing and formatting protein and DNA sequences. BioTechniques. 2000; 28:1102–1104. [DOI] [PubMed] [Google Scholar]
- 18. Puigbò P., Bravo I.G., Garcia-Vallve S. CAIcal: a combined set of tools to assess codon usage adaptation. Biol. Direct. 2008; 3:38. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Rojas J.J., Gimenez-Alejandre M., Gil-Hoyos R., Cascallo M., Alemany R. Improved systemic antitumor therapy with oncolytic adenoviruses by replacing the fiber shaft HSG-binding domain with RGD. Gene Ther. 2012; 19:453–457. [DOI] [PubMed] [Google Scholar]
- 20. Rovira-Rigau M., Raimondi G., Marín M.Á., Gironella M., Alemany R., Fillat C. Bioselection reveals miR-99b and miR-485 as enhancers of adenoviral oncolysis in pancreatic cancer. Mol. Ther. 2019; 27:230–243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Mühlemann O., Yue B.G., Petersen-Mahrt S., Akusjärvi G. A novel type of splicing enhancer regulating adenovirus pre-mRNA splicing. Mol. Cell. Biol. 2000; 20:2317–2325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Stanton R.J., McSharry B.P., Armstrong M., Tomasec P., Wilkinson G.W.G. Re-engineering adenovirus vector systems to enable high-throughput analyses of gene function. BioTechniques. 2008; 45:659–668. [DOI] [PubMed] [Google Scholar]
- 23. Puig-Saus C., Rojas L.A., Laborda E., Figueras A., Alba R., Fillat C., Alemany R. iRGD tumor-penetrating peptide-modified oncolytic adenovirus shows enhanced tumor transduction, intratumoral dissemination and antitumor efficacy. Gene Ther. 2014; 21:767–774. [DOI] [PubMed] [Google Scholar]
- 24. Graham F.L., Prevec L. Methods for construction of adenovirus vectors. Mol. Biotechnol. 1995; 3:207–220. [DOI] [PubMed] [Google Scholar]
- 25. Heitjan D.F., Manni A., Santen R.J. Statistical analysis of in vivo tumor growth experiments. Cancer Res. 1993; 53:6042–6050. [PubMed] [Google Scholar]
- 26. Sharp P.M., Li W.H. The codon adaptation index–a measure of directional synonymous codon usage bias, and its potential applications. Nucleic Acids Res. 1987; 15:1281–1295. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Hia F., Yang S.F., Shichino Y., Yoshinaga M., Murakawa Y., Vandenbon A., Fukao A., Fujiwara T., Landthaler M., Natsume T. et al. Codon bias confers stability to human mRNAs. EMBO Rep. 2019; 20:e48220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Terrível M., Gromicho C., Matos A.M. Oncolytic viruses: what to expect from its use in cancer treatment. Microbiol. Immunol. 2020; 64:477–492. [DOI] [PubMed] [Google Scholar]
- 29. Giménez-Roig J., Núñez-Manchón E., Alemany R., Villanueva E., Fillat C. Codon usage and adenovirus fitness: implications for vaccine development. Front. Microbiol. 2021; 12:633946. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.