Abstract
While many infectious diseases are controlled by vaccine strategies, important limitations continue to motivate the development of better antigen delivery systems. This study focuses on the use of a pH-sensitive polymeric carrier based on poly(propylacrylic acid) (PPAA) to address the need for more potent CD8 cytotoxic T-cell (CTL) responses. An MHC-1/CD8 CTL cell model system with ovalbumin as the protein antigen was used to test whether PPAA could enhance the delivery of ovalbumin into the MHC-1 display pathway. Ovalbumin was conjugated to poly(propylacrylic acid-co-pyridyldisulfide acrylate) (PPAA-PDSA) by disulfide exchange to make reversible conjugates that could be reduced by the glutathione redox system in the cytosol of antigen presenting cells. The PPAA-PDSA ovalbumin conjugates displayed the pH-sensitive membrane disruptive properties of the parent polymer as determined by their hemolysis activities (sharply active at the endosomal pH values of 6–6.5). The polymer-ovalbumin conjugates exhibited strong 22-fold increases in the MHC-1 presentation and ovalbumin-specific CTL activation compared to free ovalbumin. No CTL activation was observed with control conjugates of ovalbumin and poly(methylacrylic acid) (PMAA) that do not display membrane disruptive activies, suggesting it is the membrane destabilizing properties of the polymer that result in increased MHC-1 display and CTL activation. Further mechanistic studies quantitated the time course of stable intracellular localization of radiolabeled conjugates. 52% of initially internalized PPAA-conjugated ovalbumin remained in the cells after 4 hrs, compared to less than 10% of ovalbumin or PMAA-ovalbumin. These results showing enhanced cytosolic delivery and MHC-1 presentation for the PPAA-antigen conjugates suggest that they warrant future characterization as a CD8-enhancing vaccine delivery system.
Introduction
Vaccines currently play an important role in medicine, but many pathogens remain resistant to vaccine development and therapeutic vaccines against cancer have faced considerable efficacy challenges. One of the most general challenges in the vaccine field is generating a robust and efficacious CD8 cytotoxic T-lymphocyte response, even though many potentially suitable antigens against tumors and infectious agents have been identified(1–3). CD8+ cytotoxic T-lymphocytes (CTLs) are able to directly kill diseased cells and are critical to effective immunotherapy(4, 5) while CD4+ helper T-lymphocytes also play an important role in a sustained immune response(6, 7). Helper T-lymphocytes are activated upon recognition of antigens presented by major histocompatibility complex class 2 (MHC-2) proteins. This pathway is accessed by exogenous antigens that are processed and combined with MHC-2 molecules within modified endosomal compartments of the APC. CTLs are activated by recognition of antigenic peptides displayed by MHC-1 proteins that are accessed primarily via the cytoplasm, although class I cross-presentation of antigens present in vesicular compartments can occur to some degree, especially in the case of larger particulate substances taken up by phagocytosis (8–10).
Exogenous proteins enter APCs through macropinocytosis and are often degraded, sequestered, or exocytosed in the endosomal-lysosomal pathway without gaining access to the cytoplasm(11–13). Enhancing the escape of therapeutic protein antigens from the compartments in which they are endocytosed could potentially increase the efficacy of protein vaccines through increased activation of CTLs(14, 15). Several groups have explored the use of pH-sensitive polymer-based delivery systems that take advantage of the decreased pH in the endosome. Carrier particles containing acid-degradable linkages, such as acetal(14–16), hydrozone(17, 18), or ketal(19) bonds have been developed to degrade more rapidly in the acidic endosomal environment to trigger release of their cargo. Block ionmer complexes have been developed that increase in positive charge at endosomal pH, which could potentially result in endosomal membrane interaction(20). A popular approach has utilized cationic polymer systems, which enhance endosomal release via the “proton sponge effect”(21–25). Additionally, particles formed from poly(D,L-lactic-co-glycolic acid) (PLGA) have been widely investigated for antigen delivery and have resulted in increasing MHC1 presentation of encapsulated antigens(26–28). While some endosomal escape is observed for this system(27), a mechanism for cytosolic delivery is not well established.
Our group has developed synthetic polymers based on alkyl(acrylic acid) monomers that display pH-sensitive, membrane destabilizing activities (29–36). In the ionized state the polymers are inactive at membrane destabilization, but at the decreased pH levels typical of the endosome (pH 5.5–6.5) the carboxyl groups become protonated and the polymers transition to a state that is membrane destabilizing. This mechanism mimics the pH-dependent membrane disruptive activity of pathogenic proteins such as hemaglutinin (37, 38) and diphtheria toxin(39, 40), and of synthetic fusogenic peptides such as GALA (41). The mechanistic utility of pathogenic proteins has demonstrated the importance of endosomal release in MHC1 presentation and CTL activation(42–46), but corresponding biological responses to the pathogenic proteins has limited their clinical translation.
Here we report the characterization of a pH-responsive, membrane-destabilizing polymeric carrier for cytosolic protein antigen delivery in a model MHC-1 presentation system. This model utilizes CD8+ T-cells that is activated upon T-cell receptor ligation to an MHC-1/ovalbumin peptide complex displayed from a model RAW macrophage cell(14, 47). The poly (propylacrylic acid-co-pyridyldisulfide acrylate) (PPAA-PDSA) polymer was designed to conjugate ovalbumin by disulfide exchange between thiolated protein and the PDSA monomers. The resulting protein-polymer disulfide bond can be reduced by the cytosolic glutathione reduction system to leave the free antigen for subsequent proteolytic processing. Results showing a strong enhancement of CTL activation suggest that the intracellular pharmacokinetic step of vesicular release is a limiting barrier to subsequent protein processing and MHC-1 presentation.
Materials and Methods
Polymer Synthesis
All chemicals and reagents were ACS grade purchased from Sigma-Aldrich, St. Louis, MO, and used without further purification unless otherwise noted. For the synthesis of the PPAA-PDSA polymer, 0.007 mol propylacrylic acid (PAA) (Gateway Chemical Technology, St. Louis, MO), 0.00011 mol PDSA(33), and 0.000056 mol free-radical initiator azobisisobutyronitrile (AIBN, purified by recrystallization from methanol) were combined in a 5ml flask and degassed by 4 rounds of freeze-vacuum-thaw then reacted at 60°C for 24 hours. The polymer was dissolved in 3 ml dimethyl formamide (DMF) and purified by 3 rounds of precipitation in 500 ml diethyl ether. Poly(methacrylic acid-co-PDSA) (PMAA-PDSA) was synthesized for use as a control polymer. It was formed by reversible addition fragmentation chain transfer polymerization (RAFT) by combining 0.016 mol methacrylic acid (MAA) (purified by distillation), 0.00022 mol PDSA, 0.000052 mol chain transfer agent 4-cyanopentanoic acid dithiobenzoate (CTP)(48), 0.000052 mol initiator 2,2′-Azobis (2,4-dimethyl valeronitrile) (V-65, Wako Chemicals USA, Richmond VA) and 3 ml DMF in a 5 ml round bottom flask. The reaction was degassed by purging with N2 for 20 min then polymerized at 40°C for 24 hours. 6 ml DMF was added and the polymer was purified by 3 rounds of precipitation in 1 L diethyl ether.
Polymer compositions were determined by H1-NMR using a Bruker AVance 300MHz instrument and deuterated dimethyl sulfoxide (DMSO-d6, Fisher Chemical, Pittsburgh, PA). The characteristic 1H-NMR (DMSO-d6) polymer peaks were: 4.0 ppm (2H, O-CH2-R, PDSA), 7.2 ppm (1H, aromatic, PDSA), 7.8 ppm (2H, aromatic, PDSA), 8.5 ppm (1H, aromatic, PDSA), 12.1 ppm (1H, -COOH, PAAc/MAAc). PDSA content was determined both by NMR and by the absorbance at 343 nm of pyridine-2-thione released from the polymer following reduction with excess of dithiothreitol (DTT). The polymer molecular weights were determined by GPC using a Viscotek VE2001 sample module and VE3580 refractive index detector (Viscotek, Houston, TX), and Tosoh TSK-GEL α-3000 and α-4000 columns (Tosoh Biosciences, Montgomeryville, PA). Polymer molecular weights were determined based on poly(methacrylic acid) (PMMA) standards using HPLC-grade DMF with 0.1% lithium bromide as the mobile phase. The pKa of the PPAA-PDSA was determined by acid/base titration of 50 mg polymer in distilled, deionized water, starting at pH 12.5 and titrating with 0.1 N HCl.
Polymer-Protein Conjugation and Characterization
Conjugation was performed via disulfide exchange between the PDSA component of the polymer and free thiols introduced onto ovalbumin by reaction with Traut’s reagent (2-iminothiolane, Pierce Biotechnology, Rockford, IL). 10 mg ovalbumin was mixed with a 10x molar excess of Traut’s reagent in conjugation buffer (0.1M phosphate buffer, pH 7.8, 0.15M NaCl, 5mM EDTA) for 1 hour at room temperature. The reaction mixture was purified using a PD-10 desalting column containing Sephadex G-25 (MWCO 5kD, GE Healthcare, Piscataway, NJ) and the degree of modification was estimated by Ellman’s assay (Pierce Biotechnology, Rockford, IL). A 2.5x molar excess of polymer, either PPAA-PDSA or PMAA-PDSA, was immediately added to the modified protein and allowed to react 2 hours at room temperature in conjugation buffer. The degree of conjugation was estimated by measuring the absorbance at 343nm (A343) of the pyridine-2-thione group released from PDSA upon disulfide exchange, and the conjugate was purified on a PD-10 column and lyophilized for storage.
Radioactively labeled PPAA-PDSA and PMAA-PDSA - ovalbumin conjugates were formed for use in the cellular uptake and exocytosis experiments. The procedure was identical to that listed above, with the following exceptions. Ovalbumin was mixed with a 20-fold molar excess of Traut’s reagent. A 3x molar excess of 14C-iodoacetamide (MP Biomedical, Solon, OH), was then added to react with some of the introduced thiol groups. After reacting for 1 hour, the 2.5X molar excess of polymer was added to form the conjugate.
The molecular weight distribution was determined by GPC (Viscotek VE2001 sample module, VE3580 RI Detector, Waters Corp. ultrahydrogel columns) in 0.1 M sodium phosphate buffer, pH 8 using poly(ethylene oxide) (PEO) standards (Polysciences, Inc., Warrington, PA). The final weight percent of ovalbumin in the conjugates was determined by the BCA protein assay (Pierce Biotechnology, Rockford, IL), using an ovalbumin standard curve. SDS-PAGE (polyacrylamide gel electrophoresis) was performed to detect any unreacted ovalbumin in the conjugate solution. Precast Tris-HCl polyacrylamide gels, 4–20% gradient, sample and running buffer, and protein standards were purchased from Bio-Rad, Hercules, CA. Based on the results of the BCA assay, conjugates were loaded onto the gels in the appropriate amounts to give 10ug of ovalbumin per lane. Gels were run for 45 min at 100mA, then visualized using Coomassie staining (Bio-Rad, Hercules, CA).
Red Blood Cell Hemolysis
The pH-dependent membrane-disruptive ability of the polymers and polymer-protein conjugates was estimated using a red blood cell hemolysis assay, described previously(29). Briefly, red blood cells were isolated and added to polymer and conjugate solutions (normalized to equivalent polymer amounts) of varying concentrations in 0.1M phosphate buffer at pH values of 5.8, 6.6, and 7.4. The degree of RBC membrane disruption (% hemolysis) was quantified by measuring the absorbance at 541 nm of the hemoglobin released into the solution by lysed cells, in comparison with complete lysis by Triton X-100 detergent. Sample concentrations were all normalized to contain 5μg/ml of polymer, and samples were performed in triplicate with error reported as +/− one standard deviation.
MHC- I Antigen Presentation and CTL Activation Assay
The ability of the polymer to increase cytoplasmic delivery and subsequent MHC class I antigen presentation was evaluated using the lacZ antigen presentation assay(14, 47). This assay utilizes a specialized LacZ B3Z CTL hybridoma. These CTLs produce β-galactosidase upon recognition of the ovalbumin class I antigenic epitope SIINFEKL complexed with the MHC class I molecule H-2Kb, present on RAW 309.1 CR macrophages. Therefore, a measure of β-galactosidase activity can be used to determine the degree to which delivered ovalbumin is presented as a class I antigen. All tissue culture reagents were purchased from Invitrogen Corp, Carlsbad, CA, unless otherwise noted. RAW 309.1 CR macrophages (ATCC, Manassas, VA) were cultured in 90% DMEM with D-Glucose and L-glutamine, 10% fetal bovine serum (FBS), supplemented with 100U/ml penicillin/100μg/ml streptomycin. B3Z CTLs were a gift from Dr. Nilabh Shastri, UC Berkeley. They were cultured in 90% RPMI medium with D-Glucose and L-glutamine, 10% FBS, supplemented with 100U/ml penicillin/100μg/ml streptomycin, 50μM 2-mercaptoethanol (Sigma-Aldrich, St. Louis, MO), and 1mM sodium pyruvate. For the assay, RAW cells were plated at 5 × 104 cells per well in a 96-well plate and grown overnight. PPAA-ovalbumin conjugates and control samples were added to the cells and incubated 6 hrs in DMEM with 5% FBS. Three sample concentrations were tested: 50μg/ml, 100μg/ml, and 150μg/ml (samples were normalized to represent equivalent ovalbumin concentrations). RAW cells were rinsed with DMEM, then 1 × 105 B3Z cells per well were added and incubated 16 hrs. Cells were rinsed with phosphate buffered saline then 100μl lysis buffer [100 μM mercaptoethanol (Sigma-Aldrich, St. Louis, MO), 9 mM MgCl2 (Sigma-Aldrich, St. Louis, MO), and 0.15 mM chlorophenol red β-D- galactoside (EMD Biosciences, San Diego, CA) in PBS] was added. After 4 hrs the absorbance of released chlorophenol red was measured at 595 nm. All samples were evaluated in triplicate and errors are reported as +/− one standard deviation. Maximum possible β-galactosidase production was determined by chemically stimulating the B3Z cells in media containing 3.15 μM ionomycin (Sigma-Aldrich, St. Louis, MO) and 10ng/ml phorbol 12-myristate 13-acetate (Sigma-Aldrich, St. Louis, MO) for 4 hours before rinsing and adding the lysis buffer.
Cellular Uptake and Exocytosis of 14C-Ovalbumin and Ovalbumin-Polymer Conjugates
The cellular uptake and exocytosis of 14C-labeled ovalbumin and the PPAA and PMAA ovalbumin conjugates was studied in RAW 309.1 CR macrophages, using a procedure similar to that described by Besterman et al(49). For measurement of the cellular accumulation of 14C ovalbumin over time, RAW macrophages were plated in a 48-well plate at 75,000 cells/well and allowed to grow overnight. Either ovalbumin, PPAA-ovalbumin conjugate, PMAA-ovalbumin conjugate, or a PPAA and ovalbumin physical mixture was added to the cells at a concentration of 50μg/ml of ovalbumin. Samples were incubated for either 15 min, 30 min, 1 hr, or 2 hrs. The cells were then washed 2X with PBS and lysed using 1% Triton X-100 in water. Radioactivity in the cell media, PBS wash, and cell lysate was measured using a Beckman-Coulter LS 6500 liquid scintillation counter. EcoScint scintillation fluid was obtained from National Diagnostics, Atlanta, GA. Uptake of 14C-ovalbumin is presented as the % radioactivity present in the cell lysate compared to the total radioactivity delivered. The experiment was performed with a minimum of n=3.
To measure the exocytosis of 14C-ovalbumin, RAW macrophages were again plated at 75,000 cells/well in a 48-well plate and allowed to grow overnight. Either ovalbumin, PPAA-ovalbumin conjugate, PMAA-ovalbumin conjugate, or a PPAA and ovalbumin physical mixture was added to the cells at a concentration of 50μg/ml of ovalbumin. Samples were incubated for either 1 min or 15 min, then uninternalized conjugate was removed and cells were washed 2X with media. Fresh media was added to the cells at the following timpoints: 5 min, 10 min, 20 min, 30 min, 1 hr, 2 hr, and 4 hr. The reappearance of 14C-ovalbumin into the supernatant was measured at each timepoint. After 4 hrs, cells were lysed with 1% Triton X-100 and the radioactivity in the lysate was measured. The amount of ovalbumin internalized after the 1 min or 15 min incubation time was determined as a percentage of the total delivered. The amount of ovalbumin exocytosed at each timepoint, as well as the amount remaining in the cells after 4 hrs, was then determined as a percentage of the total internalized. The experiments were performed with a minimum of n=3.
In vitro Cytotoxicity of Polymers and Conjugates
The cytotoxicity of the PPAA and PMAA polymers and conjugates was determined for both the RAW and B3Z cell lines used in the MHC-1 presentation assay. Cytotoxicity was evaluated using the LDH (lactate dehydrogenase) assay (Roche Applied Sciences, Indianapolis, IN). This assay allows colorimetric measurement of LDH activity in the supernatant, which correlates to the proportion of dead or damaged cells. Cells were plated at 5×104 cells/well in their normal culture media and polymer and conjugate samples were added to concentrations up to 300 μg/ml then incubated for 24 hrs. Cells were centrifuged at 250 g for 10 min, then 100 μl supernatant was removed and combined with 100 μl LDH reagent. The absorbance at 490 nm (reference 650 nm) was recorded every 5 min for 30 min and cell survival was determined by comparing to untreated cells and cells lysed with 1% Triton X-100 in water. Each sample was evaluated in triplicate and errors are reported as the standard error of the mean (SEM.)
Statistical Anaylsis
Statistical testing was performed on all data using analysis of variance (ANOVA). The least significant difference (LSD) method was subsequently used for comparison of specific groups in the ANOVA analysis.
Results and Discussion
Synthesis and Characterization of Polymers and Conjugates
The conjugation scheme for attaching ovalbumin to PPAA-PDSA is shown in Figure 1. The conjugates are formed through disulfide exchange of the ovalbumin thiol with the PDSA group in the polymer, and are designed to be reduced by glutathione in the cell cytoplasm, freeing the protein for processing and MHC-1 presentation. The membrane-disruptive PPAA-PDSA polymer was synthesized by free radical polymerization and resulted in a polymer with 3 mol % PDSA and Mw=26 kD, Mn=10 kD, and PDI=2.6, based on GPC analysis using PMMA standards. The pKa of this polymer was determined by acid/base titration to be 6.8, which is in the range of the early endosome. A non membrane-disruptive polymer, PMAA-PDSA, of similar size (Mw=34 kD, Mn=12 kD, PDI=2.8) containing 2 mol % PDSA was synthesized as a control. Methacrylic acid is less hydrophobic than propylacrylic acid in the protonated form and does not cause any membrane disruption in the RBC hemolysis assay.
Figure 1.
Schematic of chemistry for conjugation of ovalbumin to the PDSA moiety of the PPAA-PDSA polymer. The protein is first modified using Traut’s reagent to convert primary amines to thiols, then the polymer is added and a disulfide exchange reaction occurs, releasing pyridine-2-thione. Reaction progress can be monitored by measuring A343 of released pyridine-2-thione. PPAA and PMAA conjugates consisting of 1.7 μg polymer per μg ovalbumin were formed.
The degree of thiolation of the ovalbumin used to form the polymer-ovalbumin conjugates was determined by Ellman’s assay to be 15% of the total available lysines. The ovalbumin conjugates formed from both the PPAA-PDSA and PMAA-PDSA polymers were found by BCA assay to contain 37 weight% ovalbumin and 63 weight% polymer, or 1.7 μg polymer per μg protein, and GPC analysis gave Mw=200 kD, Mn=45 kD, PDI=4.4 for the PPAA-PDSA-ovalbumin conjugate and Mw=130 kD, Mn=57 kD, PDI=2.3 for the PMAA-PDSA-ovalbumin conjugate. The 14C-lableled conjugates used for the cellular internalization studies were of similar sizes: Mw=140 kD, Mn=40 kD, PDI=3.5 for the PPAA conjugate and Mw=120 kD, Mn=50 kD, PDI=2.4 for the PMAA conjugate. The degree of thiolation of the ovalbumin used to form these conjugates was determined by Ellman’s assay to be 30%. The radiolabeled PPAA and PMAA conjugates were found to be 34 and 40 wt.% ovalbumin, or 1.9 μg polymer per μg protein and 1.5 μg polymer per μg protein, respectively. SDS-PAGE was performed to assure that free protein did not remain in the conjugate mixtures, as it could interfere with interpretation of the MHC-1 presentation assay results.
Red Blood Cell Hemolysis
Red blood cell hemolysis assays were performed to evaluate the pH-dependent membrane disruptive activity of the polymers and polymer-protein conjugates (50). Hemolysis assays were conducted at three pH values (7.4, 6.6, and 5.8) in order to approximate physiological conditions and the conditions found in early and late endosomes. Conjugate concentrations were adjusted to contain 5μg/ml of polymer. The results of this assay are detailed in Figure 2. As expected, the PPAA-PDSA polymer and conjugates were considerably more hemolytic at the lower pH characteristic of the endosome (pH 5.8). The PPAA-PDSA polymer shows slightly higher hemolyis at physiological pH than does a PPAA homopolymer of the same size, which consistently gives less than 10% hemolysis. This increased hemolyis at pH 7.4 is likely due to the hydrophobicity added by the PDSA monomer, especially the pyridyl group, which is removed upon conjugation. The increased hemolysis at pH 7.4 has not resulted in increased cytotoxicity at the concentrations and incubation times used. The PPAA ovalbumin conjugates have similar hemolysis profiles to the PPAA-PDSA polymer alone, indicating that the polymer retains its hemolytic activity when attached to the 40 kD ovalbumin protein.
Figure 2.
pH-dependent hemolysis properties of PPAA polymers and ovalbumin conjugates. Red blood cells were isolated and added to polymer and conjugate solutions (polymer concentrations = 5μg/ml) in 0.1M phosphate buffer at pH values of 7.4 (□), 6.6 (x), and 5.8 (■). Hemolysis is reported as a percentage of complete lysis by Triton X-100. PPAA-PDSA shows high membrane-disruptive activity at pH 5.8 but considerably lower membrane disruption at pH 7.4. The polymer retains its hemolysis capabilities after conjugation to the hydrophilic protein ovalbumin. PMAA-PDSA, however, does not lyse red blood cells at any pH due to the decreased hydrophobicity of its methyl side chain compared with the propyl side chain of PPAA.
MHC-I Antigen Presentation and CTL Activation Assay
The ability of the polymer to enhance delivery of protein antigen into the MHC class I pathway was evaluated using the LacZ class I presentation assay (14, 47). The PPAA-PDSA-ovalbumin conjugate resulted in a strong 22-fold increase in MHC-I presentation and CTL activation compared to free ovalbumin (p=0.0001), as shown in Figure 3. The ovalbumin must be chemically attached to the PPAA in order to be effectively delivered into the MHC-1 pathway, as physical mixtures showed only background CTL activation levels (p=0.20 compared to free ovalbumin). The PMAA-ovalbumin conjugates did not significantly enhance CTL activation over delivery of free ovalbumin (p=0.72.) These results correlate the membrane destabilizing activity of the polymer to the level of MHC-1 pathway and CTL activation, and suggest that the increase in presentation is not solely the result of increased cellular uptake due to the larger size of the conjugate compared to free ovalbumin. Furthermore, PPAA conjugation increases the CTL activation in a dose-dependent manner, whereas higher concentrations of control samples do not result in significant increases in CTL activation (p<0.2) (Figure 3b). Increasing the amount of PPAA in the conjugate further exaggerates this effect: when the weight ratio of polymer:protein is doubled from 1.7 to 3.2 μg polymer per μg protein, CTL activation increases, becoming maximized at a lower ovalbumin concentration. While direct comparisons to other similar antigen delivery systems are not possible due to the different carrier architectures (soluble vs. particulate) and differences in experimental conditions and data presentation, the PPAA conjugates perform similarly to those reported previously with the B3Z CTL activation assay. Acid-degradable particles used to deliver ovalbumin have resulted in maximal A595 values (the measure of CTL activation) in the range of 0.25–0.4(14, 16), which is similar to that reported in our study, and PLGA particles have been shown to provide a 5-fold increase in CTL activation over delivery of ovalbumin alone(26).
Figure 3.
CTL activation/MHC-I presentation of PPAA-ovalbumin conjugates. Samples were incubated with RAW macrophages for 6 hrs then removed and B3Z T-cells were added for 16 hrs. Cells were rinsed and incubated 4 hrs with lysis buffer containing chlorophenol red β-D- galactoside, then absorbance of released chlorophenol red was measured at 595 nm. Samples were evaluated in triplicate and errors are reported as +/− one standard deviation. For reference, the maximum possible β-galactosidase production was determined by chemically stimulating the B3Z cells using PMA/ionomycin for 4 hrs, which gave an A595 of 0.56. a.) Ovalbumin oncentration=100μg/ml. The PPAA-ovalbumin conjugate shows significantly greater CTL activation than do any of the control samples (p<0.0005). This is likely due to the endosomal disruption provided by PPAA, which allows the protein to more efficiently access the MHC-I pathway in the cytoplasm. However, PMAA conjugation results in low CTL activation, similar to that for free ovalbumin or a PPAA ovalbumin physical mixture (p=0.2). This suggests that the increase in MHC-1 presentation provided by PPAA is due to its endosomal disruptive properties rather than solely to increased uptake due to its larger size compared to free ovalbumin. b) The PPAA-ovalbumin conjugates enhance CTL stimulation is a dose-dependent manner. When the polymer ratio is increased from 1.7 ug/ug ova to 3.2 ug/ug ova, maximal CTL activation is reached at a lower ovalbumin concentration.
Cellular Uptake and Exocytosis of 14C-Ovalbumin and Ovalbumin-Polymer Conjugates
In order to further explore the mechanism of PPAA action, the cellular uptake and internalization of radiolabled ovalbumin was studied in RAW macrophages. It was found that the major effect of PPAA was to reduce the amount of ovalbumin recycled back out of the cell after initial internalization. The samples were incubated with RAW macrophages for 1 minute, and fresh media was applied after washing of the cells at regular time intervals from 5 min to 4 hrs. The amount of radioactivity that reappeared in the supernatant at each time interval was measured, as well as the radioactivity remaining in the cells. This method is similar to methods previously employed for the study of exocytosis of radiolabeled sucrose in guinea pig alveolar macrophages(49), hapten-protein conjugates in murine macrophages(51), and PLGA nanoparticles in vascular smooth muscle cells(52). The initial amount of 14C-ovalbumin taken up by the cells was statistically similar for all the sample groups (p=0.66), and was approximately 0.8% of the total amount delivered (Figure 4a, left panel). However, less PPAA-conjugated ovalbumin was exocytosed compared to the control groups, which is detailed in the exocytosis profiles shown in Figure 4a, right panel. This resulted in the greater and more stable accumulation of the PPAA-ovalbumin inside the cells, even after 4 hours of exocytosis. 52% of the internalized PPAA-ovalbumin was found inside the cells at four hours, whereas less than 10% of the ovalbumin remained for the free ovalbumin, the physical mixture, and the non membrane-active PMAA conjugate.
Figure 4.
Exocytosis of 14C-ovalbumin after a) 1 min uptake time and b) 15min uptake time. Samples were incubated with RAW macrophages and un-internalized conjugate was removed. Fresh media was added to the cells at various time intervals and the reappearance of 14C-ovalbumin into the supernatant was measured. After 4 hrs, cells were lysed with 1% Triton X-100 and the radioactivity in the lysate was measured. Samples were evaluated with a minimum of n=3. The amount of ovalbumin initially internalized was determined as a percentage of the total delivered (left-side panels). It can be seen that the amount of ovalbumin taken into the cells in 1 min is similar for all samples (p=0.66) giving a uniform starting point for the exocytosis measurements. However, the preferential accumulation of PPAA-ovalbumin is already noticeable at the 15-min uptake time. The amount of ovalbumin exocytosed at each timepoint was then calculated as a percentage of the amount initially internalized (right-side panels). Most exocytosis occured in the first 30 minutes, and exocytosis rates were similar for all samples. However, the amount of ovalbumin that remained in the cells and was not exocytosed was greatly enhanced for PPAA conjugates. This effect is likely due to the ability of the polymer to disrupt the endosomal membrane and deliver the ovalbumin to the cytosol before exocytosis can occur.
Similar exocytosis trends are found when the initial incubation was extended to 15 min (Figure 4b). At this uptake time, the amount of PPAA-conjugated ovalbumin initially inside the cell was already considerably greater than the control groups (left panel). When normalized to the initial amount taken up, the exocytosis profiles were similar to those for the 1 min uptake (right panel). Furthermore, between 15 min and 2 hrs, the amount of intracellular PPAA-ovalbumin increased from 0.75% of the total amount delivered to 4.8%, whereas the control groups remain within experimental error of the initial values (p>0.09) (Figure 5). These results support the hypothesis that PPAA-ovalbumin accumulates in the cell as a result of endosomal escape to the cytosol with an accompanying decrease in exocytosis. It can be noted that for all samples, reappearance of the radiolabled ovalbumin in the supernatant was observed as early as 5 min after the cells were washed, and the majority of exocytosis occured in the first 30 min, a timescale which is in accordance with previous exocytosis studies(49, 51, 52).
Figure 5.
Uptake of 14C-Ovalbumin-PPAA increases over time. RAW macrophages were incubated with samples at a concentration of 50μg/ml of ovalbumin. The cells were then washed with PBS and lysed using 1% Triton X-100. Radioactivity in the cell media, PBS wash, and cell lysate was measured, and uptake of 14C-ovalbumin was calculated as the % radioactivity present in the cell lysate compared to the total radioactivity delivered. Experiments were performed in triplicate and error is expressed as +/− one standard deviation. It can be seen that PPAA-conjugated ovalbumin continually accumulates significantly in the cell, whereas the control sample levels remain fairly constant (p>0.09). This is likely due to the ability of PPAA-ovalbumin to escape the endosome before being exocytosed.
In vitro Cytotoxicity of Polymers and Polymer-Ovalbumin Conjugates
The cytotoxicity of the PPAA-PDSA and PMAA-PDSA polymers and conjugates was tested in both the RAW macrophages and B3Z T-cells. Concentrations up to 300 μg/ml, twice the concentration used in the MHC-I presentation assay, were tested using the LDH assay. Cell survival was calculated by comparing the polymer-treated cells with untreated cells and with cells lysed with 1% Triton X-100. It can be seen in Figure 6 that none of the PPAA-PDSA or PMAA-PDSA polymers or their ovablumin conjugates induce toxicity in either cell type at this concentration.
Figure 6.
Cytotoxicity of PPAA and PMAA polymers and conjugates. Cytotoxicity was determined for both RAW and B3Z cells using the LDH assay. Samples were added to cells for 24 hrs at a concentration of 300 μg/ml polymer, twice the highest concentration used in the MHC-1 presentation assay. The cell supernatant was then combined with LDH reagent and the absorbance at 490 nm was recorded. Percent survival = 1−[(A490 of sample − A490 of untreated cells control)/(A490 of TritonX control − A490 of untreated cells control)] × 100%. Samples were evaluated in triplicate and error is expressed as +/− SEM. It can be seen that excessive toxicity was not observed for any of the samples.
Conclusions
In this study, a pH-sensitive, membrane-disruptive polymer, poly(propylacrylic acid) (PPAA), was synthesized and used to enhance the cytoplasmic delivery and MHC-I presentation of a model protein antigen, ovalbumin. The protein was derivatized to have a thiol group, which was reacted with the pendant PDSA disulfide bond on the polymer to yield a polymer-protein conjugate linked by a disulfide bond. This polymer-S-S-protein linkage was designed to allow release of the protein by glutathione reduction in the cytoplasm. The polymer exhibited low toxicity in vitro and retained its membrane-disruptive capabilities after attachment to the hydrophilic protein, as indicated by a red blood cell hemolysis assay. Conjugation to the PPAA polymer was shown to result in increased intracellular accumulation and decreased exocytosis of ovalbumin, which corresponded to significantly enhanced MHC-I presentation of ovalbumin and subsequent CTL activation. This effect is attributed to destabilization of the endosomal membrane by PPAA in the low pH environment of the endosome, and is in accordance with previous studies investigating the destabilizing action of PPAA(32, 33, 53). This system shows promise for protein vaccine strategies against cancer and viruses, and is also applicable to any technique requiring improved delivery of a protein cargo to the cytoplasm of a cell.
Acknowledgments
This project was supported by funding from the National Institutes of Health (grant R01EB2991-01) and the Whitaker Foundation. We also thank Nilabh Shastri (UC Berkeley) for the B3Z hybridoma cells, which were essential to this study.
References
- 1.Moingeon P. Cancer vaccines. Vaccine. 2001;19:1305–1326. doi: 10.1016/s0264-410x(00)00372-8. [DOI] [PubMed] [Google Scholar]
- 2.Scanlan MJ, Simpson AJ, Old LJ. The cancer/testis genes: Review, standardization, and commentary. Cancer Immunity. 2004;4:1–15. [PubMed] [Google Scholar]
- 3.Folgori A, Capone S, Ruggeri L, Meola A, Sporeno E, Ercole BB, Pezzanera M, Tafi R, Arcuri M, Fattori E, Lahm A, Luzzago A, Vitelli A, Colloca S, Cortese R, Nicosia A. A T-cell HCV vaccine eliciting effective immunity against heterologous virus challenge in chimpanzees. 2006;12:190–197. doi: 10.1038/nm1353. [DOI] [PubMed] [Google Scholar]
- 4.Boon T, Cerottini JC, Eynde BV, Bruggen P, Pel AV. Tumor antigens recognized by T lymphocytes. Annual Review of Immunology. 1994;12:337–365. doi: 10.1146/annurev.iy.12.040194.002005. [DOI] [PubMed] [Google Scholar]
- 5.Engers H, Lahaye T, Sorenson G, Glasebrook A, Horvath C, Brunner K. Functional activity in vivo of effector T cell populations. II. Anti- tumor activity exhibited by syngeneic anti-MoMULV-specific cytolytic T cell clones. J Immunol. 1984;133:1664–1670. [PubMed] [Google Scholar]
- 6.Knutson KL, Disis ML. Tumor antigen-specific T helper cells in cancer immunity and immunotherapy. Cancer Immunology Immunotherapy. 2006;54:721–728. doi: 10.1007/s00262-004-0653-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Gao FG, Khammanivong V, Liu WJ, Leggatt GR, Frazer IH, Fernando GJP. Antigen-specific CD4+ T-cell help is required to activate a memory CD8+ T cell to a fully functional tumor killer cell. Cancer Res. 2002;62:6438–6441. [PubMed] [Google Scholar]
- 8.Tacken PJ, Torensma R, Figdor CG. Targeting antigens to dendritic cells in vivo. Immunobiology. 2006;211:599–608. doi: 10.1016/j.imbio.2006.05.021. [DOI] [PubMed] [Google Scholar]
- 9.Guermonprez P, Valladeau J, Zitvogel L, Thery C, Amigorena S. Antigen presentation and T cell stimulation by dendritic cells. Annual Review of Immunology. 2002;20:621–667. doi: 10.1146/annurev.immunol.20.100301.064828. [DOI] [PubMed] [Google Scholar]
- 10.Rock KL, Shen L. Cross-presentation: underlying mechanisms and role in immune surveillance. Immunological Reviews. 2005;207:166–183. doi: 10.1111/j.0105-2896.2005.00301.x. [DOI] [PubMed] [Google Scholar]
- 11.Moore MW, Carbone FR, Bevan MJ. Introduction of soluble protein into the class I pathway of antigen processing and presentation. Cell. 1988;54:777–785. doi: 10.1016/s0092-8674(88)91043-4. [DOI] [PubMed] [Google Scholar]
- 12.Wattiaux R, Laurent N, Wattiaux-De Coninck S, Jadot M. Endosomes, lysosomes: their implication in gene transfer. Advanced Drug Delivery Reviews. 2000;41:201–208. doi: 10.1016/s0169-409x(99)00066-6. [DOI] [PubMed] [Google Scholar]
- 13.Mukherjee S, Ghosh RN, Maxfield FR. Endocytosis. Physiol Rev. 1997;77:759–803. doi: 10.1152/physrev.1997.77.3.759. [DOI] [PubMed] [Google Scholar]
- 14.Murthy N, Xu M, Schuck S, Kunisawa J, Shastri N, Frechet JMJ. A macromolecular delivery vehicle for protein-based vaccines: Acid-degradable protein-loaded microgels. Proceedings of the National Academy of Science. 2003;100:4995–5000. doi: 10.1073/pnas.0930644100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Kwon YJ, Standley SM, Goh SL, Frechet JMJ. Enhanced antigen presentation and immunostimulation of dendritic cells using acid-degradable cationic nanoparticles. Journal of Controlled Release. 2005;105:199–212. doi: 10.1016/j.jconrel.2005.02.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Standley SM, Kwon YJ, Murthy N, Kunisawa J, Shastri N, Guillaudeu SJ, Lau L, Frechet JMJ. Acid-degradable particles for protein-based vaccines: enhanced survival rate for tumor-challenged mice using ovalbumin model. Bioconjugate Chemistry. 2004;15:1281–1288. doi: 10.1021/bc049956f. [DOI] [PubMed] [Google Scholar]
- 17.Bae Y, Nishiyama N, Fukushima S, Koyama H, Yasuhiro M, Kataoka K. Preparation and biological characterization of polymeric micelle drug carriers with intracellular pH-triggered drug release property: Tumor permeability, controlled subcellular drug distribution, and Enhanced in vivo antitumor efficacy. Bioconjugate Chem. 2005;16:122–130. doi: 10.1021/bc0498166. [DOI] [PubMed] [Google Scholar]
- 18.Kale A, Torchilin VP. Design, synthesis, and characterization of pH-sensitive PEG-PE conjugates for stimuli-sensitive pharmaceutical nanocarriers: The effect of substitutes at the hydrazone linkage on the pH stability of PEG-PE conjugates. Bioconjugate Chem. 2007;18:363–370. doi: 10.1021/bc060228x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Heffernan MJ, Murthy N. Polyketal nanoparticles: A new pH-sensitive biodegradable drug delivery vehicle. Bioconjugate Chem. 2005;16:1340–1342. doi: 10.1021/bc050176w. [DOI] [PubMed] [Google Scholar]
- 20.Oh KT, Bronich TK, Bromberg L, Hatton TA, Kabanov AV. Block ionomer complexes as prospective nanocontainers for drug delivery. Journal of Controlled Release. 2006;115:9–17. doi: 10.1016/j.jconrel.2006.06.030. [DOI] [PubMed] [Google Scholar]
- 21.Boussif O, Lezoualc’h F, Zanta MA, Mergny MD, Scherman D, Demeneix B, Behr JP. A versatile vector for gene and oligonucleotide transfer into cells in culture and in vivo: polyethylenimine. Proceedings of the National Academy of Science. 1995;92:7297–7301. doi: 10.1073/pnas.92.16.7297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Akinc A, Thomas M, Klibanov AM, Langer R. Exploring polyethyleneimine-mediated DNA transfection and the proton sponge hypothesis. Journal of Gene Medicine. 2005;7:657–663. doi: 10.1002/jgm.696. [DOI] [PubMed] [Google Scholar]
- 23.Lim Y, Kim S, Suh H, Park J. Biodegradable, endosome disruptive and cationic network-type polymer as a highly efficient and nontoxic gene delivery carrier. Bioconjugate Chemistry. 2002;13:952–957. doi: 10.1021/bc025541n. [DOI] [PubMed] [Google Scholar]
- 24.Lee ES, Na K, Bae YH. Doxorubicin loaded pH-sensitive polymeric micelles for reversal of resistant MCF-7 tumor. Journal of Controlled Release. 2005;103:405–418. doi: 10.1016/j.jconrel.2004.12.018. [DOI] [PubMed] [Google Scholar]
- 25.Wang J, Mongayt D, Torchilin VP. Polymeric micelles for delivery of poorly soluble drugs: preparation and anticancer activity In vitro of paclitaxel incorporated into mixed micelles based on poly(ethylene glycol)-lipid conjugate and positively charged lipids. Journal of Drug Targeting. 2005;13:73–80. doi: 10.1080/10611860400011935. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Shen H, Ackerman AL, Cody V, Giodini A, Hinson ER, Cresswell P, Edelson RL, Saltzman WM, Hanlon DJ. Enhanced and prolonged cross-presentation following endosomal escape of exogenous antigens encapsulated in biodegradable nanoparticles. Immunology. 2006;117:78–88. doi: 10.1111/j.1365-2567.2005.02268.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Panyam J, Zhou W-z, Prabha S, Sahoo SK, Labhasetwar V. Rapid endo-lysosomal escape of poly(DL-lactide-co-glycolide) nanoparticles: implications for drug and gene delivery. FASEB Journal. 2002;16:1217–1226. doi: 10.1096/fj.02-0088com. [DOI] [PubMed] [Google Scholar]
- 28.Newman KD, Kwon GS, Miller GG, Chlumecky V, Samuel J. Cytoplasmic delivery of a macromolecular fluorescent probe by poly(d, l-lactic-co-glycolic acid) microspheres. Journal of Biomedical Materials Research. 2000;50:591–597. doi: 10.1002/(sici)1097-4636(20000615)50:4<591::aid-jbm15>3.0.co;2-9. [DOI] [PubMed] [Google Scholar]
- 29.Murthy N, Robichaud JR, Tirrell DS, Stayton PS, Hoffman AS. The design and synthesis of polymers for eukaryotic membrane disruption. Journal of Controlled Release. 1999;61:137–143. doi: 10.1016/s0168-3659(99)00114-5. [DOI] [PubMed] [Google Scholar]
- 30.Murthy N, Chang I, Stayton PS, Hoffman AS. pH-sensitive hemolysis by random copolymer of alkyl acrylates and acrylic acid. Macromol Symp. 2001;172:49–55. [Google Scholar]
- 31.Cheung CY, Murthy N, Stayton PS, Hoffman AS. A pH-Sensitive polymer that enhances cationic lipid-mediated gene transfer. Bioconjugate Chem. 2001;12:906–910. doi: 10.1021/bc0100408. [DOI] [PubMed] [Google Scholar]
- 32.Lackey CA, Press OW, Hoffman AS, Stayton PS. A biomimetic pH-responsive polymer directs endosomal release and intracellular delivery of an endocytosed antibody complex. Bioconjugate Chem. 2002;13:996–1001. doi: 10.1021/bc010053l. [DOI] [PubMed] [Google Scholar]
- 33.Murthy N, Campbell J, Fausto N, Hoffman AS, Stayton PS. Bioinspired pH-responsive polymers for the intracellular delivery of biomolecular drugs. Bioconjugate Chemistry. 2003;14:412–419. doi: 10.1021/bc020056d. [DOI] [PubMed] [Google Scholar]
- 34.Bulmus V, Woodward M, Lin L, Murthy N, Stayton P, Hoffman A. A new pH-responsive and glutathione-reactive, endosomal membrane-disruptive polymeric carrier for intracellular delivery of biomolecular drugs. Journal of Controlled Release. 2003;93:105–120. doi: 10.1016/j.jconrel.2003.06.001. [DOI] [PubMed] [Google Scholar]
- 35.El-Sayed ME, Hoffman AS, Stayton PS. Rational design of composition and activity correlations for pH-responsive and glutathione-reactive polymer therapeutics. Journal of Controlled Release. 2005;104:417–427. doi: 10.1016/j.jconrel.2005.01.009. [DOI] [PubMed] [Google Scholar]
- 36.Henry SM, El-Sayed MEH, Pirie CM, Hoffman AS, Stayton PS. pH-Responsive poly(styrene-alt-maleic anhydride) alkylamide copolymers for intracellular drug delivery. Biomacromolecules. 2006;7:2407–2414. doi: 10.1021/bm060143z. [DOI] [PubMed] [Google Scholar]
- 37.Wiley DC, Skehel JJ. The structure and function of the hemagglutinin membrane glycoprotein of influenza virus. Annual Review of Biochemistry. 1987;56:365–394. doi: 10.1146/annurev.bi.56.070187.002053. [DOI] [PubMed] [Google Scholar]
- 38.Skehel JJ, Wiley DC. Receptor binding and membrane fusion in virus entry: the influenza hemagglutinin. Annual Review of Biochemistry. 2000;69:531–569. doi: 10.1146/annurev.biochem.69.1.531. [DOI] [PubMed] [Google Scholar]
- 39.Malenbaum SE, Collier RJ, London E. Membrane topography of the T domain of diphtheria toxin probed with single tryptophan mutants. Biochemistry. 1999;37:17915–17922. doi: 10.1021/bi981230h. [DOI] [PubMed] [Google Scholar]
- 40.Wang J, Rosconi MP, London E. Topography of the hydrophilic helices of membrane-inserted diphtheria toxin T domain: TH1-TH3 as a hydrophilic tether. Biochemistry. 2006;45:8124–8134. doi: 10.1021/bi060587f. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Li W, Nicol F, Szoka FCJ. GALA: a designed synthetic pH-responsive amphipathic peptide with applications in drug and gene delivery. Advanced Drug Delivery Reviews. 2004;56:967–985. doi: 10.1016/j.addr.2003.10.041. [DOI] [PubMed] [Google Scholar]
- 42.Cabiaux V. pH-sensitive toxins: interactions with membrane bilayers and application to drug delivery. Advanced Drug Delivery Reviews. 2004;56:987–997. doi: 10.1016/j.addr.2003.10.044. [DOI] [PubMed] [Google Scholar]
- 43.Goletz TJ, Klimpel KR, Leppla SH, Keith JM, Berzofsky JA. Delivery of antigens to the MHC Class I pathway using bacterial toxins. Human Immunology. 1997;54:129–136. doi: 10.1016/s0198-8859(97)00081-5. [DOI] [PubMed] [Google Scholar]
- 44.Goletz TJ, Klimpel KR, Arora N, Leppla SH, Keith JM, Berzofsky JA. Targeting HIV proteins to the major histocompatibility complex class I processing pathway with a novel gp120-anthrax toxin fusion protein. Proceedings of the National Academy of Science. 1997;94:12059–12064. doi: 10.1073/pnas.94.22.12059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Doling AM, Ballard JD, Shen H, Krishna KM, Ahmed R, Collier RJ, Starnbach MN. Cytotoxic T-lymphocyte epitopes fused to anthrax toxin induce protective antiviral immunity. Infection and Immunity. 1999;67:3290–3296. doi: 10.1128/iai.67.7.3290-3296.1999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.De Haan L, Hearn AR, Rivett AJ, Hirst TR. Enhanced delivery of exogenous peptides into the class I antigen processing and presentation pathway. Infection and Immunity. 2002;70:3249–3258. doi: 10.1128/IAI.70.6.3249-3258.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Sanderson S, Shastri N. LacZ inducible, antigen/MHC-specific T cell hybrids. Int Immunol. 1993;6:369–376. doi: 10.1093/intimm/6.3.369. [DOI] [PubMed] [Google Scholar]
- 48.Mitsukami Y, Donovan MS, Lowe AB, McCormick CL. Water-Soluble Polymers. 81. Direct synthesis of hydrophilic styrenic-based homopolymers and block copolymers in aqueous solution via RAFT. Macromolecules. 2001;34:2248–2256. [Google Scholar]
- 49.Besterman JM, Airhart JA, Woodworth RC, Low RB. Exocytosis of pinocytosed fluid in cultured cells: Kinetic evidence for rapid turnover and compartmentation. The Journal of Cell Biology. 1981;91:716–727. doi: 10.1083/jcb.91.3.716. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Plank C, Oberhauser B, Mechtler K, Koch C, Wagner E. The influence of endosome-disruptive peptides on gene transfer using synthetic virus-like transfer systems. Journal of Biological Chemistry. 1994;269:12918–12924. [PubMed] [Google Scholar]
- 51.Weaver DJ, Jr, Voss EW., Jr Analysis of rates of receptor-mediated endocytosis and exocytosis of a fluorescent hapten-protein conjugate in murine macrophage: implications for antigen processing. Biology of the Cell. 1998;90:169–181. doi: 10.1016/s0248-4900(98)80338-9. [DOI] [PubMed] [Google Scholar]
- 52.Panyam J, Labhasetwar V. Dynamics of endocytosis and exocytosis of poly(D,L-lactide-co-glycolide) nanoparticles in vascular smooth muscle cells. Pharmaceutical Research. 2003;20:212–220. doi: 10.1023/a:1022219003551. [DOI] [PubMed] [Google Scholar]
- 53.Albarran B, To R, Stayton PS. A TAT-streptavidin fusion protein directs uptake of biotinylated cargo into mammalian cells. Protein Engineering, Design and Selection. 2005;18:147–152. doi: 10.1093/protein/gzi014. [DOI] [PubMed] [Google Scholar]






