Skip to main content
International Journal of Molecular Sciences logoLink to International Journal of Molecular Sciences
. 2013 Jan 22;14(1):2085–2103. doi: 10.3390/ijms14012085

Pre-Treatment of Platinum Resistant Ovarian Cancer Cells with an MMP-9/MMP-2 Inhibitor Prior to Cisplatin Enhances Cytotoxicity as Determined by High Content Screening

Alexandros Laios 1,2,, Bashir M Mohamed 3,, Lynne Kelly 1, Richard Flavin 2, Stephen Finn 2, Lynda McEvoy 1,2, Michael Gallagher 2, Cara Martin 2, Orla Sheils 2, Martina Ring 2, Anthony Davies 3, Margaret Lawson 4, Noreen Gleeson 1, Tom D’Arcy 1, Charles d’Adhemar 2, Lucy Norris 1, Ream Langhe 1,2, Feras Abu Saadeh 1, John J O’Leary 2,*, Sharon A O’Toole 1,2,*
PMCID: PMC3565367  PMID: 23340649

Abstract

Platinum resistance is a major cause of treatment failure in ovarian cancer. We previously identified matrix metalloproteinase 9 (MMP-9) as a potential therapeutic target of chemoresistant disease. A2780cis (cisplatin-resistant) and A2780 (cisplatin-sensitive) ovarian carcinoma cell lines were used. The cytotoxic effect of MMP-9/MMP-2 inhibitor, (2R)-2-[(4-Biphenylsulfonyl) amino]-3 phenylpropionic acid (C21H19NO4S) alone or in combination with cisplatin was determined using high content screening. Protein expression was examined using immunohistochemistry and ELISA. Co-incubation of cisplatin and an MMP-9/MMP-2 inhibitor, (2R)-2-[(4-Biphenylsulfonyl) amino]-3 phenylpropionic acid (C21H19NO4S) resulted in significantly greater cytotoxicity as compared to either treatment alone in a cisplatin resistant MMP-9 overexpressing cell line; A2780cis. In addition, pre-incubating with MMP-9i prior to cisplatin further enhances the cytotoxic effect. No significant difference was observed in MMP-9 protein in tissue but a trend towards increased MMP-9 was observed in recurrent serum. We propose that MMP-9/MMP-2i may be utilized in the treatment of recurrent/chemoresistant ovarian cancers that overexpress MMP-9 mRNA but its role in vivo remains to be evaluated.

Keywords: ovarian, MMP-9/MMP-2 inhibitor, chemoresistance, recurrent, high content screening

1. Introduction

Platinum compounds, given as cis- or carboplatin, constitute the most active and standard chemotherapy treatment for nearly all women diagnosed with ovarian cancer. Despite its efficacy and resistance to chemotherapy, both intrinsic and acquired, it is a major cause of treatment failure. Resistance to cisplatin occurs in roughly one-third of women during primary treatment and in almost all patients treated for recurrent disease [1]. Currently, it can only be determined retrospectively after patients have experienced the burden and toxicity of ineffective therapy.

In an attempt to determine novel biomarkers in recurrent/chemoresistant ovarian cancer, we identified distinct patterns of gene expression between primary and recurrent ovarian cancers and we proposed an integrative mRNA and miRNA model of recurrence in ovarian cancer [2,3]. In these studies, matrix metalloproteinase MMP-9 was identified as a potential marker of recurrence/chemoresistance and miRNAs predicted to target this gene were dysregulated between primary and recurrent specimens. The current study extended this finding to examine the protein expression of MMP-9 in tissue and serum of primary and recurrent/chemoresistant ovarian cancers.

MMPs form a family of zinc dependent endopeptidases responsible for the proteolysis of extracellular matrix (ECM) components upon various biological processes including carcinogenesis, differentiation, apoptosis, migration and invasion, regulation of tumor angiogenesis and immune surveillance [4]. They have been primarily associated with matrix remodeling and degradation of ECM, essential components of tumor invasion and spread to local and distant sites. This is particularly important in ovarian cancer where invasion and metastasis remain the most important characteristics. They can also critically regulate the tumor microenvironment [5] and their expression is increased in almost all human cancers compared to normal tissue.

The two MMPs most closely correlated with metastatic potential are the 72 kDa MMP-2 (gelatinase A) and the 92 kDa MMP-9 (gelatinase B) that function by degrading type IV collagen present in the basement membrane. Metastatic tumor cell lines have higher levels of gelatinases than nonmetastatic counterparts [6].

Dysregulation of MMPs has been shown to be central to tumor progression [7]. MMP-9 and MMP-2 have been found consistently upregulated in ovarian cancer and are associated with poor prognosis [812]. In ovarian cancer, MMP-9 is expressed in both the stroma and the ovarian epithelial tumor cells and MMP-9 expression in either compartment is indicative of poor prognosis [13].

Clinical trials with broad-spectrum MMP inhibitors in cancer patients have shown dose limiting toxicities [14] and no therapeutic efficacy due in part, to their lack of specificity for tumor-associated MMPs. Most trials use the maximum tolerated dose of inhibitors and apart from the obvious adverse side-effects, some inhibitors lose selectivity for specific MMPs [15]. This necessitates either reduced dosing or highly selective targeting, or even use in earlier stage than conventional chemotherapeutics.

To investigate the role of MMP-9 in recurrent/chemoresistant ovarian cancer we carried out functional inhibition of the gene using a chemical inhibitor (2R)-2-[(4-Biphenylsulfonyl) amino]-3 phenylpropionic acid (C21H19NO4S) (MMP-9/MMP-2i). We examined the cytotoxic effect of the inhibitor alone or in conjunction with cisplatin. Cytotoxicity was evaluated using a High Content Screening (HCS) multiparametric cytotoxicity assay. Cell based HCS assays have shown high potential for predictive toxicity assessments, mainly because they can simultaneously measure several of the features involved in chemical and environmentally presented nanomaterials induced toxicity [1619]. Furthermore, this technology is becoming an indispensable approach to research and industry, assisting in understanding complex cellular processes related to disease pathogenesis [20], drug target validation and lead to the drug identification [21,22].

2. Results and Discussion

2.1. Results

2.1.1. RNA Sample Analysis from Cell Lines

The quality and quantity of RNA extracted from A2780cis and A2780 ovarian cancer cells was determined prior to TaqMan analysis using a NanoDrop® spectrophotometer (Thermo Fisher Scientific: Wilmington, DE, USA). TaqMan PCR was carried out on cell lines using previously tissue validated targets (n = 11). Relative quantitation was carried out in A2780cis vs. A2780 ovarian cancer cells over three passages. MMP-9 and NRG2 were identified as upregulated in “resistant” vs. “sensitive” cells with fold changes of 2.12 and 4.37 respectively (Figure 1). MMP-9 expression was further investigated in a different sensitive and resistant pair of ovarian cell lines; IGROV and IGROVCDDP, but no increase was observed in the platinum resistant line of this pair. A chemical inhibitor was commercially available for MMP-9, so this was chosen for further analysis. MMP-9i is also an inhibitor of MMP-2, however, no significant difference was noted in MMP-2 expression and the MMP-9i used in this study is more selective for MMP-9. For abbreviations reasons, MMP-9i/MMP-2i will be mentioned as MMP-9i in the figures and tables below.

Figure 1.

Figure 1

Scatter plot three dimensional clustering of tested genes based on their fold changes in A2780cis compared to A2780 cell lines. Each gene represents one point with three attributes (x: A2780cis; y: A2780; z: Hierarchical clustering) and is placed as a coordinate in an attribute space based on Euclidean distance measurements. The scatter plot demonstrated a main group of genes with similar fold changes. MMP9 and NRG2 appeared to “skew” from that main group given their upregulation pattern in A2780cis vs. A2780 cells with fold changes 2.12 and 4.37 respectively.

2.1.2. Cisplatin Induces Cell Death in Cisplatin Resistant Ovarian Cancer Cells

A2780cis cells were assessed for cisplatin-induced cytotoxicity by incubating with 5, 10 and 50 μM of cisplatin for 3, 6 and 24 h time periods (Figure 1). Values were normalized to untreated controls. A significant decrease was observed in cell viability after 24 h incubation with the most significant decrease seen with the highest concentration of cisplatin (Table 1, upper panel). The cells were assessed for 4 cytotoxicity parameters, cell membrane permeability, lysosomal mass, nuclear size and nuclear intensity. A significant cytotoxic effect was observed after 3 h incubation as indicated by the measurements of lysosomal mass/pH, nuclear morphology changes. The peak plasma concentration (PPC) of cisplatin (5 μM)—and not a higher concentration—was sufficient to cause a significant increase in nuclear size and intensity at 6 h and in nuclear intensity at 24 h (Figure 2C–E).

Table 1.

Tables showing percentage cell loss (%) following incubation with cisplatin and MMP-9/MMP-2i when A2780cis cells were treated with cisplatin alone, MMP-9/MMP-2i alone, cisplatin and MMP-9/MMP-2i (after 3 h incubation) and pretreatment of MMP-9/MMP-2i for 3 h prior to cisplatin treatment. Percentage cell loss (%) is normalized to vehicle treated cells (100%).

Time Cisplatin concentration μM MMP-9/MMP-2i concentration μM

5 10 50 0.2 1.3 2.6
3 8 6 8 32 40 ** 49 **
6 +3 9 30 34 49 ** 47 **
24 47 ** 60 ** 66 ** 44 ** 53 ** 51 **

Conc cis μM Co-incubation 3 h
Conc MMP-9/MMP-2i μM
Pre-incubation 3 h
Conc MMP-9/MMP-2i μM

2 1.3 2.6 0.2 1.3 2.6

5 55 * 65 ** 79 ** 62 ** 53 ** 83 ***
10 56 * 44 ** 65 ** 59 ** 76 *** 78 ***
50 72 ** 72 ** 97 *** 77 *** 81 *** 100 ***
**

p < 0.01,

***

p < 0.001.

Figure 2.

Figure 2

A2780cis cells treated with cisplatin. Simultaneous monitoring of changes in (A) cell count, (B) cell membrane permeability, (C) lysosomal mass/pH, (D) nuclear size and (E) nuclear condensation/intensity following treatment of the A2780cis cells with cisplatin (5 μM, 10 μM, 50 μM) and incubation for different time points 3, 6 and 24 h. Values were normalised to vehicle treated wells. Representative data are shown as means ±Standard Error (SE) (n = 3), **p < 0.01, ***p < 0.001.

2.1.3. MMP-9/MMP-2i Induces Cell Death in Cisplatin Resistant Ovarian Cancer Cells

To determine if MMP-9/MMP-2i alone was cytotoxic to resistant ovarian cells in vitro, cells were treated with or without MMP-9/MMP-2i at titrated concentrations (0.2 μM, 1.3 μM, 2.6 μM) for 3, 6 and 24 h (Figure 3). MMP-9/MMP-2i caused a significant reduction in cell viability in a dose- and time-dependent manner, which was more significant than cisplatin alone treatment (Table 1, upper panel). Significant increases were observed at the early time point of 3 h for cell membrane permeability, lysosomal mass and nuclear intensity, which are indicative of a cytotoxic effect (Figure 3B,C,E).

Figure 3.

Figure 3

A2780cis cells treated with MMP-9/MMP-2i. Simultaneous monitoring of changes in (A) cell count, (B) cell membrane permeability, (C) lysosomal mass/pH, (D) nuclear size and (E) nuclear condensation/intensity following treatment of the A2780cis cells with MMP-9/MMP-2i (0.2 μM, 1.3 μM, 2.6 μM) and incubation for different time points 3, 6 and 24 h. Values were normalized to vehicle treated wells. Representative data are shown as means ± SE (n = 3), **p < 0.01, ***p < 0.001.

2.1.4. MMP-9/MMP-2i Enhances Cisplatin-Induced Cell Death in Chemoresistant Ovarian Cancer Cells at an Early Time Point

We then sought to determine whether co-treatment of ovarian cancer cells with MMP-9/MMP-2i could enhance cisplatin-induced cytotoxicity at the early time point of 3 and 6 h. Resistant ovarian cancer cells were co-incubated with cisplatin and varying concentrations of MMP-9/MMP-2i (0.2–2.6 μm) (Figure 4). A significant decrease was observed in cell viability following co-incubation of MMP-9/MMP-2i and cisplatin, which was more effective than treating with either agent alone (Table 1, lower panel). This effect was observed at a 3 h timepoint for all concentrations. Significant cytotoxic effects were observed for cell membrane permeability, lysosomal mass and nuclear intensity for all concentrations at the 3 h timepoint. The lower concentrations of cisplatin and MMP-9i displayed the most cytotoxic effects with relative fluorescence values doubling for the cell membrane permeability and lysosomal mass parameters (Figure 4B,C). A lesser effect was observed after 6 h for these 4 parameters (Figure S1).

Figure 4.

Figure 4

Co-incubation of A2780cis cells with cisplatin and MMP-9/MMP-2i. simultaneous monitoring of changes in (A) cell density, (B) cell membrane permeability, (C) lysosomal mass/pH, (D) nuclear condensation/intensity and (E) nuclear size following co-incubation of A2780cis cells with cisplatin and MMP-9/MMP-2i for 3 h. Values were normalized to vehicle treated wells. Representative data are shown as means ± SE (n = 3), *p < 0.05, **p < 0.01, ***p < 0.001.

2.1.5. Pre-Incubation with MMP-9/MMP-2i further Enhanced Cisplatin Induced Cytotoxicity

Further it was decided to investigate whether pre-incubating resistant ovarian cancer cells with MMP-9/MMP-2i for 3 h would result in more enhanced cytotoxicity. Indeed, pre-incubation with MMP-9/MMP-2i directly followed by treatment with cisplatin was significantly cytotoxic at the 3 h time point where a significant decrease in cell count was observed at all concentrations (Figure 5A and Table 1, lower panel). This cytotoxic effect was seen at the lower concentration of cisplatin in the cell membrane, lysosomal mass and nuclear intensity parameters at 3 h and it also followed through to the 6 h incubation period (Figure 5B,C,E and Figure S2).

Figure 5.

Figure 5

Pre-incubation of A2780cis cells with MMP-9/MMP-2i for 3 h followed by cisplatin treatment. Simultaneous monitoring of changes in (A) cell density, (B) cell membrane permeability, (C) lysosomal mass/pH, (D) nuclear condensation/intensity and (E). Nuclear size following pre-incubation of A2780cis cells with MMP-9/MMP-2i for 3 h followed by treatment with cisplatin for 3 h. Values were normalized to vehicle treated wells. Representative data are shown as means ± SE (n = 3), **p < 0.01, ***p < 0.001.

2.1.6. MMP-9/MMP-2i and Cisplatin Induces Cell Death in Chemosensitive Ovarian Cancer Cells

As a control, the same treatment regimens were performed (Figures S3–S6) on the A2780 sensitive cells, which do not overexpress MMP-9. The cytotoxic effects were much less than seen with A2780cis and at times only observed for the cell viability parameter. However, cytotoxicity was enhanced when pre-incubation with MMP-9/MMP-2i was performed (Figures S3–S6).

2.1.7. Evaluation of MMP-9 Expression by Immunostaining in vivo

No significant difference of MMP-9 protein was observed between primary and recurrent/chemoresistant ovarian cancers. A subset of 6 primary and recurrent/chemoresistant tissues from the same patients were also investigated and while one case demonstrated marginal increased staining in the recurrent specimen this was not observed in the other cases where both primary and recurrent/chemoresistant expressed strong MMP-9 staining. An example of MMP-9 staining in a recurrent serous papillary adenocarcinoma of the ovary is shown in Figure S7.

2.1.8. ELISA Analysis of Serum

A trend towards increased expression of MMP-9 was seen in recurrent/chemoresistant ovarian cancers with the reciprocal relationship observed in TIMP-2 levels (Figure S8). The study was confined to serous papillary adenocarcinomas and was limited by sample availability of recurrent serum and warrants investigation in a larger cohort.

2.2. Discussion

This study demonstrates the therapeutic potential of an MMP-9/MMP-2i inhibitor in combination with cisplatin for the treatment of recurrent/chemoresistant ovarian cancers overexpressing the MMP-9 gene. Using the novel high content screening technology we document for the first time an additive cytotoxic effect when MMP-9/MMP-2i is combined with cisplatin (Figure 6).

Figure 6.

Figure 6

Synergy analysis of the MMP9/MMP2i with cisplatin and combination in the A2780cis cell line. The median-effect function of Chou and Talalay, assuming mutual exclusivity, using the CombiTool (version 2.001; IMB Jena Biocomputing Group: Jena, Germany) was applied to analyze the Bliss independence reference model. Plots show the different combination indices at various effect levels (fraction affected) for an experimental design in which the doses of cisplatin varied in the presence of a fixed dose of MMP-9/MMP2i. Values are means for 3 experiments (n = 4 for the 3 h experiment). The coefficient of variation for each set of experiments was <10%. An additive effect has been observed.

In addition, pretreating cisplatin resistant ovarian cancer cells with an MMP-9/MMP-2i inhibitor prior to treatment with cisplatin resulted in enhanced cytotoxicity at an early point. A recent study has demonstrated that MMP-9 siRNA significantly reduces the invasion and adhesive ability of ovarian cancer cells [23].

We previously identified the MMP-9 gene as upregulated in recurrent ovarian cancer tissue specimens [2]. We also identified a link between this gene and dysregulated miRNAs. The list of predicted mRNA targets for these miRNAs shared common significant pathways including actin and integrin signaling [3]. This is consistent with recent studies that directly relate MMP overexpression/ovarian cancer cisplatin resistance to actin cytoskeleton and integrins [24,25]. Other genes linked to MMP-9 such as the tissue inhibitors of matrix metalloproteinases (TIMPs) and zinc metabolism genes were also dysregulated in this cohort suggesting this gene may play an important role in recurrent/chemoresistant ovarian cancer. This difference was not observed at the protein level when MMP-9 was investigated by immunohistochemistry as both primary and recurrent/chemoresistant cases exhibited strong staining and subtle changes are difficult to interpret by immunohistochemistry. We also used a previously available TMA of primary and recurrent serous ovarian specimens. These were not all platinum-sensitive or platinum-resistant to perfectly mimic the in vitro model, hence no significant difference was observed in the expression of MMP9 levels in the recurrent compared to the primary specimens. This discrepancy is possible as stromal cells also secrete MMP9—which may modulate the invasiveness of ovarian cancer cells—and may exert varying degrees of activity following chemotherapy [13].

Serum MMP-9 showed a pattern of increasing concentration across benign, borderline, malignant and recurrent/chemoresistant serous tumors and one of its inhibitors, TIMP-2 displayed the reciprocal. While this did not reach significance, it does warrant further investigation in a larger cohort. Recent studies have demonstrated the clinical utility of MMP-9 to discriminate between malignant and benign ovarian cancers, however its utility in the recurrent setting has not been investigated [23,26,27].

We observed consistently higher MMP-9 expression in a cisplatin resistant (A2780cis) ovarian cell line compared to its sensitive counterpart (A2780). This was maintained for successive passages and before treatment of the A2780cis cell line with cisplatin to maintain chemoresistance. Over expression of MMP-9 was not observed in the IGROV/IGROVCDDP paired sensitive/resistant cell lines which is not surprising due to the multifactorial nature of platinum resistance; hence emphasising the need for individual testing of tumors for specific targeted therapy.

In recent years, much attention has been focused on the function of MMP enzymes, given their sophisticated pattern of modulating opposite effects in cancer progression. Their overexpression correlates with increased invasion, metastasis and shortened survival [28]. Their antimetastatic propensity was further investigated by the development of MMP inhibitors (MMPIs) as a new class of anticancer drugs. Despite extensive research, very few inhibitors specific for the gelatinases have been described to date; the most potent also inhibit several other MMP family members. Unfortunately, these MMP intervention strategies have met with limited clinical success and severe toxicities. The mechanism of these toxicities is widely assumed to be due to the poor selectivity of these compounds but this has not been confirmed. In addition, it is now recognized that among MMPs, some possess cancer-promoting activities while others tumor-inhibiting functions underlining the risk of using broad-spectrum MMPIs [29]. A recent study in colorectal cancer has suggested that selective targeting of the tumor rather than stromal cell MMP-9 would be an ideal candidate for antimetastatic therapy [30].

The exact mechanism of their action is not yet completely understood. Apoptosis is induced by many but not all endogenous inhibitors and not necessarily by synthetic MMP inhibitors, thus suggesting that the mechanism may not rely on the inhibition of a MMP [31]. Synthetic MMP inhibitors appear to mimic most of the actions of TIMPs including MMP inhibition but also cell growth and proliferation [32,33]. Our results impose more than one mechanism is taking place as we observe inhibition when MMP-9 is overexpressed but we also observe some cytotoxicity in the cell line that doesn’t overexpress MMP-9 but this effect was not as significant when the cell line was treated with MMP-9i alone. It may well be that the chemotherapy is responsible for the increased expression of MMP-9 as established by a recent study [34]. Further work performing whole genome transriptome array analysis is necessary to evaluate the mechanism of action of this inhibitor.

We used a novel gelatinase inhibitor, derived from N-sulfony-lamino acid, which appears to specifically inhibit MMP-9 and to a lesser extent MMP-2 [35]. Inhibition of gelatinase activity in implanted tumor tissues has been demonstrated by means of film in situ zymography [36]. Such inhibitors selectively target tumors because their overexpression makes them accessible for homing in the tumor vasculature. The cytotoxic effects we observed were often at the lower concentration of the inhibitor where it has a higher specificity for MMP-9. The inhibitor used in this study has been shown to possess a novel proapoptotic function when combined with TNFa, TRAIL or FAS ligands [37]. This alternative mechanism could explain the enhanced apoptosis observed between our inhibitor and cisplatin, although the proposed antineoplastic mechanism has not been tested in an ovarian cancer model. A novel inhibitor of MMP-2 and MMP-9, BAY 12-9566 appears to have a more favorable toxicity profile by perturbation of the cell cycle [38]. Oral treatment with the highly selective MMPI RO 28-2653 decreases the incidence of liver metastases due to reduced MMP-2 and MMP-9 concentration in pancreatic cancer models [39].

We implemented a live-cell multiparametric HCS cytotoxicity assay measuring cell density, nuclear morphology, lysosomal mass and cell membrane integrity; the principle parameters of compromised cell health. This parallel analysis of multiple markers for cytotoxicity allows early reversible and late irreversible effects to be distinguished, therefore it provides a more sensitive interpretation of compound-induced toxicity, offering increased specificity and selectivity for toxic events [40]. We tested critical early measurements of toxicity as assays that target late events in the process of cell injury are more likely to miss toxicities that require chronic exposure or exert adverse but not lethal effects. Preincubating cells with MMP-9i at all doses was significantly cytotoxic at 3 h suggesting an early apoptotic response. Some of the pre-incubation effects followed through to the 6 h incubation and this was probably due to the significant effects observed at 3 h which the cells are trying to adapt to, suggesting it may require continuous or a more extended course of treatment to completely arrest tumor growth. A similar effect was observed using this inhibitor for treatment of melanoma [37]. Our time course results support the notion that if MMP-9 is considered a chemoresistant marker, the ability to acquire drug resistance arises early during the tumorigenesis process, as recently proposed and validated in an ovarian cancer model [41] and is associated with immediate adaptive response to treatment.

3. Experimental Section

3.1. Cell Culture

Matched sensitive and cisplatin resistant cell lines were investigated for this study. Human ovarian epithelial carcinoma cell lines A2780 and A2780cis (the cisplatin resistant counterpart) were purchased from the European Collection of Cell Cultures (ECACC: Salisbury, UK) and cultured in RPMI-1640 medium supplemented with 10% fetal calf serum, l-glutamine, penicillin and streptomycin (Sigma: Steinheim, Germany) in a humidified 5% CO2, 95% air atmosphere. IGROV and IGROVCDDP, were cultured in RPMI supplemented with 10% fetal calf serum.

3.2. Preparation of Cell Lines for RNA Extraction

Following trypsinisation of cultured cells, between 1 and 5 million cells were centrifuged for 12 min at 1200 rpm and supernatant was removed. Cells were lysed using Buffer RLT (Qiagen). Three different passages were used. RNA extraction was performed using the RNeasy® mini kit (Qiagen: West Sussex, UK) as per manufacturer’s instructions. RNA was quantified using the NanoDrop® spectrophotometer.

3.3. TaqMan PCR Analysis of Selected Candidates

Eleven genes (CLDN16, S100B, BTC, IL27RA, FGF2, NRG2, S100A8, ZNF218, MMP9, TJP3, IL1R2) previously validated as upregulated in recurrent compared to primary ovarian cancers [2] were selected for TaqMan PCR analysis in the cell lines. All reactions were carried out on the ABI Prism 7000 Sequence detection system (Applied Biosystems, Applera UK: Cheshire, UK) using the TaqMan® Universal PCR master Mix and TaqMan® Gene Expression Assays (Applied Biosystems). Relative quantitation in A2780cis compared to A2780 cells was carried out using the delta delta cycle time (ΔΔCt) method with 18S ribosomal RNA as an endogenous control. Upregulation was observed for an average of three passages in A2780cis compared to A2780 cell line. Technical replicates were performed (n = 3) for a representative passage for each cell line.

3.4. Chemicals

MMP-9/MMP-2 inhibitor, (2R)-2-[(4-Biphenylylsulfonyl)amino]-3 phenylpropionic acid (C21H19NO4S), was purchased from Calbiochem (Merck, Darmstadt, Germany). It is described as a potent inhibitor of MMP-2 (IC50 = 310 nM) and MMP-9 (IC50 = 240 nM) [35]. Stock solutions of MMP-9i which correspond to the IC50 (1×, 0.2 μM) and a 5× (1.3 μM) and 10× (2.6 μM) concentration were made in DMSO. Cisplatin was obtained from Sigma-Aldrich (Sigma-Aldrich, Ireland Ltd.: Arklow, Ireland, IMB Jena Biocomputing Group, http://www.imb-jena.de). A 10 μM stock solution was prepared in Phosphate Buffer Saline (PBS).

3.5. Experimental Design

The peak plasma concentration of cisplatin (5 μM) was assessed in addition to a 2× (10 μM) and a 10× (50 μM) concentration. The toxic effect of MMP-9/MMP-2i and cisplatin alone or in combination was determined using the multiparameter cytotoxicity 1 kit. Cells were plated (8 × 103) in triplicate in 96-well plates overnight and then treated with titrated concentrations of drugs for 3, 6 and 24 h. Only the inner 60 wells of 96-well plates were used due to evaporation-related edge effects in the outside wells. A pre-incubation for 3 h with MMP-9i prior to treatment with cisplatin as well as co-incubation at 3 and 6 h were assessed. DMSO was used as a vehicle control.

3.6. Multiparameter Cytotoxicity Assay Using HCS System

A multiparametric cytotoxicity assay was performed using Cellomics® HCS reagent HitKit™ as per the manufacturer’s instructions (Thermo Fisher Scientific Inc.: Pittsburgh, PA, USA). This kit enables measurements of cell viability, cell membrane permeability and lysosomal mass/pH, which are toxicity-linked cellular markers. Following a toxic compound or nanomaterial insult, cells may respond with changes in nuclear size and/or morphology depending on the cell type and the compound as well as loss of cell membrane integrity [17,18].

Prior to staining, cells were washed with PBS, then 65 μL of a fluorophore mixture (supplied by the manufacturer) containing Hoechst 33342, lysosomal mass/pH indicator and cell membrane permeability dye were made up in 10% supplemented RPMI media. Cells were incubated with 50 μL of the fluorophore mixture for 40 min under tissue culture conditions to enable measurement of cytotoxicity indicators. Dead cells were washed away twice with 100 μL of PBS and 200 μL of wash buffer was added to each well. The experimental layout for the automated microscopic analysis, based on the In Cell analyzer 1000 (GE Healthcare: Uppsala, Sweden), was composed of untreated, MMP-9/MMP-2i and DMSO treated plates. All these were scanned and acquired in a stereology configuration of 6 randomly selected fields. Images were acquired in a stereology configuration of five randomly selected fields at 10× magnification using three detection channels with different excitation filters. The rate of cell viability and proliferation were assessed by the automated analysis of the nuclear count and morphology (DAPI filter); in parallel the fluorescent staining intensities reflecting cell permeability (FITC filter) and lysosomal mass/pH changes (TRITC filter) were also quantified for each individual cell present in the examined microscopic fields (IN Cell Investigator, GE Healthcare: Buckinghamshire, UK).

3.7. Immunohistochemical Staining and Analysis

Immunohistochemical investigation for MMP-9 expression was conducted on 5 μm primary and recurrent/chemoresistant ovarian sections using the avidin-biotin-peroxidase complex detection procedure as previously described [34]. A primary TMA of 20 serous papillary adenocarcinomas was used and 20 recurrent/chemoresistant ovarian cancers of mixed histology were examined. A subset of matched primary and recurrent/chemoresistant specimens from the same patient were also investigated. Stained tissue sections were blindly investigated by a histopathologist using a 1 (weak), 2 (moderate) and 3 (strong) scoring system.

3.8. Patient Serum Samples

Serum samples from 39 patients were assayed in this study; 10 benign serous cystadenomas, 10 borderline serous cystadenomas, 10 advanced malignant serous papillary adenocarcinomas and 9 recurrent/chemoresistant serous adenocarcinomas. Pre-operative blood samples were taken from patients undergoing surgery for ovarian disease in St James’s Hospital Dublin. This research project had approval of the hospital ethics committee and informed consent was obtained.

3.9. ELISA for MMP-9 and Its Inhibitor TIMP-2

The Quantikine TIMP-2 and MMP-9 Immunoassay kits (Catalog No. DTM200 and DMP900 respectively) from R&D systems were used. The ELISA was performed according to manufacturer’s protocols. Serum samples were diluted 1:50 prior to assay.

3.10. Statistical Analysis

For cell culture, all treated cells were assayed in triplicate and results were expressed as mean percent surviving cells ± SE. Statistical analysis was carried out by Student’s t-test or two-way ANOVA was carried out using the PRISM® software. Statistical significance was inferred at p < 0.05. ELISA results were analyzed using SPSS for Windows, Release 18.0.1. 2001. Chicago: SPSS Inc.

An experimental design for comparison of a single anticancer drug dose response relation with that of the same anticancer drug in combination with a fixed concentration of MMP-9/MMP2i was used and the measured responses compared to the Bliss independence reference model of synergy using the CombiTool computer program (version 2.001, IMB Jena Biocomputing Group: Jena, Germany). The drug interaction index (Ix) was calculated according to the method of Chou and Talalay [42] using CombiTool. Ix values are geometric means ± SEM in the presence of a fixed concentration of MMP-9/MMP2i, Ix < 1 = synergy; Ix = 1 additivity and Ix > 1 antagonism. The Bliss independence model is defined by the equation: Exy = Ex + Ey − ExEy for 0 < E < 1 and where Exy is the additive effect of drugs x and y as predicted by their individual effects Ex and Ey. In this case, Exy would be the effect (fractional survival) of the drug used in combination with cisplatin, and Ex and Ey the fractional survival of cells exposed to the drug alone and to the drug in combination with cisplatin, respectively [43]. Effective inhibitory concentrations (EC50) are best-fit values obtained from non-linear regression analysis of the sigmoidal dose-response relation for each drug alone or in combination with MMP9i/MMP2i. The potency ratio and associated 95% CI (confidence interval) were computed by subtracting the log EC50 of MMP9/MMP2i in combination with cispaltin from the log EC50 of drug alone and back-transformation (antilogarithm) of data. GraphPad QuickCalcs, Graphpad Prism (Version 4.03, GraphPad Software: San Diego, CA, USA) were used for data and graphic analysis.

4. Conclusions

We report a successful adaptation of HCS for cytotoxicity using a novel MMP-9/MMP-2i alone and in combination with cisplatin and we provide evidence regarding highly selective MMP-9/MMP-2i involvement in the treatment of ovarian cancer (Figure 7). An enhanced early time and concentration-dependent cytotoxic effect was observed, consistent with a hormetic effect. This suggests that drug exposure may not have to be long-term and/or systematic thus reducing the possibility of side-effects. MMP-9 may have an important role in recurrent/chemoresistant cancer and further investigation of serum MMP-9 is warranted. This preliminary data suggests patients over expressing MMP-9 may benefit from the inclusion of an MMP-9 inhibitor in combination with chemotherapy. Our results suggest pretreating the cells with an MMP-9i before chemotherapy enhances the cytotoxic effect. Manipulation of doses, investigation of sub-toxic doses and use of antisense molecules to create highly selective MMPIs require further investigation.

Figure 7.

Figure 7

A model of possible implication of MMPIs in the treatment of ovarian cancer. Hypothesized phases in the induction of apoptosis in response to common chemotherapeutic agents in ovarian cancer. In phase I, cytotoxic agents impart damage to a critical component of the cell such as DNA or microtubules. In phase II, the cell recognizes the damage through signaling mechanisms. In phase III, the cell assesses the extent of damage and decides the appropriate response. In most cancer cells, the preferred response is the induction of apoptosis, whereas the response can also involve growth arrest to allow for repair or senescence or terminal cell differentiation. Cancer cells may acquire resistance to apoptosis at several points in this pathway. MMPs appear to induce the irreversible phase of apoptosis. Highly selective MMPIs may have a complementary role in the treatment of ovarian cancer and in particular in patients whose tumor overexpress MMP-9.

Supplementary Information

ijms-14-02085-s001.pdf (748KB, pdf)

Acknowledgements

This work was supported by the Royal City of Dublin Hospital Trust Fund and the Emer Casey Foundation. The study sponsors had no involvement in the study. The authors would like to acknowledge the contribution of Louise Rice and Nornadhi W. Wan Rosdi.

Authors’ Contributions

AL conceived and designed the study, carried out the cell line experiments/TaqMan analysis and drafted the manuscript. BMM and AD carried out the HCS analysis. LME, LK, LN, FAS and RL processed bloods and participated in the ELISA of the serum. BMM, ML, MR, RF, CD and SF performed the IHC staining and analysis. MG, CM and OS participated in the design and study coordination. NG and TD facilitated recruitment of patients and helped to draft the manuscript. JOL and SOT participated in the study design and drafted the manuscript. All authors read, edited and approved the final manuscript.

Conflict of Interest

The authors declare no conflict of interest.

References

  • 1.Vasey P.A. Resistance to chemotherapy in advanced ovarian cancer: Mechanisms and current strategies. Br. J. Cancer. 2003;89:S23–S28. doi: 10.1038/sj.bjc.6601497. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Laios A., O’Toole S., Flavin R., Martin C., Ring M., Gleeson N., D’Arcy T., McGuinness E., Sheils O., Sheppard B., et al. An integrative model for recurrence in ovarian cancer. Mol. Cancer. 2008;7:8–11. doi: 10.1186/1476-4598-7-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Laios A., O’Toole S., Flavin R., Martin C., Kelly L., Ring M., Finn S., Barrett C., Loda M., Gleeson N., et al. Potential role of miR-9 and miR-223 in recurrent ovarian cancer. Mol. Cancer. 2008;7 doi: 10.1186/1476-4598-7-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Overall C.M., Lopez-Otin C. Strategies for mmp inhibition in cancer: Innovations for the post-trial era. Nat. Rev. Cancer. 2002;2:657–672. doi: 10.1038/nrc884. [DOI] [PubMed] [Google Scholar]
  • 5.Curran S., Murray G.I. Matrix metalloproteinases in tumour invasion and metastasis. J. Pathol. 1999;189:300–308. doi: 10.1002/(SICI)1096-9896(199911)189:3<300::AID-PATH456>3.0.CO;2-C. [DOI] [PubMed] [Google Scholar]
  • 6.Karakiulakis G., Papanikolaou C., Jankovic S.M., Aletras A., Papakonstantinou E., Vretou E., Mirtsou-Fidani V. Increased type IV collagen-degrading activity in metastases originating from primary tumors of the human colon. Invasion Metastasis. 1997;17:158–168. [PubMed] [Google Scholar]
  • 7.Zucker S., Lysik R.M., Zarrabi M.H., Moll U. Mr 92,000 type IV collagenase is increased in plasma of patients with colon cancer and breast cancer. Cancer Res. 1993;53:140–146. [PubMed] [Google Scholar]
  • 8.Fishman D.A., Banionis S., Kearns A.S., Chilukuri K., Stack M.S. Production of extracellular matrix-degrading proteinases by primary cultures of human epithelial ovarian carcinoma cells. Cancer. 1997;80:1457–1463. doi: 10.1002/(sici)1097-0142(19971015)80:8<1457::aid-cncr13>3.0.co;2-4. [DOI] [PubMed] [Google Scholar]
  • 9.Davidson B., Goldberg I., Gotlieb W., Kopolovic J., Ben-Baruch G., Nesland J., Berner A., Bryne M., Reich R. High levels of MMP-2, MMP-9, MT1-MMP and TIMP-2 mRNA correlate with poor survival in ovarian carcinoma. Clin. Exp. Metastasis. 1999;17:799–808. doi: 10.1023/a:1006723011835. [DOI] [PubMed] [Google Scholar]
  • 10.Alshenawy H.A. Immunohistochemical expression of epidermal growth factor receptor, E-cadherin, and matrix metalloproteinase-9 in ovarian epithelial cancer and relation to patient deaths. Ann. Diagn. Pathol. 2010;14:387–395. doi: 10.1016/j.anndiagpath.2010.05.005. [DOI] [PubMed] [Google Scholar]
  • 11.Kamat A.A., Fletcher M., Gruman L.M., Mueller P., Lopez A., Landen C.N., Han L., Gershenson D.M., Sood A.K. The clinical relevance of stromal matrix metalloproteinase expression in ovarian cancer. Clin. Cancer Res. 2006;12:1707–1714. doi: 10.1158/1078-0432.CCR-05-2338. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Schmalfeldt B., Prechtel D., Härting K., Späthe K., Rutke S., Konik E., Fridman R., Berger U., Schmitt M., Kuhn W., et al. Increased expression of matrix metalloproteinases (MMP)-2, MMP-9, and the urokinase-type plasminogen activator is associated with progression from benign to advanced ovarian cancer. Clin. Cancer Res. 2001;7:2396–2404. [PubMed] [Google Scholar]
  • 13.Davidson B. Ovarian carcinoma and serous effusions. Changing views regarding tumor progression and review of current literature. Anal. Cell Pathol. 2002;23:107–128. doi: 10.1155/2001/418547. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Nemunaitis J., Poole C., Primrose J., Rosemurgy A., Malfetano J., Brown P., Berrington A., Cornish A., Lynch K., Rasmussen H., et al. Combined analysis of studies of the effects of the matrix metalloproteinase inhibitor marimastat on serum tumor markers in advanced cancer: Selection of a biologically active and tolerable dose for longer-term studies. Clin. Cancer Res. 1998;4:1101–1109. [PubMed] [Google Scholar]
  • 15.Coussens L.M., Fingleton B., Matrisian L.M. Matrix metalloproteinase inhibitors and cancer. J. Pathol. 2002;189:300–308. doi: 10.1126/science.1067100. [DOI] [PubMed] [Google Scholar]
  • 16.Vogt A., Kalb E.N., Lazo J.S. A scalable high-content cytotoxicity assay insensitive to changes in mitochondrial metabolic activity. Oncol. Res. 2004;14:305–314. doi: 10.3727/096504003773994842. [DOI] [PubMed] [Google Scholar]
  • 17.Mohamed B., Verma N., Prina-Mello A., Williams Y., Davies A.M., Bakos G., Tormey L., Edwards C., Hanrahan J., Salvati A., et al. Activation of stress-related signalling pathway in human cells upon SiO2 nanoparticles exposure as an early indicator of cytotoxicity. J. Nanobiotechnol. 2011;9 doi: 10.1186/1477-3155-9-29. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Byrne F., Prina-Mello A., Whelan A., Mohamed B.M., Davies A., Gun’ko Y.K., Coey J.M.D., Volkov Y. High content analysis of the biocompatibility of nickel nanowires. J. Magn. Magn. Mater. 2009;321:1341–1345. [Google Scholar]
  • 19.Mohamed B.M., Verma N., Davies A.M., McGowan M., Staunton K.C., Prina-Mello A., Kelleher D., Botting C.H., Causey C.P., Thompson P.R., et al. Citrullination of proteins: A common post-translational modification pathway induced by different nanoparticles in vitro and in vivo. Nanomedicine. 2012;7:1181–1195. doi: 10.2217/nnm.11.177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Mohamed B.M., Feighery C., Williams Y., Davies A., Kelleher D., Volkov Y., Kelly J., Abuzakouk M. The use of Cellomics to study enterocyte cytoskeletal proteins in coeliac disease patients. Cent. Eur. J. Biol. 2008;3:258–267. [Google Scholar]
  • 21.Zhou X., Wong S. Informatics challenges of high-throughput microscopy. IEEE Signal Process. Mag. 2006;23:63–672. [Google Scholar]
  • 22.Long A., Volkov Y. High content analysis approach for targeted gene silencing and probing nanoscale cell responses. Eur. Pharm. Rev. 2009;1:22–30. [Google Scholar]
  • 23.Hu X., Li D., Zhang W., Zhou J., Tang B., Li L. Matrix metallopoteinase-9 expression correlates with poor prognosis and involved in ovarian cancer cell invasion. Arch. Gynecol. Obstet. 2012;286:1537–1543. doi: 10.1007/s00404-012-2456-6. [DOI] [PubMed] [Google Scholar]
  • 24.Kwon Y., Cukierman E., Godwin A.K. Differential expressions of adhesive molecules and proteases define mechanisms of ovarian tumour cell matrix penetration/invasion. PLoS One. 2011;6 doi: 10.1371/journal.pone.0018872. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Sharma S., Santiskulvog C., Bentolola L.A., Rao J., Dorigo O., Gimzewski J.K. Correlative nanomechanical profiling with super-resolution F-actin imaging reveals novel insights into mechanisms of cisplatin resistance in ovarian cancer cells. Nanomedicine. 2012;8:757–766. doi: 10.1016/j.nano.2011.09.015. [DOI] [PubMed] [Google Scholar]
  • 26.Zhang W., Yang H.-C., Wang Q., Yang Z.-J., Chen H., Wang S.-M., Pan Z.-M., Tang B.-J., Li Q.Q., Li L. Clinical value of combined detection of serum matrix metalloproteinase-9, heparanase, and cathepsin for determining ovarian cancer invasion and metastasis. Anticancer Res. 2011;31:3423–3428. [PubMed] [Google Scholar]
  • 27.Gershtein E.S., Levkina N.V., Digayeva M.A., Laktionov K.P., Tereshkina I.V., Kushlinsky N.E. Matrix metalloproteinases 2, 7, and 9 and tissue inhibitor of metalloproteinases-1 in tumors and serum of patients with ovarian neoplasms. Bull. Exp. Biol. Med. 2010;149:628–631. doi: 10.1007/s10517-010-1010-4. [DOI] [PubMed] [Google Scholar]
  • 28.Iizasa T., Fujisawa T., Suzuki M., Motohashi S.-i., Yasufuku K., Yasukawa T., Baba M., Shiba M. Elevated levels of circulating plasma matrix metalloproteinase 9 in non-small cell lung cancer patients. Clin. Cancer Res. 1999;5:149–153. [PubMed] [Google Scholar]
  • 29.Devy L., Dransfield D.T. New strategies for the next generation of matrix-metalloproteinase inhibitors: Selectively targeting membrane-anchored mmps with therapeutic antibodies. Biochem. Res. Int. 2011;2011 doi: 10.1155/2011/191670. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Lubbe W.J., Zhou Z.Y., Fu W., Zuzga D., Schulz S., Fridman R., Muschel R.J., Waldman S.A., Pitari G.M. Tumor epithelial cell matrix metalloproteinase 9 is a target for antimetastatic therapy in colorectal cancer. Clin. Cancer Res. 2006;12:1876–1882. doi: 10.1158/1078-0432.CCR-05-2686. [DOI] [PubMed] [Google Scholar]
  • 31.Bond M., Murphy G., Bennett M.R., Amour A., Knäuper V., Newby A.C., Baker A.H. Localization of the death domain of tissue inhibitor of metalloproteinase-3 to the n terminus. J. Biol. Chem. 2000;275:41358–41363. doi: 10.1074/jbc.M007929200. [DOI] [PubMed] [Google Scholar]
  • 32.Bendeck M.P., Irvin C., Reidy M.A. Inhibition of matrix metalloproteinase activity inhibits smooth muscle cell migration but not neointimal thickening after arterial injury. Circ. Res. 1996;78:38–43. doi: 10.1161/01.res.78.1.38. [DOI] [PubMed] [Google Scholar]
  • 33.Southgate K.M., Davies M.B.R., Newby A.C. Involvement of extracellular-matrix-degrading metalloproteinases in rabbit aortic smooth-muscle cell proliferation. Biochem. J. 1992;288:93–99. doi: 10.1042/bj2880093. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Karam A.K., Santiskulvong C., Fekete M., Zabih S., Eng C., Dorigo O. Cisplatin and PI3kinase inhibition decrease invasion and migration of human ovarian carcinoma cells and regulate matrix-metalloproteinase expression. Cytoskeleton. 2010;67:535–544. doi: 10.1002/cm.20465. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Tamura Y., Watanabe F., Nakatani T., Yasui K., Fuji M., Komurasaki T., Tsuzuki H., Maekawa R., Yoshioka T., Kawada K., et al. Highly selective and orally active inhibitors of type IV collagenase (MMP-9 and MMP-2): N-sulfonylamino acid derivatives. J. Med. Chem. 1998;41:640–649. doi: 10.1021/jm9707582. [DOI] [PubMed] [Google Scholar]
  • 36.Ikeda M., Maekawa R., Tanaka H., Matsumoto M., Takeda Y., Tamura Y., Nemori R., Yoshioka T. Inhibition of gelatinolytic activity in tumor tissues by synthetic matrix metalloproteinase inhibitor: Application of film in situ zymography. Clin. Cancer Res. 2000;6:3290–3296. [PubMed] [Google Scholar]
  • 37.Nyormoi O., Mills L., Bar-Eli M. An MMP-2/MMP-9 inhibitor, 5a, enhances apoptosis induced by ligands of the TNF receptor superfamily in cancer cells. Cell Death Differ. 2003;10:558–569. doi: 10.1038/sj.cdd.4401209. [DOI] [PubMed] [Google Scholar]
  • 38.Rowinsky E.K., Humphrey R., Hammond L.A., Aylesworth C., Smetzer L., Hidalgo M., Morrow M., Smith L., Garner A., Sorensen J.M., et al. Phase I and pharmacologic study of the specific matrix metalloproteinase inhibitor bay 12-9566 on a protracted oral daily dosing schedule in patients with solid malignancies. J. Clin. Oncol. 2000;18:178–186. doi: 10.1200/JCO.2000.18.1.178. [DOI] [PubMed] [Google Scholar]
  • 39.Kilian M., Gregor J.I., Heukamp I., Hanel M., Ahlgrimm M., Schimke I., Kristiansen G., Ommer A., Walz M.K., Jacobi C.A., et al. Matrix metalloproteinase inhibitor RO 28-2653 decreases liver metastasis by reduction of MMP-2 and MMP-9 concentration in bop-induced ductal pancreatic cancer in syrian hamsters: Inhibition of matrix metalloproteinases in pancreatic cancer. Prostaglandins Leukot. Essent. Fatty Acids. 2006;75:429–434. doi: 10.1016/j.plefa.2006.08.004. [DOI] [PubMed] [Google Scholar]
  • 40.Mohamed B., Feighery C., Kelly J., Coates C., O’Shea U., Barnes L., Abuzakouk M. Increased protein expression of matrix metalloproteinases -1, -3, and -9 and TIMP-1 in patients with gluten-sensitive enteropathy. Dig. Dis. Sci. 2006;51:1862–1868. doi: 10.1007/s10620-005-9038-4. [DOI] [PubMed] [Google Scholar]
  • 41.Boehm J.S., Hahn W.C. Understanding transformation: Progress and gaps. Curr. Opin. Genet. Dev. 2005;15:13–17. doi: 10.1016/j.gde.2004.11.003. [DOI] [PubMed] [Google Scholar]
  • 42.Chou T.-C., Talalay P. Quantitative analysis of dose-effect relationships: The combined effects of multiple drugs or enzyme inhibitors. Adv. Enzyme Regul. 1984;22:27–55. doi: 10.1016/0065-2571(84)90007-4. [DOI] [PubMed] [Google Scholar]
  • 43.Bliss C. The toxicity of poisons applied jointly. Ann. Appl. Biol. 1939;26:585–615. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

ijms-14-02085-s001.pdf (748KB, pdf)

Articles from International Journal of Molecular Sciences are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES