Skip to main content
Scientific Reports logoLink to Scientific Reports
. 2017 Mar 16;7:44693. doi: 10.1038/srep44693

Role of Cyclooxygenase-2 on Intermittent Hypoxia-Induced Lung Tumor Malignancy in a Mouse Model of Sleep Apnea

Noelia Campillo 1,2,3, Marta Torres 3,4, Antoni Vilaseca 1, Paula Naomi Nonaka 1, David Gozal 5, Jordi Roca-Ferrer 3,6,7, César Picado 3,6,7, Josep Maria Montserrat 3,4, Ramon Farré 1,3,6, Daniel Navajas 1,2,3, Isaac Almendros 1,3,6,a
PMCID: PMC5353645  PMID: 28300223

Abstract

An adverse role for obstructive sleep apnea (OSA) in cancer epidemiology and outcomes has recently emerged from clinical and animal studies. In animals, intermittent hypoxia (IH) mimicking OSA promotes tumor malignancy both directly and via host immune alterations. We hypothesized that IH could potentiate cancer aggressiveness through activation of the cyclooxygenase-2 (COX-2) pathway and the concomitant increases in prostaglandin E2 (PGE2). The contribution of the COX-2 in IH-induced enhanced tumor malignancy was assessed using celecoxib as a COX-2 specific inhibitor in a murine model of OSA bearing Lewis lung carcinoma (LLC1) tumors. Exposures to IH accelerated tumor progression with a tumor associated macrophages (TAMs) shift towards a pro-tumoral M2 phenotype. Treatment with celecoxib prevented IH-induced adverse tumor outcomes by inhibiting IH-induced M2 polarization of TAMs. Furthermore, TAMs isolated from IH-exposed mice treated with celecoxib reduced the proliferation of LLC1 naïve cells, while the opposite occurred with placebo-treated IH-exposed mice. Finally, in vitro IH exposures of murine macrophages and LLC1 cells showed that both cell types increased PGE2 release in response to IH. These results suggest a crucial role for the COX-2 signaling pathway in the IH-exacerbated malignant processes, and designate macrophages and lung adenocarcinoma cells, as potential sources of PGE2.


Obstructive sleep apnea (OSA) is a prevalent condition characterized by repetitive occlusions of the upper airway during sleep resulting in intermittent hypoxia (IH), increased respiratory efforts and sleep fragmentation1. Over the last several decades, epidemiological, clinical and experimental evidences have provided significant support to the contention that OSA, and more specifically IH, operates as an independent risk factor for cardiovascular, cognitive and metabolic morbidities2,3,4. More recently, a potential link between OSA and cancer incidence and mortality has also been proposed based on epidemiological and animal studies5,6,7,8,9.

The presence of hypoxia within the tumor microenvironment can impair anti-cancer immunity responses through alterations in the secretion of cytokines, chemokines and other pro-inflammatory molecules that mediate the cross-talk between tumor cells and immune cells in the tumor stroma10,11,12. In the context of OSA, recent studies indicate that IH can facilitate cancer progression mainly through alterations in the host immune response13,14,15. More specifically, IH increases the mobilization of tumor-associated macrophages (TAMs) into the tumor, and accelerates their transformation from an anti-tumoral phenotype (M1) to a tumor-promoting phenotype (M2). In addition to TAMs, the recruitment of other immunosuppresive populations such as myeloid-derived suppressor cells (MDSCs) or regulatory T lymphocytes (Tregs) from surrounding tissues is also enhanced by IH13,14,15. Taken together, the IH-induced changes on the tumoral immune response would be anticipated to lead to a more tumor-permissive microenvironment, thus facilitating processes such as tumor growth, invasion, or dissemination, as previously reported8,9,13.

The cyclooxygenase-2 (COX-2) downstream metabolite prostaglandin E2 (PGE2) has been proposed to play a critical role in the interplay between tumor cells and stromal cells16,17. PGE2 can promote tumor cell proliferation, migration and invasion either directly, or indirectly through induction of a tumor-permissive microenvironment characterized by impaired immunosurveillance and increased angiogenesis16,17,18. Indeed, several reports have shown that COX-2 is up-regulated in different types of tumors, including colorectal, breast or lung carcinomas, and such altered expression of COX-2 is directly correlated with poor prognosis17,19. Hence, targeting COX-2 activity through nonsteroidal anti-inflammatory drugs (NSAIDs) has been proposed as a potentially promising strategy in the prevention and treatment of cancer20. In this context, NSAIDs have been widely employed over the last decades in pre-clinical and clinical trials as COX inhibitors, facilitating anti-tumoral host immune responses (mainly through the reduction of the M2-like polarization of TAMs and the infiltration of regulatory cells), and decreasing the incidence and mortality in several types of cancer21,22.

Even though COX-2 expression is stimulated by oncogenes, tumor promoters, growth factors and cytokines23,24, several reports point to an important role of microenvironmental factors, such as tumor hypoxia, in the up-regulation of COX-2 expression and the resultant tumor progression25,26. Previous in vitro studies have shown that COX-2 is up-regulated in endothelial and tumor cells in response to IH to levels that exceed even those observed in cells exposed to continuous hypoxia27. However, the IH cyclical pattern applied in the in vitro study clearly differs from the IH patterns that are characteristic of OSA, since the former occurs as a consequence of the irregular blood flow caused by aberrant non-periodic occlusions in vessels during tumor growth (lasting from many minutes to hours), while the latter is associated with recurrent apneas (lasting only seconds to minutes). Rodent studies focused on OSA have also reported a causal role of COX-2 in the microglial-specific neuroinflammation and the adverse neurocognitive consequences in response to IH28,29. Therefore, we used celecoxib (Ce), a well-characterized and specific COX-2 inhibitor, to investigate whether the COX-2/PGE2 signaling pathway participates in the IH-induced exacerbation of malignant processes using a mouse model of OSA bearing Lewis lung carcinoma (LLC1) tumors. Furthermore, we also assessed which cell type, namely macrophages or tumor cells, provides the major source of PGE2 in response to IH using a well-established in vitro model.

Methods

Cells and reagents

Mouse Lewis lung carcinoma cells (LLC1) and mouse macrophages (RAW 264.7) (American Type Culture Collection, Manassas, VA) were routinely grown as described in the online Supplementary Material. Celecoxib (Ce) preparation and administration, as well as antibodies for fluorescence-activated cell sorting (FACS) are also detailed in this section.

Animals, in vivo IH exposure and drug treatment

Forty C57BL/6 J 10-week old male mice, obtained from Charles River Laboratories (Saint Germain sur L’Arbresle, France), were maintained in a 12-h light/dark cycle and fed with a regular diet chow and tap water ad libitum. All experimental procedures were approved by the Ethical Committee for Animal Research of the University of Barcelona (67/15), following relevant guidelines on the care and use of animals and were authorized by the Generalitat de Catalunya Government (8473).

Mice were randomly exposed to either IH (n = 20) or normoxia (N) (n = 20) using an experimental setting previously described8. The IH pattern consisted of cycles of 40 seconds of 21% FiO2 followed by 20 seconds 5% FiO2 for 6 h/day, 6 days/week. This pattern reproduces the oscillations in the arterial oxygen saturation (95.4% to 62.3%) observed in moderate to severe OSA patients30. The control group was identically instrumented, but subjected to N (21% FiO2). After one week of exposures to N or IH, ten mice from each group were treated daily with 75 mg/kg body weight of Ce or vehicle (14% DMSO in sesame oil) via oral gavage (Fine Science Tools GmbH, Heidelberg, Germany), and the drugs were administered one hour prior to initiation of IH or N exposures. Therefore, four groups were performed: animals subjected to N or IH and treated with vehicle or Ce (N, N+Ce, IH, IH+Ce, n = 10 each) (Fig. S1). The daily Ce dose employed was below the maximum tolerated for mice (250 mg/kg) and similar to several other studies on the effects of Ce on cancer31,32.

Lung tumor induction and assessment of tumor malignancy

Prior to the inoculation of tumor cells in mice, the capacity of LLC1 to respond to PGE2 (Cayman Chemicals) was examined in vitro. To that end, LLC1 cells were seeded in triplicate on 24-well plates at a density of 65,000 cells/well and treated with 10−6 mM PGE2. The concentration of PGE2 chosen for this assay was similar to that measured in the plasma of different murine cancer models33,34. Cells were maintained for 40 h at 20% O2, 5% CO2, 100% humidity and 37°C. At the end-point of the experiments, cells were harvested, stained with trypan blue (Sigma-Aldrich, St. Louis, MO) and live cells were counted in a Neubauer chamber using an optical inverted microscope.

After two weeks of pre-exposures to IH or N, animals were subcutaneously injected with 105 LLC1 cells suspended in 0.2 ml of 1x phosphate buffered saline (PBS) in the right flank. Once tumors became palpable, tumor volume was estimated as described before13. All mice were euthanized by exsanguination followed by cervical dislocation at day 21 post-injection. Tumors were excised, weighted and the disruption of capsule with presence of invasion toward the skeletal muscle was visually assessed by two blinded investigators. Samples were prepared for FACS, TAMs isolation and western blot (WB). Lung lobes were extracted, fixed in Histofix (Panreac) and paraffin-embedded. Blocks were cut into 4 μm sections, stained with hematoxylin/eosin and blindly examined under light microscopy to assess metastatic potential by one of the investigators who was unaware of the treatment group. Total number of LLC1 metastases, relative metastatic area and mean size of each metastasis per group were calculated. Histological sections were also performed in some tumor samples and examined under microscopy to confirm findings regarding tumor invasion. COX-2 protein levels in the tumor were examined by WB (see online Supplementary Material for detailed protocol).

Assessment of Tregs, MDSCs and TAMs populations by flow cytometry

Tumors were minced and digested in a 1 mg/mL collagenase type IA (Gibco, Gaithersburg, MD) solution for 1 h at 37 °C. Cells were filtered through a 100 μm nylon mesh cell strainer (BD Falcon, Bedford, MA) and stained with fluorophore-conjugated antibodies for the identification and quantitative analysis of Tregs, TAMs and MDSCs populations by FACS as previously described13. Labelled cells were analyzed on a FACS Canto II cytometer using FACS Diva 5.5 software (BD Biosciences, San Jose, CA) and analyzed by FlowJo software (Tree Star, San Carlos, CA). The subpopulation of Tregs was identified by FoxP3 and CD45+, CD3+, CD4+, CD8-, CD25+ cell surface markers, while MDSCs were recognized by CD45+, CD11b+ and Gr-1+ markers, and TAMs as CD45+, CD11b+ and F4/80+. Polarization of TAMs towards M2 or M1 phenotype was assessed by measuring CD206 or CD86 surface markers, respectively. In addition, the M2/M1 ratio was computed from the quotient between the mean fluorescence intensity (MFI) values for CD206 and CD86 markers. Isotype controls were employed to establish background fluorescence. Cell populations were measured as cells per gram of tumor and total numbers of TAMs, Tregs and MDSCs recruited within the tumor.

Determination of M1/M2 TAMs phenotype by real-time polymerase chain reaction

Gene expression analyses of M1 (INF-γ, interferon gamma) and M2 markers (MRC1, mannose receptor C type 1; IL-10, interleukin 10) by real-time polymerase chain reaction (qPCR) were performed in isolated TAMs to further assess their polarization. Firstly, TAMs were purified from digested tumors by CD11b-PE magnetic labelling (EasySepTMMouse CD11b Positive Selection Kit, StemCell Technologies, Vancouver, BC) following the manufacturer’s protocol. Then, total RNA from isolated TAMs was extracted using the RNeasy kit (Qiagen, Hilden, Germany) and 0.5 μg were used to synthesize cDNA by reverse transcription polymerase chain reaction, according to manufacturers’ instructions. qPCR was performed using the Taqman Gene Expression Master Mix (ThermoFisher Scientific, Waltham, MA) in a StepOnePlus thermocycler (ThermoFisher Scientific, Waltham, MA). Relative gene expression normalized to eukaryotic 18 S rRNA endogenous control was calculated using the 2−∆∆CT method to quantify fold change in gene expression of IFN-γ, IL-10 and Mcr1 compared to baseline expression (N group). Taqman Gene Expression Assays were purchased from ThermoFisher Scientific. PTGS2 (prostaglandin-endoperoxide synthase 2) relative gene expression was also assessed in TAMs from N and IH groups to complement data regarding COX-2 protein expression in tumors.

Co-culture of tumor associated macrophages with LLC1 cells in vitro

Isolated TAMs were co-cultured with LLC1 naïve cells (4:1 ratio) in full media for three days13. At the end point, cells were harvested, labeled with CD45-FITC and both cell types were identified (TAMs as CD45+ cells and LLC1 as CD45- cells) and counted by FACS to determine LLC1 proliferation.

Assessment of PTGS2 gene expression and PGE2 production by LLC1 and RAW 264.7 cells exposed to IH in vitro

LCC1 and RAW 264.7 cell exposures to N (20% O2) or IH (30 s 1% O2–30 s 20% O2) were performed using a custom-made system adapted from a chip previously described35. The chip employed herein is composed by two PDMS layers designated as gas and culture chambers containing six PDMS wells of 12 mm diameter each. Both chambers are separated by a 20 μm thick PDMS membrane (Fig. S2a,b). Wells of the gas chamber are connected in series allowing circulation of gases from a gas source providing a constant mixture of gases (N) or oscillations in gas composition (IH) to the six independent cell cultures adhered on top of the membrane (culture chamber). Oxygen measurements performed on top of membrane (at the cell culture level) using a fiber-optic oxygen sensor (FireSting O2, Pyro Science, Aachen, Germany) showed that, in agreement with our previous study, the system displays a fast equilibration time (~6 s) due to fast oxygen diffusion through the thin membrane (Fig. S2c). Therefore, oxygen desaturation patterns experienced by OSA patients can be replicated at the cell culture level or in living animal tissues using the in vitro and in vivo models described herein, respectively.

Prior to experiments, the viability of LLC1 and RAW 264.7 cells at different concentrations of Ce was tested such as to select the optimal concentration and avoid toxicity-induced cell death (see Supplementary Fig. S3). LLC1 and RAW 264.7 single cultures treated with Ce (10 μM) or vehicle (0.05% DMSO) were exposed to either IH (30 s 1% O2–30 s 20% O2) or N (20% O2) for 24 h (Fig. S2d). Then, supernatants were collected, centrifuged at 300 g for 5 min to discard possible cells in suspension and total levels of PGE2 (pg) in cell media supernatants were determined using mouse PGE2 ELISA kit (Cayman Chemical, Tallinn, Estonia), according to the manufacturer’s protocol. RAW264.7 and LLC1 cells were harvested and PTGS2 relative gene expression was assessed as described above for the in vivo study.

Statistical analysis

Data are reported as mean ± standard error (SE). Shapiro-Wilk tests were performed to ensure normal distribution of samples prior to analysis. Data from N, N+Ce, IH, IH+Ce groups were compared using two-way analysis of variance (ANOVA). Gas and drug exposures constituted the variables. Student-Newman-Keuls post hoc test was used for multiple comparisons. T-test analyses were used to compare LLC1 in vitro proliferation in presence or absence of PGE2, COX-2 protein levels in tumors and PTGS2 gene expression in TAMs from N and IH groups. Differences were considered significant for p < 0.05. Statistical analyses were performed with SigmaPlot (Systat Software, San Jose, CA).

Results

Celecoxib inhibits IH-induced tumor malignancy changes

IH exposures promoted accelerated tumor growth from tumor weight and tumor volume measurements (2.07 g ± 0.28 and 1.57 cm3 ± 0.18, respectively) when compared to normoxic mice (0.95 g ± 0.15, p < 0.001; 0.90 cm3 ± 0.19 p = 0.005) (Fig. 1a,b). Similarly, the number of mice presenting evidence of local tumor invasion in surrounding tissues was higher in mice exposed to IH (Fig. 1c). No statistically significant differences emerged in the total number of LLC1 metastases, relative metastatic area, and mean size of metastases among the different groups (Fig. 1d). While the number of metastases slightly increased in mice exposed to N, the mean size of the metastases was lower than the observed in the IH groups. Nevertheless, the large variability among samples within the same treatment group hindered the statistical analyses. Tumors from IH-exposed mice presented a trend to an increased COX-2 protein expression in comparison to N (p = 0.284) (Fig. 1e). Similarly, isolated TAMs also exhibited a trend to increased expression of the PTGS2 gene (p = 0.106) (Fig. 1f). Daily administration of Ce markedly decreased IH-induced tumor growth (tumor weight = 0.42 g ± 0.12; tumor volume = 0.38 cm3 ± 0.13, p < 0.001) (Fig. 1a,b). Application of PGE2 to LLC1 cells in vitro elicited a 2-fold increase in proliferation (p = 0.017), confirming that this tumor model functionally responds to PGE2 (Fig. 1g).

Figure 1. Tumor growth and invasion in celecoxib (Ce) or vehicle-treated mice exposed to normoxia (N) or intermittent hypoxia (IH).

Figure 1

(a) Periodic tumor volume measurements revealed an accelerated tumor growth in IH-treated mice compared to N, which was inhibited by Ce administration. (b) Weight average of tumors from mice exposed to IH experienced ~2-fold increase respect to N. Under IH conditions, daily administration of Ce promoted a markedly reduction in tumor weight. (c) Representative histological sections of the tumor and the adjacent muscle presenting non-invasion (left) or invasion (right). LLC1 cells are predominantly stained by hematoxylin (dark blue, yellow arrows) whereas myocytes are more intensely stained with eosin (pink, white arrows). Scale bar = 100 μm. The number of mice presenting invasion was higher in IH vs N exposed mice. (d) Number of lung metastases, mean size, and relative metastatic area do not exhibit significant variations among the different treatments due to a high intra-group variability. Representative image of a metastasis (yellow arrow) in the lung parenchyma. Scale bar = 100 μm. Tumors (e) and purified TAMs (f) from IH-exposed mice showed a trend to an increased COX-2 protein and PTGS2 gene relative expression, respectively. (g) LLC1 proliferation in response to exogenous PGE2 in vitro. Data are presented as mean ± SE.

Celecoxib suppresses the IH-induced alterations in the host immune response

In absence of Ce treatment, a 2-fold increase (p = 0.014) in TAMs population and 2.5-fold increases in MDSCs (p = 0.014) and Tregs (p = 0.006) counts emerged in tumors from mice exposed to IH when compared to the N group (Fig. 2a). Conversely, in IH-exposed animals receiving Ce, TAMs, Tregs and MDSCs counts were restored to N basal levels. When normalizing for tumor weight (Fig. 2b), the number of TAMs, MDSCs and Tregs remained similar among the different conditions. See Fig. S4 for representative flow cytometry dot plots of gated populations.

Figure 2. Tumor associated macrophages (TAMs), myeloid-derived suppressor cells (MDSCs) and regulatory T cell lymphocytes (Tregs) within the tumor.

Figure 2

(a) Application of IH resulted in an enhanced tumor weight and hence increased total number of TAMs, MDSCs and Tregs populations within the tumor, while Ce administration prevented tumor growth and therefore reduced cell numbers. b) No significant differences in cell population density (cells/g of tumor) of TAMs, MDSCs and Tregs were observed amongst different groups. Data are presented as mean ± SE.

Most importantly, IH exposures induced a polarity shift in TAMs from an anti-tumoral phenotype (M1) towards a tumor-promoting phenotype (M2), as reflected by a ~2-fold increase in M2/M1 ratios when compared to mice exposed to N (p < 0.001) (Fig. 3a). Accordingly, qPCR analyses carried out on isolated TAMs revealed that IH treatment downregulated the expression of the M1 marker INF-γ (p = 0.021) while the expression of the M2 markers MCR1 (p = 0.008) and IL-10 (p = 0.083) was up-regulated, in comparison to N (Fig. 3b). On the other hand, the M2/M1 ratios in Ce-treated mice exposed to IH as well as the expression of genes associated with M1 and M2 phenotypes were restored to levels similar to those found among tumors in normoxic mice. No changes in TAMs polarization were observed between N and N+Ce groups.

Figure 3. Polarization of tumor-associated macrophages (TAMs) and their effects on LLC1 cell proliferation.

Figure 3

(a) Assessment of CD206 (M2 phenotype marker, upper) and CD86 (M1 phenotype marker, lower) in TAMs by FACS as well as representative mean fluorescence intensity (MFI) histograms of each marker in N, N+Ce, IH and IH+Ce samples. Up-regulation of M2 marker was observed in TAMs from mice that underwent IH treatment, whereas Ce resulted effective avoiding M2-like polarization. M2/M1 ratio calculated from the quotient between CD206 and CD86 MFIs increased consistently in IH-exposed animals, and was prevented in IH-treated mice that received Ce (center). (c) Proliferation of LLC1 cells co-cultured with TAMs isolated from mice. LLC1 cells increased their proliferation when co-cultured with TAMs obtained from IH-exposed mice, whereas IH+Ce TAMs significantly reduced LLC1 cell proliferation respect to the IH-treated group. Representative dot plot depicting the gating performed to identify CD45+, CD11b+ (TAMs) and CD45−, CD11b− (LLC1) populations during FACS analysis. Data are presented as mean ± SE, MFI = Mean fluorescence intensity (arbitrary units).

Co-culture of naïve LLC1 with TAMs from tumors of IH-exposed mice induced increased proliferation relative to N-exposed TAMs (Fig. 3c, p = 0.009). However, when LLC1 cells were co-cultured with TAMs from IH+Ce-exposed mice, cell numbers were significantly decreased to levels slightly below those of LLC1 co-cultured with N TAMs (p = 0.003).

Celecoxib inhibits the increased PGE2 production by LLC1 and RAW 264.7 cells in response to IH in vitro

RAW 264.7 macrophages and LLC1 cells exposed to IH for 24 h exhibited ~4.5-fold and ~1.5-fold increases in PGE2 production, respectively (Fig. 4a, n = 6 p < 0.001; Fig. 4b, n = 5, p = 0.014), when compared to normoxic conditions. Similarly, IH induced an up-regulation of PTGS2 expression in macrophages (p = 0.003), while no changes were observed in the PTGS2 gene expression in tumor cells (Fig. 4c,d). The addition of 10 μM Ce to the cell media significantly reduced PGE2 secretion to levels observed under normoxia (RAW 264.7) or even below (LLC1 cells) (p < 0.001), while PTGS2 gene expression did not change in response to Ce treatment.

Figure 4. Alterations in the COX-2/PGE2 signaling pathway in by RAW 264.7 and LLC1 cells exposed to IH and/or Ce treatment in vitro.

Figure 4

PGE2 secretion by RAW 264.7 macrophages (a) and LLC1 cells (b) exposed to IH increased significantly in comparison to N, while Ce administration resulted in a reduction of PGE2 production in both cell types near to N levels (RAW 264.7 cells) or even below (LLC1 cells). PTGS2 relative gene expression was up-regulated in RAW264.7 cells in response to IH (c) while no changes were detected in the case of PTGS2 by LLC1 cells between different treatments (d). Data are presented as mean ± SE.

Discussion

In this study, we found that the IH-induced enhancements of tumor malignancy are mediated, at least in part by the COX-2/PGE2 signaling pathway. The application of the COX-2 specific inhibitor Ce suppressed IH-induced alterations in the host immune response within the tumor microenvironment, leading to a marked reduction in tumor growth. Furthermore, LLC1 cells increased their proliferative rates in response to exogenous PGE2 at concentrations previously measured in several types of cancer33,34. In vitro exposure of macrophages and LLC1 cells to IH resulted in the activation of the COX-2/PGE2 pathway, suggesting that these cells are likely sources of PGE2 in the tumor microenvironment and also can further increase in response to IH.

Recent clinical and translational studies have suggested a link between OSA and increased cancer incidence, aggressiveness and mortality5,6,7,8,9. Animal studies have further revealed that IH exposures that mimic OSA-induced oxygenation patterns during sleep lead to accelerated tumor growth, invasiveness and metastasis in certain types of tumors such as lung carcinoma13 and melanoma9. In the present study, LLC1 tumors had similar responses to IH as those reported in previous studies with other types of cancer cells8,9,13. Concretely, IH led to increased tumor growth and invasiveness in LLC1 tumors. In contrast to previous findings, no changes in tumor metastases were observed, a finding that may be explained by the highly aggressive metastatic behavior of these cells even in control conditions32. PTGS2 gene and COX-2 protein expression showed a trend toward increases in purified TAMs and in tumors isolated from IH-exposed mice in comparison to normoxia, respectively. Given that the biological material available to perform WB and qPCR analyses was limited owing to the reduced size of tumors (especially in Ce groups) and that samples were mostly used to perform FACS analyses and TAMs co-cultures with LLC1, it becomes apparent that larger sample sizes would be desirable to draw a more definitive conclusion. Regarding the immune alterations promoted by IH, our results are closely concordant with previous data on other tumors13,14. FACS analysis revealed alterations in TAMs polarity from the classically activated anti-tumoral M1 phenotype towards an alternatively activated pro-tumoral M2 phenotype. Accordingly, qPCR analyses further confirmed the enhanced expression of MRC1 and IL-10 genes (M2 markers) and the decreased expression of IFN-γ (M1 marker) in TAMs isolated from IH-exposed mice. In fact, the polarity switch of TAMs is currently considered a key step in the acceleration of cancer aggressiveness, and has been directly associated with a poor prognosis in several types of tumors36,37. Despite the fact that IH-exposed tumors had increased TAMs, MDSCs and Tregs counts, the number of cells per gram of tumor remained similar among groups, suggesting that the increased tumor aggressiveness observed in animals treated with IH is most likely explained by a change in TAMs phenotype rather than ascribable to an increased infiltration of other immunosuppressive populations. Other studies observed an accumulation of MDSCs and Tregs which was associated with increased malignant properties, since both populations impair tumor immunosurveillance by limiting the infiltration and functions of cytotoxic populations38, while also promoting the M2-like polarization of TAMs39.

There is increasing evidence suggesting that biochemical signals participating in the cross-talk between tumor cells and tumor stromal cells are essential for cancer escape (i.e. transcription factors, growth factors and some cytokines)40. In addition, biophysical cues of the tumor microenvironment (i.e. hypoxia41 or extracellular matrix components which can modulate its stiffness42) have also been implicated. PGE2, a downstream product of COX-2 enzymatic activity, has been identified as a major orchestrator, coordinating the pro-angiogenic and immunosuppressive programs that facilitate tumor growth and contribute to cancer progression16,18. Regarding immunosuppression, a large body of evidence indicates that PGE2 plays an important role in the initiation and maintenance of M2 polarized TAMs, as well in promoting the suppression of M1 polarity22,43. In addition, PGE2 downregulates anti-tumoral Th1 responses while promoting pro-tumoral Th2 responses of T helper cells44, limits the proliferation and functionality of cytotoxic T-lymphocytes and natural killer (NK) cells16,45, induces the recruitment of Tregs and MDSCs populations16, and inhibits the differentiation of dendritic cells46. Moreover, PGE2 also increases the proliferation, survival, migration and invasion of tumor cells through its binding to their specific receptors47. In fact, high levels of PGE2 in the tumor resulting from the aberrant activation of COX-2 are commonly considered as indicators of a poorer cancer prognosis in different types of malignancies such as melanoma, breast, colon, lung, or gastric cancer17. In this study, LLC1 cells exposed in vitro to PGE2 augmented their proliferative rate revealing their susceptibility to respond to this inflammatory mediator likely through its binding to the EP4 receptor48 (Fig. 1g). Although COX-2 up-regulation in cancer cells has been classically linked to the activation of oncogenes or transcription factors, it has been also detected in tumor cells and other cells of tumor stroma in response to hypoxia, via stabilization of hypoxia inducible factor 1 (HIF-1) and nuclear factor kappa-light-chain-enhancer of activated B cells (NF-κB)25,26,49. In fact, hypoxic regions of the tumor positively correlate with increased COX-2 expression, accumulation of M2-like polarized macrophages and other immunosuppressive cells41.

In the context of IH, a previous study showed the potential involvement of COX-2 in the transcriptomic adaptation of endothelial and tumor cells to low frequency cyclic hypoxia27. Similarly, studies in the field of OSA, also reported the participation of COX-2 in the pathogenesis of OSA-related morbidities28. Thus, the link between COX-2 and IH is not only biologically plausible, but further appears to underlie components of the enhanced aggressive biological properties of cancer in the context of OSA. To characterize the potential implications of COX-2/PGE2 signaling pathway in the IH-enhanced tumor growth and aggressiveness in the mouse model of OSA bearing LLC1 tumors, we employed Ce, a specific inhibitor of COX-2. Experimental studies and clinical trials have been carried out over the last decades to assess the potential therapeutic role of Ce and other COX-2 inhibitors in the prevention and treatment of different types of cancer20,21. Although most clinical trials point to a better prognosis in patients receiving Ce treatment in addition to chemo-, radio- or chemoradiotherapy, there is still a lack of consensus and certainly some degree of controversy about the therapeutic role of this compound, probably due to the presence of multiple other confounding factors affecting cancer outcomes50,51. Notwithstanding, the effectiveness of Ce in delaying tumor growth and improving cancer prognosis has been shown in several types of cancer both in vivo and in vitro, when experimental conditions were tightly controlled22,32. In the present study, the effect of Ce on tumor growth was evident in IH-exposed animals, and induced 5-fold reductions in tumor weight and volume. In addition, Ce reduced the number of animals presenting tumor invasion to adjacent muscle. These improvements in cancer prognosis could be partially explained by the recovery of the anti-tumoral responses of the immune system as reflected by increases in M1 polarized TAMs and reductions in the M2-like polarization of TAMs through the specific inhibition of COX-2 by Ce, as determined by FACS, qPCR and ELISA analyses. Similar findings were previously observed in murine models of cancer that were unrelated to OSA or IH22,52. Some studies have also documented an increase in the infiltration of cytotoxic T-lymphocytes and NK cells53. Although we did not assess the effects of IH and/or Ce on the recovery of such immune populations, we would anticipate similar findings based on the reduction of PGE2 production by Ce.

The in vitro experiments carried out with isolated TAMs from tumors confirmed that the phenotypic changes have implications in LLC1 proliferation in co-culture. Similar to our previous findings13, LLC1 naïve cells co-cultured with TAMs from mice exposed to IH showed increased proliferation over those co-cultured with N-exposed TAMs. When co-cultured with TAMs from IH-exposed animals treated with Ce, LLC1 cells significantly reduced their proliferation. Moreover, LLC1 single cultures showed higher proliferative capacity when exogenous PGE2 at a concentration similar to that found in plasma from different mouse models of cancers33,34 was added to the media. These findings confirm that PGE2 is able to directly induce tumor cell growth in our model, most likely through binding to specific receptors in LLC1 cells.

Macrophages and tumor cells (RAW 264.7 and LLC1 cell lines, respectively) were single cultured and exposed to IH in vitro in order to identify which cells is the major source of PGE2 in the tumor in response to IH. qPCR and ELISA analyses revealed that IH induced significant increases in PTGS2 gene expression and PGE2 production by macrophages. In tumor cells, PGE2 production was also increased in response to IH; however, no changes on PTGS2 gene expression were detected. This finding could be explained by the increased expression of PTGS2 on tumor cells even in basal conditions23,24, with IH most likely being associated with modulation of expression at the protein level. Addition of Ce to the media inhibited PGE2 production, supporting the efficiency of this drug in delaying tumor malignancy by reducing PGE2 secretion by TAMs and cancer cells and also their positive-feedback, hence supporting the findings in vivo43. Taken together, these results suggest that despite the fact that macrophages are more prone to exhibit alterations in the COX-2/PGE2 pathway in response to IH, both cell types (macrophages and LLC1 cells) are relevant sources of PGE2 in our murine model of OSA.

In conclusion, the increased tumor malignant properties associated with IH appear to be mediated, at least in part, by the up-regulation of the COX-2/PGE2 pathway in tumor cells and macrophages. Our findings provide further support to the concept that NSAIDS, and more concretely Ce, could provide effective benefits in the treatment of tumors whose proliferative properties and vascularity patterning make them more susceptible to regional hypoxic cycles, as well as in the context of cancer patients suffering from OSA.

Additional Information

How to cite this article: Campillo, N. et al. Role of Cyclooxygenase-2 on Intermittent Hypoxia-Induced Lung Tumor Malignancy in a Mouse Model of Sleep Apnea. Sci. Rep. 7, 44693; doi: 10.1038/srep44693 (2017).

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Material

Supplementary Material
srep44693-s1.doc (1.5MB, doc)

Acknowledgments

The authors wish to thank Miguel Ángel Rodríguez and Maeba Polo from the Unit of Biophysics and Bioengineering (University of Barcelona) for their technical assistance. The authors are indebted to the Cytomics core facility of the Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS) for the technical support. This work was supported in part by the Spanish Ministry of Economy and Competitiveness (Instituto de Salud Carlos III; PI14-00004; PI14-00280) and SEPAR (086/2014; 139/2015).

Footnotes

The authors declare no competing financial interests.

Author Contributions N.C., R.F., D.N., D.G., J.M.M. and C.P. participated in the conceptual framework of the project. N.C., M.T., A.V., J.R.-F. and P.N.N. performed experiments and analyzed the experimental data. N.C., R.F., D.N., D.G. and I.A. interpreted the results. N.C., I.A., R.F., D.G., D.N. participated in the drafting of the manuscript. D.N., R.F. and I.A. are responsible for the financial support of the project. I.A. conceptualized the project and provided crucial insights throughout all phases of the project. All authors have reviewed and approved the final version of the manuscript.

References

  1. Peppard P. E. et al. Increased prevalence of sleep-disordered breathing in adults. American journal of epidemiology 177, 1006–1014, doi: 10.1093/aje/kws342 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. McNicholas W. T., Bonsigore M. R. & Management Committee of, E. C. A. B. Sleep apnoea as an independent risk factor for cardiovascular disease: current evidence, basic mechanisms and research priorities. The European respiratory journal 29, 156–178, doi: 10.1183/09031936.00027406 (2007). [DOI] [PubMed] [Google Scholar]
  3. Felmet K. A. & Petersen M. Obstructive sleep apnea and cognitive dysfunction. JAAPA: official journal of the American Academy of Physician Assistants 19, 16–20 (2006). [DOI] [PubMed] [Google Scholar]
  4. Bonsignore M. R., Borel A. L., Machan E. & Grunstein R. Sleep apnoea and metabolic dysfunction. European respiratory review: an official journal of the European Respiratory Society 22, 353–364, doi: 10.1183/09059180.00003413 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Nieto F. J. et al. Sleep-disordered breathing and cancer mortality: results from the Wisconsin Sleep Cohort Study. American journal of respiratory and critical care medicine 186, 190–194, doi: 10.1164/rccm.201201-0130OC (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Campos-Rodriguez F. et al. Association between obstructive sleep apnea and cancer incidence in a large multicenter Spanish cohort. American journal of respiratory and critical care medicine 187, 99–105, doi: 10.1164/rccm.201209-1671OC (2013). [DOI] [PubMed] [Google Scholar]
  7. Chen J. C. & Hwang J. H. Sleep apnea increased incidence of primary central nervous system cancers: a nationwide cohort study. Sleep medicine 15, 749–754, doi: 10.1016/j.sleep.2013.11.782 (2014). [DOI] [PubMed] [Google Scholar]
  8. Almendros I. et al. Intermittent hypoxia enhances cancer progression in a mouse model of sleep apnoea. The European respiratory journal 39, 215–217, doi: 10.1183/09031936.00185110 (2012). [DOI] [PubMed] [Google Scholar]
  9. Almendros I. et al. Intermittent hypoxia increases melanoma metastasis to the lung in a mouse model of sleep apnea. Respiratory physiology & neurobiology 186, 303–307, doi: 10.1016/j.resp.2013.03.001 (2013). [DOI] [PubMed] [Google Scholar]
  10. Pollard J. W. Tumour-educated macrophages promote tumour progression and metastasis. Nature reviews. Cancer 4, 71–78, doi: 10.1038/nrc1256 (2004). [DOI] [PubMed] [Google Scholar]
  11. Noman M. Z. et al. Microenvironmental hypoxia orchestrating the cell stroma cross talk, tumor progression and antitumor response. Critical reviews in immunology 31, 357–377 (2011). [DOI] [PubMed] [Google Scholar]
  12. Sceneay J. et al. Primary tumor hypoxia recruits CD11b+/Ly6Cmed/Ly6G+ immune suppressor cells and compromises NK cell cytotoxicity in the premetastatic niche. Cancer research 72, 3906–3911, doi: 10.1158/0008-5472.CAN-11-3873 (2012). [DOI] [PubMed] [Google Scholar]
  13. Almendros I. et al. Intermittent hypoxia-induced changes in tumor-associated macrophages and tumor malignancy in a mouse model of sleep apnea. American journal of respiratory and critical care medicine 189, 593–601, doi: 10.1164/rccm.201310-1830OC (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Almendros I. et al. Adipose tissue macrophage polarization by intermittent hypoxia in a mouse model of OSA: effect of tumor microenvironment. Cancer letters 361, 233–239, doi: 10.1016/j.canlet.2015.03.010 (2015). [DOI] [PubMed] [Google Scholar]
  15. Gozal D., Almendros I. & Hakim F. Sleep apnea awakens cancer: A unifying immunological hypothesis. Oncoimmunology 3, e28326, doi: 10.4161/onci.28326 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Markosyan N., Chen E. P. & Smyth E. M. Targeting COX-2 abrogates mammary tumorigenesis: Breaking cancer-associated suppression of immunosurveillance. Oncoimmunology 3, e29287, doi: 10.4161/onci.29287 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Misra S. & Sharma K. COX-2 signaling and cancer: new players in old arena. Current drug targets 15, 347–359 (2014). [DOI] [PubMed] [Google Scholar]
  18. Greene E. R., Huang S., Serhan C. N. & Panigrahy D. Regulation of inflammation in cancer by eicosanoids. Prostaglandins & other lipid mediators 96, 27–36, doi: 10.1016/j.prostaglandins.2011.08.004 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Hoellen F. et al. Impact of cyclooxygenase-2 in breast cancer. Anticancer research 31, 4359–4367 (2011). [PubMed] [Google Scholar]
  20. Ghosh N., Chaki R., Mandal V. & Mandal S. C. COX-2 as a target for cancer chemotherapy. Pharmacological reports: PR 62, 233–244 (2010). [DOI] [PubMed] [Google Scholar]
  21. Harris R. E. Cyclooxygenase-2 (cox-2) blockade in the chemoprevention of cancers of the colon, breast, prostate, and lung. Inflammopharmacology 17, 55–67, doi: 10.1007/s10787-009-8049-8 (2009). [DOI] [PubMed] [Google Scholar]
  22. Nakanishi Y. et al. COX-2 inhibition alters the phenotype of tumor-associated macrophages from M2 to M1 in ApcMin/+ mouse polyps. Carcinogenesis 32, 1333–1339, doi: 10.1093/carcin/bgr128 (2011). [DOI] [PubMed] [Google Scholar]
  23. Shao J., Sheng H., Inoue H., Morrow J. D. & DuBois R. N. Regulation of constitutive cyclooxygenase-2 expression in colon carcinoma cells. The Journal of biological chemistry 275, 33951–33956, doi: 10.1074/jbc.M002324200 (2000). [DOI] [PubMed] [Google Scholar]
  24. Cui X. et al. Unphosphorylated STAT6 contributes to constitutive cyclooxygenase-2 expression in human non-small cell lung cancer. Oncogene 26, 4253–4260, doi: 10.1038/sj.onc.1210222 (2007). [DOI] [PubMed] [Google Scholar]
  25. Kaidi A., Qualtrough D., Williams A. C. & Paraskeva C. Direct transcriptional up-regulation of cyclooxygenase-2 by hypoxia-inducible factor (HIF)-1 promotes colorectal tumor cell survival and enhances HIF-1 transcriptional activity during hypoxia. Cancer research 66, 6683–6691, doi: 10.1158/0008-5472.CAN-06-0425 (2006). [DOI] [PubMed] [Google Scholar]
  26. Greenhough A. et al. The COX-2/PGE2 pathway: key roles in the hallmarks of cancer and adaptation to the tumour microenvironment. Carcinogenesis 30, 377–386, doi: 10.1093/carcin/bgp014 (2009). [DOI] [PubMed] [Google Scholar]
  27. Daneau G., Boidot R., Martinive P. & Feron O. Identification of cyclooxygenase-2 as a major actor of the transcriptomic adaptation of endothelial and tumor cells to cyclic hypoxia: effect on angiogenesis and metastases. Clinical cancer research: an official journal of the American Association for Cancer Research 16, 410–419, doi: 10.1158/1078-0432.CCR-09-0583 (2010). [DOI] [PubMed] [Google Scholar]
  28. Li R. C. et al. Cyclooxygenase 2 and intermittent hypoxia-induced spatial deficits in the rat. American journal of respiratory and critical care medicine 168, 469–475, doi: 10.1164/rccm.200211-1264OC (2003). [DOI] [PubMed] [Google Scholar]
  29. Smith S. M., Friedle S. A. & Watters J. J. Chronic intermittent hypoxia exerts CNS region-specific effects on rat microglial inflammatory and TLR4 gene expression. PloS one 8, e81584, doi: 10.1371/journal.pone.0081584 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Torres M. et al. Male fertility is reduced by chronic intermittent hypoxia mimicking sleep apnea in mice. Sleep 37, 1757–1765, doi: 10.5665/sleep.4166 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Tong C. T. et al. Effects of celecoxib in human retinoblastoma cell lines and in a transgenic murine model of retinoblastoma. The British journal of ophthalmology 89, 1217–1220, doi: 10.1136/bjo.2004.064915 (2005). [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Park W., Oh Y. T., Han J. H. & Pyo H. Antitumor enhancement of celecoxib, a selective Cyclooxygenase-2 inhibitor, in a Lewis lung carcinoma expressing Cyclooxygenase-2. Journal of experimental & clinical cancer research: CR 27, 66, doi: 10.1186/1756-9966-27-66 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Wang W., Andersson M., Lonnroth C., Svanberg E. & Lundholm K. Prostaglandin E and prostacyclin receptor expression in tumor and host tissues from MCG 101-bearing mice: a model with prostanoid-related cachexia. International journal of cancer 115, 582–590, doi: 10.1002/ijc.20539 (2005). [DOI] [PubMed] [Google Scholar]
  34. Iresjo B. M. et al. Food intake, tumor growth, and weight loss in EP2 receptor subtype knockout mice bearing PGE2-producing tumors. Physiological reports 3, doi: 10.14814/phy2.12441 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Campillo N., Jorba I., Schaedel L., Casals B., Gozal D., Farre R., Almendros I. & Navajas D. A novel chip for cell exposures to cyclic stretch and intermittent hypoxia mimicking obstructive sleep apnea. Front Physiol, 7, 319, doi: 10.3389/fphys.2016.00319 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Medrek C., Ponten F., Jirstrom K. & Leandersson K. The presence of tumor associated macrophages in tumor stroma as a prognostic marker for breast cancer patients. BMC cancer 12, 306, doi: 10.1186/1471-2407-12-306 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Mantovani A., Schioppa T., Porta C., Allavena P. & Sica A. Role of tumor-associated macrophages in tumor progression and invasion. Cancer metastasis reviews 25, 315–322, doi: 10.1007/s10555-006-9001-7 (2006). [DOI] [PubMed] [Google Scholar]
  38. Lindau D., Gielen P., Kroesen M., Wesseling P. & Adema G. J. The immunosuppressive tumour network: myeloid-derived suppressor cells, regulatory T cells and natural killer T cells. Immunology 138, 105–115, doi: 10.1111/imm.12036 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Sinha P., Clements V. K., Bunt S. K., Albelda S. M. & Ostrand-Rosenberg S. Cross-talk between myeloid-derived suppressor cells and macrophages subverts tumor immunity toward a type 2 response. Journal of immunology 179, 977–983 (2007). [DOI] [PubMed] [Google Scholar]
  40. Vendramini-Costa D. B. & Carvalho J. E. Molecular link mechanisms between inflammation and cancer. Current pharmaceutical design 18, 3831–3852 (2012). [DOI] [PubMed] [Google Scholar]
  41. Lewis C. & Murdoch C. Macrophage responses to hypoxia: implications for tumor progression and anti-cancer therapies. The American journal of pathology 167, 627–635, doi: 10.1016/S0002-9440(10)62038-X (2005). [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Acerbi I. et al. Human breast cancer invasion and aggression correlates with ECM stiffening and immune cell infiltration. Integrative biology: quantitative biosciences from nano to macro 7, 1120–1134, doi: 10.1039/c5ib00040h (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Li H. et al. Cyclooxygenase-2 in tumor-associated macrophages promotes breast cancer cell survival by triggering a positive-feedback loop between macrophages and cancer cells. Oncotarget 6, 29637–29650, doi: 10.18632/oncotarget.4936 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Snijdewint F. G., Kalinski P., Wierenga E. A., Bos J. D. & Kapsenberg M. L. Prostaglandin E2 differentially modulates cytokine secretion profiles of human T helper lymphocytes. Journal of immunology 150, 5321–5329 (1993). [PubMed] [Google Scholar]
  45. Holt D., Ma X., Kundu N. & Fulton A. Prostaglandin E(2) (PGE (2)) suppresses natural killer cell function primarily through the PGE(2) receptor EP4. Cancer immunology, immunotherapy: CII 60, 1577–1586, doi: 10.1007/s00262-011-1064-9 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Sombroek C. C. et al. Prostanoids play a major role in the primary tumor-induced inhibition of dendritic cell differentiation. Journal of immunology 168, 4333–4343 (2002). [DOI] [PubMed] [Google Scholar]
  47. Ruan D. & So S. P. Prostaglandin E2 produced by inducible COX-2 and mPGES-1 promoting cancer cell proliferation in vitro and in vivo. Life sciences 116, 43–50, doi: 10.1016/j.lfs.2014.07.042 (2014). [DOI] [PubMed] [Google Scholar]
  48. Yang L. et al. Host and direct antitumor effects and profound reduction in tumor metastasis with selective EP4 receptor antagonism. Cancer research 66, 9665–9672, doi: 10.1158/0008-5472.CAN-06-1271 (2006). [DOI] [PubMed] [Google Scholar]
  49. Schmedtje J. F. Jr., Ji Y. S., Liu W. L., DuBois R. N. & Runge M. S. Hypoxia induces cyclooxygenase-2 via the NF-kappaB p65 transcription factor in human vascular endothelial cells. The Journal of biological chemistry 272, 601–608 (1997). [DOI] [PubMed] [Google Scholar]
  50. Liu R., Xu K. P. & Tan G. S. Cyclooxygenase-2 inhibitors in lung cancer treatment: Bench to bed. European journal of pharmacology 769, 127–133, doi: 10.1016/j.ejphar.2015.11.007 (2015). [DOI] [PubMed] [Google Scholar]
  51. Koch A. et al. Effect of celecoxib on survival in patients with advanced non-small cell lung cancer: a double blind randomised clinical phase III trial (CYCLUS study) by the Swedish Lung Cancer Study Group. European journal of cancer 47, 1546–1555, doi: 10.1016/j.ejca.2011.03.035 (2011). [DOI] [PubMed] [Google Scholar]
  52. Na Y. R., Yoon Y. N., Son D. I. & Seok S. H. Cyclooxygenase-2 inhibition blocks M2 macrophage differentiation and suppresses metastasis in murine breast cancer model. PloS one 8, e63451, doi: 10.1371/journal.pone.0063451 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  53. Kundu N., Walser T. C., Ma X. & Fulton A. M. Cyclooxygenase inhibitors modulate NK activities that control metastatic disease. Cancer immunology, immunotherapy: CII 54, 981–987, doi: 10.1007/s00262-005-0669-2 (2005). [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Material
srep44693-s1.doc (1.5MB, doc)

Articles from Scientific Reports are provided here courtesy of Nature Publishing Group

RESOURCES