Skip to main content
Cells logoLink to Cells
. 2020 Feb 12;9(2):429. doi: 10.3390/cells9020429

Unique Pro-Inflammatory Response of Macrophages during Apoptotic Cancer Cell Clearance

Veronica Mendoza-Reinoso 1, Dah Youn Baek 1, Adrianne Kurutz 1, John R Rubin 1, Amy J Koh 1, Laurie K McCauley 1,2,*, Hernan Roca 1,*
PMCID: PMC7072562  PMID: 32059476

Abstract

The clearance of apoptotic cells by macrophages (efferocytosis) is crucial to maintain normal tissue homeostasis; however, efferocytosis of cancer cells frequently results in inflammation and immunosuppression. Recently, we demonstrated that efferocytosis of apoptotic prostate cancer cells by bone marrow-derived macrophages induced a pro-inflammatory response that accelerated metastatic tumor growth in bone. To evaluate the microenvironmental impact of macrophages and their efferocytic function, we compared peritoneal macrophages (P-MΦ) versus bone marrow-derived macrophages (BM-MΦs) using an efferocytosis in vitro model. The capability to engulf apoptotic prostate cells was similar in BM-MΦs and P-MΦs. Ex vivo analysis of BM-MΦs showed an M2-like phenotype compared with a predominantly M1-like phenotype in P-MΦs. A distinct gene and protein expression profile of pro-inflammatory cytokines was found in BM-MΦs as compared with P-MΦs engulfing apoptotic prostate cancer cells. Importantly, the reprogramming of BM-MΦs toward an M1-like phenotype mitigated their inflammatory cytokine expression profile. In conclusion, BM-MΦs and P-MΦs are both capable of efferocytosing apoptotic prostate cancer cells; however, BM-MΦs exert increased inflammatory cytokine expression that is dependent upon the M2 polarization stage of macrophages. These findings suggest that bone marrow macrophage efferocytosis of apoptotic cancer cells maintains a unique pro-inflammatory microenvironment that may support a fertile niche for cancer growth. Finally, bone marrow macrophage reprogramming towards M1-type by interferon-γ (IFN-γ) induced a significant reduction in the efferocytosis-mediated pro-inflammatory signature.

Keywords: bone marrow macrophages, peritoneal macrophages, prostate cancer, bone metastasis, tumor associated macrophages, efferocytosis

1. Introduction

Macrophage efferocytosis of apoptotic cells is essential for human health as it maintains tissue homeostasis by preventing the harmful effects of apoptotic cell accumulation and necrosis [1,2,3]. Conversely, efferocytosis of apoptotic cells in the tumor microenvironment, a perpetual process during tumor growth, promotes a pro-inflammatory and immunosuppressive program [4,5,6]. Our group recently identified that bone marrow-derived macrophage engulfment of cancer cells resulted in the production of inflammatory cytokines to promote immunosuppression and tumor growth in bone [7]. However, it remains unclear how the pro-tumorigenic and immunosuppressive effects of macrophage efferocytosis in bone metastasis are linked to uniqueness of the bone microenvironment.

Myeloid cells in the bone marrow provide a fertile microenvironment for cancer cells to stimulate metastatic establishment. Millions of cells undergo apoptosis in the tumor microenvironment; thus, macrophage-mediated efferocytosis of cancer cells has a crucial role in pro-tumorigenic and immunosuppressive mechanisms that lead to tumor progression and metastases [4,5]. Tumor-associated efferocytic macrophages are typically M2 polarized pro-inflammatory macrophages that promote cell growth through the production of IL-6, IL-23, and TNFα. They also drive tumor development through immune suppressive factors such as TGFβ and IL-10 [8,9]. Moreover, increased expression of MerTK, Axl, and Tyro3 receptor kinases by efferocytic macrophages in the tumor microenvironment stimulates tumor metastasis and immune suppression through elevated secretion of immune suppressive cytokines [10,11].

Although macrophages exhibit a high degree of plasticity [12,13], they are classified into two simplified categories: M1 (classically activated) or M2 (alternatively activated) phenotypes. M1 macrophages express CD80 and CD86 to trigger inflammation and tissue damage, whereas M2 macrophages express the mannose receptor-1 (CD206) and macrophage scavenger receptors (CD204 and CD163) to promote tissue remodeling and fibrosis [14]. Interferon-γ (IFNγ) has the ability to switch immunosuppressive tumor associated macrophages (TAMs), M2-like polarized macrophages, into M1-like immunostimulatory cells in different types of cancers [15,16].

Peritoneal macrophages are commonly used to study efferocytic responses after being exposed to apoptotic cells; yet, solid tumors like prostate cancer preferentially locate to the bone marrow versus the peritoneum. Recently, we determined that bone marrow macrophage engulfment of cancer cells resulted in a distinct profile of cytokine production. Engulfment of cancer cells, but not normal cells, resulted in the production of C-X-C motif chemokine ligand 5 (CXCL5) and other pro-inflammatory cytokines, which led to immunosuppression and rebounding tumor growth [7]. The possibility that tissue resident macrophages at different sites encounter, engulf, or present differing post-engulfment profiles upon apoptotic tumor cell efferocytosis is unknown. The prospect of considering the fundamental process of efferocytosis as a molecular switch in programming or re-programming tumor associated macrophages bears promise [17]. Such information could provide valuable new insights into the intervention of tumor progression.

Using primary macrophages and an efferocytosis in vitro model, we investigated the differential gene expression of inflammatory cytokines in response to apoptotic cancer cell clearance by bone marrow-derived and peritoneal macrophages. We found that bone marrow-derived macrophages have a very unique role in the efferocytosis-induced inflammatory gene expression profile, which is likely critical in the acceleration of prostate cancer skeletal metastasis.

2. Materials and Methods

2.1. Cell Lines and Animals

Murine (Ras+Myc)-induced prostate cancer (RM1)cells were a gift from Timothy C. Thompson (Baylor College of Medicine, Houston, TX, USA) [18,19]. C57BL/6J mouse primary prostate epithelial cells (mPEC) were obtained from Cell Biologics (C57-6038). Both cell lines were certified mycoplasma-free (RM1 cells were characterized by IDEXX BioResearch; mPECs were obtained from Cell Biologics). All animal experiments were performed with approval from the University of Michigan Institutional Animal Care and Use Committee. Immunocompetent C57BL/6J mice were purchased from the Jackson Laboratory.

2.2. Macrophage and Apoptotic Cell Co-Culture

Bone marrow-derived macrophages (BM-MΦs) were isolated from wildtype 4–6 week old male C57BL/6J mice by flushing the femur and tibia with minimum essential medium eagle - alpha modification (αMEM) supplemented with L-glutamine, antibiotic-antimycotic 1× and 10% fetal bovine serum (FBS). From the same mice, peritoneal macrophages (P-MΦs) were isolated by flushing the peritoneal cavity with 5 mL of ice cold αMEM (L-glutamine, antibiotic-antimycotic 1×, 10% FBS). BM-MΦs and P-MΦs were cultured in αMEM (L-glutamine, antibiotic-antimycotic 1×, 10% FBS) in the presence of macrophage colony stimulating factor (M-CSF) (30 ng/mL, #315-02, Peprotech, Rocky Hill, NJ, USA). After three days in culture, macrophages were plated independently at 1.5 × 106 cells/well in αMEM (L-glutamine, antibiotic-antimycotic 1×, 0.25% FBS) for co-culture experiments. RM1 and mPEC cells were exposed to UV light for 30 min to induce apoptosis. Apoptotic (a) cells (>90% trypan blue incorporation) were co-cultured with macrophages at a 1:1 ratio in αMEM (L-glutamine, 0.25% FBS) for 16–18 h. For flow cytometric analyses, apoptosis was induced in RM1 cells and the cells were labeled with CellTrace™ CFSE (ThermoFisher Scientific, C34554), and then co-cultured with BM-MΦs or P-MΦs for 16–18 h. Efferocytosis inhibition was performed by incubation of cultures at 4 °C over 6 h.

2.3. Flow Cytometry

BM- and P-MΦs alone and co-cultured with RM1(a) cells were collected and incubated in fluorescence-activated cell sorter (FACS) staining buffer (phosphate buffered saline-1×, 0.2% bovine serum albumin). Antibodies and/or matched isotype controls were added and incubated for 1 h at 4 °C. The following antibodies were used: allophycocyanin (APC)-F4/80 (CI:A3-1) (#ab105080, Abcam, Cambridge, MA, USA); fluorescein isothiocyanate (FITC)-CD86 (GL-1) (#105006, Biolegend, San Diego, CA, USA), FITC-CD206 (C068C2) (#141704, Biolegend, San Diego, CA, USA). Cells were analyzed by flow cytometry using a BD FACSAriaTM III (BD biosciences, San Jose, CA, USA) and Amnis® ImageStream®XMk II (Luminex, Austin, TX, USA).

2.4. Quantitative Polymerase Chain Reaction (qPCR)

Total RNA was isolated from BM- and P-MΦs alone, and co-cultured with RM1(a) or mPEC(a) cells using the RNeasy® Mini Kit (#74104, Qiagen, Hilden, Germany) following the manufacturer’s instructions. qPCR was performed using TaqMan gene expression master mix (#4369016, AppliedBiosystems, Foster City, CA, USA) and the corresponding TaqMan probes: Cxcl1 (Mm04207460_m1), Cxcl4 (Mm00451315_g1), Cxcl5 (Mm00436451_g1), IL-6 (Mm00446190_m1), CD86 (Mm00444540_m1), CD206 (Mm01329362_m1), and 18S (Mm03928990_g1). Real time PCR was analyzed on ABI PRISM 7700 (Applied Biosystems, Foster City, CA, USA). Relative expression levels were calculated after normalization to 18S expression.

2.5. Macrophage Reprogramming

BM-MΦs were harvested and expanded as described above. On day four, macrophages were stimulated for 24 h with 60 ng/mL of interferon-γ (IFN-γ, , 315-05, Peprotech, Rocky Hill, NJ, USA) in αMEM (L-glutamine, antibiotic-antimycotic 1×, 10% FBS, M-CSF 30 ng/mL) to reprogram BM-MΦs towards the M1-type. Efferocytosis assays were then performed by adding RM1(a) cells and co-cultured 16–18 h as described.

2.6. ELISA

CXCL1 and CXCL5 were quantitatively measured using RayBio® Mouse enzyme-linked immunosorbent assay (ELISA) assay systems (#ELM-KC and #ELM-LIX, RayBiotech, Inc., Peachtree Corners, GA, USA) using the conditioned media collected from BM- and P-MΦs alone and in co-cultured with RM1(a) or mPEC(a) cells, and BM-MΦs alone and in co-culture treated with IFN-γ- and vehicle.

2.7. Statistics

Statistical analyses were performed using GraphPad Prism 6 (GraphPad Software, version 8.0.2, San Diego, CA, USA) using one-way analysis of variance (ANOVA) with Dunnet’s multiple-comparisons and unpaired t-tests with significance of p < 0.05.

3. Results

3.1. Bone Marrow-Derived and Peritoneal Macrophages Display Effective Efferocytosis of Apoptotic Prostate Cancer and Normal Prostate Cells

Efferocytosis of apoptotic cells by bone marrow-derived macrophages (BM-MΦs) and peritoneal macrophages (P-MΦs) has been previously demonstrated by flow cytometry analysis [7,20,21,22]. The ability of P-MΦs versus BM-MΦs to efferocytose apoptotic cancer and normal prostate epithelial cells was analyzed using primary BM-MΦs, isolated from C57BL/6J mouse femurs and tibiae, and P-MΦs, isolated from peritoneal exudates, in co-culture with apoptotic RM1(a) prostate cancer cells and apoptotic normal prostate epithelial cells mPEC(a). In addition, efferocytosis of live RM1(l) cells by BM and P-MΦs was also analyzed and compared with apoptotic RM1(a) cells. RM1 cells were derived from the prostate epithelium of C57BL/6J mice and overexpress Ras and Myc oncogenes that resemble the oncogene-specific gene expression signatures of prostate cancer patient samples, and these are associated with prostate cancer progression [23,24]. RM1 cells have been used in vossicle and intratibial mouse models, where cancer cells are implanted directly in the bone niche to study the interaction between tumor and bone at the early stages of skeletal tumor development [7,25]. The mPEC cells are primary prostate epithelial cells derived from the prostate tissue of C57BL/6J mice (Cell Biologics). RM1 and mPEC cells were exposed to UV light to induce apoptosis, and then live RM1(l), apoptotic RM1(a), and apoptotic mPEC(a) cells were pre-labeled with CFSE dye and co-cultured with BM- and P-MΦs. After 16–18 h, the cells were collected; labeled with anti-F4/80-APC or its IgG isotype control; and analyzed using FACS (BD FACSAria™ III) and ImageStream flow cytometry (Amnis), which provides microscopic event images (model workflow, Figure 1A). Figure 1B,C depict the results from double-labeled APC+CFSE+ cells, indicating partial or complete engulfment of live RM1(l), apoptotic RM1(a) and mPEC(a) cells by BM- and P-MΦs. The double positive APC+CFSE+ (light blue cells in flow scatter plots) represent the RM1(l), RM1(a), and mPEC(a) cells (CFSE+) that are engulfed by F4/80-APC+ macrophages in the early (E-gate) and late (L-gate) internalization stages (Figure 1B). BM- and P-MΦs engulfed a significantly higher percentage of mPEC(a) cells, however, the efferocytosis efficiency was similar in P-MΦs and BM-MΦs. Engulfment of live RM1(l) cells by BM- and P-MΦs was observed, however, the percentages were significantly lower when compared with apoptotic RM1(a) cells. It is important to understand that dead cells are always present in live cell cultures, and that the CFSE labeling procedure may have also caused RM1 cell death. Also, BM-MΦs (BM+) and P-MΦs (P+) (red, APC+) internalization stages of apoptotic RM1(a) and mPEC(a) cells (green, CFSE+) were corroborated by ImageStream, as shown in Figure 3C (late stage, L; early stage, E).

Figure 1.

Figure 1

Efferocytosis of apoptotic prostate cancer cells and normal prostate epithelial cells by bone marrow-derived (BM) and peritoneal (P) macrophages (MΦ). (A) BM-MΦ and P-MΦ isolation and in vitro culture. Prostate cancer (RM1) and normal prostate ephitelial (mPEC) cells were exposed to UV to induce apoptosis and RM1(l), RM1(a), and mPEC(a) were stained with cell-trace-CFSE. BM-MΦ and P-MΦ were co-cultured with live prostate cancer RM1(l), apoptotic prostate cancer RM1(a) cells, and apoptotic normal prostate epithelial mPEC(a) cells. The co-cultures were stained with anti-F4/80-APC. (B) Flow cytometry analysis from A. Gates were adjusted to IgG isotype control. (C) Representative images from ImageStream show macrophages (F4/80-APC+, red) engulfing RM1(a) and mPEC(a) cells (CSFE+, green) in the early (E, red line) and late (L, black line) internalization stages. BF, bright field; BM+, bone marrow macrophages; P+, peritoneal macrophages. Data are mean ± SEM, n = 4 per group; **p < 0.01, #p < 0.001, †p < 0.0001 (one-way analysis of variance (ANOVA); Dunnet’s multiple-comparisons test).

3.2. Bone Marrow-Derived Macrophages Display a Robust M2 Polarization

A previous study suggested that BM-MΦs are predominantly M2 (alternatively activated), while P-MΦs are M1 (classically activated) macrophages [26]. The M2-like polarized macrophages have been characterized by their ability to release anti-inflammatory cytokines [27], and recent studies implicated efferocytosis of apoptotic tumor cells in accelerated tumor growth by inducing M2 macrophage polarization [5,21]. To characterize M1/M2 polarization phenotypes in BM-MΦs and P-MΦs, we compared the expression of the surface markers CD86 (M1-type) and CD206 (M2-type) by flow cytometry. Ex vivo total bone marrow cells and peritoneal exudates were stained with anti-F4/80-APC, anti-CD86-FITC, anti-CD206-FITC, and their respective IgG-isotype controls and analyzed by flow cytometry. We found that approximately 1% of total bone marrow-derived cells and 29% of peritoneal exudate cells were F4/80+ (phagocytic MΦs). BM-MΦs expressed low CD86 levels (<5%, F4/80+CD86+, Figure 2A) and high CD206 levels (>60%, F4/80+CD206+, Figure 2A); in contrast, P-MΦs expressed high CD86 levels (>55%, F4/80+CD86+, Figure 2A) and low CD206 levels (<9%, F4/80+CD206+, Figure 2A), confirming that BM-MΦs and P-MΦs are predominantly M2- and M1-like polarized macrophages, respectively. In addition, flow cytometric analysis of CD86 and CD206 expression was performed in BM-MΦs and P-MΦs cultured in vitro in the presence of M-CSF for three days and exposed to RM1(a) cells. In order to investigate how efferocytosis affects macrophage polarization, at day four, apoptotic RM1 cells were added to BM-MΦs and P-MΦs and cultured for 18 h. Interestingly, we found that approximately 50% of BM-MΦs and 70% of P-MΦs were F4/80+ (Figure 2B). In vitro, F4/80+ BM-MΦs maintained significantly higher CD206 expression levels (>80%, F4/80+CD206+, Figure 2B) when compared with P-MΦs (<14.5%, F4/80+CD206+, Figure 2B); however, P-MΦs cultured in vitro with M-CSF decreased CD86 expression levels (<7%, F4/80+CD86+, Figure 2B). Moreover, CD86 expression levels in BM-MΦ and P-MΦ co-cultured with apoptotic RM1 cells remained unchanged, although CD206 expression was slightly increased in P-MΦ co-cultured with apoptotic RM1 cells (>15%, F4/80+CD86+, Figure 2B). These results suggested that BM-MΦs maintained the M2-like phenotype, while P-MΦs showed neither M1- nor M2-like polarization in the in vitro cultures. Moreover, efferocytosis of apoptotic RM1 cells by P-MΦs slightly changed their polarization towards M2, whereas efferocytic BM-MΦs maintained their strong M2 polarization.

Figure 2.

Figure 2

Ex vivo and in vitro M1 and M2 polarization of bone marrow-derived and peritoneal macrophages. BM-MΦs and P-MΦs were isolated from C57BL/6J mice. (A) Freshly isolated bone marrow and peritoneal exudate cells were stained for anti-F4/80-APC combined with either anti-CD86-FITC or anti-CD206-FITC and analyzed by flow cytometry. (B) BM-MΦs and P-MΦs co-cultured with RM1(a) cells for 18 h were stained with anti-F4/80-APC combined with either anti-CD86-FITC or anti-CD206-FITC and analyzed by flow cytometry. BM, bone marrow; P, peritoneal. Data in A and B are mean ± SEM, n = 3 per group; *p < 0.05, †p < 0.0001 (one-way ANOVA; Dunnet’s multiple-comparisons test).

3.3. Bone Marrow Macrophage Efferocytosis of Apoptotic Prostate Cancer Cells Induces Unique Pro-Inflammatory Cytokine Gene Expression

We previously demonstrated that BM-MΦ efferocytosis of apoptotic prostate cancer cells orchestrates a pro-inflammatory response in prostate skeletal metastasis. In that study, cytokine array analyses of efferocytic bone marrow-derived macrophages identified the upregulation of pro-inflammatory cytokines such as CCL5, CXCL1, CXCL5, IL-6, and IL-12 [7]. We hypothesized that BM-MΦs efferocytosis of apoptotic cancer cells may induce a different pro-inflammatory cytokine response when compared with P-MΦs efferocytosis. To test this hypothesis, we assessed cytokine expression in BM- and P-MΦs in co-cultures with apoptotic prostate cancer RM1(a) or non-cancer prostatic epithelial mPEC(a) cells. Both BM- and P-MΦs were isolated from the same mice and cultured under the same conditions. Relative mRNA expression was analyzed by qPCR for Cxcl1, Cxcl4, Cxcl5, and IL-6, and macrophage responses to efferocytosis were compared. Figure 3A shows that Cxcl1, Cxcl4, Cxcl5, and IL-6 were significantly upregulated in co-cultures of BM-MΦs and RM1(a) cells in contrast to mPEC(a) cells. Conversely, Cxcl1 and Cxcl5 expression levels remained unaffected in P-MΦs co-cultured with RM1(a) or mPEC(a) cells. Cxcl4 and IL-6 expression was significantly increased in P-MΦs co-cultured with RM1(a) versus mPEC(a) cells, but was lower in comparison with BM-MΦs (Figure 3A). In addition, CXCL1 and CXCL5 were evaluated by ELISA in the conditioned media from BM- and P-MΦs co-cultured with apoptotic prostate cancer RM1(a) or non-cancer prostatic epithelial mPEC(a) cells (Figure 3B). Significantly higher levels of CXCL1 and CXCL5 were found in BM-MΦs co-cultured with RM1(a) cells; however, no changes were observed with mPEC(a) (Figure 3B). Interestingly, CXCL1 levels were increased in P-MΦs co-cultured with apoptotic RM1(a) or mPEC(a) cells relative to P-MΦs alone, although the fold stimulation was significantly lower as compared with BM-MΦs (Figure 3B). It has been shown that macrophage efferocytosis blockade of highly apoptotic cancer cells at 4 °C reduces the expression of M2-like macrophage associated genes [21]. To confirm that macrophage efferocytosis of apoptotic cancer cells drives the expression of pro-inflammatory cytokines, BM-MΦs and P-MΦs were incubated alone and co-cultured with RM1(a) cells at 37 °C and at 4 °C, where efferocytosis is inhibited. The gene expression of pro-inflammatory Cxcl1, Cxcl4, Cxcl5, and IL-6 was quantified by qPCR. Figure 3C shows that BM-MΦs efferocytosis of RM1(a) cells significantly increased Cxcl1, Cxcl5, and IL-6 gene expression under normal conditions (37 °C). Moreover, efferocytosis inhibition at 4 °C significantly decreased Cxcl5 expression levels in BM-MΦs. Basal gene expression levels of Cxcl1, Cxcl4, and IL6 in BM-MΦs alone increased at 4°C; however, no stimulation was observed with RM1(a) in Cxcl1 and IL-6 expression under inhibitory conditions. Interestingly, it has been demonstrated that pro-inflammatory cytokines CXCL1, CXCL4, CXCL5, and IL-6 trigger tumor progression in different contexts [7,28,29,30]. These results suggest that the higher expression of inflammatory cytokines triggered by efferocytosis of apoptotic cancer cells is uniquely associated with bone marrow-derived macrophages.

Figure 3.

Figure 3

Differential gene expression of bone marrow-derived and peritoneal macrophages after efferocytosis of apoptotic prostate cancer cells and normal prostate epithelial cells. (A) mRNAs isolated from BM-MΦs and P-MΦs alone or co-cultured with apoptotic prostate cancer cells RM1(a) or apoptotic prostate epithelial cells mPEC(a) for 18–20 h were analyzed by quantitative PCR (qPCR) for the specified genes. (B) Conditioned media from (A) were analyzed by ELISA for total CXCL1 and CXCL5 levels. (C) qPCR analysis of BM-MΦs and P-MΦs during efferocytosis permissive (37 °C) or inhibitory (4 °C) conditions. Graphs show the gene expression quantification of inflammatory cytokines normalized to respective MΦs alone. Data are mean ± SEM, n = 3 per group; *p < 0.05, **p < 0.01, #p < 0.001, †p < 0.0001 (one-way ANOVA; Dunnet’s multiple-comparisons test).

3.4. M1 Bone Marrow Macrophage Repolarization by INF-γ Reduces Pro-Inflammatory Cytokine Expression

Bone marrow macrophages have the capacity to switch phenotypes in response to interferon- γ (INF-γ) and/or lipopolysaccharides (LPS) [28,29]. We hypothesized that M1 repolarization of BM-MΦs (predominantly M2 polarized) would affect the inflammatory cytokine profile induced after efferocytosis of RM1(a) cells. To test this, BM-MΦs were isolated from long bones of C57BL/6J mice and cultured in the presence of M-CSF for 72 h. IFN-γ was then added and incubated for 24 h, at which point RM1(a) cells were added and co-cultured with BM-MΦs for 16–18 h (workflow, Figure 4A). To confirm the BM-MΦs’ reprogramming, we performed a flow cytometric analysis of BM-MΦs co-cultured with apoptotic cells in the presence of IFN-γ or vehicle control. Cells were labeled using F4/80-APC (MΦs) in combination with CD86-FITC (M1) or CD206-FITC (M2) and control IgG antibodies (Figure 4B). BM-MΦs treated with IFN-γ showed significantly higher CD86 (>35%, F4/80+CD86+, Figure 4B) and lower CD206 (~45%, F4/80+CD206+, Figure 4B) expression levels when compared with those vehicle treated (<12% F4/80+CD86+; >92% F4/80+CD206+; Figure 4B). This confirmed the BM-MΦs’ repolarization towards an M1 profile. BM-MΦs’ responses to efferocytosis of apoptotic cells in IFN-γ- and vehicle-treated cultures were analyzed by relative mRNA expression for CD86, Cxcl1, Cxcl4, Cxcl5, and IL-6 (Figure 4C). Figure 4C shows that IFN-γ treatment of BM-MΦs alone and BM-MΦs co-cultured with RM1(a) cells significantly increased CD86 expression, in correlation with the flow cytometric analysis (Figure 4B). With the exception of IL-6 (no change), gene expressions of the inflammatory cytokines (Cxcl1, Cxcl4, and Cxcl5) were significantly reduced in BM-MΦs alone and BM-MΦs co-cultured with RM1(a) cells when treated with IFN-γ (Figure 4C). Moreover, pro-inflammatory cytokine detection was performed by ELISA for CXCL1 and CXCL5 using the conditioned media from BM-MΦs alone and co-cultured with RM1(a) and IFN-γ- and vehicle-treated cultures. The results confirmed the gene expression data from Figure 4C. CXCL1 and CXCL5 expression was significantly decreased in BM-MΦs alone and BM-MΦs co-cultured with RM1(a) after IFN-γ treatment (Figure 4D). Altogether, these results suggest that BM-MΦ repolarization towards M1 profile mitigates the inflammatory response mediated by efferocytosis of apoptotic prostate cancer cells and suggest the dependence of this response on the M2-activation stage of macrophages.

Figure 4.

Figure 4

Effect of interferon-γ (IFNγ)-M1 polarization of bone marrow-derived macrophages in inflammatory cytokine expression. (A) Workflow: BM-MΦs were isolated and enriched in M-CSF for three days, and then treated with vehicle or IFN-γ and cultured alone or co-cultured with RM1(a) cells for 16–18 h. (B) BM-MΦs alone and in co-culture with RM1(a) cells were stained for anti-F4/80-APC combined with either anti-CD86-FITC or anti-CD206-FITC and analyzed by flow cytometry. (C) mRNAs from (A) were isolated and analyzed by qPCR for the specified inflammatory cytokine genes. (D) Conditioned media from (A) were analyzed via ELISA for total CXCL1 and CXCL5 levels. Data are mean ± SEM, n = 3 per group; *p < 0.05, **p < 0.01, †p < 0.0001 (one-way ANOVA; Dunnet’s multiple-comparisons test and unpaired t-test).

4. Discussion

Recent investigations have indicated that bone marrow-derived macrophage efferocytosis of apoptotic cancer cells stimulates bone metastasis through pro-inflammatory and immunosuppressive responses [7,30]. It remains unclear how the bone marrow microenvironment shapes these metastatic responses and how bone marrow macrophages uniquely mediate the efferocytosis-accelerating tumor growth. An in vitro efferocytosis model was used to evaluate the differential responses of bone marrow-derived and peritoneal macrophage efferocytosis of apoptotic cancer cells and demonstrated that bone marrow-derived macrophages activate a unique pro-inflammatory response upon apoptotic cancer cell clearance.

Few studies have identified key differences between bone marrow-derived and peritoneal macrophage properties in different contexts. In 2013, a study demonstrated that bone marrow-derived macrophages are more proliferative and have higher phagocytic rates when compared with peritoneal and spleen macrophages [31]. However, in the current study, similar efferocytosis efficiencies of apoptotic prostate cancer cells were found in bone marrow-derived versus peritoneal macrophages. The ImageStream analysis identified early (high CFSE intensity) and late (low CFSE intensity) stages of cancer apoptotic cell engulfment by F4/80+ macrophages. Additionally, they identified that in vitro generated bone marrow-derived macrophages have higher expression of TGF-β and IL-10, intimating their M2-like phenotype [31]. These data were corroborated in 2016 by a study that demonstrated that bone marrow-derived macrophages display higher CD206 (M2-like marker) compared with peritoneal macrophages, which was also confirmed by lower oxidized low-density lipoprotein receptor (LOX-1, M1-like marker) and higher peroxisome proliferator-activated receptor-γ (PPARγ, M2-like marker) expression in the bone marrow-derived macrophages [26]. Similarly, we found that bone marrow-derived macrophages consistently expressed a higher percentage of F4/80+CD206+ (M2-like) in ex vivo and in vitro experiments, whereas peritoneal macrophages expressed a higher percentage of F4/80+CD86+ (M1-like) ex vivo, but with no clear phenotype in vitro. This may be explained by the presence of M-CSF in the media, which is known for its effect in promoting M2 polarization in macrophages [20]. Interestingly, another study demonstrated that bone marrow-derived macrophage efferocytosis of apoptotic colon cancer cells resulted in an increase of M2-like macrophages promoting tumor metastasis [32]. Efferocytosis performed by tumor-associated macrophages (TAMs) promotes their polarization toward an M2-like wound healing phenotype triggering immunosuppressive signals within the tumor microenvironment [4,21,33]. In contrast, we found that P-MΦs co-cultured with apoptotic RM1 cells showed a slight increment in the percentage of F4/80+CD206+, likely owing to their polarization towards M2 induced by efferocytosis. The strong CD206 expression (M2 polarization) of BM-MΦs remains unchanged, which may be because of their already high percentage of F4/80+CD206+ (~90%) under basal conditions.

Bone marrow-derived macrophage efferocytosis of apoptotic cancer cells, but not apoptotic normal cells, resulted in increased gene expression of Cxcl1, Cxcl4, Cxcl5, and IL-6 inflammatory cytokines in comparison with peritoneal macrophages. In line with these results, ELISAs measuring CXCL1 and CXCL5 cytokines revealed elevated levels in bone marrow-derived macrophages upon apoptotic RM1 cancer cell engulfment. A significantly reduced stimulation was observed by efferocytic peritoneal macrophages, which could be explained by their polarization towards M2, as shown in Figure 2B. Moreover, efferocytosis inhibition of bone marrow-derived macrophages (4°C) resulted in decreased Cxcl5 and unchanged Cxcl1 and IL-6 expression, which confirmed that the pro-inflammatory response of bone marrow-derived macrophages is produced by efferocytosis of apoptotic cancer cells. Upregulation of Cxcl1 and IL-6 gene expression in bone marrow-derived macrophages alone at 4°C may be the result of acute cold stress, which decreases IFN-γ expression [34]. These results correlated with recent in vitro and in vivo clinical data, where bone marrow-derived macrophage efferocytosis of cancer cells promotes the expression of CCL5, CXCL1, CXCL5, and IL-6 pro-inflammatory cytokines that accelerate tumor progression in the bone microenvironment [7]. The roles of these cytokines have been previously associated with tumor inflammation mechanisms and metastasis in various cancer types [7,35,36,37,38]. In accordance with this hypothesis, we found that inducing bone marrow macrophage repolarization with IFN-γ towards M1-type resulted in a significant downregulation of Cxcl1, Cxcl4, and Cxcl5 expression in efferocytic macrophages, which was corroborated by the CXCL1 and CXCL5 ELISA results. M1 polarized macrophages have been described as anti-tumorigenic macrophages that remove tumor cells and produce high levels of immunostimulatory cytokines [13]. Macrophages treated with IFNγ, LPS, and IFNγ + LPS promote M1-like macrophage polarization [13,39]. Macrophage polarization (M1/M2) plasticity is ideal for immunomodulation of these cells in diseases involving macrophage dysregulation, such as cancer. Novel studies are reporting the use of macrophage-reprogramming agents to promote M1-like TAMs polarization that reduce tumor growth [40,41,42]. Similarly, the findings presented here suggest that efferocytic macrophages in the tumor bone microenvironment may be reprogrammed towards the M1 phenotype to reduce inflammation and tumor progression [17].

In summary, bone marrow macrophage efferocytosis of apoptotic prostate cancer cells drives a unique inflammatory response. This response as well as their polarization stage differs from the response of other site-specific macrophages such as peritoneal macrophages. As shown before, efferocytosis of apoptotic cancer cells accentuates M2 polarization of bone marrow macrophages [21], which accelerates tumor promoting inflammation and immunosuppression, suggesting that bone marrow macrophages may play a critical role during progression of skeletal metastasis. Bone marrow macrophage reprogramming towards M1 reduces the efferocytosis-mediated pro-inflammatory phenotype. We are currently pursuing studies to characterize the exact molecular mechanisms mediating bone marrow macrophage efferocytosis of apoptotic cancer cells in order to identify novel drug targets to be used as coadjuvant therapies to treat skeletal metastasis.

Acknowledgments

The authors would like to thank Ann-Marie Deslauriers-Cox, for the Amnis® ImageStream®XMk II analysis at the Flow Cytometry Core – Biomedical Research Core Facilities – University of Michigan.

Author Contributions

H.R. and L.K.M. conceived the study. H.R. designed the study, with contributions from V.M.-R., J.R., and L.K.M. V.M.-R. performed the experiments, with contributions from D.Y.B. and A.K. for macrophage isolations and H.R. for FACS. A.J.K. contributed with technical assistance. V.M.-R. and H.R. designed the figures. V.M.-R. prepared the figures and drafted the manuscript. All authors discussed the data; contributed to critical reading, editing, and revisions; and approved the final version of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by NIH awards P01-CA093900 and R01-DE022327 to L.K.M.

Conflicts of Interest

The authors declare no conflict of interest.

References

  • 1.Savill J., Fadok V. Corpse clearance defines the meaning of cell death. Nature. 2000;407:784–788. doi: 10.1038/35037722. [DOI] [PubMed] [Google Scholar]
  • 2.Decathelineau A.M., Henson P.M. The final step in programmed cell death: phagocytes carry apoptotic cells to the grave. Essays Biochem. 2003;39:105–117. doi: 10.1042/bse0390105. [DOI] [PubMed] [Google Scholar]
  • 3.Elliott M.R., Ravichandran K.S. Clearance of apoptotic cells: implications in health and disease. J. Cell Boil. 2010;189:1059–1070. doi: 10.1083/jcb.201004096. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Poon I.K.H., Lucas C.D., Rossi A.G., Ravichandran K.S. Apoptotic cell clearance: basic biology and therapeutic potential. Nat. Rev. Immunol. 2014;14:166–180. doi: 10.1038/nri3607. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Stanford J.C., Young C., Hicks D., Owens P., Williams A., Vaught D.B., Morrison M.M., Lim J., Williams M., Brantley-Sieders D.M., et al. Efferocytosis produces a prometastatic landscape during postpartum mammary gland involution. J. Clin. Investig. 2014;124:4737–4752. doi: 10.1172/JCI76375. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Graham U.K., DeRyckere D., Davies K.D., Earp H.S. The TAM family: phosphatidylserine-sensing receptor tyrosine kinases gone awry in cancer. Nat. Rev. Cancer. 2014;14:769–785. doi: 10.1038/nrc3847. [DOI] [PubMed] [Google Scholar]
  • 7.Roca H., Jones J.D., Purica M.C., Weidner S., Koh A.J., Kuo R., Wilkinson J.E., Wang Y., Daignault-Newton S., Pienta K.J., et al. Apoptosis-induced CXCL5 accelerates inflammation and growth of prostate tumor metastases in bone. J. Clin. Invest. 2018;128:248–266. doi: 10.1172/JCI92466. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Yang L., Huang J., Ren X., Gorska A.E., Chytil A., Aakre M., Carbone D.P., Matrisian L.M., Richmond A., Lin P.C., et al. Abrogation of TGF beta signaling in mammary carcinomas recruits Gr-1+CD11b+ myeloid cells that promote metastasis. Cancer Cell. 2008;13:23–35. doi: 10.1016/j.ccr.2007.12.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Yang J., Liao D., Chen C., Liu Y., Chuang T.-H., Xiang R., Markowitz R., Reisfeld R.A., Luo Y. Tumor-Associated Macrophages Regulate Murine Breast Cancer Stem Cells Through a Novel Paracrine EGFR/Stat3/Sox-2 Signaling Pathway. STEM CELLS. 2013;31:248–258. doi: 10.1002/stem.1281. [DOI] [PubMed] [Google Scholar]
  • 10.Lemke G., Rothlin C.V. Immunobiology of the TAM receptors. Nat. Rev. Immunol. 2008;8:327–336. doi: 10.1038/nri2303. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Linger R.M.A., Keating A.K., Earp H.S., Graham U.K. TAM Receptor Tyrosine Kinases: Biologic Functions, Signaling, and Potential Therapeutic Targeting in Human Cancer. Adv. Breast Cancer Res. 2008;100:35–83. doi: 10.1016/S0065-230X(08)00002-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Biswas S.K., Mantovani A. Macrophage plasticity and interaction with lymphocyte subsets: cancer as a paradigm. Nat. Immunol. 2010;11:889–896. doi: 10.1038/ni.1937. [DOI] [PubMed] [Google Scholar]
  • 13.Mantovani A., Sozzani S., Locati M., Allavena P., Sica A. Macrophage polarization: tumor-associated macrophages as a paradigm for polarized M2 mononuclear phagocytes. Trends Immunol. 2002;23:549–555. doi: 10.1016/S1471-4906(02)02302-5. [DOI] [PubMed] [Google Scholar]
  • 14.Gundra U.M., Girgis N.M., Ruckerl D., Jenkins S., Ward L.N., Kurtz Z.D., Wiens K.E., Tang M.S., Basu-Roy U., Mansukhani A., et al. Alternatively activated macrophages derived from monocytes and tissue macrophages are phenotypically and functionally distinct. Blood. 2014;123:110–122. doi: 10.1182/blood-2013-08-520619. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Duluc D., Corvaisier M., Blanchard S., Catala L., Descamps P., Gamelin E., Ponsoda S., Delneste Y., Hebbar M., Jeannin P. Interferon-γ reverses the immunosuppressive and protumoral properties and prevents the generation of human tumor-associated macrophages. Int. J. Cancer. 2009;125:367–373. doi: 10.1002/ijc.24401. [DOI] [PubMed] [Google Scholar]
  • 16.Haabeth O.A.W., Lorvik K.B., Hammarström C., Donaldson I.M., Haraldsen G., Bogen B., Corthay A. Inflammation driven by tumour-specific Th1 cells protects against B-cell cancer. Nat. Commun. 2011;2:240. doi: 10.1038/ncomms1239. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Roca H., McCauley L.K. Efferocytosis and prostate cancer skeletal metastasis: implications for intervention. Oncoscience. 2018;5:174–176. doi: 10.18632/oncoscience.440. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Baley P., Yoshida K., Qian W., Sehgal I., Thompson T. Progression to androgen insensitivity in a novelin vitro mouse model for prostate cancer. J. Steroid Biochem. Mol. Boil. 1995;52:403–413. doi: 10.1016/0960-0760(95)00001-G. [DOI] [PubMed] [Google Scholar]
  • 19.Thompson T.C., Southgate J., Kitchener G., Land H. Multistage carcinogenesis induced by ras and myc oncogenes in a reconstituted organ. Cell. 1989;56:917–930. doi: 10.1016/0092-8674(89)90625-9. [DOI] [PubMed] [Google Scholar]
  • 20.Proto J.D., Doran A.C., Gusarova G., Yurdagul A., Sozen E., Subramanian M., Islam M.N., Rymond C.C., Du J., Hook J., et al. Regulatory T Cells Promote Macrophage Efferocytosis during Inflammation Resolution. Immun. 2018;49:666–677. doi: 10.1016/j.immuni.2018.07.015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Soki F.N., Koh A.J., Jones J.D., Kim Y.W., Dai J., Keller E.T., Pienta K.J., Atabai K., Roca H., McCauley L.K. Polarization of Prostate Cancer-associated Macrophages Is Induced by Milk Fat Globule-EGF Factor 8 (MFG-E8)-mediated Efferocytosis. J. Boil. Chem. 2014;289:24560–24572. doi: 10.1074/jbc.M114.571620. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Michalski M.N., Koh A.J., Weidner S., Roca H., McCauley L.K. Modulation of Osteoblastic Cell Efferocytosis by Bone Marrow Macrophages. J. Cell. Biochem. 2016;117:2697–2706. doi: 10.1002/jcb.25567. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Ju X., Ertel A., Casimiro M.C., Yu Z., Meng H., McCue P.A., Walters R., Fortina P., Lisanti M.P., Pestell R.G. Novel oncogene-induced metastatic prostate cancer cell lines define human prostate cancer progression signatures. Cancer Res. 2013;73:978–989. doi: 10.1158/0008-5472.CAN-12-2133. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Koh C.M., Bieberich C.J., Van Dang C., Nelson W.G., Yegnasubramanian S., De Marzo A.M. MYC and Prostate Cancer. Genes Cancer. 2010;1:617–628. doi: 10.1177/1947601910379132. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Jung Y., Shiozawa Y., Wang J., McGregor N., Dai J., Park S.I., Berry J.E., Havens A.M., Joseph J., Kim J.K., et al. Prevalence of Prostate Cancer Metastases after Intravenous Inoculation Provides Clues into the Molecular Basis of Dormancy in the Bone Marrow Microenvironment. Neoplasia. 2012;14:429–439. doi: 10.1596/neo.111740. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Bisgaard L.S., Mogensen C.K., Rosendahl A., Cucak H., Nielsen L.B., Rasmussen S.E., Pedersen T.X. Bone marrow-derived and peritoneal macrophages have different inflammatory response to oxLDL and M1/M2 marker expression – implications for atherosclerosis research. Sci. Rep. 2016;6:35234. doi: 10.1038/srep35234. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Huynh M.-L.N., Fadok V.A., Henson P.M. Phosphatidylserine-dependent ingestion of apoptotic cells promotes TGF-β1 secretion and the resolution of inflammation. J. Clin. Investig. 2002;109:41–50. doi: 10.1172/JCI0211638. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Nathan C.F., Murray H.W., E Wiebe M., Rubin B.Y. Identification of interferon-gamma as the lymphokine that activates human macrophage oxidative metabolism and antimicrobial activity. J. Exp. Med. 1983;158:670–689. doi: 10.1084/jem.158.3.670. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Stein M., Keshav S., Harris N., Gordon S. Interleukin 4 potently enhances murine macrophage mannose receptor activity: a marker of alternative immunologic macrophage activation. J. Exp. Med. 1992;176:287–292. doi: 10.1084/jem.176.1.287. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Soki F.N., Cho S.W., Kim Y.W., Jones J.D., Park S.I., Koh A.J., Entezami P., Daignault-Newton S., Pienta K.J., Roca H., et al. Bone marrow macrophages support prostate cancer growth in bone. Oncotarget. 2015;6:35782–35796. doi: 10.18632/oncotarget.6042. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Wang C., Yu X., Cao Q., Wang Y., Zheng G., Tan T.K., Zhao H., Zhao Y., Wang Y., Harris D.C. Characterization of murine macrophages from bone marrow, spleen and peritoneum. BMC Immunol. 2013;14:6. doi: 10.1186/1471-2172-14-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Yang M., Liu J., Piao C., Shao J., Du J. ICAM-1 suppresses tumor metastasis by inhibiting macrophage M2 polarization through blockade of efferocytosis. Cell Death Dis. 2015;6:e1780. doi: 10.1038/cddis.2015.144. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Pollard J.W. Trophic macrophages in development and disease. Nat. Rev. Immunol. 2009;9:259–270. doi: 10.1038/nri2528. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Wei H., Zhang R., Su Y., Bi Y., Li X., Zhang X., Li J., Bao J. Effects of Acute Cold Stress After Long-Term Cold Stimulation on Antioxidant Status, Heat Shock Proteins, Inflammation and Immune Cytokines in Broiler Heart. Front. Physiol. 2018;9:1589. doi: 10.3389/fphys.2018.01589. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Sottnik J.L., Dai J., Zhang H., Campbell B., Keller E.T. Tumor-induced pressure in the bone microenvironment causes osteocytes to promote the growth of prostate cancer bone metastases. Cancer Res. 2015;75:2151–2158. doi: 10.1158/0008-5472.CAN-14-2493. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Rutkowski M.R., Stephen T.L., Svoronos N., Allegrezza M.J., Tesone A.J., Perales-Puchalt A., Brencicova E., Escovar-Fadul X., Nguyen J.M., Cadungog M.G., et al. Microbially driven TLR5-dependent signaling governs distal malignant progression through tumor-promoting inflammation. Cancer Cell. 2015;27:27–40. doi: 10.1016/j.ccell.2014.11.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Han R., Gu S., Zhang Y., Luo A., Jing X., Zhao L., Zhao X., Zhang L. Estrogen promotes progression of hormone-dependent breast cancer through CCL2-CCR2 axis by upregulation of Twist via PI3K/AKT/NF-κB signaling. Sci. Rep. 2018;8:9575. doi: 10.1038/s41598-018-27810-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Acharyya S., Oskarsson T., Vanharanta S., Malladi S., Kim J., Morris P.G., Manova-Todorova K., Leversha M., Hogg N., Seshan V.E., et al. A CXCL1 Paracrine Network Links Cancer Chemoresistance and Metastasis. Cell. 2012;150:165–178. doi: 10.1016/j.cell.2012.04.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Mantovani A., Sica A., Sozzani S., Allavena P., Vecchi A., Locati M. The chemokine system in diverse forms of macrophage activation and polarization. Trends Immunol. 2004;25:677–686. doi: 10.1016/j.it.2004.09.015. [DOI] [PubMed] [Google Scholar]
  • 40.Wanderley C.W., Colon D.F., Luiz J.P.M., Oliveira F.F., Viacava P.R., A Leite C., A Pereira J., Silva C.M., Silva C.R., Silva R.L., et al. Paclitaxel reduces tumor growth by reprogramming tumor-associated macrophages to an M1- profile in a TLR4-dependent manner. Cancer Res. 2018;78:5891–5900. doi: 10.1158/0008-5472.CAN-17-3480. [DOI] [PubMed] [Google Scholar]
  • 41.Xu M., Liu M., Du X., Li S., Li H., Li X., Li Y., Wang Y., Qin Z., Fu Y.-X., et al. Intratumoral Delivery of IL-21 Overcomes Anti-Her2/Neu Resistance through Shifting Tumor-Associated Macrophages from M2 to M1 Phenotype. J. Immunol. 2015;194:4997–5006. doi: 10.4049/jimmunol.1402603. [DOI] [PubMed] [Google Scholar]
  • 42.Poh A.R., Love C.G., Masson F., Preaudet A., Tsui C., Whitehead L., Monard S., Khakham Y., Burstroem L., Lessene G., et al. Inhibition of Hematopoietic Cell Kinase Activity Suppresses Myeloid Cell-Mediated Colon Cancer Progression. Cancer Cell. 2017;31:563–575. doi: 10.1016/j.ccell.2017.03.006. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Cells are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES