Abstract
Detecting circulating microRNAs (miRNAs; miRs) by means of liquid biopsy is an important tool for the early diagnosis and prognosis of breast cancer (BC). We aimed to identify and validate miR-210 and miR-152 as non-invasive circulating biomarkers, for the diagnosis and staging of BC patients, confirming their involvement in tumor angiogenesis. Methods: RT-qPCR was performed and MiRNA expression analysis was obtained from plasma and fragments of BC and benign breast condition (BBC) women patients, plus healthy subjects. Additionally, the immunohistochemistry technique was carried out to analyze the expression of target proteins. Results: Tumor fragments showed increased expression of oncomiR-210 and decreased expression of miR-152 tumoral suppressor. Both miRNAs were increased in plasma samples from BC patients. The receiver operating characteristic (ROC) curve analysis revealed that only the expression of oncomiR-210 in tissue samples and only the expression of the miR-152 suppressor in plasma have the appropriate sensitivity and specificity for use as differential biomarkers between early/intermediate and advanced stages of BC patients. In addition, there was an increase in the expression of hypoxia-inducible factor 1-alpha (HIF-1α), insulin-like growth factor 1 receptor (IGF-1R), and vascular endothelial growth factor (VEGF) in BC patients. On the contrary, a decrease in Von Hippel–Lindau (VHL) protein expression was observed. Conclusions: This study showed that increased levels of miR-210 and decreased levels of miR152, in addition to the expressions of their target proteins, could indicate, respectively, the oncogenic and tumor suppressive role of these miRNAs in fragments. Both miRNAs are potential diagnostic biomarkers for BC by liquid biopsy. In addition, miR-152 proved to be a promising biomarker for disease staging.
Keywords: breast cancer, miRNAs, liquid biopsy, angiogenesis, biomarkers, early diagnosis
1. Introduction
The high mortality rate for breast cancer (BC) is mainly related to the development of metastasis, a process that depends on angiogenesis [1]. Data show that this malignant evolution is aggravated, in most cases, by the late diagnosis of the disease [2]. Therefore, the identification of biomarkers that can diagnose cancer in the early stage and predict the behavior of the tumor is of special interest to the patients.
As the tumor grows, there is a reduction in oxygen at the center of the tumor, creating adverse conditions of hypoxia, which induces increased expression of numerous pro-angiogenic factors, such as hypoxia-inducible factor 1-alpha (HIF-1α) and insulin-like growth factor type 1 receptor (IGF-1R) [3]. Increased levels of HIF-1α and IGF-1R stimulate vascular endothelial growth factor (VEGF) expression [4]. On the contrary, anti-angiogenic factors, such as Von Hippel–Lindau (VHL) protein act in the degradation of HIF-1α and, consequently, decrease the expression of VEGF [5].
Currently, liquid biopsy has been gaining ground as a promising tool for the detection of neoplasms, having the benefit of being less invasive and causing minimal discomfort and risk to patients. This procedure consists of the collection of any bodily fluid for the purpose of analyzing information from the tumor, including circulating nucleic acids—circulating tumor DNA (ctDNA) and circulating tumor RNA (ctRNA) [6].
These circulating biomarkers have advantages over tissue biomarkers as they are easily obtained and can also be monitored routinely, resulting in real-time detection, and consequently effective diagnosis and prognosis. With the advancement of this technique, a growing series of research studies have been developed for the purpose of discovering new circulating biomarkers that are more sensitive, characterizing specific subtypes of each tumor type [7].
Additionally, a class of small non-coding RNAs, called microRNAs (miRNAs; miRs), has been studied as potential biomarkers in cancer. MiRNAs are small, non-coding endogenous RNAs with approximately 22 nucleotides that control numerous cell pathways through the regulation of gene expression in the post-transcriptional phase [8,9].
A broad review showed the most significant miRNAs for BC and which regulators (hallmarks) they involved [10]. Among them, miR-210 is considered an oncogenic miRNA which exhibits regulation mediated by HIF-1α and VHL. HIF-1α promotes increased expression of miR-210 and this leads to stabilization of HIF-1α, suggesting that both miRNA and its target gene are involved in a positive feedback loop. HIF-1α, in turn, will stimulate the expression of genes that promote angiogenesis, such as VEGF [11,12,13]. In addition, studies have shown that miR-210 expression was significantly higher in patients with BC in the preoperative phase compared to women who underwent tumor removal surgery [14]. Moreover, a study showed that elevated levels of miR-210 lead to increased tumor progression and migration and reduced cell cycle arrest in MCF-7 breast tumor cells [15].
Another miRNA present in the review by Bertoli, Cava, and Castiglioni is miR-152, which belongs to the miR-148/152 family. This miRNA is involved in the regulation of angiogenesis, being considered a tumor suppressor in BC [10]. Studies investigated the regulation of the IGF-1R receptor by miR-152. The high expression of this miR inhibits the expression of IGF-1R through its binding to the 3′-UTR region, leading to the blocking of the expression of HIF-1α and VEGF [16,17]. In BC, miR-152 showed low levels of expression in tumor tissue compared to adjacent non-tumor tissue, as well as in a series of BC cell lines [18,19].
In summary, on tumor progression, the high expression of oncomiR-210 and the low expression of the miR-152 suppressor trigger the increase in VEGF. The mechanisms of action of both miRNAs in the angiogenic pathway are summarized in Figure 1.
In recent years, studies have shown that miRNAs are not only detected in tissues, but also in fluids [9]. The circulating miRNAs, that represent the miRNA population in the free portion of body fluids, have attracted interest in the field of biomarker discovery because they are involved in several gene regulation processes [20]. Therefore, it is of great importance for patients to validate tumor biomarkers that are capable of diagnosing and predicting the staging for BC and can still be detected by a non-invasive method such as liquid biopsy. The aim of this study was to validate two miRNAs involved in the angiogenic process, and to evaluate the potential of these as biomarkers of diagnosis and staging in BC.
2. Materials and Methods
This study was approved by the Research Ethics Committee (CEP) of the Faculty of Medicine of Sao Jose do Rio Preto (FAMERP), Sao Jose do Rio Preto, Brazil, #2.118.866/2017, and it was elaborated following the national and international rules of ethics in experiments with human samples.
2.1. Experimental Groups
The samples were collected from patients at their first medical appointment and selected by BI-RADS™ that indicated a higher probability of BC (4C and 5). Of the total samples, 30 women from the BC group and 5 from the benign breast condition (BBC) group were selected, based on the inclusion criteria pre-established in this study. The experimental groups of this study were as follows:
Group Breast Cancer (BC): women with breast cancer (plasma/fragment: n = 30);
Group Benign Breast Conditions (BBC): women with benign breast conditions (plasma/fragment: n = 5);
Control: women with no atypical breast, and no history of BC in the family (plasma: n = 15; fragment: n = 5).
Inclusion criteria for BC: patients pathologically diagnosed with BC who had undergone surgical treatment; exclusion criteria for BC: patients who had received radiotherapy and chemotherapy before specimens were taken; exclusion criteria for all groups: women with other severe organ diseases; patients with any inflammatory process at the time of collection. All collections were performed at the Base Hospital, Sao Jose do Rio Preto, Brazil.
2.2. Collections
With respect to groups BC and BBC, the fragments were obtained by core biopsy performed. For the control group, the mammary fragments were obtained in mammoplasty reduction. Blood samples were collected by venipuncture (up to 5 mL per patient) and processed within one hour of collection.
2.3. Determination of Diagnosis and Pathological Prognosis Staging
All BC and BBC women included in this study had their diagnoses confirmed by the pathology team at the Base Hospital—Sao Jose do Rio Preto, SP/Brazil. To determine the staging of each patient, the most recent version (8th edition/2018) published by the American Joint Committee on Cancer (AJCC) was used.
The present study divided the women with staging Ia, Ib, IIa, and IIb and considered the respective patients to have an early/intermediatestage. Women with staging IIIa, IIIb, IIIc, and IV were considered to have an advanced stage.
2.4. Analysis of miRNA Expression by RT-qPCR
Plasma RNA extraction was performed with the miRNeasy Serum/Plasma Advanced kit (Qiagen, CA, USA) (200 μL plasma), and the Trizol™ reagent (Life Technologies, Carlsbad, CA, USA) was used for the fragments. The RNA concentration and purity was assessed using a spectrophotometer (NanoDrop™ 2000/2000c, Thermo Fisher Scientific, Waltham, MA, USA). The status purity was verified using A260/A280 ratios (range: 1.8–2.0). The complementary DNA (cDNA) was obtained by reverse transcriptase technique from the RNA extracted from the samples (50 ng). cDNA was synthesized from 50 ng of total RNA with the TaqMan™ MicroRNA Reverse Transcription kit (Applied Biosystems, Foster City, CA, USA).
The quantitative real-time polymerase chain reaction (qPCR) was performed using the StepOnePlus™ Real-Time PCR System (Applied Biosystems). Each sample were normalized against U6 levels. Reactions for miRNA expression analysis (and the reference gene, U6) were performed in triplicate (plasma) and duplicate (fragment) using 10 μL of 2 × TaqMan® Gene Expression Master Mix (Applied Biosystems), 1 μL of 20 × TaqMan Gene Expression Assay (Applied Biosystems), 3 μL cDNA by volume, and 6 μL of H2O DEPC, at a final volume of 20 μL.
The expression values of the miRNAs of interest were determined by the relative quantification (RQ) method in relation to normalizing of the gene used as reference (2−ΔΔCq). Details of the sequences of miRNAs (miR-210 and miR-152) are available in Table S1, Supplementary Materials.
2.5. Analysis of Target Protein Expression by Immunohistochemistry
The protein expression of the target genes HIF-1α, IGF-IR, VHL, and VEGF was performed by immunohistochemistry assay, and their standardization followed the instructions provided by the manufacturer. Histological sections of 4 μm were obtained from paraffin-embedded material and adhered to silanized slides. The deparaffinization was performed on xylol followed by hydration, and subsequently incubated with hydrogen peroxide with the blocking of proteins (blocking non-specific reactions). The material was incubated with the primary antibody of each specific protein for 18 h at 4 °C. The Complement and HRP Conjugate (REVEAL™ Biotin-Free Polyvalent DAB - Spring Bioscience, Pleasanton, CA, USA) were applied, followed by the chromogenic substrate (DAB) and Harris hematoxylin.
All immunoreactions were accompanied by a positive control and a negative control (without primary antibody). The slides were observed under a 40× objective of the Olympus BX60 light equipment (Olympus, Shinjuku, Tokyo, Japan) and analyzed by optical densitometry. For each sample, 3 different fields were photographed only in the immunoreactive areas, in which 20 points were quantified with ImageJ software, totaling 60 quantified points for each slide. The values were obtained in arbitrary units (a.u.) and demonstrated the average optical density (DOM) for each sample. The details of the antibodies and the photomicrographs of the positive and negative controls are presented in Table S2 and Figure S1, respectively, Supplementary Materials.
2.6. Statistical Analysis
The results were submitted to descriptive analysis to determine normality. For each group, the Gaussian distribution test or D’Agostino and Pearson omnibus normality test was applied. The comparison of two parameters was performed using the Mann–Whitney test, and for three or more parameters the Kruskal–Wallis test (posteriorly Dunn post test) was performed. Data were presented as mean ± standard error of the mean (SEM). Values of p < 0.05 were considered significant and all analyses were performed using GraphPad Prism 8 software (GraphPad Software, Inc., San Diego, CA, USA). In order to measure the diagnostic accuracy of each miRNA, the receiver operating characteristic (ROC) curve was used. In addition, the sensitivity and specificity of the optimum cutoff point were defined as those values that maximized the area under the curve (AUC).
3. Results
3.1. Characterization of Study Population
For the BC group, the demographic characteristics analyzed were age, distant metastasis, pathological prognosis staging, histological grade, and expression of hormonal receptors (ER, RP, HER2). Regarding age, among the 30 women included in this study, 25 (83.33%) had an age greater than or equal to 50 years, the mean age being 59 years (29–79 years). For the pathological prognosis staging, 14 samples (46.66%) were of the early/intermediate stages (Ia, Ib, IIa, and IIb), and 16 samples (53.34%) were of the advanced stage (IIIa, IIIb, IIIc, and IV). The histological grade of the tumor showed that 3 (10%), 20 (66.67%), and 7 (23.33%) samples were tumors that were low differentiated (Grade I), moderately differentiated (Grade II), and well differentiated (Grade III), respectively. Distant metastasis was found in 6 (20%) women with metastatic BC at the time of this study. For the expression of hormone receptors, the data show that 22 (73.33%), 19 (63.33%), and 14 (46.67%) samples were positive for ER, PR, and HER2, respectively. The mean age of the BBC group was 52 years (40–70 years), and the mean age of the control group was 49 years (23–70 years).
3.2. Expression Levels of miRNAs in Breast Cancer
Initially, we verified the expression of miR-210 and miR-152 in tumor fragments (BC), benign (BBC), and control to test the different levels of expression of these miRNAs in BC. MiR-210 showed increased expression in tumor fragments of BC compared to the BBC (* p < 0.05) (Figure 2a). However, there was no significant difference between BC fragments compared to the control group and between the BBC group and the control group. For miR-152, relative quantification showed decreased expression in tumor fragments of BC when compared to BBC fragments (** p < 0.01) and normal fragments (** p < 0.01) (Figure 2b).
Subsequently, we verified the expression levels of these miRNAs in plasma samples for the three different groups. With respect to miR-210, the relative quantification showed increased plasma expression for women with BC compared to the control group (** p < 0.01) (Figure 3a). However, there was no significant difference in plasma samples from the BC group compared to the BBC group or between the BBC group and the control group.
Surprisingly, we found that the tumor suppressor, miR-152, also had elevated levels in plasma samples from BC patients compared to the control group (* p < 0.05), different from the tumor fragments (Figure 3b). There was no significant difference in these miRs when compared to the BC group and women with BBC.
After finding the expression levels in the BC, BBC, and control groups, the miRNA expression levels were also analyzed in the staging groups. Our results show that miR-210 had increased expression in fragments of malignant neoplasms of advanced stage when compared to samples of early/intermediate stage BC fragments (** p < 0.01). In addition, there was increased expression in malignant neoplasms of advanced stage when compared to samples of BBC fragments (** p < 0.01) (Figure 4a). Regarding miR-152, relative quantification showed decreased expression in malignant neoplasm fragments of advanced stage in relation to the control group (* p < 0.05). The difference was also significant among women with early/intermediatestage malignant neoplasm vs. women with BBC (* p < 0.05) and control women (* p < 0.05) (Figure 4b). However, there was no difference between the different stages of BC for miR-152 in fragments.
For plasma samples, with respect to the miR-210, relative quantification showed increased expression in women with advanced stage of BC in relation to women controls (*** p < 0.001) (Figure 5a). However, there was no significant difference between the different stages of BC. Surprisingly, in addition to the increased expression level of the tumor suppressor, miR-152, in plasma of women with BC, this was also able to differentiate women with advanced stage from women with early/intermediate stage of BC and control women (* p < 0.05) (Figure 5b).
Finally, the miRNA expression levels were analyzed together to verify the strength of their combined use in plasma samples. Our results showed the combined amount of both miRNAs was able to differentiate patients with BC from control group (*** p < 0.001). However, there was no significant difference between the BC and BBC group (Figure 6a). In addition, the two miRNAs together were able to differentiate patients in advanced stage of BC from patients with early/intermediate stage of BC (** p < 0.01), advanced stage from BBC (* p < 0.05) and, lastly, advanced stage from control (*** p < 0.001). The other peer-compared groups showed no significant differences (Figure 6b).
3.3. miR-210 and miR-152 Are Stable in Bloodstream
Subsequently, the differences in the miRNA expression in fragments and plasma samples were analyzed for the BC group. The results reveal that miR-210 (** p < 0.01) (Figure 7a) and miR-152 (*** p < 0.001) (Figure 7b) presented increased expression in plasma samples compared to the fragments, indicating that oncomiR, and even the tumor suppressor, have stabilizing mechanisms in the bloodstream. Although both miRNAs were increased in plasma samples compared to the fragment, there was no significant difference in circulating levels between them (Figure 7c).
3.4. Expression of miRNA Target Proteins by Immunohistochemistry
To confirm the action of miR-210 and miR-152 on the angiogenesis pathway, we verified the expression of the target proteins of both miRNAs by immunohistochemistry. All proteins showed cytoplasmic marking. Evaluation of protein expression by immunohistochemistry revealed increased levels of HIF-1α (*** p < 0.0001), IGF-1R (*** p < 0.0001), and VEGF (*** p < 0.0001) proteins in BC tissues compared to the control group. In addition, the proteins also showed increased expression in BC samples compared to the BBC group (HIF-1α *** p < 0.0001, IGF-1R *** p < 0.0001, and VEGF *** p < 0.0001). With respect to VHL, this protein showed decreased expression in BC samples when compared to the control group (*** p < 0.0001) and BBC group (*** p < 0.0001) (Figure 8).
3.5. Evaluation of miR-210 and miR-152 as Potential Diagnostic and Staging Biomarkers
Analysis of the ROC curve was used to determine miR-210 and miR-152 in plasma as a diagnostic biomarker to differentiate patients with BC from healthy individuals. The AUC for miR-210 for women with BC compared to the control group was 0.8427 (0.7174 to 0.9680) (p = 0.0011) with optimal sensitivity and specificity values of 76.9% and 90.9%, respectively, to the cut-off value of 1.690 as well as a positive predictive value of 95.24% and a negative predictive value of 62.44% (Figure 9a).
The AUC for miR-152 in plasma expression for women with BC compared to the control group was 0.7709 (0.6095 to 0.9324) (p = 0.0105) with optimal sensitivity and specificity values of 80% and 72.7%, respectively, to the cut-off value of 0.252 as well as a positive predictive value of 86.92% and a negative predictive value of 61.58%. (Figure 9b). Therefore, miR-210 and miR-152 expression in plasma samples have appropriate sensitivity and specificity to differentiate women without BC from women with BC (Figure 9).
ROC curve analysis was also performed to investigate the role of mir-152 in plasma as a staging biomarker for distinguishing advanced stage of BC patients from early/intermediate stage BC patient. On RT-qPCR, miR-210 did not show significantly different levels between women with early/intermediate stage of BC and women with advanced stage. The miR-152 showed good results in ROC analysis for women with advanced BC compared to women with early/intermediate stages of BC. The AUC was 0.8917 (0.7598 to 1.0000) (p = 0.0019) with optimal sensitivity and specificity values of 90% and 75%, respectively, to the cut-off value of 2.573 as well as a positive predictive value of 73.03% and a negative predictive value of 89.98% (Figure 9c).
Ultimately, the ROC curve was used with the combined amount of these two miRNAs to determine whether together they could be diagnostic and prognostic biomarkers for BC (Figure 10).
The AUC for both miRNAs in plasma expression for women with BC compared to the control group was 0.7542 (0.6345 to 0.8739) (p = 0.0004) with optimal sensitivity and specificity values of 83.33% and 68.0%, respectively, to the cut-off value of 0.9571 as well as a positive predictive value of 89.47% and a negative predictive value of 55.51% (Figure 10a). Thus, the combined amount expression in plasma samples has appropriate sensitivity and specificity to differentiate the control group to women with BC.
ROC curve analysis was also performed to investigate the role of miR-210 with miR-152 in plasma together as staging biomarkers for distinguishing advanced stage from early/intermediate stage of BC. The AUC was 0.7733 (0.6382 to 0.9084) (p = 0.0016) with optimal sensitivity and specificity values of 85.71% and 60%, respectively, to the cut-off value of 2.660 as well as a positive predictive value of 83.29% and a negative predictive value of 64.33% (Figure 10b). Therefore, miRNAs together showed good results in the analysis of the ROC curve as prognostic biomarkers. However, the AUC showed that miRNAs individually are better diagnostic and prognostic biomarkers for BC.
4. Discussion
This study aimed to identify and validate two promising circulating miRNAs as biomarkers for diagnosis and staging of BC. In the clinical routine, a useful biomarker is still not available that is able to detect early malignant breast tumors and also predict the clinical evolution of the disease, with the advantage of being minimally invasive and routinely quantified [21]. In addition to the benefits of liquid biopsy, studies show that miRNAs are stable in biological fluids, and therefore have been investigated as potential circulating biomarkers [9]. Thus, the well-consolidated miRNAs in BC were selected to verify if they have good potential as circulating biomarkers.
miR-210 has been reported as one of the most consistent miRNAs for this neoplasm [22]. In this study, the results showed increased expression levels of miR-210 in tumor fragment samples. Thakur et al. also observed increased expression of this miRNA in tissue and cell lines of BC (MDA-MB-231 and MCF-10) [23]. Subsequently, the oncomiR-210 target protein expressions involved in the angiogenesis pathway were validated. In BC samples, this study found increased levels of HIF-1α expression and decreased levels of VHL. In neuroblastoma tumors, Ognibene et al. also observed that most hypoxic tumors present high expression of HIF-1α, which is a prognostic indicator to stratify high-risk patients [24]. In renal carcinoma cells, densitometry analysis revealed that the protein expression of VHL in cancerous tissue was lower when compared to normal adjacent tissue of the patients [25].
Another miRNA addressed in this study was miR-152. This is considered a tumor miRNA suppressor well validated in several types of neoplasms, including BC [16,26]. In this study, decreased levels of miR-152 expression were observed in tumor fragments. In addition to these results, Wen et al. found that miR-152 expression levels were significantly lower in BC fragments than in non-cancerous tissues [27]. Furthermore, Ge et al. investigated the role of this miRNA in the initiation and progression of BC and found that miR-152 expression was significantly reduced in BC fragments and in cell lines [19]. MiR-152 acts on the angiogenesis pathway as a tumor suppressor, leading to IGF-1R blockade [16]. In agreement with our findings, studies have observed the overexpression of IGF-1R in BC samples, and this may influence the heterogeneity of molecular subtypes [28].
Both cascades of miR-210 and miR-152 have a final interference on the VEGF protein, which culminates in the development of new blood vessels for the tumor microenvironment [29]. In this study, the expression of VEGF in BC samples was validated. As with our results, previous studies have shown an increase of this protein in BC and also in other neoplasms [30,31].
After verifying the expression of these miRNAs and their target proteins in BC fragments, we questioned whether they could be potential circulating biomarkers for this neoplasm. According to Chen et al. [32], the source of circulating miRNAs in cancer patients is controlled by the following three mechanisms: (i) passive miRNA leakage from tumor cells, (ii) active secretion via microvesicles, and (iii) active secretion using an RNA-binding protein-dependent pathway, without microvesicles. Nonetheless, according to these authors, the miRNAs from sources (i) and (ii) have stability in the blood circulation, despite the presence of ribonucleases.
In the specific case of miR-210, this study found increased levels in the plasma of patients with BC, which coincides with the findings in the fragments. In agreement with these results, Madhavan et al. observed that miR 210 presented high levels in plasma samples from women with BC, and its expression was associated with the appearance of metastasis for up to two years after confirmation of the diagnosis [33]. Markou et al. also found significantly elevated plasma miR-210 levels in women with metastatic BC compared to healthy women [34]. Moreover, Qattan et al., comparing the expression levels of plasma miRNAs from women with BC and available RNASeq data from breast tumor tissue, also found that miR-210 showed increased levels of expression in both samples [35].
Cancer cells secrete various types of humoral factors in their tumor microenvironment and, among them, are extracellular vesicles (microvesicles and exosomes). Currently, evidence suggests the importance of communication between cancer cells and their microenvironment by releasing membrane exosomes that can fuse with nearby cells [36]. According to Adouh et al., circulating blood exosomes are the main contributing factors involved in the horizontal transfer of malignant characteristics to the target cells [37]. These horizontal molecular transfers can modulate cell-signaling pathways, such as the miR-210 pathway of angiogenesis. It is concluded, therefore, that the increased levels of miR-210 in plasma may reflect molecular changes in the cells from which they are derived [38].
Our results showed increased expression of circulating miR-152 in the plasma of women with BC. This was an interesting finding in this study because, as already described, miR-152 has a suppressive action on fragments of breast neoplasms. In the literature, there is only one study involving miR-152 and blood samples from patients with BC. The authors also observed increased plasma levels of miR-152 in patients with the disease and in patients with benign lesions compared to the control group. Furthermore, the increased expression of plasma miR-152 levels was also observed in patients with lung and colon cancer when compared to the control group [39]. Another study demonstrated that an increased level of circulating miR-152 was found in patients with bladder cancer, which was related to tumor recurrence of invasive bladder cancer [40]. In addition, Lin et al. showed that the tumor suppressor miR-34a was upregulated in esophageal cancer and concluded that this miRNA can serve as a potential biomarker in the detection of the early stages of this neoplasia [41]. Moreover, Qattan et al. observed an inverse pattern between plasma and tissue levels of patients with BC triple negative for let-7b, miR-29c, and miR-22. In all cases, plasma miRNA levels were higher than tissue levels [35].
According to Kosaka et al., negatively regulated miRNAs in cancer tissues are supplied during the initial stage of tumorigenesis by the surrounding cells that provide exosomes containing the decreased miRNAs. However, if the surrounding cells fail to meet demand, the cancer cells end up entering an advanced oncogenic stage. Thus, microRNAs secreted by exosomes can be useful for the maintenance and surveillance system against cancer progression [42].
In some cases, the exosomal mechanism can be used by metastatic cells to eliminate miRNAs with suppressive functions. For example, one study showed that miRNAs in the let-7 family, which preferentially act as a tumor suppressor, showed increased levels of expression in metastatic gastric cancer cells compared to non-metastatic parental cells. Therefore, the authors concluded that the let-7 miRNA family is rich in exosomes from a metastatic gastric cancer [43]. Yet, another study showed that tumor suppressor miR-23b, highly secreted by exosomes from metastatic cells, showed decreased levels in lymph node metastasis compared to primary tumors. Thus, the exosome-mediated secretion of tumor suppressor miRNA is selected during tumor progression as a mechanism to coordinate the activation of a metastatic cascade [44].
Therefore, exosomes play an important role in communicating with the tumor microenvironment, since cancer cells can modulate the stromal environment in their favor, or even surrounding cells can try to stop the evolution of malignancy by “delivering” protective miRNAs [45]. Many studies show that circulating miRNAs packaged by extracellular vesicles are protected from the degradation action of ribonucleases and, therefore, present high levels in the bloodstream. In this way, so as not to be degraded in the bloodstream, secretory vesicles carry circulating miRNAs [46,47].
In summary, we hypothesized that the discrepancies in the expected miR-152 expression in plasma and tissue fragments occur because circulating miRNAs packaged by extracellular vesicles are protected from the degradation action of ribonucleases and, thus, present high levels in the bloodstream. Despite the advances made regarding miR-152, further studies are needed to determine which regulatory mechanisms for miRNAs are secreted by exosomes, especially with regard to tumor suppressor miRNAs present in biological fluids. This will provide enormous opportunities for cancer-targeted therapies in the near future.
In order to establish the value of miRNAs as circulating biomarkers of diagnosis and staging, ROC curves were constructed and the AUC calculated. Hosmer and Lemeshow defined a rule that studies follow to identify good results in the ROC curves, based on respective AUC values: “0.5 = this suggests no discrimination, so we might as well flip a coin; 0.5–0.7 = we consider this poor discrimination, not much better than a coin toss; 0.7–0.8 = acceptable discrimination; 0.8–0.9 = excellent discrimination and >0.9 = outstanding discrimination” [48].
In the present study, results showed that miR-210 in plasma samples have excellent discrimination to be used as a biomarker of diagnosis, according to the AUC of the ROC curve comparing the control group and BC. With the same objective, other studies obtained similar results. Markou et al. evaluated miR-210 by ROC curve analysis and concluded that it was a valuable biomarker for discriminating patients from healthy individuals, with AUCs of 0.959 (95% Confidence Interval (CI) = 0.917–1.000, p < 0.0001) [34].
Despite the unexpected increased expression of miR-152 in women with BC, ROC curve analysis demonstrated that miR-152 expression in plasma samples has an acceptable discrimination to be used as a biomarker of diagnosis. Furthermore, miR-152 has shown greater sensitivity compared to miR-210, which demonstrated its greater capacity in the screening of BC. In contrast, miR-210 was shown to be the most specific in the analysis, which could indicate a greater capacity, compared to the miR-152, to confirm the diagnosis of BC, with lower false-positive results. In the same way, other authors obtained similar results. Chen et al. observed significant upregulated miR-152 expression with a 2.91-fold change in BC patients (p = 0.00275), when compared to normal controls. Furthermore, they evaluated miR-152 by ROC curve analysis and concluded that it was a valuable plasma biomarker for discriminating patients with BC and BBC from normal controls [39].
To investigate the role of miR-152 in plasma staging biomarkers, the values of AUC showed that miR-152 plasma expression has an outstanding discrimination to differentiate early/intermediate and advanced stage of BC patients. Furthermore, Dasari et al. evaluated that the level of miR-152 in peripheral blood was higher in patients with high-grade cervical intraepithelial neoplasia (CIN) compared with those with low-grade CIN, which demonstrates the prognostic importance of this miRNA in the carcinogenic process [49].
5. Conclusions
In conclusion, analysis of miRNA expression in the fragments showed increased miR-210 and decreased miR-152 in BC, also validated by the expression of their target proteins involved in angiogenesis. Among miRNAs, miR-210 had a potential as a diagnostic biomarker and miR-152 presented a potential as diagnostic and staging biomarkers. The combination of the two miRNAs has the potential to be used as diagnostic and prognostic biomarkers in BC, but not better than the miRNAs used individually. These results may contribute to the use of these miRNAs as promising circulating markers in addition to the benefit of being detected by liquid biopsy. In the future, it is also expected that the miRNAs may be potential therapeutic targets, contributing to advances in personalized medicine.
Acknowledgments
The authors thank to the Laboratory of Morphology and Microanalysis (LMM) of the Institute of Biosciences, Letters and Exact Sciences (IBILCE), Sao Jose do Rio Preto, Brazil, for the support in obtaining the photomicrographs. Thanks to all patients and to the team of doctors, nurses and technicians at the Base Hospital, Sao Jose do Rio Preto, Brazil.
Supplementary Materials
The following are available online at https://www.mdpi.com/2075-4426/11/1/31/s1, Table S1: Description of microRNAs, Table S2: Primary antibodies used in immunohistochemical techniques and their respective specifications, Figure S1: Photomicrographs of the positive and negative controls of the target proteins during the immunohistochemistry reaction. Magnification of 40X. Bar: 20 μm.
Author Contributions
Conceptualization, B.C.L. and D.A.P.C.Z.; methodology, B.C.L., C.Z.B., F.V.V., J.G.d.O. and E.M.K.-J.; software, B.C.L., C.Z.B. and F.V.V.; validation, B.C.L., C.Z.B. and J.G.d.O.; formal analysis, B.C.L. and C.Z.B.; investigation, B.C.L. and C.Z.B.; resources, D.A.P.C.Z.; data curation, B.C.L. and D.A.P.C.Z.; writing—original draft preparation, B.C.L. and C.Z.B.; writing—review and editing, D.A.P.C.Z.; visualization, B.C.L. and D.A.P.C.Z.; supervision, D.A.P.C.Z. and N.A.B.-J.; project administration, D.A.P.C.Z.; funding acquisition, B.C.L. and D.A.P.C.Z. All authors have read and agreed to the published version of the manuscript.
Funding
Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) (2017/11807-3)/MSc. Beatriz Camargo Lopes. Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) (2017/15006-5)/PhD. Debora Aparecida Pires de Campos Zuccari. Fundação de Apoio à Pesquisa e Extensão de Sao Jose do Rio Preto (FAPERP) (028/2018)/MSc. Beatriz Camargo Lopes.
Institutional Review Board Statement
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. In addition, all procedures performed in studies were in accordance with the ethical standards of the institutional and/or national research committee (Research Ethics Committee (CEP) of the Faculty of Medicine of Sao Jose do Rio Preto (FAMERP), Sao Jose do Rio Preto, Brazil, #2.118.866/2017). This article does not contain any studies with animals performed by any of the authors.
Informed Consent Statement
Informed consent was obtained from all individual participants included in the study.
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Crawford Y., Ferrara N. VEGF inhibition: Insights from preclinical and clinical studies. Cell Tissue Res. 2009;335:261–269. doi: 10.1007/s00441-008-0675-8. [DOI] [PubMed] [Google Scholar]
- 2.Zhang C., Liu K., Li T., Fang J., Ding Y., Sun L., Tu T., Jiang X., Du S., Hu J., et al. miR-21: A gene of dual regulation in breast cancer. Int. J. Oncol. 2016;48:161–172. doi: 10.3892/ijo.2015.3232. [DOI] [PubMed] [Google Scholar]
- 3.Boudreau N., Myers C. Breast cancer-induced angiogenesis: Multiple mechanisms and the role of the microenvironment. Breast Cancer Res. 2003;5:140–146. doi: 10.1186/bcr589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Chiu C.J., Conley Y.P., Gorin M.B., Gensler G., Lai C.Q., Shang F., Taylor A. Associations between Genetic Polymorphisms of Insulin-like Growth Factor Axis Genes and Risk for Age-related Macular Degeneration. Investig. Ophthalmol. Vis. Sci. 2011;52:9099–9107. doi: 10.1167/iovs.11-7782. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Rahimi N. The Ubiquitin-Proteasome System Meets Angiogenesis. Mol. Cancer Ther. 2012;11:538–548. doi: 10.1158/1535-7163.MCT-11-0555. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Wu F.T., Lu L., Xu W., Li J.Y. Circulating tumor DNA: Clinical roles in diffuse large B cell lymphoma. Ann. Hematol. 2018;98:255–269. doi: 10.1007/s00277-018-3529-9. [DOI] [PubMed] [Google Scholar]
- 7.Qi Z.H., Xu H.X., Zhang S.R., Xu J.Z., Li S., Gao H.L., Jin W., Wang W.Q., Wu C.T., Ni Q.X., et al. The Significance of Liquid Biopsy in Pancreatic Cance. J. Cancer. 2018;9:3417–3426. doi: 10.7150/jca.24591. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Esquela-Kerscher A., Slack F.J. Oncomirs-microRNAs with a role in cancer. Nat. Rev. Cancer. 2006;6:259–269. doi: 10.1038/nrc1840. [DOI] [PubMed] [Google Scholar]
- 9.Wei J., Gao W., Zhu C.J., Liu Y.K., Mei Z., Cheng T., Shu Y.Q. Identification of plasma microRNA-21 as biomarker for early detection and chemosensity of non-small cell lung cancer. Chin. J. Cancer. 2011;30:407–414. doi: 10.5732/cjc.010.10522. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Bertoli G., Cava C., Castiglioni I. MicroRNAs: New biomarkers for diagnosis, prognosis, therapy prediction and therapeutic tools for breast cancer. Theranostics. 2015;5:1122–1143. doi: 10.7150/thno.11543. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Karakashev S.V., Reginato M.J. Progress toward overcoming hypoxia-induced resistance to solid tumor therapy. Cancer Manag. Res. 2015;7:253–264. doi: 10.1186/s13046-015-0148-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Agrawal R., Pandey P., Jha P., Dwivedi V., Sarkar C., Kulshreshtha R. Hypoxic signature of microRNAs in glioblastoma: Insights from small RNA deep sequencing. BMC Genom. 2014;17:1–16. doi: 10.1186/1471-2164-15-686. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Jung E.J., Santarpia L., Kim J., Esteva F.J., Moretti E., Buzdar A.U., Di Leo A., Le X.F., Bast-Jr R.C., Park S.T., et al. Plasma microRNA 210 levels correlate with sensitivity to trastuzumab and tumor presence in breast cancer patients. Cancer. 2012;118:2603–2614. doi: 10.1002/cncr.26565. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Dang K., Myers K.A. The role of Hypoxia-Induced miR-210 in Cancer Progression. Int. J. Mol. Sci. 2015;16:6353–6372. doi: 10.3390/ijms16036353. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Liu D., Xia H., Wang F., Chen C., Long J. MicroRNA-210 interacts with FBXO31 to regulate cancer proliferation cell cycle and migration in human breast cancer. Onco Targets Ther. 2016;9:5245–5255. doi: 10.2147/OTT.S110969. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Xu Q., Jiang Y., Yin Y., Li Q., He J., Jing Y., Qi Y.-T., Xu Q., Li W., Lu B., et al. A regulatory circuit of miR-148a/152 and DNMT1 in modulating cell transformation and tumor angiogenesis through IGF-IR and IRS1. J. Mol. Cell Biol. 2013;5:3–13. doi: 10.1093/jmcb/mjs049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Sengupta D., Deb M., Rath S.K., Kar S., Parbin S., Pradhan N., Patra S.K. DNA methylation and not H3K4 trimethylation dictates the expression status of miR-152 gene which inhibits migration of breast cancer cells via DNMT1/CDH1 loop. Exp. Cell Res. 2016;15:176–187. doi: 10.1016/j.yexcr.2016.07.023. [DOI] [PubMed] [Google Scholar]
- 18.Liu X., Li J., Qin F., Dai S. miR-152 as a tumor suppressor microRNA: Target recognition and regulation in cancer. Oncol. Lett. 2016;11:3911–3916. doi: 10.3892/ol.2016.4509. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Ge S., Wang D., Kong Q., Gao W., Sun J. Function of miR-152 as a Tumor Suppressor in Human Breast Cancer by Targeting PIK3CA. Oncol. Res. 2017;25:1363–1371. doi: 10.3727/096504017X14878536973557. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 20.Roth C., Rack B., Müller V., Janni W., Pantel K., Schwarzenbach H. Circulating microRNAs as blood-based markers for patients with primary and metastatic breast cancer. Breast Cancer Res. 2010;12:R90. doi: 10.1186/bcr2766. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Duffy M.J., Harbeck N., Nap M., Molina R., Nicolini A., Senkus E., Cardoso F. Clinical use of biomarkers in breast cancer: Updated guidelines from the European Group on Tumor Markers (EGTM) Eur. J. Cancer. 2017;75:284–298. doi: 10.1016/j.ejca.2017.01.017. [DOI] [PubMed] [Google Scholar]
- 22.Qin Q., Furong W., Baosheng L. Multiple functions of hypoxia-regulated miR-210 in cancer. J. Exp. Clin. Cancer Res. 2014;33:1–10. doi: 10.1186/1756-9966-33-50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Thakur S., Grover R.K., Gupta S., Yadav A.K., Das B.C. Identification of Specific miRNA Signature in Paired Sera and Tissue Samples of Indian Women with Triple Negative Breast Cancer. PLoS ONE. 2016;11:1–21. doi: 10.1371/journal.pone.0158946. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Ognibene M., Cangelosi D., Morini M., Segalerba D., Bosco M.C., Sementa A.R., Eva A., Varesio L. Immunohistochemical analysis of PDK1, PHD3 and HIF-1α expression defines the hypoxic status of neuroblastoma tumors. PLoS ONE. 2017;12:1–19. doi: 10.1371/journal.pone.0187206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Hogner A., Krause H., Jandrig B., Kasim M., Fuller T.F., Schostak M., Erbersdobler A., Patzak A., Kilic E. PBRM1 and VHL expression correlate in human clear cell renal cell carcinoma with differential association with patient’s overall survival. Urol. Oncol. Semin. Orig. Investig. 2018;36:94.e1–94.e14. doi: 10.1016/j.urolonc.2017.10.027. [DOI] [PubMed] [Google Scholar]
- 26.Zhang H., Lu Y., Wang S., Sheng X., Zhang S. MicroRNA-152 Acts as a Tumor Suppressor MicroRNA by Inhibiting Kruppel-Like Factor 5 in Human Cervical Cancer. Oncol Res. Featur. Preclin. Clin. Cancer Ther. 2019;27:335–340. doi: 10.3727/096504018X15252202178408. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Wen Y.Y., Liu W.T., Sun H.R., Ge X., Shi Z.M., Wang M., Ling-Zhi L., Zhang J.Y., Liu L.Z., Jiang B.H. IGF-1-mediated PKM2/beta-catenin/miR-152 regulatory circuit in breast cancer. Sci. Rep. 2017;7:1–10. doi: 10.1038/s41598-017-15607-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Sun W.Y., Yun H.Y., Song Y.J., Kim H., Lee O.J., Nam S.J., Koo J.S. Insulin-like growth factor 1 receptor expression in breast cancer tissue and mammographic density. Mol. Clin. Oncol. 2015;3:572–580. doi: 10.3892/mco.2015.497. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Cebe-Suarez S., Zehnder-Fjallman A., Ballmer-Hofer K. The role of VEGF receptors in angiogenesis; complex partnerships. Cell Mol. Life Sci. 2006;63:601–615. doi: 10.1007/s00018-005-5426-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Maae E., Nielsen M., Steffensen K.D., Jakobsen E.H., Jakobsen A., Sorensen F.B. Estimation of immunohistochemical expression of VEGF in ductal carcinomas of the breast. J. Histochem. Cytochem. 2011;59:750–760. doi: 10.1369/0022155411412599. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Wen S., Shao G., Zheng J., Zeng H., Luo J., Gu D. Apatinib regulates the cell proliferation and apoptosis of liver cancer by regulation of VEGFR2/STAT3 signaling. Pathol. Res. Pract. 2019;215:816–821. doi: 10.1016/j.prp.2019.01.021. [DOI] [PubMed] [Google Scholar]
- 32.Chen X., Liang H., Zhang J., Zen K., Zhang C.Y. Secreted microRNAs: A new form of intercellular communication. Trends Cell Biolog. 2012;22:125–132. doi: 10.1016/j.tcb.2011.12.001. [DOI] [PubMed] [Google Scholar]
- 33.Madhavan D., Peng C., Wallwiener M., Zucknick M., Nees J., Schott S. Circulating miRNAs with prognostic value in metastatic breast cancer and for early detection of metastasis. Carcinogenesis. 2016;37:461–470. doi: 10.1093/carcin/bgw008. [DOI] [PubMed] [Google Scholar]
- 34.Markou A., Zavridou M., Sourvinou I., Yousef G., Kounelis S., Malamos N., Georgoulias V., Lianidou E. Direct Comparison of Metastasis-Related miRNAs Expression Levels in Circulating Tumor Cells, Corresponding Plasma, and Primary Tumors of Breast Cancer Patients. Clin. Chem. 2016;62:1002–1011. doi: 10.1373/clinchem.2015.253716. [DOI] [PubMed] [Google Scholar]
- 35.Qattan A.M., Intabli H., Alkhayal W., Eltabache C., Tweigieri T., Amer S.B. Robust expression of tumor suppressor miRNA’s let-7 and miR-195 detected in plasma of Saudi female breast cancer patients. BMC Cancer. 2017;17:1–10. doi: 10.1186/s12885-017-3776-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Yoshioka Y., Katsuda T., Ochiya T. Extracellular vesicles and encapusulated miRNAs as emerging cancer biomarkers for novel liquid biopsy. Jpn. J. Clin. Oncol. 2018;48:1–8. doi: 10.1093/jjco/hyy120. [DOI] [PubMed] [Google Scholar]
- 37.Adouh M., Hamam D., Gao Z.H., Arena V., Arena M., Arena G.O. Exosomes isolated from cancer patients sera transfer malignant traits and confer the same phenotype of primary tumors to oncosuppressor-mutated cells. J. Exp. Clin. Cancer Res. 2017;36:1–15. doi: 10.1186/s13046-017-0587-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Dilsiz N. Role of exosomes and exosomal microRNAs in cancer. Future Sci. 2020;6:FSO465. doi: 10.2144/fsoa-2019-0116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Chen H., Liu H., Zou H., Chen R., Dou Y., Sheng S., Dai S., Ai J., Melson J., Kittles R.A., et al. Evaluation of Plasma miR-21 and miR-152 as Diagnostic Biomarkers for Common Types of Human Cancers. J. Cancer. 2016;7:490–499. doi: 10.7150/jca.12351. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Jiang X., Du L., Wang L., Li J., Liu Y., Zheng G., Qu A., Zhang X., Pan H., Yang Y., et al. Serum microRNA expression signatures identified from genome-wide microRNA profiling serve as novel noninvasive biomarkers for diagnosis and recurrence of bladder cancer. Int. J. Cancer. 2015;136:854–862. doi: 10.1002/ijc.29041. [DOI] [PubMed] [Google Scholar]
- 41.Lin Y., Lin Z., Fang Z., Li H., Zhi X., Zhang Z. Plasma MicroRNA-34a as a Potential Biomarker for Early Diagnosis of Esophageal Cancer. Clin. Lab. 2019;65 doi: 10.7754/Clin.Lab.2019.190340. [DOI] [PubMed] [Google Scholar]
- 42.Kosaka N., Iguchi H., Yoshioka Y., Takeshita F., Matsuki Y., Ochiya T. Secretory Mechanisms and Intercellular Transfer of MicroRNAs in Living Cells. J. Biol. Chem. 2010;285:17442–17452. doi: 10.1074/jbc.M110.107821. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Ohshima K., Inoue K., Fujiwara A., Hatakeyama K., Kanto K., Watanabe Y., Muramatsu K., Fukuda Y., Ogura S.-I., Yamaguchi K., et al. Let-7 microRNA family is selectively secreted into the extracellular environment via exosomes in a metastatic gastric cancer cell line. PLoS ONE. 2010;8:e13247. doi: 10.1371/journal.pone.0013247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Ostenfeld M.S., Jeppesen D.K., Laurberg J.R., Boysen A.T., Bramsen J.B., Primdal-Bengtson B., Hendrix A., Lamy P., Dagnaes-Hansen F., Rasmussen M.H., et al. Cellular Disposal of miR23b by RAB27-Dependent Exosome Release Is Linked to Acquisition of Metastatic Properties. Cancer Res. 2014;74:5758–5771. doi: 10.1158/0008-5472.CAN-13-3512. [DOI] [PubMed] [Google Scholar]
- 45.Falcone G., Felsani A., D’Agnano I. Signaling by exosomal microRNAs in cancer. J. Exp. Clin. Cancer Res. 2015;34:1–10. doi: 10.1186/s13046-015-0148-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Wang K., Zhang S., Weber J., Baxter D., Galas D.J. Export of microRNAs and microRNA-protective protein by mammalian cells. Nucleic Acids Res. 2010;38:7248–7259. doi: 10.1093/nar/gkq601. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Mitchell P.S., Parkin R.K., Kroh E.M., Fritz B.R., Wyman S.K., Pogosova-Agadjanyan E.L., Peterson A., Noteboom J., O’Briant K.C., Allen A., et al. Circulating microRNAs as stable blood-based markers for cancer detection. Proc. Natl. Acad. Sci. USA. 2008;105:10513–10518. doi: 10.1073/pnas.0804549105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Hosmer D.W., Jr., Lemeshow S., Sturdivant R.X. Applied Logistic Regression. 3rd ed. Wiley; Hoboken, NJ, USA: 2013. p. 177. [Google Scholar]
- 49.Dasari S., Wudayagiri R., Valluru L. Cervical Cancer: Biomarkers for Diagnosis and Treatment. Clin. Chim. Acta. 2015;445:7–11. doi: 10.1016/j.cca.2015.03.005. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.