Abstract
Circulating microRNAs are non-invasive biomarkers that can be used for breast cancer diagnosis. However, differences in cancer tissue microRNA expression are observed in populations with different genetic/environmental backgrounds. This work aims at checking if a previously identified diagnostic circulating microRNA signature is efficient in other genetic and environmental contexts, and if a universal circulating signature might be possible. Two populations are used: women recruited in Belgium and Rwanda. Breast cancer patients and healthy controls were recruited in both populations (Belgium: 143 primary breast cancers and 136 healthy controls; Rwanda: 82 primary breast cancers and 73 healthy controls; Ntot = 434), and cohorts with matched age and cancer subtypes were compared. Plasmatic microRNA profiling was performed by RT-qPCR. Random Forest was used to (1) evaluate the performances of the previously described breast cancer diagnostic tool identified in Belgian-recruited cohorts on Rwandan-recruited cohorts and vice versa; (2) define new diagnostic signatures common to both recruitment sites; (3) define new diagnostic signatures efficient in the Rwandan population. None of the circulating microRNA signatures identified is accurate enough to be used as a diagnostic test in both populations. However, accurate circulating microRNA signatures can be found for each specific population, when taken separately.
Subject terms: Cancer, Computational biology and bioinformatics, Genetics, Biomarkers, Medical research, Oncology
Introduction
Breast cancer is the most commonly diagnosed and deadly malignancy in women in both developed and developing countries, with about 2.1 million cases and 627,000 deaths registered in 2018. It causes 25.1% of all cancer deaths each year in developed countries and is the leading cause of mortality among women in developing countries, with 14.3% of all deaths annually1.
In Belgium, about 11,000 new breast cancer cases in women and 2500 related deaths are registered every year (Belgian Cancer Registry2).
In Sub-Saharan Africa (SSA), breast cancer is becoming a major public health issue with a significant increase in its incidence, young age at diagnosis, and a high mortality rate as compared to developed parts of the world3,4. A recent study showed that more than 50% of all breast cancer women in Rwanda are younger than 50 years old, and more than 60% presented with advanced disease5.
The major challenge for optimizing the management of breast cancer is the early detection of the disease. Currently, mammography combined with invasive needle biopsy is used as a gold standard for breast cancer screening and allows early detection of the disease. However, it has some limitations; (a) exposure to X-ray radiation, (b) low sensitivity and specificity in young women or women with a high breast density6. Blood biomarkers such as carbohydrate antigen (CA 15.3) and carcino-embryogenic antigen (CEA) are useful for monitoring breast cancer treatment but lacks sensitivity for the detection of primary breast cancers7.
MicroRNAs are small non-coding RNAs of approximately 22 nucleotides long that regulate gene expression at the post-transcriptional level by binding to the 3′ untranslated region (UTR) of the target messenger RNAs. Studies have reported that microRNAs act as oncogenes or tumor suppressors and are aberrantly expressed in many cancers, including breast cancer8–12.
Circulating microRNAs have become promising non-invasive biomarkers of breast cancer. They can be easily measured in body fluids, including blood, plasma, and serum, where they remain highly stable12. Several microRNA profiling studies showed their potential as circulating biomarkers for diagnosis, prognosis, or prediction of treatment response in breast cancer pathology13–16.
Few studies have investigated the differential expression of microRNAs between different ethnic/ancestry groups. Some studies focusing on hypertension, diabetes, or uterine leiomyomas have shown differences of microRNAs between different populations. These differences were observed not only in the disease tissues but also in the healthy tissues17–19. In particular, a study comparing lymphoblastoid cell lines derived from 53 American subjects of European ancestry, and 54 people from Nigeria showed a high proportion of microRNAs that are differentially expressed in the two populations20. There are also few reports of microRNA expression differences in the breast cancer field. Nassar and colleagues compared breast cancer tissues of 45 Lebanese patients and 197 American patients, and highlighted ethnic differences21. Pollard et al. did the same kind of observation when comparing breast cancer tissues of 4 ethnic groups, i.e., British Caucasians, British Blacks, Nigerians, and Indians22. Two additional reports confirm such differences when comparing African American and European American patients23,24.
In our previous study of microRNA expression profiling of 188 microRNAs present in human plasma using reverse transcription quantitative polymerase chain reaction (RT-qPCR) and Random Forest-based analysis, we identified an 8 microRNA-based signature displaying high performance (AUC > 0.8) to detect breast cancers in a Belgian-recruited population25. The authors recommended its use in complement with mammography to identify early primary breast cancers. In the present study, we applied this “8 microRNA signature” on cohorts with a quite different genetic and environmental background as breast cancer patients and age-matched controls were recruited in Rwanda. Circulating microRNAs were quantified in their plasma. Diagnostic performances of several microRNA combinations, including the best performing that we called the “8 microRNA signature”, were determined using the same profiling and analysis method.
This work aimed at assessing if the previously identified circulating microRNA signature is efficient in another genetic and environmental context, and if a universal signature might be possible. The secondary objective was to find out an efficient signature to detect Rwandan breast cancer patients.
Results
Random forest
The random forest algorithm is a supervised machine learning classification method based on an ensemble of decision trees, that was first described by Breiman et al.26. In our study, Random Forest algorithms are used in a sequence of 3 main steps (see material and methods for details):
Feature selection
Its aim is to rank the plasmatic microRNAs according to the best discriminating power to correctly classify healthy women and primary breast cancers patients. It allows to reduce the number of microRNAs to those that contain more information than noise.
Building of random forest models
Its aim is to learn a prediction model from past observations. These observations are stocked in a “design” dataset that, in the present study, contains the plasmatic microRNA levels of breast cancer patients and healthy subjects that are known to be correctly classified based on the clinical diagnosis. A set of decision trees, called Random Forest models, is built from a bootstrap sample, which is a random selection of plasmatic microRNA levels drawn from the design dataset.
Validation of the models
Its aim is to predict the class—healthy or breast cancer- of new subjects, based on their plasmatic microRNA levels. During prediction, Random Forest outputs the class agreed by most of the individual trees. In this study, as the class of the subject in the validation dataset are also known, the classification performances of the models can be computed in terms of an area under the curve (AUC).
The first and second steps are performed on the well characterized “design” dataset. Of note, the dataset used to design and to validate (third step) the random forest models in this study are fully independent (see result section “Cohorts”).
Note that the first step is not mandatory and can be omitted when the number of features is small, or when the feature selection has been performed before. This is the case in the first result paragraph of this study (result section “Evaluation of the performances of the breast cancer diagnostic tool described by P. Frères and colleagues on Rwandan‑recruited cohorts”): the selection of the microRNAs forming the tested signatures was performed in our previous work25.
Cohorts
The Belgian-recruited cohort contains 143 primary breast cancers and 136 healthy women25. The Rwandan-recruited cohort contains 82 primary breast cancers and 73 healthy women. In order to be used in the Random Forest procedure described above, this ensemble of subjects (N tot = 434) was split into four groups. Two groups were first created according to the recruitment site to allow the comparison of the two populations. Next, each site-specific group was split into two groups to allow the design of the microRNA signatures and their validation on independent cohorts, during the Random Forest procedure. The resulting four cohorts are called: MATCHED-BE; MATCHED-RW; REST-BE and REST-RW. The suffix -BE or -RW will be used according to the recruitment site. The MATCHED-BE and MATCHED-RW cohorts are matched in terms of age, breast cancer status, breast cancer subtype and subject number to allow a controlled comparison of the two populations. Each of them contains 55 healthy women, and 55 primary invasive breast cancer patients. The detailed information of those MATCHED cohorts is available in Table 1. The REST-BE cohort contains the remaining patients of the cohort described in Frères et al.: 88 primary breast cancer patients and 81 healthy women25. The REST-RW cohort contains the remaining 27 primary breast cancer patients and 18 healthy women recruited in Rwanda. The detailed information of the REST cohorts is available in Table S2.
Table 1.
Belgian-recruitment site (n = 110) | Rwandan-recruitment site (n = 110) | |||
---|---|---|---|---|
Primary breast cancers (n = 55) | Healthy women (n = 55) | Primary breast cancers (n = 55) | Healthy women (n = 55) | |
Median age (range) (y) | 45 (26–68) | 43 (27–63) | 45 (27–65) | 46 (31–64) |
Estrogen receptor [n (%)] | 34 (61.8) | 34 (61.8) | ||
HER2 [n (%)] | 15 (27.3) | 15 (27.3) | ||
Molecular subtype [n (%)] | ||||
NA | 0 | 0 | ||
1 = ER + /HER2- | 26 (47.3) | 26 (47.3) | ||
2 = ER + /HER2 + | 8 (14.5) | 8 (14.5) | ||
3 = ER-/HER2 + | 7 (12.7) | 7 (12.7) | ||
4 = TN | 14 (25.5) | 14 (25.5) | ||
Lymph node involvement [n (%)] | ||||
NA | 0 (0) | 22 (40) | ||
1 | 29 (52.7) | 30 (54.5) | ||
0 | 26 (47.3) | 3 (5.5) | ||
Stage [n (%)] | ||||
NA | 0 (0) | 6 (10.9) | ||
1 | 9 (16.4) | 1 (1.8) | ||
2 | 33 (60) | 13 (23.6) | ||
3 | 13 (23.6) | 35 (63.6) | ||
Histologic subtype [n (%)] | ||||
NA | 0 (0) | 1 (1.8) | ||
IDC | 46 (83.6) | 49 (89) | ||
ILC | 8 (14.5) | 2 (3.6) | ||
other | 1 (1.8) | 3 (5.5) |
Study summary
The overview of the major steps of the study is presented in Fig. 1. We first considered the results from our previously work25 and evaluated the diagnostic accuracy of 13 circulating microRNA signatures designed before in two different population-cohorts of breast cancer patients and age-matched healthy controls with different genetic and environmental backgrounds.
To do this, we measured the levels of 175 circulating microRNAs in a cohort of women recruited in Rwanda with the same RT-qPCR profiling method. These data were analyzed using the same Random Forest-based method.
-
i.
Step 1—result section "Evaluation of the performances of the breast cancer diagnostic tool described by P. Frères and colleagues on Rwandan-recruited cohorts ": For the 13 previously defined signatures, new random forest models were designed and validated using the following combinations: (i) design of the random forest models on a cohort recruited in Belgium and validation on a separate Belgian cohort and on a second cohort recruited in Rwanda (Fig. 2A, B) ; (ii) design of the random forest models on the Rwandan-recruited cohort and validation on a separate Rwandan cohort, and on a second Belgian-recruited cohort (Fig. 2C, D).
-
ii.
Step 2—result section "The profile of circulating microRNA levels is different in the Belgian and Rwandan recruitment sites": Circulating microRNAs significantly different in Belgian and Rwandan women are searched to be removed from the analysis performed in Step 3 (Fig. 3).
-
iii.
Step 3—result section "Defining new signatures able to discriminate patients from healthy women in both recruitment sites": Design of new diagnostic circulating microRNA signatures and the corresponding random forest models on a mixed cohort of Rwanda- and Belgian-recruited patients, and validation on a separate mixed cohort (Fig. 4).
-
iv.
Step 4—result section "Defining new signatures able to discriminate patients from healthy women in Rwanda only": Design of new circulating microRNA signatures and the corresponding random forest models, considering the Rwandan-recruited cohorts only, for both design and validation of the signatures (Figs. 5 and 6).
For both groups, healthy controls with matched age were also considered. Patients with matched age and breast cancer subtypes were only included in the analysis.
Evaluation of the performances of the breast cancer diagnostic tool described by P. Frères and colleagues on Rwandan-recruited cohorts25
The flowchart of this experiment is depicted in Fig. 2A. Random Forest models of the “8 microRNA signature” were first designed on the microRNA dataset corresponding to the Belgian recruited cohort MATCHED-BE. Next, the Random Forest models were applied on two validation datasets containing microRNA levels of subjects from the two recruitment sites: REST-BE and the fusion of the MATCHED-RW and REST-RW (Table S3). The resulting AUC of the “8 microRNA signature” are represented in Fig. 2B, first boxes. The AUC obtained in our previous study is also plotted as reference. The AUC of the “8 microRNA signature” designed on the Belgian-recruited population (REST-BE) is quite similar to the value described in Frères et al. (2016), which is expected. The slight difference observed is explained by the fact that the models were designed in a subgroup of the cohorts used in our previous work. By contrast, the AUC obtained in the Rwandan-recruited population is drastically reduced compared to the performances obtained in the Belgian-recruited population.
Besides the best performing “8 microRNA signature”, twelve other alternative signatures with comparable performances were also found in our previous work (unpublished results). This can be explained by the fact that many microRNAs might be deregulated in the same manner in a particular disease condition, leading to many correlated circulating microRNA level variations. In consequence, one microRNA may be replaced by another microRNA in a specific signature25. The performances of 12 other signatures displaying a mean AUC > 0.70 in the Belgian population (Table 2), were also tested on the different cohorts of this study (Fig. 2B). The 12 alternative signatures display the same variation profile of performances in the different cohorts than the “8 microRNA signature”: none of them displayed an AUC > 0.6 in the Rwandan-recruited cohorts when the models were computed in subjects of the Belgian recruitment site. The resulting AUC of these signatures in each dataset is available in Table S4.
Table 2.
Signature Name | MicroRNA signature composition |
---|---|
The “8 microRNA Signature” | hsa-miR-16-5p + hsa-let-7d-5p + hsa-miR-103a-3p + hsa-miR-107 + hsa-miR-148a-3p + hsa-let-7i-5p + hsa-miR-19b-3p + hsa-miR-22-5p |
Signature_1 | hsa-let-7d-5p + hsa-miR-16-5p + hsa-miR-103a-3p + hsa-miR-199a-5p |
Signature_2 | hsa-let-7d-5p + hsa-miR-16-5p + hsa-miR-103a-3p + hsa-miR-22-3p + hsa-miR-30b-5p |
Signature_3 | hsa-let-7d-5p + hsa-miR-32-5p + hsa-miR-199a-5p + hsa-miR-142-3p + hsa-miR-22-5p |
Signature_4 | hsa-let-7d-5p + hsa-miR-148a-3p + hsa-let-7i-5p + hsa-miR-199a-5p + hsa-miR-451a |
Signature_5 | hsa-let-7d-5p + hsa-miR-148a-3p + hsa-let-7f.-1-3p + hsa-miR-199a-5p + hsa-miR-32-5p |
Signature_6 | hsa-miR-16-5p + hsa-let-7d-5p + hsa-miR-103a-3p + hsa-miR-148a-3p + hsa-let-7f.-1-3p + hsa-miR-32-5p |
Signature_7 | hsa-miR-16-5p + hsa-let-7d-5p + hsa-let-7i-5p + hsa-miR-19a-3p + hsa-let-7f.-1-3p + hsa-miR-1-3p |
Signature_8 | hsa-miR-16-5p + hsa-let-7i-5p + hsa-miR-19a-3p + hsa-miR-451a + hsa-miR-19b-3p + hsa-miR-32-5p |
Signature_9 | hsa-miR-16-5p + hsa-let-7d-5p + hsa-miR-103a-3p + hsa-miR-148a-3p + hsa-miR-19a-3p + hsa-miR-199a-5p + hsa-miR-22-3p |
Signature_10 | hsa-miR-16-5p + hsa-let-7d-5p + hsa-miR-103a-3p + hsa-miR-20a-5p + hsa-let-7i-5p + hsa-miR-1-3p + hsa-miR-32-5p |
Signature_11 | hsa-miR-16-5p + hsa-let-7d-5p + hsa-miR-103a-3p + hsa-miR-148a-3p + hsa-miR-93-5p + hsa-miR-451a + hsa-miR-1-3p + hsa-miR-22-5p |
Signature_12 | hsa-miR-16-5p + hsa-let-7d-5p + hsa-miR-103a-3p + hsa-miR-20a-5p + hsa-let-7f.-1-3p + hsa-miR-30b-5p + hsa-miR-590-5p + hsa-miR-22-3p |
Alternatively, the MATCHED-RW cohort was used to model the Random Forest trees corresponding to the 13 signatures (Table 2), and those models were validated on dataset containing subjects of different origin: REST-RW, and the fusion of MATCHED-BE and REST-BE (Table S3 and Fig. 2C). The 13 signatures display lower performances in Rwandan-recruited population than what was observed when the models were designed in Belgian-recruited population (compare REST-BE in Fig. 2B and REST-RW in Fig. 2D). And the performances were again lower when the cohort used for the random forest models validation is recruited in the other site than the cohort used for the design of the models (Fig. 2D). Details of the signature performances in each cohort can be found in Table S4.
Quite similar results were obtained when we designed and validated complete new microRNAs signatures, instead of new random forest models only, using the same scheme for the choice of the design and the validation cohorts (data not shown).
The profile of circulating microRNA levels is different in the Belgian and Rwandan recruitment sites
These results suggest that the circulating microRNA levels are different in the Belgian and Rwandan recruitment sites. Indeed, the Fig. 3A shows that the two sites of recruitments can be distinguished by the two first components of a principal component analysis.
If some microRNAs have the simultaneous potential to allow discrimination of breast cancer patients from healthy women, but also to allow discrimination of Belgian-recruited population from Rwandan-recruited population, they need to be removed from the dataset in order to be able to find signatures working on both recruitment sites.
We, thus, performed a Random Forest feature selection process to find out the 25 best performing circulating microRNAs able to discriminate Belgian-recruited women from Rwandan-recruited women (N = 434). In parallel we did the same using a conventional statistical test, Kruskal–Wallis. Finally, we compared the intersection of those microRNAs with the 25 microRNAs determined in our previous work to be the best discriminating for cancer/healthy plasma in Belgian-recruited women (Fig. 3B). By this method, we determined that the microRNAs hsa-let-7d-5p and hsa-miR-103a-3p need to be removed from the dataset to proceed to our next analysis step. They were also the only two microRNAs appearing as discriminating the Belgian from the Rwandan women when only healthy women were compared, or when only breast cancer patients were compared (data not shown).
Defining new signatures able to discriminate patients from healthy women in both recruitment sites
The three steps of the Random Forest procedure were then applied on the new dataset excluding hsa-let-7d-5p and hsa-miR-103a-3p, as depicted in Fig. 4A. The design dataset for Random Forest procedure contains the patients from both recruitment sites: it is the fusion of the MATCHED-BE and MATCHED-RW cohorts. The validation dataset also contains subjects from the two recruitment sites (fusion of the REST-BE and REST-RW—see Table S3).
The feature selection result—depicted in the Figure S1—allowed the identification of 13 microRNAs that are the most important and robust in distinguishing the cancer from the healthy subjects. The performances of all the possible combinations of these 13 microRNAs generated (2^13–1 = 8191) were calculated on the design cohort, and 163 combinations with AUC ≥ 0.82 (Table S5) were identified. The performances of those 163 combinations were next evaluated on the validation datasets (Fig. 4B). The AUC values in the total validation cohort are ranging from 0.596 to 0.698 (Standard deviation, SD = 0.14). However, these values are dropping in the REST-BE (0.272–0.578; SD = 0.025) and REST-RW (0.240–0.569; SD = 0.044) sub-cohorts, when they are considered separately.
In conclusion, none of the circulating microRNA signature designed on dataset containing heterogeneous recruitment site patients is efficient.
Defining new signatures able to discriminate patients from healthy women in Rwanda only
As circulating microRNA signatures established on patients recruited on mixed genetic and environmental background were not efficient enough to be used as diagnostic tool, Rwandan-only subjects were used in this part of the work to design new signatures able to diagnose breast cancers in this population.
A design dataset containing the circulating microRNA data of Rwandan-only recruited subjects—MATCHED-RW—was used in this Random Forest procedure, which is depicted in Fig. 5A. Next the validation of the models was performed on two datasets that contain either the microRNA data of Rwandan-recruited subjects (REST-RW) or Belgian-recruited subjects (REST-BE) (Table S3).
The feature selection allowed the identification of 17 microRNAs efficient to discriminate healthy women from cancer patients. The performances in terms of AUC of the 131.071 combinations of those 17 microRNAs (2^17–1 = 131,071) were first evaluated on a subset of the same design cohort (test cohort, see material and methods). The 995 signatures that displayed AUC ≥ 0.94 were selected to be next validated on two datasets constructed with microRNA data from patients recruited on the two different recruitment sites. Figure 5B is depicting the results obtained.
Among the 17 identified microRNAs from the feature selection in the Rwandan design dataset, the expression of hsa-miR-342-3p and hsa-miR-185-5p were not measured in the Belgian validation dataset. Consequently, all the signatures among the 995 containing at least one of those microRNAs were discarded when evaluated on the Belgian cohort. Only 623 signatures were validated on the Belgian cohort.
The best signature on the Rwandan validation cohort displays an AUC = 0.86 and is highlighted in blue in Fig. 5. However, as it contains the hsa-miR-342-3p, this signature was not validated in the Belgian dataset.
Among the 623 signatures validated on the Belgian cohort, the best performing display poor performance (AUC = 0.61), showing again that only cohorts from a single recruitment site can be used to design powerful circulating diagnostic microRNA signatures.
Eleven alternative signatures displaying good performances on the Rwandan validation cohort were also selected for the next steps analyses. In order to calculate their sensitivities and specificities, the optimal cut-off of the ROC curves were calculated according to the Youden index27. Table 3 reports the AUC of 12 best signatures on the Rwandan-recruited cohort, and their corresponding specificity and sensitivity metrics. More details about their composition in circulating microRNAs are available in Table S6. The corresponding receiver operating characteristics (ROC) curves are displayed in Fig. 6A. The 12 signatures were then used to compute the probability of each subject of the Rwandan-recruited validation cohort to be classified into healthy or cancer groups, and the distribution of those probabilities is depicted in Fig. 6B.
Table 3.
AUC | Sensitivity | Specificity | Number of microRNAs per signature | |
---|---|---|---|---|
RW_1 | 0.8675 | 0.92 | 0.72 | 13 |
RW_2 | 0.8654 | 0.88 | 0.78 | 13 |
RW_3 | 0.8654 | 0.92 | 0.72 | 11 |
RW_4 | 0.8654 | 0.85 | 0.78 | 13 |
RW_5 | 0.8632 | 0.92 | 0.72 | 13 |
RW_6 | 0.8632 | 0.73 | 0.89 | 12 |
RW_7 | 0.8611 | 0.96 | 0.67 | 11 |
RW_8 | 0.8590 | 0.92 | 0.78 | 8 |
RW_9 | 0.8590 | 0.81 | 0.83 | 11 |
RW_10 | 0.8590 | 0.96 | 0.67 | 10 |
RW_11 | 0.8590 | 1 | 0.61 | 10 |
RW_12 | 0.8568 | 0.88 | 0.78 | 8 |
Among the 12 best performing diagnostic signatures for Rwandan-recruited cohort, the 4 microRNAs hsa-let-7a-5p, hsa-miR-126-3p, hsa-miR-150-5p, and hsa-miR-940 appear to be particularly important to distinguish healthy women from breast cancer patients, as they appear in all the 12 signatures.
Discussion
An important improvement in the management of breast cancer would result from the discovery of sensitive and specific minimally invasive biomarkers to detect breast cancers at early stage28. A good biomarker should be easily accessible and non-invasive, sensitive enough to detect early tumors in almost all patients and absent in healthy women. None of the current diagnostic biomarkers used for breast cancer detection meets the above-cited criteria29. However, circulating microRNAs have been identified in serum and plasma, and are increasingly recognized as powerful disease biomarkers for breast cancers30,31.
In our previous work, we identified an 8 microRNA-based signature, quantified by RT-qPCR in plasma. This signature can discriminate breast cancer patients from healthy controls in Belgian-recruited women with high performance. We have also identified other alternative microRNA signatures with an AUC > 0.8. Among them, an 11 microRNA signature was validated in an independent cohort of 54 serum samples from Singaporeans of Chinese ancestry and gave an AUC of 0.7725. However, it is still largely unknown if the signatures that are established in a specific population can be applied to other groups from different ancestries.
In this study, we found that the diagnostic circulating microRNA signatures perform better on their own geographical and environmental recruitment site, and that their performances decrease when they are established on the recruitment group from a different continent. We also found that the plasmatic microRNA content of the Belgian and Rwandan population is highly different. In particular, 2 microRNAs that are part of most of the best performing microRNA signatures described by Frères et al., namely let-7d-5p and miR-103a-3p, are also able to discriminate the two ethnic groups. This might explain the observed performance differences of the diagnostic signatures between cohorts of different origins.
However, even when these two microRNAs are excluded from the analysis, none of the 163 newly designed signatures on cohort from mixed origins could differentiate breast cancers from healthy controls in either Rwandan or Belgian cohorts with sufficient performance for a clinical test. In opposite, highly performant circulating diagnostic signatures can be found in a homogeneous population, as illustrated by the determination of 12 newly designed signatures in the Rwandan cohorts, and by the results of Frères et al. in the Belgian cohort.
Indeed, when we considered data from the Rwanda-only recruited subjects, the feature selection process highlighted 17 efficient microRNAs to discriminate healthy women from breast cancers patients. Combining them, we were able to identify 12 microRNA signatures that could be used to diagnose breast cancer in Rwanda, all displaying AUC > 0.86. Among the 17 plasmatic microRNAs, four of them seem to be particularly important as they are part of all the 12 best signatures. These four microRNAs, let-7a-5p, miR-126-3p, miR-150-5p and miR-940, are known to have deregulated expression in breast cancer tissues, and are involved in molecular pathways leading to breast cancer development or progression32–36.
The performances of the screening mammography are described in many publications with sensitivity values ranging from 87 to 70%, and specificity values ranging from 97 to 89%37–39. The 12 circulating microRNA diagnostic signatures selected to detect breast cancer in Rwandan women display higher sensibility than mammography, but lower specificities, meaning that more false positive cases might be found using this technique. However, the signature 8 seems to be the best compromise with its specificity of 78% and sensitivity of 92%—which are near of the range of the mammography values—and composed of only 8 circulating microRNAs. As this number is low, their quantification by RT-qPCR, a technique often used in clinical routine, would be easy to implement in clinical use. Indeed, we aimed at selecting short combinations of biomarkers to facilitate their transfer towards the medical practice.
To date, few comprehensive investigations of population differences in microRNA content, either at the tissue or at the circulating levels, were conducted in breast cancer.
At the circulating level, Zhao et al. investigated plasmatic microRNA levels in breast cancer patients and matched controls from different ethnic origins, and found that 31 microRNAs were differentially expressed in plasma of 10 Caucasian Americans and 10 African Americans with two microRNAs overlapping between the two ethnic groups. However, the patients and controls in this-cited study were recruited from the same living environment40.
At the breast cancer tissue level, Pollard et al. analyzed the microRNA expression of four different ethnic groups (British Blacks, British Caucasians, Indians and Nigerians) and confirmed that microRNAs are differentially expressed in their tumor tissues. The authors found that miR-140-5p, miR-194 and miR-423-5p were upregulated in Nigerians compared with the other ethnic groups. They concluded that these disparities in microRNA expression between African and European descent women could be linked to the differences in the frequency of the tumor molecular subtypes in those ethnic groups. Indeed, breast tumors in sub-Saharan African women are predominantly hormone negative and triple negative subtypes while breast tumors in European women are predominantly hormone positive and luminal subtypes, and distinct molecular pathways are involved in those breast cancer subtypes22. This drawback in the cohort selection was avoided in our study, as the enrolled subjects of the two populations were matched in terms of breast cancer molecular subtypes.
Another study showed that European, African, and Asian subjects display population-specific genetic variations in microRNA genes associated with cancer risk. Those genetic variations may also affect microRNA expression and contribute to observed population differences in health disparities in multiple forms of cancers, including breast cancers41.
Our results are in line with these few studies showing differences in microRNA content in tissues and/or circulating compartments between specific ethnic groups and suggest that the differences in the plasmatic microRNA content observed between Belgian and Rwandan women could be linked to their genetic background, living environment and/or life style. However, the size of the two populations our study is too small to allow conclusions across the human populations, focused in European and African ancestries.
Among limitations of this study, we can cite that the dataset used for the design of the signatures were over-represented by the ER + HER− (47.3%) compared to the other subtypes (ER + HER + : 14.5%, ER-HER + : 12.7%, and ER-HER−: 25.5%). In such setting, the signatures can be biased to the most representative subtype. Breast cancer patients recruited in Rwanda had also more advanced tumor stages and more frequent lymph nodes metastasis compared to their Belgian counterparts. Moreover, the metastasis detection was not systematically performed in Rwanda. Yet, a number of studies have shown that microRNAs are differentially expressed between early, advanced and metastatic stages in breast tumor tissues42–45. We have also observed differences in the plasmatic microRNA content between metastatic and primary breast cancers, in Belgian-recruited patients (unpublished results). Besides, there is a lack of data on tumor subtypes in the Rwanda validation cohort (Table S2). Our study would have been improved if we had them, as we could test the performances of the 12 Rwanda-specific signatures on sub-cohorts of different tumor subtypes. In addition, we do not have precise information about the bloodline of the recruited subjects, but only their living country. We do not have any information either about inflammatory, autoimmune or chronic diseases of the recruited patients/controls, that might also affect the results obtained. Nevertheless, this is the first study providing valuable information on plasmatic microRNA content in large cohorts of breast cancer patients from different ethnicities with quite different genetic background and living environment.
In conclusion, efficient plasmatic microRNA signatures can be found to diagnose breast cancers, but their performances only reach the level needed for clinical use when the signature are designed on homogeneous geographical and environmental groups. This is probably due to high disparities in plasmatic microRNA content between populations, that are consequences of genetic and/or environmental differences. Further studies would be needed to distinguish those two aspects, and to compare other ethnic groups. Even so, the results of this study are suggesting that finding a universal circulating microRNA signature is highly unlikely.
Moreover, we describe several efficient plasmatic microRNA signatures to diagnose breast cancers in Rwandan women. The more suitable for clinical use display, when tested on an independent cohort, AUC of 86% (sensitivity = 92% and specificity = 78%). This short biomarker signature contains only 8 microRNAs, which can be measured in the plasma—in a non-invasive procedure – by RT-qPCR—which is a simple technique routinely used in hospitals. These features could favor an easy transfer to the medical practice.
Materials and methods
Patients and healthy controls
Rwandan recruitment site: patients and control healthy women with matched-age were recruited at three teaching hospitals in Rwanda: Butare Teaching Hospital (CHUB), Kigali Teaching Hospital (CHUK) and Rwanda Military Hospital (RMH) from May 2016 to May 2018.
Belgian recruitment site: the recruitment was described in25. Briefly, patients and healthy women were recruited prospectively at Centre Hospitalier Universitaire CHU of Liège and Clinic Saint-Vincent (Liège, Belgium) from July 2011 to September 2014.
In both cohorts, healthy women displayed normal mammograms and breast cancers subtypes were defined using routine immunohistochemistry for estrogen receptor (ER), progesterone receptor (PgR), and human growth factor receptor 2 (HER2). In the Belgian cohort only, HER2 status was confirmed by fluorescent in situ hybridization (FISH).
Ethical consideration
The study was conducted in accordance of the Declaration of Helsinki for both recruitment sites. In Rwanda, the study was conducted with the approval of the Institutional Review Board (IRB) of the College of Medicine and Health Sciences (CMHS) at University of Rwanda (No: 156/CMHS IRB/2016) and the ethical committee of each hospital: CHUK Clinical Research Ethical Committee (Ref.: EC/CHUK/089/2016); CHUB Research Ethical Committee (Ref.: CHUB/DG/SA/5/869/2016) and RMH Research Ethical Committee (Ref.: EC/RMH/051/2016). from the Institutional. In Belgium, this study was approved by the Ethics Committee of the University Hospital of Liège (Ref.: B70720109893/2018/191).
All study participants signed the written informed consent prior to enrollment, in both recruitment sites.
Plasma samples
Blood samples from Rwanda recruitment site was performed using the same protocol than used previously for the Belgian cohort25. Blood were collected in EDTA tubes and double centrifuged within 1h of collection to get plasma. The two centrifugations were done at 4 °C during 10 min, at 815 × g and 2500 × g respectively. Plasma were stored at −80 °C until use.
Total RNA extraction from plasma
RNA extractions from blood samples of the Rwanda recruitment site were performed using the same protocol than used previously for the Belgian cohort25. The degree of hemolysis of all plasma samples was evaluated prior to total RNA extraction using NanoDrop at 414 nm absorbance (ABS414). All samples with ABS414 > 5 were excluded for further steps.
Total RNA was extracted from 100 μl of plasma using miRNeasy Mini Kit (Qiagen) according to manufacturer’s instructions. Cel-miR-39-3p was added to the plasma before extraction to be used as spike-in extraction control.
Reverse transcription and cDNA preparation
Reverse transcriptions of RNA extracted from blood samples of the Rwanda recruitment site were performed using the same protocol than used previously for the Belgian cohort25. Reverse transcription of RNA was carried out using miRCURY LNA™ Universal RT microRNA PCR (RT-qPCR universal cDNA synthesis Kit II) (Exiqon) following the manufacturer’s instructions, using UniSP6 spike-in as reverse transcription control.
microRNA profiling
MicroRNA profiling of RNA extracted from blood samples of the Rwanda recruitment site were performed using the same protocol than used previously for the Belgian cohort25. Quantitative PCR (qPCR) were performed on custom panels for selected microRNA (Pick-&-Mix microRNA PCR Panel, Exiqon). Controls included inter-plate calibrator UniSP3, UniSP6, negative controls and cel-miR-39. The custom panels were slightly different in our previous study performed on the Belgian-recruited cohort and in the Rwandan-recruited cohort. The custom panel used previously for the Belgian-recruited cohort contains 187 microRNAs (list “Frères et al. 2016” available as Table S1)25. The custom panel used on the Rwandan-recruited cohort contains 175 microRNAs (list1 available as Table S1). 165 microRNAs were quantified in common on plasma samples collected on both recruitment sites (list2 available as Table S1). Quantitative PCR were performed on a Taqman 7900HT Real –Time PCR System (Applied Biosystems) according to the manufacturer’s protocol.
Normalization of microRNA expression
Normalization of microRNA profiling from blood samples of the Rwanda recruitment site were performed using the same method than used previously for the Belgian cohort25. Raw Cq values for each sample were normalized to the mean Cq of the 50 most expressed microRNAs of the same dataset. These 50 most expressed microRNAs are different according to the data set analyzed. Results were expressed and analyzed as deltaCq (Cqsample − Cqrmean50MostExpressed).
Random forest (RF)
Feature selection
The feature selection was performed on 100 random resampling partitions of the design dataset (see next point). The importance of the microRNA was measured using both Mean Decrease in Accuracy MDA and Mean Decrease in Gini MDG. The combined rank according to MDA and MDG was then used to rank the microRNAs. The stability of the feature selection was measured using the Kuncheva and the Spearman indexes calculated by the package OmicsMarkeR46.
Building of the random forest models
To identify the best microRNA-based signature, all combinations of the microRNAs selected by the previous step are generated, and their performances in terms of AUC are evaluated using a ten-fold cross-validation on the same design cohort.
The design dataset is randomly divided 50 times into training partition containing 90% of the samples which are used to construct the Random Forest models. The remaining 10% of samples constitutes the testing cohort, and are used for a first test of the models.
For all the signatures, the same partitions were used to construct the RF models using parameters ntree = 3000, and . The Average AUC on the test partitions is then calculated over all the models and reported as AUC. CohortName.TEST in Table S4.
Random forest models validation
The best signatures identified in step 2 (modeling) are next validated on one or several independent dataset(s) that is/are normalized separately from de design dataset used in the steps one and two (feature selection and modeling).
Datasets
The details of the datasets used for Random Forest procedures in this study are summarized in the Table S3.
Supplementary information
Acknowledgements
We thank all staff of Anatomy- Pathology department of CHUB, CHUK and RMH for their support during recruitment and data collection. We thank the data managers from the Medical Oncology department and the BHUL members for their valuable help. We also extend our acknowledgement to patients and their families who took part in this study. This study was funded by the Académie de Recherche et d’Enseignement Supérieur (ARES), Belgium, in its cooperation project with the University of Rwanda (UR), Rwanda (UR-ARES Project-R1), the FIRS from the CHU Liege and the NACATS (#1610125) project from the Région Wallonne.
Author contributions
Conception, C.J., V.B. and G.J.; analysis, J.U., A.D., C.P., and C.J.; software creation, A.D. and C.P.; data acquisition, J.U., J.T.; interpretation of data A.D., J.U. and C.J.; resources, C.J., L.M., V.B. and G.J.; clinical data curation, J.U., P.F., and A.P.; writing—original draft preparation, A.D., J.U. and C.J.; writing—review and editing, A.D., J.U., C.P., V.B., G.J. and C.J.; supervision, C.J., V.B. and G.J.; project administration, C.J.; funding acquisition, C.J., V.B., and G.J. All authors have read and agreed to the published version of the manuscript.
Data availability
The raw and normalized data of the miRNA profiling are available upon request.
Competing interests
Dr. Jerusalem reports grants, personal fees and non-financial support from Novartis, grants, personal fees and non-financial support from Roche, grants, personal fees and non-financial support from Pfizer, personal fees and non-financial support from Lilly, personal fees and non-financial support from Amgen, personal fees and non-financial support from BMS, personal fees and non-financial support from Astra-Zeneca, personal fees from Daiichi Sankyo, personal fees from Abbvie, non-financial support from Medimmune, non-financial support from MerckKGaA, outside the submitted work. Those funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. The other authors have no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
These authors contributed equally: Jeanne P. Uyisenga and Ahmed Debit.
These authors jointly supervised this work: Vincent Bours and Claire Josse.
Supplementary Information
The online version contains supplementary material available at 10.1038/s41598-021-91278-0.
References
- 1.Bray F, et al. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 2018;68:394–424. doi: 10.3322/caac.21492. [DOI] [PubMed] [Google Scholar]
- 2.Belgian Cancer Registry. https://kankerregister.org/Home_en.
- 3.Brinton LA, et al. Breast cancer in Sub-Saharan Africa: Opportunities for prevention. Breast Cancer Res. Treat. 2014;144:467–478. doi: 10.1007/s10549-014-2868-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Jedy-Agba E, McCormack V, Adebamowo C, Dos-Santos-Silva I. Stage at diagnosis of breast cancer in sub-Saharan Africa: A systematic review and meta-analysis. Lancet. Glob. Heal. 2016;4:e923–e935. doi: 10.1016/S2214-109X(16)30259-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Uyisenga JP, et al. Prevalence of histological characteristics of breast cancer in Rwanda in relation to age and tumor stages. Horm. Cancer. 2020 doi: 10.1007/s12672-020-00393-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Checka CM, Chun JE, Schnabel FR, Lee J, Toth H. The relationship of mammographic density and age: Implications for breast cancer screening. AJR Am. J. Roentgenol. 2012;198:W292–W295. doi: 10.2214/AJR.10.6049. [DOI] [PubMed] [Google Scholar]
- 7.Gion M, et al. CA27.29: A valuable marker for breast cancer management. A confirmatory multicentric study on 603 cases. Eur. J. Cancer (Oxf. Engl.) 2001;37:355–363. doi: 10.1016/S0959-8049(00)00396-8. [DOI] [PubMed] [Google Scholar]
- 8.Serpico D, Molino L, Di Cosimo S. MicroRNAs in breast cancer development and treatment. Cancer Treat. Rev. 2014;40:595–604. doi: 10.1016/j.ctrv.2013.11.002. [DOI] [PubMed] [Google Scholar]
- 9.Wang W, Luo Y. MicroRNAs in breast cancer: Oncogene and tumor suppressors with clinical potential. J. Zhejiang Univ. Sci. B. 2015;16:18–31. doi: 10.1631/jzus.B1400184. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Hamam R, et al. microRNA expression profiling on individual breast cancer patients identifies novel panel of circulating microRNA for early detection. Sci. Rep. 2016;6:25997. doi: 10.1038/srep25997. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Hemmatzadeh M, Mohammadi H, Jadidi-Niaragh F, Asghari F, Yousefi M. The role of oncomirs in the pathogenesis and treatment of breast cancer. Biomed. Pharmacother. 2016;78:129–139. doi: 10.1016/j.biopha.2016.01.026. [DOI] [PubMed] [Google Scholar]
- 12.Loh HY, et al. The regulatory role of microRNAs in breast cancer. Int. J. Mol. Sci. 2019;20:1–27. doi: 10.3390/ijms20194940. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Gu X, Xue J-Q, Han S-J, Qian S-Y, Zhang W-H. Circulating microRNA-451 as a predictor of resistance to neoadjuvant chemotherapy in breast cancer. Cancer Biomark. 2016;16:395–403. doi: 10.3233/CBM-160578. [DOI] [PubMed] [Google Scholar]
- 14.Odenthal M, et al. Serum microRNA profiles as prognostic/predictive markers in the multimodality therapy of locally advanced adenocarcinomas of the gastroesophageal junction. Int. J. Cancer. 2015;137:230–237. doi: 10.1002/ijc.29363. [DOI] [PubMed] [Google Scholar]
- 15.Li Q, et al. Circulating miR-19a and miR-205 in Serum May Predict the sensitivity of luminal A subtype of breast cancer patients to neoadjuvant chemotherapy with epirubicin plus paclitaxel. PLoS ONE. 2014;9:e104870. doi: 10.1371/journal.pone.0104870. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Müller V, et al. Changes in serum levels of miR-21, miR-210, and miR-373 in HER2-positive breast cancer patients undergoing neoadjuvant therapy: A translational research project within the Geparquinto trial. Breast Cancer Res. Treat. 2014;147:61–68. doi: 10.1007/s10549-014-3079-3. [DOI] [PubMed] [Google Scholar]
- 17.Dluzen DF, et al. Racial differences in microRNA and gene expression in hypertensive women. Sci. Rep. 2016;6:35815. doi: 10.1038/srep35815. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Wang X, et al. Determination of 14 circulating microRNAs in Swedes and Iraqis with and without diabetes mellitus type 2. PLoS ONE. 2014;9:1–8. doi: 10.1371/journal.pone.0086792. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wang T, et al. A micro-RNA signature associated with race, tumor size, and target gene activity in human uterine leiomyomas. Genes. Chromosomes Cancer. 2007;46:336–347. doi: 10.1002/gcc.20415. [DOI] [PubMed] [Google Scholar]
- 20.Huang RS, et al. Population differences in microRNA expression and biological implications. RNA Biol. 2011;8:692–701. doi: 10.4161/rna.8.4.16029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Nassar FJ, et al. MicroRNA expression in ethnic specific early stage breast cancer: An integration and comparative analysis. Sci. Rep. 2017;7:1–12. doi: 10.1038/s41598-016-0028-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Pollard J, et al. Differential expression of MicroRNAs in breast cancers from four different ethnicities. Pathobiology. 2018;85:220–226. doi: 10.1159/000488456. [DOI] [PubMed] [Google Scholar]
- 23.Gong Z, et al. Differences in microRNA expression in breast cancer between women of African and European ancestry. Carcinogenesis. 2019;40:61–69. doi: 10.1093/carcin/bgy134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Lara OD, et al. Pan-cancer clinical and molecular analysis of racial disparities. Cancer. 2020;126:800–807. doi: 10.1002/cncr.32598. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Frères P, et al. Circulating microRNA-based screening tool for breast cancer. Oncotarget. 2016;7:5416–5428. doi: 10.18632/oncotarget.6786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Breiman L. Random forests. Mach. Learn. 2001;45:5–32. doi: 10.1023/A:1010933404324. [DOI] [Google Scholar]
- 27.Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3:32–35. doi: 10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3. [DOI] [PubMed] [Google Scholar]
- 28.Coleman C. Early detection and screening for breast cancer. Semin. Oncol. Nurs. 2017;33:141–155. doi: 10.1016/j.soncn.2017.02.009. [DOI] [PubMed] [Google Scholar]
- 29.Bleyer A, Welch HG. Effect of three decades of screening mammography on breast-cancer incidence. N. Engl. J. Med. 2012;367:1998–2005. doi: 10.1056/NEJMoa1206809. [DOI] [PubMed] [Google Scholar]
- 30.Aggarwal T, et al. MicroRNAs as biomarker for breast cancer. Endocr. Metab. Immune Disord. Drug Targets. 2020;20:1597–1610. doi: 10.2174/1871530320666200428113051. [DOI] [PubMed] [Google Scholar]
- 31.Yang Z, Liu Z. The emerging role of MicroRNAs in breast cancer. J. Oncol. 2020;2020:9160905. doi: 10.1155/2020/9160905. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Yu F, et al. let-7 regulates self renewal and tumorigenicity of breast cancer cells. Cell. 2007;131:1109–1123. doi: 10.1016/j.cell.2007.10.054. [DOI] [PubMed] [Google Scholar]
- 33.Tavazoie SF, et al. Endogenous human microRNAs that suppress breast cancer metastasis. Nature. 2008;451:147–152. doi: 10.1038/nature06487. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Huang S, et al. miR-150 promotes human breast cancer growth and malignant behavior by targeting the pro-apoptotic purinergic P2X7 receptor. PLoS ONE. 2013;8:e80707. doi: 10.1371/journal.pone.0080707. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Li H, et al. A serum microRNA signature predicts trastuzumab benefit in HER2-positive metastatic breast cancer patients. Nat. Commun. 2018;9:1614. doi: 10.1038/s41467-018-03537-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Hashimoto K, et al. Cancer-secreted hsa-miR-940 induces an osteoblastic phenotype in the bone metastatic microenvironment via targeting ARHGAP1 and FAM134A. Proc. Natl. Acad. Sci. 2018;115:2204–2209. doi: 10.1073/pnas.1717363115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Pisano ED, et al. Diagnostic performance of digital versus film mammography for breast-cancer screening. N. Engl. J. Med. 2005;353:1773–1783. doi: 10.1056/NEJMoa052911. [DOI] [PubMed] [Google Scholar]
- 38.Lehman CD, et al. National performance benchmarks for modern screening digital mammography: Update from the breast cancer surveillance consortium. Radiology. 2017;283:49–58. doi: 10.1148/radiol.2016161174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Poplack SP, Tosteson AN, Grove MR, Wells WA, Carney PA. Mammography in 53,803 women from the New Hampshire mammography network. Radiology. 2000;217:832–840. doi: 10.1148/radiology.217.3.r00dc33832. [DOI] [PubMed] [Google Scholar]
- 40.Zhao H, et al. A pilot study of circulating miRNAs as potential biomarkers of early stage breast cancer. PLoS ONE. 2010;5:e13735. doi: 10.1371/journal.pone.0013735. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Rawlings-Goss RA, Campbell MC, Tishkoff SA. Global population-specific variation in miRNA associated with cancer risk and clinical biomarkers. BMC Med. Genomics. 2014;7:53. doi: 10.1186/1755-8794-7-53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Souza KCB, et al. Identification of cell-free circulating microRNAs for the detection of early breast cancer and molecular subtyping. J. Oncol. 2019;2019:1–11. doi: 10.1155/2019/8393769. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Saleh AA, Soliman SE, Habib MSE, Gohar SF, Abo-Zeid GS. Potential value of circulatory microRNA122 gene expression as a prognostic and metastatic prediction marker for breast cancer. Mol. Biol. Rep. 2019;46:2809–2818. doi: 10.1007/s11033-019-04727-5. [DOI] [PubMed] [Google Scholar]
- 44.Yerukala Sathipati S, Ho S-Y. Identifying a miRNA signature for predicting the stage of breast cancer. Sci. Rep. 2018;8:16138. doi: 10.1038/s41598-018-34604-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Stückrath I, et al. Aberrant plasma levels of circulating miR-16, miR-107, miR-130a and miR-146a are associated with lymph node metastasis and receptor status of breast cancer patients. Oncotarget. 2015;6:13387–13401. doi: 10.18632/oncotarget.3874. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Determan CE., Jr Optimal algorithm for metabolomics classification and feature selection varies by dataset. Int. J. Biol. 2014;7:100–115. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The raw and normalized data of the miRNA profiling are available upon request.