Abstract
The interaction between the meiotic recombination 11 homolog A (MRE11) oncoprotein and breast cancer recurrence status remains unclear. The aim of this study was to assess the interaction between MRE11 and clinicopathologic variables in breast cancer. A dataset for 254 subjects with breast cancer (220 nonrecurrent and 34 recurrent) was used in individual and cumulated receiver operating characteristic (ROC) analyses of MRE11 and 12 clinicopathologic variables for predicting breast cancer recurrence. In individual ROC analysis, the area under curve (AUC) for each predictor of breast cancer recurrence was smaller than 0.7. In cumulated ROC analysis, however, the AUC value for each predictor improved. Ten relevant variables in breast cancer recurrence were used to find the optimal prognostic indicators. The presence of any six of the following ten variables had a high (79%) sensitivity and a high (70%) specificity for predicting breast cancer recurrence: tumor size ≥ 2.4 cm, tumor stage II/III, therapy other than hormone therapy, age ≥ 52 years, MRE11 positive cells > 50%, body mass index ≥ 24, lymph node metastasis, positivity for progesterone receptor, positivity for epidermal growth factor receptor, and negativity for estrogen receptor. In conclusion, this study revealed that these 10 clinicopathologic variables are the minimum discriminators needed for optimal discriminant effectiveness in predicting breast cancer recurrence.
1. Introduction
Breast cancer is the most common cancer in women worldwide and is diagnosed in one in three of all women with cancer. Reported risk factors for breast cancer include age, family history, genetic specificity, and lifestyle [1–4]. Local and/or systematic treatments for breast cancer now enable a high survival rate, especially when breast cancer is diagnosed at an early stage [5]. However, breast cancer recurrence or metastasis (i.e., the spread of tumor cells from the original site) can reduce survival time [6].
Prognostic indicators of breast cancer complication and recurrence can be used to predict survival after diagnosis of breast cancer [7]. Estrogen receptor (ER), progesterone receptor (PR), and human epidermal growth factor receptor 2 (HER2) are reportedly accurate and independent prognostic indicators of breast cancer recurrence risk [6], and combining these independent indicators can improve accuracy in predicting recurrence. Representative prognostic indicators can also be used to evaluate the effectiveness of adjuvant therapy and to estimate the risk of tumor recurrence [8].
Our previous study [9] reported the important role of meiotic recombination 11 homolog A (MRE11) in cell proliferation, tumor invasion, and DNA repair in patients with breast cancer. The MRE11 is considered an oncoprotein because it is overexpressed in colorectal cancer [10] and in highly malignant breast cancer [9]. However, no studies have evaluated the use of breast cancer tumor marker MRE11 as a diagnostic or prognostic indicator in breast cancer. Specifically, no studies have evaluated whether MRE11 interacts with clinicopathologic variables associated with breast cancer recurrence.
Receiver operating characteristic (ROC) analysis is widely used method of evaluating the performance of a diagnostic test according to a continuous spectrum of results [11, 12]. By graphically depicting the quantitative analysis results, the ROC curve reveals the discriminant thresholds based on the probability of positive results (sensitivity against 1 − specificity) in individual subjects [13]. The area under the curve (AUC) is a measure of the overall accuracy of the dichotomous methods of the measurements. Recently, ROC has been used as a tool for comparing the accuracy of various models for predicting cancer diagnosis, prognosis, and survival [14–20].
This study developed a scoring system based on ROC analysis to identify patient characteristics associated with susceptibility to breast cancer recurrence. Thus, aims of this study were (i) to assess breast cancer recurrence based on MRE11 expression and clinicopathologic characteristics and (ii) to identify the patient characteristics that are risk factors for breast cancer recurrence.
2. Methods
2.1. Study Participants
After obtaining IRB approval, this study enrolled 254 female breast cancer patients who had received surgical treatment for pathology-confirmed invasive ductal carcinoma at the Department of Surgery, Kaohsiung Medical University Hospital, during 2006–2010. Informed consent was obtained from all patients. The ethics statement, laboratory procedures, and other study procedures were identical to those in our previous study [9]. The dataset for all clinicopathological variables is available online at https://wp.kmu.edu.tw/changhw/files/2015/10/ROC_MRE11_DATASET.xlsx.
2.2. Criteria for Breast Cancer Recurrence
Patients with and without breast cancer recurrence were classified into a recurrence group and a nonrecurrence group, respectively. In the recurrence group, breast cancer recurrence was defined as a local/regional recurrence with or without distant metastasis diagnosed according to symptoms observed in clinical examination, pathology study, or imaging study. Patients who remained disease-free for 60 months after diagnosis or who were disease-free at the end of the follow-up period were classified into the nonrecurrence group.
2.3. Dichotomous Results of ROC Analysis for Each Clinicopathologic Variable
The 13 clinicopathologic variables included in the ROC analysis included MRE11 positive cells (%), tumor stage, tumor grade, age, body mass index (BMI), tumor size, lymph node (LN) metastasis, estrogen receptor (ER) status, progesterone receptor (PR) status, human epidermal growth factor receptor 2 (HER2) status, radiotherapy (RT), chemotherapy (CT), and hormone therapy (HT). First, the clinicopathologic variables were dichotomized by ROC curve analysis. The ROC curve is a graphical plot of the true positive rate (sensitivity) against the false positive rate (1 − specificity) at various threshold settings. Each cut-off point estimated by ROC analysis indicates the distinguishing characteristic of each clinicopathologic variable used to classify participants into the recurrence group. The area under the ROC curve (AUC) is used to calculate the accuracy of dichotomous results.
2.4. AUC of Cumulated ROC Analysis
A cumulated ROC analysis was performed to detect the combined effects of the clinicopathologic variables used to predict recurrence. Variables that had a strong association with recurrence (i.e., values larger than the cut-off point in AUC from the individually dichotomous results) received a score of 1. The remaining variables received a score of 0 (i.e., values less than the cut-off point in AUC from the individually dichotomous results). The indicators were then ranked by cumulated AUC results for individually dichotomous results. Positive changes in the cumulated AUC values for these variables were tracked until the addition of other variables no longer increased the AUC values. Accordingly, clinicopathologic variables that contributed to positive changes in AUC were selected for further analysis.
2.5. Cut-Off Point for Cumulated Scoring System
The cumulated scoring system was then used to rank the clinicopathologic variables as breast cancer predictors. The cumulated score for each subject was obtained by adding the risk factors to the recurrence score (1 or 0). The correctly classified rate for each possible cut-off point within the range of cumulated scores was dependent on the number of clinicopathologic variables selected for ROC analysis. For example, if “n” variables were selected according to a positive change in AUC value in the previous step, cumulated scores ranging from 0 to “n” were generated. The last step was calculating the specificity, sensitivity, and correctly classified rate for each cut-off point in the cumulated score range.
2.6. Risk Relationship of the Selected Variables in the Cumulated Scoring System
For each subject, the cumulated score represented the total number of clinicopathologic variables that were breast cancer risk factors. For instance, a score of 3 was interpreted as the presence of three risk factors that were more relevant to breast cancer recurrence compared to the selected clinicopathologic variables.
2.7. Statistical Analyses
Differences in the distributions of clinicopathologic variables between the recurrence and the nonrecurrence groups were estimated by frequency tables and the χ2 test. The AUC represents the accuracy of the dichotomous results for a single clinicopathologic variable for predicting breast cancer recurrence. The dichotomous results with high AUC values were considered better predictors of breast cancer recurrence.
In cumulated ROC analysis, the likelihood ratio was used to assess recurrence status in subjects with different cumulated scores. The likelihood ratio for a positive test result [LR+: sensitivity/(1 − specificity)] represents the ratio of the probability of a positive test in the recurrence subjects to the probability of a positive test in the nonrecurrence subjects. Comparatively, the likelihood ratio for a negative test [LR−: (1 − sensitivity)/specificity] result represents the ratio of the probability of a negative test in the recurrence subjects to the probability of a negative test in the nonrecurrence subjects. All statistical analyses were performed by STATA version 11.0.
3. Results
3.1. Clinicopathologic Characteristics and Recurrence of Breast Cancer
During the 5-year follow-up period, recurrence developed in 34 (13.39%) of the 254 breast cancer patients. Table 1 compares clinicopathological variables between the recurrence and the nonrecurrence groups. Compared to the nonrecurrence group, the recurrence group had significantly larger proportions of patients with MRE11 positive cells > 50% (85.29%), breast cancer stage II/III (94.12%), age ≥ 52 years (67.65%), tumor size ≥ 2.4 cm (67.65%), LN metastasis (58.82%), negative expression of ER (58.82%), negative expression of PR (64.71%), triple negative breast cancer (35.29%), RT (79.41%), and no-HT treatment (61.76%).
Table 1.
Clinicopathologic characteristics of breast cancer patients in recurrence status∗1.
| Variable | No recurrence (n = 220) | Recurrence (n = 34) | P | ||
|---|---|---|---|---|---|
| N | % | N | % | ||
| MRE11 positive cells | 0.030 | ||||
| ≤50% | 73 | 33.18 | 5 | 14.71 | |
| >50% | 147 | 66.82 | 29 | 85.29 | |
| Stage | <0.001 | ||||
| I | 88 | 40.00 | 2 | 5.88 | |
| II, III | 132 | 60.00 | 32 | 94.12 | |
| Grade | 0.543 | ||||
| 1, 2 | 166 | 75.45 | 24 | 70.59 | |
| 3 | 54 | 24.55 | 10 | 29.41 | |
| Age | 0.007 | ||||
| <52 yrs | 126 | 57.27 | 11 | 32.35 | |
| ≥52 yrs | 94 | 42.73 | 23 | 67.65 | |
| BMI (kg/m2) | 0.151 | ||||
| <24 | 126 | 57.27 | 15 | 44.12 | |
| ≥24 | 94 | 42.73 | 19 | 55.88 | |
| Tumor size (cm) | <0.001 | ||||
| <2.4 cm | 150 | 68.18 | 11 | 32.35 | |
| ≥2.4 cm | 70 | 31.82 | 23 | 67.65 | |
| LN metastasis | 0.003 | ||||
| Negative | 149 | 67.73 | 14 | 41.18 | |
| Positive | 71 | 32.27 | 20 | 58.82 | |
| ER | <0.001 | ||||
| Negative | 63 | 28.64 | 20 | 58.82 | |
| Positive | 157 | 71.36 | 14 | 41.18 | |
| PR | 0.009 | ||||
| Negative | 90 | 40.91 | 22 | 64.71 | |
| Positive | 130 | 59.09 | 12 | 35.29 | |
| HER2 status | 0.430 | ||||
| Negative | 140 | 63.64 | 24 | 70.59 | |
| Positive | 80 | 36.36 | 10 | 29.41 | |
| Triple negative | 0.002 | ||||
| No | 190 | 86.36 | 22 | 64.71 | |
| Yes | 30 | 13.64 | 12 | 35.29 | |
| RT | 0.021 | ||||
| No | 91 | 41.36 | 7 | 20.59 | |
| Yes | 129 | 58.64 | 27 | 79.41 | |
| CT | 0.866 | ||||
| No | 30 | 13.64 | 5 | 14.71 | |
| Yes | 190 | 86.36 | 29 | 85.29 | |
| HT | 0.001 | ||||
| No | 72 | 32.73 | 21 | 61.76 | |
| Yes | 148 | 67.27 | 13 | 38.24 | |
∗1Dataset was retrieved from our previous study [9]. MRE11: meiotic recombination 11; BMI: body mass index; LN: lymph node; ER: estrogen receptor; PR: progesterone receptor; HER2: human epidermal growth factor receptor 2; RT: radiotherapy; CT: chemotherapy; HT: hormone therapy.
3.2. AUC for Clinicopathologic Variables for Breast Cancer Recurrence
Table 2 shows the AUCs obtained when these 13 variables were considered in estimates of recurrence risk. The clinical criteria for high and low risk of breast cancer recurrence were identical to those used in our previous study [9]. Notably, although the dichotomized tumor size yielded the highest AUC value (0.679 with sensitivity of 0.677 and specificity of 0.682), it did not meet the criterion of AUC ≥ 0.7 [21] for classification of recurrence.
Table 2.
AUC of clinicopathologic characteristics for recurrence status∗1.
| Variable | AUC | High risk | Low risk | Sensitivity | Specificity |
|---|---|---|---|---|---|
| Tumor size (cm) | 0.679 | ≥2.4 cm | <2.4 cm | 0.677 | 0.682 |
| Stage | 0.671 | II, III | I | 0.941 | 0.400 |
| ER | 0.651 | Negative | Positive | 0.588 | 0.714 |
| HT | 0.645 | No | Yes | 0.618 | 0.673 |
| LN metastasis | 0.633 | Positive | Negative | 0.588 | 0.677 |
| Age | 0.625 | ≥52 yrs | <52 yrs | 0.677 | 0.573 |
| PR | 0.619 | negative | positive | 0.647 | 0.591 |
| MRE11 positive cells | 0.592 | >50% | ≤50% | 0.853 | 0.332 |
| BMI | 0.566 | ≥24 | <24 | 0.559 | 0.573 |
| HER2 status | 0.535 | Negative | Positive | 0.706 | 0.364 |
| Grade | 0.524 | 3 | 1, 2 | 0.294 | 0.755 |
| CT | 0.505 | No | Yes | 0.147 | 0.864 |
| RT | 0.396 | No | Yes | 0.206 | 0.586 |
∗1Data for high/low risks of breast cancer recurrence were retrieved from our previous study [9]. AUC: area under receiver operating characteristic; ER: estrogen receptor; HT: hormone therapy; LN: lymph node; PR: progesterone receptor; MRE11: meiotic recombination 11; BMI: body mass index; HER2: human epidermal growth factor receptor 2; CT: chemotherapy; RT: radiotherapy.
3.3. Cumulated ROC Analysis of Breast Cancer Recurrence
No single dichotomized variable showed satisfactory performance in predicting breast cancer recurrence (defined as AUC < 0.700). Therefore, this study developed an improved scoring system that considered the combined effects of these variables. Table 3 shows the ROC analysis results obtained for the developed scoring system with cumulated top-ranked predictors. The scoring system obtained a good AUC value (0.806) when 6 dichotomized variables (tumor size, tumor stage, ER, HT, LN metastasis, and age) were used. The AUC values showed further positive changes (range, 0.806 to 0.821) when the scoring system consisted of the cumulated top tenth rank of dichotomized variables (tumor size, stage, ER, HT, LN metastasis, age, PR, MRE11 positive cells, BMI, and HER2). When the number of variables exceeded ten cumulated top-ranked variables, however, the AUC value slightly decreased. That is, the scoring system obtained the best AUC values when ten dichotomized variables were used.
Table 3.
Cumulated top-ranked prediction results using ROC analysis∗1.
| Cumulated top-ranked variables | Variables | AUC |
|---|---|---|
| 2 | Tumor size and stage | 0.724 |
| 3 | Above variables plus ER | 0.771 |
| 4 | Above variables plus HT | 0.765 |
| 5 | Above variables plus LN metastasis | 0.790 |
| 6 | Above variables plus age | 0.806 |
| 7 | Above variables plus PR | 0.800 |
| 8 | Above variables plus MRE11 positive cells | 0.799 |
| 9 | Above variables plus BMI | 0.810 |
| 10 | Above variables plus HER2 | 0.821 |
| 11 | Above variables plus grade | 0.806 |
| 12 | Above variables plus CT | 0.799 |
| 13 | Above variables plus RT | 0.774 |
∗1Dataset and high/low risks of breast cancer recurrence were retrieved from our previous study [9]. ER: estrogen receptor; HT: hormone therapy; LN: lymph node; PR: progesterone receptor; BMI: body mass index; CT: chemotherapy; RT: radiotherapy.
3.4. Cut-Off Point for Cumulated Scoring System
Hence, the performance of possible cut-off points ranging from score 0 to 10 were compared in the scoring system. Table 4 compares the results. For predicting recurrence, a cut-off point of 0 had a sensitivity of 100% (all recurrence patients correctly classified) but had a specificity of 0% (no recurrence patients correctly classified). In contrast, a cut-off point of 100% had a specificity of 10 (all nonrecurrence subjects correctly classified) but a sensitivity of 0 (no recurrence patients correctly classified). The cut-off point for 6 dichotomized variables had the highest sensitivity and the highest specificity. This cut-off point correctly classified 71.3% with the best combination of sensitivity (0.794) and specificity (0.700; LR+ 2.647 and LR− 0.294).
Table 4.
Cut-off point identified by ROC analysis∗1.
| Number of dichotomized variables∗2 |
Sensitivity | Specificity | Sensitivity + specificity |
Correctly classified | LR+ | LR− |
|---|---|---|---|---|---|---|
| 0 | 1.000 | 0.000 | 1.000 | 0.134 | 1.000 | — |
| 1 | 1.000 | 0.027 | 1.027 | 0.158 | 1.028 | 0.000 |
| 2 | 1.000 | 0.073 | 1.073 | 0.197 | 1.078 | 0.000 |
| 3 | 1.000 | 0.182 | 1.182 | 0.291 | 1.222 | 0.000 |
| 4 | 0.941 | 0.332 | 1.273 | 0.413 | 1.409 | 0.177 |
| 5 | 0.912 | 0.468 | 1.380 | 0.528 | 1.714 | 0.189 |
| 6 | 0.794 | 0.700 | 1.494 | 0.713 | 2.647 | 0.294 |
| 7 | 0.618 | 0.868 | 1.486 | 0.835 | 4.686 | 0.440 |
| 8 | 0.382 | 0.941 | 1.323 | 0.866 | 6.471 | 0.656 |
| 9 | 0.177 | 0.986 | 1.163 | 0.878 | 12.941 | 0.835 |
| 10 | 0.029 | 1.000 | 1.029 | 0.870 | — | 0.971 |
LR+: likelihood ratio for a positive test result; LR−: likelihood ratio for a negative test result.
∗1Dataset was retrieved from our previous study [9].
∗2The number of dichotomized variables was the cumulated effects of the various clinicopathologic variables from Table 3, including tumor size, stage, ER, HT, LN metastasis, age, PR, BMI, MRE11 positive cells, and HER2.
3.5. Risk Relationships of the Selected Variables in the Cumulated Scoring System
Table 5 lists the clinicopathologic variables that contributed the five largest possible changes in AUC values (0.799 to 0.821) in Table 3. The scores for 10 dichotomized variables were then computed into these five clinicopathologic variables as indicated in Table 5. In the 254 patients analyzed, scores were ≤ 5 in most (63.39%; 161) patients. In the 161 patients with scores of ≤ 5, most (63.98%, 103) patients were HER2 negative. The score was 6 in 16.93% (43/254) of the patients. In patients with a score of 6, most (74.42%; 32/43) had BMI ≥ 24. The score was 7 in 9.45% (24/254) of the patients. In patients with a score of 7, all (100.00%) had BMI ≥ 24. The score was 8 in 6.69% (17/254) patients. In patients with a score of 8, 88.24% (15) had BMI ≥ 24. The score was 9 in 3.15% (8/254) patients. All patients who had a score of 9 were negative for PR expression and had a BMI ≥ 24. Only 0.39% (1/254) patients had a score of 10, that is, high values for all five clinicopathologic variables that were risk factors for breast cancer recurrence.
Table 5.
Risk relationship of scores with selected variables∗1.
| Score∗2 | Total | Age ≥ 52 yrs (n = 117) |
PR negative (n = 112) |
MRE11 positive cells > 50% (n = 113) |
BMI ≥ 24 (n = 176) |
HER2 negative (n = 164) |
|||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| N | N | % | N | % | N | % | N | % | N | % | |
| ≤5 | 161 | 51 | 31.68 | 47 | 29.19 | 61 | 37.89 | 96 | 59.63 | 103 | 63.98 |
| 6 | 43 | 27 | 62.79 | 27 | 62.79 | 20 | 46.51 | 32 | 74.42 | 27 | 62.79 |
| 7 | 24 | 18 | 75.00 | 16 | 66.67 | 13 | 54.17 | 24 | 100.00 | 14 | 58.33 |
| 8 | 17 | 13 | 76.47 | 13 | 76.47 | 12 | 70.59 | 15 | 88.24 | 13 | 76.47 |
| 9 | 8 | 7 | 87.50 | 8 | 100.00 | 6 | 75.00 | 8 | 100.00 | 6 | 75.00 |
| 10 | 1 | 1 | 100.00 | 1 | 100.00 | 1 | 100.00 | 1 | 100.00 | 1 | 100.00 |
PR: progesterone receptor; MRE11: meiotic recombination 11; BMI: body mass index; HER2: human epidermal growth factor receptor 2.
∗1Dataset was retrieved from our previous study (n = 254) [9].
∗2Cumulated score representing the number of risk properties of the selected clinicopathologic variables in the subjects. The selected clinicopathologic variables included tumor size, tumor stage, ER, HT, LN metastasis, age, PR, BMI, MRE11 positive cells, and HER2.
4. Discussion
Conventional statistical methods used to estimate probability of breast cancer recurrence include logistic regression, Cox-proportional hazard regression model, Kaplan-Meier estimator, and log-rank test [22]. Our previous work using similar statistical methods revealed that MRE11 is associated with breast cancer malignancy [9]. However, possible interactions between MRE11 and clinicopathologic variables for breast cancer recurrence have not been reported in the literature.
An ROC analysis is a simple and powerful approach to discriminant analysis. In this study, dichotomization of clinicopathologic variables by AUC enabled quick and easy differentiation of variables associated with high and low recurrence risk. However, variations in breast cancer recurrence are rarely affected by a single factor. Similarly, we found that the contribution of each variable may be too weak (<0.7) in terms of AUC.
A recent study developed a cumulated ROC analysis strategy for assessing outcomes of orthodontic surgery [23] and for diagnosing metastasis in breast cancer [24] and other cancer types [25, 26]. In our study, a similar scoring system was applied in multivariate cumulated ROC analysis to evaluate diagnostic indicators of breast cancer recurrence. Table 3 shows that 10 variables were the minimum number of discriminators required to obtain the optimum discriminant effectiveness. Table 4 further shows that a cut-off point of 6 had the best combination of sensitivity and specificity for predicting breast cancer recurrence. These results suggest that the cumulated ROC analysis strategy also improves accuracy in predicting breast cancer recurrence.
Moreover, these data suggest that both gene-environment and environment-environment interactions have important roles in predicting recurrence when clinicopathologic variables are regarded as the environmental factors. Similar interactions between these variables have been reported. For example, ER and HER2 are reportedly both interdependent and independent prognostic indicators of breast cancer recurrence [27]. The Nottingham prognostic index considers tumor size, lymph node metastasis, and tumor grade to obtain an estimate of recurrence risk in patients with breast cancer [28, 29]. In contrast, the breast cancer severity score (BCSS) is a prognostic scoring system based on tumor size, number of metastatic lymph nodes, and HER2 status [30]. The BCSS may be the best predictor of both overall survival and disease-free survival. A common feature of these prognostic scoring systems is that all of the breast cancer characteristics mentioned in the current study are considered simultaneously.
Comparisons of these variables further showed that most subjects with a high risk of breast cancer recurrence had a high BMI (Table 5), which is consistent with reports that high BMI is associated with aggressive tumor characteristics in premenopausal [31] and postmenopausal women [32]. Another randomized trial showed that lymph node metastasis, ER-negativity, and HER2 negativity are associated with breast cancer risk and prognosis [33]. Breast cancer patients with the triple negative subtype (i.e., negativity for ER, PR, and HER2) have a high risk of disease progression [34]. Supplementary Table 1 (in Supplementary Material available online at https://doi.org/10.1155/2017/2563910) shows that MRE11 expression did not significantly differ among ER-positivity, ER-negativity, PR-positivity, or PR-negativity in the current study. Supplementary Table 2 further shows that BMI level did not significantly differ among ER-positivity, ER-negativity, PR-positivity, PR-negativity, HER2-positivity, or HER2-negativity.
Some limitations of this study should be noted. First, our previous work [9] suggested a survival analysis of the current dataset using Cox-proportional hazard model, Kaplan-Meier curve, and log-rank test. However, survival was not considered in the follow-up analyses of subjects in the current study. Another limitation is that, although the cumulated ROC analysis revealed potential joint effects of the selected clinicopathologic variables, the complex interactions of all possible combinations of clinicopathologic variables were not analyzed because the cumulated ROC was initially based on the highest ranked AUC for a single variable. In subsequent analyses, the variable with the lowest AUC was not considered. Moreover, this study did not validate the signature identified by ROC analysis in a testing dataset. Therefore, the use of a testing dataset and intelligent computational algorithms [35–44] is warranted in future studies of the complex high-order interactions between these clinicopathologic variables and breast cancer recurrence.
5. Conclusions
This study evaluated the contributions of 13 clinicopathologic variables in predicting breast cancer recurrence. In individual ROC analysis, each variable had a weak AUC for predicting breast cancer recurrence. In cumulative ROC analysis, however, each variable had an improved AUC. Finally, this study revealed that 10 clinicopathologic variables is the minimum number of discriminators needed for optimum accuracy in predicting breast cancer recurrence by discriminant analysis.
Supplementary Material
Supplementary Table 1. The expression range of MRE11 in the different groups of breast cancer patients. Supplementary Table 2. The distribution of BMI level in the different groups of ER, PR and HER2 breast cancer patients.
Acknowledgments
This work was supported by grants from the Ministry of Science and Technology (MOST 104-2320-B-037-013-MY3, MOST 103-2221-E-151-029-MY3), the National Sun Yat-sen University-KMU Joint Research Project (#NSYSU-KMU 105-p022), the Chimei-KMU jointed project (105CM-KMU-06), and the Health and Welfare Surcharge of Tobacco Products, the Ministry of Health and Welfare, Taiwan (MOHW105-TDU-B-212-134007, MOHW104-TD-B-111-05, and MOHW104-TDU-B-212-124-003).
Competing Interests
The authors have no competing interests to declare.
References
- 1.Ibrahim E. M., Al-Foheidi M. E., Al-Mansour M. M., Kazkaz G. A. The prognostic value of tumor-infiltrating lymphocytes in triple-negative breast cancer: a meta-analysis. Breast Cancer Research and Treatment. 2014;148(3):467–476. doi: 10.1007/s10549-014-3185-2. [DOI] [PubMed] [Google Scholar]
- 2.Yang Z.-Y., Di M.-Y., Yuan J.-Q., et al. The prognostic value of phosphorylated Akt in breast cancer: a systematic review. Scientific Reports. 2015;5, article no. 7758 doi: 10.1038/srep07758. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Stevens K. N., Vachon C. M., Couch F. J. Genetic susceptibility to triple-negative breast cancer. Cancer Research. 2013;73(7):2025–2030. doi: 10.1158/0008-5472.can-12-1699. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Chang W.-P., Liu M.-E., Chang W.-C., et al. Sleep apnea and the subsequent risk of breast cancer in women: a nationwide population-based cohort study. Sleep Medicine. 2014;15(9):1016–1020. doi: 10.1016/j.sleep.2014.05.026. [DOI] [PubMed] [Google Scholar]
- 5.Goldhirsch A., Wood W. C., Gelber R. D., Coates A. S., Thurlimann B., Senn H. J. Progress and promise: highlights of the international expert consensus on the primary therapy of early breast cancer 2007. Annals of Oncology. 2007;18(7):1133–1144. doi: 10.1093/annonc/mdm271. [DOI] [PubMed] [Google Scholar]
- 6.Bundred N. J. Prognostic and predictive factors in breast cancer. Cancer Treatment Reviews. 2001;27(3):137–142. doi: 10.1053/ctrv.2000.0207. [DOI] [PubMed] [Google Scholar]
- 7.Ohno-Machado L. Modeling medical prognosis: survival analysis techniques. Journal of Biomedical Informatics. 2001;34(6):428–439. doi: 10.1006/jbin.2002.1038. [DOI] [PubMed] [Google Scholar]
- 8.Ludwig J. A., Weinstein J. N. Biomarkers in cancer staging, prognosis and treatment selection. Nature Reviews Cancer. 2005;5(11):845–856. doi: 10.1038/nrc1739. [DOI] [PubMed] [Google Scholar]
- 9.Yuan S.-S. F., Hou M.-F., Hsieh Y.-C., et al. Role of MRE11 in cell proliferation, tumor invasion, and DNA repair in breast cancer. Journal of the National Cancer Institute. 2012;104(19):1485–1502. doi: 10.1093/jnci/djs355. [DOI] [PubMed] [Google Scholar]
- 10.Wang C.-J., Frånbergh-Karlson H., Wang D.-W., Arbman G., Zhang H., Sun X.-F. Clinicopathological significance of BTF3 expression in colorectal cancer. Tumor Biology. 2013;34(4):2141–2146. doi: 10.1007/s13277-013-0745-8. [DOI] [PubMed] [Google Scholar]
- 11.Robertson E. A., Zweig M. H. Use of receiver operating characteristic curves to evaluate the clinical-performance of analytical systems. Clinical Chemistry. 1981;27(9):1569–1574. [PubMed] [Google Scholar]
- 12.Zweig M. H., Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clinical Chemistry. 1993;39(4):561–577. [PubMed] [Google Scholar]
- 13.Gu J., Ghosal S., Roy A. Bayesian bootstrap estimation of ROC curve. Statistics in Medicine. 2008;27(26):5407–5420. doi: 10.1002/sim.3366. [DOI] [PubMed] [Google Scholar]
- 14.Yen C.-Y., Chen C.-H., Chang C.-H., et al. Matrix metalloproteinases (MMP) 1 and MMP10 but not MMP12 are potential oral cancer markers. Biomarkers. 2009;14(4):244–249. doi: 10.1080/13547500902829375. [DOI] [PubMed] [Google Scholar]
- 15.Yen C.-Y., Huang C.-Y., Hou M.-F., et al. Evaluating the performance of fibronectin 1 (FN1), integrin α4β1 (ITGA4), syndecan-2 (SDC2), and glycoprotein CD44 as the potential biomarkers of oral squamous cell carcinoma (OSCC) Biomarkers. 2013;18(1):63–72. doi: 10.3109/1354750X.2012.737025. [DOI] [PubMed] [Google Scholar]
- 16.Shih I.-M. Application of human leukocyte antigen-G expression in the diagnosis of human cancer. Human Immunology. 2007;68(4):272–276. doi: 10.1016/j.humimm.2007.01.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Jin H., Daly D. S., Marks J. R., Zangar R. C. Oxidatively modified proteins as plasma biomarkers in breast cancer. Cancer Biomarkers. 2013;13(3):193–200. doi: 10.3233/cbm-130349. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Baskic D., Popovic S., Bankovic D., et al. Evaluation of inflammatory biomarkers as helping diagnostic tool in patients with breast cancer. Cancer Biomarkers. 2014;14(6):401–408. doi: 10.3233/CBM-140426. [DOI] [PubMed] [Google Scholar]
- 19.Zhao Y., Wang M., Cui C., et al. Significance of combined tests of serum golgi glycoprotein 73 and other biomarkers in diagnosis of small primary hepatocellular carcinoma. Cancer Biomarkers. 2015;15(5):677–683. doi: 10.3233/CBM-150508. [DOI] [PubMed] [Google Scholar]
- 20.Qin M., Liu G., Huo X., et al. Hsa_circ_0001649: a circular RNA and potential novel biomarker for hepatocellular carcinoma. Cancer Biomarkers. 2016;16(1):161–169. doi: 10.3233/cbm-150552. [DOI] [PubMed] [Google Scholar]
- 21.Hanley J. A., McNeil B. J. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983;148(3):839–843. doi: 10.1148/radiology.148.3.6878708. [DOI] [PubMed] [Google Scholar]
- 22.Sotiriou C., Neo S.-Y., McShane L. M., et al. Breast cancer classification and prognosis based on gene expression profiles from a population-based study. Proceedings of the National Academy of Sciences of the United States of America. 2003;100(18):10393–10398. doi: 10.1073/pnas.1732912100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Tseng Y.-C., Pan C.-Y., Chou S.-T., et al. Treatment of adult Class III malocclusions with orthodontic therapy or orthognathic surgery: receiver operating characteristic analysis. American Journal of Orthodontics and Dentofacial Orthopedics. 2011;139(5):e485–e493. doi: 10.1016/j.ajodo.2010.12.014. [DOI] [PubMed] [Google Scholar]
- 24.El-Mezayen H. A., Metwally F. M., Darwish H. A novel discriminant score based on tumor-associated trypsin inhibitor for accurate diagnosis of metastasis in patients with breast cancer. Tumor Biology. 2014;35(3):2759–2767. doi: 10.1007/s13277-013-1366-y. [DOI] [PubMed] [Google Scholar]
- 25.Rozalski R., Gackowski D., Siomek-Gorecka A., et al. Urinary 5-hydroxymethyluracil and 8-oxo-7,8-dihydroguanine as potential biomarkers in patients with colorectal cancer. Biomarkers. 2015;20(5):287–291. doi: 10.3109/1354750X.2015.1068860. [DOI] [PubMed] [Google Scholar]
- 26.De Paoli M., Perco P., Mühlberger I., et al. Disease map-based biomarker selection and pre-validation for bladder cancer diagnostic. Biomarkers. 2015;20(5):328–337. doi: 10.3109/1354750X.2015.1068867. [DOI] [PubMed] [Google Scholar]
- 27.Walker R. A., Thompson A. M. Prognostic and Predictive Factors in Breast Cancer. London, UK: Informa Healthcare; 2008. [Google Scholar]
- 28.D'Eredita' G., Giardina C., Martellotta M., Natale T., Ferrarese F. Prognostic factors in breast cancer: the predictive value of the Nottingham Prognostic Index in patients with a long-term follow-up that were treated in a single institution. European Journal of Cancer. 2001;37(5):591–596. doi: 10.1016/s0959-8049(00)00435-4. [DOI] [PubMed] [Google Scholar]
- 29.Rampaul R. S., Pinder S. E., Elston C. W., Ellis I. O. Prognostic and predictive factors in primary breast cancer and their role in patient management: The Nottingham Breast Team. European Journal of Surgical Oncology. 2001;27(3):229–238. doi: 10.1053/ejso.2001.1114. [DOI] [PubMed] [Google Scholar]
- 30.Jimenez-Lee R., Ham B., Vetto J., Pommier R. Breast cancer severity score is an innovative system for prognosis. American Journal of Surgery. 2003;186(4):404–408. doi: 10.1016/S0002-9610(03)00283-6. [DOI] [PubMed] [Google Scholar]
- 31.Yanai A., Miyagawa Y., Murase K., et al. Influence of body mass index on clinicopathological factors including estrogen receptor, progesterone receptor, and Ki67 expression levels in breast cancers. International Journal of Clinical Oncology. 2014;19(3):467–472. doi: 10.1007/s10147-013-0585-y. [DOI] [PubMed] [Google Scholar]
- 32.Biglia N., Peano E., Sgandurra P., et al. Body mass index (BMI) and breast cancer: impact on tumor histopatologic features, cancer subtypes and recurrence rate in pre and postmenopausal women. Gynecological Endocrinology. 2013;29(3):263–267. doi: 10.3109/09513590.2012.736559. [DOI] [PubMed] [Google Scholar]
- 33.Loi S., Sirtaine N., Piette F., et al. Prognostic and predictive value of tumor-infiltrating lymphocytes in a phase III randomized adjuvant breast cancer trial in node-positive breast cancer comparing the addition of docetaxel to doxorubicin with doxorubicin-based chemotherapy: BIG 02-98. Journal of Clinical Oncology. 2013;31(7):860–867. doi: 10.1200/JCO.2011.41.0902. [DOI] [PubMed] [Google Scholar]
- 34.Cetin I., Topcul M. Triple negative breast cancer. Asian Pacific Journal of Cancer Prevention. 2014;15(6):2427–2431. doi: 10.7314/APJCP.2014.15.6.2427. [DOI] [PubMed] [Google Scholar]
- 35.Yang C.-H., Chang H.-W., Cheng Y.-H., Chuang L.-Y. Novel generating protective single nucleotide polymorphism barcode for breast cancer using particle swarm optimization. Cancer Epidemiology. 2009;33(2):147–154. doi: 10.1016/j.canep.2009.07.001. [DOI] [PubMed] [Google Scholar]
- 36.Wang T. N., Cheng C. H., Chiu H. W. Predicting post-treatment survivability of patients with breast cancer using Artificial Neural Network methods. Proceedings of the 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2013); July 2013; Osaka, Japan. pp. 1290–1293. [DOI] [PubMed] [Google Scholar]
- 37.Yang C.-H., Lin Y.-D., Chuang L.-Y., Chen J.-B., Chang H.-W. MDR-ER: balancing functions for adjusting the ratio in risk classes and classification errors for imbalanced cases and controls using multifactor-dimensionality reduction. PLoS ONE. 2013;8(11) doi: 10.1371/journal.pone.0079387.e79387 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Yang C.-H., Chuang L.-Y., Chen Y.-J., Tseng H.-F., Chang H.-W. Computational analysis of simulated SNP interactions between 26 growth factor-related genes in a breast cancer association study. OMICS. 2011;15(6):399–407. doi: 10.1089/omi.2010.0028. [DOI] [PubMed] [Google Scholar]
- 39.Chang H.-W., Chuang L.-Y., Ho C.-H., Chang P.-L., Yang C.-H. Odds ratio-based genetic algorithms for generating SNP barcodes of genotypes to predict disease susceptibility. OMICS A Journal of Integrative Biology. 2008;12(1):71–81. doi: 10.1089/omi.2007.0036. [DOI] [PubMed] [Google Scholar]
- 40.Yang C.-H., Lin Y.-D., Yen C.-Y., Chuang L.-Y., Chang H.-W. A systematic gene-gene and gene-environment interaction analysis of DNA repair genes XRCC1, XRCC2, XRCC3, XRCC4, and oral cancer risk. OMICS. 2015;19(4):238–247. doi: 10.1089/omi.2014.0121. [DOI] [PubMed] [Google Scholar]
- 41.Yang C.-H., Chuang L.-Y., Cheng Y.-H., et al. Single nucleotide polymorphism barcoding to evaluate oral cancer risk using odds ratio-based genetic algorithms. Kaohsiung Journal of Medical Sciences. 2012;28(7):362–368. doi: 10.1016/j.kjms.2012.02.002. [DOI] [PubMed] [Google Scholar]
- 42.Chuang L.-Y., Chang H.-W., Lin M.-C., Yang C.-H. Chaotic particle swarm optimization for detecting SNP-SNP interactions for CXCL12-related genes in breast cancer prevention. European Journal of Cancer Prevention. 2012;21(4):336–342. doi: 10.1097/CEJ.0b013e32834e31f6. [DOI] [PubMed] [Google Scholar]
- 43.Chuang L.-Y., Lin Y.-D., Chang H.-W., Yang C.-H. An improved PSO algorithm for generating protective SNP barcodes in breast cancer. PLoS ONE. 2012;7(5) doi: 10.1371/journal.pone.0037018.e37018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Kourou K., Exarchos T. P., Exarchos K. P., Karamouzis M. V., Fotiadis D. I. Machine learning applications in cancer prognosis and prediction. Computational and Structural Biotechnology Journal. 2015;13:8–17. doi: 10.1016/j.csbj.2014.11.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Supplementary Table 1. The expression range of MRE11 in the different groups of breast cancer patients. Supplementary Table 2. The distribution of BMI level in the different groups of ER, PR and HER2 breast cancer patients.