Abstract
Background: Recurrent event data are often encountered in biomedical research, for example, recurrent infections or recurrent hospitalizations for patients after renal transplant. In many studies, there are more than one type of events of interest. We aimed to identify the association between two types of events using multivariate joint modeling and then apply this statistical method in the clinical data set.
Study design: A retrospective cohort study
Methods: Overall, 342 subjects with breast cancer whose records were registered for follow-up in a Cancer Research Center at Shohadaye Tajrish Hospital, Tehran, Iran from 2006 to 2015 were investigated. These patients were monitored for at least 6 months after diagnosis and their latest status were recorded. Joint frailty model was used for modeling the relationship between two types of recurrences with Frailty package in R software.
Results: When the terminal event was considered as death, three-year and five-year survival rates for the patients were 0.79 and 0.68, respectively. Given the results obtained from a fitted joint frailty model, the risk of multiple recurrences (local and metastases) increased for the patients with tumor grades greater than I.
Conclusion: With regard to the significant variance of the frailty component of the metastases event, it can be inferred that patients with the same predictive variables are prone to different levels of metastases risk and, on the other hand, given the low frequency of types of recurrences, caution should be exercised when considering the obtained results.
Keywords: Breast Cancer, Multivariate Analysis, Recurrent Events
Introduction
In the survival analysis literature, different methods were proposed for estimating recurrent events of a type. Conditional models1 and marginal models2 were all presented for analyzing recurrent events of a type. These models are based on modeling a hazard function. Despite the advancement in methods of analyzing data on recurrent events of a type, methods used to analyze recurrent events of several types, including non-homogeneous Poisson’s processes using random and fixed effects with inferential procedures, are all based on the maximum likelihood estimation. Such parametric methods require identifying the correctness of the considered in-person correlation structure which is difficult to achieve for multiple recurrent events. Semi-parametric robust methods are desirable when a correlation structure is not considered. Marginal regression models for multivariate failure time data proposed by Spiekerman and Lin3 (and Aalen, Borgan, and Gjessing4 can be generalized to the analysis of multiple recurrent events5.
Breast cancer after skin cancer is the most prevalent cancer among women6. Besides the high prevalence rate of breast cancer among Iranian women, the facts that 16% of all cancers in Iran are related to breast cancer and that Iranian women, compared to developed countries, developing this disease at least a decade earlier7 double the importance of studying this issue. One of the possible complications of breast cancer after conducting a treatment (surgery) is either metastases or local recurrence of the disease. The primary causes of death in breast cancer are tumor invasion and metastases8,9. Despite significant advances in the diagnosis and treatment of breast cancer, a high mortality rate and incidence of metastases breast cancer in affected women treated by performing a surgery and applying necessary treatments still remain as medical issues10.
Patients with metastases had shorter lifespans compared to other patients6. On the other hand, metastatic recurrence of the disease decreases a patient’s physical and mental dimensions of quality of life. Therefore, recognizing factors affecting the incidence of metastases and examining the relationship between the two types of recurrences, i.e. metastases and local recurrences, among patients with breast cancer is very important in the process of identifying and treating this disease11. Different factors affecting the incidence of metastases have been studiesalready12. However, objectives related to analyzing such recurrent events can include describing the status of recurrent events in people, changing the recurrence rate of a process from a person to another person, and investigating the relationship of fixed dependent variables or time-dependent variables with the occurrence time of recurring events. These objectives can be verified by models associated with analyzing recurrent events. Due to their ability to conduct a simultaneous investigation of two processes of recurrent events and to achieve unbiased and efficient estimates for parameters, in survival analyses, joint models are applied for analyzing follow-up studies including carrying out a simultaneous examination of two survival events13.
The simplest way of analyzing recurrent events is to only consider the first occurrence for each patient and use Cox’s proportional hazards model for just one of the events. This is a direct method and avoids considering complexities such as the effect of the first event on the risk of the occurrence of the next event. Furthermore, only considering the first event is not satisfactory for evaluating the natural history of the disease and examining the effects of therapeutic interventions. Additionally, by the sole consideration of the first event, this kind of analysis does not apply all available data and does not correctly estimate all advantages of performing a therapeutic approach.
Various models have been presented to fit data on recurrent events, which are all essentially generalizations of the Cox’s proportional hazards model. In addition, in studies where several failures occur during the follow-up period, there are always individual factors, which create a correlation between the time of the occurrence of events in the same people and the reason for the differences amongst people (dispersion amongst individuals). Standard survival models, like the Cox’s proportional hazards model, ignore the effects of unobserved individual factors and lead to an incorrect estimation of model parameters. In recent studies, a random component was used to express these unknown factors and correlations amongst the incidence of recorded events in a patient. This random component is known as frailty16. Accordingly, joint modeling is suitable for such a condition since it is able to study two processes at the same time and achieve unbiased and efficient estimates for parameters to analyze several follow-up studies13. On the other hand, people may be exposed to more than one recurrent event during their lifetime with the disease. Since data related to recurrent events have existed in most medical longitudinal studies and, sometimes, more than one type of recurrent events have been considered in these studies, a multivariate joint frailty model was proposed in the current study for analyzing such data and examining hazard functions of various types of recurrent events with respect to the effect of frailty. The complexity of the mentioned modeling was that it simultaneously modeled two types of recurrences, i.e. local and metastases recurrences.
Methods
This study was a retrospective cohort study, in which all patients with breast cancer referred to Shohadaye Tajrish Hospital, Tehran, Iran from 2006 to 2015 were considered as a statistical population. The current study was extracted from an Phd thesis, which was checked and approved by the Ethics Committee of the Tarbiat Modares University of Medical Sciences (IR.TMU.REC.1396.632).
During the abovementioned years, patients with definite breast cancer diagnoses were enrolled and examined in a cancer ward at this hospital as a historic cohort. These patients’ data were collected by the Cancer Research Center of this hospital under the supervision of Shahid Beheshti University of Medical Sciences. Data needed to carry out the present study were extracted from the patients’ medical records and their latest conditions in terms of the recurrence of the disease recorded by this center. An inclusion criterion was considering all patients with definite breast cancer diagnoses who had been followed up at Shohadaye Tajrish Hospital for at least 6 months after their surgeries and an exclusion criterion was regarding cases whose records were incomplete and patients who had been followed up to five months that it means that patients who had less than 6 months follow up were excluded from the study. Finally, by eliminating variables overlapped with the results of the current study, the final sample size was considered 342 patients.
In this study, variables under study were age, diagnosis time, family history of breast cancer, tumor size, levels of the involvement of lymph node removed after surgery, metastases, surgical type, tumor grade, estrogen receptor levels, progesterone receptor levels, undergoing a chemotherapy, the stage of the disease are considered as independent variables and the time until local and metastases recurrences are considered as dependent variables. In this historic cohort study, all patients with definite pathologic diagnoses whose records could be used were enrolled. Alive patients who did not experience any local and metastases at the end of the study and patients who, after a certain period of time, provided no data about their survival status were considered as right-censoring.
In the current study, Using Kaplan-Meier estimator, a median of disease-free survival time (the time till the occurrence of the first surgery is known as disease-free survival time) for breast cancer patients was estimated. The following additive joint frailty model was used for modeling joint recurrent events.
=h1i(t1ij)exp(βT1Z(L)i+ɵ1i)
=h2i(t2ij')exp(βT2Z(D)i+ɵ2i)
In this model, h1(t), h2(t) are basic hazard functions for local and metastases recurrences in ithperson, respectively. Moreover, Z(L) and Z(D) are auxiliary vectors for local and metastases recurrences, respectively. Furthermore, βTa , βTa are vectors for corresponding regression parameters. Parameters specific to each part are bivariate frailties logarithms {(ɵ1i,ɵ2i)}ni=1 which are patient-specific. In this regard, ɵ1i,ɵ2i indicate frailties. These frailties can demonstrate that patients with higher levels of frailty, compared to others, are more prone to the risk of recurrence. The effects of ɵ1i and ɵ2i work on the time of recurrence type 1 (T1 ) and the time of recurrence type 2 (T2 ). Hence, it was assumed that effects of these two types of recurrences were not the same. Finally, a bivariate normal distribution for {(ɵ1i,ɵ2i)} was presented as follows:
Hence, the variance of ui (θ) specifies the dependency between occurrences of the recurrent events of type 1 and the survival and also the interrecurrence dependency. Similarly, the variance of vi (η) specifies the dependency between occurrences of the recurrent events of type 2 and the survival and also the interrecurrence dependency. In the current study, the proposed model was run by the frailtypack in R software version 3.4.1 and estimating the parameters was done by using maximum penalized likelihood estimation.
Results
A total of 342 patients were enrolled. Univariate and multivariate analyses were conducted on these patients. In the current cohort study, a corpus of 342 women with breast cancer was examined. The patients aged 22 to 84 yr with a mean age of 47.84, a standard deviation of 11.75 yr, and a median of 47 years. The median follow-up time was 113 months. Among these 342 patients under study, 87 patients (25.4%) experienced the incidences of recurrences and the other 225 patients (74.6%) did not experience such recurrences. 44 people (12.9%) suffered from stage 1 of the disease, 168 people (49.1%) suffered from stage 2 of the disease, 121 people (35.4%) suffered from stage 3 of the disease, and only 9 people (2.6%) suffered from stage 4 (the most dangerous stage of this disease).
In these patients, the median disease-free survival time was 30.57 months with a minimum of 6 months and a maximum of 187 months. A distribution of the frequency of the independent variables under study was presented in Table 1.
Table 1. The distribution of the frequency of characteristics among the patients with breast cancer .
Variables | Number | Percent |
Family history | ||
None | 233 | 68.1 |
Immediate family member | 52 | 15.2 |
Extended family member | 57 | 16.7 |
Tumor size (mm) | ||
<2 | 72 | 21.1 |
2-5 | 211 | 61.7 |
>5 | 59 | 17.3 |
Stage of the disease | ||
Stage 1 | 44 | 12.9 |
Stage 2 | 168 | 49.1 |
Stage 3 | 121 | 35.4 |
Stage 4 | 9 | 2.6 |
Chemotherapy | ||
Yes | 330 | 96.5 |
No | 12 | 3.5 |
Using Kaplan-Meier estimator, a median of disease-free survival time (the time till the occurrence of the first recurrence after surgery is known as disease-free survival time) for breast cancer patients was estimated to be 30.57 and disease-free one-year, three-year, and 5-year survival rates were 96% (0.01), 79% (0.026), and 68% (0.033), respectively.(Table 2)
Table 2. The disease-free one-year, three-year, and 5-year survival rates of the patients with breast cancer .
Follow-up time (yr) | Survival probability | Standard error |
1 | 0.96 | 0.010 |
3 | 0.79 | 0.026 |
5 | 0.68 | 0.033 |
In this section, the joint frailty model was fitted with an approximated basic hazard function using smoothing methods. The maximum penalized likelihood estimation was applied for estimating the parameters. The maximum likelihood estimation was used for models with a fixed basic hazard function. Given the results obtained from the fitted model, the risk of local and metastases recurrences was higher in the patients with at least one N+ lymph node and/or in the patients with a tumor grade of greater than 1 (HR>1). Moreover, no significant difference was found in terms of the risk of death between the patients who were younger than 40 yr old and those who were older than 60 yr old. However, there was a slightly significant difference in hazard ratio between the patients aged 40 to 60 yr old and the patients older than 60 yr old. The risk of multiple local and metastases recurrences was higher in the patients who were younger than 40 yr old compared to the patients who were older than 60 yr old. Furthermore, the tumor size (>20 mm) had a significant effect on the risk of recurrences (P<0.05). The risk of local recurrence was higher among the patients with HER2+. Besides, the hazard of metastases recurrence was higher for subjects with HER2+ (HR>1). (Table 3)
Table 3. Results of the joint frailty modeling for multiple recurrent events, local recurrence, and metastases recurrence in the breast cancer patients .
Local recurrence | HR | 95% CI |
Age (yr) | ||
>60 | 1.00 | |
≤40 years old | 2.86 | 1.76, 4.64 |
40-60 years old | 1.32 | 0.94, 1.86 |
Tumor grade | ||
I | 1.00 | |
II | 2.79 | 1.53, 5.09 |
III | 4.79 | 1.33, 3.17 |
Tumor size (mm) | ||
<20 | 1.00 | |
>≥20 | 1.61 | 1.15, 2.25 |
HER2+ | ||
Negative | 1.00 | |
Positive | 1.83 | 1.18, 2.82 |
Metastases | HR | 95% CI |
Age (yr) | ||
>60 | 1.00 | |
≤40 years old | 2.81 | 1.31, 6.03 |
40-60 years old | 0.80 | 0.49, 1.29 |
Tumor grade | ||
I | 1.00 | |
II | 1.63 | 1.15, 2.30 |
III | 4.56 | 2.26, 9.20 |
Tumor size (mm) | ||
<20 | 1.00 | |
≥20 | 5.92 | 2.53, 13.86 |
HER2+ | ||
Negative | 1.00 | |
Positive | 2.19 | 1.10, 4.34 |
θ = var(ui ) (SE) | 1.10 | 0.11 |
η = var(vi) (SE) | 7.39 | 0.63 |
Discussion
In the present study, in order to simultaneously consider two recurrent events and to achieve more accurate results, the joint frailty model was used for modeling multiple recurrent events and the maximum penalized likelihood estimation was applied for estimating the hazard functions. This approach is also consistent with informative censoring of recurrent events. The proposed model showed that there was a correlation between the two types of recurrences. This method can also cover the relationship between recurrent events and the terminal event14. This method is better for practical situations and is better and more efficient compared to applying two separated models (having a separate joint frailty model for each type of recurrences). On the other hand, this method also considers the correlation between events and unobserved heterogeneity in data. As inferred from the concept of joint frailty models, a joint frailty component can improve the fitness of a model. In addition, ignoring it when fitting a model can cause an impairment in the fitness of the model. This approach accounts for between events dependencies, interrecurrence dependencies, and nonobserved heterogeneity. As observed in Putter and van Houwelingen in the context of shared frailty models, the latent frailties can pick up anything that improves the fit of the model15. This could be true heterogeneity but also lack of fit of the model without frailties. For instance, the lack of fit of the PHs models can be confused with the presence of heterogeneity, that is, it is difficult to tell whether there is true heterogeneity or whether the PHs assumption is violated16.
We also did the PHs assumption conditionally on frailties in our proposed model. Another advantage of this proposed model is that the effects of various covariates are evaluated by two types of hazard functions. These variables can be independent of time and/or time-dependent. In the application of these models, we concluded that the risk of locoregional recurrences is associated with the risk of metastatic recurrences and the risk of metastatic recurrences is also associated with death. The risk of death is not directly associated with the risk of locoregional recurrence. However, Wapnir et al showed a dependence between locoregional relapses and death17. A major issue of debate in this area of research is whether for death following locoregional relapse, the locoregional relapse is causal (produces additional risk of metastatic spread) versus incidental (in fact, a marker or flag for high-risk disease that may have disseminated already at the time of diagnosis18-20. For example, the reason early locoregional relapse associated with death is that it is indeed a flag for aggressive21, already disseminated disease (and also greater risk of locoregional relapse concurrently), whereas a late locoregional relapse may be just a de novo recurrence found early due to increased screening vigilance, and any disseminated disease has just begun and will not increase mortality risk any time soon.
Generally, there are several reasons for using frailty models to provide time-to-recurrence responses, including achieving an overall possible correlation by applying a bias correction for a regression coefficient in survival analysis and whether one or both types of recurrences can be used as an alternative endpoint. In cases where there was a significant difference in a subgroup of patients, a frailty model can be used to evaluate such heterogeneity in the population under study22. A number of authors have also applied the frailty model to analyze data on breast cancer23.
In the present study, the mean age of the patients was 47.81 yr, which is consistent with findings of other studies carried out in Iran reporting that the mean age of breast cancer patients was between 45 and 50 years24,25. The age distribution of women with breast cancer in Iran indicates that the diagnosis age is lower in Iran compared to that in Western Europe and North America. This means that Iranian women are more likely to suffer from this disease earlier. This was confirmed by a number of studies examined the issue in Iran24,25. The median disease-free survival time in this study was 64 months and the five-yr survival rate for the patients was 68%. In another study23, a disease-free 5-yr lifespan was reported as 77.3% (21). HER+2 in patients was not considered as a prognostic factor for metastases recurrence in the frailty model; however, it can be regarded as a prognostic factor in the recurrence of metastases26. The degree of tumor malignancy was recognized as a significant factor in the prognosis of local and metastases recurrences in the patients, which is in line with other results25showing that patients with the first-degree malignancy had more survival rate than patients with the second-degree and third-degree malignancy. Moreover, during the follow-up period of the patients under study, none of the two events, i.e. death or metastases, was observed in the patients with the first-degree malignancy. The tumor size was proved to be a prognostic factor for patients’ survival rate 27. In the current study, this variable was also significant in the joint model for two types of local and metastases recurrences. The variance in the distribution of frailty in the above model for local recurrence was 1.1, which did not differ significantly with the value of 1 and for metastases recurrence, this value was 7.39, which indicated that only considering the effect of auxiliary variables did not determine the state of recurrence of the disease and individual characteristics were also effective in the recurrence of tumors. In other words, the effect of unknown variables or variables that are not included in the model was also important in predicting metastases recurrences of the disease and these factors, a small part of which are individual characteristics of patients, play significant roles in predicting the patients' statuses. In the Gohari's study 20 the variance of frailty was 0.31 and in the study of carried out by Rondeau23, it was 0.35. This suggested a high degree of non-homogeneity amongst breast cancer patients participating in this study compared to those participating in the studies conducted earlier22,25.
Conclusion
Even the patients with the same explanatory variables presented different risks of metastases recurrence. Similarly, in a sample selected from a large population of women with breast cancer, it was inferred that there was a positive relationship between multiple recurrences among the patients. In other words, the presented model used in the current study for modeling the dataset converged correctly. In this study, a small number of both types of local and metastases recurrences were observed. Therefore, the random effects of ui and vi reflected the relationship between the two types of recurrences rather than the interpersonal dependence of the patients. In this particular case, achieving the independence of the two answers (multiple recurrences) may be difficult. Since this study included a small number of recurrent events, cautions should be exercised when considering the obtained data.
Acknowledgements
The authors would like to thank the Breast Cancer Research Center of Shohadaye Tajrish Hospital for providing access to the data on the patients with breast cancer. This article was extracted from a doctoral thesis presented at the Faculty of Medicine, Tarbiat Modares University. In this way, the authors sincerely thank faculty members and employees of the Faculty of Medicine at Tarbiat Modares University.
Conflict of interest statement
There is no conflict of interest in this study.
Funding
This work was supported by Tarbiat Modares University, faculty of medical science. The collection of cancer data used in this study was supported by Shahid Beheshti Breast Cancer Research Center in Iran.
Highlights
Breast cancer patients with the same predictors are prone to different levels of metastases risk.
By ignoring the relationship between multiple recurrences in the patients with breast cancer, a significant correlation was missed.
According to the results, a simultaneous examination of different types of recurrences leads to the achievement of more accurate results
Citation: Osmani F, Hajizadeh E, Rasekhi AA. Association between Multiple Recurrent Events with Multivariate Modeling: A Retrospective Cohort Study. J Res Health Sci. 2018; 18(4): e00433.
References
- 1.Prentice RL, Williams BJ, Peterson AV. On the regression analysis of multivariate failure time data. Biometrika. 1981;68:373–89. [Google Scholar]
- 2.Wei LJ, Lin DY, Weissfeld L. Regression analysis of multivariate incomplete failure time data by modeling marginal distributions. J Am Stat Assoc. 1989;84:1065–73. [Google Scholar]
- 3.Spiekerman CF, Lin DY. Marginal regression models for multivariate failure time data. J Am Stat Assoc. 1998;93:1164–75. [Google Scholar]
- 4. Aalen O, Borgan O, Gjessing H. Survival and event history analysis: a process point of view. New York: Springer; 2000.
- 5.Osmani F, Hajizadeh E, Mansoori P. Estimation of seasonal effect on the psoriasis recurrence using time dependent coefficient rates model for recurrent events. J Dermatol Cosmetic. 2015;6(1):23–30. [Google Scholar]
- 6.Parkin DM, Bray F, Ferlay J, Pisani P. Estimating the world cancer burden: Globocan 2000. Int J Cancer. 2001;94(2):153–6. doi: 10.1002/ijc.1440. [DOI] [PubMed] [Google Scholar]
- 7.Harirchi I, Karbakhsh M, Kashefi A, Momtahen AJ. Breast cancer in Iran: results of a multi-center study. Asian Pac J Cancer Prev. 2004;5(1):24–7. [PubMed] [Google Scholar]
- 8.Suva LJ, Griffin RJ, Makhoul I. Mechanisms of bone metastases of breast cancer. Endocrinerelated Cancer. 2009;16(3):703–13. doi: 10.1677/ERC-09-0012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Li P, Sun T, Yuan Q, Pan G, Zhang J, Sun D. The expressions of NEDD9 and E-cadherin correlate with metastasis and poor prognosis in triple-negative breast cancer patients. Onco Targets Ther. 2016;9:5751–9. doi: 10.2147/OTT.S113768. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Uría JA, Stahle-Bäckdahl M, Seiki M, Fueyo A, López-Otín C. Regulation of collagenase-3 expression in human breast carcinomas is mediated by stromal-epithelial cell interactions. Cancer Res. 1997;57(21):4882–8. [PubMed] [Google Scholar]
- 11.Lentzsch S, Reichardt P, Weber F, Budach V, Dörken B. Brain metastases in breast cancer: prognostic factors and management. Eur J Cancer. 1999;35(4):580–5. doi: 10.1016/s0959-8049(98)00421-3. [DOI] [PubMed] [Google Scholar]
- 12. Kumar V, Abbas AK, Fausto N, Robbins YC. Patología estructuraly functional. Rio de Janeiro: Elsevier; 2005.
- 13.Aitken S, Thomas J, Langdon S, Harrison D, Faratian D. Quantitative analysis of changes in ER, PR and HER2 expression in primary breast cancer and paired nodal metastases. Ann Oncol. 2010;21(6):1254–61. doi: 10.1093/annonc/mdp427. [DOI] [PubMed] [Google Scholar]
- 14.Mazroui Y, Mathoulin‐Pélissier S, MacGrogan G, Brouste V, Rondeau V. Multivariate frailty models for two types of recurrent events with a dependent terminal event: application to breast cancer data. Biom J. 2013;55(6):866–84. doi: 10.1002/bimj.201200196. [DOI] [PubMed] [Google Scholar]
- 15.Cook R J, Lawless JF. Analysis of repeated events. Stat Methods Med Res. 2002;11(2):141–66. doi: 10.1191/0962280202sm278ra. [DOI] [PubMed] [Google Scholar]
- 16.Liu L, Wolfe RA, Huang X. Shared frailty models for recurrent events and a terminal event. Biometrics. 2004;60(3):747–56. doi: 10.1111/j.0006-341X.2004.00225.x. [DOI] [PubMed] [Google Scholar]
- 17.Wapnir IL, Anderson SJ, Mamounas EP, Geyer Jr CE, Jeong JH, Tan-Chiu E. et al. Prognosis after ipsilateral breast tumor recurrence and loco-regional recurrences in five National Surgical Adjuvant Breast and Bowel Project node-positive adjuvant breast cancer trials. J Clin Oncol. 2006;24(13):2028–37. doi: 10.1200/JCO.2005.04.3273. [DOI] [PubMed] [Google Scholar]
- 18.Heitz F, Rochon J, Harter P, Lueck HJ, Fisseler-Eckhoff A, Barinoff J. et al. Cerebral metastases in metastatic breast cancer: disease specific risk factors and survival. Ann Oncol. 2011;22(7):1571–81. doi: 10.1093/annonc/mdq625. [DOI] [PubMed] [Google Scholar]
- 19.Vahdaninia M, Montazeri A. Breast cancer in Iran: a survival analysis. Asian Pac J Cancer Prev. 2004;5(2):223–5. [PubMed] [Google Scholar]
- 20.Gohari MR, Mahmoudi M, Kazem M, Pasha E, Khodabakhshi R. Recurrence in breast cancer analysis with frailty model. Saudi Med J. 2006;27(8):1187–93. [PubMed] [Google Scholar]
- 21.Mirzaei HR, Hajian S, Mofid B. The role of prognostic factors on breast cancer recurrence in patients at radiation oncology ward in Imam Hossain Hospital. Iranian Quarterly Journal of Breast Disease. 2008;1(2):18–23. [Persian]. [Google Scholar]
- 22.Dawood S, Broglio K, Esteva F, Ibrahim N, Kau SW, Islam R. et al. Defining prognosis for women with breast cancer and CNS metastases by HER2 status. Ann Oncol. 2008;19(7):1242–8. doi: 10.1093/annonc/mdn036. [DOI] [PubMed] [Google Scholar]
- 23.Rondeau V, Mathoulin-Pélissier S, Tanneau L, Sasco AJ, MacGrogan G, Debled M. Separate and combined analysis of successive dependent outcomes after breast-conservation surgery: recurrence, metastases, second cancer and death. BMC Cancer. 2010;10:697. doi: 10.1186/1471-2407-10-697. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Esmaily H, Tayefi M, Doosti H, Nezami H, Amirabadizadeh A. A comparison between decision tree and random forest in determining the risk factors associated with type 2 diabetes. J Res Health Sci. 2018;18(2)):e00412. [PubMed] [Google Scholar]
- 25.Mansouri P, Hajizadeh E, Osmani F. Analysis of risk factors for psoriasis recurrence using proportional rates model. Skin and Stem Cell Journal. 2014;1(3)):e25808. [Google Scholar]
- 26.Vicini F, Kestin L, Huang R, Martinez A. Does local recurrence affect the rate of distant metastases and survival in patients with early-stage breast carcinoma treated with breast-conserving therapy? Cancer. 2003;97:910–9. doi: 10.1002/cncr.11143. [DOI] [PubMed] [Google Scholar]
- 27.Tanis E, van de Velde CJ, Bartelink H, van de Vijver MJ, Putter H, van der Hage JA. Locoregional recurrence after breast-conserving therapy remains an independent prognostic factor even after an event free interval of 10 years in early stage breast cancer. Eur J Cancer. 2012;48:1751–6. doi: 10.1016/j.ejca.2012.02.051. [DOI] [PubMed] [Google Scholar]