Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Aug 13;16(8):e0255313. doi: 10.1371/journal.pone.0255313

Competing risk of mortality in association studies of non-fatal events

Petra Buzkova 1,*
Editor: Robert Daniel Blank2
PMCID: PMC8362942  PMID: 34388170

Abstract

In geriatric research of non-fatal events, participants often die during the study follow-up without having the non-fatal event of interest. Cause-specific (CS) hazard regression and Fine-Gray (FG) subdistribution hazard regression are the two most common estimation approaches addressing such competing risk. We explain how the conventional CS approach and the FG approach differ and why many FG estimates of associations are counter-intuitive. Additionally, we clarify the indirect link between models for hazard and models for cumulative incidence. The methodologies are contrasted on data from the Cardiovascular Health Study, a population-based study in adults aged 65 years and older.

Introduction

Many studies use the time to a non-fatal event as their primary outcome. In geriatric research, mortality often precludes individuals from reaching the end of the study and thus possibly prevents primary events from happening. A competing risk event is, by definition, an event that either hinders the observation of the event of interest or modifies the chance that this event occurs. Therefore, death is indeed a competing risk event.

FG subdistribution hazard regression is often the recommended methodology for competing risk scenarios. However, substantial confusion exists about the interpretation of the FG estimates [13]. A systematic review of the use and interpretation of the FG methods, conducted from medical literature in 2015 [2] and coauthored by one of the originators of the FG methodology, found that 91% of papers using FG methodology interpreted its estimates unclearly or incorrectly. This is an alarming state of practice, since incorrect interpretation of estimates may trigger incorrect conclusions and clinical decisions. This review excluded methodologically oriented publications, but even there the FG methodology is misrepresented. For instance, the authors of a paper guiding the use of competing risk methods for death in a gerontology journal incorrectly claim that the FG methodology “adjusts” for the associated risk of competing events [4]. The misuse of the FG methodology may be further encouraged by the fact that implementing FG estimators is extremely easy. There are many papers with high citation counts serving as a guide for clinicians for obtaining the FG estimates using statistical software where functions were build-in for convenience [57]. Some of these guidelines mislead researchers with incorrect interpretations of the estimates, e.g, some authors call FG subdistribution hazard ratios relative risk or incidence rate ratios [6].

The Cardiovascular Health Study (CHS) is ideal for studying the impact of the competing risk of death because 87% of the 5265 participants from the baseline 1992/93 visit died prior to the end of the clinical follow-up of 22 years. Furthermore, 87% of those deaths occurred in participants prior to an incident hip fracture, the event of our interest. A pie chart of the status of the CHS population at the end of the follow-up in Fig 1 shows that while only 13% experienced the primary event of incident hip fracture, 76% suffered from the competing event of death without a prior hip fracture.

Fig 1. Events status.

Fig 1

The 1992/93 CHS population status at the end of follow-up for incident hip fracture on June 30, 2014. 76% of the study participants suffered from the competing event of death.

Table 1, borrowed from a clinical paper [8], further summarized in Fig 2, lists the hazard ratio estimates that were obtained applying the traditional cause-specific Cox regression that censors individuals at death and the FG subdistribution hazard regression [9] in the CHS population. The methods sometimes yielded similar strengths of association, sometimes directionally concordant but quantitatively different strengths of association, and at other times estimates discordant in direction, with the FG subdistribution hazard regression suggesting effects in the opposite direction of well-understood and widely accepted associations [8].

Table 1. Hazard ratio estimates for incident hip fracture, with mortality a competing risk.

Cause-specific hazard FG subdistribution hazard
HR 95%CI p-val HR 95%CI p-val
M1:
5 years of age 1.74 (1.61, 1.87) <0.01 1.16 (1.09, 1.24) <0.01
male 0.62 (0.53, 0.74) <0.01 0.49 (0.41, 0.58) <0.01
black 0.39 (0.29, 0.52) <0.01 0.38 (0.29, 0.51) <0.01
M2s = M1+:
current smoking 1.66 (1.28, 2.14) <0.01 1.17 (0.90, 1.51) 0.24
diabetes 1.19 (0.94, 1.52) 0.15 0.79 (0.62, 1.01) 0.06
cystatin C eGFR* 0.95 (0.89, 1.02) 0.19 1.09 (1.02, 1.17) <0.01

Model M1 is adjusting for demographic factors of age, gender and race. Models M2 are adjusting for the demographic factors and an additional risk factor of smoking, diabetes, and cystatin C-based estimated glomerular filtration rate (eGFR), in separate models.

* per15 ml/min/1.73 m2

Fig 2. Hazard ratios estimates.

Fig 2

Contrasting the magnitudes of the hazard ratio estimates for incident hip fracture between the cause-specific and FG subdistribution approaches.

In this article we study in detail the difference between the cause specific and subdistribution hazard definitions. We explain why we can observe such striking differences between the hazard ratio estimates, and discuss whether we can foresee how the estimates change when we switch the methodologies. We then focus on incidence rates, which are often overlooked. Incidence rates are simple to grasp, and the cause-specific and subdistribution approaches to these statistics clearly demonstrate the conceptual difference between the methodologies. Because it is sometimes suggested that the FG approach estimates cumulative incidence, we will clarify the link between hazard and cumulative incidence. The CHS is uniquely suited for demonstrating differences in these approaches owing to the long follow-up of several decades and the large proportion of now deceased participants.

Hazard

In time to event data, the outcome of interest is not only whether or not an event occurred, but also the time during which an individual was at risk for the event. Hazard is based on fully utilizing time-to-event data. It is defined as the limit of the probability rate of having an event at time t conditional on being at risk at that time. Denote T the time to event, also called failure time, and D the event type. Let us denote the primary event k.

The cause specific hazard at time t for event k is defined as

λkCS(t)=limΔt0P(tT<t+Δt,D=k|Tt)Δt.

Those who have not yet experienced the event of interest or the competing event are at risk at time t. This approach is often called conditional since it conditions on not having had any type of event; (|Tt). If an individual has a competing event, they are censored at that time and removed from the risk set from then on. In our scenario, cause specific hazard for incident hip fracture at time t is defined in the population of alive and hip fracture-free individuals at time t.

The subdistribution (SD) hazard at time t for event k, on the other hand, is defined as

λkSD(t)=limΔt0P(tT<t+Δt,D=k|Tt(T<t,Dk)Δt.

The two definitions differ in the risk sets, that is, in what the probabilities of having an event k at time t condition on. In the subdistribution approach the risk set consists of those who have not yet had any type of event (Tt), and (∪), additionally, of those who had a competing event that preceded time t (T < t, Dk) [10]. This risk set is unnatural, consisting of these two very distinct groups of individuals [9]. In our scenario those groups are a population of alive hip fracture-free individuals and hip fracture-free individuals previously deceased. Thus, at risk are all individuals who have not experienced the event of interest, without regard to the competing event. This approach is called marginal, in contrast to the conditional cause-specific approach. The term “subdistribution”, defining the FG methodology, refers to the distribution of an improper random time variable whose density has an augmented mass at infinity due to competing events [9]. Having a competing event protects an individual indefinitely from experiencing the primary event, in spite of the fact that such an individual is retained in the risk set as if at risk for the primary event.

Both cause-specific and subdistribution hazard approaches typically model their hazard function λ(t) using the same semiparametric Cox model [11]

λ(t)=λ0(t)exp{βTZ},

where Z is a vector of risk factors and λ0 is an unspecified baseline hazard function under Z = 0. The parameters of interest are the βs, the log-hazard ratios.

The partial likelihood function for estimating the cause-specific hazard is

L(β)=i=1n(exp{βTZi}jRiexp{βTZj})I(Di=k), (1)

where we contrast an individual i with an event k to those in the risk set Ri, that is those who are alive and without the primary event at the time of primary event of individual i.

When data are complete, that is, for each individual we observe the primary event or the competing event or the individual reaches the end of the study, the partial likelihood function for estimating the subdistribution hazard is identical to Eq (1) [9], section 3.1. The risk set Ri is however augmented with individuals with competing event prior to the time of primary event of individual i. Indeed, in the complete CHS data, the subdistribution hazard ratio estimates are identical when fitted with traditional Cox regression with an augmentation of the time at risk for individuals with competing event. We note that in the absence of competing events there is no need to augment the risk set and the cause-specific and subdistribution hazards are identical.

With incomplete data, that is when right censoring is present, weights wij are incorporated into the partial likelihood function for subdistribution hazard estimation

L(β)=i=1n(exp{βTZi}jRiwijexp{βTZj})I(Di=k).

The weights are inverse probability of censoring weights, based on a Kaplan-Meier estimate for censoring evaluated at two different time points. Specifically, wij=G(Ti)G(TiTj) where ∧ denotes minimum. The weight is one for all those who are competing event and primary event free at the time of primary event of individual i and wij=G(Ti)G(Tj) for those with competing event before the time of primary event of individual i. These weights are often mistaken for competing event weights, but they do not address the probability of having a primary event for those with competing events. Rather, these weights only re-scale the part of population included in the risk set for competing events to mirror the censoring due to loss of follow-up. Primary events are not added among those with competing events, and time at risk is not shortened in those with competing events.

In the subdistribution risk set, those who have not experienced any type of event are being combined with those who experienced the competing event first. The latter subset is rather different from the former, and often so are their risk factors. We can explain the differences in the methodologies’ estimates we saw with the CHS data by exploring the risk factors of the group of participants who experienced death as a competing risk. In Fig 3, we have added the cause-specific mortality estimates. Competing mortality is positively associated with age, as is incident hip fracture, and thus by augmenting the risk set for hip fracture in the FG approach with competing mortality population, we artificially lower the hazard. With gender the situation is reversed. The competing mortality association with male gender has opposite direction to the hip fracture association, and thus the FG approach suggests a stronger association with hip fracture. Lastly, when there is a lack of association of the competing mortality with black race, the FG and cause-specific approaches provide a similar hazard ratio. The authors of the clinical article further discuss the implausible associations for diabetes and cystatin C-based eGFR observed with FG approach, in contrast to the associations observed in situations when competing death is rare [8].

Fig 3. Hazard ratios estimates.

Fig 3

Contrasting the hazard ratio estimates for incident hip fracture between the cause-specific approach and the FG subdistribution approach. Mortality cause-specific hazard ratio estimate foretells the mutual position of the hazard ratios for incident hip fracture.

To summarize, when the associations between the primary event and a risk factor and the competing event and a risk factor are concordant, then the primary event FG HR will be closer to null than the cause specific HR, and in some situations can even become discordant with the cause specific HR. In the rare situations when the associations between the primary event and a risk factor and the competing event and a risk factor are discordant, then the primary event FG HR will be further from null than the cause specific HR. We note that the ground work for a quantitative link between the FG hazard and cause-specific hazard has been recently laid out [12] and reduction factor has been introduced, representing the proportion of subjects in the FG risk set that has not yet experienced a competing event.

Incidence rate

While hazard takes into account the relative times at which events occurred by considering the different risk sets for each person at their event time, incidence rate only measures the ratio between the number of events and the total time at risk. Because of this, incidence rate is an optimal statistic to show the conceptual difference between the cause-specific and subdistribution FG approaches.

In Table 2 we list the number of events, person-years at risk, and incidence rates along with their confidence intervals calculated using a quasi-Poisson model with offset to account for the time at risk. Competing risks are considered multi-component endpoints and it is often emphasized that all of them need to be analyzed simultaneously [13, 14]. Thus, we add the analysis of mortality in the hypothetical scenario where hip fracture is its competing event. For completeness, we also consider the composite outcome [13, 15] of hip fracture and mortality as well as that of mortality alone.

Table 2. Summary of CS and SD approaches.

Outcome, approach n = 5265 Event count Person-years at risk Incidence rate (IR) 95% CI of IR
Hip fracture, CS 688 59776 11.5 (10.2, 13.0)
Hip fracture, SD 688 107238 6.4 (5.4, 7.6)
Mortality, CS 3979 59776 66.6 (63.4, 69.8)
Mortality, SD 3979 68369 58.2 (55.2, 61.3)
Composite event 4667 59776 78.1 (74.8, 81.5)
Mortality 4580 62207 73.6 (70.6, 76.8)

Incidence rate is per 1000 person-years of follow-up, computed with Poisson model with offset for time at risk.

In the analysis of incident hip fracture, the CS approach and the SD approach have the same number of events (688). However, the SD approach claims almost twice as many person-years at risk than the CS approach because it keeps the 3979 individuals who die before having hip fracture in the risk set until the end of the study. Therefore, the incidence rate, reflecting both the number of events and the person-years at risk, is about half in the SD estimate as compared to the CS estimate.

Similarly, for mortality, the CS and SD approaches use the same number of deaths (3979), but the number of person years at risk is larger in the SD approach owing to those who had a hip fracture, resulting in a smaller incidence rate. In this case, SD adds fewer years to the time at risk compared to the analysis of hip fracture, leading to more similar incidence rate estimates between the SD and CS approaches. Fig 4 further shows the boxplots of years at risk across the approaches. The FG approach for hip fracture inflates the time at risk, with about 87% of individuals reaching the end of the study under this model (alive or dead), while only 10% of study participants were hip fracture free and alive at the end of the study.

Fig 4. Boxplots of years at risk for incident hip fracture and mortality.

Fig 4

Various approaches.

Note that the model of composite outcome has the most events, counting both hip fractures and deaths in those without a hip fracture. The actual mortality model has a larger number of deaths than both the CS and the SD mortality approach because it includes deaths after incident hip fractures.

We can see that in incidence rate, similarly to hazard, the SD approach artificially increases the time at risk by keeping individuals who have already had a competing event as “at risk” until the end of the study. While CS estimates the risks of having hip fracture among living populations, the SD approach estimates the risks of having a hip fracture among both those alive and those who have already died.

From now on, we consider only model M1 with the three demographic risk factors of age, gender, and race. The incidence rate ratios are in the upper part of (Table 3), with hazard ratios for comparison in the lower part.

Table 3. Incidence rate ratios and hazard ratios estimates for incident hip fracture, mortality and composite event in model M1.

Outcome, approach 5 years of age Male Black
IRR 95% CI IRR 95% CI IRR 95% CI
Hip fracture, CS 1.49 (1.35, 1.64) 0.59 (0.46, 0.75) 0.4 (0.26, 0.6)
Hip fracture, SD 1.16 (1.01, 1.33) 0.48 (0.34, 0.69) 0.38 (0.21, 0.69)
Mortality, CS 1.41 (1.35, 1.47) 1.36 (1.23, 1.49) 1.11 (0.98, 1.26)
Mortality, SD 1.3 (1.24, 1.36) 1.45 (1.31, 1.61) 1.21 (1.06, 1.39)
Composite Event 1.42 (1.37, 1.48) 1.21 (1.11, 1.32) 0.99 (0.88, 1.11)
Mortality 1.43 (1.37, 1.48) 1.28 (1.17, 1.4) 1.04 (0.92, 1.16)
HR 95%CI HR 95%CI HR 95%CI
Hip fracture, CS 1.74 (1.61, 1.87) 0.62 (0.53, 0.74) 0.39 (0.29, 0.52)
Hip fracture, SD 1.16 (1.09, 1.24) 0.49 (0.41, 0.58) 0.38 (0.29, 0.51)
Mortality, CS 1.7 (1.65, 1.75) 1.47 (1.38, 1.56) 1.12 (1.03, 1.21)
Mortality, SD 1.36 (1.33, 1.4) 1.54 (1.44, 1.63) 1.25 (1.15, 1.36)
Composite Event 1.7 (1.66, 1.75) 1.31 (1.23, 1.38) 0.99 (0.92, 1.07)
Mortality 1.72 (1.67, 1.77) 1.41 (1.33, 1.49) 1.05 (0.97, 1.14)

We can see similar relationships between incidence rate ratios calculated using the SD and CS approaches as have been discussed for hazard ratios.

Cumulative incidence

It is often claimed that the FG hazard approach estimates hazard ratios that are directly linked to the effect of a risk factor on the cumulative incidence of events. Fig 5 shows the cumulative incidence function (CIF) estimates for the six scenarios.

Fig 5. Estimates of cumulative incidence.

Fig 5

Cumulative incidence functions estimates for incident hip fracture, mortality and composite event.

The dark red curve representing the hip fracture CIF estimate in the CS approach computes the CIF among individuals alive at the time. We see that this curve is higher than the red dashed curve, the hip fracture CIF estimate using the SD approach, where individuals after death are maintained in the sample as hip fracture-free. Thus, while the CIF under the SD approach may be a useful statistic for public health decisions, or prediction, its use for estimating the associations between an individual’s outcome and a risk factor is limited.

Similar observations apply to the blue curves when we estimate the CIF of mortality with incident hip fracture as competing event. The black line is the true mortality CIF estimate. We note that its upper boundary is the composite event CIF (green curve) and its lower boundary is the mortality CIF of the SD approach. The same can be said for hip fracture.

The incident hip fracture and mortality CIF in the subdistribution approach sum up to the composite event CIF. For heterogeneous events such as any non-fatal event and mortality, we find this to be of no actual advantage.

When there is no loss of follow-up, we can directly model the CI under the subdistribution approach. Cumulative hazard is naturally related to the cumulative incidence function through the complimentary −log link [9]. Thus, we model CI at the end of the study with −log(1 − CI) = exp{βT Z}. Table 4 shows these estimates, often called cumulative hazard ratio (CHR) estimates, for model M1 with the demographic risk factors for age, gender, and race. These estimates are indeed similar to the FG hazard ratios, showed at the top part of the table. However, there is not a direct link between the FG hazard ratios and relative changes in CI when modeled directly [2]. To demonstrate that we model the cumulative incidence relative risk (RR) with quasi-Poisson approach, CI = exp{βT Z}. Additionally, we model the cumulative incidence odds ratios (OR), CI1-CI=exp{βTZ}, both at the lower part of Table 4. We see large differences between the hazard ratios and the relative risks and odds ratios, especially in the associations of risk factors with mortality. This is not surprising as one is a hazard and the other two are cumulative risks.

Table 4. The comparison of hazard ratios estimates, cumulative hazard ratios estimates, relative risk estimates, and odds ratios estimates for cumulative incidence for incident hip fracture and mortality in the competing risk setting under the subdistribution approach.

Statistic 5 years of age Male Black
Outcome
log Hazard HR 95% CI HR 95% CI HR 95% CI
Hip fracture 1.16 (1.09, 1.24) 0.49 (0.41, 0.58) 0.38 (0.29, 0.51)
Mortality 1.36 (1.33, 1.4) 1.54 (1.44, 1.63) 1.25 (1.15, 1.36)
log(−log(1 − CI)) CHR 95% CI CHR 95% CI CHR 95% CI
Hip fracture 1.15 (1.07, 1.23) 0.49 (0.41, 0.58) 0.38 (0.29, 0.51)
Mortality 1.3 (1.26, 1.34) 1.45 (1.35, 1.55) 1.26 (1.14, 1.38)
logCI RR 95% CI RR 95% CI RR 95% CI
Hip fracture 1.13 (1.06, 1.2) 0.51 (0.44, 0.6) 0.4 (0.31, 0.52)
Mortality 1.08 (1.07, 1.09) 1.17 (1.14, 1.21) 1.1 (1.06, 1.14)
logit CI OR 95% CI OR 95% CI OR 95% CI
Hip fracture 1.14 (1.07, 1.22) 0.46 (0.39, 0.56) 0.36 (0.27, 0.48)
Mortality 1.47 (1.37, 1.57) 2.04 (1.78, 2.34) 1.55 (1.29, 1.86)

We note that similarly to the link between cumulative incidence and hazard under the subdistribution approach, there is an identical link between the cumulative incidence and hazard under the cause-specific approach in the absence of competing events. In both situations, the link is however indirect; a hazard ratio estimate is only linked to the complimentary −log link of cumulative incidence, and cannot be interpreted as effects of risk factors on the cumulative incidence.

Discussion

The FG subdistribution methodology keeps individuals with competing events in the study, while forever curing them of the primary event. It is thus not suitable when estimating the association between a new biomarker, or drug, and a non-fatal event [3, 8, 13, 16]. In such scenarios, the population of interest is those without the competing event, which is modeled by the cause specific approach. Indeed, application of FG methods to these scenarios can often lead to results that conflict with well-established associations. FG approach doesn’t address missing data problems related to informative censoring due to competing risk, but simply changes the population studied. According to its creators, the approach is “better suited for estimating a patient’s clinical prognoses” [3], a scientific question asked less often. A complication for prognostic applications of the FG methodology is that prognostic models are often developed from data collected decades ago, and as such the effects of death being protective of the primary outcome are overestimated because of increasing life expectancy. Individuals who died in the study and were thus cured of the primary event may currently stay alive and be at risk.

We note that Lunn McNeil approach [17] to competing risk in modeling hazard is sometimes used as an alternative the CS and FG approaches. It is based on the cause-specific approach, and estimates hazard ratios simultaneously for all types of events by augmenting the data, treating other types of events as censoring. It allows for comparison of magnitude of hazard ratios across the types of the events. A drawback is that it assumes independent risk, that is, non-informative censoring due to the other competing events. This assumption of independent risk often limits the use of this methodology. For example, in the CHS study, mortality hazard is likely not independent of incident hip fracture hazard, so any estimates obtained from this approach may be biased and the comparisons between hazard ratios for different types of events may be invalid. Further research is needed into bias of this approach under competing risks and how to modify this approach to provide a valid estimate comparison.

Sometimes, FG methodologies are used because researchers believe that the proportional hazard assumption of Cox regression prevents the CS approach from being valid. However, both FG subdistribution hazard and the cause specific approaches are modeled using Cox regression. If the proportional hazard assumption is violated, the estimator is still well defined: it is the “average hazard” over time [18, 19]. If an average hazard is not of interest, there are two simple ways to address the problem. One approach is to accommodate non-proportional hazards by including interactions between the risk factor and time in the Cox regression model as time-dependent predictors. A second approach is to divide the data into strata based on the value of the risk factor, with each stratum permitted to have a different baseline hazard function.

We now give the correct interpretations for the two methodologies. Cause-specific Cox regression can be fitted in R by using package survival, with coxph function. It estimates the hazard of the primary event in the population free of the primary event and the competing event. To estimate hazard ratios, we contrast a person with a primary event with those without a primary or competing event by the time. In the context of the CHS data, we contrast an alive individual who sustained hip fracture to those alive who have not sustained hip fracture by that time.

FG subdistribution hazard can be estimated in R by using package cmprsk with crr function. It estimates the hazard of the primary events in the population free of the primary event. This population includes those that sustained the competing event. To estimate hazard ratios, we contrast a person with a primary event with those without primary event by that time. We contrast an alive individual who sustained hip fracture to those alive who have not sustained hip fracture by that time augmented with individuals why had died by that time without having a hip fracture. The estimated hazard ratios cannot be interpreted as estimates of the effect of a risk factor on the cumulative incidence of events.

In conclusion, we find that considering the population of interest is critical to choosing the correct methodology. If the population of interest is individuals free of a competing event at a given time, the cause-specific approach should be used. This is commonly the case when death is a competing event, as the clinical interest lies with alive individuals. In such a population, death does not occur by definition, and therefore should not be considered a competing event.

If the population of interest is the entire starting population, but the competing events are non-informative about the risk of primary events, the cause-specific approach should likewise be used. If the population of interest is the entire population, the competing events are informative, and one is interested in what would have happened had the competing event not occurred, simulations should be used with a list of scenarios of the dependence structure between the primary and competing events.

Data Availability

All files are from the Cardiovascular Health Study; https://chs-nhlbi.org/ Data repository is at biolincc.nhlbi.nih.gov/studies/chs/ available to researchers for requests.

Funding Statement

This research was supported by contracts HHSN 268201200036C, HHSN 268200800007C, HHSN 268201800001C, N01HC 55222, N01HC 85079, N01HC 85080, N01HC 85081, N01HC 85082, N01HC 85083, N01HC 85086, and grants U01HL 080295 and U01HL 130114 from the National Heart, Lung, and Blood Institute (NHLBI), with additional contribution from the National Institute of Neurological Disorders and Stroke (NINDS). Additional support was provided by R01AG 023629 from the National Institute on Aging (NIA). A full list of principal CHS investigators and institutions can be found at CHS-NHLBI.org. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Latouche A, Allignol A, Beyersmann J, Labopin M, Fine JP. A competing risks analysis should report results on all cause-specific hazards and cumulative incidence functions. Journal of Clinical Epidemiology. 2013;66(6):648–653. doi: 10.1016/j.jclinepi.2012.09.017 [DOI] [PubMed] [Google Scholar]
  • 2.Austin PC, Fine JP. Practical Recommendations for reporting Fine-Gray Model Analyses for Competing Risk Data. Statistics in Medicine. 2017;36:4391–4400. doi: 10.1002/sim.7501 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Austin PC, Lee DS, Fine JP. Introduction to the Analysis of Survival Data in the Presence of Competing Risks. Circulation. 2016;83:311–321. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Berry SD, Ngo L, Samelson EJ, Kiel DP. Competing Risk of Death: An Important Consideration in Studies of Older Adults. J Am Geriatr Soc. 2010;58(4):783–787. doi: 10.1111/j.1532-5415.2010.02767.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Zhang Z. Survival analysis in the presence of competing risks. Annals of Translational Medicine. 2017;5(3):47. doi: 10.21037/atm.2016.08.62 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Scrucca L, Santucci A, Aversa F. Regression modeling of competing risk using R: an in depth guide for clinicians. Bone Marrow Transplant. 2010;45:1388–1395. doi: 10.1038/bmt.2009.359 [DOI] [PubMed] [Google Scholar]
  • 7.Scrucca L, Santucci A, Aversa F. Competing risk analysis using R: an easy guide for clinicians. Bone Marrow Transplant. 2007;40:381–387. doi: 10.1038/sj.bmt.1705727 [DOI] [PubMed] [Google Scholar]
  • 8.Buzkova P, Barzilay JI, Mukamal KJ. Assessing Risk Factors of Non-Fatal Outcomes Amid a Competing Risk of Mortality: The Example of Hip Fracture. Osteoporosis International. 2019;30:2073–2078. doi: 10.1007/s00198-019-05048-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Fine JP, Gray RJ. A Proportional Hazards Model for the Subdistribution of a Competing Risk. J Am Statistical Association. 1999;94(446):496–509. doi: 10.1080/01621459.1999.10474144 [DOI] [Google Scholar]
  • 10.Gray RJ. A Class of K-Sample Tests for Comparing the Cumulative Incidence of a Competing Risk. Annals of Statistics. 1988;16(3):1141–1154. doi: 10.1214/aos/1176350951 [DOI] [Google Scholar]
  • 11.Cox DR. Regression Models and Life-Tables. Journal of the Royal Statistical Society Series B (Methodological). 1972;34(2):187–220. doi: 10.1111/j.2517-6161.1972.tb00899.x [DOI] [Google Scholar]
  • 12.Putter H, Schumacher M, van Houwelingen HC. On the relation between the cause-specific hazard and the subdistribution rate for competing risks data: The Fine–Gray model revisited. Biometrical Journal. 2020;62(3):790–807. doi: 10.1002/bimj.201800274 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Wolbers M, Koller MT, Stel VS, Jager K, Leffondre K, Heinze G. Competing Risks Analyses: Objectives and Approaches. European Heart Journal. 2014;35:2936–2941. doi: 10.1093/eurheartj/ehu131 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Allignol A, Schumacher M, Wanner C, Drechsler C, Beyersmann J. Understanding competing risks: a simulation point of view. BMC Medical Research Methodology. 2011;11(86). doi: 10.1186/1471-2288-11-86 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Ferreira-Gonzalez I, Permanyer-Miralda G, Busse JW, Bryant DM, Montori VM, Alonso-Coello P, et al. Methodologic discussions for using and interpreting composite endpoints are limited, but still identify major concerns. Journal of Clinical Epidemiology. 2007;60(7):651–657. doi: 10.1016/j.jclinepi.2006.10.020 [DOI] [PubMed] [Google Scholar]
  • 16.Lau B, Cole SR, Gange SJ. Competing risk regression models for epidemiologic data. Am J Epidemiology. 2009;170(2):244–256. doi: 10.1093/aje/kwp107 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Lunn M, McNeil D. Applying Cox regression to competing risks. Biometrics. 1995;51(2):524–532. doi: 10.2307/2532940 [DOI] [PubMed] [Google Scholar]
  • 18.Allison P. Survival Analysis Using Sas®: A Practical Guide. 1st ed. SAS Publishing; 1995. [Google Scholar]
  • 19.Grambauer N, Schumacher M, Beyersmann J. Proportional subdistribution hazards modeling offers a summary analysis, even if misspecified. Statistics in Medicine. 2010;29(7):875–884. doi: 10.1002/sim.3786 [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Robert Daniel Blank

6 May 2021

PONE-D-21-10045

Competing Risk of Mortality in Association Studies of Non-fatal Events

PLOS ONE

Dear Dr. Buzkova,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Reviewer 1 has asked that you include some additional information about the statistical modeling to make your analyses easier to understand by non-specialists.

Please submit your revised manuscript by Jun 20 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Robert Daniel Blank, MD, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

  1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

  1. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

  1. Thank you for stating the following in the Acknowledgments Section of your manuscript:

This research was supported by contracts HHSN268201200036C, HHSN268200800007C,

HHSN268201800001C, N01HC55222, N01HC85079, N01HC85080, N01HC85081,

N01HC85082, N01HC85083, N01HC85086, and grants U01HL080295 and U01HL130114

from the National Heart, Lung, and Blood Institute (NHLBI), with additional

contribution from the National Institute of Neurological Disorders and Stroke (NINDS).

Additional support was provided by R01AG023629 from the National Institute on

Aging (NIA). A full list of principal CHS investigators and institutions can be found at

CHS-NHLBI.org. The content is solely the responsibility of the authors and does not

necessarily represent the official views of the National Institutes of Health.

We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.

Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Please include your amended statements within your cover letter; we will change the online submission form on your behalf.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This paper compares 2 commonly used time-to-event methods: cause specific and subdistribution hazards models applied to studies of non-fatal events. The topic is important, and the manuscript covers well the main points of interest.

I have several comments:

1. In the Introduction, the author stated that one of the main current issue is related to the misuse of terminology when FG subdistribution methodology is used. I indeed agree with the author on this. However, I could not find in the manuscript, any suggestion from the author on an appropriate use of terminology. It would be great, if such a paragraph with appropriate reporting and terminology can be included in the manuscript.

2. A diagram depicting the differences in allocation of person risks between the 2 methodologies would be helpful, particularly for the readers without a strong statistical background. The section on incidence rates is particularly difficult to follow. A clear definition including allocation of events, person-years and deaths should accompany that section.

3. It will also be useful to add a section on the availability and syntaxes for FG methodology in common statistical softwares such as SAS, Stata, R. This section could also include the appropriate use of terminology for reporting in future publication

4. In the discussion, a point is made that FG subdistribution hazard model is generally recommended for clinical prognostic models. However, there can be some limitations. For example, the author may consider commenting on the impact of increasing population’s life expectancy on the validity of prognostic models using competing risk of mortality, particularly that these prognostic models are usually developed in study cohorts collected 2 decades prior to their intended use, when mortality risk was much higher than in the current context.

Reviewer #2: I don't have specific suggestions for the authors.

The manuscript looks like a PFD of a paper. Has this been published before?

Would suggest submitting revision double spaced with line numbers.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Robert Daniel Blank

14 Jul 2021

Competing Risk of Mortality in Association Studies of Non-fatal Events

PONE-D-21-10045R1

Dear Dr. Buzkova,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Robert Daniel Blank, MD, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I thank the author for addressing all my comments. I think that the manuscript is much clearer now. I have no further comments.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Acceptance letter

Robert Daniel Blank

2 Aug 2021

PONE-D-21-10045R1

Competing risk of mortality in association studies of non-fatal events

Dear Dr. Buzkova:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Robert Daniel Blank

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: ReviewersComments_R1.pdf

    Data Availability Statement

    All files are from the Cardiovascular Health Study; https://chs-nhlbi.org/ Data repository is at biolincc.nhlbi.nih.gov/studies/chs/ available to researchers for requests.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES