SUMMARY
Many robust tests have been proposed in the literature to compare two hazard rate functions, however, very few of them can be used in cases when there are multiple hazard rate functions to be compared. In this paper, we propose an approach for detecting the difference among multiple hazard rate functions. Through a simulation study and a real-data application, we show that the new method is robust and powerful in many situations, compared with some commonly used tests.
Keywords: Asymptotically independent, counting process, crossing, survival data
1. Introduction
In survival data analysis, people are often interested in comparing hazard rate functions or survival curves of different treatment groups. In the literature, a large number of tests have been proposed to compare two hazard rate functions. See, for example, the so-called Gρ,γ test statistics introduced by Fleming and Harrington (Fleming and Harrington, 1991) that include the commonly used log-rank test due to Mantel and Haenszel (Mantel and Haenszel, 1959), and the Gehan-Wilcoxon test due to Gehan (Gehan, 1965) as special cases. The Gρ,γ tests are weighted log-rank tests that are based on the weighted sum of the differences between the expected and observed numbers of events in one group at each failure time point. In the Gρ,γ tests, the weights are usually assigned using non-negative values. In different situations, it has been shown that improvement of the Gρ,γ tests can be achieved by choosing appropriate weights (Buyske, Fagerstrom and Ying, 2000; Yang and Prentice, 2010).
In practice, the two hazard rate functions may cross each other. If this is the case, then the Gρ,γ tests would not be optimal and they may even have little or no power at all. To circumvent this limitation, negative weights have been considered and assigned to some failure time points (Moreau et al., 1992; Qiu and Sheng, 2008). In Qiu and Sheng (2008), the authors proposed a two-stage approach to compare two hazard rate functions. In the first stage, they used the log-rank test, which has been shown to be the most powerful test when the hazard rates are proportional (Fleming and Harrington, 1991); in the second stage, a weighted log-rank test with possible negative weights was designed to detect the difference between two hazard rate functions in cases when they crossed each other. An overall p-value was then calculated based on the two test statistics. This two-stage test was shown to be robust and it has a good power to detect the difference between two hazard rate functions regardless whether they cross each other or not. In the literature, some other methods designed specifically for detecting the difference between two crossing hazard rate functions have been proposed either based on other functions (e.g., absolute or squared) of the differences between the two hazard rates or some modeling techniques (Lin and Wang, 2004; Liu, Qiu and Sheng, 2007; Park and Qiu, 2014).
When there are multiple treatment groups, although the log-rank test and the Gehan-Wilcoxon test can be extended and applied, they may have little or no power if the hazard rate functions cross each other. Robust methods with good properties as those of the two-stage approach are highly desirable. However, there is no simple extension of the aforementioned two-stage approach for comparing multiple hazard rate functions. In this paper, we propose a new approach based on a series of asymptotically independent tests. An overall p-value for each test is calculated using a robust p-value combining method.
The rest parts of the paper are organized as follows. In Section 2, we describe the proposed method; in Section 3, through a simulation study, we study the numerical performance of the new test; in Section 4, we illustrate the new test using a real-data application; the paper is concluded with some concluding remarks.
2. Proposed Method
Suppose we have K treatment groups; for group k (k = 1,2, …, K), the survival function of the surviving time, Tik (i = 1,2, …, nk), is Sk(t) = 1 − Fk(t), and the survival function of the censoring time, Cik, is Lk(t) = 1 − Gk(t), where Fk(t) and Gk(t) are the related cumulative distribution functions. Let {t1, t2, ⋯, tD} be the set of D distinct ordered event times in the pooled sample. Define dik as the observed number of events out of Yik individuals at risk in the kth group at time ti (i = 1,2, ⋯, D). Denote di = (di1, di2, ⋯, diK)T, and Yi = (Yi1, Yi2,· ⋯, YiK)T. Let Xik = min (Tik, Cik), , and πk(t) = P(Xik > t) = Sk(t)Lk(t) (k = 1,2, …, K), where I(·) is the indicator function. In this paper, we make the conventional assumption that the surviving times Tik and the censoring times Cik are independent.
To test for the homogeneity of the hazard rate functions among the K groups, we consider the following hypotheses:
H0:S1(t) = S2(t) = ⋯ = SK(t), and
H1: at least one Sk is different than others at some time t.
In the two-sample situation (i.e., K = 2), the un-weighted log-rank test is constructed as follows:
(1) |
where , and w1i = 1 for all i = 1,2, …, D. Under the null hypothesis, U in (1) has an asymptotic standard normal distribution.
The weighted log-rank test statistic considered by (Qiu and Sheng, 2008) is defined as follows.
(2) |
where , the integer part of Dr for any r ∈ [ε, 1 − ε], 0 < ε < 0.5, and , which is an estimate of the quantity
(3) |
where is the estimate of Lt(t) (l = 1,2), is the estimate of the survival distribution S(t) using the pooled samples, , ; m =[Dr], and u = inf [s: min{π1(s), π2(s)} = 0].
Under the null hypothesis, each Vm defined in (2) has an asymptotic standard normal distribution (Qiu and Sheng, 2008). Furthermore, let
(3) |
which is designed specifically for detecting the difference between two crossing hazard rate functions, we have the following result (Qiu and Sheng, 2008):
Lemma 1
Under the null hypothesis, U and Vm for each m, and therefore, U and V, are asymptotically independent.
The sampling distribution of V in (3) under the null hypothesis is hard to derive explicitly since Vm’s are correlated. However, its p-value can be estimated using bootstrap (Qiu and Sheng, 2008).
Next, we want to generalize the statistics U and V to cases with multiple hazard rate functions (i.e., K > 2). To this end, we will obtain K−1 pairs of U and V through comparing two hazard rate functions K−1 times. Specifically, for each k (k=1, 2, …, K−1), we compare two groups, one from the pooled original treatment groups of 1, 2, …, k, and the other is the original group of k+1, and obtain two respective statistics Uk and Vk. For those Uk and Vk, we have the following result.
Theorem 1
Under the null hypothesis, the 2(K−1) statistics, Uk, Vk (k=1, 2, …, K−1) are asymptotically independent.
The proof of Theorem 1 is given in the Appendix. It should be pointed out that when K=2, the two statistics U1 and V1 are the same statistics as in (1) and (3) obtained by the Qiu and Sheng method. Based on the properties of those statistics Uk and Vk, we define some test statistics.
2.1 The U test
Define the test statistic
(4) |
where is the p-value from the test Ui (i = 1,2, ⋯, K − 1), is the inverse function of the cumulative chi-square distribution with degree of freedom (df) 1.
We will call the test UO in (4) the U test. Under the null hypothesis are asymptotically and independently distributed uniformly between 0 and 1. Therefore, under the null hypothesis, UO has an asymptotic chi-square distribution with K – 1 df. Its p-value can be calculated as . The U test is an extension of the two-sample log-rank test and it has similar performance as the multiple-sample log-rank test. When the hazard rate functions are parallel, this test should be powerful.
2.2 The V test
Define the test statistic
(13) |
where is the p-value from the test Vi (i = 1,2, ⋯, K − 1).
We will call the test VO in (13) the V test. From theorem 1, under the null hypothesis Vi are asymptotically independent. Therefore, under the null hypothesis, VO has an asymptotic chi-square distribution with df K−1. Its p-value can be calculated as . The V test is an extension of the weighted log-rank test which is powerful when the hazard rate functions are crossing.
2.3 The UV test
From Theorem 1, under the null hypothesis, Uk, Vk′ (k, k′ = 1,2, ⋯, K − 1) are asymptotically independent. Therefore, we have the following result.
Theorem 2
Under the null hypothesis, the U test and the V test statistics are asymptotically independent.
The proof of Theorem 2 are given in the Appendix.
Based on this result, a test statistic can be constructed as UO + VO. We will call this test the UV test. Under the null hypothesis, the UV test has an asymptotic chi-square distribution with df equals 2(K−1). Therefore, its p-value can be calculated as
It should be pointed out that when K=2, the above UV test is constructed based on the two statistics U and V as obtained by the Qiu and Sheng method. However, the Qiu and Sheng approach obtains the overall p-value from U and V in a different way. Our simulation study (data not shown) indicates that our proposed UV test is usually more powerful than the Qiu and Sheng test when K=2.
3. A Simulation Study
In this section, we conduct a simulation study to demonstrate the performance of the U test, the V test and the UV test. We will compare these methods with the commonly used log-rank (LR) test, and the Gehan-Wilcoxon (GW) test for multiple samples. In this simulation study, we assume there are three treatment groups with hazard rate functions, h1(t), h2(t), and h3(t), respectively. We assume the censoring times are uniformly distributed between 0 and 2. Two different sample sizes are considered: 50 and 100 for each group. The empirical type I error rate and power are estimated based on 1000 replicates using the significance level of 0.05. When the null hypothesis is true, we set h1(t) = h2(t) = h3(t) = 1 to estimate the type I error rate. To estimate the power, we consider the following four cases, as shown in Figure 1: (a) h1(t) = 1, h2(t) = 1.2, h3(t) = 1.5; (b) h1(t) = 1, h2(t) = 1.5, h3(t) = 1 + 0.5t; (c) h1(t) = 1, h2(t) = 1.2, h3(t) = 2t; and (d) h1(t) = 1, h2(t) = 0.5 + t, h3(t) = 2t. Note that, in (a), the three hazard rate functions are parallel; in (b), the three hazard rate functions cross once (beyond time 0); in (c), the three hazard rate functions cross twice; and in (d), the three hazard rate functions cross three times. From (a) to (d), the degree of crossing among the three risk rate functions is in an increasing order.
Figure 1.
Four sets of hazard rate functions used in the simulation study for power estimation.
Table 1 reports the empirical type I error rate and power for each method considered in the simulation. From Table 1, we can see that the U test, the V test and the proposed UV test all control the type I error rate quite well. We also observe that the U test has similar performance to that of the LR test, because they are both extensions of the two-sample LR test in different ways. When there are no or very few crossings among the hazard rate functions (e.g., cases (a) and (b)), the V test has no or little power; therefore, the proposed UV test has slightly lower power than the U test. However, when there are more crossings (e.g., cases (c) and (d)), the V test can be very powerful while the LR and GW tests lose power dramatically. From this simulation example, it can be seen that the U, LR and GW tests are powerful when there are no or few crossings, the V test is powerful when there are more crossings, and the UV test is always close to the best test in all cases considered. Therefore, the UV test is robust to different patterns of the hazard rate functions. It should be pointed out that in the simulation study, we simply use the number of crossing to indicate the degree of crossing. However, the performance of the V test, and the UV test may also depend on when and how the crossing take place.
Table 1.
Empirical type I error rate and power of each method obtained from 1000 replicates with nominal significance level of 0.05.
Sample size | Test | Type I error rate | Power
|
|||
---|---|---|---|---|---|---|
(a) | (b) | (c) | (d) | |||
n1 = n2 = n3 = 50 | U | 0.048 | 0.281 | 0.289 | 0.132 | 0.044 |
V | 0.043 | 0.036 | 0.079 | 0.845 | 0.721 | |
UV | 0.047 | 0.187 | 0.244 | 0.832 | 0.628 | |
LR | 0.048 | 0.273 | 0.310 | 0.185 | 0.066 | |
GW | 0.052 | 0.235 | 0.268 | 0.449 | 0.215 | |
| ||||||
n1 = n2 = n3 = 100 | U | 0.047 | 0.545 | 0.495 | 0.301 | 0.072 |
V | 0.036 | 0.049 | 0.137 | 0.995 | 0.965 | |
UV | 0.054 | 0.431 | 0.464 | 0.995 | 0.935 | |
LR | 0.051 | 0.533 | 0.521 | 0.349 | 0.092 | |
GW | 0.053 | 0.469 | 0.479 | 0.777 | 0.356 |
4. A Real Data Example
In this section, we apply the proposed test to a real data set from the randomized, double-blinded Digoxin Intervention Trial (The Digitalis Investigation Group, 1997). In the trial, patients with left ventricular ejection fractions of 0.45 or less were randomly assigned to digoxin (3397 patients) or placebo (3403 patients) groups. A primary outcome was the mortality due to worsening heart failure. Figure (a) plots the Kaplan-Meier curves for the two treatment groups.
Figure 2.
Kaplan-Meier curves for the two treatment groups (plot (a)) and the four treatment by gender groups (plot (b)).
In the original study, the authors used the LR test and obtained a p-value of 0.06, indicating that the evidence of the effectiveness of digoxin, in terms of reducing the mortality due to worsening heart failure, is at most marginal. However, based on the above Kaplan-Meier curves, the proportional hazard rates assumption made in the LR test may not be valid, and tests other than the LR should be considered. In fact, we obtain p-values from other methods as shown in Table 2 (a). The p-value from the UV test is 0.021; there is a relatively stronger evidence to support the effectiveness of the drug.
Table 2.
P-values from various tests when compare (a) two groups (placebo, drug), (b) compare four groups (male placebo, male drug, female placebo, and female drug); (c) two groups (male placebo, male drug), and (d) two groups (female placebo, female drug).
Data used | U | V | UV | LR | GW |
---|---|---|---|---|---|
(a) P vs. D | 0.061 | 0.040 | 0.021 | 0.061 | 0.050 |
(b) M-P, M-D, F-P, F-D | 0.11 | 0.0083 | 0.0070 | 0.11 | 0.092 |
(c) M-P vs. M-D | 0.019 | 0.026 | 0.0054 | 0.019 | 0.014 |
(d) F-P vs. F-D | 0.66 | 0.69 | 0.84 | 0.66 | 0.66 |
We then consider the possible interaction between the treatment and gender. Table 3 summarizes the data for the four groups. Figure 2 (b) plots the Kaplan-Meier curves for the four groups, which clearly shows that the LR test is not optimal as the proportional hazard rates assumption is violated. Table 2 (b) reports the p-values from different tests. Both the V test and the UV test obtain very small p-values. It is then interesting to compare the two treatments among male patients: M-P vs. M-D. Table 2 (c) gives the p-values from various tests. The p-value from the UV test is 0.0054; there is strong evidence that the drug is effective among male patients. Finally, we compare the treatments among female patients; the p-values from all the methods considered are shown in Table 2 (d). All tests obtained large p-values; there is no evidence from the data to support the effectiveness of the drug for female patients, although it is noticeable that there were much fewer female patients in the study.
Table 3.
Death due to worsening heart failure by treatment and gender.
Group | Yes (%) | No (%) | Total |
---|---|---|---|
male-placebo (M-P) | 358 (13.6) | 2281 (86.4) | 2639 |
male-drug (M-D) | 300 (11.4) | 2342 (88.6) | 2642 |
female-placebo (F-P) | 91 (11.9) | 673 (88.1) | 764 |
female-drug (F-D) | 94 (12.5) | 661 (87.5) | 755 |
5. Discussion and Conclusion
In this paper we extend the two-sample LR test to multiple samples and call this extension the U test. The U test has similar performance as the traditional LR test, and therefore, it is powerful when the hazard rate functions are parallel. We also proposed another test, called the V test, which is designed specifically for the situation when the hazard rate functions cross each other and when the U test fails. The proposed UV test is a robust approach that combines information from the U test and the V test in an efficient way. If we have information about the hazard rate functions prior to seeing the data, we can use the U test, or the V test only when it is appropriate. For example, if the alternative hypothesis is directional, S1(t) ≥ S2(t) ≥ ⋯ ≥ SK(t) (or S1(t) ≤ S2(t) ≤ ⋯ ≤ SK(t)), the one-sided p-values obtained based on the test statistics Uk(k = 1,2, ⋯, K − 1) can be used to obtain an overall p-value. However, if this kind of information is unavailable, the proposed UV test would be a good choice.
In each of the U, V and UV tests, we choose to combine the related p-values using the chi-square distribution with df 1 as this method is robust (Chen, 2011; Chen and Nadarajah, 2014). Although other robust methods of combing p-values, such as the Fisher test (Fisher, 1932), are also possible, the weighted z tests are not recommended here since they are not robust and may lose power dramatically in some situations. In addition, for the UV test, we can combine the two p–values from the U and V tests, namely, PU and PV, with different df values dfU and dfV, i.e., . If we know that the hazard rate functions are mainly parallel, we can assign a large number for dfU and a relatively small number for dfV. On the other hand, if the hazard rate functions are dominated by the crossing, we can assign a small number for dfU and a large number for dfV. When dfU = dfV = K−1, it is the proposed UV test.
In summary, the UV test proposed in this paper is a flexible and robust approach, which has been confirmed by a simulation study and a real data application. More specifically, we have shown that this approach has good performance in terms of controlling the type I error rate and the detecting power. In some situations, the gain in power is substantial compared with other commonly used methods, such as the LR test and the GW test.
Acknowledgments
The authors are grateful to editor Professor Yi-Hau Chen for his helpful comments and suggestions that lead to improvement of the paper. The first author also acknowledges the support from the internal research funds awarded by Indiana University School of Public Health-Bloomington.
APPENDIX
For the proofs, first, we define the following statistics:
(A.1) |
(A.2) |
where k = 1,2, …, K − 1, , Dk is the total number of distinct failure times from groups 1,2, …, k + 1, and are suitable weight functions defined as follows.
, for i=1,.2,…, Dk, and
(A.3) |
where
(A.4) |
Fk+(t) = 1 − Sk+(t) is the cumulative distribution function of the survival time using the pooled data from groups 1,2, …, k + 1; , , mk = [Dkrk], and uk = inf[s : min{πk1(s), πk2(s)} = 0]. Note that the wights defined in (A.3) and (A.4) are analogous to those defined in (2) and (3).
For the covariance between and , we have the following major result.
Lemma 2
If k ≠ k′, , for l,l′ = 1,2 and k,k′ =1,2, …, K − 1
Proof of Lemma 2
First we define the following counting processes:
To simplify the notation, for given rk, we use wk:l to denote . For the statistic , where l = 1,2, k = 1,2, …, K – 1, it can be shown that
where and martingale .Therefore, , where
Without loss of generality, in this proof we assume k < k′. With the weight functions wk:l(t) and wk′:l′(t) defined as in (A.3), it is easy to check that the required conditions in theorem 2.6.2 of Fleming and Harrington (Fleming and Harrington, 1991) are met; therefore, based on that theorem, the covariance between Zlk(wk:l;t) and Zl′k′(wk′:l′;t) can be expressed as:
Therefore, .
But,
Finally, let uk,k′ = inf [s: min{πk1(s), πk2(s), πk′1(s), πk′2(s)} = 0], covariance cov(Zlk, Zl′k′) = cov{Zlk(uk,k′), Zl′k′(uk,k′)} = 0 when k = k′.
Proof of theorem 1
Note that
(A.5) |
where , Yk:i1 = Yi(k+1), , Yk:i = Yk:i1 + Yk:i2, .
And
(A.6) |
where ,
(A.7) |
and is the K-M estimate of the survival function for censoring time using the (k+1)th sample, and is the K-M estimate of the survival function for censoring time using pooled sample from groups 1, 2, …, k and is the K-M estimate of the survival function for survival time using pooled sample from groups 1, 2, …, k + 1.
We have the following result for in (A.7) (Qiu and Sheng, 2008): it convergences in probability to
(A.8) |
The quantity defined in (A.8) is analogous to that in (3).
This part can be proved in the same way as the proof of lemma 1.
-
From Corollary 7.2.1 in Fleming and Harrington (Fleming and Harrington, 1991), see also Appendix A in Qiu and Sheng (Qiu and Sheng, 2008), we know that under the null hypothesis has an asymptotic standard normal distribution, and convergences to 1 in probability, where .
From lemma 2, we also have cov(Z1k, Z1k′) = 0 for k ≠ k′. Therefore , and Uk and Uk′ (k, k′ = 1,2,…,K – 1, k ≠ k′) are asymptotically independent.
For any k ≠ k′, as in (ii), it can be shown that under the null hypothesis and are asymptotically independent. Notice that , based on theorems 18.10, and 18.11 in van der Vaart (Van der Vaart, 1998),we have under the null hypothesis Vk and each , are asymptotically independent. Similarly, under the null hypothesis Vk, and each are asymptotically independent. Therefore, under the null hypothesis Vk and Vk′ are asymptotically independent.
For any k ≠ k′, as in (ii), it can be shown that under the null hypothesis Uk and each are asymptotically independent. Therefore, again by theorems 18.10, and 18.11 in van der Vaart (Van der Vaart, 1998), under the null hypothesis Uk and Vk, are asymptotically independent.
Proof of theorem 2
Under the null hypothesis, the U test is the sum of K – 1 asymptotically independent chi-square distributions each with df 1; and the V test is the sum of another K – 1 asymptotically independent chi-square distributions each with df 1. The two sets of chi-square distributions are mutually asymptotically independent, therefore, under the null hypothesis, the U test and the V test statistics are asymptotically independent.
References
- Buyske S, Fagerstrom R, Ying Z. A class of weighted log-rank tests for survival data when the event is rare. Journal of the American Statistical Association. 2000;95:249–258. [Google Scholar]
- Chen Z. Is the weighted z-test the best method for combining probabilities from independent tests? Journal of Evolutionary Biology. 2011;24:926–930. doi: 10.1111/j.1420-9101.2010.02226.x. [DOI] [PubMed] [Google Scholar]
- Chen Z, Nadarajah S. On the optimally weighted z-test for combining probabilities from independent studies. Computational statistics & data analysis. 2014;70:387–394. [Google Scholar]
- Fisher RA, editor. Statistical Methods for Research Workers. Edinburgh: Oliver and Boyd; 1932. [Google Scholar]
- Fleming TR, Harrington DP. Counting processes and survival analysis. New York: Wiley; 1991. [Google Scholar]
- Gehan EA. A generalized Wilcoxon test for comparing arbitrarily singly-censored samples. Biometrika. 1965;52:203–223. [PubMed] [Google Scholar]
- Lin X, Wang H. A new testing approach for comparing the overall homogeneity of survival curves. Biometrical Journal. 2004;46:489–496. [Google Scholar]
- Liu K, Qiu P, Sheng J. Comparing two crossing hazard rates by Cox proportional hazards modelling. Statistics in Medicine. 2007;26:375–391. doi: 10.1002/sim.2544. [DOI] [PubMed] [Google Scholar]
- Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies. J natl cancer inst. 1959;22:719–748. [PubMed] [Google Scholar]
- Moreau T, Maccario J, Lellouch J, Huber C. Weighted log rank statistics for comparing two distributions. Biometrika. 1992;79:195–198. [Google Scholar]
- Park KY, Qiu P. Model selection and diagnostics for joint modeling of survival and longitudinal data with crossing hazard rate functions. Statistics in Medicine. 2014;33:4532–4546. doi: 10.1002/sim.6259. [DOI] [PubMed] [Google Scholar]
- Qiu P, Sheng J. A two-stage procedure for comparing hazard rate functions. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 2008;70:191–208. [Google Scholar]
- The Digitalis Investigation Group. The effect of digoxin on mortality and morbidity in patients with heart failure. N Engl J Med. 1997;336:525–533. doi: 10.1056/NEJM199702203360801. [DOI] [PubMed] [Google Scholar]
- Van der Vaart AW. Asymptotic statistics. Cambridge university press; 1998. [Google Scholar]
- Yang S, Prentice R. Improved Logrank Type Tests for Survival Data Using Adaptive Weights. Biometrics. 2010;66:30–38. doi: 10.1111/j.1541-0420.2009.01243.x. [DOI] [PMC free article] [PubMed] [Google Scholar]