Abstract
Survival data often contain tied event times. Inference without careful treatment of the ties can lead to biased estimates. This paper develops the Bayesian analysis of a stochastic wear process model to fit survival data that might have a large number of ties. Under a general wear process model, we derive the likelihood of parameters. When the wear process is a Gamma process, the likelihood has a semi-closed form that allows posterior sampling to be carried out for the parameters, hence achieving model selection using Bayesian deviance information criterion. An innovative simulation algorithm via direct forward sampling and Gibbs sampling is developed to sample event times that may have ties in the presence of arbitrary covariates; this provides a tool to assess the precision of inference. An extensive simulation study is reported and a data set is used to further illustrate the proposed methodology.
Keywords and phrases: Direct forward sampling, Gibbs sampling, jump process, latent variables, proportional hazards model, tied event times
1. Introduction
Tied event times are a common phenomenon in time-to-event studies. For events that only happen at specific points in time, ties occur naturally, and for events that can happen at any point in time, ties may arise when a coarse time scale is used to record data (cf., Rossi, Berk, and Lenihan (1980)). Even when continuous event times are recorded at a fine time scale, ties can occur. Thus, machines in a workshop can stop working instantaneously from a power outage, an abrupt worsening of air quality can cause multiple emergency calls in a short time period, and in a sudden natural or man-made disaster casualties tend to happen at the same time (cf., Gold et al. (2007)). It can be more useful to model observed ties as the outcome of a certain mechanism underpinning the events than to either account for them as artifacts or to ignore them altogether.
Under the Proportional Hazards (PH) model of Cox (1972, 1975), the survival function of a subject with time-invariant covariates is expressed as
| (1.1) |
where T is the failure time, x is a vector of covariates, H is a completely un-specified baseline cumulative hazard function, and β is a vector of regression coefficients. In the non-Bayesian setting, inference from the model uses the partial likelihood of β, which implicitly assumes that the baseline hazard rate H′(t) exists, hence ruling out ties between independent failure times. In practice, in the presence of ties, approximation can be made by applying the formula for the no-tie case or by discretizing time (Cox (1972); Peto (1972); Breslow (1974); Efron (1977)).
Taking H as modeled as a stochastic process provides a powerful way to handle ties. In reliability analysis, Gaver (1963) took H to be a process with independent increments. Reynolds and Savage (1971) studied Gaver’s model in detail and obtained a likelihood function of its parameters and, for the case of Gamma process, several closed form results. However, as Gaver’s model sets β = 0 in (1.1), its primary concern is different from the PH model. Within the Bayesian setting, Dirichlet, Gamma, Beta, beta-Stacy and, more generally, neutral-to-the-right processes have been introduced as priors on H or its transformations (Ferguson (1973); Doksum (1974); Kalbfleisch (1978); Ferguson and Phadia (1979); Hjort (1990); Walker and Muliere (1997); Epifani, Lijoi, and Prünster (2003)), and inference on β can be based on maximum likelihood estimation or Bayesian posterior analysis (Kalbfleisch (1978); Hjort (1990); Damien, Laud, and Smith (1996); Laud, Damien, and Smith (1998); Kim and Lee (2003); Lee and Kim (2004)). Under these priors, tied event times occur with positive probability. On the other hand, a standard Bayesian approach that rules out ties imposes priors on the baseline hazard rate function H′, which leads to continuous H (Antelman and Savage (1965); Reynolds and Savage (1971); Dykstra and Laud (1981); Lo and Weng (1989); Clayton (1991); Ibrahim, Chen, and Sinha (2001); Nieto-Barajas and Walker (2004); James (2005, 2006); Lijoi, Prünster, and Walker (2008b); Peccati and Prünster (2008); Kim and Kim (2009); Kim, Park, and Kim (2011)). In data analysis, tie-breaking has been used to artificially transform tied event times into distinct ones (Kalbfleisch (1978); Chen, Ibrahim, and Shao (2006)). However, the resulting estimate can be seriously biased if the proportion of ties is large (Burridge (1981)).
Following Gaver (1963), we regard H as a hidden stochastic wear process underlying the failures, rather than a parameter with a certain prior distribution. Based on the joint likelihood of β and the parameters of the process H, we establish Bayesian inference and model selection to analyze survival data with ties. The joint likelihood is obtained under a general multivariate process model that associates with each subject a possibly different H. This model unifies the PH model as a limiting case and others, such as the Lévy copula model (Epifani and Lijoi (2010)). We obtain the likelihood of the parameters using an argument similar in spirit to those for several special cases (Reynolds and Savage (1971); Lijoi, Prünster, and Walker (2008a); Epifani and Lijoi (2010)). For homogeneous Gamma wear processes, we derive the likelihood in a semi-closed form. By imposing suitable noninformative priors on β and the parameters of the Gamma process, we can sample from their joint posterior distribution efficiently using Gibbs sampling. While similar methods have been used for posterior sampling of β (Damien, Laud, and Smith (1996); Laud, Damien, and Smith (1998)), the joint sampling appears to be new. With this in place, we propose to use the Bayesian deviance information criterion (DIC) (Spiegelhalter et al. (2002)) to guide the selection of Gamma process models.
We develop a Gibbs sampling-based simulation algorithm, termed the Direct Forward Sampling (DFS), to sample multiple failure times allowing for ties from a homogeneous Gamma process H in the presence of arbitrary values of β and covariates. The sampling is clearly different from posterior sampling, which has failure times already observed, and it does not rely on truncating the Lévy measure or sampling the path of H at pre-selected time points (Damien, Laud, and Smith (1996); Laud, Damien, and Smith (1998); Lee and Kim (2004)). Except for the approximation error of the Gibbs sampling of H just before and at failure times, as in posterior Gibbs sampling (Laud, Damien, and Smith (1998)), our sampling method is precise. In fact, by replacing Gibbs sampling with rejection sampling, exact sampling can be achieved (Chi (2012)).
The rest of the paper is as follows. Section 2 sets up notation. In Section 3 we propose a general multivariate additive process model, derive the likelihood function for the model, and apply it to Gamma wear processes. In Section 4 we describe the DFS algorithm. Section 5 details a Gibbs sampling algorithm for posterior computation. In Section 6 we report on an extensive simulation study to examine the empirical properties of the Gamma wear process model. In this section, we use DIC to guide the choice of parameters. In Section 7 we analyze a prostate cancer data set with our methodology. Section 8 ends with a discussion and potential future research work on this topic. Proofs and a discussion on possible extension to processes other than Gamma processes are given in Supplementary Material.
2. Basic Setup
Suppose n subjects are observed in a time-to-event study. Denote by Ti, Ci, and Yi = min(Ti, Ci), the random failure time, right-censoring time, and endpoint of the ith subject, respectively. We use the corresponding lower-case letters to denote the actual values of the random variables. Thus yi = min(ti, ci) is the observed endpoint for the ith subject, with ti observable if and only if ti ≤ ci. Let δi = I {yi = ti} = I {ti ≤ ci}. The observed data is Dobs = {yi, δi, xi; i ≤ n}, where xi is the vector of covariates of the ith subject. Let
= {i : δi = 1},
= {i : δi = 0}, so
consists of those subjects that fail before censoring, and
those that are censored. Denote by 0 < τ1 < τ2 <···< τN the distinct values of y1, …, yn and τ0 = 0. For j ≤ N, let
| (2.1) |
so
consists of subjects that fail at time τj,
those censored at τj,
those at risk in time interval (0, τj), and
those at risk in time interval (0, τj]. Let nT = |{j :
≠ ∅}| be the number of endpoints where failures occur. For A ⊂ {1, …, n}, take κA = (a1, …, an) with ai = I {i ∈ A}. For brevity, write κi = κ{i}. Let
| (2.2) |
and ϱN+1 = ωN+1 = (0, 0, …, 0). All analyses are conditional on C1, …, Cn.
A stochastic process
= (
(t) : t ≥ 0) is said to be additive if it has independent increments, is stochastically continuous, and with probability 1, the function t →
(t) is right-continuous in t ≥ 0 with
(0) = 0 and has left limit in t > 0. In this paper,
= (H1, …, Hn) is an additive process taking values in
with ℝ+ := [0, ∞), and we refer to
as a pure jump process. It is well known that each Hi in
is nondecreasing and, for
,
| (2.3) |
where given t > 0, φ(ds |t) is a Lévy measure on
with ∫ min(1, |s|) φ(ds |t) < ∞ (Sato (1999)). We refer to Ψ as the characteristic exponent of
. By Ferguson and Phadia (1979),
is homogeneous if Ψ(a, t) = Ψ1(a) Ψ2(t).
Denote by U(0, 1) the uniform distribution on (0, 1), Gamma(a, b) the distribution with density I {x > 0}b−axa−1e−x/b, Exp(c) = Gamma(1, c), and δ the unit mass concentrated at 0. If F is a nondecreasing function on ℝ+, then let F*(z) = inf{t > 0 : F(t) ≥ z} with the convention inf ∅ = ∞.
3. Joint Likelihood for Wear Process Model
3.1. N-variate wear process model
Assume that each of n subjects is exposed to a type of environmental fluc-tuation characterized by a nondecreasing stochastic process Hi with Hi(0) = 0 and Hi(∞) = ∞, such that
= (H1, …, Hn) is a pure jump process and, conditional on
, the failure times T1, …, Tn of the subjects are independent, with
| (3.1) |
We assume
is unobservable. We also assume the right-censoring times C1, … Cn are independent of
and T1, …, Tn. The process
is referred to as a (cumulative) wear process (Gaver (1963); Reynolds and Savage (1971)).
Example 1 (PH model)
In a Bayesian analysis of the PH model, typically there is a univariate pure jump process H such that, conditional on H, T1, …, Tn are independent with P(Ti > t | H) = e−γiH(t), where γi is a constant that may incorporate covariates of the ith subject. Here, H is often referred to as the baseline cumulative hazard function. To account for possible changes over time of the covariates, one might take
, where γi ≥ 0 is a bounded nonrandom function such that
with probability 1. Let
and
= (H1, …, Hn). Since
is H-measurable,
The PH model can thus be formulated as an n-variate model with
the wear process. Let φ0(dx | t) be the Lévy measure of H. For
and t > 0, since
, with λ(t) = a1γ1(t) + ··· + an γn(t), the characteristic exponent of
is
Consequently, the Lévy measure φ(ds |t) of
, where s = (s1, …, sn), is as follows. Given t > 0, if all γi(t) = 0, then φ(ds | t) = 0. On the other hand, if γi(t) > 0 for some i, then
| (3.2) |
Clearly, φ is determined by both φ0 and γ;i. In Bayesian analysis, often only the parameters in γi are estimated, while the parameters of φ0 are regarded as hyperparameters. However, under the n-variate model, this distinction between φ0 and γi disappears, as both become parameters of the wear process
.
Example 2 (Lévy copula)
A Lévy copula survival model was studied by Epifani and Lijoi (2010), in which the subjects are divided into two nonempty groups and a bivariate pure jump process Z = (Z1, Z2) is used as the wear process such that, conditional on Z, the failure times are independent, and for each i = 1, …, n and j = 1, 2, if the ith subject is in the jth group, then P(Ti > t | Z) = e−Zj(t). By letting Hi = Zj, the model becomes an n-variate model. Suppose subject 1 belongs to group 1, subject 2 belongs to group 2 and, for each i > 2, ji is the index of the group subject i belongs to. Then the characteristic exponent and Lévy measure of
= (H1, …, Hn) are
respectively, where φ0 is the Lévy measure of Z.
Example 3 (Independent failure times)
In the above examples, the Hi are dependent processes, making Ti dependent random variables. If the Hi are independent, then the Ti are independent. If the Lévy measure of each Hi is φi(dx | t), then the characteristic exponent and Lévy measure of
are
respectively, where Ψi(ai, t) is the characteristic exponent of Hi.
Under the n-variate model, when the Hi are dependent, the probability of ties among Ti is positive. From (3.1),
so each Ti has a probability density. Then the Ti are dependent. It is noteworthy to mention that Ti are pairwise locally independent as defined by Oakes (1989). Let X, Y > 0 be random variables. For t = (t1, t2), let S(t) = P (X > t1, Y > t2) and Dα = ∂/∂tα. Then is the ratio of the conditional hazard rate of X at t1 given Y = t2, to that of X at t1 given Y > t2. X and Y are called locally independent if .
Proposition 1
T1, …, Tn are pairwise locally independent.
3.2. Likelihood function
The Lévy measure φ can be regarded as the only parameter of
.
Theorem 1
The likelihood function of φ based on Dobs is
| (3.3) |
Kalbfleisch (1978) observed that in the setting of Example 1, if H is a Gamma process, then depending on its variability a spectrum of likelihoods can be obtained. To characterize this in general, write φ(ds|t) = cν(cds|t), with c > 0, where ν(ds|t) is a Lévy measure with support in . Suppose for all i = 1, …, n and t > 0,
| (3.4) |
and σii(t) < ∞, where , j = 1, …, n. Let m(t) = (m1(t), …, mn(t)) and Σ(t) = (σij(t)). Then
Here, c is called a precision parameter; the larger c is, the less variable
is. For us, c is fixed, its value will be determined via model selection, so it is not a part of the parameter to be estimated; see Sections 6–7 for more detail. Whenever c is involved, we rewrite the likelihood as L(ν|c, Dobs).
Proposition 2
If we fit Dobs
to the model
, with Lévy measure cν(cds|t) satisfying (3.4), then, as c →; ∞,
Consider Example 1 again. Suppose φ0(dx|t) = ch(cx, t)dx for x > 0. Letting , it can be seen that . As a result, as c → ∞, the likelihood tends to
and hence it behaves similarly to the one under the PH model. However, whereas the likelihood based on the n-variate model automatically discriminates against ties in this case, the one based on the PH model cannot.
The result implicitly assumes that m is differentiable at every τj with
≠ 0. Following the argument for the existence of probability density of Ti, this indeed holds with probability 1. Here then is some information on the probability of ties for the case of most interest to us.
Proposition 3
Let
be homogeneous such that, for any
, Ψ(a, t) = Ψ1(a)Ψ2(t). Then
| (3.5) |
If
has Lévy measure φ(ds|t) = cν(cds|t) with ν(ds|t) = h(t)λ(ds) satisfying (3.4), where λ is a Lévy measure on
, then as c → ∞, P(Ti all different) → 1.
3.3. A Gamma wear process model
Let
= γH, where γ = (γ1, …, γn) is a constant vector with γi > 0 and H is a homogeneous Gamma process with Lévy measure
with c > 0 being the precision parameter and f = F′. Denote H ~
(cF, c). We refer to the corresponding n-variate model as the Gamma Process (GP) model. The parameters of the model are γ, F, and c, but c will be fixed via model selection and only γ and F will be estimated.
Corollary 1
The likelihood function for the GP model is
| (3.6) |
The proof of (3.6) is quick. As a′
(t) = a′γH(t) ~ Gamma(cF(t), a′γ/c) for
, e−Ψ(a,t) = (1 + a′γ/c)−cF(t). Then the first factor on the right hand side in (3.6) follows from that in (3.3); the second factor follows from that in (3.3) and (3.2).
When the data have no ties, (3.6) can be shown to coincide with (14) in Kalbfleisch (1978). To take ties into account, Kalbfleisch (1978) derived a likelihood of regression coefficients in his (23) which, if expressed in integral form, is a part of the likelihood in (3.6) but with the factor
cf (τj) missing. From Proposition 2, we get the following when c → ∞.
Corollary 2
Given Dobs, let the GP model be fit with
= γH, where γ = (γ1, …, γn) with γi > 0 and H ~
(cF, c). Fixing γ and F, as c → ∞,
Corollary 3
Suppose there is no censoring. Then for any i ≠ j,
Thus, as c → 0, P(Ti all equal) → 1, and as c → ∞, P (Ti all different) → 1.
It should be noted that in general, as the wear process becomes more variable, it is not necessarily true that P(Ti all equal) → 1. For example, let H be a generalized Gamma process with time-independent Lévy density c2h1(cs), where h1(s) = s−α−1e−s, 0 < α < 1 (Hougaard (1986); Brix (1999); Epifani, Lijoi, and Prünster (2003); Lijoi, Mena, and Prünster (2007); Argiento, Guglielmi, and Pievatolo (2010)). Then Ψ1(λ) = (1 + λ/c)α − 1 and, by Proposition 3, as c → 0,
4. Sampling of Survival Data from Gamma Process
Proposition 4
Let F be strictly increasing and α(t) = cF(t). Let G ~
(t, 1) be a standard Gamma process and ηi be i.i.d. Exp(c) random variables independent of G. Then (T1, …, Tn) ~ (α−1(G*(η1/γ1)), …, α−1(G*(ηn/γn))).
Here, since ηi and G are independent, if we can sample G*(θi) for an arbitrary fixed set of θi > 0, then we can sample T1, …, Tn. The result follows from the inversion formula for univariate distributions (Devroye (1986)). The inversion is used by Bender, Augustin, and Blettner (2005) to sample failure times with no ties for the PH model. We next describe how to jointly sample G*(θi) forwardly. For convenience, suppose θi are already sorted in increasing order.
Theorem 2
Let G ~
(t, 1). Given a single θ > 0, the distribution function of G*(θ) is given by
| (4.1) |
and, given G*(θ) = τ, the conditional distribution of G(τ) is
| (4.2) |
where
This enables us to sample G*(θi) for 0 < θ1 < ··· < θn, as follows. First sample τ1 = G*(θ1) from (4.1) and r1 = G(τ1), conditional on τ1, from (4.2). If r1 ≥ θn, then all G*(θi) = τ1. Otherwise, with s the number with θs ≤ r1 < θs+1, G*(θ1) = ··· = G*(θs) = τ1 < G*(θs+1) ≤ ··· ≤ G*(θn). In general, if (τ1, r1), …, (τk, rk) have been sampled but there is s < n such that θs ≤ rk < θs+1, then τk+1 and rk+1 = G*(τk+1) are sampled as follows. First, independently from all (τj, rj), j ≤ k, sample τ̃k+1 ~ G*(θs+1 − rk) from (4.1) and r̃k+1 ~ G(τ̃k+1), conditional on G*(θs+1 − rk) = τ̃k+1, from (4.2). Then τk+1 = G*(θs+1) = τk + τ̃k+1 and rk+1 = rk + r̃k+1. If rk+1 ≥ θn, then all G*(θs+1) = ··· = G(θn) = τk, otherwise, sample the next distinct failure time τk+2 and rk+2. The procedure continues until all G*(θi) are sampled.
Gibbs sampling can be applied to the conditional distribution (4.2). Introduce two latent variables U and V such that 0 < U < θ, V > 0 and, conditional on G*(θ) = τ, G(τ), U, and V have joint density
Let ζ = ln[U/(θ − U)] and denote the conditional joint density of G(τ), ζ, and V by mθ(r, z, v). Using the collapsed Gibbs method (Liu (1994); Chen, Shao, and Ibrahim (2000)), we then sample from, in turn: (i) mθ(z|r), (ii) mθ(v|r, z), and (iii) mθ(r|v). For (i), we have
this can be shown to be a log-concave density with the conditional mode
thus allowing the application of the adaptive-rejection algorithm of Gilks and Wild (1992) to sample ζ conditional on G(τ) = r. For (ii), we have
which is an exponential density with mean [r− θez/(1+ez)]−1. For (iii), mθ(r|v) ∝ e−r(1+v), r > θ, and hence sampling r is also straightforward. We use the following algorithm to generate failure times that may have ties.
Direct Forward Sampling (DFS) Algorithm
Set n (number of failure times), c (precision parameter), and γ1, …, γn (coefficients).
Generate ηi i.i.d. ~ Exp(c) and set θi = ηi/γi for i ≤ n.
Rearrange (γi, θi) so that 0 < θ1 < · · · < θn.
Initialize k = 0, t = 0, and h = 0.
Generate τ, which is a realization of G*(θk+1 − h).
Generate r, which is a realization of G(τ) conditional on G*(θk+1 − h) = τ.
Update t to t + τ.
Update h to h + r.
If h ≥ θn, then G*(θk+1) = · · · = G*(θn) = t. Go to Step 14.
If θk+s ≤ h < θk+s+1 for some 1 ≤ s < n − k, then G*(θk+1) = · · · = G*(θk+s) = t.
Update k to k + s.
Go to Step 5.
Follow Steps 8 through 12 until all G*(θ1), …, G*(θn) are generated.
Return c−1F−1(G*(θi)), the failure times from
(cF, c).
5. Bayesian Posterior Inference
Henceforth, we assume that in the GP model , where xi is the vector of covariates of the ith subject and β the vector of regression coefficients. Our goal is to develop posterior inference for (β, F) given c.
5.1. Prior
We assume a piecewise linear model for F as follows. Partition the time axis into K intervals (a0, a1], (a1, a2], …, (aK−1, aK], where a0 = 0 and aK ≥ τN. Then let f(t) = F′(t) = λk for ak−1 < t ≤ ak. Under our model,
| (5.1) |
Let λ = (λ1, …, λK)′, and for j ≤ N, ν(j) be the unique index with aν(j) − 1 < τj ≤ aν(j). Then, the likelihood function in (3.6) can be rewritten as
| (5.2) |
We assume the prior . Under the prior, β, and λ1, …, λK are independent, with β ~ Np(0, Σ0) and λk ~ Gamma(α0, 1/α1). In Sections 6 and 7, we specify Σ0 = 104Ip and α0 = α1 = 10−2, which lead to a relatively vague prior for (β, λ).
5.2. Posterior computation
To sample the joint posterior distribution
introduce the latent variable s = (sj :
≠ ∅, j ≤ N) and define an augmented joint posterior distribution π(β, λ, s | c, Dobs) ∝ L(β, λ, s | c, Dobs)π(β, λ), where
Since ∫ π(β, λ, s | c, Dobs) ds = π(β, λ | Dobs) by Corollary 1, π(β, λ | c, Dobs) can be sampled by applying Gibbs sampling to π(β, λ, s | c, Dobs). We sample (β, λ, s) from the following, in turn: (i) π(β | λ, s, c, Dobs), (ii) π(λ | β, s, c, Dobs), and (iii) π(s | β, c, Dobs). For (i),
Since , it is easy to show that π(β | λ, s, Dobs) is log-concave in each component of β, and so we can use the adaptive rejection algorithm of Gilks and Wild (1992) to sample β. For (ii), given β and s, λ1, …, λK are conditionally independent and, for each k, the conditional posterior distribution of λk is
Thus, λk follows a Gamma distribution that is easy to sample. For (iii), given β, s1, …, sN are conditionally independent and, for each j with
≠ ∅,
Let uj = ln sj. Then the conditional posterior density of uj is
It is easy to show that π(uj | β, Dobs) is log-concave. Then we again can use the adaptive rejection algorithm to sample uj and set sj = exp(uj).
6. A Simulation Study
We conducted a simulation study to compare the PH model and the GP model with H ~
(cF, c). As the value of c is unknown in practice, to guide the choice of c in fitting the GP model, we use deviance information criterion (DIC) (Spiegelhalter et al. (2002)). Define the deviance function
where ψ = (β′, λ′)′ and L(β, λ | c, Dobs) is given in (5.2). Then
| (6.1) |
where ψ̄ = E[ψ |Dobs] and with . In (6.1), D(ψ̄) measures the goodness-of-fit, and pD is the effective number of model parameters. The DIC is a Bayesian measure of fit or adequacy with 2pD being the dimensional penalty term. The smaller the DIC value, the better the model fits the data. In this simulation study, our second goal was to examine the performance of DIC in correctly identifying c in the fitted the GP model.
In the simulation study, the data were generated as follows. We generated xi = (xi1, xi2)′, i ≤ n, where xi1 ~ N(0, 1), xi2 ~ Bernoulli(0.7) were all independent. We set β = (β1, β2) = (1, −0.5), and F(t) = t, and considered sample sizes n = 250 and 500. We used the DFS algorithm in Section 4 to generate failure times from the GP model with , and for c as 1, 10, and 100. We independently generated n censored times from a rescaled beta distribution such that Ci = 38qi with qi ~ beta(1, 3), which yielded approximately 15% of censored observations for each simulated data set. We independently generated 500 data sets under each simulation setting.
For each data set, we let Ntotal = Σj |
|I {|
| > 1} and Nmax = maxj |
|, where
is defined as (2.1). Figure 1 shows the boxplots of
and Figure 2 shows the boxplots of
for the 500 simulated data sets under the six simulation settings. From Figure 1, we can see that as c increases from 1 to 100,
in the simulated data sets decrease as a whole, and their median drops substantially.
Figure 1.
Boxplots of the total numbers of ties in 500 simulated data sets of sizes n = 250 and n = 500 generated from the GP models with c = 1, 10, and 100.
Figure 2.
Boxplots of the maximum numbers of ties in 500 simulated data sets of sizes n = 250 and n = 500 generated from the GP model with c = 1, 10, and 100.
For each simulated data set, we fit the PH model with a constant baseline hazard rate function and the GP model with F(t) = t; the true value of c was used in the simulation. For each simulated data set, we implemented the Gibbs sampling algorithm of Section 5.2 and used 5,000 Gibbs iterations after a burnin of 500 iterations to compute the posterior estimates. Let β̂jℓ and sdℓ(βj) denote the posterior mean and the posterior standard deviation of βj computed from the ℓth simulated data set for ℓ = 1, …, 500. The simulation posterior estimate (Est), the simulation posterior standard deviation (SD), the simulation error (SE), and the mean squared error (MSE) for βj are, respectively, , and , where βj is the true value. We define the same simulation summary statistics for λ. We let CP denote the coverage probability of the 95% highest posterior density (HPD) intervals that contain the true parameter value in the 500 simulated data sets, using the Monte Carlo method developed by Chen and Shao (1999). Table 1 shows these simulation summary statistics. We see that the GP model generally performed well and the posterior estimates were very close to the true values of β and λ, and the coverage probabilities were close to 95%. Meanwhile, the PH model performed poorly and there were substantial biases in the posterior estimates, especially when c was small. When c = 100, the performance of the PH model improved and the biases of the posterior estimates under the PH model were reduced considerably, but the coverage probabilities were still smaller than the expected 95%, especially for β1 when n = 500.
Table 1.
Summary of posterior estimates for the GP and the PH Models in simulation studies.
| n | Parameter | True c = 1
|
True c = 10
|
True c = 100
|
||||
|---|---|---|---|---|---|---|---|---|
| GP | PH | GP | PH | GP | PH | |||
| 250 | β1 | True | 1 | 1 | 1 | |||
| Est | 1.012 | 0.827 | 1.013 | 0.965 | 1.002 | 0.995 | ||
| SD | 0.096 | 0.070 | 0.085 | 0.072 | 0.078 | 0.073 | ||
| SE | 0.094 | 0.242 | 0.085 | 0.127 | 0.079 | 0.085 | ||
| MSE | 0.009 | 0.089 | 0.007 | 0.017 | 0.006 | 0.007 | ||
| CP | 0.944 | 0.300 | 0.950 | 0.682 | 0.942 | 0.906 | ||
|
| ||||||||
| β2 | True | −0.5 | −0.5 | −0.5 | ||||
| Est | −0.504 | −0.407 | −0.514 | −0.482 | −0.498 | −0.494 | ||
| SD | 0.178 | 0.158 | 0.152 | 0.156 | 0.139 | 0.156 | ||
| SE | 0.157 | 0.176 | 0.142 | 0.158 | 0.128 | 0.144 | ||
| MSE | 0.025 | 0.040 | 0.020 | 0.025 | 0.016 | 0.021 | ||
| CP | 0.974 | 0.894 | 0.962 | 0.956 | 0.966 | 0.970 | ||
|
| ||||||||
| λ | True | 1 | 1 | 1 | ||||
| Est | 1.055 | 0.903 | 1.020 | 0.964 | 1.011 | 1.007 | ||
| SD | 0.225 | 0.116 | 0.135 | 0.123 | 0.113 | 0.128 | ||
| SE | 0.234 | 0.782 | 0.136 | 0.254 | 0.109 | 0.145 | ||
| MSE | 0.057 | 0.619 | 0.019 | 0.066 | 0.012 | 0.021 | ||
| CP | 0.940 | 0.262 | 0.944 | 0.654 | 0.962 | 0.924 | ||
|
| ||||||||
| 500 | β1 | True | 1 | 1 | 1 | |||
| Est | 1.010 | 0.824 | 0.999 | 0.964 | 1.003 | 0.995 | ||
| SD | 0.068 | 0.050 | 0.061 | 0.051 | 0.057 | 0.051 | ||
| SE | 0.071 | 0.244 | 0.063 | 0.129 | 0.055 | 0.062 | ||
| MSE | 0.005 | 0.091 | 0.004 | 0.018 | 0.003 | 0.004 | ||
| CP | 0.938 | 0.184 | 0.948 | 0.532 | 0.964 | 0.892 | ||
|
| ||||||||
| β2 | True | −0.5 | −0.5 | −0.5 | ||||
| Est | −0.501 | −0.400 | −0.511 | −0.489 | −0.508 | −0.500 | ||
| SD | 0.129 | 0.113 | 0.113 | 0.111 | 0.098 | 0.110 | ||
| SE | 0.117 | 0.156 | 0.098 | 0.112 | 0.094 | 0.108 | ||
| MSE | 0.014 | 0.034 | 0.010 | 0.013 | 0.009 | 0.012 | ||
| CP | 0.966 | 0.754 | 0.972 | 0.952 | 0.948 | 0.952 | ||
|
| ||||||||
| λ | True | 1 | 1 | 1 | ||||
| Est | 1.026 | 0.860 | 1.020 | 0.986 | 1.013 | 1.000 | ||
| SD | 0.188 | 0.078 | 0.108 | 0.089 | 0.081 | 0.090 | ||
| SE | 0.190 | 0.597 | 0.102 | 0.263 | 0.079 | 0.112 | ||
| MSE | 0.037 | 0.375 | 0.011 | 0.070 | 0.006 | 0.013 | ||
| CP | 0.940 | 0.200 | 0.970 | 0.498 | 0.956 | 0.870 | ||
To examine the performance of DIC, for each simulated data set, we fit the GP model with c = 1, 10, and 100 when the true c = 1 or 100. When the true c = 10, we fit the GP model with c = 1, 10, 15, and 100. In the DIC computation, we used (3.6) to compute L(β,λ, c |Dobs). Our simulation codes were written in FORTRAN 95 with double precision. The IMSL subroutine DQDAGI was used for evaluating all one-dimensional integrals involved in the likelihood function. For ℓ = 1,…, 500, let DICc,ℓ denote the DIC computed for the ℓth simulated data set. The boxplots of the DIC differences Δℓ(c, c′) = DICc′,ℓ − DICc,ℓ for different values of c′ and c in Figure 3 show that DIC could identify the true GP model correctly for most of the simulated data sets and the DIC differences were quite large when the value of c in the fitted GP model was far from the true c. Even when c in the fitted GP model was close to the true one, for example, when c = 15 in the fitted GP model and the true c = 10, the boxplot shown in Figure 3 is nearly above zero, but with much smaller DIC differences.
Figure 3.
Boxplots of DIC differences in 500 simulations for the data of sizes n = 250 and n = 500 generated from the GP model with c = 1, c = 10, and c = 100.
7. Analysis of Prostate Cancer Data
We considered a subset of the data from a prostate cancer study published by D’Amico et al. (2010), which consisted of 558 patients with high risk prostate cancer, namely, prostate specific antigen (PSA) > 20, clinical Gleason score ≥ 8, or clinical stage T3 or higher. All patients in the subset were treated with radical prostatectomy (RP) between 1989 and 2008. In these data, the response is time to PSA failure or time to the last follow-up from the time of RP, whichever is smaller. The time of PSA failure is the time of prostate cancer recurrence after RP. The clinical implication of PSA recurrence is that men are offered salvage therapy (second treatment), which may prolong life or cure the patient but may have side effects. The covariates include age in years at the date of RP, the logarithm of PSA (logpsa), pathological Gleason score (pGS7 and pGS8H), pathological stage (pT3H), positive surgical margin (Margin), and year of RP. Among these covariates, age, logpsa, and year of RP are continuous, while pGS7 = 1 and pGS8H = 0 if pathological Gleason score was 7, pGS7 = 0 and pGS8H = 1 if pathological Gleason score was 8 or higher, and pGS7 = 0 and pGS8H = 0 if pathological Gleason score was 6 or less; pT3H = 1 if pathological stage was T3 or higher and 0 otherwise; Margin = 1 if the surgical margin was positive and 0 if surgical margin was negative. There are 216 censored and 342 failed patients in the data. The total number of ties is 215 and the maximum size of tied group is 16.
We fit the GP model with the seven covariates (age, logpsa, pGS7, pGS8H, pT3H, Margin, year of RP) to the data. In all the posterior computations, the covariates were standardized. A piecewise linear model was assumed for F(t) in the GP model. The intervals (ak−1, ak] were chosen to be the (100k/K)th percentile of the ordered distinct failure times for k ≤ K. The model parameters included β = (β1,…, β7)′ and λ= (λ1,…,λK)′. We computed DIC and pD under various values of c and K. The values of DIC are plotted in Figure 4. For all the values of c considered, the values of pD range from 12.03 to 12.16 for K = 5, 17.03 to 17.13 for K = 10, and 22.12 to 22.23 for K = 15; these are almost the same as those corresponding numbers of parameters. The GP model with c = 185 and K = 10 attained the smallest DIC value among all of the combinations of (c, K) considered. However, as seen from Figure 4, the DIC values were very close for 170 ≤ c ≤ 200. In fact, for K = 10, the DIC values were 2,939.63, 2,939.61, 2,939.49, 2,939.32, 2,939.40, 2,939.64 for c = 170, 175, 180, 185, 190, 200, respectively. To further verify this finding, we simulated 500 data sets of size n = 558 from the GP model with c = 185 under the simulation setting discussed in Section 6; the resulting median and IQR of Ntotal were 219 and (208, 229), closely matching Ntotal = 215 in the prostate cancer data. In addition, as shown in Figure 4, the GP model with K = 10 clearly outperforms those with K = 5 and K = 15 according to the DIC measure.
Figure 4.
Plots of DIC values versus c with K = 5, 10, 15 for the prostate cancer data.
Under the best DIC GP model with c = 185 and K = 10, we computed the posterior means, posterior standard deviations (SD), and 95% HPD intervals of β. We also fit the PH model with the piecewise linear baseline hazard function with K = 10. Table 2 shows the maximum partial likelihood estimates (MPLEs) and Bayes estimates of β. From Table 2, we see that (i) under the PH model, the Bayes estimates were very close to the MPLEs; (ii) the estimates of β1 and β7 were very similar under the PH and GP models; (iii) the estimates of β2, β5, and β6 under the PH model were slightly smaller than those under the GP model; and (iv) the estimates of β3 and β4 under the PH model were much smaller than those under the GP model. The difference in the estimates of β is expected as there were a large number of ties in the data and the best GP model was the one with c = 185 according to the DIC measure. Also, due to the large value of c, the difference in the estimates of β should not be too large as shown in our simulation study. When the regression coefficients were underestimated, the effects of the covariates could not be accurately assessed, which may lead to an incorrect conclusion regarding the impact of important clinical factors, such as a pathological Gleason score, on the risk of PSA failure.
Table 2.
Estimates of β under the PH and GP Models for the prostate cancer data.
| Method | Variable | Parameter | Estimate | SD* | 95% Interval† |
|---|---|---|---|---|---|
| MPLE | age | β1 | 0.003 | 0.008 | (−0.012, 0.019) |
| logpsa | β2 | 0.282 | 0.066 | (0.152, 0.411) | |
| pGS7 | β3 | 0.461 | 0.178 | (0.113, 0.809) | |
| pGS8H | β4 | 0.916 | 0.177 | (0.570, 1.263) | |
| pT3H | β5 | 0.533 | 0.145 | (0.248, 0.818) | |
| Margin | β6 | 0.532 | 0.121 | (0.296, 0.769) | |
| year of RP | β7 | −0.054 | 0.014 | (−0.082, −0.026) | |
|
| |||||
| Bayes Based on PH Model | age | β1 | 0.003 | 0.008 | (−0.013, 0.019) |
| logpsa | β2 | 0.270 | 0.066 | (0.144, 0.403) | |
| pGS7 | β3 | 0.468 | 0.179 | (0.114, 0.818) | |
| pGS8H | β4 | 0.913 | 0.178 | (0.569, 1.267) | |
| pT3H | β5 | 0.534 | 0.146 | (0.249, 0.823) | |
| Margin | β6 | 0.527 | 0.121 | (0.289, 0.762) | |
| year of RP | β7 | −0.052 | 0.014 | (−0.079, −0.024) | |
|
| |||||
| Bayes Based on GP Model | age | β1 | 0.003 | 0.008 | (−0.012, 0.019) |
| logpsa | β2 | 0.309 | 0.067 | (0.175, 0.437) | |
| pGS7 | β3 | 0.507 | 0.177 | (0.163, 0.854) | |
| pGS8H | β4 | 0.992 | 0.175 | (0.639, 1.329) | |
| pT3H | β5 | 0.553 | 0.144 | (0.278, 0.840) | |
| Margin | β6 | 0.566 | 0.120 | (0.337, 0.806) | |
| year of RP | β7 | −0.053 | 0.014 | (−0.081, −0.025) | |
For MPLE, the values under the SD column are the standard errors of the estimates.
For MPLE, the 95% intervals are the 95% confidence intervals while for Bayes, those intervals are the 95% HPD intervals.
In all the Bayesian computations in this section, we used 50,000 Gibbs iterations after a burn-in of 1,000 iterations to compute the posterior estimates, including DICs, posterior means, posterior standard deviations, and 95% HPD intervals. The convergence of the Gibbs sampling algorithm was checked and the autocorrelations for all model parameters disappeared before lag 5.
8. Discussion
We have carried out an in-depth investigation of the GP model and its properties. Our results are obtained as special cases of a general multivariate wear process model. A novel DFS algorithm and a new Gibbs sampling algorithm have been developed that allow us to generate the tied failure times from the GP model, and to carry out posterior computations. The simulation study of Section 6 revealed some empirical properties of the GP model and the degree of biases of the parameter estimates when fitting the PH model to the data generated from the GP model.
One potential limitation of our analysis is its use of homogeneous Gamma process to model the baseline wear process H. This choice allows us to obtain the joint likelihood in a form explicit enough to achieve several goals, including posterior sampling of parameters and model selection. To our best knowledge, processes such as the Dirichlet and the Beta, do not yield such formulas for the joint likelihood. Furthermore, in S2 of the Supplementary Material, we argue that, under mild conditions, a Beta process is a homogeneous Gamma process plus an independent compound Poisson process with bounded Lévy density. This suggests that our sampling algorithm of failure times can be extended to Beta processes. It also implies that Beta and Gamma processes have similar behavior at small jumps, while the former have more large jumps. Therefore, for data sets that exhibit few large jumps, these two should have similar performance as models for H. In S2, we also comment on how to extend the sampling algorithm to other types of pure jump processes.
In our simulation study and data analysis, we used DIC to determine the value of c when we fit the GP model to survival data with ties. Our simulation study showed that DIC was an effective measure in determining the true value of c. As an extension of this research, one can assume that c is an unknown parameter. With a prior distribution for c, posterior inference needs to be carried out. An unknown c may pose a computational challenge in sampling from its conditional posterior distribution. Theoretically, when there is a large number of ties, the PH model is not appropriate because under the model the probability of tied failure times is zero. When there are no ties in failure times, as shown in Proposition 2, the likelihood function under the GP model converges to the one under the PH model when the fitted wear process is concentrated. In practice, one can fit a GP model to survival data and then determine the “best” value of c according to DIC. When c is large, the PH model might be appropriate for fitting such survival data. Other extensions of the proposed methodology include time-dependent covariates, multivariate failure times, and non-proportional hazards models. These extensions are currently under investigation.
Supplementary Material
Acknowledgments
The authors thank the referees for their careful reviews, an associate editor, and the Editor. A suggestion of one of the referees inspired our development of the multivariate wear process model. The authors thank Dr. Anthony V. D’Amico of Brigham and Women’s Hospital and Dana-Farber Cancer Institute for providing the prostate cancer data and advice on the clinical implication of PSA failure. Dr. Chen’s research was partially supported by NIH grants #GM70335 and #P01CA142538.
Footnotes
The online supplementary material has two sections. Section S1 contains proofs of the theoretical results of the paper. Section S2 is a discussion on possible extension to wear processes other than the Gamma processes considered in the paper.
References
- Antelman G, Savage IR. Characteristic functions of stochastic integrals and reliability theory. Naval Res Logist Quart. 1965;12:199–222. [Google Scholar]
- Argiento R, Guglielmi A, Pievatolo A. Bayesian density estimation and model selection using nonparametric hierarchical mixtures. Comput Statist Data Anal. 2010;54:816–832. [Google Scholar]
- Bender R, Augustin T, Blettner M. Generating survival times to simulate Cox proportional hazards models. Statist Med. 2005;24:1713–1723. doi: 10.1002/sim.2059. [DOI] [PubMed] [Google Scholar]
- Breslow NE. Covariance analysis of censored survival data. Biometrics. 1974;30:89–100. [PubMed] [Google Scholar]
- Brix A. Generalized gamma measures and shot-noise Cox processes. Adv Appl Probab. 1999;31:929–953. [Google Scholar]
- Burridge J. Empirical Bayes analysis of survival time data. J Roy Statist Soc Ser B. 1981;43:65–75. [Google Scholar]
- Chen MH, Shao QM. Monte Carlo estimation of Bayesian credible and HPD intervals. J Comput Graph Statist. 1999;8:69–92. [Google Scholar]
- Chen MH, Ibrahim JG, Shao QM. Posterior propriety and computation for the Cox regression model with applications to missing covariates. Biometrika. 2006;93:791–807. [Google Scholar]
- Chen M-H, Shao Q-M, Ibrahim JG. Monte Carlo Methods in Bayesian Computation. Springer-Verlag; New York: 2000. [Google Scholar]
- Chi Z. Technical Report 28. Department of Statistics, University of Connecticut; 2012. On exact sampling of the first passage event of Lévy process with infinite Lévy measure and bounded variation. Available at arxiv.org with article id 1207.2495. [Google Scholar]
- Clayton DG. A Monte Carlo method for Bayesian inference in frailty models. Biometrics. 1991;47:467–485. [PubMed] [Google Scholar]
- Cox DR. Regression models and life-tables. J Roy Statist Soc Ser B. 1972;34:187–220. [Google Scholar]
- Cox DR. Partial likelihood. Biometrika. 1975;62:269–276. [Google Scholar]
- D’Amico AV, Chen MH, Sun L, Lee WR, Mouraviev V, Robertson CN, Walther PJ, Polascik TJ, Albala DM, Moul JW. Adjuvant versus salvage radiation therapy for prostate cancer and the risk of death. BJU International. 2010;106:1618–1622. doi: 10.1111/j.1464-410X.2010.09447.x. [DOI] [PubMed] [Google Scholar]
- Damien P, Laud PW, Smith AFM. Implementation of Bayesian non-parametric inference based on beta processes. Scand J Statist. 1996;23:27–36. [Google Scholar]
- Devroye L. Nonuniform Random Variate Generation. Springer-Verlag; New York: 1986. [Google Scholar]
- Doksum K. Tailfree and neutral random probabilities and their posterior distributions. Ann Probab. 1974;2:183–201. [Google Scholar]
- Dykstra RL, Laud P. A Bayesian nonparametric approach to reliability. Ann Stat. 1981;9:356–367. [Google Scholar]
- Efron B. The efficiency of Cox’s likelihood function for censored data. J Amer Statist Assoc. 1977;72:557–565. [Google Scholar]
- Epifani I, Lijoi A. Nonparametric priors for vectors of survival functions. Statist Sinica. 2010;20:1455–1484. [Google Scholar]
- Epifani I, Lijoi A, Prünster I. Exponential functionals and means of neutral-to-the-right priors. Biometrika. 2003;90:791–808. [Google Scholar]
- Ferguson TS. A Bayesian analysis of some nonparametric problems. Ann Stat. 1973;1:209–230. [Google Scholar]
- Ferguson TS, Phadia EG. Bayesian nonparametric estimation based on censored data. Ann Stat. 1979;7:163–186. [Google Scholar]
- Gaver DP., Jr Random hazard in reliability problems. Technometrics. 1963;5:211–226. [Google Scholar]
- Gilks WR, Wild P. Adaptive rejection sampling for Gibbs sampling. Appl Statist. 1992;41:337–348. [Google Scholar]
- Gold LS, Kane LB, Sotoodehnia N, Rea T. Disaster events and the risk of sudden cardiac death: a Washington State investigation. Prehosp Disaster Medicine. 2007;22:313–317. doi: 10.1017/s1049023x00004921. [DOI] [PubMed] [Google Scholar]
- Hjort NL. Nonparametric Bayes estimators based on beta processes in models for life history data. Ann Stat. 1990;18:1259–1294. [Google Scholar]
- Hougaard P. Survival models for heterogeneous populations derived from stable distributions. Biometrika. 1986;73:387–396. [Google Scholar]
- Ibrahim JG, Chen M-H, Sinha D. Bayesian Survival Analysis. Springer-Verlag; New York: 2001. [Google Scholar]
- James LF. Bayesian Poisson process partition calculus with an application to Bayesian Lévy moving averages. Ann Stat. 2005;33:1771–1799. [Google Scholar]
- James LF. Poisson calculus for spatial neutral to the right processes. Ann Stat. 2006;34:416–440. [Google Scholar]
- Kalbfleisch JD. Non-parametric Bayesian analysis of survival time data. J Roy Statist Soc Ser B. 1978;40:214–221. [Google Scholar]
- Kim Y, Kim D. Bayesian partial likelihood approach for tied observations. J Statist Plann Inference. 2009;139:469–477. [Google Scholar]
- Kim Y, Lee J. Bayesian analysis of proportional hazard models. Ann Stat. 2003;31:493–511. [Google Scholar]
- Kim Y, Park JK, Kim G. Bayesian analysis for monotone hazard ratio. Lifetime Data Anal. 2011;17:302–320. doi: 10.1007/s10985-010-9181-x. [DOI] [PubMed] [Google Scholar]
- Laud PW, Damien P, Smith AFM. Practical Nonparametric and Semiparametric Bayesian Statistics. Springer; New York: 1998. Bayesian nonparametric and covariate analysis of failure time data; pp. 213–225. [Google Scholar]
- Lee J, Kim Y. A new algorithm to generate beta processes. Comput Statist Data Anal. 2004;47:441–453. [Google Scholar]
- Lijoi A, Mena RH, Prünster I. Controlling the reinforcement in Bayesian non-parametric mixture models. J Roy Statist Soc Ser B. 2007;69:715–740. [Google Scholar]
- Lijoi A, Prünster I, Walker SG. Investigating nonparametric priors with Gibbs structure. Statist Sinica. 2008a;18:1653–1668. [Google Scholar]
- Lijoi A, Prünster I, Walker SG. Posterior analysis for some classes of nonpara-metric models. J Nonparametr Statist. 2008b;20:447–457. [Google Scholar]
- Liu JS. The collapsed Gibbs sampler in Bayesian computations with applications to a gene regulation problem. J Amer Statist Assoc. 1994;89:958–966. [Google Scholar]
- Lo AY, Weng CS. On a class of Bayesian nonparametric estimates. II Hazard rate estimates. Ann Inst Statist Math. 1989;41:227–245. [Google Scholar]
- Nieto-Barajas LE, Walker SG. Bayesian nonparametric survival analysis via Lévy driven Markov processes. Statist Sinica. 2004;14:1127–1146. [Google Scholar]
- Oakes D. Bivariate survival models induced by frailties. J Amer Statist Assoc. 1989;84:487–493. [Google Scholar]
- Peccati G, Prünster I. Linear and quadratic functionals of random hazard rates: an asymptotic analysis. Ann Appl Probab. 2008;18:1910–1943. [Google Scholar]
- Peto R. Contribution to the discussion of paper by D. R. Cox. J Roy Statist Soc Ser B. 1972;34:205–207. [Google Scholar]
- Reynolds DS, Savage IR. Random wear models in reliability theory. Adv Appl Probab. 1971;3:229–248. [Google Scholar]
- Rossi PH, Berk RA, Lenihan KJ. Money, Work and Crime: Experimental Evidence. Academic Press; New York: 1980. [Google Scholar]
- Sato K-I. Lévy Processes and Infinitely Divisible Distributions. Cambridge University Press; Cambridge: 1999. [Google Scholar]
- Spiegelhalter DJ, Best NG, Carlin BP, van der Linde A. Bayesian measures of model complexity and fit. J Roy Statist Soc Ser B. 2002;64:583–639. [Google Scholar]
- Walker S, Muliere P. Beta-Stacy processes and a generalization of the Pólya-urn scheme. Ann Stat. 1997;25:1762–1780. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.




