ABSTRACT
Correlated survival data are prevalent in various clinical settings and have been extensively discussed in the literature. A common example is clustered survival data, where survival times are associated due to shared characteristics within clusters. In our study, we analyze invasive mechanical ventilation data collected from multiple intensive care units (ICUs) across Ontario, Canada. Patients within the same ICU exhibit similarities in clinical profiles and mechanical ventilation settings, leading to a correlation in their ventilation durations. To address this association, we introduce a shared frailty log‐logistic accelerated failure time model that accounts for intra‐cluster correlation through a cluster‐specific random intercept. We present a novel, fast variational Bayes (VB) algorithm for parameter inference and evaluate its performance using simulation studies varying the number of clusters and their sizes. We further compare the performance of our proposed VB algorithm with the h‐likelihood method and a Markov Chain Monte Carlo (MCMC) algorithm. The proposed algorithm delivers satisfactory results and demonstrates computational efficiency over the MCMC algorithm. We apply our method to ICU ventilation data from Ontario to investigate the ICU‐site random effect on ventilation duration.
Keywords: clustered survival data, ICU ventilation, random effects, variational inference
1. Introduction
Correlated survival data are commonplace in various research contexts and have been extensively studied in the literature [1, 2, 3]. One such context of correlated survival data is observed in clustered survival data, which are derived from multiple entities such as families or hospitals. Within each cluster, survival data exhibit correlation due to shared environmental factors, primarily cluster‐level characteristics such as hospital type (e.g., public or private hospitals in the US, teaching or non‐teaching hospitals in Canada). Random effects are commonly introduced to capture these shared characteristics and to model unmeasured heterogeneity between clusters that cannot be directly accounted for by cluster‐level covariates. Conditional on the random effects (frailty), the survival times within a cluster can be assumed independent, which leads to a shared frailty model to account for cluster‐level uncertainty [4, 5, 6].
Our research is motivated by data from intensive care units (ICUs) across multiple clinical centers in Ontario, Canada. The ICU data were provided by the Critical Care Information System (CCIS) Ontario database. In Canadian ICUs, invasive mechanical ventilation is prevalent, with approximately one‐third of patients requiring ventilation during their ICU stay [7]. The duration of ventilation has significant implications for clinical outcomes and is associated with an increased risk of complications [7]. Analysis on the ventilation duration for ICU patients utilizing the associated risk factors, such as patient categories (e.g., medical or surgical), admission diagnoses, and patient severity, can provide insights into interventions and treatments that may reduce time‐to‐extubation from initiation. Such insights can indirectly support capacity planning and effective clinical resource management by optimizing the allocation of ventilator‐equipped beds. The severity of patients in ICU is often assessed using the Multiple Organ Dysfunction Score (MODS) [8] that evaluates organ function. Kobara et al. [9] conducted a study on ventilation duration for ICU patients from Ontario using a survival analysis framework. In their study, patient ventilation duration is considered as a time‐to‐event (survival) outcome and parametric accelerated failure time (AFT) models are applied to predict the ventilation time. If a patient is transferred to another facility without subsequent follow‐up information, the ventilation time is considered right censored. Kobara et al. found that the log‐logistic AFT model well describes the association between risk factors and patients' ventilation duration in Ontario ICUs. However, Kobara et al. did not consider a possible correlation of ventilation duration times among patients within the same ICU. Previous studies have indicated that patient outcomes within the same ICU site may be correlated, and ignoring this hierarchical structure can result in flawed prediction models [10, 11].
As aforementioned, shared frailty can be used to accommodate cluster‐level association among patients within the cluster. Gorfine and Zucker [6] recently provided a comprehensive review of shared frailty methods for complex survival data. To incorporate risk factors in survival data, the Cox proportional hazards (PH) model with a multiplicative shared frailty on the hazard rates has been widely developed [6]. As an alternative to the Cox PH model, AFT models offer an intuitive interpretation of covariate effects on survival time. Lambert et al. [12] developed shared frailty AFT models with different parametric distributions assumed for the survival time and conducted maximum likelihood estimation by integrating out the unobserved frailties. They empirically found that the choice of distribution for the shared frailty is not critical, recommending the normal distribution. Do Ha et al. [13, 14] considered a shared frailty log‐normal AFT model and used the hierarchical‐likelihood (h‐likelihood) approach to estimate the model parameters. The h‐likelihood method obtains fixed effects estimates by maximizing the h‐likelihood, while utilizing the restricted maximum likelihood estimate for the estimation of the variance of the shared frailty [14]. An R package, frailtyHL [15] has been developed to implement the h‐likelihood estimation in the shared frailty log‐normal AFT model. Building on this, Park and Do Ha [16] introduced a penalized variable selection technique for the shared frailty log‐normal AFT model. Additionally, Zhou et al. [17] developed a Markov chain Monte Carlo (MCMC)‐based algorithm, called survregBayes, to estimate the shared frailty AFT model, and an R package, spBayesSurv [18], is available for its implementation. To our knowledge, there is no work on variational Bayesian inference for shared frailty AFT models.
As an alternative to MCMC methods, which are the gold standard for obtaining posterior distributions under a Bayesian framework, variational inference (VI) has gained popularity due to its favourable results and lower computational cost than MCMC. Recently, several types of VI algorithms have been developed, including mean‐field VI [19], stochastic VI [20], and black‐box VI [21]. A special case of mean‐field VI, called mean‐field variational Bayes (VB), arises when the Kullback–Leibler (KL) divergence is utilized to quantify the dissimilarity between exact and approximated posterior distributions. In addition, the approximated posterior distribution, referred to as the variational posterior, is assumed to belong to a mean‐field variational family. Under the mean‐field VB framework, the solutions to minimizing the KL divergence can be obtained by utilizing the coordinate ascent algorithm [19, 22]. Mean‐field VB has been widely applied to regression models such as the generalized additive model [23], nonparametric regression with measurement error [24], count response semiparametric regression [25], high‐dimensional linear regression [26], multilevel regression modeling [27], B‐spline regression mixture model for functional data clustering [28], basis selection for functional data representation [29], among others. Applications of other types of VI can be found in a comprehensive review of VI from a statistical perspective by Blei et al. [30].
In this study, we propose a shared frailty log‐logistic AFT model to account for the correlation among patient ventilation durations within the ICU sites. Ventilation duration is defined as the time‐to‐extubation [31] for patients after initiation on invasive mechanical ventilation. Similar to Kobara et al. [9], we treat time‐to‐extubation from initiation as a survival time outcome, considering it right‐censored if the patient is transferred to another facility while still on a ventilator with no follow‐up data available. We develop a novel and fast mean‐field VB algorithm to infer the model parameters. By applying the piece‐wise approximation techniques proposed by Xian et al. [32] to avoid intractable calculations, we obtain closed‐form posterior distributions. We conduct extensive simulation studies with various numbers of clusters and cluster sizes to evaluate the performance of the proposed method, and compare the performance of our VB algorithm with the h‐likelihood method [14] and the MCMC‐based algorithm survregBayes [18]. We also evaluate the performance of the VB algorithm using simulated data under scenarios involving survival distribution misspecification and imbalanced cluster sizes. Finally, we apply our methodology to investigate ventilation duration for ICU patients using the same dataset as Kobara et al. [9]. This study was approved by the Research Ethics Review Committee at King's University College at Western University. Our method is implemented as part of the R package survregVB available at CRAN (https://cran.r‐project.org/web/packages/survregVB/index.html).
The remainder of the paper is organized as follows. Section 2 presents the log‐logistic AFT model with a shared frailty under the Bayesian framework. We introduce our proposed VB algorithm in Section 3. In Section 4, simulation studies are conducted to evaluate the performance of our VB algorithm. Section 5 illustrates the application of the proposed method to the ICU ventilation duration data. A discussion is provided in Section 6.
2. Bayesian Log‐Logistic AFT Model With a Shared Frailty
Let and be the survival and censoring times, respectively, of the subject from the group (i.e., cluster) in a sample, and . Let and be the subject's observed time and the indicator for right censoring, respectively. We consider a log‐logistic AFT model with shared frailty (a random intercept) specified as follows:
| (1) |
where is a column vector with length containing fixed effects (covariates) and a constant one to incorporate the constant intercept (i.e., ), is the corresponding vector of coefficients for the fixed effects, where is a random intercept for the cluster and is a random variable following a standard logistic distribution, and is a scale parameter. We further assume that represents the discrepancy between clusters with iid denoting identically and independently distributed. The survival time and censoring time are assumed independent given the covariates . Our model follows a structure similar to the one presented by Robison (1991) [33] and Nolan et al. [34] for a Gaussian linear mixed‐effects model.
In our proposed Model (1), we incorporate the unknown and unobserved shared risk through cluster‐specific random intercepts and estimate the model parameters, , , and using a Bayesian framework by further assuming the following independent marginal prior distributions:
and being a identity matrix
Where , , and are known hyperparameters (parameters of the prior distributions).
3. Variational Bayes Algorithm
In what follows, we outline our methodology for deriving a mean‐field VB algorithm for Model (1). We summarize the resulting VB algorithm in Algorithm 1.
ALGORITHM 1. Variational Bayesian inference of correlated survival data using a shared frailty log‐logistic AFT model.

Given the observed data , we denote the complete data log‐likelihood by , where . Our objective is to derive a VB algorithm to approximate the exact posterior joint distribution of , , and given the data by maximizing the evidence lower bound (ELBO) defined as
| (2) |
where is the approximated posterior joint distribution, which is also called the variational density, and the expectation is taken with respect to the variational density [30]. We consider the mean‐field variational family which assumes that , and apply the coordinate ascent variational inference (CAVI) algorithm [19] to obtain each variational component (e.g., in ). Under our Model (1), the complete data log‐likelihood can be obtained by
| (3) |
where
| (4) |
with being the number of observed uncensored times and being the log observed survival time.
By maximizing the ELBO, the following solutions are provided by the CAVI algorithm:
where we use to denote equality up to a constant additive factor for convenience, and indicates the expectation is taken with respect to the variational density of other latent variables but , same for other solutions. To achieve conjugacy and tractable expectation calculation of as specified in (4), we apply the proposed method by Xian et al. [32], piecewise approximations of the function, , embedded in deriving the update equations for each parameter. As in Nolan et al. [34] and Lee and Wand [35], we are also interested in the posterior distribution of the random effects, , in our proposed VB framework.
3.1. Update Equation for Each Variational Density
The update equations to obtain the optimal variational densities of , , and denoted by , , and , respectively, which are the corresponding approximated posterior distributions, are presented as follows within the paper while their derivations are given in Appendix A. The calculations of expectations in the update equations are given in Section 3.2. In the update equations, , , and represent the piece‐wise approximation coefficients proposed by Xian et al. [32] for the subject in the cluster. Detailed information regarding these coefficients is also provided in Appendix A.
(1) Update equation for
is an , where
and
(2) Update equation for
is an , where
and
(3) Update equation for
is an , where and
(4) Update equation for
is an , where and
3.2. ELBO Calculation
The ELBO under Model (1) is defined in (2) with the complete‐data log‐likelihood calculated by (3) and note that . Let
Then we can calculate the ELBO as follows with proof details provided in Appendix B.
| (5) |
where
We now present the calculation of the expectations in the update equations and the ELBO calculation. All the expectations are taken with respect to the approximated variational distributions. Since is an Inverse‐, we have
where is the digamma function defined as .
Similarly,
4. Simulation Studies
4.1. Simulation Study 1: Different Number of Clusters and Cluster Sizes
4.1.1. Design of Simulation Study 1
In simulation study 1, we evaluate the performance of our proposed VB algorithms across different scenarios by varying the number of clusters and the number of observations within each cluster.
We generate the log of survival time for the subject in the cluster, , and as follows:
| (6) |
where , , and are mutually independently generated with , and . The values of , and are chosen as 0.2, 0.8 and 0.8, respectively. The random intercept for the cluster, , is generated from with . The censoring time for the subject in the cluster, , is generated from a uniform distribution, , where is a positive value controlling the percentage of censoring. Then and . Take to achieve a 15% censoring rate in our simulations. Investigation of the effect of censoring rates can be found in Xian et al. [32], where it is shown that as the censoring rate increases, an increase in the mean squared error (MSE) of estimating parameters in an AFT model using a VB algorithm is observed.
We explore various scenarios by varying the number of clusters, , and the number of observations within each cluster, for all . Across the experiments, we consider values from the set and values from , resulting in a total of 16 unique scenarios. Our objective is to assess the estimation performance of the VB algorithm concerning the variations in and . We consider a prior setting with , , , and , which indicates no strong prior information on the parameters. The ELBO convergence threshold is set as 0.01, which is the default recommendation [36], and the maximum number of iterations is 100.
We conduct runs (replicates) in each considered scenario and apply our proposed VB algorithm to derive the approximated posterior distribution of each parameter for each run. The mean of each approximated posterior distribution is used as the parameter estimate for the corresponding parameter. The empirical bias and sample standard deviation (SD) as well as the empirical MSE for each estimate are obtained, where
and is the estimate of parameter in the replicate, and is the true value. In addition, for each parameter of interest, we report the empirical 95% coverage rate (CR) calculated as
where is the indicator variable that equals 1 if the true parameter value falls within the corresponding 95% credible interval, and 0 otherwise.
4.1.2. Results of Simulation Study 1
The empirical bias, sample SD, empirical MSE, and empirical CR of estimating , , , and from 500 replicates are summarized in Table 1. Considering , , and , we observe that when the number of clusters is fixed, increasing the cluster size from 5 to 50 does not always significantly affect the empirical bias. However, there is a noticeable decrease in the sample SD, leading to a pronounced reduction in the empirical MSE. A similar trend is observed when the cluster size is fixed while increasing . Figure 1 visually illustrates this asymptotic property through boxplots. Our primary focus lies in understanding the impact of and on estimating the variance of the random intercept, denoted as . In most of the scenarios, when the number of clusters is fixed, we observe that the bias of estimating decreases as the cluster size increases, while the sample SD remains relatively stable. However, when is increased, both the empirical bias and the sample SD decrease noticeably, except for the case when as grows from 15 to 30. Particularly noteworthy is the scenario with and , where we achieve a less biased and less variable estimation of the variance of the random intercept. In addition, the empirical CRs corresponding to a 95% credible interval for each parameter across all scenarios are close to the nominal level of 95%, with a mean of 94.1% and a standard deviation of 0.014. Furthermore, based on a nominal level of 95% with 500 replicates, the coverage with two standard deviations is = since . We observe that the majority of our empirical CRs are within the range of .
TABLE 1.
Simulation study 1: Numerical estimation results (point estimate using the mean of the corresponding posterior distribution) including the empirical Bias, sample SD, empirical MSE, and coverage rate (CR) for parameters in each scenario with different numbers of clusters and cluster sizes from the proposed VB algorithm.
|
|
|
|
|
||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
|
Bias | SD | MSE | CR | Bias | SD | MSE | CR | Bias | SD | MSE | CR | Bias | SD | MSE | CR | ||||
| 15 | 5 | 0.066 | 0.764 | 0.587 | 94.2 | −0.026 | 0.352 | 0.124 | 90.0 | 0.005 | 0.095 | 0.009 | 94.5 | −0.101 | 0.312 | 0.107 | 91.4 | ||||
| 15 | 0.018 | 0.489 | 0.239 | 93.2 | 0.007 | 0.192 | 0.037 | 94.0 | 0.006 | 0.052 | 0.003 | 94.8 | −0.081 | 0.287 | 0.089 | 93.1 | |||||
| 30 | 0.006 | 0.354 | 0.125 | 93.2 | −0.017 | 0.139 | 0.019 | 92.4 | −0.006 | 0.036 | 0.001 | 96.0 | 0.003 | 0.290 | 0.087 | 95.5 | |||||
| 50 | 0.009 | 0.254 | 0.065 | 95.6 | −0.001 | 0.104 | 0.011 | 94.8 | 0.003 | 0.029 | 0.001 | 94.7 | −0.040 | 0.299 | 0.100 | 94.2 | |||||
| 30 | 5 | 0.004 | 0.589 | 0.346 | 92.8 | −0.015 | 0.257 | 0.066 | 92.8 | 0.015 | 0.071 | 0.005 | 94.4 | −0.092 | 0.274 | 0.084 | 92.6 | ||||
| 15 | 0.002 | 0.360 | 0.129 | 93.0 | −0.018 | 0.140 | 0.020 | 93.0 | 0.008 | 0.038 | 0.001 | 96.1 | −0.057 | 0.242 | 0.062 | 91.1 | |||||
| 30 | 0.012 | 0.239 | 0.057 | 94.6 | −0.004 | 0.088 | 0.008 | 95.7 | 0.005 | 0.026 | 0.001 | 95.6 | −0.036 | 0.248 | 0.063 | 92.4 | |||||
| 50 | −0.007 | 0.192 | 0.037 | 93.0 | −0.005 | 0.074 | 0.005 | 95.0 | 0.003 | 0.020 |
|
95.8 | −0.026 | 0.228 | 0.052 | 95.2 | |||||
| 50 | 5 | −0.011 | 0.470 | 0.220 | 94.3 | −0.033 | 0.199 | 0.041 | 91.4 | 0.014 | 0.051 | 0.003 | 95.1 | −0.062 | 0.235 | 0.059 | 93.2 | ||||
| 15 | 0.003 | 0.253 | 0.064 | 95.2 | −0.001 | 0.104 | 0.011 | 94.8 | 0.018 | 0.029 | 0.001 | 94.2 | −0.033 | 0.203 | 0.042 | 92.4 | |||||
| 30 | −0.006 | 0.192 | 0.037 | 92.3 | −0.006 | 0.074 | 0.006 | 94.4 | 0.003 | 0.020 |
|
95.6 | −0.027 | 0.191 | 0.037 | 93.3 | |||||
| 50 | −0.002 | 0.143 | 0.020 | 94.4 | −0.004 | 0.057 | 0.003 | 95.6 | 0.002 | 0.016 |
|
95.7 | 0.016 | 0.201 | 0.040 | 93.4 | |||||
| 80 | 5 | 0.013 | 0.384 | 0.147 | 93.2 | −0.005 | 0.161 | 0.026 | 91.3 | 0.014 | 0.041 | 0.002 | 95.2 | −0.048 | 0.197 | 0.041 | 94.4 | ||||
| 15 | −0.008 | 0.223 | 0.050 | 93.4 | −0.005 | 0.090 | 0.008 | 92.4 | 0.008 | 0.023 | 0.001 | 95.5 | −0.023 | 0.160 | 0.026 | 92.2 | |||||
| 30 | 0.008 | 0.141 | 0.020 | 95.8 | −0.005 | 0.058 | 0.003 | 95.1 | −0.003 | 0.015 |
|
95.6 | 0.003 | 0.161 | 0.026 | 92.8 | |||||
| 50 | −0.005 | 0.108 | 0.012 | 95.4 | −0.002 | 0.043 | 0.002 | 95.5 | 0.003 | 0.013 |
|
95.5 | 0.014 | 0.157 | 0.025 | 94.4 | |||||
FIGURE 1.

Boxplots of estimates of (a) , (b) , (c) , and (d) . Estimates correspond to the posterior means from 500 replicates under various scenarios with different numbers of clusters and cluster sizes based on our proposed VB algorithm. The horizontal dashed line on each plot represents the true value of the corresponding parameter used when generating the data.
To assess the significance of the cluster‐specific random intercepts in the AFT model, we visualize the estimated random effects and their 95% credible intervals for one simulated dataset from the scenario with clusters and observations per cluster (Figure 2, right panel). For comparison, we also generate data under the same setting but without random intercepts , and fit the shared frailty log‐logistic AFT model using our VB method (Figure 2, left panel). In both panels, the estimated random intercepts are ordered by magnitude for clarity. In the no‐frailty case (Figure 2, left panel), all credible intervals for the estimated random effects overlap and contain zero, suggesting no significant between‐cluster variation. In contrast, when the data include random intercepts, the estimated effects show greater variation across clusters than in the case without frailty. In addition, there is less overlap across credible intervals, along with intervals that do not contain zero, indicating the presence of significant frailty effects.
FIGURE 2.

Estimated cluster‐specific random effects and their 95% credible intervals using the proposed VB algorithm under the shared frailty log‐logistic AFT model with . The left panel (a) shows results from a dataset generated without random intercepts; the right panel (b) shows results from a dataset generated with random intercepts. Random effects are ordered by magnitude to facilitate visualization.
Since the random intercepts are assumed a priori to have a mean of zero, their influence on the point estimates of the regression coefficients (fixed effects) and the overall goodness‐of‐fit is minimal. However, ignoring random effects when they are present distorts statistical inference on the fixed effects. In our simulated dataset with random intercepts under , , and , , the VB‐based shared frailty AFT model yields with a posterior standard deviation (SD) of 0.120, and a 95% credible interval (CI) of [0.054, 0.526], and with SD = 0.057, 95% CI = [0.690, 0.915]. In contrast, the VB‐based AFT model without shared frailty gives (SD = 0.181, 95% CI = [−0.065, 0.643]) and (SD = 0.070, 95% CI = [0.649, 0.925]). We observe that ignoring shared frailty inflates uncertainty, widens the credible intervals, and may make some of the fixed effects statistically insignificant.
The left part of Figure 3 presents the computational run time of 500 replicates in minutes against the number of clusters () with different colors for different cluster sizes . Fixing , as increases, the used time increases. The scatter plot on the right of Figure 3 shows the run time against the sample size (). As anticipated, the computational cost rises with increasing sample size.
FIGURE 3.

(a): The run time in minutes used for 500 replicates under various scenarios with different numbers of clusters and cluster sizes based on our proposed VB algorithm. (b): The run time in minutes used for 500 replicates in different sample sizes based on VB.
Furthermore, among those considered 16 scenarios, we select three scenarios ( with , with , and with ) and conduct a comparative analysis of estimation results obtained from the proposed VB algorithm with those from two alternative methods which we introduced in Section 1: the h‐likelihood method proposed by Do Ha et al. [14] and the MCMC‐based survregbayes developed by Zhou et al. [17]. Summaries from the MCMC‐based survregbayes algorithm are derived from one Markov chain, subsampled every 5 iterations to achieve a final chain size of 2000 after a burn‐in period of 5000 iterations [17]. We further refer to our VB method and the h‐likelihood method as survregVBfrailty and survregHL, respectively. Numerical estimation results are presented in Table 2, where we focus on the comparison of estimation for , and since the MCMC‐based survregbayes does not directly return the estimate for . In the scenario with and , the proposed survregVBfrailty exhibits a larger empirical bias compared to both the survregHL and survregbayes methods. However, as and increase, the discrepancy in empirical bias among the three methods becomes negligible. In terms of the sample SD, on average, across the three parameters , , and , survregVBfrailty yields a 16.5% smaller sample SD when and , a 7.6% smaller sample SD when and , and a 3.7% smaller sample SD when and , compared to survregHL. Compared with the survregBayes algorithm, we observe a decrease in sample SD of 7.8% in the , scenario, mainly due to , and only 2.0% in the , scenario. However, in the scenario with , , no average difference in sample SD is observed between VB and MCMC. Therefore, the survregVBfrailty algorithm generally yields a smaller SD, resulting in a lower MSE compared to the other two methods in most cases. On average, across the three parameters , , and , survregVBfrailty achieves a 27.2% lower MSE when , , a 12.0% lower MSE when , , and a 13.4% lower MSE when , , compared to survregHL. Compared with survregBayes, we observe a reduction in MSE of 12.4% in the , scenario, mainly because of , and only 3.0% in the , scenario. However, in the scenario with , , no difference in MSE is observed between VB and MCMC. In addition, we compare the posterior densities for , , and obtained from both survregVBfrailty and the MCMC‐based survregBayes using a simulated dataset with and . These densities present a strong consistency between the VB and MCMC algorithms as illustrated in Figure 4, which is also reflected in the results presented in Table 2.
TABLE 2.
A comparison of numerical estimation results, including the empirical Bias, sample SD and MSE, from our VB method survregVBfrailty, the h‐likelihood method survregHL and MCMC‐based survregbayes method in each scenario (: number of clusters, : number of observations in each cluster).
| survregVBfrailty | survregHL | survregbayes | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Scenario | Parameter | Bias | SD | MSE | Bias | SD | MSE | Bias | SD | MSE | |
| , |
|
0.004 | 0.589 | 0.346 | 0.001 | 0.664 | 0.440 | 0.001 | 0.664 | 0.440 | |
|
|
−0.015 | 0.257 | 0.066 | −0.002 | 0.270 | 0.073 | −0.002 | 0.266 | 0.071 | ||
|
|
−0.092 | 0.274 | 0.084 | 0.001 | 0.412 | 0.170 | −0.042 | 0.300 | 0.092 | ||
| , |
|
0.003 | 0.253 | 0.064 | 0.001 | 0.268 | 0.072 | −0.005 | 0.259 | 0.067 | |
|
|
−0.001 | 0.104 | 0.011 | 0.007 | 0.107 | 0.011 | −0.004 | 0.104 | 0.011 | ||
|
|
−0.033 | 0.203 | 0.042 | 0.011 | 0.237 | 0.056 | −0.001 | 0.211 | 0.044 | ||
| , |
|
0.008 | 0.141 | 0.020 | 0.009 | 0.143 | 0.021 | −0.009 | 0.142 | 0.020 | |
|
|
−0.005 | 0.058 | 0.003 | 0.001 | 0.060 | 0.004 | 0.001 | 0.058 | 0.003 | ||
|
|
0.003 | 0.161 | 0.026 | 0.007 | 0.172 | 0.029 | 0.001 | 0.160 | 0.026 | ||
FIGURE 4.

A comparison of posterior densities of (a) , (b) and (c) obtained from our VB method survregVBfrailty and MCMC‐based survregbayes from a simulated data set in the scenario with and .
To assess the computational efficiency of the proposed VB algorithm, we compare the run time in minutes for 500 replicates in these three scenarios across survregVBfrailty, survregHL, and survregbayes methods and present the results in Table 3. In Table 3, we observe that in the scenario with a small sample size ( and ), there is minimal difference in the run times between the VB and h‐likelihood methods. However, as both and increase, the h‐likelihood method requires progressively longer computation times to obtain estimates. Particularly in the scenario with and , the computational time is over 10 times longer than that required by the VB algorithm. Comparatively, the VB algorithm demonstrates significantly higher computational efficiency when contrasted with the MCMC‐based survregbayes algorithm. Notably, in the scenario with and , the survregVBfrailty algorithm runs approximately 150 times faster than the survregbayes algorithm. All algorithms were implemented within R version 4.3.2, and simulations were conducted on a computer operating the Mac OS X platform, equipped with a 4.05 GHz CPU and 8 GB RAM.
TABLE 3.
Times in minutes for 500 replicates from our VB algorithm survregVBfrailty, the h‐likelihood method survregHL and the MCMC‐based survregbayes algorithm, respectively, under each scenario.
| Scenario | survregVBfrailty | survregHL | survregbayes |
|---|---|---|---|
| , | 0.61 | 0.67 | 47.65 |
| , | 1.70 | 9.59 | 232.31 |
| , | 8.47 | 124.53 | 1302.80 |
4.2. Simulation Study 2: Misspecification of the Survival Distribution
We conduct a simulation study to evaluate the performance of the proposed VB algorithm for parameter estimation under the log‐logistic AFT model when data are generated from a misspecified survival distribution. We use the same simulation setup as in Section 4.1, with 50 clusters and 30 observations per cluster (i.e., ). However, unlike in Section 4.1, we independently generate , in (6), from either a standard extreme value distribution or a standard normal distribution. This results in survival times following a Weibull or log‐normal distribution, respectively, both of which are commonly used in survival analysis. We then apply the proposed VB algorithm under the log‐logistic AFT model to the simulated data for parameter estimation.
Table 4 presents a comparison of the numerical estimation results for the regression coefficients and the variance of the random intercept, , based on the posterior means. The comparison includes empirical bias, sample standard deviation (SD), mean squared error (MSE), and credible interval coverage rate under both the correctly specified survival distribution (log‐logistic) and the misspecified models (Weibull or log‐normal AFT). The results in Table 4 demonstrate the robustness of the proposed VB algorithm to survival model misspecification. Across all three model specifications—log‐logistic (correct), Weibull (misspecified), and log‐normal (misspecified)—the estimated regression coefficients () exhibit minimal bias. The standard deviations (SD) and mean squared errors (MSE) remain relatively stable, indicating that the VB algorithm provides reliable parameter estimates even under model misspecification. The variance of the random intercept () shows slightly higher bias under the Weibull and log‐normal models compared to the correctly specified log‐logistic model. However, the credible interval coverage rates (CR) remain close to the nominal level across all models, further supporting the robustness of the VB approach.
TABLE 4.
Simulation study 2: Comparison of numerical estimation results, including empirical bias, sample SD, MSE, and coverage rate (CR), under the shared frailty log‐logistic (correct), Weibull (misspecified), and log‐normal (misspecified) AFT models.
| Log‐logistic | Weibull | Log‐normal | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Parameter | Bias | SD | MSE | CR | Bias | SD | MSE | CR | Bias | SD | MSE | CR | |
|
|
−0.006 | 0.192 | 0.037 | 92.3 | −0.003 | 0.133 | 0.018 | 92.8 | 0.001 | 0.113 | 0.013 | 92.4 | |
|
|
−0.006 | 0.074 | 0.006 | 94.4 | −0.007 | 0.052 | 0.003 | 93.0 | −0.002 | 0.045 | 0.002 | 94.4 | |
|
|
−0.027 | 0.191 | 0.037 | 93.3 | 0.054 | 0.211 | 0.047 | 93.6 | 0.050 | 0.201 | 0.043 | 92.8 | |
4.3. Simulation Study 3: Imbalanced Cluster Sizes
In this section, we evaluate the performance of the proposed VB algorithm under scenarios with imbalanced cluster sizes. We conduct a simulation study with clusters across two scenarios. In Scenario 1, cluster sizes are randomly and uniformly sampled from the set , introducing a high degree of heterogeneity. In Scenario 2, 75 clusters have a size of 50, while the remaining 5 clusters have a much smaller size of 10, resulting in a highly unbalanced structure. All other simulation settings are identical to those described in Section 4.1.
Table 5 presents the empirical bias, SD, MSE, and CR for estimating , , , and based on 500 replicates for both scenarios. In Scenarios 1 and 2, the proposed VB algorithm performs well in estimating the regression coefficients , , and the scale parameter , showing similar bias, SD, MSE, and CR to those observed in the balanced setting with in Section 4.1 (see Table 1).
TABLE 5.
Simulation study 3: Numerical estimation results including the empirical Bias, SD, MSE and coverage rate (CR) for parameters in two considered scenarios with imbalanced cluster sizes.
| Scenario 1 | Scenario 2 | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Parameter | Bias | SD | MSE | CR | Bias | SD | MSE | CR | |||
|
|
0.005 | 0.162 | 0.026 | 94.4 | −0.008 | 0.120 | 0.015 | 93.8 | |||
|
|
−0.002 | 0.067 | 0.004 | 93.6 | −0.003 | 0.046 | 0.002 | 95.4 | |||
|
|
0.004 | 0.016 |
|
95.4 | 0.004 | 0.012 |
|
95.2 | |||
|
|
0.002 | 0.169 | 0.029 | 91.0 | 0.022 | 0.159 | 0.026 | 94.8 | |||
Although imbalanced cluster sizes can pose challenges in estimating the variance of the random intercept (i.e., ), the VB algorithm remains robust. Specifically, the MSEs for are 0.029 in Scenario 1 and 0.026 in Scenario 2, which are comparable to those reported in Section 4.1 under balanced settings. More concretely, the estimation results in Scenario 1 are similar to those in the case with , , while Scenario 2 yields results comparable to the case with , in Section 4.1. In conclusion, the proposed VB algorithm maintains satisfactory estimation performance even under substantial imbalance in cluster sizes.
5. Application to Ventilation Duration Analysis
In this section, we apply the shared frailty log‐logistic AFT model with the proposed VB algorithm to the ICU data as we described in the Introduction section and conduct a retrospective study on ventilation duration time. We aim to investigate the ICU site‐specific random effect on patients' ventilation duration. We extend the work by Kobara et al. [9] by incorporating the uncertainty from the ICU sites via a group‐specific random intercept under a Bayesian analysis framework. It is important to note that, unlike Kobara et al., we exclude ICU patients who did not survive (approximately 18% of the 49,467 patients) to eliminate competing risks from the analysis and ensure a clearer assessment of ventilation duration using our current proposed methodology.
The CCIS ICU data, excluding deaths, were collected between July 2015 and December 2016 and contained 40,426 patients receiving invasive mechanical ventilation upon arrival to the ICU. About 3% of these patients were discharged/transferred to a Complex Continuing Care Facility, other hospitals, the Level 3 Unit, and outside the ICU while still on a ventilator, and therefore, their ventilation time was considered as right‐censored data [9]. The data were from 66 ICU sites (centers), and each site has a unique site code, for example, 3970. In the CCIS dataset, the median number of ventilated patients per ICU site over the 1.5‐year study period is 307.5, with an interquartile interval of . The median ventilation duration (defined as time‐to‐extubation from initiation) per ICU patient is 2 days, with an interquartile interval of days. We consider the significant covariates investigated by Kobara et al. [9] as fixed effects which are admission source (e.g., from operation rooms), admission diagnosis, patient type (medical or surgical), scheduled admission (yes or no), scheduled surgery (yes or no), referring physician specialty, other interventions (yes or no), central venous line (CVL, yes or no), arterial line (AL, yes or no), intra‐cranial pressure monitor (IPM, yes or no), extracorporeal membrane oxygen (EMO, yes or no), intra‐aortic balloon pump (IABP, yes or no), age group (18‐39, 40‐80 or above 80 years of age), pre‐LOS (no more than 1 day, between 2 and 7 days, or no less than 7 days), and the MODS score (none with MODS , minimal with scores, mild with scores, moderate with scores or, severe with scores ).
To apply our proposed VB algorithm in real data analysis, we consider the same weak prior setting in our simulation study described in Section 4: , , , and . Table C1 in Appendix C displays the estimated regression coefficients from the fitted shared frailty log‐logistic AFT model. For comparative analysis, we also employed the h‐likelihood method survregHL and the MCMC‐based survregbayes to model the data, incorporating shared frailty. In the absence of shared frailty, we used the likelihood‐based survreg from the survival package in R, and the VB method survregVB proposed by Xian et al. [32]. Furthermore, for the Bayesian methods (survregVBfrailty, survregVB, and survregbayes), we report the 95% credible intervals, whereas for the likelihood‐based methods, we provide the 95% confidence intervals. In Table C1, we first observe that there is no significant difference in the estimated regression coefficients between survregVBfrailty and survregbayes. However, some of the estimated coefficients from survregHL, such as scheduled surgery, CVL, AL, IPM, and EMO, are different from those based on survregVBfrailty and survregbayes, which is further discussed in Section 6. In comparison to the models with frailty, the survregVB and survreg methods, which do not account for frailty, exhibit some differences in estimating certain coefficients. However, they maintain a strong overall consistency in estimating the regression coefficients with the results from the frailty models. This consistency is expected, as the inclusion of frailty does not affect the fixed effects, implying that the regression lines from models with or without frailty should be parallel. To illustrate the difference in interval estimation between models with and without frailty, we calculated the mean overlap percentage of the two 95% credible intervals from VB with or without frailty. Using the 95% credible intervals from VB without frailty (survregVB) as references, we found a 77.3% overlap on average. This means that if we fit a model using VB without considering the ICU site as a shared frailty, about 77% of the credible interval will fall within the corresponding credible interval obtained from the model that includes the shared frailty.
In what follows, we summarize the fixed effects on ventilation duration based on estimates from our proposed VB algorithm, survregVBfrailty. For the baseline (reference) patient group—defined as patients aged 18 to 39, admitted from downstream units, with a cardiovascular diagnosis, without scheduled ICU admissions or surgeries, under medical referral physician service, without any specific treatment interventions (e.g., CVL, AL, IPM, EMO, and IABP), with day pre‐ICU LOS, and with a MODS score —the estimated mean ICU ventilation duration is 1.40 days, with a 95% credible interval of [1.32, 1.48]. Regarding the admission source, patients arriving from the emergency department (ED), operating room (OR), or ward have a time‐to‐extubation from initiation in days that are shorter (credible interval (CI): [7.32%, 14.61%]), 28.04% shorter (CI: [24.80%, 31.20%]), and 13.32% shorter (CI: [9.52%, 16.89%]), respectively, compared to patients admitted from a downstream unit (baseline). Conversely, patients admitted from home or another hospital have ventilation durations that are 10.19% (CI: [−1.78%, 23.61%]) and 11.29% (CI: [6.40%, 16.30%]) longer, respectively. Since the CI for patients admitted from home includes zero, we conclude that admission from home is not a statistically significant factor. Additionally, patients from other sources, such as from outside the province, have ventilation durations that are 19.81% longer (CI: [6.82%, 34.31%]).
Compared to cardiovascular patients, those with gastrointestinal, neurological, and trauma diagnoses experience significantly longer ventilation times. Specifically, ventilation duration increases by 30.60% (CI: [25.73%, 35.53%]) for gastrointestinal patients, 32.05% (CI: [27.51%, 36.89%]) for neurological patients, and 74.37% (CI: [65.86%, 83.31%]) for trauma patients. Patient categories (surgical or medical) do not show significant differences in ventilation time. However, scheduled ICU admissions or surgeries are important factors. Patients with a scheduled ICU admission have a 23.66% shorter ventilation time (CI: [20.23%, 26.88%]), and those with a scheduled surgery have a 12.37% shorter ventilation time (CI: [8.33%, 16.31%]) compared to patients without scheduled admissions or surgeries. The referral physician service is also a significant risk factor. Compared with medical referrals, surgical referrals result in a 6.29% shorter ventilation time (CI: [2.66%, 9.88%]), while respirology referrals result in a 17.94% longer ventilation time (CI: [11.96%, 24.23%]).
Specific treatment interventions upon ICU arrival significantly impact ventilation duration. Patients receiving a CVL, AL, IPM, EMO, or IABP have increased ventilation times by 20.32% (CI: [17.70%, 23.00%]), 21.90% (CI: [19.12%, 24.86%]), 71.60% (CI: [60.48%, 83.49%]), 143.03% (CI: [120.12%, 168.59%]), and 46.81% (CI: [37.16%, 57.15%]), respectively. Age is also a significant factor. Compared to patients aged 18 to 39, those aged 40 to 80 and those over 80 have longer ventilation periods, increasing by 13.54% (CI: [10.30%, 16.88%]) and 7.68% (CI: [4.08%, 11.40%]), respectively.
Both pre‐ICU LOS and patients' severity scores, as measured by MODS, are significant risk factors for longer ventilation duration. Longer pre‐ICU LOS correlates with longer ventilation times. Patients with a pre‐ICU LOS of 2‐7 days or days experience increases in ventilation duration by 4.19% (CI: [1.82%, 6.61%]) and 12.98% (CI: [10.19%, 15.72%]), respectively, compared to those with day pre‐ICU LOS. Compared to patients with a MODS score , those with minimal (1–4), mild (4–8), moderate (8–12), or severe () MODS scores experience increases in ventilation duration by 9.97% (CI: [7.04%, 13.09%]), 23.12% (CI: [19.96%, 26.49%]), 29.30% (CI: [25.11%, 33.64%]), and 12.08% (CI: [4.71%, 20.08%]), respectively.
We now turn to the analysis of variance in terms of the variations from individual patients and from ICU sites. Using the mean of the posterior distribution for , the estimated variance () for the shared ICU site effect from survregVBfrailty is 0.097, with a square root of 0.311, which indicates that the average spread of the ventilation time among ICU sites is , or 1.37. The estimated scale parameter is 0.442, resulting in an estimated variance of the logarithms of individual patient ventilation times of , or 0.643, where is the variance of a standard logistic distribution. To measure the strength of the correlation between patients within the same ICU site, the intra‐class correlation coefficient between the logarithms of ventilation time can be estimated by .
On the left of Figure 5, we observe a strong consistency in estimating the variance of the ICU‐site specific random effect between survregVBfrailty and the MCMC‐based survregbayes. We further visualize the estimated ICU‐site random effects with the 95% credible intervals based on their posterior distributions obtained from survregVBfrailty, as shown on the right of Figure 5, where the random effects are ranked from smallest to largest. Wider credible intervals correspond to ICUs with larger numbers of patients. As discussed in Lambert et al. [12] and demonstrated in our simulation study, non‐overlapping credible intervals suggest the presence of significant cluster‐specific random effects. We observe that some of the intervals do not overlap, indicating that these ICU sites perform differently in terms of patient ventilation duration.
FIGURE 5.

(a): Posterior distribution of the variance of the random intercept from VB and MCMC. (b): Estimated ICU site‐specific random effects with their 95% credible interval from the proposed VB algorithm. The random effects have been ranked in an increasing order.
To assess the goodness‐of‐fit of the proposed log‐logistic AFT model in our ICU ventilation duration analysis, we computed individual Cox–Snell residuals [37] and evaluated their empirical survival function using the Kaplan–Meier (K‐M) estimator. If the model is appropriate, the K‐M survival curve of the residuals should closely follow the Exponential(1) survival function. As shown in Figure 6, the K‐M survival curve (black) closely aligns with the theoretical exponential curve (red), indicating a good fit of the log‐logistic AFT model to the data.
FIGURE 6.

Kaplan–Meier (K‐M) survival curve (black) of the Cox–Snell residuals compared to the theoretical Exponential(1) survival curve (red), based on the ICU ventilation duration analysis.
For reference on computational efficiency, the run times in minutes for each method are as follows: survregVBfrailty took 1.15 min, h‐likelihood took 86.40 min, MCMC‐based survregbayes took 208.26 min, survreg took 0.01 min, and survregVB took 0.08 min.
6. Discussion
In this paper, we have proposed a fast variational Bayesian algorithm, called survregVBfrailty, for statistical inference using a shared frailty log‐logistic AFT model, which can be applied to analyze clustered survival data. We demonstrated that our proposed survregVBfrailty algorithm achieves satisfactory estimation performance through simulation studies under various scenarios with different numbers of clusters and cluster sizes. Additionally, we further investigate the robustness of our approach by evaluating its performance under model misspecification, conducting simulation studies where survival times are generated from Weibull and log‐normal AFT models with a shared frailty component. To better reflect real‐world clinical settings, where hospitals often have varying patient capacities, we also introduce two additional simulation scenarios to assess the impact of imbalanced cluster sizes on model performance. Our results confirm the reliability and efficiency of the proposed algorithm, with strong consistency observed between VB and MCMC methods in both simulations and real‐world ICU ventilation data analysis. Moreover, the survregVBfrailty algorithm is significantly more computationally efficient, running over 150 times faster than the MCMC‐based survregbayes algorithm.
The h‐likelihood method proposed by Do Ha et al. [13] for analyzing clustered survival data in a log‐normal AFT model has been shown to be robust against violations of the normality assumption (e.g., extreme value distribution) for the logarithm of survival time. In our simulation study, we investigated the performance of the h‐likelihood method when the survival data, given the covariates in a specific cluster, follow a log‐logistic distribution. We compared its estimation results to those obtained using VB and MCMC algorithms. We found that the h‐likelihood method, survregHL, results in higher mean squared errors (MSEs) compared to VB and MCMC algorithms. Specifically, survregHL produced a 49.1% higher MSE than VB and a 41.2% higher MSE than MCMC for estimating the variance of the random intercept in our simulation study. Additionally, in our application to ICU ventilation duration analysis, we observed significant differences in some regression coefficients between h‐likelihood and VB or MCMC methods. Therefore, our proposed shared frailty log‐logistic AFT model using variational Bayes can be viewed as a better approach to the shared frailty log‐normal AFT model using h‐likelihood. While our proposed shared frailty log‐logistic AFT model using VB offers a computationally efficient alternative with satisfactory estimation performance, it does not currently account for competing risks such as death. It is important to note that the absence of a competing risks framework has varying implications depending on the ICU context. In high‐mortality ICUs, failing to account for death as a competing event may impact model applicability, whereas in low‐mortality settings, or when patient transfers are reasonably treated as censoring events, the current model remains appropriate. With the VB algorithm now established, extending it to incorporate competing risks is a compelling direction for future work.
Our application of the proposed method to the CCIS ICU data for ventilation duration analysis reveals a moderate correlation of 0.134 among patients within the same ICU site. By incorporating the ICU site‐specific random effect as an unknown shared frailty, we further validate the significant risk factors including the patient severity score MODS identified in the study by Kobara et al. [9] based on the 95% credible intervals obtained from the posterior distributions of each regression coefficient. We observe a similar trend regarding the effect of MODS on ventilation duration as reported by Kobara et al. [9]. Specifically, when MODS reaches a severe level, the increase in ventilation duration becomes less pronounced. This may be due to patient mortality, which warrants further investigation in future studies. We demonstrate that different ICU sites have varying effects on patient ventilation duration, as observed through differences in the estimated ICU site‐specific random effects. Our research provides valuable insights and practical implications for clinical practice and resource management. Specifically, ICUs with smaller estimated random intercepts tend to have shorter overall ventilation durations compared to other ICUs. Understanding the patient characteristics and ventilation practices within these ICUs may help improve clinical performance. For ICUs with larger estimated random intercepts, equipping more ventilators could enhance the overall efficiency of the ICU ventilation procedures.
While Cox‐type frailty models remain a widely used tool in survival analysis (even in the presence of competing risks) due to their flexibility and semi‐parametric nature, they are inherently hazard‐based and rely on the PH assumption. However, this assumption may not hold in practice. For instance, Kobara et al. [9] found violations of the PH assumption in our Ontario ICU ventilation duration data, indicating that the assumption is not reasonable. This issue is further compounded when modeling both cause‐specific and subdistribution hazards, as the PH structure generally cannot hold for both simultaneously in the presence of competing risks [38, 39]. In contrast, AFT models provide a complementary framework by directly modeling survival time on the log scale, offering an intuitive interpretation of covariate effects in terms of time acceleration or deceleration. Therefore, our proposed VB approach under the shared frailty AFT framework offers a practical alternative, especially in settings where the PH assumption is in doubt, or when researchers seek direct inference on survival time. It complements, rather than replaces, Cox‐type models and broadens the toolkit available for applied researchers handling complex clustered survival data.
We present several open problems and directions for future work related to our proposed methodology. As discussed, we assume that the survival time from a specific cluster follows a log‐logistic distribution. Therefore, extending the current VB algorithm to accommodate other survival distributions, such as the Weibull distribution, could be an interesting avenue of research. Integrating competing risks into the shared frailty AFT modeling framework using variational inference also presents an interesting research direction. A possible approach is to extend the cause‐specific or crude‐risk AFT model [38] to a shared frailty version, which allows for modeling competing events. In our current framework, we account for cluster‐level uncertainty using a random intercept. This approach could be extended to a more general model that includes cluster‐level covariates (e.g., the ICU type, general or specialized), resulting in a mixed‐effects model. Specifically, one could consider a log‐logistic AFT model with random effects specified as follows:
where is a column vector with length , containing random effects (cluster‐level covariates, not including the random intercept), and is the corresponding vector of coefficients for the random effects from cluster. We further assume that where is an covariance matrix. A prior distribution can be specified for as with being a known positive definite matrix and is a known hyperparameter. Such a general model can be used to better assess differences in performance across ICU sites regarding the duration of invasive mechanical ventilation. Another potential area for development is the integration of variable selection techniques within the VB algorithm, see Park and Do Ha [16] as a reference.
Conflicts of Interest
The authors declare no conflicts of interest.
Acknowledgments
This research was supported by the Natural Sciences and Engineering Research Council of Canada (NSERC) (Grant RGPIN‐2019‐05915). We extend our gratitude to Dr. Yawo M. Kobara for facilitating access to the CCIS dataset used in our real data analysis.
Appendix A. Update Equations
(1) Update equation for
where
| (A1) |
with being the number of observed survival times, and
In Equation (A1), we use the quadratic piece‐wise approximation proposed by Xian et al. to approximate :
| (A2) |
where and with , , , and . Then, we obtain,
Let
and
Then, is .
(2) Update equation for
where
| (A3) |
and
We again apply the quadratic approximation in (A2) to (A3), and obtain
Let
and
Then, is .
(3) Update equation for
where
| (A4) |
and
since we assume the prior b∼ Inverse‐Gamma (α_0,ω_0). In Equation (A4), we apply the linear piece‐wise approximation proposed by Xian et al. to approximate to achieve conjugacy:
where with , , , , and .
Then, we obtain
Let and
we have is .
(4) Update equation for
where
and .
Therefore,
Let and
is an .
Appendix B. ELBO Calculation
We now present details of calculating in the ELBO defined in (5).
Note that
which is always a constant at each iteration and therefore we ignore it.
Since for , and therefore,
which is a constant, and we can ignore it.
Since does not change at each iteration, we remove in the calculation of the ELBO.
Since does not change at each iteration, we remove in the calculation of the ELBO.
Appendix C. Real Data Analysis
TABLE C1.
Results for ICU ventilation duration analysis: Posterior means (Mean) with 95% credible intervals (95% Cred. Int.) from the VB algorithms and MCMC‐based survregbayes, respectively. Point estimates (Est.) with 95% confidence interval (95% Conf. Int.) from the h‐likelihood survregHL and survreg methods.
| With frailty | Without frailty | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| survregVBfrailty | survregHL | survregbayes | survreg | survregVB | |||||||
| Mean | 95% Cred. Int. | Est. | 95% Conf. Int. | Mean | 95% Cred. Int. | Est. | 95% Conf. Int. | Mean | 95% Cred. Int. | ||
| Admission Source | |||||||||||
| Downstream (ref) | — | — | — | — | — | — | — | — | — | — | |
| ED | −0.117 | [−0.158, −0.076] | −0.112 | [−0.160, −0.064] | −0.114 | [−0.160, −0.068] | −0.126 | [−0.168, −0.085] | −0.125 | [−0.166, −0.083] | |
| Home | 0.097 | [−0.018, 0.212] | 0.115 | [−0.019, 0.249] | 0.108 | [−0.023, 0.240] | 0.082 | [−0.037, 0.201] | 0.080 | [−0.038, 0.197] | |
| Hospital | 0.107 | [0.062, 0.151] | 0.093 | [0.042, 0.144] | 0.103 | [0.072, 0.134] | 0.084 | [0.040, 0.129] | 0.087 | [0.042, 0.132] | |
| OR | −0.329 | [−0.374, −0.285] | −0.305 | [−0.358, −0.252] | −0.325 | [−0.357, −0.294] | −0.342 | [−0.387, −0.296] | −0.341 | [−0.387, −0.296] | |
| Other | 0.181 | [0.066, 0.295] | 0.170 | [0.043, 0.297] | 0.171 | [0.059, 0.283] | 0.205 | [0.088, 0.322] | 0.210 | [0.094, 0.325] | |
| Ward | −0.143 | [−0.185, −0.100] | −0.133 | [−0.181, −0.084] | −0.143 | [−0.161, −0.124] | −0.145 | [−0.187, −0.102] | −0.146 | [−0.188, −0.103] | |
| Diagnosis | |||||||||||
| Cardiovascular (ref) | — | — | — | — | — | — | |||||
| Gastrointestinal | 0.267 | [0.229, 0.304] | 0.252 | [0.206, 0.298] | 0.258 | [0.206, 0.308] | 0.271 | [0.232, 0.309] | 0.271 | [0.232, 0.309] | |
| Neurological | 0.278 | [0.243, 0.314] | 0.276 | [0.234, 0.318] | 0.273 | [0.234, 0.313] | 0.293 | [0.258, 0.329] | 0.292 | [0.256, 0.328] | |
| Other | 0.381 | [0.355, 0.407] | 0.357 | [0.326, 0.388] | 0.387 | [0.358, 0.416] | 0.384 | [0.358, 0.410] | 0.383 | [0.357, 0.410] | |
| Trauma | 0.556 | [0.506, 0.606] | 0.515 | [0.456, 0.574] | 0.535 | [0.482, 0.588] | 0.565 | [0.514, 0.616] | 0.568 | [0.517, 0.619] | |
| Patient type | |||||||||||
| Medical (ref) | — | — | — | — | — | — | |||||
| Surgical | −0.006 | [−0.049, 0.036] | −0.009 | [−0.058, 0.041] | −0.007 | [−0.058, 0.044] | −0.012 | [−0.055, 0.031] | −0.015 | [−0.058, 0.029] | |
| Scheduled Admission | |||||||||||
| No (ref) | — | — | — | — | — | — | |||||
| Yes | −0.270 | [−0.313, −0.226] | −0.286 | [−0.340, −0.231] | −0.278 | [−0.333, −0.223] | −0.299 | [−0.343, −0.254] | −0.287 | [−0.331, −0.242] | |
| Scheduled Surgery | |||||||||||
| No (ref) | — | — | — | — | — | — | |||||
| Yes | −0.132 | [−0.178, −0.087] | −0.121 | [−0.176, −0.065] | −0.128 | [−0.169, −0.087] | −0.131 | [−0.177, −0.084] | −0.134 | [−0.180, −0.087] | |
| Referral | |||||||||||
| Medical (ref) | — | — | — | — | — | — | |||||
| Other | −0.022 | [−0.055, 0.011] | −0.022 | [−0.062, 0.018] | −0.023 | [−0.060, 0.014] | −0.041 | [−0.075, −0.008] | −0.042 | [−0.076, −0.009] | |
| Respirology | 0.165 | [0.113, 0.217] | 0.155 | [0.091, 0.219] | 0.160 | [0.101, 0.220] | 0.177 | [0.124, 0.230] | 0.178 | [0.126, 0.231] | |
| Surgical | −0.065 | [−0.104, −0.027] | −0.065 | [−0.111, −0.019] | −0.068 | [−0.119, −0.017] | −0.048 | [−0.087, −0.009] | −0.049 | [−0.088, −0.010] | |
| Other Interventions | |||||||||||
| No (ref) | — | — | — | — | — | — | |||||
| Yes | 0.085 | [0.068, 0.102] | 0.090 | [0.068, 0.111] | 0.087 | [0.066, 0.108] | 0.060 | [0.043, 0.078] | 0.060 | [0.042, 0.077] | |
| CVL | |||||||||||
| No (ref) | — | — | — | — | — | — | |||||
| Yes | 0.185 | [0.163, 0.207] | 0.173 | [0.147, 0.199] | 0.191 | [0.161, 0.221] | 0.198 | [0.176, 0.220] | 0.200 | [0.178, 0.222] | |
| AL | |||||||||||
| No (ref) | — | — | — | — | — | — | |||||
| Yes | 0.198 | [0.175, 0.222] | 0.175 | [0.147, 0.203] | 0.188 | [0.162, 0.214] | 0.201 | [0.178, 0.225] | 0.204 | [0.180, 0.228] | |
| IPM | |||||||||||
| No (ref) | — | — | — | — | — | — | |||||
| Yes | 0.540 | [0.473, 0.607] | 0.487 | [0.413, 0.562] | 0.570 | [0.513, 0.628] | 0.551 | [0.483, 0.618] | 0.550 | [0.482, 0.618] | |
| EMO | |||||||||||
| No (ref) | — | — | — | — | — | — | |||||
| Yes | 0.888 | [0.789, 0.988] | 0.810 | [0.705, 0.915] | 0.896 | [0.765, 1.028] | 0.963 | [0.862, 1.064] | 0.964 | [0.862, 1.066] | |
| IABP | |||||||||||
| No (ref) | — | — | — | — | — | — | |||||
| Yes | 0.384 | [0.316, 0.452] | 0.338 | [0.260, 0.416] | 0.350 | [0.264, 0.436] | 0.362 | [0.293, 0.432] | 0.356 | [0.286, 0.426] | |
| Age | |||||||||||
| 18‐39 (ref) | — | — | — | — | — | — | |||||
| 40‐80 | 0.127 | [0.098, 0.156] | 0.111 | [0.077, 0.145] | 0.133 | [0.106, 0.159] | 0.109 | [0.080, 0.138] | 0.110 | [0.080, 0.139] | |
|
|
0.074 | [0.040, 0.108] | 0.064 | [0.023, 0.105] | 0.069 | [0.030, 0.108] | 0.055 | [0.020, 0.090] | 0.056 | [0.021, 0.091] | |
| Pre‐LOS | |||||||||||
| day (ref) | — | — | — | — | — | — | |||||
| 2‐7 days | 0.041 | [0.018, 0.064] | 0.044 | [0.014, 0.073] | 0.041 | [0.010, 0.072] | 0.045 | [0.021, 0.069] | 0.044 | [0.021, 0.068] | |
| days | 0.122 | [0.097, 0.146] | 0.141 | [0.110, 0.172] | 0.144 | [0.119, 0.169] | 0.132 | [0.107, 0.158] | 0.131 | [0.106, 0.157] | |
| MODS | |||||||||||
| None (ref) | — | — | — | — | — | — | |||||
| Minimal | 0.095 | [0.068, 0.123] | 0.086 | [0.050, 0.122] | 0.093 | [0.062, 0.124] | 0.077 | [0.049, 0.105] | 0.076 | [0.048, 0.104] | |
| Mild | 0.208 | [0.182, 0.235] | 0.187 | [0.152, 0.223] | 0.198 | [0.165, 0.231] | 0.179 | [0.152, 0.206] | 0.176 | [0.149, 0.203] | |
| Moderate | 0.257 | [0.224, 0.290] | 0.240 | [0.198, 0.282] | 0.245 | [0.202, 0.288] | 0.236 | [0.202, 0.269] | 0.234 | [0.201, 0.268] | |
| Severe | 0.114 | [0.046, 0.183] | 0.100 | [0.023, 0.177] | 0.114 | [0.038, 0.191] | 0.111 | [0.043, 0.179] | 0.107 | [0.039, 0.175] | |
Xian C., P. E. de Souza C., He W., Rodrigues F. F., and Tian R., “Fast Variational Bayesian Inference for Correlated Survival Data: An Application to Invasive Mechanical Ventilation Duration Analysis,” Statistics in Medicine 44, no. 15‐17 (2025): e70198, 10.1002/sim.70198.
Funding: This work was supported by the Natural Sciences and Engineering Research Council of Canada (RGPIN‐2019‐05915).
Data Availability Statement
The ICU data analyzed in Section 5 were from Critical Care Information System (CCIS) Ontario database. Under the authors' data use agreement, they are unable to share the files directly.
References
- 1. Luo S., Yi M., Huang X., and Hunt K. K., “A Bayesian Model for Misclassified Binary Outcomes and Correlated Survival Data With Applications to Breast Cancer,” Statistics in Medicine 32, no. 13 (2013): 2320–2334. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Honerkamp‐Smith G. and Xu R., “Three Measures of Explained Variation for Correlated Survival Data Under the Proportional Hazards Mixed‐Effects Model,” Statistics in Medicine 35, no. 23 (2016): 4153–4165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Liu X. R., Pawitan Y., and Clements M. S., “Generalized Survival Models for Correlated Time‐To‐Event Data,” Statistics in Medicine 36, no. 29 (2017): 4743–4762. [DOI] [PubMed] [Google Scholar]
- 4. Hougaard P., “Frailty Models for Survival Data,” Lifetime Data Analysis 1 (1995): 255–273. [DOI] [PubMed] [Google Scholar]
- 5. Hanagal D. D., Modeling Survival Data Using Frailty Models (Springer, 2011). [Google Scholar]
- 6. Gorfine M. and Zucker D. M., “Shared Frailty Methods for Complex Survival Data: A Review of Recent Advances,” Annual Review of Statistics and Its Application 10 (2023): 51–73. [Google Scholar]
- 7. Canadian Institute for Health Information , Care in Canadian ICUs. Technical Report, Canadian Institute for Health Information; Canada (2020).
- 8. Marshall J. C., Cook D. J., Christou N. V., Bernard G. R., Sprung C. L., and Sibbald W. J., “Multiple Organ Dysfunction Score: A Reliable Descriptor of a Complex Clinical Outcome,” Critical Care Medicine 23, no. 10 (1995): 1638–1652. [DOI] [PubMed] [Google Scholar]
- 9. Kobara Y. M., Wismer M., Rodrigues F. F., and de Souza C. P. E., “Invasive Mechanical Ventilation Duration Prediction Using Survival Analysis,” International Journal of Healthcare Management 18 (2023): 307–311. [Google Scholar]
- 10. J. F. Burgess, Jr. , Christiansen C. L., Michalak S. E., and Morris C. N., “Medical Profiling: Improving Standards and Risk Adjustments Using Hierarchical Models,” Journal of Health Economics 19, no. 3 (2000): 291–309. [DOI] [PubMed] [Google Scholar]
- 11. Glance L. G., Dick A. W., Osler T. M., and Mukamel D., “Using Hierarchical Modeling to Measure ICU Quality,” Intensive Care Medicine 29, no. 12 (2003): 2223–2229, 10.1007/s00134-003-1959-9. [DOI] [PubMed] [Google Scholar]
- 12. Lambert P., Collett D., Kimber A., and Johnson R., “Parametric Accelerated Failure Time Models With Random Effects and an Application to Kidney Transplant Survival,” Statistics in Medicine 23, no. 20 (2004): 3177–3192. [DOI] [PubMed] [Google Scholar]
- 13. Do Ha I., Lee Y., and Song J. K., “Hierarchical‐Likelihood Approach for Mixed Linear Models With Censored Data,” Lifetime Data Analysis 8 (2002): 163–176. [DOI] [PubMed] [Google Scholar]
- 14. Do Ha I., Jeong J. H., and Lee Y., Statistical Modelling of Survival Data With Random Effects: H‐Likelihood Approach (Springer, 2017). [Google Scholar]
- 15. Do Ha I., Noh M., and Lee Y., “frailtyHL: A Package for Fitting Frailty Models With H‐Likelihood,” R Journal 4, no. 2 (2012): 28. [Google Scholar]
- 16. Park E. and Do Ha I., “Penalized Variable Selection for Accelerated Failure Time Models With Random Effects,” Statistics in Medicine 38, no. 5 (2019): 878–892. [DOI] [PubMed] [Google Scholar]
- 17. Zhou H., Hanson T., and Zhang J., “Generalized Accelerated Failure Time Spatial Frailty Model for Arbitrarily Censored Data,” Lifetime Data Analysis 23 (2017): 495–515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Zhou H., Hanson T., and Zhang J., “spBayesSurv: Fitting Bayesian Spatial Survival Models Using R,” Journal of Statistical Software 92, no. 9 (2020): 1–33, 10.18637/jss.v092.i09. [DOI] [Google Scholar]
- 19. Bishop C., Pattern Recognition and Machine Learning (Springer, 2006). [Google Scholar]
- 20. Hoffman M. D., Blei D. M., Wang C., and Paisley J., “Stochastic Variational Inference,” Journal of Machine Learning Research 14 (2013): 1303–1347. [Google Scholar]
- 21. Ranganath R., Gerrish S., and Blei D., “Black Box Variational Inference,” in Artificial Intelligence and Statistics (PMLR, 2014), 814–822. [Google Scholar]
- 22. Jordan M. I., Ghahramani Z., Jaakkola T., and Saul L., “Introduction to Variational Methods for Graphical Models,” Machine Learning 37 (1999): 183–233. [Google Scholar]
- 23. Neville S. E., Palmer M., and Wand M., “Generalized Extreme Value Additive Model Analysis via Mean Field Variational Bayes,” Australian & New Zealand Journal of Statistics 53, no. 3 (2011): 305–330. [Google Scholar]
- 24. Pham T. H., Ormerod J. T., and Wand M., “Mean Field Variational Bayesian Inference for Nonparametric Regression With Measurement Error,” Computational Statistics & Data Analysis 68 (2013): 375–387, 10.1016/j.csda.2013.07.014. [DOI] [Google Scholar]
- 25. Luts J. and Wand M. P., “Variational Inference for Count Response Semiparametric Regression,” Bayesian Analysis 10, no. 4 (2015): 991–1023, 10.1214/14-BA932. [DOI] [Google Scholar]
- 26. Ray K. and Szabó B., “Variational Bayes for High‐Dimensional Linear Regression With Sparse Priors,” Journal of the American Statistical Association 117, no. 539 (2022): 1270–1281, 10.1080/01621459.2020.1847121. [DOI] [Google Scholar]
- 27. Lee C. Y. Y. and Wand M. P., “Streamlined Mean Field Variational Bayes for Longitudinal and Multilevel Data Analysis,” Biometrical Journal 58, no. 4 (2016): 868–895. [DOI] [PubMed] [Google Scholar]
- 28. Xian C., de Souza C. P. E., Jewell J., and Dias R., “Clustering Functional Data via Variational Inference,” Advances in Data Analysis and Classification (2024): 1–50. [Google Scholar]
- 29. da Cruz A. C., de Souza C. P. E., and Sousa P. H. T. O., “Fast Bayesian Basis Selection for Functional Data Representation With Correlated Errors,” arXiv (2024).
- 30. Blei D. M., Kucukelbir A., and McAuliffe J. D., “Variational Inference: A Review for Statisticians,” Journal of the American Statistical Association 112, no. 518 (2017): 859–877. [Google Scholar]
- 31. Epstein S. K. and Ciubotaru R. L., “Independent Effects of Etiology of Failure and Time to Reintubation on Outcome for Patients Failing Extubation,” American Journal of Respiratory and Critical Care Medicine 158, no. 2 (1998): 489–493. [DOI] [PubMed] [Google Scholar]
- 32. Xian C., de Souza C. P. E., He W., Rodrigues F. F., and Tian R., “Variational Bayesian Analysis of Survival Data Using a Log‐Logistic Accelerated Failure Time Model,” Statistics and Computing 34, no. 2 (2024): 67. [Google Scholar]
- 33. Robinson G. K., “That BLUP Is a Good Thing: The Estimation of Random Effects,” Statistical Science 6 (1991): 15–32. [Google Scholar]
- 34. Nolan T. H., Menictas M., and Wand M. P., “Streamlined Variational Inference With Higher Level Random Effects,” Journal of Machine Learning Research 21, no. 157 (2020): 1–62.34305477 [Google Scholar]
- 35. Lee C. Y. Y. and Wand M. P., “Variational Methods for Fitting Complex Bayesian Mixed Effects Models to Health Data,” Statistics in Medicine 35, no. 2 (2016): 165–188. [DOI] [PubMed] [Google Scholar]
- 36. Yao Y., “Yes, but did it Work?: Evaluating Variational Inference,” in Proceedings of Machine Learning Research, vol. 80 (PMLR, 2018). [Google Scholar]
- 37. Cox D. R. and Snell E. J., “A General Definition of Residuals,” Journal of the Royal Statistical Society. Series B, Statistical Methodology 30, no. 2 (1968): 248–265. [Google Scholar]
- 38. Choi S. and Cho H., “Accelerated Failure Time Models for the Analysis of Competing Risks,” Journal of the Korean Statistical Society 48 (2019): 315–326. [Google Scholar]
- 39. Beyersmann J., Allignol A., and Schumacher M., Competing Risks and Multistate Models With R (Springer Science & Business Media, 2011). [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The ICU data analyzed in Section 5 were from Critical Care Information System (CCIS) Ontario database. Under the authors' data use agreement, they are unable to share the files directly.
