Abstract
Informative terminal events often occur in the long term recurrent event follow-up studies. To reflect their effects on recurrent event processes explicitly, we propose a reversed nonparametric mean model for panel count data with a terminal event subject to right censoring. This model enjoys meaningful interpretation for applications and robustness for statistical inference. Treating the distribution of the right-censored terminal event time as a nuisance functional parameter, we develop a two-stage estimation procedure by combining the Kaplan-Meier estimator and nonparametric sieve estimation techniques. The consistency, convergence rate and asymptotic normality of the proposed nonparametric estimator are established. Then we construct a class of new statistics for two-sample test. The asymptotic properties of the new tests are established and evaluated by extensive simulation studies. Panel count data from Chinese Longitudinal Healthy Longevity study are analyzed using the proposed method for illustration.
Key words and phrases: Panel count data, Two-stage estimation, Nonparametric test, Terminal event, Monotone polynomial spline
1. Introduction
In longitudinal follow-up studies, recurrent events are the same type events that individuals may experience repeatedly. However, exact recurrent event times may not be observed in many practical applications. Instead, individuals can be examined at distinct time points, and the number of recurrent events between two observation time points are collected. Such data are socalled panel count data which frequently occur in medical follow-up studies and clinical trials. Many methods have been developed for the analysis of panel count data. For example, Sun and Kalbfeisch (1995), Wellner and Zhang (2000), Hu, Lagakos, and Lockhart (2009), and Lu, Zhang, and Huang (2007) studied nonparametric estimation of mean function of a underlying counting process with panel count data; Thall and Lachin (1988), Sun and Fang (2003), Zhang (2006), Balakrishnan and Zhao (2009), and Zhao and Zhang (2017) developed some nonparametric tests for comparison of mean functions of counting processes based on panel count data. Among others, Cheng and Wei (2000), Sun and Wei (2000), Hu, Sun, and Wei (2003), Sun, Tong, and He (2007), Wellner and Zhang (2007), Lu, Zhang, and Huang (2009), He et al. (2017), and Jiang, Su, and Zhao (2020) studied semiparametric regression models with panel count data, while Zhao et al. (2019) investigated a nonparametric regression model for panel count data analysis.
The recurrent events are often truncated by a terminal event such as death. A commonly used approach is a joint modeling approach through a shared frailty variable to deal with the correlation between the terminal event and recurrent event processes; see for example, Liu, Wolfe, and Huang (2004), Zhao, Zhou, and Sun (2011), Sun et al. (2012), Zhao, Li and Sun (2013a,b), and Zhou et al. (2017). However, these approaches do not exhibit an explicit effect of the terminal event on recurrent events, which is often the study of interest in scientific investigations. For example, Chan et al. (1995) found that the occurrences of AIDS-defending events were accumulated sharply before the death of the HIV-infected individuals; Lunney et al. (2003) claimed that the functional decline changed tremendously in the last year of the HIV-infected individuals. Directly modeling the effect of terminal event on recurrent events is a challenging task. Recently, Chan and Wang (2010) developed a backward model to study the behavior of recurrent events prior to a terminal event. Chan and Wang (2017) considered effects of covariates and extended the backward model to a semiparametric model. Kong et al. (2018) proposed a conditional model for longitudinal data by treating the terminal event time as a covariate. Our goal is to propose a reversed mean model for panel count data with an informative terminal event, and then to develop nonparametric inference procedures for comparing the mean functions of recurrent event processes that are likely truncated by a terminal event.
The main contributions of this work are fourfold. First, we propose a reversed nonparametric mean model for panel count data with a right-censored terminal event, where the nonparametric mean function is increasingly dependent on the terminal event time. Thus, the proposed model provides an intuitive interpretation of the effect of terminal event on recurrent event processes. Second, we develop a two-stage sieve-based nonparametric estimation procedure by treating the distribution function of the terminal event time as a nuisance functional parameter. Third, we establish the asymptotic properties of the proposed estimator by overcoming the challenges from both a nuisance functional parameter and a nonparametric estimator with a convergence rate slower than the standard rate . Fourth, we develop a class of nonparametric tests for comparison of mean functions of recurrent event processes with panel count data in the presence of informative terminal event.
The remainder of this paper is organized as follows. In Section 2, we present a reversed mean model anchoring at a terminal event and propose a two-stage nonparametric sieve-based estimation procedure. In Section 3, we establish the asymptotic properties of the proposed estimator. In Section 4, we propose a class of new test statistics for two-sample comparison and establish their asymptotic normality. In Section 5, we conduct simulation studies to demonstrate the finite-sample performance of the proposed methods. In Section 6, we apply the proposed methods to panel count data from Chinese Longitudinal Healthy Longevity study. Some concluding remarks are made in Section 7. All technical proofs are provided in the supplementary materials.
2. Model Setting and Estimation Procedure
Suppose that a counting process denotes the number of recurrent events occurring up to time , where is a fixed time point. Let be the observation times of , where represents the total number of observation times. Then the observed counting process is . Let and be the terminal event time and the censoring time, respectively. The time for the last observation is denoted by and whether the time is the terminal even time is denoted by . The observed data for subject consists of , where and . Let denote the sample of such panel count data from subjects.
To investigate the effect of terminal event on the recurrent event process, motivated by Chan and Wang (2010, 2017) and Kong et al. (2018), we consider a counting process denoting the event counts from time to the terminal event , and propose a reversed nonparametric mean model anchoring at the terminal event:
| (2.1) |
where is an unknown nondecreasing function with to ensure the identifiability of this model. In this paper, we propose to model the recurrent events anchoring at the terminal event time through (2.1). The advantage of this approach is to straightforwardly describe the behavior of the stochastic process from the terminal event while all the event counts can still be used for learning the model of the entire process. This model implies that , where . Noting that and , we obtain .
Let denote the underlying distribution function of . To make a valid inference for our proposed model, we consider the following data scenarios: (i) and are independent; (ii) The censoring event time is noninformative to . (iii) Given , the distribution of is non-informative to . Define and for with . A straightforward calculation yields that
hence we propose a least-squares based loss function
| (2.2) |
where and . A natural idea is to take the minimizer of defined in (2.2) as the estimator of the parameter. However, since the loss function involves an unknown distribution function , it is difficult to estimate and simultaneously. To tackle the problem, we propose a two-stage approach. Specifically, in Stage 1, we estimate by using the Kaplan-Meier (KM) estimator Kaplan and Meier, 1958). In Stage 2, is obtained by minimizing the loss function with respect to . Since the observed data of are used in both Stages 1 and 2, to distinguish them, we use the notation to represent the data when we obtain the KM estimator in Stage 1 without any ambiguity.
We adopt the spline-based sieve estimation method to estimate the nondecreasing function because of its numerical advantage and good statistical properties (Lu, Zhang and Huang, 2007, 2009). Let be a sequence of knots that partition into subintervals, where
Let and be the I-spline basis functions of order (Ramsay, 1988). We then define the functional space of the estimator for to be
Since is a monotone step function, as shown in Section S1 in the online Supplementary Material, minimizing the loss function is a quadratic programming with the constraint that for . Let , and the solution of quadratic programming be . Then the spline estimator of is .
3. Asymptotic Properties
To present the asymptotic results, we introduce some notation. Let be the th derivative of function . For , define
Denote the true value of to be . For
where denotes the collection of Borel sets, set
| (3.3) |
Then and are two measures on . For any functions , we define the metric as
where . For any , we define the metric as
where represents the norm. Denote the -neighbourhood of by for any small .
To establish the asymptotic properties of the proposed estimator, we assume:
(C1)
(C2) is absolutely continuous with respect to Lebesgue measure. Moreover, the density function has a uniform positive lower bound for all , where is a constant representing the minimum value of the support of .
(C3) .
(C4) The probability of censoring satisfies that 1.
- (C5) for . Moreover, we suppose that
and there is a constant such that
uniformly for . (C6) There is a constant such that .
(C7) for all with some constant .
Remark 1. Condition (C1) is standard in the literature of nonparametric estimation. Condition (C2) generally holds for the cumulative distribution function of a continuous random variable in view of applications. Condition (C3) requires that has finite second order central moment. Condition (C4) ensures the censoring rate between 0 and 1, which is commonly assumed in practice of survival data analysis. Condition (C5) is a regularity condition for monotone spline estimation, see Lu, Zhang, and Huang (2007, 2009). Condition (C6) is similar to Condition (C2) in Wellner and Zhang (2007), which indicates that the number of observations is bounded. Condition (C7) requires that the adjacent observation times are separable (Wellner and Zhang, 2007), which is generally the case in applications.
Theorem 1 (Consistency for the Two-Stage Estimator). Suppose that Conditions (C1)-(C7) hold. Then, for every satisfying , we have
In particular, if , then .
To establish the rate of convergence and the asymptotic normality, we further assume:
(C8) is absolutely continuous with respect to Lebesgue measure with a derivative , and has a uniform positive lower bound.
(C9) There is a constant such that for all with such that .
(C10) and .
(C11) is uniformly bounded for and some constant .
Remark 2. Condition (C8) implies that the metric defined in (3.3) has a strictly positive intensity. Condition (C9) requires the true conditional mean function be absolutely continuous with bounded intensity function, which is reasonable as explained in Wellner and Zhang (2007). (C10) is used as a technical condition in the proof of the uniform weak convergence rate of the KM estimator according to Kong et al. (2018). Condition (C11) holds when is from a Poisson-type process or is uniformly bounded conditional on terminal event time, which is also generally true in view of applications.
Theorem 2 (Rate of Convergence). Suppose that Conditions (C1)-(C11) hold and . Taking , we have .
To present the asymptotic normality, we introduce more notation. Let and denote probability measure and empirical measure with and , respectively. Write . Let be the space of bounded functionals on under the norm. For , define a sequence of maps of a neighborhood of , denoted by , in the parameter space for into as the derivative of with respect to in the direction :
and define , where
with . Furthermore, define
with
and
with
Theorem 3 (Asymptotic Normality). Suppose that Conditions (C1)-(C11) hold and .
- Then for any bounded function , we have
-
Moreover, , where
and is defined in the online Supplementary Material.
4. Two-Sample Test
Suppose that subjects are from two groups with corresponding sample sizes and , where . Denote the observed data of the th group as , for . Given the terminal event time , the conditional mean function of is .
4.1. Terminal Events with an Identical Distribution
In this subsection, we assume that terminal event times share the same distribution function for all the subjects so that its estimator can be obtained based on the pooled data. We investigate two-sample test with the null hypothesis . Denote and as the estimates of and based on the data set of group and the pooled data, respectively.
Theorem 4 (Two-Sample Test with an Identical Distribution of Terminal Events). In addition to the conditions in Theorem 3, we suppose that is a bounded weight process, and there is a bounded function such that
Assume that as , where . Then under converges in distribution to , where . Moreover, can be consistently estimated by .
Remark 5. Theorem 4 states the asymptotic normality of the new statistic and gives a consistent estimator of its asymptotic variance. Then the -specific standardized statistic, can be applied to conduct the two-sample hypothesis test. A natural choice is to take . Other possible choices of the weight processes are explored and evaluated in the simulation studies. It is worth noting that the weight process is only required to be bounded, which is more flexible compared to the monotone condition in Zhang (2006) and Balakrishnan and Zhao (2009).
4.2. Terminal Events with Different Distributions
In this subsection, we assume the distribution and density functions of to be and , which may be different for the two groups. Let and be the estimator of and , respectively. Given a partition , we define the histogram-type estimators of as for following Földes, Rejtő, and Winter (1981). Set ,
where for .
Theorem 5 (Two-Sample Test with Different Distributions of Terminal Events). Suppose that the conditions in Theorem 4 hold for each group and ‘s are Lipschitz continuous. Then for , under the null hypothesis we have
-
converges in distribution to , where
with defined in the online Supplementary Material.
-
In addition, suppose the knots of partition satisfyas . Then can be consistently estimated by , and the asymptotic variance of can be consistently estimated by , where
with defined in the online Supplementary Material.
According to Theorem 5, we can apply the statistics to test the equality of the mean function of counting processes under the scenario of different terminal event time distributions between the two samples.
5. Simulation Studies
5.1. Two-Stage Estimation for the Mean Function
We conducted simulation studies to evaluate the finite-sample performance of the two-stage estimator with sample size and 200. For subject , the observation was generated as below. The latent terminal event time was from 6 + exp(1), and the censoring time was from . The study ending time was set at . The values of were chosen to be 1.375 and 0.500 such that the terminal events were censored by 20% and 40%, respectively, in the study. Let and . The number of observation was generated from the discrete uniform distribution in . Given the censored terminal event time , observation time was an ordered sample from uniform distribution . Let be a Poisson process with and , which means that was from Poisson distribution with mean , and was from Poisson distribution with mean . For the knots of spline, took and let be quartiles of . All simulation studies were based on 1000 replications.
Figure 1 shows the results of two-stage estimators for the conditional mean functions. The solid line represents the true mean function, the dashed line represents the average of the estimated mean function, and the dotted-dash lines represent the 2.5% and 97.5% pointwise percentiles of the functional estimator based on 1000 replications. From (a)-(d) in Figure 1, we can conclude that the sample mean of the estimated mean functions is very close to the true one, the degree of the variability of the functional estimator decreases as the sample increases indicating the asymptotic unbiasedness of the proposed method, and the sampling distribution of the estimator does not appear to be much impacted by the censoring rate.
Figure 1:

Estimates of the mean function.
5.2. Two-Sample Test with an Identical Distribution of Terminal Event Time
We conducted the two-sample test under the scenario where the two groups have a same distribution of terminal event time. We generated two groups of independent and identically distributed sample by the same way as in Subsection 5.1 for , with sample size , 150 or 200. Let be a Poisson process with for the th group. We considered the following two cases:
We took in Case 1 and in Case 2.
Figure 2 plots the true mean functions for the two cases with different values of . It can be seen that the conditional mean functions of two groups in Case 1 do not overlap but they cross over in Case 2. The weight processes in Theorem 4 were chosen to be
The results of the simulation study were evaluated with 1000 replications.
Figure 2:

Discrepancy of the mean functions
Figure 3 presents the quantile plots of the test statistics with the three weight processes against the standard normal distribution for Case 1 with and censoring rate 20%. They demonstrate that the normality of the test statistics is generally satisfactory with sample size of 200. Similar results were obtained for other situations and hence were not presented here.
Figure 3:

Q-Q plots for , and censoring rate = 20% when the distribution functions of the terminal event time are identical for the two groups.
Tables 1 and 2 report the sizes and powers of the proposed test statistics with the three weight processes at significance level 0.05 for different values of for Cases 1 and 2, respectively, where represents the test statistic with the th weight process for . The simulation results show that the proposed test possesses good properties: (i) the estimated sizes are all around the significance level of 0.05; (ii) for any fixed value of in both cases, the power increases when sample size increases; (iii) the power increases to 1 when the discrepancy of the mean functions becomes more evident implying the consistency of the proposed test; (iv) the test powers also appear not to be much impacted by the censoring rate.
Table 1:
Simulation results of the two-sample tests with different weights for Case 1 when the distribution functions of the terminal event time are identical for the two groups.
| Censoring rate 20% | Censoring rate 40% | |||||
|---|---|---|---|---|---|---|
| n1=n2=100 | ||||||
| 1 | 0.051 | 0.047 | 0.052 | 0.052 | 0.048 | 0.051 |
| 1.1 | 0.242 | 0.229 | 0.243 | 0.258 | 0.240 | 0.255 |
| 1.2 | 0.728 | 0.703 | 0.728 | 0.715 | 0.690 | 0.717 |
| 1.3 | 0.967 | 0.956 | 0.967 | 0.962 | 0.956 | 0.960 |
| n1=n2=150 | ||||||
| 1 | 0.048 | 0.047 | 0.048 | 0.049 | 0.048 | 0.048 |
| 1.1 | 0.359 | 0.344 | 0.361 | 0.355 | 0.338 | 0.354 |
| 1.2 | 0.873 | 0.851 | 0.873 | 0.877 | 0.859 | 0.878 |
| 1.3 | 0.996 | 0.989 | 0.996 | 0.995 | 0.991 | 0.995 |
| n1=n2=200 | ||||||
| 1 | 0.042 | 0.044 | 0.043 | 0.043 | 0.051 | 0.043 |
| 1.1 | 0.438 | 0.398 | 0.443 | 0.467 | 0.433 | 0.467 |
| 1.2 | 0.944 | 0.924 | 0.943 | 0.954 | 0.939 | 0.954 |
| 1.3 | 1.000 | 1.000 | 1.000 | 0.999 | 0.998 | 0.999 |
Table 2:
Simulation results of the two-sample tests with different weights for Case 2 when the distribution functions of the terminal event time are identical for the two groups.
| Censoring rate 20% | Censoring rate 40% | |||||
|---|---|---|---|---|---|---|
| n1=n2=100 | ||||||
| 1 | 0.999 | 1.000 | 0.752 | 1.000 | 1.000 | 0.868 |
| 3 | 0.982 | 0.971 | 0.859 | 0.987 | 1.000 | 0.892 |
| 5 | 0.998 | 1.000 | 0.991 | 0.999 | 1.000 | 0.991 |
| n1=n2=150 | ||||||
| 1 | 1.000 | 1.000 | 0.900 | 1.000 | 1.000 | 0.960 |
| 3 | 0.998 | 1.000 | 0.949 | 0.998 | 1.000 | 0.970 |
| 5 | 1.000 | 1.000 | 0.998 | 1.000 | 1.000 | 0.999 |
| n1=n2=200 | ||||||
| 1 | 1.000 | 1.000 | 0.941 | 1.000 | 1.000 | 0.977 |
| 3 | 1.000 | 1.000 | 0.986 | 1.000 | 1.000 | 0.989 |
| 5 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
5.3. Two-Sample Test with Different Distributions of Terminal Event Times
We conducted a parallel simulation study to evaluate the proposed two-sample test for two groups with different distributions of terminal event time. The data sets were generated in a similar mechanism as in Subsection 5.2 except that the terminal event times and were from 6 + exp(1) and 6 + exp(2), and the censoring times and were from and , where and (0.500, 1.010) to result in 20% and 40% censoring rate, respectively. The three weight processes were similarly chosen as
To calculate the histogram-type estimators of , we evenly divided into 5 subintervals. The results of the simulation study were again evaluated with 1000 replications.
Figure 4 presents the quantile plots of the test statistics with the three weight processes against the standard normal distribution with and censoring rate 20% for Case 1. The normality of the test statistics does appear to be justified when sample size is 200. The plots for other situations are similar and hence not presented here. Tables 3 and 4 summarize the sizes and powers of proposed statistics at significance level 0.05 for Cases 1 and 2, respectively, which results in the same conclusions as those in Subsection 5.2.
Figure 4:

Q-Q plots for , and censoring rate = 20% when the distribution functions of the terminal event time are different for the two groups.
Table 3:
Simulation results of the two-sample tests with different weights for Case 1 when the distribution functions of the terminal event time are different for the two groups.
| Censoring rate 20% | Censoring rate 40% | |||||
|---|---|---|---|---|---|---|
| n1=n2=100 | ||||||
| 1 | 0.056 | 0.061 | 0.061 | 0.068 | 0.056 | 0.072 |
| 1.1 | 0.231 | 0.221 | 0.231 | 0.260 | 0.241 | 0.260 |
| 1.2 | 0.688 | 0.664 | 0.693 | 0.721 | 0.687 | 0.717 |
| 1.3 | 0.960 | 0.956 | 0.960 | 0.956 | 0.951 | 0.955 |
| n1=n2=150 | ||||||
| 1 | 0.043 | 0.049 | 0.041 | 0.056 | 0.052 | 0.054 |
| 1.1 | 0.338 | 0.311 | 0.341 | 0.352 | 0.330 | 0.348 |
| 1.2 | 0.863 | 0.835 | 0.865 | 0.872 | 0.851 | 0.869 |
| 1.3 | 0.993 | 0.992 | 0.994 | 0.994 | 0.985 | 0.992 |
| n1=n2=200 | ||||||
| 1 | 0.046 | 0.048 | 0.045 | 0.058 | 0.057 | 0.060 |
| 1.1 | 0.447 | 0.427 | 0.450 | 0.469 | 0.451 | 0.469 |
| 1.2 | 0.951 | 0.933 | 0.953 | 0.952 | 0.941 | 0.954 |
| 1.3 | 1.000 | 0.998 | 1.000 | 0.999 | 0.999 | 0.998 |
Table 4:
Simulation results of the two-sample tests with different weights for Case 2 when the distribution functions of the terminal event time are different for the two groups.
| Censoring rate 20% | Censoring rate 40% | |||||
|---|---|---|---|---|---|---|
| n1=n2=100 | ||||||
| 1 | 1.000 | 1.000 | 0.834 | 1.000 | 1.000 | 0.926 |
| 3 | 0.986 | 1.000 | 0.884 | 0.999 | 1.000 | 0.947 |
| 5 | 0.997 | 1.000 | 0.987 | 1.000 | 1.000 | 0.996 |
| n1=n2=150 | ||||||
| 1 | 1.000 | 1.000 | 0.940 | 1.000 | 1.000 | 0.985 |
| 3 | 0.998 | 1.000 | 0.976 | 0.999 | 1.000 | 1.000 |
| 5 | 1.000 | 1.000 | 0.999 | 1.000 | 1.000 | 0.999 |
| n1=n2=200 | ||||||
| 1 | 1.000 | 1.000 | 0.972 | 1.000 | 1.000 | 0.990 |
| 3 | 1.000 | 1.000 | 0.994 | 1.000 | 1.000 | 0.995 |
| 5 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
6. Real Data Analysis
In this section, we applied our method to analyzing the dataset from Chinese Longitudinal Healthy Longevity Survey (CLHLS) during the period from 1998 to 2014 (Zeng et al., 2017). This survey was conducted by the Center for Healthy Aging and Development Studies (CHADS) of National School of Development at Peking University and Chinese Center for Disease Control and Prevention (CDC) to study the determinants of healthy human longevity and the later-life mortality. The data consist of survey information in the seven waves at 1998, 2000, 2002, 2005, 2008, 2011 and 2014 by interviewing 9093 respondents who were 77 years or older in the 1998 baseline survey. In each wave, the respondents were asked to provide information regarding their health, socioeconomic status, family, lifestyle and demographic profile on a date randomly chosen in the interview year.
For this dataset, we analyzed panel count data of serious illness before death, for which the serious illness is defined as the illness making people bedridden, and compared the incidences of serious illness among elderly people living in different areas during the whole study period. The incidences of serious illness were counted repeatedly if the respondents were confined to bed again after recovering from the previous serious illness. We chose to analyze data for those subjects who had at least one follow-up observation after 1998 to allow for a meaningful analysis of panel count data. Therefore, we included 4362 elders for analysis by removing 3368 individuals, among which 2,005 dies in 2000 or between 1998 and 2000; 894 lost to follow-up in 2000, and 469 had missing or mistakenly documented records. Among the 4362 individuals, 1489 and 1561 lived in the urban and rural areas, respectively, all the time, and 1312 lived in both areas during this period. For the th individual, we defined as the time in month between the survey and the baseline survey, as the accumulated number of serious illness that the individual suffered up to time , and as the total number of follow-up surveys in the study. Death was the terminal event and loss to follow-up was treated as censoring event to death. In sum, the longest follow-up time was (months) and the censoring rate was 25.72%.
We studied the mean function of the serious illness process using model (2.1). We estimated the mean function using I-spline with order and to divide into 4 subintervals with the internal knots of splines selected at . Figure 5 plots the estimated mean functions for the combined sample (solid line), urban sample (dash line), rural sample (dotted-dash line), and duo-area sample (longdash line), respectively. It reveals that the urban-area residents tended to experience more serious illnesses than the rural-area and duo-area residents, which may be the outcome that the rural-area and duo-area residents had limited access to advanced medical system compared to their counterparts in the urban area.
Figure 5:

The two-stage estimates of the mean function for the CLHLS data.
We then used the same three weight functions as those in Subsection 5.2 to conduct the two-sample test for each pair of two mean functions for the urban sample, rural sample, and duo-area sample. That is the null hypotheses were , and , where , and are the corresponding mean functions for the urban sample, rural sample, and duo-area sample, respectively. To conduct the test, we first concluded by the log-rank test that the survival function of death for the urban-area residents was significantly different from the rural-area residents and the duo-area residents with -values and 0.006, respectively. Furthermore, the log-rank test revealed that the survival functions of death for the rural-area residents were not significantly different from the duo-area residents with -value =0.09. Figure 6 displays the KM estimates for the survival functions of death for elders in the three groups. Therefore, we used the test statistic in Theorem 4 to compare the mean functions for the rural-area and duo-area residents. For the tests and , we divided evenly into 8 subintervals to obtain the histogram-type estimators, and then applied the test statistic in Theorem 5. The test results are summarized in Table 5 suggesting a significant difference in later-life serious illness experience at level 0.01 between the urban-area and the rural-area residents, and between the urban-area and the duo-area residents. Though there is no significant difference in the mean function between the duo-area and rural-area residents from a statistical perspective (p-value >0.05), the duoarea residents seemed to have fewer incidences of severe illness compared to rural-area residents. It may be due to the facts that: (i) many rural-area residents were transitioned to urban along with the urbanization movement in China in recent years; (ii) the elder duo-area residents tend to be in a better family socioeconomic status with better health status compared to other rural-area residents. The conclusion was consistent regardless of the choice of the weight processes.
Figure 6:

The KM estimates of the survival function for the CLHLS data.
Table 5:
Two-sample test results with the three weights for the CLHLS data.
| 287.904 | 3.968 | 4.325 | |
| 77.849 | 1.138 | 1.182 | |
| 3.698 | 3.488 | 3.659 | |
| p-value | < 0.001*** | < 0.001*** | < 0.001*** |
| 368.945 | 4.132 | 5.225 | |
| 79.298 | 1.193 | 1.205 | |
| 4.653 | 3.465 | 4.335 | |
| p-value | < 0.001*** | < 0.001*** | < 0.001*** |
| 84.872 | 0.384 | 0.932 | |
| 66.322 | 0.957 | 0.833 | |
| 1.280 | 0.401 | 1.119 | |
| p-value | 0.201 | 0.688 | 0.263 |
(or : the observed value of the test statistic with different weight functions;
represents significance level of 0.01
7. Discussion
Considering the potential association between recurrent event and terminal event processes that often occur in life sciences, we have developed a conditional nonparametric mean functional model to study the explicit effects of the terminal events on the recurrent event process with panel count data. This approach is particularly useful in ascertaining the recurrent event behavior prior to the terminal event. However, the approach has challenges in both numerical computation and statistical inference due to the nature of panel count data subject to informative termination. We have designed a two-stage spline-based estimation procedure to ease the computation burden, and studied the asymptotic behavior of the proposed nonparametric estimator using modern empirical process theories. In particular, the asymptotic normality can be readily expanded to address multi-sample hypothesis testing problems. Our extensive simulation studies have demonstrated the good performance of the proposed method in finite-sample settings.
The proposed method can be extended to consider a conditional semiparametric mean function model:
where and is the number of recurrent events up to time is the terminal event time, is a covariate vector, is an unknown parameter, and is an unknown nondecreasing baseline function. This model has a broader application that not only captures the effect of the terminal event but also allows to assess external risk factors on recurrent event process, and is currently under our investigation.
Supplementary Material
Acknowledgements
The authors are grateful to the Editor, Associate Editor, and two referees for their valuable comments and suggestions that greatly improved the paper. This work is supported in part by the Research Grant Council of Hong Kong (15301218, 15303319) for Xingqiu Zhao and by NIH/NIGMS (2 U54 GM115458-06) for Ying Zhang.
Footnotes
Supplementary Materials
The online Supplementary Materials provide the calculation of the loss function, some preliminary lemmas, the proofs of Theorems 1–5, some additional works on simulation studies and the real data analysis.
References
- Balakrishnan N, and Zhao X (2009). New multi-sample nonparametric tests for panel count data. Annals of Statistics 37, 1112–1149. [Google Scholar]
- Chan KCG, and Wang M-C (2010). Backward estimation of stochastic processes with failure events as time origins. Annals of Applied Statistics 4, 1602–1620. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chan KCG, and Wang M-C (2017). Semiparametric modeling and estimation of the terminal behavior of recurrent marker processes before failure events. Journal of the American Statistical Association 112, 351–362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chan SF, Neaton JD, Saravolatz LD, Crane LR, and James Osterberger for the Community Programs for Clinical Research on AIDS. (1995). Frequencies of opportunistic diseases prior to death among HIV-infected persons. Aids 9, 1145–1151. [DOI] [PubMed] [Google Scholar]
- Cheng SC, and Wei LJ (2000). Inferences for a semiparametric model with panel data. Biometrika 87, 89–97. [Google Scholar]
- Földes A, Rejtő L, and Winter BB (1981). Strong consistency properties of nonparametric estimators for randomly censored data, II: Estimation of density and failure rate. Periodica Mathematica Hungarica 12, 15–29. [Google Scholar]
- Harrington DP, and Fleming TR (1982). A class of rank test procedures for censored survival data. Biometrika 69, 553–566. [Google Scholar]
- He X, Feng X, Tong X, and Zhao X (2017). Semiparametric partially linear varying coefficient models with panel count data. Lifetime Data Analysis 23, 439–466. [DOI] [PubMed] [Google Scholar]
- Hu XJ, Lagakos SW, and Lockhart RA (2009). Generalized least squares estimation of the mean function of a counting process based on panel counts. Statistica Sinica 19, 561–580. [PMC free article] [PubMed] [Google Scholar]
- Hu XJ, Sun J, and Wei LJ (2003). Regression parameter estimation from panel counts. Scandinavian Journal of Statistics 30, 25–43. [Google Scholar]
- Jiang H, Su W, and Zhao X (2020). Robust estimation for panel count data with informative observation times and censoring times. Lifetime Data Analysis 26, 65–84. [DOI] [PubMed] [Google Scholar]
- Kaplan EL, and Meier P (1958). Nonparametric estimation from incomplete observations. Journal of the American Statistical Association 53, 457–481. [Google Scholar]
- Kong S, Nan B, Kalbfleisch JD, Saran R, and Hirth R (2018). Conditional modeling of longitudinal data with terminal event. Journal of the American Statistical Association 113, 357–368. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Liu L, Wolfe RA, and Huang X (2004). Shared frailty models for recurrent events and a terminal event. Biometrics 60, 747–756. [DOI] [PubMed] [Google Scholar]
- Lu M, Zhang Y, and Huang J (2007). Estimation of the mean function with panel count data using monotone polynomial splines. Biometrika 94, 705–718. [Google Scholar]
- Lu M, Zhang Y, and Huang J (2009). Semiparametric estimation methods for panel count data using monotone B-splines. Journal of the American Statistical Association 104, 1060–1070. [Google Scholar]
- Lunney JR, Lynn J, Foley DJ, Lipson S, and Guralnik JM (2003). Patterns of functional decline at the end of life. Journal of Nonparametric Statistics 289, 2387–2392. [DOI] [PubMed] [Google Scholar]
- Ramsay JO (1988). Monotone regression splines in action. Statistical Science 3, 425–441. [Google Scholar]
- Sun J, and Fang HB (2003). A nonparametric test for panel count data. Biometrika 90, 199–208. [Google Scholar]
- Sun J, and Kalbfleisch JD (1995). Estimation of the mean function of point processes based on panel count data. Statistica Sinica 5, 279–290. [Google Scholar]
- Sun L, Song X, Zhou J, and Liu L (2012). Joint analysis of longitudinal data with informative observation times and a dependent terminal event. Journal of the American Statistical Association 107, 688–700. [Google Scholar]
- Sun J, Tong X, and He X (2007). Regression analysis of panel count data with dependent observation times. Biometrics 63, 1053–1059. [DOI] [PubMed] [Google Scholar]
- Sun J, and Wei LJ (2000). Regression analysis of panel count data with covariate-dependent observation and censoring times. Journal of the Royal Statistical Society: Series B 62, 293–302. [Google Scholar]
- Thall PF, and Lachin JM (1988). Analysis of recurrent events: Nonparametric methods for random-interval count data. Journal of the American Statistical Association 83, 339–347. [Google Scholar]
- van der Vaart AW, and Wellner JA (1996). Weak convergence and empirical processes. New York: Springer-Verlag. [Google Scholar]
- Wellner JA, and Zhang Y (2000). Two estimator of the mean of a counting process with panel count data. Annals of Statistics 28, 779–814. [Google Scholar]
- Wellner JA, and Zhang Y (2007). Two likelihood-based semiparametric estimation methods for panel count data with covariates. Annals of Statistics 35, 2106–2142. [Google Scholar]
- Zeng Y, Vaupel J, Xiao Z, Liu Y, and Zhang C Chinese Longitudinal Healthy Longevity Survey (CLHLS), 1998–2014. Ann Arbor, MI: Inter-university Consortium for Political and Social Research; [distributor], 2017-04-11. 10.3886/ICPSR36692.v1 [DOI] [Google Scholar]
- Zhang Y (2006). Nonparametric k-sample tests for panel count data. Biometrika 93, 777–790. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zhao H, Li Y, and Sun J (2013a). Analyzing panel count data with a dependent observation process and a terminal event. Canadian Journal of Statistics 41, 174–191. [Google Scholar]
- Zhao H, Li Y, and Sun J (2013b). Semiparametric analysis of multivariate panel count data with dependent observation processes and a terminal event. Journal of Nonparametric Statistics 25, 379–394. [Google Scholar]
- Zhao H, Zhang Y, Zhao X, and Yu Z (2019). A nonparametric regression model for panel count data analysis. Statistica Sinica 29, 809–826. [Google Scholar]
- Zhao X, and Zhang Y (2017). Asymptotic normality of nonparametric M-estimators with applications to hypothesis testing for panel count data. Statistica Sinica 27, 931–950. [Google Scholar]
- Zhao X, Zhou J, and Sun L (2011). Semiparametric transformation models with timevarying coefficients for recurrent and terminal events. Biometrics 67, 404–414. [DOI] [PubMed] [Google Scholar]
- Zhou J, Zhang H, Sun L, and Sun J (2017). Joint analysis of panel count data with an informative observation process and a dependent terminal event. Lifetime Data Analysis 23, 560–584. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
