Abstract
In this paper, the authors investigate the Berry-Esseen bounds of weighted kernel estimator for a nonparametric regression model based on linear process errors under a LNQD random variable sequence. The rate of the normal approximation is shown as under some appropriate conditions. The results obtained in the article generalize or improve the corresponding ones for mixing dependent sequences in some sense.
Keywords: weighted kernel estimator, LNQD sequence, Berry-Esseen bound, linear process
Introduction
We discuss that the estimation of the fixed design nonparametric regression model involves a regression function which is defined on a closed interval :
| 1.1 |
where are known fixed design points, we suppose to be ordered , and are random errors.
As we all know, model (1.1) has been considered extensively by many authors, e.g., Schuster and Yakowitz [1] studied the nonparametric model (1.1) with i.i.d. errors. They obtained the strong convergence and asymptotic normality of the estimator of , and Qin [2] obtained the strong consistency of the estimator of . Yang [3–5] studied the nonparametric model (1.1) with φ-mixing errors, censored data random errors and negatively associated errors. He obtained the complete convergence, strong consistency and uniformly asymptotic normality of the estimator of , respectively. Zhou et al. [6] studied the nonparametric model (1.1) with weakly dependent processes. They obtained the moment consistency, strong consistency, strong convergence rate and asymptotic normality of the estimator of , etc. Inspired by the literature above, we are devoted to investigating the Berry-Esseen bounds of the estimator for linear process errors in the nonparametric regression model (1.1).
In the article, we will discuss the Berry-Esseen bounds of the estimator of in the model (1.1) with repeated measurements. Here, we recall the weighted kernel estimator of nonparametric regression functions. A popular nonparametric estimate of is then
| 1.2 |
where is a Borel measurable function, as .
The weighted kernel estimator was first proposed by Priestley and Chao [7], who discussed the weak consistency conditions of , and subsequently it has been studied extensively by many authors. For instance, in the independent assumption, Benedetti [8] gave the sufficient condition for the strong consistency of under the condition of . Schuster and Yakowitz [1] discussed the uniformly strong consistency of . Qin [2] extended the moment condition to (as ). Under the mixing dependent assumption, Yang [3] and [9] not only comprehensively improved these results under φ-mixing and ρ-mixing, but reduced the condition to (as ), weakened the addition of the kernel function . Pan and Sun [10] extended this discussion to censored data and gave some sufficient conditions for strong consistency in the independent and φ-mixing case. Yang [4] discussed the consistency of weighted kernel estimators of a nonparametric regression function with censored data and obtained strong consistency under some more weakly sufficient conditions. But, up to now, there have been few results related to weighted kernel estimator for model (1.1) with linear process errors.
The Berry-Esseen theorem is the rate of convergence in the central limit theorem. There is a lot of literature regarding this kind of the Berry-Esseen bounds theorem. For the details, Cheng [11] established a Berry-Esseen type theorem showing the near-optimal quality of the normal distribution approximation to the distribution of smooth quantile density estimators. Wang and Zhang [12] obtained a Berry-Esseen type estimate for NA random variables with only finite second moment. They also improved the convergence rate result in the central limit theorem and precise asymptotics in the law of the iterated logarithm for NA and linearly negative quadrant dependent sequences. Liang and Li [13] derived the Berry-Esseen type bound based on linear process errors under negatively associated random variables. Li et al. [14] established the Berry-Esseen bounds of the wavelet estimator for a nonparametric regression model with linear process errors generated by φ-mixing sequences. Yang et al. [15] investigated the Berry-Esseen bound of sample quantiles for NA random variables, the rate of normal approximation is shown as , etc.
In this paper, we shall study the above nonparametric regression problem with linear process errors generated by a linearly negative quadrant dependent sequence.
Definition 1.1
([16])
Two random variables X and Y are said to be negative quadrant dependent (NQD in short) if, for any ,
Definition 1.2
([17])
A sequence of random variables is said to be linearly negative quadrant dependent (LNQD in short) if for any disjoint subsets and positive , and are NQD.
The concept of LNQD sequence was introduced by Newman [17], who investigated the central limit theorem for a strictly stationary LNQD process, and it subsequently has been studied by many authors. Wang and Zhang [12] provided the uniform rates of convergence in the central limit theorem for LNQD random variables. Ko et al. [18] established the Hoeffding-type inequality for a LNQD sequence. Ko et al. [19] discussed the strong convergence and central limit theorem for weighted sums of LNQD random variables. Wang et al. [20] presented some exponential inequalities and complete convergence for a LNQD sequence. Wang and Wu [21] gave some strong laws of large numbers and strong convergence properties for arrays of rowwise NA and LNQD random variables. Li et al. [22] established some inequalities and asymptotic normality of the weight function estimate of a regression function for a LNQD sequence. Shen et al. [23] investigated the complete convergence for weighted sums of LNQD random variables based on the exponential bounds and obtained some complete convergence for arrays of rowwise LNQD random variables, etc.
However, there are very few literature works on Berry-Esseen bounds of weighted kernel estimator for nonparametric regression model (1.1) with linear process errors. So, the main purpose of the paper is to investigate the Berry-Esseen bounds of weighted kernel estimator for nonparametric regression model with linear process errors generated by a LNQD sequence.
In what follows, let C be positive constants which may be different in various places. All limits are taken as the sample size n tends to ∞, unless specified otherwise.
The structure of the rest of the paper is as follows. In Section 2, we give some basic assumptions and main results. Some preliminary lemmas are stated in Section 3. Proofs of the main results are provided in Section 4. Authors’ declaration is given at the end of the paper.
Assumptions and main results
In order to facilitate the process, we write , , , , .
First, we make the following basic assumptions:
has a linear representation , where is a sequence of real numbers with , is a strictly stationary and LNQD sequence with , for some , and ;
satisfies the Lipschitz condition of order α () on , satisfies the Lipschitz condition of order β () on , , , where is bounded on ;
and as , as , let for ;
;
There exist two positive integers p and q such that , , and (), where , , , .
Remark 2.1
(A1) is a basic condition of the LNQD sequence, and conditions (A2)-(A3) are general assumption conditions of the weighted kernel estimator which have been used by some authors such as Yang [3, 4, 9], Pan and Sun [10].
Remark 2.2
Let be bounded, suppose that conditions (A2)-(A3) hold true. We have
Thus, (A4) can be assumed.
Remark 2.3
For (A5), , , are easily satisfied, if p, q are chosen reasonable, which is the same as in Yang [5] and Li et al. [14]. So, (A5) is a standard regularity condition used commonly in the literature.
Therefore, we can see that conditions (A1)-(A5) in this paper are suitable and reasonable.
Next, we give the main results as follows.
Theorem 2.1
Assume that (A1)-(A5) hold true, then for each , we can get that
Corollary 2.1
Assume that (A1)-(A5) hold true, then for each , we can get that
Corollary 2.2
Assume that (A1)-(A5) hold true, for some , and for some . We can get that
Observe, taking and as , it follows that .
Remark 2.4
We develop the weighted kernel estimator methods in the nonparametric regression model (1.1) which are different from estimation methods of Liang and Li [13], Li et al. [14]. Our theorem and corollaries improve Theorem 3.1 of Li et al. [22] for the case of linear process errors generated by LNQD sequences and also generalize the results of Li et al. [14] from linear process errors generated by LNQD sequences to the ones generated by φ-mixing sequences. So, our results obtained in the paper generalize and improve some corresponding ones for φ-mixing random variables to the case of LNQD setting.
Some preliminary lemmas
First, we have by (1.1) and (1.2) that
where
Let , where , , ,
where
then
Next, we give the following main lemmas.
Lemma 3.1
([3])
Let satisfy the Lipschitz condition of order β () on , and , , where is bounded on . Assume that and as , and as , then for any ,
Lemma 3.2
([22])
Let be a LNQD random variable sequence with zero mean and finite second moment . Assume that is a real constant sequence satisfying . Then, for any ,
Lemma 3.3
([22])
If are LNQD random variables with finite second moments, let and be characteristic functions of and , respectively, then for all nonnegative (or nonpositive) real numbers ,
Lemma 3.4
([14])
Suppose that , and are three random variable sequences, is a positive constant sequence, and . If , then for any and ,
Lemma 3.5
Assume that (A1)-(A5) hold true, we can get that
, , ;
, , .
Proof of Lemma 3.5
By Lemma 3.2 and assumptions (A4)-(A5), we can obtain that
This completes the proof of Lemma 3.5(1). In addition, Lemma 3.5(2) can be derived from the Markov inequality and Lemma 3.5(1) immediately. □
Lemma 3.6
Assume that (A1)-(A5) hold, write , we can get that
Let be independent random variables and , . Write . Then we get the following.
Proof of Lemma 3.6
Let , then . By , Lemma 3.5(1), the -inequality and the Cauchy-Schwarz inequality, it follows that
Hence, it has been found that
| 3.1 |
On the other hand, from the basic definition of LNQD sequence, Lemma 3.1, (A1) and (A4), we can prove that
| 3.2 |
Therefore, combining equations (3.1) and (3.2), we can get that
□
Lemma 3.7
Assume that (A1)-(A5) hold true and, applying these in Lemma 3.6, we can obtain that
Proof of Lemma 3.7
By using the Berry-Esseen inequality [24], we obtain
| 3.3 |
According to Lemma 3.1, Lemma 3.2, (A1), (A4) and (A5), we can get that
| 3.4 |
Hence, by Lemma 3.6, combining equations (3.3) and (3.4), we can obtain Lemma 3.7. □
Lemma 3.8
Assume that (A1)-(A5) hold, and applying this in Lemma 3.4, we can obtain that
Proof of Lemma 3.8
Suppose that and are the characteristic functions of and . Therefore, it follows from Lemma 3.3, (A1) and (A4) that
It is easily seen that
| 3.5 |
which implies
Consequently, from Lemma 3.7, it has been found
Therefore
| 3.6 |
Thus, combining equations (3.5) and (3.6), taking , it suffices to prove that
□
Proofs of the main results
Proof of Theorem 2.1
| 4.1 |
According to Lemma 3.8, Lemma 3.7 and Lemma 3.6, it follows that
| 4.2 |
| 4.3 |
| 4.4 |
Hence, by (4.1)-(4.4), we have that
| 4.5 |
Thus, by Lemma 3.4, Lemma 3.5(2) and (4.5), it suffices to prove that
□
Proof of Corollary 2.1
By (A1) we can easily see that , therefore Corollary 2.1 holds. □
Proof of Corollary 2.2
Let , . Taking , , we have by that
Therefore, the desired result is completed by Corollary 2.1 immediately. □
Acknowledgements
This research is supported by the National Natural Science Foundation of China (11271189, 11461057), 2017 Youth Teacher Research and Development Fund project of Guangxi University of Finance and Economics (2017QNA01).
Authors’ contributions
All authors contributed equally and read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Liwang Ding, Email: 2008dingliwang@163.com.
Ping Chen, Email: prob123@163.com.
Yongming Li, Email: lym1019@163.com.
References
- 1.Schuster E, Yakowitz S. Contributions to the theory of nonparametric regression, with application to system identification. Ann. Stat. 1979;7(1):139–149. doi: 10.1214/aos/1176344560. [DOI] [Google Scholar]
- 2.Qin YS. A result on the nonparametric estimation of regression functions. J. Eng. Math. 1989;6(3):120–123. [Google Scholar]
- 3.Yang SC. Consistency of weighted kernel estimator nonparametric regression functions under φ-mixing errors. Appl. Math. J. Chin. Univ. 1995;10(2):173–180. [Google Scholar]
- 4.Yang SC. The weighted kernel estimators of nonparametric regression function with censored data. Acta Math. Sin. 1999;42(2):255–262. [Google Scholar]
- 5.Yang SC. Uniformly asymptotic normality of the regression weighted estimator for negatively associated samples. Stat. Probab. Lett. 2003;62:101–110. doi: 10.1016/S0167-7152(02)00427-3. [DOI] [Google Scholar]
- 6.Zhou XC, Lin JG, Yin CM. Asymptotic properties of wavelet-based estimator in nonparametric regression model with weakly dependent processes. J. Inequal. Appl. 2013;2013:261. doi: 10.1186/1029-242X-2013-261. [DOI] [Google Scholar]
- 7.Priestley MB, Chao MT. Nonparametric function fitting. J. R. Stat. Soc. B. 1972;34(3):385–392. [Google Scholar]
- 8.Benedetti JK. On the nonparametric estimation of regression functions. J. R. Stat. Soc. B. 1977;39(2):248–253. [Google Scholar]
- 9.Yang SC. Moment inequality for mixing sequences and nonparametric estimation. Acta Math. Sin. 1997;40(2):271–279. [Google Scholar]
- 10.Pan JM, Sun YP. Strong consistency of the weighing kernel estimate of nonparametric regression function with censored data. Math. Stat. Appl. Probab. 1997;12(2):151–160. [Google Scholar]
- 11.Cheng C. A Berry-Esseen-type theorem of quantile density estimators. Stat. Probab. Lett. 1998;39(3):255–262. doi: 10.1016/S0167-7152(98)00064-9. [DOI] [Google Scholar]
- 12.Wang JF, Zhang LX. A Berry-Esséen theorem for weakly negatively dependent random variables and its applications. Acta Math. Hung. 2006;110(4):293–308. doi: 10.1007/s10474-006-0024-x. [DOI] [Google Scholar]
- 13.Liang HY, Li YY. A Berry-Esseen type bound of regression estimator based on linear process errors. J. Korean Math. Soc. 2008;45(6):1753–1767. doi: 10.4134/JKMS.2008.45.6.1753. [DOI] [Google Scholar]
- 14.Li YM, Wei CD, Xin GD. Berry-Esseen bounds of wavelet estimator in a regression with linear process errors. Stat. Probab. Lett. 2011;81(1):103–111. doi: 10.1016/j.spl.2010.09.024. [DOI] [Google Scholar]
- 15.Yang WZ, Hu SH, Wang XJ, Zhang QC. Berry-Esséen bound of sample quantiles for negatively associated sequence. J. Inequal. Appl. 2011;2011:83. doi: 10.1186/1029-242X-2011-83. [DOI] [Google Scholar]
- 16.Lehmann EL. Some concepts of dependence. Ann. Math. Stat. 1966;37:1137–1153. doi: 10.1214/aoms/1177699260. [DOI] [Google Scholar]
- 17.Newman CM. Asymptotic independence and limit theorems for positively and negatively dependent random variables. In: Tong YL, editor. Stat. Probab. Hayward: Inst. Math. Statist.; 1984. pp. 127–140. [Google Scholar]
- 18.Ko MH, Choi YK, Choi YS. Exponential probability inequality for linearly negative quadrant dependent random variables. Commun. Korean Math. Soc. 2007;22(1):137–143. doi: 10.4134/CKMS.2007.22.1.137. [DOI] [Google Scholar]
- 19.Ko MH, Ryu DH, Kim TS. Limiting behaviors of weighted sums for linearly negative quadrant dependent random variables. Taiwan. J. Math. 2007;11(2):511–522. doi: 10.11650/twjm/1500404705. [DOI] [Google Scholar]
- 20.Wang XJ, Hu SH, Yang WZ, Li XQ. Exponential inequalities and complete convergence for a LNQD sequence. J. Korean Stat. Soc. 2010;39:555–564. doi: 10.1016/j.jkss.2010.01.002. [DOI] [Google Scholar]
- 21.Wang JF, Wu QY. Strong laws of large numbers for arrays of rowwise NA and LNQD random variables. J. Probab. Stat. 2011 [Google Scholar]
- 22.Li YM, Guo JH, Li NY. Some inequalities for a LNQD sequence with applications. J. Inequal. Appl. 2012;2012:216. doi: 10.1186/1029-242X-2012-216. [DOI] [Google Scholar]
- 23.Shen AT, Zhu HY, Wu RC, Zhang Y. Complete convergence for weighted sums of LNQD random variables. Stochastics. 2015;87(1):160–169. doi: 10.1080/17442508.2014.931959. [DOI] [Google Scholar]
- 24.Petrov VV. Limit Theory for Probability Theory. New York: Oxford University Press; 1995. [Google Scholar]
