Abstract
We investigate the complete convergence of partial sums of randomly weighted extended negatively dependent (END) random variables. Some results of complete moment convergence, complete convergence and the strong law of large numbers for this dependent structure are obtained. As an application, we study the convergence of the state observers of linear-time-invariant systems. Our results extend the corresponding earlier ones.
Keywords: complete convergence, randomly weighted, END sequences, strong law of large numbers
Introduction
Let us recall the concept of extended negatively dependent (END) random variables which was introduced by Liu [1].
Definition 1.1
We call random variables to be END if there exists a positive constant M such that both
and
hold for each and all real numbers .
Obviously, for all , let or in Definition 1.1, it is easy to see that the dominating coefficient . If the dominating coefficient M is 1, then END random variables reduce to NOD random variables which contain NA random variables and NSD random variables (see Joag-Dev and Proschan [2], Hu [3] and Wang et al. [4]). Various examples of NA random variables and related fields can be found in Bulinski and Shaskin [5], Prakasa Rao [6], Oliveira [7] and the references therein. In view of the importance of END random variables, many researchers pay attention to the study of END. For example, Liu [1, 8] studied the precise large deviations and moderate deviations of END sequence with heavy tails; Chen et al. [9] obtained strong law of large numbers of END sequence and gave some applications to the risk theory and renewal theory; Shen [10] obtained some moment inequalities of END sequence; Wang et al. [11] and Hu et al. [12] investigated the complete convergence for END sequences; Wang et al. [13] and Yang et al. [14] investigated the nonparametric regression model under END errors; Yang et al. [15] obtained some large deviation results of nonlinear regression models under END errors; Wang et al. [16] established some exponential inequality for m-END sequence; Deng et al. [17] studied the Hajek-Renyi-type inequality and strong law of large numbers for END sequences, etc. Furthermore, there are many works on the negatively dependent random variables. For example, Wang et al. [18] studied the complete convergence for WOD random variables and gave the application to the estimator of nonparametric regression models; Wu et al. [19] obtained some results of complete convergence and complete moment convergence for weighted sums of m-NA random variables; Yang and Hu [20] investigated the complete moment convergence of pairwise NQD random variables; Shen et al. [21] investigated the strong law of large numbers for NOD random variables; Li et al. [22] obtained some results of inverse moment for WOD random variables, etc.
In addition, there are many researchers paying attention to the study of the properties of partial sums of randomly weighted random variables. For example, Thanh and Yin [23] established the complete convergence of partial sums of randomly weighted independent sequences in Banach spaces; Thanh et al. [24] investigated complete convergence of partial sums of randomly weighted ρ̃-mixing sequences; Cabrera et al. [25] and Shen et al. [26] investigated the conditional convergence for partial sums of randomly weighted dependent random variables; Yang et al. [27] and Yao and Lin [28] obtained the complete convergence and moment of maximum normed based on the randomly weighted martingale differences; Han and Xiang [29] obtained the complete moment convergence of double-indexed randomly weighted sums of ρ̃-mixing sequences; Li et al. [30] studied the convergence of partial sums of randomly weighted pairwise NQD sequences, etc.
We aim to investigate the complete convergence of partial sums of randomly weighted END sequences. Some results of complete moment convergence, complete convergence and strong law of large numbers for this dependent structure are obtained. As an application, we study the convergence of state observers of linear-time-invariant systems. We extend some results of Thanh et al. [24], Wang et al. [31] and Yang et al. [32] to the case of randomly weighted END sequences. For the details, see our results in Sections 3 and 4, and the conclusions in Section 5. Some lemmas and proofs of main results are presented in Sections 2 and 6, respectively.
Some lemmas
Lemma 2.1
Liu [8]
Let the random variables be a sequence of END random variables. If is a sequence of all nondecreasing (or nonincreasing) functions, then is also a sequence of END random variables.
Remark 2.1
Let be an END sequence and be a sequence of nonnegative and independent random variables, which is independent of . Let , . Combining the definition of END with nonnegative and independent of , we establish, for all real numbers ,
by using the fact that are END random variables following from Lemma 2.1. Similarly, for all real numbers , one has
Therefore, it can be found that is also an END sequence with the same dominating coefficient M.
Lemma 2.2
Shen [10]
Let and be an END sequence such that and for all . Then there exists a positive constant such that for all
Lemma 2.3
Sung [33]
Let and be sequences of random variables. Then, for any , , and ,
Lemma 2.4
Adler and Rosalsky [34] and Adler et al. [35]
Let be a sequence of random variables which is stochastically dominated by a random variable X, i.e. for some positive constant and all . Then, for all , and , the following two statements hold:
Consequently, one has for all . Here are some positive constants not depending on n.
The complete convergence for partial sums of randomly weighted END sequences
In the following, we list two assumptions:
Let be a mean zero sequence of END random variables stochastically dominated by a random variables X.
For every , let be a sequence of independent random variables satisfying that is independent of .
Theorem 3.1
Assume that (A.1) and (A.2) are satisfied. Let , , and such that
| 3.1 |
Then, for every ,
| 3.2 |
So one has
| 3.3 |
Theorem 3.2
Assume that (A.1) and (A.2) are satisfied. Let , , and such that
| 3.4 |
for some . Then we also obtain the results of (3.2) and (3.3).
For some and , we take in Theorem 3.2 and establish the following result.
Theorem 3.3
Suppose that (A.1) and (A.2) are fulfilled. Let , and . If
| 3.5 |
then, for every ,
| 3.6 |
and
| 3.7 |
Thus, by the Borel-Cantelli lemma and (3.7), the strong law of large numbers is as follows:
| 3.8 |
Let . In addition, for the case , we have the following result.
Theorem 3.4
Suppose that (A.1) and (A.2) are fulfilled. Let and . If (3.1) holds, then, for every ,
| 3.9 |
So one has
| 3.10 |
Remark 3.1
If in (3.1) and (3.4), then the randomly weighted conditions are
| 3.11 |
and
| 3.12 |
which are used in Thanh et al. [24]. Under the randomly weighted conditions (3.11), (3.12) and other conditions, Thanh et al. [24] obtained some complete convergence such as
for partial sums of randomly weighted ρ̃-mixing sequences. Yang et al. [32] extended the results of Thanh et al. [24] and obtained complete moment convergence such as
for partial sums of constant weighted martingale differences. In this paper, we weaken the randomly weighted conditions such as (3.1) and (3.4) for and obtain the results of Theorems 3.1-3.4. Generally, we extend the results of Thanh et al. [24] and Yang et al. [32] to the case of randomly weighted END sequences.
The application to linear-time-invariant systems
As an application of Theorem 3.3, we study the convergence of the state observers of linear-time-invariant systems in this section.
For , we consider a multi-input-single-output (MISO) linear time invariant system as follows:
| 4.1 |
where , , are known system matrices, is the control input, is the state and is the system output. The initial state is unknown. For some limited observations on , it is interesting to estimate . In the setup, the output is only measured at a sequence of sampling time instants with measured values and noised such that
We would like to estimate the state from information on , and . Let denote the transpose of G. In order to proceed, we need the following assumption.
Assumption 4.1
The system (4.1) is observable, i.e., the observability matrix
has full rank.
The solution to system (4.1) can be checked:
From , it follows that
Denote
So this leads to the observation
| 4.2 |
Define
Then we rewrite (4.2) as follows:
| 4.3 |
Suppose that is full rank, which will be established later. Then the least-squares estimator of is given by
| 4.4 |
Combining (4.3) with (4.4), the estimation error for at is presented as
In order to obtain the convergence, one must consider a typical entry in . By the Cayley-Hamilton theorem [36], the matrix exponential can be expressed by a polynomial function of A of order at most :
where the time functions can be derived by the Lagrange-Hermite interpolation method [36]. So one has
where and is the observability matrix.
Denote
Then
which reduces to
As a result, one has for any
| 4.5 |
By Assumption 4.1, it can be found that exists. The convergence analysis will be established by the sufficiently conditions: , a.s., and , a.s., for some . So we need the following PE condition which was used in Thanh et al. [24] and Wang et al. [31].
Assumption 4.2
For some ,
| 4.6 |
where is the small eigenvalue of H for a suitable symmetric H.
We focus on the convergence of partial sums of randomly weighted END random variables such that
| 4.7 |
for some . Since a typical entry of is
| 4.8 |
the convergence analysis for is a special case of (4.7). Note that when the sampling time sequence is a random process, so are in (4.8), rendering a randomly weighted noise driven by END random variables. As an application of Theorem 3.3, we obtain the following theorem.
Theorem 4.1
Let , and Assumptions 4.1 and 4.2 hold. Suppose that is an END sequences stochastically dominated by a random variable d with . Suppose that, for some , one has
| 4.9 |
where . Then
| 4.10 |
Consequently,
| 4.11 |
Remark 4.1
If is uniformly bounded, a.s., then the condition (4.9) holds with for any q. Wang et al. [31] obtained (4.11) for constant weighted ρ̃-mixing errors (see Theorem 4 of Wang et al. [31]). Thanh et al. [24] extended the result of Wang et al. [31] to randomly weighted ρ̃-mixing errors (see Theorem 4.1 of Thanh et al. [24]). Yang et al. [32] obtained the result (4.11) for the case of constant weighted martingale differences (see Theorem 11 of Yang et al. [32]). Generally, our Theorem 4.1 generalize the results of Thanh et al. [24], Wang et al. [31] and Yang et al. [32] to the case of randomly weighted END errors.
Conclusions
In this paper, we investigate the complete convergence of partial sums of randomly weighted END random variables. Some results of complete moment convergence, complete convergence and strong law of large numbers for this dependent structure are presented (see our Theorems 3.1-3.4). As an application of Theorem 3.3, we study the convergence of the state observers of linear-time-invariant systems and obtain the result of the strong law of large numbers for the systems (see our Theorem 4.1). Therefore, we extend some results of Thanh et al. [24], Wang et al. [31] and Yang et al. [32] to the case of randomly weighted END sequences. Furthermore, END random variables contain NA random variables, NOD random variables and NSD random variables, so the results obtained in this paper hold true for these negatively dependent random variables.
The proofs of main results
In the proofs, denote some positive constants not depending on n.
Proof of Theorem 3.1
Since , without loss of generality, we assume in the proof. For and , let
It can be found that
Therefore, by Lemma 2.3 with and , we obtain
| 6.1 |
Combining (3.1) with Hölder’s inequality, one has
| 6.2 |
by using the fact .
Since, for every , is independent of the sequence , one has by Markov’s inequality, Lemma 2.4, (6.2) and ()
| 6.3 |
In addition, it can be seen that , , . So, by the proof of (6.3), we have
| 6.4 |
In view of Lemma 2.1, one sees that are END random variables. Combining the assumption of with Remark 2.1, we establish that are mean zero END random variables with the same dominating coefficient. So, by Markov’s inequality, (3.1), Lemma 2.2 with and Lemma 2.4, we get
| 6.5 |
Since and , it can be checked that
| 6.6 |
By the proof of (6.3), it follows that
| 6.7 |
Combining (6.1) with (6.3)-(6.7), we can get (3.2) immediately. Moreover, by (3.2) and Remark 2.6 of Sung [33], for every , it can be argued that
| 6.8 |
which implies (3.3). □
Proof of Theorem 3.2
We use the same notation in the proof of Theorem 3.1. Obviously, by , it is easy to see that . Consequently, for any , by Hölder’s inequality and condition (3.4), one has
| 6.9 |
It can be seen that . So one has . Together with (6.1), (6.3), (6.4) and (6.9), we obtain and . Therefore, we have to prove that . Since , similar to the proof of (6.5), by Lemma 2.2, it follows that
| 6.10 |
Obviously, for , by Lemma 2.4, it follows that
| 6.11 |
By and , one concludes that . Thus, we take (6.9) with and (6.11), and establish
| 6.12 |
by the fact . In addition, by the inequality, Lemma 2.4 and (3.4),
| 6.13 |
By and , one has , which implies . So, by , it can be argued that
| 6.14 |
By the proof of (6.3), one has
| 6.15 |
Consequently, by (6.10) and (6.12)-(6.15), we obtain . So, we obtain the result (3.2). Finally, by the proof of (6.8), (3.3) also holds true. □
Proof of Theorem 3.3
For some and , we take and have . Applying Theorem 3.2, we obtain (3.6) and (3.7) immediately. Combining (3.7) with the Borel-Cantelli lemma, we establish the result of (3.8). □
Proof of Theorem 3.4
Similar to the proof of Theorem 3.1, by Lemma 2.3, we can check that
| 6.16 |
By the proof of (6.3), it follows that
| 6.17 |
Similarly, by the proof of (6.4), one has
| 6.18 |
Moreover, by the proof of (6.5), we obtain
| 6.19 |
So, by (6.16)-(6.19), (3.9) holds. In addition, by (3.3) with , (3.10) also holds true under the conditions of Theorem 3.4. □
Proof of Theorem 4.1
It is easy to check that
In order to prove (4.10), it suffices to look at the jth component of . For some , by (4.9), we apply Theorem 3.3 with , in (4.8) and , and obtain the result of (4.10).
Moreover, by Assumption 4.1, exists. In addition, by (4.6) in Assumption 4.2, exists and
where is the largest eigenvalue. Therefore, combining
Acknowledgements
The authors are deeply grateful to the editors and anonymous referees, whose insightful comments and suggestions have contributed substantially to the improvement of this paper. This work is supported by National Natural Science Foundation of China (11501005, 61403053, 61403115), Natural Science Foundation of Anhui Province (1508085J06, 1608085QA02) and Science Research Project of Anhui Colleges (KJ2017A027, KJ2014A020, KJ2015A065, KJ2016A027).
Footnotes
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally to the writing of this paper. All authors read and approved the final manuscript.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Penghua Li, Email: lipenghua88@163.com.
Xiaoqin Li, Email: lixiaoqin1983@163.com.
Kehan Wu, Email: wukehan@yeah.net.
References
- 1.Liu L. Precise large deviations for dependent random variables with heavy tails. Stat. Probab. Lett. 2009;79:1290–1298. doi: 10.1016/j.spl.2009.02.001. [DOI] [Google Scholar]
- 2.Joag-Dev K, Proschan F. Negative association of random variables with applications. Ann. Stat. 1983;11:286–295. doi: 10.1214/aos/1176346079. [DOI] [Google Scholar]
- 3.Hu TZ. Negatively superadditive dependence of random variables with applications. Chinese J. Appl. Probab. Statist. 2000;16:133–144. [Google Scholar]
- 4.Wang XJ, Shen AT, Chen ZY, Hu SH. Complete convergence for weighted sums of NSD random variables and its application in the EV regression model. Test. 2015;24:166–184. doi: 10.1007/s11749-014-0402-6. [DOI] [Google Scholar]
- 5.Bulinski AV, Shaskin A. Limit Theorems for Associated Random Fields and Related Systems. Singapore: World Scientific; 2007. [Google Scholar]
- 6.Prakasa Rao BLS. Associated Sequences, Demimartingales and Nonparametric Inference. Basel: Springer; 2012. [Google Scholar]
- 7.Oliveira PE. Asymptotics for Associated Random Variables. Berlin: Springer; 2012. [Google Scholar]
- 8.Liu L. Necessary and sufficient conditions for moderate deviations of dependent random variables with heavy tails. Sci. China Ser. A. 2010;53:1421–1434. doi: 10.1007/s11425-010-4012-9. [DOI] [Google Scholar]
- 9.Chen YQ, Chen AY, Ng KW. The strong law of large numbers for extended negatively dependent random variables. J. Appl. Probab. 2010;47:908–922. doi: 10.1017/S0021900200007257. [DOI] [Google Scholar]
- 10.Shen AT. Probability inequalities for END sequence and their applications. J. Inequal. Appl. 2011;2011 doi: 10.1186/1029-242X-2011-98. [DOI] [Google Scholar]
- 11.Wang XJ, Hu T-C, Volodin A, Hu SH. Complete convergence for weighted sums and arrays of rowwise extended negatively dependent random variables. Commun. Stat., Theory Methods. 2013;42:2391–2401. doi: 10.1080/03610926.2011.609321. [DOI] [Google Scholar]
- 12.Hu T-C, Rosalsky A, Wang KL. Complete convergence theorems for extended negatively dependent random variables. Sankhya, Ser. A. 2015;77:1–29. doi: 10.1007/s13171-014-0058-z. [DOI] [Google Scholar]
- 13.Wang XJ, Zheng LL, Xu C, Hu SH. Complete consistency for the estimator of nonparametric regression models based on extended negatively dependent errors. Statistics. 2015;49:396–407. doi: 10.1080/02331888.2014.888431. [DOI] [Google Scholar]
- 14.Yang WZ, Xu HY, Chen L, Hu SH. Complete consistency of estimators for regression models based on extended negatively dependent errors. Stat. Pap. 2016 [Google Scholar]
- 15.Yang WZ, Zhao ZR, Wang XH, Hu SH. The large deviation results for the nonlinear regression model with dependent errors. Test. 2017;26(2):261–283. doi: 10.1007/s11749-016-0509-z. [DOI] [Google Scholar]
- 16.Wang XJ, Wu Y, Hu SH. Exponential probability inequality for m-END random variables and its applications. Metrika. 2016;79:127–147. doi: 10.1007/s00184-015-0547-7. [DOI] [Google Scholar]
- 17.Deng X, Wang XJ, Xia FX. Hajek-Renyi-type inequality and strong law of large numbers for END sequences. Commun. Stat., Theory Methods. 2017;46(2):672–682. doi: 10.1080/03610926.2014.1002938. [DOI] [Google Scholar]
- 18.Wang XJ, Xu C, Hu T-C, Volodin A. On complete convergence for widely orthant-dependent random variables and its applications in nonparametric regression models. Test. 2014;23(3):607–629. doi: 10.1007/s11749-014-0365-7. [DOI] [Google Scholar]
- 19.Wu YF, Hu T-C. Complete convergence and complete moment convergence for weighted sums of m-NA random variables. J. Inequal. Appl. 2015;2015 doi: 10.1186/s13660-015-0717-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Yang WZ. Complete moment convergence of pairwise NQD random variables. Stochastics. 2015;87(2):199–208. [Google Scholar]
- 21.Shen AT, Zhang Y. On the rate of convergence in the strong law of large numbers for negatively orthant-dependent random variables. Commun. Stat., Theory Methods. 2016;45(21):6209–6222. doi: 10.1080/03610926.2014.957858. [DOI] [Google Scholar]
- 22.Li XQ, Liu X, Yang WZ. The inverse moment for widely orthant dependent random variables. J. Inequal. Appl. 2016;2016 doi: 10.1186/s13660-016-1099-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Thanh LV, Yin G. Almost sure and complete convergence of randomly weighted sums of independent random elements in Banach spaces. Taiwan. J. Math. 2011;15:1759–1781. doi: 10.11650/twjm/1500406378. [DOI] [Google Scholar]
- 24.Thanh LV, Yin G, Wang LY. State observers with random sampling times and convergence analysis of double-indexed and randomly weighted sums of mixing processes. SIAM J. Control Optim. 2011;49:106–124. doi: 10.1137/10078671X. [DOI] [Google Scholar]
- 25.Cabrera MO, Rosalsky A, Volodin A. Some theorems on conditional mean convergence and conditional almost sure convergence for randomly weighted sums of dependent random variables. Test. 2012;21:369–385. doi: 10.1007/s11749-011-0248-0. [DOI] [Google Scholar]
- 26.Shen AT, Wu RC, Chen Y, Zhou Y. Conditional convergence for randomly weighted sums of random variables based on conditional residual h-integrability. J. Inequal. Appl. 2013;2013 doi: 10.1186/1029-242X-2013-122. [DOI] [Google Scholar]
- 27.Yang WZ, Wang YW, Wang XH, Hu SH. Complete moment convergence for randomly weighted sums of martingale differences. J. Inequal. Appl. 2013;2013 doi: 10.1186/1029-242X-2013-396. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Yao M, Lin L. The moment of maximum normed randomly weighted sums of martingale differences. J. Inequal. Appl. 2015;2015 doi: 10.1186/s13660-015-0786-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Han J. Complete moment convergence of double-indexed randomly weighted sums of mixing sequences. J. Inequal. Appl. 2016;2016 doi: 10.1186/s13660-016-1260-4. [DOI] [Google Scholar]
- 30.Li XQ, Zhao ZR, Yang WZ, Hu SH. The inequalities of randomly weighted sums of pairwise NQD sequences and its application to limit theory. J. Math. Inequal. 2017;11:323–334. [Google Scholar]
- 31.Wang LY, Li C, Yin G, Guo L, Xu CZ. State observability and observers of linear-time-invariant systems under irregular sampling and sensor limitations. IEEE Trans. Autom. Control. 2011;56:2639–2654. doi: 10.1109/TAC.2011.2122570. [DOI] [Google Scholar]
- 32.Yang WZ, Wang XH, Li XQ, Hu SH. The convergence of double-indexed weighted sums of martingale differences and its application. Abstr. Appl. Anal. 2014;2014 [Google Scholar]
- 33.Sung SH. Moment inequalities and complete moment convergence. J. Inequal. Appl. 2009;2009 doi: 10.1155/2009/271265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Adler A, Rosalsky A. Some general strong laws for weighted sums of stochastically dominated random variables. Stoch. Anal. Appl. 1987;5:1–16. doi: 10.1080/07362998708809104. [DOI] [Google Scholar]
- 35.Adler A, Rosalsky A, Taylor RL. Strong laws of large numbers for weighted sums of random elements in normed linear spaces. Int. J. Math. Math. Sci. 1989;12:507–530. doi: 10.1155/S0161171289000657. [DOI] [Google Scholar]
- 36.Ogata K. Modern Control Engineering. 4. Englewood Cliffs: Prentice Hall; 2002. [Google Scholar]
