ABSTRACT
This article considers the problem of jointly monitoring the mean and variance of a process by multi-chart schemes. Multi-chart is a combination of several single charts which detects changes in a process quickly. Asymptotic analyses and simulation studies show that the optimized CUSUM multi-chart has optimal performance than optimized EWMA multi-chart in jointly detecting mean and variance shifts in an normal observation. A real example that monitors the changes in IBM's stock returns (mean) and risks (variance) is used to demonstrate the performance of the above two multi-charts. The proposed method has been compared to a benchmark and it performed better.
Keywords: Mean–variance monitoring, optimized CUSUM & EWMA multi-charts, IBM
1. Introduction
A wealth of research is ongoing in qualimetry (also known as statistical process control (SPC)), an area of science bringing together various methods for the quantitative evaluation of product quality. Many of the existing works focused on methods for detecting mean shifts while others considered methods for detecting changes in variability (variance or standard deviation) or jointly ( mean–variance) change in the variables one wish to monitor. The application areas of these SPC schemes are varied such as industrial and chemical engineering, information and communication systems, biostatistics and public health, econometrics and financial surveillance, network science and graph data, and so on; see, for example, Frisén [13], Fricker [12], Woodall and Montgomery [43], Montgomery [35], Woodall et al. [44], Bersimis et al. [3] and Hosseini and Noorossana [22].
It is important to note that when special causes exist which triggers both the mean and variance to shift simultaneously, then it is more reasonable to combine the mean and variance information on one scheme and look at their behavior jointly. For instance, a wrongly fixed stencil in a circuit manufacturing may result in a concurrent change in the mean and variance of the thickness of the solder paste printed on circuit boards [14].
Several schemes have been proposed in open literatures for joint monitoring of both mean and variance or standard deviation. For example, Reynolds and Glosh [38] proposed the L chart for joint monitoring of mean and variance shifts. Domangue and Patch [9] proposed the omnibus exponentially weighted moving average (EWMA) chart for joint monitoring of mean and variance shifts. Costa [6] developed the so-called non-central chi-square statistic (also known as NCS chart) to monitor the mean and variance simultaneously. Grabov and Ingman [17] also presented the B-chart while Chen et al. [5] considered the MaxEWMA chart for mean–variance monitoring. Costa and Rahim [7] proposed EWMA non-central chi-square statistic to detect changes in mean and increase in variance, their chart does not detect decrease in variance. Wu and Tian [45] considered the weighted loss function (WLC) chart while Capizzi and Masarotto [4] developed generalized likelihood ratio (GLR) charts for joint monitoring of the mean and variance shifts of an autoregressive moving average process. Guh [18] used artificial neural network to monitor process mean and variance shifts. Guh's results indicated that the proposed model can effectively recognized single mean and variance control chart patterns and also mixed control chart patterns of mean and variance. Li et al. [26] considered a self-starting control chart for monitoring the mean and variance shifts simultaneously. McCracken et al. [33] considered a Shewhart-type control scheme for joint monitoring of mean and variance of a normal process. Li et al. [25] also presented the so-called Case-U type scheme which is the CUmulative SUM (CUSUM) modification of the scheme by McCracken et al. [33].
In recent years, Lu and Chang [31] proposed a fuzzy classification maximum likelihood change-point (FCML-CP) algorithm to detect shifts in the mean and variance, Wang and Cheng [42] presented an EWMA chart based on likelihood ratio test for monitoring Weibull mean and variance with subgroups, Quininoa et al. [37] presented novel control charts that are based on the inspection of attributes and the use of traditional control limits for the joint monitoring of mean and variance, Gao et al. [15] proposed a penalized weighted least-squares approach with an iterative estimation procedure that integrates variance change point detection and smooth mean function estimation, Messer [34] proposed a method for bivariate change point detection of changes in expectation and variance, and Kim et al. [23] proposed the so-called copula Markov statistical process control and conditional distribution method to monitor the mean and variance jointly.
It can be seen that all the control charts above mainly focus on monitoring whether there are changes in mean and variance, and rarely consider the magnitude of such changes at the same time and optimize the proposed control charts. Besides, some of the charts, for example FCML-CP algorithm has computational complexities and hence it is time-consuming in detecting shifts in mean and variance much faster due to the slow rate of convergence. The main purpose of this present paper is to deal with these problems by optimizing CUSUM and EWMA multi-charts for jointly detecting a range of mean and variance change.
Multi-chart consists of several single charts with different reference values that are used simultaneously to detect and monitor process changes. Multi-chart schemes have elegant properties in the sense that they are faster in detecting changes in a process and computationally less expensive than similar charts like Generalized EWMA by Han and Tsung [19] and the CUSUM-like control chart by Siegmund and Venkatraman [40]. Multi-chart schemes are different from multivariate CUSUM (MCUSUM) schemes (see Crosier [8], Apley and Fsung [1] and Golosnoy [16]), multivariate EWMA (MEWMA) schemes (see Lowry et al. [30]) and multi-hypothesis testing (see Baum and Veeravalli [2] and Lai [24]) in terms of methodology. For example, multi-chart schemes can tell which of the charts triggered some change, a property that falls short of multivariate charts (MCUSUM and MEWMA).
Generally, we rarely know the exact shift of a process before it is detected, hence it is imperative we consider a range of known or unknown mean and variance reference values which are the magnitude of shifts to be detected. Indeed, the possible change in many practical problems often forms a continuous region of two-dimensional plane. In fact, Lorden [28] considered and studied a model which consisted of several control charts. Since then, Lorden and Eisenberger [29], Lucas [32], Dragalin [10,11], Sparks [41], Han et al. [21] and Liu et al. [27] have further investigated and studied a combination of several CUSUM charts and a combined Shewhart-CUSUM to detect mean shifts in a range. However, most of the works centered on mean or variance change detection. Of course, the joint problem we faced here is how to design the best control chart (faster detection) which can detect shifts in the mean and variance simultaneously given some reference values. In the paper, we will give an optimal design of CUSUM and EWMA multi-charts procedures for monitoring shifts in the mean and variance simultaneously and seek to find optimal parameters for determining the multi-charts.
The reminder of the article is organized as follows; Section 2 presents the optimized CUSUM and EWMA multi-chart schemes. Section 3 gives the asymptotic analyses of the optimized multi-chart schemes. Section 4 presents the numerical simulation analyses that compare the CPIs of the charts. Section 5 gives a real example that illustrates the proposed method for financial surveillance using the IBM stock returns. Discussion, suggestion for further research and conclusion are presented in Section 6, with proof of preposition given in Appendix.
2. Optimized CUSUM and EWMA multi-charts
Assume that where . Usually, at some time period τ, the probability distribution of changes from to . We generally refer to τ as a change point where but here we assume , which means the first time there is change in distribution. Intuitively, the mean and variance of undergo a shift of size and /( ) respectively where and are assumed known and are taken to be and .
Again let assume the common probability density (pdf of normal distribution) of before change time be and after the change time, the post-change probability density of be , where the parameter θ belongs to a bounded set with if and only if and , where denotes two-dimensional real number space. Again let denote ( ) as the probability distribution (expectation) with the post-change density function after the change time. When , i.e. the change never occurs, we denote by the probability distribution (expectation) with the density function for all time .
Usually, the possible change region Θ forms a continuous region of two-dimensional plane and may be determined by engineering knowledge, practical experience or by statistical data. We may have to divide region Θ into several disjointed subsets for ) such that . The region Θ is a closed boundary set of the parameters and the boundary of Θ is known. For example, let be the normal density function with parameter , we can take the set , where and are the possible change regions, given that μ and σ denote the mean and standard deviations respectively and and are four known numbers.
Here, we will use the charting performance index (CPI) proposed by Han and Tsung [20] to judge which chart performs better and is defined by
| (1) |
where is a positive weight function for detection satisfying , is the average run length (ARL) of the chart to be evaluated and is the chart with the lowest ARL value. The average run length (ARL) is the average number of samples taken before a chart signal. That is, . Usually, denotes in-control average run length and denotes out-of-control average run length. Moustakides [36] and subsequently Ritov [39] showed that among all control charts, the ARL of the chart with reference value as parameter is optimal. The chart with the greatest CPI performs best in jointly detecting the mean–variance change over a range. We have .
In general, we define multi-chart as , given by
| (2) |
where is a chart, m is the number of charts and k is a particular value of m.
We then define the CUSUM multi-chart as , where
| (3) |
is a one-sided CUSUM charts which we will define shortly and are some reference parameters for . The reference parameters are the sizes of shifts in the mean and variance one anticipates to detect quickly. Generally, smaller values of the reference values are effective for monitoring smaller shifts and larger values of the reference values are effective for monitoring larger shifts. The charting performance index (CPI) which is used to measure which chart (T) performs better, depends on the position of the reference value in the region for . can be written as
| (4) |
for , where n is the sample number, is the CUSUM charting statistic and the control limits are taken such that have a common in-control ARL , that is, for .
We define the optimized CUSUM multi-chart as , where is constructed with the optimal reference numbers; for . Preposition 1 will enable us construct the optimized CUSUM multi-chart.
The EWMA scheme for joint monitoring of the mean and variance is defined as where
| (5) |
where
,
,
and .
for and .
The smoothing parameters α and β are the mean charting statistic and variance charting statistic respectively. The parameter c is the width of the control limit.
We also define the EWMA multi-chart for joint monitoring of the mean and variance as where
| (6) |
The optimized EWMA multi-chart is defined as where is the EWMA multi-chart that has the greatest charting performance index (CPI).
3. Asymptotic analysis of optimized multi-chart scheme
The consequence of the following preposition will enable us construct the optimized CUSUM multi-chart.
Proposition 3.1
Let the real measure for and , where then for large we have
(7)
Proposition 3.1 implies that the charting performance index (CPI) which is used to measure which chart performs better, depends on the position of the real measure (real shifts) = for and in the region for , where the number of real mean shifts is l and q is the number of real variance shifts. In general, we may consider l and q fewer than 10 to reduce computational burden. The proof of proposition 3.1 is in Appendix.
4. Numerical results and comparison
In this section, we shall consider the application of Proposition 3.1 in Section 1 and present results for the optimized CUSUM and EWMA multi-charts in Sections 2 and 3 respectively and round it up with comparison of the schemes in Section 4.
4.1. Application of Proposition 3.1
For the sake of convenience let's consider m = 2 to construct the optimized CUSUM multi-chart using the proposed method. The Kullback–Leibler information distance is defined as
| (8) |
where is the mathematical expectation with respect to the parameter θ, is the pdf of the normal distribution, is the variance axis (coordinate) and μ is the mean axis (coordinate). For example, if we consider two parameters; and , we can set the boundary (∂) equation between the two points on a plane using the Kullback–Leibler information distance as
| (9) |
where
| (10) |
and
| (11) |
The boundary is found such that with little algebraic simplification gives
| (12) |
where
, , and .
We computed the CPI for each of the pairs as follows.
Let's consider that the reference parameter is from region and is from region separated by the boundary (12), that is to say . We computed the boundary equation between each pairs and found the position and region where the real shifts belong.
We considered five real mean shifts and three real variance shifts hence, , we can therefore write Equation (7) as
| (13) |
where
and are the ARL's of CUSUM chart with parameters and respectively and
| (14) |
We consequently computed the CPIs for each of the pairs by (13) and the results presented in Table 1.
Table 1.
CPI results of CUSUM multi-charts with .
| Chart | CPI | Chart | CPI |
|---|---|---|---|
| 0.8690 | 0.8215 | ||
| 0.8690 | 0.8208 | ||
| 0.8880 | 0.7580 | ||
| 0.8628 | 0.7586 | ||
| 0.8646 | 0.7579 | ||
| 0.8695 | 0.8211 | ||
| 0.8587 | 0.8215 | ||
| 0.8540 | 0.7586 | ||
| 0.8481 | 0.7586 | ||
| 0.8847 | 0.8217 | ||
| 0.8786 | 0.8203 | ||
| 0.8705 | 0.7589 |
4.2. Results for optimized CUSUM multi-chart
To construct the optimized CUSUM multi-chart , we seek to find and that will optimize Equation (13), where and . In other words, the value of mean (μ) and variance ( ) for which Equation (13) has the greatest CPI.
Usually, the possible change region Θ forms a continuous region of two-dimensional plane, we consider the region . We hereby considered parameters of the mean from the range and parameters of the variance from the range .
We choose values of μ as
We also choose values of as
Instead of constructing schemes of all possible combinations of the mean (μ) and variance ( ), we use pairs of the combinations of the mean (μ) and variance ( ) in an efficient way utilizing orthogonal experimental design ( ) (see Table A1, Appendix). The design reduces the computations from to 24 computations.
We selected values of the parameters; μ and according to the orthogonal experimental design as follows:
and
where for example
is
We take , that is, and =1 when there is no change. We assume that after the change-point, the possible change region for constructing the CUSUM multi-chart is . If we consider two parameters; and , we can get the curve from Equation (12) which is the red line as shown in Figure 1. The curve divides the region Θ into two parts, and such that ∈ and ∈ . For each of the 24 pairs of parameters, we computed the boundary (12) between and and found the position and region where the real shifts belong. We computed the ARL's of the charts and used (13) to compute the CPIs of each of the 24 pairs. The chart with the highest CPI is the optimized CUSUM multi-chart.
Figure 1.
Parameter boundary of CUSUM multi-chart.
Table 1 shows the CPIs for different combinations of the mean and variance. The pairs and produced the greatest CPI of 0.8880. We therefore conclude that the optimized CUSUM multi-chart can be constructed with the parameters; and according to our design.
4.3. Results for optimized EWMA multi-chart
We presented the results for the EWMA multi-chart for joint monitoring of the mean and variance in Table 2. The smoothing parameters α and β were selected from the range .
Table 2.
CPI of EWMA multi-charts with .
| Chart | CPI | Chart | CPI |
|---|---|---|---|
| 0.2895 | 0.3579 | ||
| 0.2895 | 0.3873 | ||
| 0.3027 | 0.3882 | ||
| 0.1157 | 0.4330 | ||
| 0.3334 | 0.3268 | ||
| 0.2030 | 0.4162 | ||
| 0.4895 | 0.4115 | ||
| 0.5234 | 0.4391 | ||
| 0.4856 | 0.3268 | ||
| 0.3545 | 0.3179 | ||
| 0.2060 | 0.3415 | ||
| 0.2431 | 0.4629 |
We choose values of the smoothing parameter α as
We also choose values of the smoothing parameter β as
Instead of carrying out computations for , we use orthogonal experimental design (see Table A1, Appendix) to choose possible combinations of α and β which reduces the computations to 24. We select values of the smoothing parameter α and β according to the orthogonal experimental design ( ) to construct EWMA multi-chart as follows:
and
where
is
The EWMA multi-chart parameter space spans between and as shown in Figure 2.
Figure 2.
Parameter boundary of EWMA multi-chart.
Considering the real measure for and , we compute the CPIs of EWMA multi-charts by
| (15) |
where
is the ARL of EWMA multi-chart to be evaluated and
| (16) |
The EWMA multi-chart that has the greatest CPI is the optimized EWMA multi-chart.
Table 2 presents the CPIs results of EWMA multi-charts ( ) for jointly detecting mean–variance shifts. The EWMA multi-charts were constructed with repetition experiments and the of the single charts were made to be approximately equal using Monte Carlo simulations. We considered five real mean shifts ( , , , and ) and three real variance changes ( , and ). The change point , that is the first time there is change. The smoothing parameter α and β were chosen according to orthogonal experimental design . We aim to find the EWMA multi-chart that will optimize in respect to the CPI. In other words, which has the greatest CPI.
Apparently, the EWMA multi-chart of and produced the greatest CPI of 0.5234, hence the optimized EWMA multi-chart is and .
4.4. Comparison of results
Here in this section, we shall compare the CPI results of the optimized CUSUM multi-chart with optimized EWMA multi-chart. The optimized CUSUM multi-chart has a CPI of 0.8880 whilst the optimized EWMA multi-chart has CPI of 0.5234. The optimized CUSUM multi-chart has higher CPI value than the optimized EWMA multi-chart hence the optimized CUSUM multi-chart scheme has better detection performance than the optimized EWMA multi-chart scheme.
We also compared our results to that of Han et al. [21]. The CPI's of Table 3 in page 1149 of [21] are: CUSUM multi-chart , optimized CUSUM multi-chart and EWMA multi-chart for m = 5, where m is the number of charts.
Table 3.
CPIs of CUSUM and EWMA multi-charts for monitoring IBM stock returns with .
| Chart | CPI |
|---|---|
| 0.5510 | |
| 0.6341 | |
| 0.5615 | |
| 0.4755 |
The proposed method gave a CPI of optimized CUSUM multi-chart with m = 2 to be 0.8880 which is higher than the CPI of optimized CUSUM multi-chart in Han et al. [21] for m = 5.
By inequality (4.8) and Remark 2 in [21], the CPIs will increase if we add more reference values (more charts). This means the CPI will increase if we add more charts since our work considered only two charts .
5. A real example
We use the International Business Machines (IBM) stock market returns from 2013 to 2018 to illustrate the implementation of the optimized CUSUM and EWMA multi-charts for financial surveillance. We monitored the changes in IBM's stock returns (mean) and risks (variance) using the two multi-charts. Let the daily closing prices be where is the closing price on trading day k. We denote the stock returns for the IBM as
| (17) |
Figure 3 shows the IBM stock market returns from 2013 to 2018. The mean of the returns seems to be dynamic while the variance (risks) seems to be increasing at some time period and decreasing at some time period. Many researchers have developed methods for monitoring financial variables. However, most of the works monitored the mean or variance but rarely has work been done concerning the joint mean–variance monitoring of financial variables by multi-chart schemes. Financial surveillance is important as investors are advised with a range of investment options based on statistical/ econometric models. It is in this light that we monitored the mean of the IBM returns and the variance (risk) jointly using the optimized CUSUM and optimized EWMA multi-chart schemes. We tested whether the stock returns follow the normal distribution using Shapiro Wilk test with a 0.05 level of significance. The hypothesis of interest is the stock returns are normally distributed versus the stock returns are not normally distributed. The p-value is . Since the p-value is small, we reject and claim that the stock returns do not follow normal distribution.
Figure 3.
IBM stock returns from 2013 to 2018.
The histogram of IBM stock returns with the normal density having same mean and variance as returns superimposed on it shows some heaviness at the tails as shown in Figure 4. The t-distribution is known to fit data that is heavy tailed. We fitted several t-distributions with different degrees of freedom to the stock returns data as shown in Figure 5.
Figure 4.
Histogram of the IBM stock returns with the normal density having the same mean and variance superimposed on it.
Figure 5.
Plots of quantiles of IBM stock returns with quantiles of several t-distributions having different degrees of freedom.
The quantile of t-distribution with five degrees of freedom fitted well with the quantiles of IBM stock returns as shown in Figure 5. The quantiles are very close to the straight line (qqline). We consequently used t-distribution with five degrees freedom to generate parameters for monitoring.
We estimate the change point time by
| (18) |
Generally, the in-control values are unknown, hence, we use data before change point as phase 1 data to estimate the in-control parameter. We denote the in-control reference value as , where is the mean of returns and is the risk before change point. After change point we partitioned the data into three sections and found the mean of returns and risks for each section which represents the reference values. For example, the reference values are parameterized as , and
Table 3 presents the numerical results of the optimized CUSUM and EWMA multi-chart schemes for monitoring IBM stock returns. The change point was estimated at the 226th trading day (21st November 2013) probably because the festive season (Christmas) was approaching so there was surge in the purchase of stocks. We consequently estimated the in-control reference parameter as . The post-change parameters were also estimated as , and .
We formulate the parameters of the CUSUM multi-charts for joint monitoring of the mean and risks of the IBM stock returns as
and
We then seek to determine the detection capability of the optimized CUSUM and EWMA multi-charts to detect changes in the mean and risk of returns starting from the 226th trading day (21st November 2013). We constructed the CUSUM charts , and with an in-control ARL of approximately 500 by choosing , and , where and are the control limits. We constructed the CUSUM multi-chart using Equation (13) and the results presented in Table 3.
We also used parameters of the optimized EWMA multi-chart that is and to jointly monitor the mean and risks of the IBM stock returns. We constructed the optimized EWMA multi-chart with an in-control ARL of approximately 500 by choosing with = 1.26648 and with = 1.882597, where , and are the control limits. That is, we chose the of the single charts to be approximately equal.
We considered five real mean shifts ( , , , and ) and three real variance changes ( , and .
The optimized CUSUM multi-chart has CPI of 0.6341 whilst the optimized EWMA multi-chart has CPI of 0.4755 as shown in Table 3, hence the optimized CUSUM multi-chart has better detection performance than the optimized EWMA multi-chart for detecting mean and variance (risks) change in the IBM stock returns.
6. Conclusion and discussion
Basically, this study seeks to jointly monitor the mean and variance of an i.i.d process by using the optimized CUSUM and EWMA multi-charts such that they can detect changes in mean–variance much faster and also evaluates the efficiency of these schemes by the charting performance index (CPI). To achieve this purpose, we constructed the optimized CUSUM multi-charts as follows; we derived the theoretical relation between the CPI, the post-change reference value of mean and variance, and the position of the real mean–variance shifts given some two reference parameters and .
Usually, the possible change region Θ forms a continuous region of two-dimensional plane, we hereby selected parameters of the mean from the range and variance from the range . Instead of constructing schemes of all possible combinations of the mean (μ) and variance ( ), we use pairs of the combinations of the mean (μ) and variance ( ) in an efficient way utilizing orthogonal experimental design . We computed the CPIs for each pair of parameters using Equation (13). The pair and produced the greatest CPI of 0.8880. We therefore conclude that the optimized CUSUM multi-charts can be constructed with the parameters and according to our design.
We also constructed the optimized EWMA multi-charts for joint monitoring of the mean and variance as follows: we selected the smoothing parameters; α and β such that α, β ∈ . Again we use design to choose possible combinations of α and β to construct EWMA multi-charts. The EWMA multi-chart scheme that has the greatest CPI is the optimized EWMA multi-chart schemes. The EWMA multi-chart [ and ] produced the greatest CPI of 0.5234, hence the optimized EWMA multi-chart scheme is [ and ].
The simulation results show that the optimized CUSUM multi-chart has a higher charting performance index (CPI) than the optimized EWMA multi-chart hence the optimized CUSUM multi-chart scheme has better detection performance. We also compared our results to that of Han et al. [21], where they considered five charts and our results performed better with just two charts. Also, the asymptotic analyses were consistent with the simulation results.
It is known that the stock returns have elegant statistical properties hence we used the proposed methods to jointly monitor the mean and risks of IBM stock returns from the period of 2013 to 2018. The stock returns seems fairly not normal as there is evidence of heaviness at the tails of the returns distribution hence we fitted several t-distributions with different degrees of freedom to the stock returns data as the t-distribution is known to fit approximately data that is heavy tailed. The quantile of t-distribution with five degrees of freedom fitted the data well. We generated the parameters for monitoring IBM stock returns from the t-distribution with five degrees of freedom. We estimated the change point at the 226th trading day (21st November 2013) and consequently used the data before 21st November 2013 as phase 1 historical data to find the in-control reference values which was estimated as . After change point we partitioned the data into three sections and estimated post-change parameters as , and . We used these parameters to construct the CUSUM multi-charts for jointly monitoring changes in the mean and risks of IBM stock returns. We also used parameters of the optimized EWMA multi-chart that is and to jointly monitor changes in the mean and risks of the IBM stock returns. Monitoring results have it that the optimized CUSUM multi-chart has higher CPI, hence better detection performance in the changes of IBM stock returns than the optimized EWMA multi-chart .
Early detection of abrupt changes in the mean and risks of IBM returns could be an important information for financial and economic analysts to advise clients and investors appropriately. Further research can focus on how the procedures considered in the article may be adapted using nonparametric monitoring methods. Also, some volatility models could be fitted and the errors monitored for abrupt changes using the method discussed in this paper.
Appendices.
Appendix 1. Design of Experiment.
Table A1.
design.
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 |
|---|---|---|---|---|---|---|---|
| 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 |
| 1 | 1 | 1 | 1 | 1 | 2 | 2 | 2 |
| 1 | 1 | 2 | 2 | 2 | 1 | 1 | 1 |
| 1 | 2 | 1 | 2 | 2 | 1 | 2 | 2 |
| 1 | 2 | 2 | 1 | 2 | 2 | 1 | 2 |
| 1 | 2 | 2 | 2 | 1 | 2 | 2 | 1 |
| 2 | 1 | 2 | 2 | 1 | 1 | 2 | 2 |
| 2 | 1 | 2 | 1 | 2 | 2 | 2 | 1 |
| 2 | 1 | 1 | 2 | 2 | 2 | 1 | 2 |
| 2 | 2 | 2 | 1 | 1 | 1 | 1 | 2 |
| 2 | 2 | 1 | 2 | 1 | 2 | 1 | 1 |
| 2 | 2 | 1 | 1 | 2 | 1 | 2 | 1 |
Appendix 2. Proof of Preposition 3.1.
Assuming that is the Kullback–Leibler information (number) defined as
For large , we have
for
where
We also have
It follows from Theorem 3.3 in Han and Tsung [20] that for large γ and , the charting performance index (CPI) in (1) can be written as
| (A1) |
Specifically, under the normal distribution we can derive that
| (A2) |
and
| (A3) |
Funding Statement
This research was supported by National Basic Research Program of China (973 Program, 2015CB856004) and the National Natural Science Foundation of China (11531001).
Disclosure statement
No potential conflict of interest was reported by the author(s).
References
- 1.Apley D.W. and Tsung F., The autoregressive T-squared chart for monitoring univariate autocorrelated processes, J. Qual. Tech. 34 (2002), pp. 80–96. [Google Scholar]
- 2.Baum C.W. and Veeravalli V.V., A sequential procedure for multi-hypothesis testing, IEEE Trans. Inf. Theory 40 (1994), pp. 1994–2007. [Google Scholar]
- 3.Bersimis S., Sgora A., and Psarakis S., The application of multivariate statistical process monitoring in non-industrial processes, Qual. Tech. Quant. Manag. 15 (2018), pp. 526–549. [Google Scholar]
- 4.Capizzi G. and Masarotto G., Practical design of generalized likelihood ratio control charts for autocorrelated data, Technometrics 50 (2008), pp. 357–370. [Google Scholar]
- 5.Chen G., Cheng S.W., and Xie H.S., Monitoring process mean and variability with one EWMA chart, J. Qual. Tech. 33 (2018), pp. 223–233. [Google Scholar]
- 6.Costa A.F.B., Joint econometric design of and R control charts for processes subject to two independent assignable causes, IIE Trans. 25 (1993), pp. 27–33. [Google Scholar]
- 7.Costa A.F.B. and Rahim M.A., Monitoring process mean and variability with one non-central chi-square chart, J. Appl. Stat. 31 (2004), pp. 1171–1183. [Google Scholar]
- 8.Crosier R.B., Multivariate generalizations of cumulative sum quality control schemes, Technometrics 30 (1988), pp. 291–303. [Google Scholar]
- 9.Domangue R. and Patch S.C., Some omnibus exponentially weighted moving average statistical process monitoring schemes, Technometrics 33 (1991), pp. 299–313. [Google Scholar]
- 10.Dragalin V., The optimality of generalized CUSUM procedure in quickest detection problem, Pro. Steklov. Inst. Math. Stat. Cont. Stoch. Proc. 202 (1993), pp. 132–148. [Google Scholar]
- 11.Dragalin V., The design and analysis of 2-CUSUM procedure, Comm. Stat. Simu. Comp. 26 (1997), pp. 67–81. [Google Scholar]
- 12.Fricker Jr. R.D., Introduction to Statistical Methods for Biosurveillance with An Emphasis on Syndromic Surveillance, Cambridge, Cambridge University Press, 2013. [Google Scholar]
- 13.Frisén M., Optimal sequential surveillance for finance, public health, and other areas (with discussion), Sequent. Analy. 28 (2009), pp. 310–337. [Google Scholar]
- 14.Gan F.F., Ting K.W., and Chang T.C., Interval charting schemes for joint monitoring of process mean and variance, Qual. Rel. Eng. Int. 20 (2004), pp. 291–303. [Google Scholar]
- 15.Gao Z., Shang Z., Du P., and Robertson J.L., Variance change point detection under a smoothly-changing mean trend with application to liver procurement, J. Amer. Stat. Asso. 114 (2019), pp. 773–781. [Google Scholar]
- 16.Golosnoy V., Ragulin S., and Schmid W., Multivariate CUSUM Chart: Properties and Enhancements, AStA Advan. Stat. Analy., Springer, 2009. [Google Scholar]
- 17.Grabov P. and Ingman D., Adaptive control limits for bivariate process monitoring, J. Qual. Tech. 28 (1996), pp. 320–330. [Google Scholar]
- 18.Guh R.S., Simultaneous process mean and variance monitoring using artificial neural networks, Comp. Ind. Eng. 58 (2010), pp. 739–753. [Google Scholar]
- 19.Han D. and Tsung F.G., A generalized EWMA control chart and its comparison with the optimal EWMA, CUSUM and GLR schemes, Ann. Stat. 32 (2004), pp. 316–339. [Google Scholar]
- 20.Han D. and Tsung F.G., Detection and diagnosis of unknown abrupt changes using CUSUM multi-chart schemes, Sequent. Analy. 26 (2007), pp. 225–249. [Google Scholar]
- 21.Han D., Tsung F.G., Hu X.J., and Wang K.B., CUSUM and EWMA multi-charts for detecting a range of mean shifts, Stat. Sinica 17 (2007), pp. 1139–1164. [Google Scholar]
- 22.Hosseini S.H. and Noorossana R., Performance evaluation of EWMA and CUSUM control charts to detect anomalies in social networks using average and standard deviation of degree measures, Qual. Rel. Eng. Int. 34 (2018), pp. 477–500. [Google Scholar]
- 23.Kim J.M., Baik J., and Reller M., Control charts of mean and variance using copula Markov SPC and conditional distribution by copula, Comm. Stat. Simu. Comp. 50 (2021)), pp. 85–102. [Google Scholar]
- 24.Lai T.L., Sequential multiple hypothesis testing and efficient fault detection-isolation in stochastic systems, IEEE Trans. Inform. Theory 46 (2000), pp. 595–608. [Google Scholar]
- 25.Li C., Mukherjee A., Su Q., and Xie M., Design and implementation of two CUSUM schemes for simultaneously monitoring the process mean and variance with unknown parameters, Qual. Rel. Eng. Int. 32 (2016), pp. 2961–2975. [Google Scholar]
- 26.Li Z., Zhang J., and Wang Z., Self-starting control chart for simultaneously monitoring process mean and variance, Int. J. Prod. Res. 48 (2010), pp. 4537–4553. [Google Scholar]
- 27.Liu G.F., Pu X.L., Wang L., and Xiang D.D., CUSUM chart for detecting range shifts when monotonicity of likelihood ratio is invalid, J. Appl. Stat. 42 (2015), pp. 1635–1644. [Google Scholar]
- 28.Lorden G., Procedures for reacting to a change in distribution, Ann. Math. Stat. 42 (1971), pp. 1897–1908. [Google Scholar]
- 29.Lorden G. and Eisenberger I., Detection of failure rate increases, Technometrics 15 (1973), pp. 167–175. [Google Scholar]
- 30.Lowry C.A., Woodall W.H., Champ C.W., and Rigdon S.E., A multivariate exponentially weighted moving average control chart, Technometrics 34 (1992), pp. 46–53. [Google Scholar]
- 31.Lu K.P. and Chang S.T., Detecting change-points for shifts in mean and variance using fuzzy classification maximum likelihood change-point algorithm, J. Comp. Appl. Math. 308 (2016), pp. 447–463. [Google Scholar]
- 32.Lucas J.M., Combined Shewhart-CUSUM quality control scheme, J. Qual. Tech. 14 (2018), pp. 51–59. [Google Scholar]
- 33.McCracken A.K., Chakraborti S., and Mukherjee A., Control charts for simultaneous monitoring of unknown mean and variance of normally distributed processes, J. Qual. Tech. 45 (2013), pp. 360–376. [Google Scholar]
- 34.Messer M., Bivariate change point detection : joint detection of changes in expectation and variance, Preprint (2019). Available at https://arxiv.org/abs/1904.01320v2
- 35.Montgomery D.C., Introduction to Statistical Quality Control, 6th ed., John Wiley & Sons, New York, 2009. [Google Scholar]
- 36.Moustakides G.V., Optimal stopping times for detecting changes in distribution, Ann. Stat. 14 (1986), pp. 1379–1387. [Google Scholar]
- 37.Quininoa R.C., Cruza F.R.B., and Hob L.L., Novel control charts that are based on the inspection of attributes and use traditional control limits are proposed for the joint monitoring of mean and variance, Comp. Lnd. Eng. 139 (2020), pp. 106131. [Google Scholar]
- 38.Reynolds Jr. M.R. and Glosh B.K., Designing control charts for means and variances, ASQC Qual. Cong. Trans. Amer. Soc. Qual. Cont., San Francisco CA (1981), pp. 400–407. [Google Scholar]
- 39.Ritov Y., Decision theoretic optimality of the CUSUM procedure, Ann. Stat. 18 (1990), pp. 1464–1469. [Google Scholar]
- 40.Siegmund D. and Venkatraman E.S., Using the generalized likelihood ratio statistic for sequential detection of a change-point, Ann. Stat. 23 (1995), pp. 255–271. [Google Scholar]
- 41.Spark R.S., Charts for signalling varying location shifts, J. Qual. Tech. 32 (2000), pp. 157–171. [Google Scholar]
- 42.Wang F.K and Cheng X.B., An exponentially weighted moving average chart based on likelihood-ratio test for monitoring Weibull mean and variance with subgroups, Qual. Rel. Eng. Int. 33 (2017), pp. 2409–2421. [Google Scholar]
- 43.Woodall W.H. and Montgomery D.C., Some current directions in the theory and application of statistical process monitoring, J. Qual. Tech. 46 (2014), pp. 78–94. [Google Scholar]
- 44.Woodall W.H., Zhao M.J., Paynabar K., Sparks R., and Wilson J.D., An overview and perspective on social network monitoring, IIE Trans. 49 (2017), pp. 354–365. [Google Scholar]
- 45.Wu Z. and Tian Y., Weighted-loss-function CUSUM chart for monitoring mean and variance of a production process, Int. J. Prod. Res. 43 (2005), pp. 3027–3044. [Google Scholar]





