Skip to main content
Entropy logoLink to Entropy
. 2020 Jun 26;22(6):709. doi: 10.3390/e22060709

Generalized Entropies, Variance and Applications

Abdolsaeed Toomaj 1,, Antonio Di Crescenzo 2,*,
PMCID: PMC7517246  PMID: 33286481

Abstract

The generalized cumulative residual entropy is a recently defined dispersion measure. In this paper, we obtain some further results for such a measure, in relation to the generalized cumulative residual entropy and the variance of random lifetimes. We show that it has an intimate connection with the non-homogeneous Poisson process. We also get new expressions, bounds and stochastic comparisons involving such measures. Moreover, the dynamic version of the mentioned notions is studied through the residual lifetimes and suitable aging notions. In this framework we achieve some findings of interest in reliability theory, such as a characterization for the exponential distribution, various results on k-out-of-n systems, and a connection to the excess wealth order. We also obtain similar results for the generalized cumulative entropy, which is a dual measure to the generalized cumulative residual entropy.

Keywords: generalized cumulative entropy, generalized cumulative residual entropy, variance, mean residual life, stochastic orders

MSC: 60E05, 62B10, 62N05, 94A17

1. Introduction and Background

The notions of uncertainty and information are relative and involve comparisons of distributions in terms of a probabilistic point of view. In information theory a relevant role is played by the concept of entropy; see Shannon [1]. We recall that an absolutely continuous nonnegative random variable X with probability density function (pdf) f, the (differential) entropy of X is defined as

H(X)=E[logf(X)]=0f(x)logf(x)dx, (1)

where E(·) denotes expectation and “log” is the natural logarithm, with the convention 0log0=0.

Despite the many advantages, the Shannon entropy has some limitations; see, e.g., Rao et al. [2] and Schroeder [3]. We recall the following concerns about the differential entropy. (i) H(X) cannot be used when X is a mixed random variable. (ii) The differential entropy of an absolutely continuous random variable may take any value on the extended real line, wheres in the discrete case the entropy is always positive. (iii) H(X) is inconsistent, in the sense that for a uniform distribution it may be zero, or negative, or positive. (iv) The differential entropy is decreased by conditioning. Moreover, the vanishing of the conditional differential entropy of X given Y does not imply that X is a function of Y, whereas in the discrete case the conditional entropy of X given Y is equal to zero if and only if X is a function of Y. (v) In general, the entropy of the empirical distribution does not provide a proper approximation of the differential entropy of an absolutely continuous random variable. (vi) The differential entropy, as the Shannon entropy, is location independent. To overcome these drawbacks, various new alternative measures of uncertainty have been proposed in the recent literature. Here we recall some basic concepts which are involved in their definitions.

Let X be a random variable with support (0,), having cumulative distribution function (cdf) F(x)=P(Xx) and survival function F¯(x)=1F(x). As customary, we denote by

Λ(x)=logF¯(x)=0xλ(t)dt,x>0

the cumulative hazard function and by

λ(t)=ddtΛ(t)=f(t)F¯(t),t>0 (2)

the hazard rate function of X. Let X describe the lifetime of a system. Under the condition that the system has survived up to age t>0, the survival function and the cumulative hazard function of the residual lifetime Xt:=[Xt|X>t], t>0, are respectively given by

F¯t(x)=F¯(x+t)F¯(t),Λt(x)=logF¯t(x)=tt+xλ(τ)dτ,x0, (3)

where [X|B] refers to a random variable having the same distribution of X conditioned on B. The mean residual lifetime (MRL) function of X is defined as

m(t)=E[Xt]=E[Xt|X>t]=1F¯(t)tF¯(x)dx,t>0. (4)

Similarly, one can also introduce the reversed hazard rate function of X, given by τ(t)=f(t)/F(t), t>0, and the cumulative reversed hazard function

T(x)=logF(x)=xτ(t)dt,x>0. (5)

Under the condition that the system has been found failed at age t>0, the inactivity time is defined as X[t]=[tX|Xt], t>0. The mean inactivity time (MIT) function of X is

μ˜(t)=E[X[t]]=E[tX|Xt]=1F(t)0tF(x)dx,t>0. (6)

It is also known as the mean past lifetime and the mean waiting time function of X.

Let us now recall various useful information measures that have been defined recently in terms of the functions reported above. For clarity and brevity, we report them in Table 1. The cumulative residual entropy (CRE) has been proposed and studied by Rao et al. [2] and Rao [4] as an alternative measure of uncertainty; see case (i) of Table 1. This measure is obtained by replacing the pdf with the survival function in (1). The CRE can be expressed as (see, e.g., Mitra [5] and Asadi and Zohrevand [6])

E(X)=E[m(X)]=0f(x)m(x)dx. (7)

Table 1.

Information measures of interest, for a given random lifetime X, with nN0 for cases (iii) and (v), nN for cases (iv) and (vi), and t>0 for cases (v) and (vi).

(i) cumulative residual entropy (CRE) (ii) cumulative entropy (CE)
E(X)=0F¯(x)logF¯(x)dx=0F¯(x)Λ(x)dx CE(X)=0F(x)logF(x)dx=0F(x)T(x)dx
(iii) generalized cumulative residual entropy (GCRE) (iv) generalized cumulative entropy (GCE)
En(X)=1n!0F¯(x)[Λ(x)]ndx=1n!0F¯(x)[logF¯(x)]ndx CEn(X)=1n!0F(x)[T(x)]ndx=1n!0F(x)[logF(x)]ndx
(v) dynamic gen. cumulative residual entropy (DGCRE) (vi) dynamic gen. cumulative entropy (DGCE)
En(X;t)=1n!tF¯(x)F¯(t)logF¯(x)F¯(t)ndx=1n!tF¯(x)F¯(t)[Λ(x)Λ(t)]ndx CEn(X;t)=1n!0tF(x)F(t)logF(x)F(t)ndx=1n!0tF(x)F(t)T(x)T(t)ndx

The CRE has been used by Leser [7] in order to measure the elasticity of life expectancy with respect to a proportional change of mortality in life tables. Recently, it has been extended in Psarrakos and Navarro [8] to the generalized cumulative residual entropy (GCRE) of X, for nN0N{0}={0,1,2,}, as given in (iii) of Table 1. It is worth noting that the GCRE is a dispersion measure related to the (upper) record values of a sequence of independent and identically distributed random variables and to the relevation transform. We recall that the relevation transform of X, denoted by X(X), is defined through the survival function

P[X(X)>x]=F¯(x)[1Λ(x)],x0,

where X is an independent copy of the lifetime X. Specifically, the GCRE refers to a relevation process with underlying distribution function F(x). This process describes the occurrence of failures of items, where a failed item is replaced (or repaired) by another item with the same age. Hence, after denoting by Xn the lifetime of the nth items, X1 has distribution function F(x). Moreover, Xn+1 conditional on Xn=t has the same distribution of [Xnt|Xn>t], that is, the residual lifetime of Xn, for all nN (see Psarrakos and Navarro [8] and Kapodistria and Psarrakos [9] for details). According to the above notation, we note that the GCRE satisfies the following probabilistic relation (see Corollary 4.1 of [9], and Equation (11) below):

En(X)=EXn+1EXn,nN0.

Hence, the GCRE provides a measure on the effectiveness of a relevation process, in the sense of the mean. Moreover, it is appropriate to describe useful information on stochastic models connected with the non-homogeneous Poisson process, shock models, preventive maintenance, repairable systems, and standby systems.

For n=0, one has E0(X)=E(X), whereas for n=1, the GCRE identifies with the CRE (see Table 1). In order to capture the effect of the age t>0 of a system on the information of the residual distribution, according to Equation (8) of Psarrakos and Navarro [8], the dynamic version of GCRE, denoted DGCRE for short, is defined by substituting F¯(x) with F¯t(x) in the definition (see cases (iii) and (v) of Table 1). It is evident that En(X;0)=En(X). Moreover, for n=0 we have

E0(X;t)=m(t), (8)

i.e., the mean residual life function (4). Some properties of E1(X)E(X) and its dynamic version are widely discussed in Asadi and Zohrevand [6] and Navarro et al. [10], among others. An application of the CRE in reliability engineering systems is given by Toomaj et al. [11]. Several properties of the GCRE and the DGCRE, such as bounds, stochastic ordering, aging classes properties, relationships with other entropy concepts, and characterization results, were investigated by Navarro and Psarrakos [12], Psarrakos and Navarro [8], and Psarrakos and Toomaj [13]. Specifically, in the latter paper the GCRE was studied as a risk measure, compared to the standard deviation and the right-tail risk measure, the latter being introduced by Wang [14].

Various dual measures can be introduced by analogy, as can be seen on the right-hand-side of Table 1, by replacing F¯(x) with F(x), and Λ(x) with T(x). Indeed, Di Crescenzo and Longobardi [15] defined the cumulative entropy (CE) as an alternative measure of uncertainty for the inactivity time by replacing the survival function with the distribution function; see (ii) of Table 1. We also recall that CE(X)=E[μ˜(X)]. A suitable extension of the CE, in analogy with the GCRE, was defined by Kayal [16] as the generalized cumulative entropy (GCE); see case (iv) of Table 1. Furthermore, Kayal [16] considered the corresponding dynamic version, named dynamic generalized cumulative entropy (DGCE), as given in case (vi) of Table 1. Note that limtCEn(X;t)=CEn(X), which coincides with the GCE of X. Various results on GCE and DGCE, related to bounds, stochastic ordering, aging classes properties, relationships with other entropy concepts, and characterizations, were obtained by Kayal [16] and Di Crescenzo and Toomaj [17].

The aim of the present paper is to investigate further results on GCRE and GCE. Specifically, we first illustrate an intimate connection between the GCRE and the non-homogeneous Poisson process. Moreover, we perform various stochastic comparisons, and provide various inequalities, including an upper bound for the GCRE in terms of the standard deviation. Some of our results are based on the fact that the GCRE is related to the record values of a sequence of independent and identically distributed (i.i.d.) random variables and the relevation transform, and that its dual, i.e., the GCE, is related to the lower record values and the reversed relevation transform. We recall that, in analogy with the relevation transform, the reversed relevation transform of X, denoted by X[X], is defined through the distribution function

P[X[X]x]=F(x)[1+T(x)],x>0,

with X an independent copy of the lifetime X.

In this paper we also focus on certain connections with the excess wealth order, based on the result that the GCRE can be expressed in terms of the excess wealth transform. Our investigation also deals with classical coherent systems of interest in reliability theory, i.e., k-out-of-n systems, by focusing on monotonicity properties and comparison results for their residual variance and GCRE.

The rest of this paper is organized as follows: In Section 2 we investigate a connection of the GCRE with the non-homogeneous Poisson processes (NHPP). Further, an expression for the variance of a random variable based the its mean residual lifetime is obtained and the connection of the GCRE with the standard deviation is considered. The connection of the GCRE with the excess wealth order is obtained in Section 3. Dynamic properties of GCRE and of the residual variance are given in Section 4. A characterization of the exponential distribution in terms of the variance residual life function and the dynamic GCE is also provided in Section 4. In Section 5, we discuss applications of the dynamic GCRE and of the residual variance in reliability, also with reference to k-out-of-n systems. In Section 6, similar results for the GCE are studied, whereas the dynamic GCE and inactivity variance are investigated in Section 7. Finally, Section 8 concludes the paper with some closing remarks.

For simplicity, in the rest of the paper we write ϕn(x) instead of [ϕ(x)]n for any given function ϕ. Moreover, ϕ denotes the derivative of ϕ. Note that the terms increasing and decreasing are used in a non-strict sense.

2. Connection of Variance and GCRE

An intimate connection of the GCRE with the expected interepochs (or successive times) of a non-homogeneous Poisson process and the relevation transform has been pointed out by Psarrakos and Navarro [8]. These notions arise naturally in preventive maintenance, repairable systems, cold standby systems, and shock models. In fact, such connection shows that the known results on the GCRE can be used in various applied contexts thanks to the large usefulness of the Poisson process. In particular, there is an intimate connection among non-homogeneous Poisson processes (NHPPs), record values, and minimal repair processes. For an excellent review, we refer the readers to, e.g., Gupta and Kirmani [18] and Kirmani and Gupta [19].

Let X be an absolutely continuous nonnegative random variable with pdf f(x) and survival function F¯(x). Assume that 0X0X1X2 denote the epoch times of a NHPP with intensity function (2), where X1 has the same distribution as X. In this case, Xn+1Xn,nN0, describes the duration of the interepoch intervals or the interoccurrence times. Denoting by F¯n+1(x) the survival function of Xn+1,nN0, it follows that (see Baxter [20])

F¯n+1(x)=F¯(x)k=0nΛk(x)k!,x0, (9)

so that the pdf of Xn+1 is given by

fn+1(x)=f(x)Λn(x)n!,x0. (10)

Recalling the definition of GCRE given in case (iii) of Table 1, from (9) we obtain

En(X)=E[Xn+1Xn]=0F¯n+1(x)F¯n(x)dx=0Λn(x)n!F¯(x)dx,nN0. (11)

Thus, for nN0, the GCRE of order n corresponds to the expected interepoch interval in a non-homogeneous Poisson process, with E0(X)=E(X).

As mentioned by Psarrakos and Toomaj [13], there is a close relationship between the GCRE and the standard deviation σ(X). Indeed, En(X),nN can be used for measuring the closeness of X to a degenerate distribution; i.e., it is a dispersion measure.

Proposition 1.

Let Y=ϕ(X), where ϕ:(0,)(0,) is a strictly increasing function such that ϕ(u)1 for all u>0. Then, En(X)En(Y) for all nN.

Proof. 

From (iii) of Table 1, denoting by ϕ1 the inverse of ϕ, one has

En(Y)=1n!0F¯Y(x)logF¯Y(x)ndx=1n!0F¯X(ϕ1(x))logF¯X(ϕ1(x))ndx=1n!0ϕ(u)F¯X(u)logF¯X(u)ndu=En(X)+1n!0[ϕ(u)1]F¯X(u)logF¯X(u)ndu.

Therefore, the proof immediately follows. □

This result is similar to that shown in Theorem 1 of Ebrahimi et al. [21] for the differential entropy. It should be noted that one advantage of the GCRE is that it exists for heavy tailed distributions with mean E(X)< and E(X2)=, while in this case σ(X) is not finite; see Psarrakos and Toomaj [13] and Yang [22]. Similar results also hold for the generalized entropy.

Hereafter, we provide a connection between the variance and the generalized cumulative residual entropy. First, we obtain an expression for the variance, σ2(X), in terms of the mean residual life function. It is based on the results in Hall and Wellner [23] (see also, Fernandez-Ponce et al. [24]).

Theorem 1.

Let X be an absolutely continuous nonnegative random variable with pdf f, distribution function F, and mean residual life function m(x), where the second moment E(X2) is finite. Then

σ2(X)=E[m2(X)]. (12)

Hereafter we show that Theorem 1 does not hold for a discrete random variable.

Remark 1.

Let X be an integer-valued random variable with probability mass function p(j)=P(X=j) and survival function P¯(k)=P(Xk)=i=kp(i), respectively. The discrete mean residual life m(k) is defined as (see Roy and Gupta [25])

m(k)=E[Xk|X>k]=1P¯(k+1)j=k+1P¯(j),kN0. (13)

For example, we consider a three-point discrete distribution with the probability mass function p(0)=1/2,p(1)=1/4 and p(2)=1/4. Then from (13), we obtain m(0)=3/2 and m(1)=1 while m(2)=0. It is obvious that σ2(X)=11/16. However, we get

E[m2(X)]=j=02m2(j)p(j)=118σ2(X).

Applying Theorem 1, one can get variance inequalities under suitable sufficient conditions. First, we recall that X is said to have increasing (decreasing) mean residual life, IMRL (DMRL) for short, if m(t) is increasing (decreasing) in t>0.

Moreover, for absolutely continuous nonnegative random variables X and Y with CDFs F and G, PDFs f and g, and mean residual lifetime functions mX(t) and mY(t), respectively, we say that X is smaller than Y in the

  • Usual stochastic order, denoted by XstY, if F¯(t)G¯(t),tR;

  • Mean residual lifetime order, denoted by XmrlY, if mX(t)mY(t) for all t>0.

For further information and properties about these concepts and on the stochastic orders that will be used in this paper (i.e., hr, rhr, ew, disp), we refer the reader to Shaked and Shanthikumar [26]. In view of the following theorem, we recall that neither of the orders st and mrl implies the other (see Section 2.A.2 of [26]).

Theorem 2.

Let X and Y be nonnegative random variables with mean residual life functions mX(x) and mY(x), respectively. Then

  •  (i) 

    Let XstY and XmrlY. If either X or Y is IMRL; then σ2(X)σ2(Y).

  •  (ii) 

    Let XstY and XmrlY. If either X or Y is DMRL; then σ2(X)σ2(Y).

Proof. 

Let Y be IMRL. From (12), we get

σ2(X)=E[mX2(X)]E[mY2(X)]E[mY2(Y)]=σ2(Y).

The first inequality is obtained from the assumption XmrlY while the last inequality is obtained by the fact that XstY implies that E(ψ(X))E(ψ(Y)) for all increasing functions ψ(·). Now, let X be IMRL. Then, we similarly have

σ2(X)=E[mX2(X)]E[mX2(Y)]E[mY2(Y)]=σ2(Y),

and hence the result stated in (i) follows. The proof of (ii) is similar. □

Example 1.

Let XGP(a,b) have generalized Pareto distribution, with survival function

F¯(x)=bax+b1a+1,x0,withx<baifa<0,

for a>1, a0, b>0 (see Arriaza et al. [27] for a recent characterization of the generalized Pareto distribution). It is well known that X has linear mean residual life function m(x)=ax+b, x0, ax+b>0. Clearly, X is DMRL if 1<a<0, is exponential if a0, and is IMRL if a>0. Assume that YGP(c,d), with analogous constraints on the parameters. It is clear that if a=c and b<d, then XstY and XmrlY. If, in addition, a=c>0, then both X and Y are IMRL. Indeed, in this case the result stated in point (i) of Theorem 2 is confirmed, being σ2(X)=1+a1ab2<1+c1cd2=σ2(Y) for a=c(1,1) and 0<b<d.

In the sequel, we give an upper bound for the generalized CRE in terms of the standard deviation. First, as extension of Theorem 2.1 of Asadi and Zohrevand [6] we provide an expression for the GCRE in terms of the mean residual life function.

Theorem 3.

Let X be an absolutely continuous nonnegative random variable with survival function F¯(x) and mean residual life function m(x), and let Xn be the nth epoch time of a NHPP with intensity function (2). Then, for all nN

En(X)=E[m(Xn)]. (14)

The identity (14) is a special case of Equation (34), which is proved in Section 4 below. As application of the representations (12) and (14), consider the following results.

Example 2.

(i) Assume that X is exponentially distributed with mean μ. Then, it is known that the MRL function of X is m(t)=μ,t>0. Hence, we have σ2(X)=μ2, and En(X)=μ, for any nN due to (14).

(ii) If X is distributed uniformly on (0,b),b>0, then m(t)=(bt)/2,0tb. From this, it can be shown that σ2(X)=E((bX)2/4)=b2/12. Moreover, for any nN we have

En(X)=b212E[Xn]=b2n+1,

where the last equality is obtained by noting that E[Xn]=bb/2n.

(iii) Let X have a Pareto (Lomax) distribution with parameters α>1 and β>0, with survival function and mean residual life given respectively by

F¯(x)=βα(x+β)α,x0,m(t)=1α1(t+β),t0.

Hence, we get

σ2(X)=1(α1)2E[(X+β)2]=αβ2(α1)2(α2).

Furthermore, it holds that

En(X)=1α1E[Xn]+β=βαn(α1)n+1,

where the last equality is obtained by E[Xn]=βαn/(α1)nβ, for nN.

Remark 2.

A class of distributions of interest in maintenance policies and shock models is the class of new better (worse) than used in expectation (NBUE) (NWUE) distributions. A random lifetime X is said to have a new better (worse) than used in expectation (NBUE) (NWUE) distribution if m(t)()m(0)=μ for all t>0. For a greater detail on these concepts, we refer the reader to, e.g., Barlow and Proschan [28]. If X is NBUE (NWUE), then under the assumptions of Theorem 3 we have

En(X)()μ. (15)

Moreover, from (12) one can see that σ2(X)()μ2, or equivalently

σ(X)()μ. (16)

The upper (lower) bounds in (15) and (16) show that the expected interepoch intervals (or the amount of uncertainty of a random variable X based on the GCRE) and the standard deviation are less (greater) than the expected value of X if it is NBUE (NWUE).

Thanks to (14), an iterative formula for the GCRE is proved in the following theorem.

Theorem 4.

Under the assumption of Theorem 3, for all nN we have

En(X)=En1(X)+1(n1)!E[hn(X)], (17)

where

hn(t):=0tm(x)Λn1(x)dx.

Proof. 

By virtue of (14) and m(x)λ(x)=1+m(x), it holds that

En(X)=0m(x)λ(x)F¯(x)Λn1(x)(n1)!dx=En1(X)+0m(x)F¯(x)Λn1(x)(n1)!dx,

for all nN. Using Fubini’s theorem, we have

0m(x)F¯(x)Λn1(x)dx=0m(x)xf(u)Λn1(x)dudx=0f(u)0um(x)Λn1(x)dxdu,

this giving the desired result. □

Hereafter we provide an alternative iterative formula for the GCRE.

Theorem 5.

Under the assumption of Theorem 3, for all nN, we have

En(X)=En1(X)1+E[m(Z)], (18)

where Z is an absolutely continuous nonnegative random variable having pdf

fZ(x)=F¯(x)En1(X)Λn1(x)(n1)!,x>0.

Proof. 

The result follows from the probabilistic mean value theorem (cf. Theorem 4.1 of [29]) and making use of Equations (11) and (14). □

Remark 3.

It is worth mentioning that if X is IMRL (DMRL), since m(x)()0, then as an immediate consequence of (17) or (18), we have

En(X)()En1(X)forallnN.

Hereafter, we obtain an upper bound for the GCRE of X in terms of its standard deviation, thereby providing a suitable relation between two concepts of dispersion measure.

Theorem 6.

Let X be an absolutely continuous nonnegative random variable with standard deviation σ(X) and GCRE function En(X). Then, for all nN,

En(X)[2(n1)]!(n1)!σ(X), (19)

Proof. 

By the Cauchy–Schwarz inequality, for all nN we obtain

0m(x)Λn1(x)f(x)dx20m2(x)f(x)dx0Λ2n2(x)f(x)dx.

On the other hand, it holds that

0Λ2n2(x)f(x)dx=Γ(2n1)=[2(n1)]!. (20)

Therefore, use of Theorems 1 and 3 completes the proof. □

In the special case n=1, from Theorem 6 one can obtain a close relationship between the standard deviation and CRE; i.e.,

eCH(X)E1(X)σ(X), (21)

where, for C=exp{01log(x|logx|)dx}0.2065, the first inequality is obtained from Rao et al. [2]. It is worth pointing out that the inequalities given in (21) involve three uncertainty measures. Moreover, the related inequality between the differential entropy and the standard deviation is similar to relation (2) of Ebrahimi et al. [21]. They also pointed out that the first inequality in (21) becomes an equality if and only if X is normal. Moreover, if X is exponential then the second inequality is satisfied as equality. As well known, the entropy is a measure of disparity of the density function f(x) from the uniform distribution. On the other hand, the variance measures an average of distances of outcomes of the probability distribution f(x) from the mean. Additionally, as mentioned by Psarrakos and Toomaj [13] (see also Toomaj et al. [11]), the CRE acts like the standard deviation, i.e., it is a dispersion measure in spite of the similarity shape with the Shannon entropy. Although all of three measures, i.e., entropy, standard deviation, and CRE, are measures of dispersion and uncertainty, the lack of a simple relationship between orderings of a distribution by the three measures derives from their quite substantial and subtle differences. All such measures reflect “concentration”, but their respective metrics for concentration are different.

We remark also that the Stirling formula allows one to obtain the following asymptotic result for the term given in the right-hand-side of (20):

[2(n1)]!(n1)!2n1[π(n1)]1/4asn.

For the last theorem of this section, we provide suitable bounds for the GCRE. These are useful in reliability applications, since in a typical situation the only fact known a priori, for example, is that the component has an increasing (decreasing) failure rate due to wear (reverse ageing). We recall that if X is an absolutely continuous nonnegative random variable with hazard rate function λ(t), then X is said to have an increasing (decreasing) failure rate, say IFR (DFR), if λ(t) is increasing (decreasing) in t>0.

Theorem 7.

Let X be an absolutely continuous nonnegative random variable with hazard rate function λ(t) and GCRE function En(X). If X is IFR (DFR), then for all nN

En(X)()1n!E[Xnλn1(X)].

Proof. 

Since X is IFR (DFR), for all x0 we have

Λ(x)=0xλ(t)dt()xλ(x). (22)

Hence, recalling that X has survival function F¯(t) and pdf f(x), from (iii) of Table 1 we have

n!En(X)=0F¯(x)[Λ(x)]ndx()0xnλn(x)F¯(x)dx=0xnλn1(x)f(x)dx,

this giving the proof. □

It is not hard to verify that if X is IFR, then

E[XΛn1(X)]E[Xnλn1(X)],forallnN. (23)

We recall that the condition that X is IFR implies that X is IFRA, i.e., 1tlogF¯(t) is increasing in t, so that the above relation indicates that the upper bound in Proposition 3.1 of Psarrakos and Toomaj [13] is a sharper bound. On the other hand, if X is DFR, then it is also DFRA. In this case, the inequality in (23) is reversed. This shows also that the lower bound in Proposition 3.1 of [13] improves the bound given in Theorem 7 when X is DFR.

3. Connection with the Excess Wealth Order

One of the most important issues in statistics, probability, actuarial science, risk theory, and other related areas is the concept of variability. The simplest way of comparing the variabilities of two distributions involves the associated standard deviations. However, the comparison of numerical measures is not always sufficiently informative. Several transforms and stochastic orders for comparing their variabilities have been introduced and widely studied (see Shaked and Shanthikumar [26]). One of said orders for the measure of spread is the excess wealth order. For a nonnegative random variable X with probability distribution function F, we recall that the quantile function is defined by

F1(p)=sup{x0:F(x)p},forp(0,1).

The excess wealth transform (or right spread function) is, for p(0,1),

WX(p)=F1(p)F¯(x)dx=p1(F1(q)F1(p))dq. (24)

This function is also related to the mean residual life function (4) by the following relation

mX(F1(p))=WX(p)1p,0<p<1. (25)

For an absolutely continuous nonnegative random variable X with strictly increasing distribution function F, Fernández-Ponce et al. [24] obtained the following representation for the variance of X in terms of excess wealth

σ2(X)=01[mX(F1(p))]2dp.

Analogously, in the following theorem we show that the GCRE can be expressed in terms of the excess wealth transform by means of (14). The proof is straightforward and thus is omitted.

Theorem 8.

For an absolutely continuous nonnegative random variable X, for any nN one has

En(X)=1(n1)!01mX(F1(p))[log(1p)]n1dp. (26)

Example 3.

(i) If X is uniformly distributed in [0,b], then mX(F1(p))=b(1p)/2. Thus, using (26), for any nN we obtain

En(X)=b2(n1)!01(1p)[log(1p)]n1dp=b2n+1.

(ii) Let us consider the Pareto distribution given in case (iii) of Example 2. It is easily seen that mX(F1(p))=β(1p)1/α/(α1). Thus, from (26), for any nN we have

En(X)=β(α1)(n1)!01(1p)1/α[log(1p)]n1dp=βαn(α1)n+1.

Let X and Y be random variables with distribution functions F and G, respectively. Then X is said to be smaller than Y in the excess wealth order, denoted as XewY, when WX(p)WY(p) for all p(0,1). It is known that XewY implies σ2(X)σ2(Y); see Shaked and Shanthikumar [26]. From (26) we thus obtain the following result, whose proof is straightforward.

Theorem 9.

Let X and Y be absolutely continuous nonnegative random variables. If XewY, then En(X)En(Y), for any nN.

Consequently, we have the following implications:

XdispYXewYEn(X)En(Y),

for any nN. We recall that X is smaller than Y in the dispersive order (denoted by XdispY) if F1(v)F1(u)G1(v)G1(u), 0<uv<1 (for more details, see, e.g., Shaked and Shanthikumar [26]).

4. Results on Dynamic GCRE and Residual Variance

In this section, we extend the previous results from GCRE to the DGCRE, cf. Table 1, as well as to the variance residual life function. The mean residual life function at age t has been employed in life lengths studies by various authors; see, e.g., Hollander and Proschan [30], Bhattacharjee [31], Hall and Wellner [23], Gupta [32], and the references therein. Another quantity which has generated interest in recent years is the variance of the residual life function defined by

σ2(Xt)=Var[Xt|X>t]=E[(Xt)2|X>t]m2(t)=2F¯(t)txF¯(u)dudxm2(t),t>0. (27)

It is involved in the formula for Var[m^n(t)] where m^n(t) is an estimator of the mean residual life function; see Hall and Wellner [23]. Several properties of the variance residual life function are studied in Gupta [32], Gupta et al. [33], and Gupta and Kirmani [18], among others. In this section, we will study some further results of this quantity and the GCRE. Similarly to (12), one can obtain an analogue representation for the variance residual life function in terms of the mean residual life function as follows:

σ2(Xt)=E[m2(X)|X>t]=1F¯(t)tm2(x)f(x)dx, (28)

for all t>0. Furthermore, its derivative is expressed as (see also Gupta [32])

ddtσ2(Xt)=λ(t)[σ2(Xt)m2(t)],t>0. (29)

If X is an absolutely continuous nonnegative random variable, it is shown in Psarrakos and Navarro [8] and Navarro and Psarrakos [12] that, for t>0 and nN, the DGCRE satisfies the following equalities:

En(X;t)=λ(t)[En(X;t)En1(X;t)], (30)

and

En(X;t)=1F¯(t)tEn1(X;x)f(x)dx. (31)

Moreover, recalling (3), in analogy with (11) we have:

En(X;t)=E[Xn+1Xn|X>t]=0F¯t(x)[Λt(x)]nn!dx,nN0. (32)

Hereafter we specify the dynamic version of identity (14). To this aim we point out that

fn(x|t):=[Λ(x)Λ(t)]n1(n1)!f(x)F¯(t),xt0 (33)

is the pdf of [Xn|X>t], nN. Recalling the correspondence between the structure of upper record values and the occurrence times of non-homogeneous Poisson processes under minimal repair (see Gupta and Kirmani [18]), we note that fn(x|t) can be viewed also as the pdf of the nth epoch time of a (delayed) NHPP Poisson process whose intensity function is λ(x)1{xt}.

Theorem 10.

Under the assumptions of Theorem 1, for all nN and t0 we have

En(X;t)=E[m(Xn)|X>t]. (34)

Proof. 

Recalling (3), since λt(z)=ddzΛt(z)=λ(t+z), it is not hard to see that for all nN one has

0uΛtn1(z)(n1)!λt(z)dz=Λtn(u)n!,u,t0.

From the above relation, from the definition given in (iii) of Table 1, and using Fubini’s theorem, we obtain

En(X;t)=0Λtn(u)n!F¯t(u)du=0F¯t(u)0uΛtn1(z)(n1)!λt(z)dzdu=0Λtn1(z)(n1)!λt(z)zF¯t(u)dudz=0Λtn1(z)(n1)!f(z+t)F¯(z+t)zF¯(u+t)F¯(t)dudz.

By setting y=u+t and recalling (4), we have

En(X;t)=0Λtn1(z)(n1)!f(z+t)F¯(t)z+tF¯(y)F¯(z+t)dydz=0Λtn1(z)(n1)!f(z+t)F¯(t)m(z+t)dz=t[Λ(x)Λ(t)]n1(n1)!f(x)F¯(t)m(x)dx,

with x=z+t. Thus, due to (33), we get the result (34). □

Clearly, for t=0, Equation (34) yields identity (14). We remark that the dynamic version of Theorem 6 provides the following upper bound:

En(X;t)[2(n1)]!(n1)!σ(Xt),nN,t0.

In the next theorem, through two suitable expressions we provide different probabilistic meanings for the DGCRE. The first is given in terms of a conditional expectation involving the cumulative hazard function and the hazard rate function. The second involves the conditional covariance of the n-th epoch time and the random variable Λ(Xn).

Theorem 11.

For any t0 and for all nN, it holds that

  • (i) 

    1nEΛ(Xn)Λ(t)λ(Xn)|X>t=En(X;t);

  • (ii) 

    1nCov[Xn,Λ(Xn)|X>t]=En(X;t).

Proof. 

(i) Recalling (33) we have

1nEΛ(Xn)Λ(t)λ(Xn)|X>t=1ntΛ(x)Λ(t)λ(x)fn(x|t)dt=t[Λ(x)Λ(t)]nn!F¯(x)F¯(t)dx,

this giving the desired result due to the definition of DGCRE given in (v) of Table 1.

(ii) By the definition, we have

Cov[Xn,Λ(Xn)|X>t]=E[XnΛ(Xn)|X>t]E[Xn|X>t]E[Λ(Xn)|X>t].

From (33), one can easily obtain

E[XnΛ(Xn)|X>t]=txΛ(x)fn(x|t)dx=nE[Xn+1|X>t]+Λ(t)E[Xn|X>t]

and

E[Λ(Xn)|X>t]=tΛ(x)fn(x|t)dx=n+Λ(t),

so that

Cov[Xn,Λ(Xn)|X>t]=n(E[Xn+1|X>t]E[Xn|X>t]).

Therefore, the result follows by means of (32). □

For t=0, Theorem 11 immediately yields the following result.

Corollary 1.

For all nN it holds that

  • (i) 

    1nEΛ(Xn)λ(Xn)=En(X);

  • (ii) 

    1nCov(Xn,Λ(Xn))=En(X).

We remark also that Λ(Xn)Gamma(n,1), and thus E[Λ(Xn)]=n. Moreover, the special case n=1 of Corollary 1 yields the relation Cov(X,Λ(X))=E(X), which is given in, e.g., [9].

Let us now provide a result for the variance residual life functions of two random variables satisfying the proportional mean residual life model (see Zahedi [34] and Nanda et al. [35] for some contributions on this topic).

Theorem 12.

Let X and Y be absolutely continuous nonnegative random variables with survival functions F¯(t) and G¯(t), hazard functions λX(t) and λY(t), and residual variances σ2(Xt) and σ2(Yt), respectively. Assume that X and Y satisfy the proportional mean residual life model, so that

mY(t)=cmX(t),t>0, (35)

where c is constant. If c>1 and if σ2(Xt) is an increasing function of t, then σ2(Yt) is also increasing in t, provided that limtG¯(t)F¯(t)<.

Proof. 

From differentiation of (35), after some calculations and making use of Equations (2) and (4), we first obtain that the hazard functions are related to the mean residual life of X by the following relation:

λX(t)λY(t)=c1cmX(t). (36)

Since σ2(Xt) is increasing in t by assumption, from (29) we have

σ2(Xt)mX2(t) (37)

for all t>0. We need to show that

σ2(Yt)mY2(t)=c2mX2(t)

or, due to (37), the stronger condition

1c2σ2(Yt)σ2(Xt).

To that aim, we define the function

φ(t):=G¯(t)σ2(Xt)1c2σ2(Yt).

We shall prove that φ(t)0. Differentiating φ(t) and using (29), (35), and (36), we have

φ(t)=g(t)σ2(Xt)1c2σ2(Yt)+G¯(t)λX(t)[σ2(Xt)mX2(t)]1c2λY(t)[σ2(Yt)mY2(t)]=G¯(t)[λX(t)λY(t)][σ2(Xt)mX2(t)]=G¯(t)c1cmX(t)[σ2(Xt)mX2(t)].

Hence, due to (37), since c>1, we have φ(t)0. From the fact that σ2(Xt)0 and assumption limtG¯(t)F¯(t)<, recalling (28) we get

limtφ(t)=limtG¯(t)σ2(Xt)1c2limtG¯(t)σ2(Yt)=0.

Since φ(t) is increasing, this implies that φ(t)0, and the desired result then follows. □

The next theorem generalizes Theorem 4.5 of Asadi and Zohrevand [6] for the GCRE and the variance residual life function. We first recall the following result, which is stated in Navarro and Psarrakos [12].

Lemma 1.

If X is IMRL (DMRL), then En(X;t) is increasing (decreasing) in t>0, for all nN.

Theorem 13.

Let X and Y be absolutely continuous nonnegative random variables with survival functions F¯(t) and G¯(t), variance residual life functions σ2(Xt) and σ2(Yt), and DGCRE functions En(X;t) and En(Y;t), respectively, such that En(X;0)< and En(Y;0)<, for fixed nN. Let XhrY, and let either X or Y be IMRL. Then

  •  (i) 

    En(X;t)En(Y;t), for all t>0 and for all nN;

  •  (ii) 

    σ2(Xt)σ2(Yt), for all t>0.

Proof. 

(i) We prove it by induction, when X is IMRL. Assumption XhrY gives mX(t)mY(t), for all t>0. Moreover, XhrY implies that E[ψ(X)|X>t]E[ψ(Y)|Y>t] for all increasing functions ψ(·), and in particular for mX(·) since X is IMRL. Hence, from these conditions, recalling (31) one can obtain, for all t>0,

E1(X;t)=tmX(x)f(x)dxF¯(t)tmX(x)g(x)dxG¯(t)tmY(x)g(x)dxG¯(t)=E1(Y;t).

Assume now that En1(X;t)En1(Y;t), for all t>0, and for a fixed n2. We recall that if X is IMRL, then En(Y;t) is increasing in t>0, for all nN (see Lemma 1). Thus, using similar arguments of n=1, from (31) we obtain, for all t>0,

En(X;t)=tEn1(X;x)f(x)dxF¯(t)tEn1(X;x)g(x)dxG¯(t)tEn1(Y;x)g(x)dxG¯(t)=En(Y;t),

for n2. Thus, in this case the proof is completed. The case when Y is IMRL can be treated similarly.

(ii) By using similar arguments of part (i), and due to (28), the result is obtained. □

In the sequel, we compare the GCRE and variance residual life functions of two random variables under weaker conditions.

Theorem 14.

Let X and Y be absolutely continuous nonnegative random variables with survival functions F¯(t) and G¯(t), mean residual life functions mX(t) and mY(t), and DCRE functions En(X;t) and En(Y;t), respectively. If XmrlY, and if X is DMRL and Y is IMRL, then

  • (i) 

    En(X;t)En(Y;t), for all t>0 and for all nN.

  • (ii) 

    σ2(Xt)σ2(Yt), for all t>0.

Proof. 

(i) The proof proceeds by induction. For n=1, we have

E1(Y;t)E1(X;t)=1G¯(t)tmY(x)g(x)dx1F¯(t)tmX(x)f(x)dxmY(t)G¯(t)tg(x)dxmX(t)F¯(t)tf(x)dx=mY(t)mX(t)0. (38)

The first inequality in (38) is obtained by noting that Y is IMRL and X is DMRL, while the last inequality is obtained from the assumption XmrlY. This gives the stated result for n=1. Now we assume that En1(X;t)En1(Y;t), for all t>0, and for a given n2. Since X is DMRL and Y is IMRL, from Lemma 1 we have that En1(X;t) and En1(Y;t) are decreasing and increasing, respectively. Hence, recalling (31) we get

En(Y;t)En(X;t)=1G¯(t)tEn1(Y;t)g(x)dx1F¯(t)tEn1(X;t)f(x)dxEn1(Y;t)G¯(t)tg(x)dxEn1(X;t)F¯(t)tf(x)dx=En1(Y;t)En1(X;t)0,

where the last inequality is due to the inductive hypothesis. This completes the proof.

(ii) The proof of σ2(Xt)σ2(Yt), t>0, can be obtained similarly, starting from (28), making use of the assumption that mX(x) and mY(x) are decreasing and increasing, respectively, and finally, using XmrlY. □

Finally, we conclude this section with a characterization of the exponential distribution in terms of variance residual life function and DCRE.

Theorem 15.

Let X be a nonnegative, absolutely continuous random variable having support (0,), with survival function F¯(t), residual variance σ2(Xt), and DCRE E(X;t). Then

E(X;t)=σ(Xt)t>0 (39)

if and only if X is exponentially distributed.

Proof. 

The necessity is obvious. To prove the sufficiency, let Equation (39) hold so that

E2(X;t)=σ2(Xt)t>0. (40)

By differentiating both sides of such identity with respect to t, recalling (29) and (30) for n=1, and (8), we obtain

2λ(t)[E2(X;t)m(t)E(X;t)]=λ(t)[σ2(Xt)m2(t)].

Hence, from (40) we get

2E2(X;t)2m(t)E(X;t)=E2(X;t)m2(t).

This reduces to [E(X;t)m(t)]2=0, which yields

E(X;t)=m(t),t>0.

The proof is thus complete; recal that the latter identity is fulfilled if and only if X is exponentially distributed (see Theorem 4.8 of Asadi and Zohrevand [6]). □

5. Applications in Reliability Theory

In the study of reliability of redundant systems, parallel systems play an important role. A parallel system consisting of m components, is a system which functions if and only if at least one of its m components functions. Let X,X1,X2,,Xm be i.i.d. random variables with common absolutely continuous distribution function F and survival function F¯=1F, and assume that Xi, i=1,2,,m, is the time up to the failure of the ith component of a coherent system. We denote by Xk:m, k=1,2,,m, the lifetime of the component having the kth smallest lifetime among m i.i.d. system components. The random lifetime Xk:m may represent the lifetime of an (mk+1)-out-of-m system, which consists of m components and functions if and only if at least (mk+1) out of m components functions. For the analysis of an (mk+1)-out-of-m system, we can define Xr,k,m(t)=[Xk:mt|Xr:m>t], for all 1rkm. The conditional random variable Xr,k,m(t) denotes the residual lifetime of the system under the condition that at least mr+1 components of the system are working at time t. The survival function of this lifetime is expressed as

F¯r,k,m(x|t)=i=0r1miFi(t)F¯mi(t)u=0ki1mmiF¯(x)F¯(t)miu1F¯(x)F¯(t)ui=0r1miFi(t)F¯mi(t), (41)

for all xt>0. We denote the corresponding mean residual lifetime by

mr,k,m(X,t)=E[Xk:mt|Xr:m>t],1rkm.

Asadi and Goliforushani [36] provided the following expression

mr,k,m(X,t)=i=0r1pi(t)m1,ki,mi(X,t), (42)

where

pi(t)=miϕi(t)j=0r1mjϕj(t),

and where ϕ(t)=F(t)/F¯(t),t>0, is the odds function. This measure has been studied by several authors in the reliability literature. Applying (42) and recalling (12), the residual variance of Xr,k,m(t), for t>0 will be denoted

σr,k,m2(X,t)=Var[Xk:mt|Xr:m>t]=tmr,k,m2(X,x)fr,k,m(x|t)dx (43)

for all 1rkm, where

fr,k,m(x|t)=ddxF¯r,k,m(x|t)

is the pdf of Xr,k,m(t). Recalling (31), one can obtain the GCRE of Xr,k,m(t) as

En(Xr,k,m(t))=tEn1(Xr,k,m(x))fr,k,m(x|t)dx,t>0,

for all 1rkm, and for all nN.

Asadi and Goliforushani [36] have shown that, when the components of an (mk+1)-out-of-m system are IFR, then the mean residual life function of Xr,k,m(t) is a decreasing function of time t. In the following theorem, we prove similar results for the variance residual life function and the GCRE. We just prove it for the variance since the proof for the other measure is similar.

Theorem 16.

Let X1,,Xn denote the i.i.d. lifetimes of an (mk+1)-out-of-m system. If X is IFR, then σr,k,m2(X,t) and En(Xr,k,m(t)) are decreasing functions of t.

Proof. 

The results simply follow from Theorem 2.4 of Asadi and Goliforushani [36], Theorem 3.3 of Gupta [32] and making use of Lemma 1. □

Other comparisons of (mk+1)-out-of-m systems are given in the next two theorems.

Theorem 17.

Let X1,,Xn denote the lifetimes of an (mk+1)-out-of-m system. If X is DFR, then

  • (i) 

    σ1,k1,m12(X,t)σ1,k,m2(X,t) for all t>0;

  • (ii) 

    En(X1,k1,m1(t))En(X1,k,m(t)) for all t>0.

Proof. 

(i) Let X be DFR. Then, from (43) we have

σ1,k1,m12(X,t)=tm1,k1,m12(X,x)f1,k1,m1(x|t)dxtm1,k,m2(X,x)f1,k1,m1(x|t)dxtm1,k,m2(X,x)f1,k,m(x|t)dx=σ1,k,m2(X,t).

The first inequality is obtained due to Remark 3 of Asadi and Bayramoglu [37] by noting that m1,k1,m12(X,x)m1,k,m2(X,x) for all x>0, while the second inequality follows by the fact that when X is DFR, then m1,k,m(X,x) is an increasing function of x due to Theorem 2 of Asadi and Bayramoglu [37] and by noting that X1,k1,m1(t)lrX1,k,m(t) which implies X1,k1,m1(t)hrX1,k,m(t) for all t>0. The latter relation can be obtained from the following remarks: from Remark 1 of Asadi and Bayramoglu [37], we derive that the distribution of X1,k,m(t) is identical to the distribution of the k-th order statistics of the sample taken from the conditional distribution of [Xt|X>t]. Therefore, from Corollary 1.C.38 of Shaked and Shanthikumar [26] it holds that X1,k1,m1(t)lrX1,k,m(t), which implies X1,k1,m1(t)hrX1,k,m(t) for all t>0.

(ii) The proof is similar to that of (i) and thus is omitted. □

The following theorem gives sufficient conditions for comparison of two (mk+1)-out-of-m systems based on their variance residual life functions and dynamic GCREs.

Theorem 18.

Let us consider two (mk+1)-out-of-m systems with i.i.d. component lifetimes distributed as X and Y, and having distribution functions F and G, respectively. If XhrY and X is DFR, then

  •  (i) 

    σ1,k,m2(X,t)σ1,k,m2(Y,t) for all t>0;

  •  (ii) 

    En(X1,k,m(t))En(Y1,k,m(t)) for all t>0.

Proof. 

For t>0, from (43) we have

σ1,k,m2(X,t)=tm1,k,m2(X,t)f1,k,m(x|t)dxtm1,k,m2(X,t)g1,k,m(x|t)dxtm1,k,m2(Y,t)g1,k,m(x|t)dx=σ1,k,m2(Y,t).

Since X is DFR, then m1,k,m2(X,t) is an increasing function of t due to Theorem 2 of Asadi and Bayramoglu [37]. Moreover, XhrY implies X1,k,m(t)hrY1,k,m(t) and hence the first inequality is obtained. The second inequality follows from Theorem 3 of Asadi and Bayramoglu [37]. Finally, the proof of part (ii) is similar to the proof of part (i) and thus is omitted. □

6. Results on the GCE

As pointed out by Kayal [16], there is an intimate connection with GCE and lower record values. Let Y1,Y2, be a sequence of i.i.d. nonnegative random variables with a common absolutely continuous cdf F, and with pdf f(x). An observation Yi is said to be a lower record if Yi<Yj for all j<i. Assume that if Yi occurs at time i, then the record time sequence is defined as

L(1)=1,L(n+1)=min{i:Yi<YL(n)},nN.

The random variables Xn+1🟉=YL(n+1), nN0, are said to be the lower records, such that YL(1)=dX. Denoting by Fn+1🟉(x) the cumulative distribution function of Xn+1🟉,nN0, it follows that

Fn+1🟉(x)=F(x)k=0nTk(x)k!,x0, (44)

so that the pdf of Xn+1🟉 is given by

fn+1🟉(x)=f(x)Tn(x)n!,x0, (45)

where T(x) is the cumulative reversed hazard function defined in (5). Recalling the definition of GCE given in case (iv) of Table 1, from (44) we obtain

CEn(X)=E[Xn🟉Xn+1🟉]=0Fn+1🟉(x)Fn🟉(x)dx,=0Tn(x)n!F(x)dx,nN. (46)

Thus, the GCE of order n corresponds to the expected spacings of lower record values. Note that for n=0,CE0(X)=0F(x)dx, which may be divergent. With reference to the GCE, in the following theorem we obtain a result analogous to (14). The proof is omitted, being similar to that of Theorem 3 since

tTn1(x)(n1)!τ(x)dx=Tn(t)n!,t0,nN.

Theorem 19.

Let X be an absolutely continuous nonnegative random variable with mean inactivity time function μ˜(t). Then, for all nN one has

CEn(X)=E[μ˜(Xn🟉)].

In the following theorem, we determine equivalent expressions for the GCE analogous to those given in Theorems 4 and 5, and thus the proof is omitted.

Theorem 20.

Under the assumption of Theorem 19, for all nN, we have

  • (i) 
    CEn(X)=CEn1(X)1(n1)!E[h˜n(X)],
    where
    h˜n(t):=tμ˜(x)Tn1(x)dx.
  • (ii) 
    CEn(X)=CEn1(X)1E[μ˜(Z˜)],
    where Z˜ is an absolutely continuous nonnegative random variable having pdf
    fZ˜(x)=F(x)CEn1(X)Tn1(x)(n1)!,x>0.

For an absolutely continuous nonnegative random variable X, for all t>0 such that F(t)>0, the mean inactivity time (6) can be written as

μ˜(t)=E[tX|Xt]=tμ(t), (47)

where

μ(t)=E[X|Xt]=1F(t)0txf(x)dx

denotes the mean failure time of a system conditioned by a failure before time t, also named “mean past lifetime”. The derivative of this function is given by

μ(t)=tτ(t)τ(t)μ(t), (48)

for all t>0. In the next theorem, we prove that the variance of a random variable can also be written in terms of the mean inactivity time function.

Theorem 21.

Let X be an absolutely continuous nonnegative random variable with pdf f, cdf F, and mean inactivity time μ˜(x), where the second moment E(X2) is finite. Then

σ2(X)=E[μ˜2(X)]. (49)

Proof. 

Let us set

w(x):=μ(x)F(x)=0xtf(t)dt,x>0.

Using (47), we obtain

E[μ˜2(X)]=0[xμ(x)]2f(x)dx=E(X2)+0μ2(x)f(x)dx20xμ(x)f(x)dx. (50)

Recalling (48), it holds that

0μ2(x)f(x)dx=0μ(x)τ(x)w(x)dx=0xτ(x)w(x)dx0μ(x)w(x)dx=0xμ(x)f(x)dx0μ(x)w(x)dx.

Integration by parts gives

0μ(x)w(x)dx=[E(X)]20xμ(x)f(x)dx,

which implies

0μ2(x)f(x)dx=20xμ(x)f(x)dx[E(X)]2. (51)

By substituting Equation (51) into (50), we have

E[μ˜2(X)]=E(X2)[E(X)]2σ2(X),

and this gives (49). □

In analogy with the result given in Theorem 2, on the ground of identity (49) we can now state the following theorem. First we remark that for two absolutely continuous nonnegative random variables X and Y with cdf’s F and G, pdf’s f and g, and mean inactivity time functions μ˜X(t) and μ˜Y(t), respectively, we say that X is smaller than Y in the mean inactivity time order, denoted by XmitY, if μ˜X(t)μ˜Y(t) for all t>0. Moreover, we recall that X is said to have increasing mean inactivity time (IMIT) if μ˜(t) is increasing in t>0. The proof of the following theorem is omitted, being similar to that of Theorem 2.

Theorem 22.

Let X and Y be nonnegative random variables with mean inactivity time functions μ˜X(t) and μ˜Y(t), respectively. Let XstY and XmitY. If either X or Y is IMIT, then σ2(X)σ2(Y).

Analogously to (19), hereafter we obtain an upper bound for the GCE in terms of the expected value of the squared mean inactivity time. The proof is omitted being similar to that of Theorem 6.

Theorem 23.

Let X be an absolutely continuous nonnegative random variable with mean inactivity time μ˜(t). Then, for all nN,

CEn(X)[2(n1)]!(n1)!σ(X).

In the special case n=1, from Theorem 23, one can obtain a close relationship between the standard deviation and the cumulative entropy; i.e.,

eCH(X)CE1(X)σ(X),

similarly as in (21).

7. Results on Past Variance and DGCE

In analogy with the variance of the residual life function defined in (27), we can introduce the variance of inactivity time (VIT) as (see, e.g., Mahdy [38])

σ2[X[t]]:=Var[tX|Xt]=E[(tX)2|Xt]μ˜2(t)=2F(t)0t0xF(u)dudxμ˜2(t),t>0. (52)

It should be noted that it is of interest to compare the dispersion of inactivity time distributions in some situations, especially when the mean inactivity times of these distributions are non-ordered. For example, suppose that the random variable X represents the failure time (or time of death) of a component or a living organism. Assume that the a component or a patient with lifetime X, fails (dies) at time t or sometimes before t, and consequently the component can be considered as a black box in the sense that the exact failure time or drying time of X is unknown. In this case, one wishes to estimate the time that has elapsed since the failure and to study the dispersion of this elapsed interval of time. Therefore, several authors have considered properties and stochastic orders of the variance inactivity time function; see Mahdy [38,39] and Kayid and Izadkhah [40] and the references therein. Similarly as (49), one can obtain an analogue representation for the variance inactivity time function in terms of the mean inactivity time function as follows:

σ2[X[t]]=E[μ˜2(X)|Xt],t>0. (53)

In analogy with (46) we have:

CEn(X;t)=E[Xn🟉Xn+1🟉|Xt]=0tF(x)F(t)[T(x)T(t)]nn!dx,nN.

Hereafter, we provide a result that is dual to Theorem 10, and hence its proof is omitted. To that end, we note that

fn🟉(x|t):=[T(x)T(t)]n1(n1)!f(x)F(t),0<xt, (54)

is the pdf of [Xn🟉|Xt], nN.

Theorem 24.

Under the assumptions of Theorem 19, for all nN and t0, we have

CEn(X;t)=E[μ˜(Xn🟉)|Xt].

We remark that the dynamic version of Theorem 23 provides the following upper bound:

CEn(X;t)[2(n1)]!(n1)!σ[X;t],nN,t0.

Now, with reference to Theorem 11, we obtain the dual results for the past time. In fact, through two suitable expressions we provide different probabilistic meanings for the DGCE where the first is given in terms of a conditional expectation involving the cumulative reversed hazard function as well as the reversed hazard rate function.

Theorem 25.

For any t0 and for all nN, it holds that

  • (i) 

    1nET(Xn🟉)T(t)τ(Xn🟉)|Xt=CEn(X;t);

  • (ii) 

    1nCov[Xn🟉,T(Xn🟉)|Xt]=CEn(X;t).

The analogies between Equations (27) and (52) allow us to provide various results for the VIT that are similar to those for the variance of the residual life. The following theorem is an analogue to Theorem 12; the proof is similar and thus is omitted. In this case we consider random variables having proportional mean inactivity time functions.

Theorem 26.

Let X and Y be absolutely continuous nonnegative random variables with survival functions F¯(t) and G¯(t), mean inactivity time functions μ˜X(t) and μ˜Y(t), and variances of inactivity time σ2[X[t]] and σ2[Y[t]], respectively. Assume that

μ˜Y(t)=cμ˜X(t),t>0, (55)

where c is constant. If c>1 and if σ2[X[t]] is an increasing function of t, then σ2[Y[t]] is also increasing in t.

We conclude with a result for the generalized cumulative entropy and the variance of inactivity time that is analogous to Theorem 13. Again, the proof is similar and thus is omitted. We have seen already that X is IMIT means that μ˜(t) is increasing in t>0. Moreover, consider the following lemma, which is stated in Di Crescenzo and Toomaj [17].

Lemma 2.

If X is IMIT, then CEn(X;t) is increasing in t>0, for all nN.

Theorem 27.

Let X and Y be absolutely continuous nonnegative random variables with variances of inactivity time σ2[X[t]] and σ2[Y[t]], and DGCE functions CEn(X;t) and CEn(Y;t), respectively, such that CEn(X;0)<, and CEn(Y;0)<, for fixed nN. Let XrhrY, and let either X or Y be IMIT. Then

  • (i) 

    CEn(X;t)CEn(Y;t), for all t>0 and for all nN;

  • (ii) 

    σ2[X[t]]σ2[Y[t]], for all t>0.

8. Conclusions

Besides that the GCRE is related to the upper record values of a sequence of independent and identically distributed random variables, and the relevation transform, there is also an intimate connection of the GCRE with the non-homogeneous poisson process, so we are assured that several findings in the literature on the GCRE can be used in shock models, preventive maintenance, repairable systems, and standby systems. It is known that the GCRE has some important variability properties, such as location invariance and positive homogeneity (i.e., En(aX+b)=aEn(X) for all a>0 and bR) and standardization (i.e., for all cR, one has En(c)=0). These properties suggest that the GCRE can also be considered as a dispersion measure. In this case, a connection of the GCRE with the standard deviation is derived. We have shown that when a random variable is absolutely continuous, then its variance can be represented in terms of either mean residual lifetime and mean inactivity time. Based on these expressions, several preservation properties with some well-known stochastic orders have been investigated. Moreover, the connection of the GCRE with the excess wealth order has been studied, together with some properties of the dynamic version of GCRE. Similar results have been obtained also for the GCE, being the dual measure of GCRE.

Future developments based on the ideas considered in this paper will be oriented to the case of weighted measures involving cumulative weighted random variables (see Toomaj and Di Crescenzo [41]). Other related research lines may involve (i) the information-based measures of statistical dispersion based on entropy and Fisher information treated by Kostal et al. [42], and (ii) the variance of typical information measures, such as the differential entropy and the Tsallis entropy (see, e.g., Di Crescenzo and Paolillo [43], and Wei [44]).

Finally, we note that a new kind of entropy that combines the concepts of CRE and CE is the cumulative paired ϕ-entropy. The construction of such a notion is based on both the distribution function and the survival function of X, through the functional

CPEϕ(X)=Rϕ(F(x))+ϕ(F¯(x))dx.

See Klein et al. [45] and Klein and Doll [46] for detailed investigations on CPEϕ, also dealing with relationships of the cumulative paired entropy to the variance. This entropy has the properties of a measure of scale (or dispersion). Suitable choices of ϕ allow one to introduce suitable generalized measures. This approach can be adopted also to construct paired combinations of the CGRE and GCE, and of their dynamic counterparts. This reveals new research ideas for future developments.

Acknowledgments

We thank the referees for useful comments.

Author Contributions

The authors contributed equally to this work. All authors have read and agreed to the published version of the manuscript.

Funding

A.T. is partially supported by a grant from Gonbad Kavous University. A.D.C. is a member of the GNCS of INdAM. This research is partially supported by MIUR (PRIN 2017, project “Stochastic Models for Complex Systems”, number 2017JFFHSH).

Conflicts of Interest

The authors declare no conflict of interest.

References

  • 1.Shannon C.E. A mathematical theory of communication. Bell. Syst. Tech. J. 1948;27:379–423, 623–656.. doi: 10.1002/j.1538-7305.1948.tb01338.x. [DOI] [Google Scholar]
  • 2.Rao M., Chen Y., Vemuri B., Fei W. Cumulative residual entropy: A new measure of information. IEEE Trans. Inf. Theory. 2004;50:1220–1228. doi: 10.1109/TIT.2004.828057. [DOI] [Google Scholar]
  • 3.Schroeder M.J. An alternative to entropy in the measurement of information. Entropy. 2004;6:388–412. doi: 10.3390/e6050388. [DOI] [Google Scholar]
  • 4.Rao M. More on a new concept of entropy and information. J. Theoret. Probab. 2005;18:967–981. doi: 10.1007/s10959-005-7541-3. [DOI] [Google Scholar]
  • 5.Mitra S. A short note on the Taeuber paradox. Demography. 1978;15:621–623. doi: 10.2307/2061211. [DOI] [PubMed] [Google Scholar]
  • 6.Asadi M., Zohrevand Y. On the dynamic cumulative residual entropy. J. Stat. Plan. Inference. 2007;137:1931–1941. doi: 10.1016/j.jspi.2006.06.035. [DOI] [Google Scholar]
  • 7.Leser C.E.V. Variations in mortality and life-expectation. Popul. Stud. 1955;9:67–71. doi: 10.1080/00324728.1955.10405052. [DOI] [Google Scholar]
  • 8.Psarrakos G., Navarro J. Generalized cumulative residual entropy and record values. Metrika. 2013;27:623–640. doi: 10.1007/s00184-012-0408-6. [DOI] [Google Scholar]
  • 9.Kapodistria S., Psarrakos G. Some extensions of the residual lifetime and its connection to the cumulative residual entropy. Probab. Eng. Inform. Sci. 2012;26:129–146. doi: 10.1017/S0269964811000271. [DOI] [Google Scholar]
  • 10.Navarro J., del Aguila Y., Asadi M. Some new results on the cumulative residual entropy. J. Stat. Plan. Inference. 2010;140:310–322. doi: 10.1016/j.jspi.2009.07.015. [DOI] [Google Scholar]
  • 11.Toomaj A., Sunoj S., Navarro J. Some properties of the cumulative residual entropy of coherent and mixed systems. J. Appl. Probab. 2017;54:379–393. doi: 10.1017/jpr.2017.6. [DOI] [Google Scholar]
  • 12.Navarro J., Psarrakos G. Characterizations based on generalized cumulative residual entropy functions. Commun. Stat. Theory Methods. 2017;46:1247–1260. doi: 10.1080/03610926.2015.1014111. [DOI] [Google Scholar]
  • 13.Psarrakos G., Toomaj A. On the generalized cumulative residual entropy with applications in actuarial science. J. Comput. Appl. Math. 2017;309:186–199. doi: 10.1016/j.cam.2016.06.037. [DOI] [Google Scholar]
  • 14.Wang S. An actuarial index of the right-tail risk. N. Am. Actuar. J. 1998;2:88–101. doi: 10.1080/10920277.1998.10595708. [DOI] [Google Scholar]
  • 15.Di Crescenzo A., Longobardi M. On cumulative entropies. J. Stat. Plan. Inferfaces. 2009;139:4072–4087. doi: 10.1016/j.jspi.2009.05.038. [DOI] [Google Scholar]
  • 16.Kayal S. On generalized cumulative entropies. Probab. Eng. Inform. Sci. 2016;30:640–662. doi: 10.1017/S0269964816000218. [DOI] [Google Scholar]
  • 17.Di Crescenzo A., Toomaj A. Further results on the generalized cumulative entropy. Kybernetika. 2017;53:959–982. doi: 10.14736/kyb-2017-5-0959. [DOI] [Google Scholar]
  • 18.Gupta R.C., Kirmani S.N.U.A. Closure and monotonicity properties of non-homogeneous Poisson processes and record values. Probab. Eng. Inform. Sci. 1988;2:475–484. doi: 10.1017/S0269964800000188. [DOI] [Google Scholar]
  • 19.Kirmani S.N.U.A., Gupta R.C. On repair age and residual repair life in the minimal repair process. Probab. Eng. Inform. Sci. 1989;3:381–391. doi: 10.1017/S0269964800001248. [DOI] [Google Scholar]
  • 20.Baxter L. Reliability applications of the relevation transform. Naval Res. Logist. Quart. 1982;29:323–329. doi: 10.1002/nav.3800290212. [DOI] [Google Scholar]
  • 21.Ebrahimi N., Maasoumi E., Soofi E.S. Ordering univariate distributions by entropy and variance. J. Econom. 1999;90:317–336. doi: 10.1016/S0304-4076(98)00046-3. [DOI] [Google Scholar]
  • 22.Yang L. Study on cumulative residual entropy and variance as risk measure; Proceedings of the 2012 Fifth International Conference on Business Intelligence and Financial Engineering; Lanzhou, Gansu, China. 18–21 August 2012; pp. 210–213. [Google Scholar]
  • 23.Hall W.J., Wellner J.A. Mean residual life. In: Csörgö M., Dawson D.A., Rao J.N.K., Saleh A.K.M.E., editors. Statistics and Related Topics. North-Holland; Amsterdam, The Netherlands: 1981. pp. 169–184. [Google Scholar]
  • 24.Fernández-Ponce J.M., Kochar S.C., MuÑoz-Perez J. Partial orderings of distributions based on right spread functions. J. Appl. Probab. 1998;35:221–228. doi: 10.1239/jap/1032192565. [DOI] [Google Scholar]
  • 25.Roy D., Gupta R.P. Characterizations and model selections through reliability measures in the discrete case. Stat. Probab. Lett. 1999;43:197–206. doi: 10.1016/S0167-7152(98)00260-0. [DOI] [Google Scholar]
  • 26.Shaked M., Shanthikumar J.G. Stochastic Orders and Their Applications. Academic Press; San Diego, CA, USA: 2007. [Google Scholar]
  • 27.Arriaza A., Di Crescenzo A., Sordo M.A., Suárez-Llorens A. Shape measures based on the convex transform order. Metrika. 2019;82:99–124. doi: 10.1007/s00184-018-0667-y. [DOI] [Google Scholar]
  • 28.Barlow R.E., Proschan F. Statistical Theory of Reliability and Life Testing. Holt, Rinehart and Winston; New York, NY, USA: 1975. [Google Scholar]
  • 29.Di Crescenzo A. A probabilistic analogue of the mean value theorem and its applications to reliability theory. J. Appl. Probab. 1999;36:706–719. doi: 10.1239/jap/1032374628. [DOI] [Google Scholar]
  • 30.Hollander W., Proschan F. Tests for mean residual life. Biometrika. 1975;62:585–593. doi: 10.1093/biomet/62.3.585. [DOI] [Google Scholar]
  • 31.Bhattacharjee M.C. The class of mean residual lives and some consequences. Siam J. Algebraic Discrete Methods. 1982;3:56–65. doi: 10.1137/0603006. [DOI] [Google Scholar]
  • 32.Gupta R.C. On the monotonic properties of residual variance and their applications in reliability. J. Stat. Plan. Infer. 1987;16:329–335. doi: 10.1016/0378-3758(87)90085-1. [DOI] [Google Scholar]
  • 33.Gupta R.C., Kirmani S.N.U.A., Launer R.L. On life distributions having monotone residual variance. Probab. Eng. Inform. Sci. 1987;1:299–307. doi: 10.1017/S0269964800000073. [DOI] [Google Scholar]
  • 34.Zahedi H. Proportional mean remaining life model. J. Stat. Plan. Inference. 1991;29:221–228. doi: 10.1016/0378-3758(92)90135-F. [DOI] [Google Scholar]
  • 35.Nanda A.K., Bhattacharjee S., Alam S.S. Properties of proportional mean residual life model. Stat. Probab. Lett. 2006;76:880–890. doi: 10.1016/j.spl.2005.10.019. [DOI] [Google Scholar]
  • 36.Asadi M., Goliforushani S. On the mean residual life function of coherent systems. IEEE Trans. Inf. Theory. 2008;57:314–318. doi: 10.1109/TR.2008.2007161. [DOI] [Google Scholar]
  • 37.Asadi M., Bairamoglu I. The mean residual life function of the k-out-of-n systems at system level. IEEE Trans. Inf. Theory. 2006;55:314–318. [Google Scholar]
  • 38.Mahdy M. Characterization and preservations of the variance inactivity time ordering and the increasing variance inactivity time class. J. Adv. Res. 2012;3:29–34. doi: 10.1016/j.jare.2011.03.001. [DOI] [Google Scholar]
  • 39.Mahdy M. Further results involving variance past lifetime class and associated orderings, and its properties. Phys. A Stat. Mech. Its Appl. 2016;462:1148–1160. doi: 10.1016/j.physa.2016.06.066. [DOI] [Google Scholar]
  • 40.Kayid M., Izadkhah S. Some new results about the variance inactivity time ordering with applications. Appl. Math. Model. 2016;40:3832–3842. doi: 10.1016/j.apm.2015.11.006. [DOI] [Google Scholar]
  • 41.Toomaj A., Di Crescenzo A. Connections between weighted generalized cumulative residual entropy and variance. Mathematics. 2020 submitted. [Google Scholar]
  • 42.Kostal L., Lansky P., Pokora O. Measures of statistical dispersion based on Shannon and Fisher information concepts. Inf. Sci. 2013;235:214–223. doi: 10.1016/j.ins.2013.02.023. [DOI] [Google Scholar]
  • 43.Di Crescenzo A., Paolillo L. Analysis and applications of the residual varentropy of random lifetimes Probab. Eng. Inform. Sci. 2020 doi: 10.1017/S0269964820000133. to appear. [DOI] [Google Scholar]
  • 44.Wei L. On the exact variance of Tsallis entanglement entropy in a random pure state. Entropy. 2019;21:539. doi: 10.3390/e21050539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Klein I., Mangold B., Doll M. Cumulative paired ϕ-entropy. Entropy. 2016;18:248. doi: 10.3390/e18070248. [DOI] [Google Scholar]
  • 46.Klein I., Doll M. (Generalized) maximum cumulative direct, residual, and paired Φ entropy approach. Entropy. 2020;22:91. doi: 10.3390/e22010091. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Entropy are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES