Skip to main content
Entropy logoLink to Entropy
. 2023 Mar 20;25(3):534. doi: 10.3390/e25030534

Explicit Expressions for Most Common Entropies

Saralees Nadarajah 1,*, Malick Kebe 1
Editor: Giorgio Kaniadakis1
PMCID: PMC10048637  PMID: 36981422

Abstract

Entropies are useful measures of variation. However, explicit expressions for entropies available in the literature are limited. In this paper, we provide a comprehensive collection of explicit expressions for four of the most common entropies for over sixty continuous univariate distributions. Most of the derived expressions are new. The explicit expressions involve known special functions.

Keywords: beta function, gamma function, Gauss hypergeometric function

1. Introduction

Let X denote a continuous random variable with probability density and cumulative distribution functions specified by fX(·) and FX(·), respectively. Four of the most popular entropies are the geometric mean [1,2], Shannon entropy ([3], pp. 379–423; [3], pp. 623–656), Rényi entropy [4] and the cumulative residual entropy [5], defined by

GM(X)=∫logxfX(x)dx, (1)
S(X)=−∫logfX(x)fX(x)dx, (2)
R(X)=11−γlog∫fX(x)γdx (3)

and

CE(X)=−∫1−FX(x)log1−FX(x)dx, (4)

respectively, for γ≥0 and γ≠1.

There have been several papers giving explicit expressions for entropies. Ref. [6] derived expressions for S(X) for twenty univariate distributions. Ref. [7] derived expressions for S(X) for five multivariate distributions. Ref. [8] derived expressions for S(X) and mutual information for eight multivariate distributions. Ref. [9] derived expressions for S(X) and R(X) for fifteen bivariate distributions. Ref. [10] derived expressions for S(X) and R(X) for fifteen multivariate distributions. Ref. [11] derived expressions for S(X), R(X) and the q-entropy for the Dagum distribution. Ref. [12] derived expressions for S(X) for certain binomial type distributions. Ref. [13] derived expressions for GM(X) and CE(X) for three Lindley type distributions.

All of these and other papers are restrictive in terms of the entropies considered and the number of distributions considered. In this paper, we derive expressions for (1)–(4) for more than sixty continuous univariate distributions, see Section 3. Most of the derived expressions are new. Some technicalities used in the derivations are given in Section 2. The derivations themselves are not given and can be obtained from the corresponding author. Some conclusions and future work are noted in Section 4.

The calculations of this paper involve several special functions, including the the exponential integral defined by

Ei(a)=∫−∞aexp(t)tdt;

the gamma function defined by

Γ(a)=∫0∞ta−1exp(−t)dt;

the lower incomplete gamma function defined by

Γ(a,x)=∫x∞ta−1exp(−t)dt;

the upper incomplete gamma function defined by

γ(a,x)=∫0xta−1exp(−t)dt;

the digamma function defined by

ψ(a)=logΓ(a)da;

the standard normal distribution function defined by

Φ(a)=12π∫−∞xexp−t22dt;

the error function defined by

erf(a)=2π∫0aexp−t2dt;

the complementary error function defined by

erfc(a)=2π∫a∞exp−t2dt;

the beta function defined by

B(a,b)=∫01ta−1(1−t)b−1dt;

the incomplete beta function defined by

Bx(a,b)=∫0xta−1(1−t)b−1dt;

the incomplete beta function ratio defined by

Ix(a,b)=Bx(a,b)B(a,b);

the modified Bessel function of the first kind of order ν defined by

Iν(x)=∑k=0∞1Γ(k+ν+1)k!x22k+ν;

the modified Bessel function of the second kind defined by

Kν(x)=π2sin(πν)I−ν(x)−Iν(x),if ν∉Z,limμ→νKμ(x),if ν∈Z;

the confluent hypergeometric function defined by

1F1a;b;x=∑k=0∞(a)k(b)kxkk!,

where (a)k=a(a+1)⋯(a+k−1) denotes the ascending factorial; the Kummer function defined by

Ψa;b;x=Γ(1−b)Γ(1+a−b)1F1a;b;x+Γ(b−1)Γ(a)x1−b1F11+a−b;1−b;x;

the Gauss hypergeometric function defined by

2F1a,b;c;x=∑k=0∞(a)k(b)k(c)kxkk!;

the degenerate hypergeometric series of two variables defined by

Φ1a,b,c,x,y=∑m=0∞∑n=0∞(a)m+n(b)nxmyn(c)m+nm!n!;

the degenerate hypergeometric function of two variables defined by

F1a,b,c;d;x,y=∑m=0∞∑n=0∞(a)m+n(b)m(c)nxmyn(d)m+nm!n!.

The properties of these special functions can be found in [14,15].

2. Technical Lemmas

The derivations in Section 3 use the following two lemmas.

Lemma 1.

The geometric mean defined by (1) can be calculated using

GM(X)=ddαEXαα=0, (5)

where E(·) denotes the expectation defined by

EXα=∫xαfX(x)dx.

Proof. 

Note that

GM(X)=∫ddαxαα=0fX(x)dx=ddα∫xαfX(x)dxα=0.

Hence, the result. □

Lemma 2.

The cumulative residual entropy defined by (4) can be calculated using

CE(X)=∑k=1∞1k∫FX(x)kdx−∑k=1∞1k∫FX(x)k+1dx. (6)

Proof. 

Using the Taylor series expansion for log(1−z), we can write

CE(X)=∫1−FX(x)∑k=1∞1kFX(x)kdx=∫∑k=1∞1kF(x)kdx−∫∑k=1∞1kF(x)k+1dx.

Hence, the result. □

3. The Tabulation

In this section, we give expressions for fX(x) (the probability density function), FX(x) (the cumulative distribution function), GM(X) (the geometric mean), S(X) (Shannon entropy), R(X) (Rényi entropy), and CE(X) (the cumulative residual entropy) for over sixty continuous univariate distributions.

1. Gauss hypergeometric beta distribution [16]: for this distribution,

fX(x)=Kxa−1(1−x)b−1(1+dx)c,
FX(x)=KxaaF1a,c,1−b,a+1;−dx,x,
GM(X)=expΓ′(a)Γ(a)+12F1c,a;a+b;−d∂∂α2F1c,α+a;α+a+b;−dα=0−Γ′(a+b)Γ(a+b),
S(X)=−Γ′(a)Γ(a)−12F1c,a;a+b;−d∂∂α2F1c,α+a;α+a+b;−dα=0+2Γ′(a+b)Γ(a+b)−Γ′(b)Γ(b)−12F1c,a;a+b;−d∂∂α2F1c,a;α+a+b;−dα=0−12F1c,a;a+b;−dddα2F1c−α,a;a+b;−d−logB(a,b)−log2F1c−α,a;a+b;−d,
R(X)=11−γlogBaγ−γ+1,bγ−γ+1+11−γlog2F1cγ,aγ−γ+1;aγ+bγ−2γ+2;−d−γ1−γlogB(a,b)−γ1−γlog2F1c,a;a+b;−d

and

CE(X)=−∫011−KxaaF1a,c,1−b,a+1;−dx,xlog1−KxaaF1a,c,1−b,a+1;−dx,xdx

for 0<x<1, a>0, b>0, −∞<c<∞ and d>−1, where Γ′(x)=dΓ(x)dx and 1K=B(a,b)2F1c,a;a+b;−d.

2. q Weibull distribution [17]: for this distribution,

fX(x)=(2−q)abxa−11−(1−q)bxa11−q,
FX(x)=1−1−(1−q)bxa2−q1−q,
GM(X)=−2−qa(q−1)log(q−1)bΓ2−qq−1Γ1q−1−2−qa(q−1)Γ′2−qq−1Γ1q−1+2−qa(q−1)Γ′(1)Γ2−qq−1Γ1q−1,if 1<q<2,2−qa(q−1)log(1−q)bΓ2−q1−qΓ3−2q1−q+2−qa(q−1)Γ′3−2q1−qΓ3−2q1−q2−2−qa(q−1)Γ′(1)Γ2−q1−qΓ3−2q1−q,if q<1,
S(X)=−log(2−q)ab+12−q−(1−a)(2−q)a(q−1)log(q−1)bΓ2−qq−1Γ1q−1−(1−a)2−qa(q−1)Γ′2−qq−1Γ1q−1+(1−a)(2−q)a(q−1)Γ′(1)Γ2−qq−1Γ1q−1,if 1<q<2,−log(2−q)ab+12−q+(1−a)(2−q)a(q−1)log(1−q)bΓ2−q1−qΓ3−2q1−q+(1−a)(2−q)a(q−1)Γ′3−2q1−qΓ3−2q1−q2−(1−a)(2−q)a(q−1)Γ′(1)Γ2−q1−qΓ3−2q1−q,if q<1,
R(X)=11−γlog(2−q)γaγ−1bγ−1a(q−1)γ+1−γaBγ+1−γa,−γ1−q−γ−1−γa,if 1<q<2,log(2−q)γaγ−1bγ−1a(q−1)γ+1−γaBγ+1−γa,1+γ1−q,if q<1

and

CE(X)=−2−qa(q−1)Γ1a(q−1)b1aΓ′2−qq−1−1aΓ2−qq−1+2−qa(q−1)Γ1a(q−1)b1aΓ2−qq−1−1aΓ′2−qq−1Γ2−qq−12,if 1<q<2,2−qa(q−1)Γ1a(1−q)b1aΓ′2−q1−q+1Γ2−q1−q+1+1a−2−qa(q−1)Γ1a(1−q)b1aΓ2−q1−q+1Γ′2−q1−q+1+1aΓ2−q1−q+1+1a2,if q<1

for a>0, b>0, 0<x<∞ if 1<q<2 and 0<x<(1−q)b1a if q<1.

3. q exponential distribution [17]: for this distribution,

fX(x)=(2−q)b1−(1−q)bx11−q,
FX(x)=1−1−(1−q)bx2−q1−q,
GM(X)=−2−qq−1Γ′qq−1Γ2q−1q−1+2−qqΓ′1−2−qqlog(q−1)b,if 1<q<2,−Γ′3−2q1−qΓ3−2q1−q+Γ′1−log(1−q)b,if q<1,
S(X)=−log(2−q)b−2−q1−q11+(α+1)(1−q),
R(X)=−logb+11−γlog(2−q)γγ+1−q

and

CE(X)=2−qb3−2q2

for b>0, 0<x<∞ if 1<q<2 and 0<x<(1−q)b if q<1.

4. Weighted exponential distribution: for this distribution,

fX(x)=a+1abexp(−bx)1−exp(−abx),
FX(x)=1aexp(−bx)exp(−abx)−a−1,
GM(X)=aΓ′(1)−alogb+(a+1)log(a+1),
S(X)=−log(a+1)ba+a+1−1a+1−Γ′(2)+Γ′1a+2Γ1a+2,
R(X)=−logb−1+γ1−γloga+γ1−γlog(a+1)+11−γlogBγa,γ+1

and

CE(X)=a+1ab1−1(1+a)3+(a+1)logaab1−1(1+a)2

for x>0, a>0 and b>0.

5. Teissier distribution [18]: for this distribution,

fX(x)=exp(ax)−1expax−exp(ax)+1,
FX(x)=1−expax−exp(ax)+1,
GM(X)=e∂∂αa−α∫1∞(logy)α(y−1)exp(−y)dyα=0,
S(X)=−loga−ae∂∂α∫1∞y(y−1)α+1exp(−y)dyα=0−e∂∂αΓ(α+2,1)−Γ(α+1,1)α=0+2,
R(X)=aγΓ(γ+1)Ψγ+2,2γ+1;γ

and

CE(X)=−eaEi(1)−exp(−1)

for x>0 and a>0.

6. Maxwell distribution [19,20]: for this distribution,

fX(x)=4a32πx2exp−ax2,
FX(x)=2πγ32,ax2,
GM(X)=1−loga2,
S(X)=−Γ32loga+Γ′32π,
R(X)=−log2a+log21−γ−γlogπ2(1−γ)−γ+12logγ1−γ+11−γlogΓγ+12

and

CE(X)=−2π∫0∞log2−logπ+logΓ32,ax2Γ32,ax2dx

for x>0 and a>0.

7. Inverse Maxwell distribution: for this distribution,

fX(x)=4a32πx−4exp−ax−2,
FX(x)=2πΓ32,ax−2,
GM(X)=Γ32loga−Γ′32π,
S(X)=−log4π+12loga−4πΓ′32,
R(X)=11−γlog2a52π+γ1−γlog4aπ+11−γlogΓ2γ−12

and

CE(X)=−2aπlog2π−2π∫0∞γ32,ax−2logγ32,ax−2dx

for x>0 and a>0.

8. Power Maxwell distribution [21]: for this distribution,

fX(x)=4ab32πx3a−1exp−bx2a,
FX(x)=2πγ32,bx2a,
GM(X)=−Γ32logb+Γ′32aπ,
S(X)=32−logb2a+1−3aaπΓ′32−log4aπ,
R(X)=−log2ab12a+log21−γ−γlogπ2(1−γ)−3γ2+1−γ2alogγ1−γ+11−γlogΓ3γ2+1−γ2a

and

CE(X)=−2πb12alog2πΓ12a+32−2π∫0∞γ32,bx2alogΓ32,bx2adx

for x>0, a>0 and b>0.

9. Inverse power Maxwell distribution [22]: for this distribution,

fX(x)=4ab32πx−3a−1exp−bx−2a,
FX(x)=2πΓ32,bx−2a,
GM(X)=Γ32logb−Γ′32aπ,
S(X)=−log4aπ+12alogb−3a+1aπΓ′32,
R(X)=11−γlog2b52π+γ1−γlog4abπ+11−γlogΓ3γ2+γ−12a

and

CE(X)=−2πb12alog2πΓ32−12a−2π∫0∞γ32,bx−2alogγ32,bx−2adx

for x>0, a>0 and b>0.

10. Omega distribution [23]: for this distribution,

fX(x)=abxb−11−x2b1+xb1−xb−a2,
FX(x)=1−1+xb1−xb−a2,
GM(X)=a∂∂αBαb+1,a22F1αb+1,a2+1;αb+1+a2;−1α=0,
S(X)=−log(ab)+a(1−b)∂∂αBαb+1,a22F1αb+1,a2+1;αb+1+a2;−1α=0+(a+2)∂∂α2F11,a2+1−α;α2+1;−1α=0−a(a−2)∂∂α1a+2α2F11,a2+1;α+1+a2;−1α=0,
R(X)=11−γlogaγ−1bγBγ+1−γb,1−γ+aγ22F1γ+1−γb,γa2+γ;aγ2+1−γb+1;−1

and

CE(X)=a2b∂∂αBb,a2+12F1b,a2−α;b+a2+1;−1α=0−a2b∂∂αBb,α+a2+12F1b,a2;b+α+a2+1;−1α=0

for x>0, a>0 and b>0.

11. Colak et al.’s distribution [24]: for this distribution,

fX(x)=a(b+1)(1−x)a−1(1+bx)a+1,
FX(x)=1−x1+bxa,
GM(X)=a(b+1)∂∂αB(α+1,a)2F1α+1,a+1;α+1+a;−bα=0,
S(X)=−loga(b+1)+a(1−a)(b+1)∂∂α1α+a2F11,a+1;α+a+1;−bα=0+(a+1)(b+1)∂∂α2F1a,a+1−α;a+1;−bα=0,
R(X)=11−γloga(b+1)γγa−γ+12F11,γa+γ;γa−γ+2;−b

and

CE(X)=aa+1∂∂α2F11,a−α;a+2;−bα=0−∂∂αaa+α+12F11,a;a+α+2;−bα=0

for x>0, a>0 and b>0.

12. Bimodal beta distribution [25]: for this distribution,

fX(x)=ρ+(1−δx)2CB(α,β)xα−1(1−x)β−1,
FX(x)=1C(1+ρ)Ix(α,β)−2δBx(α+1,β)Bx(α,β)+δ2Bx(α+2,β)Bx(α,β),
GM(X)=Γ(α+β)CΓ(α)∑i=02ciΓ′(α+i)Γ(α+β+i)−Γ(α+i)Γ′(α+β+i)Γ(α+β+i)2,
S(X)=logCB(α,β)+(1−α)Γ(α+β)CΓ(α)∑i=02ciΓ′(α+i)Γ(α+β+i)−Γ(α+i)Γ′(α+β+i)Γ(α+β+i)2+(1−β)Γ(α+β)CΓ(α)∑i=02ciΓ(α+i)Γ′(β)Γ(α+β+i)−Γ(α+i)Γ(β)Γ′(α+β+i)Γ(α+β+i)2−∂∂a1+ρa+1CF1α,−a−1,−a−1;α+β;δ1+iρ,δ1−iρa=0,
R(X)=Bαγ−γ+1,βγ−γ+1(1+ρ)γCγB(α,β)γF1αγ−γ+1,−γ,−γ,αγ+βγ−2γ+2;δ1+iρ,δ1−iρ

and

CE(X)=−∫011−1C(1+ρ)Ix(α,β)−2δBx(α+1,β)Bx(α,β)+δ2Bx(α+2,β)Bx(α,β)·log1−1C(1+ρ)Ix(α,β)−2δBx(α+1,β)Bx(α,β)+δ2Bx(α+2,β)Bx(α,β)dx

for 0<x<1, α>0, β>0, ρ≥0 and −∞<δ<∞, where i=−1, c0=1+ρ, c1=−2δ, c2=δ2 and C=1+ρ−2δαα+β+δ2α(α+1)(α+β)(α+β+1).

13. Confluent hypergeometric beta distribution [26]: for this distribution,

fX(x)=xa−1(1−x)b−1exp(−cx)B(a,b)1F1a;a+b;−c,
FX(x)=xaΦ1a,1−b,a+1;x,cxaB(a,b)1F1(a;a+b;−c),
GM(X)=Γ(a+b)Γ(a)1F1a;a+b;−c∂∂αΓ(a+α)Γ(a+b+α)1F1a+α;a+b+α;−cα=0,
S(X)=(1−a)Γ(a+b)Γ(a)1F1a;a+b;−c∂∂αΓ(a+α)Γ(a+b+α)1F1a+α;a+b+α;−cα=0+(1−b)Γ(a+b)Γ(b)1F1a;a+b;−c∂∂αΓ(b+α)Γ(a+b+α)1F1a;a+b+α;−cα=0+caa+b1F1a+1;a+b+1;−c1F1a;a+b;−c+logB(a,b)+log1F1a;a+b;−c,
R(X)=11−γlogBaγ−γ+1,bγ−γ+11F1aγ−γ+1;aγ+bγ−2γ+2;−cγBa,bγ1F1a;a+b;−cγ

and

CE(X)=−∫011−xaΦ1a,1−b,a+1;x,cxaB(a,b)1F1(a;a+b;−c)log1−xaΦ1a,1−b,a+1;x,cxaB(a,b)1F1(a;a+b;−c)dx

for 0<x<1, a>0, b>0 and c>0.

14. Libby and Novick’s beta distribution [27]: for this distribution,

fX(x)=caxa−1(1−x)b−1B(a,b)1−(1−c)xa+b,
FX(x)=I1−x1+cx−x(b,a),
GM(X)=caB(a,b)∂∂αB(α+a,b)2F1α+a,a+b;α+a+b;1−cα=0,
S(X)=−alogc+(1−a)caB(a,b)∂∂αB(α+a,b)2F1α+a,a+b;α+a+b;1−cα=0+(1−b)caB(a,b)∂∂αB(a,b+α)2F1a,a+b;α+a+b;1−cα=0+ca(a+b)∂∂α2F1a,a+b−α;a+b;1−cα=0,
R(X)=11−γlogcaγBaγ−γ+1,bγ−γ+1B(a,b)γ2F1aγ−γ+1,a+b;aγ+bγ−2γ+2;1−c

and

CE(X)=−∫01Icx1+cx−x(a,b)logIcx1+cx−x(a,b)dx

for 0<x<1, a>0, b>0, and c>0.

15. Generalized beta distribution [28]: for this distribution,

fX(x)=∣a∣xap−11−(1−c)xbaq−1bapB(p,q)1+cxbap+q,
FX(x)=xappB(p,q)bapF1p,1−q,p+q,p+1;(1−c)xba,−cxba,
GM(X)=∂∂αbαBp+αa,qB(p,q)2F1p+αa,αa;p+q+αa;cα=0,
S(X)=−log∣a∣+aplogb+logB(p,q)+(1−ap)∂∂αbαBp+αa,qB(p,q)2F1p+αa,αa;p+q+αa;cα=0−(1−q)∂∂αBp,q+αB(p,q)2F1p,α;p+q+α;cα=0+(p+q)∂∂α2F1p,α;p+q;cα=0,
R(X)=11−γlog{b1−γBpγ+1−γa,qγ−γ+1B(p,q)γ·2F1pγ+1−γa,(a+1)(1−γ)a;pγ+qγ+(1−γ)1a+1;c}

and

CE(X)=−∫011−xappB(p,q)bapF1p,1−q,p+q,p+1;(1−c)xba,−cxba·log1−xappB(p,q)bapF1p,1−q,p+q,p+1;(1−c)xba,−cxbadx

for 0<xa<ba1−c, b>0, 0<c<1, p>0 and q>0.

16. Log-logistic distribution: for this distribution,

fX(x)=babxb−1ab+xb2,
FX(x)=xbab+xb,
GM(X)=loga,
S(X)=loga−logb+2,
R(X)=loga−logb+2bγloga1−γ+11−γlogBγ+γ−1b,γ+1−γb

and

CE(X)=−abΓ1bΓ′1−1b−Γ′(1)Γ1−1b

for x>0, a>0 and b>0.

17. Inverse Gaussian distribution [29]: for this distribution,

fX(x)=a2πx3exp−a(x−b)22b2x,
FX(x)=Φaxxb−1−Φ−axxb+1exp2ab,
GM(X)=2alogbπbexpabK−12expab+2aπbexpab∂∂αKα−12expabα=0,
S(X)=12−12loga2π+3alogb2πbexpabK−12expab+3a2πbexpab∂∂αKα−12expabα=0,
R(X)=γ2(1−γ)loga2πb3+11−γlog2bγ+a(1−γ)b+11−γK1−3γ2ab

and

CE(X)=−∫0∞Φax1−xb−Φ−axxb+1exp2ab·logΦax1−xb−Φ−axxb+1exp2abdx

for x>0, a>0 and b>0.

18. Gompertz distribution [30]: for this distribution,

fX(x)=abexpa+bx−aexp(bx),
FX(x)=1−expa−aexp(bx),
GM(X)=−logb+aexp(a)∫1∞loglogyexp(−ay)dy,
S(X)=−a−log(ab)−Ei(−a)exp(a)+a2exp(a)∫1∞texp(at)dt,
R(X)=−logb−γlogγ1−γ+aγ1−γ+logΓ(γ,aγ)1−γ

and

CE(X)=1−aexp(a)Ei(−a)b

for x>0, a>0 and b>0.

19. Exponential distribution: for this distribution,

fX(x)=aexp(−ax),
FX(x)=1−exp(−ax),
GM(X)=Γ′(1)−loga,
S(X)=1−loga,
R(X)=−loga−logγ1−γ

and

CE(X)=1a

for x>0 and a>0.

20. Inverse exponential distribution: for this distribution,

fX(x)=bx−2exp−bx,
FX(x)=exp−bx,
GM(X)=logb−Γ′(1),
S(X)=logb−2Γ′(1)+1,
R(X)=logb+1−2γ1−γlogγ+logΓ(2γ−1)1−γ

and

CE(X)=−∫0∞1−exp−bxlog1−exp−bxdx

for x>0 and b>0.

21. Exponentiated exponential distribution [31]: for this distribution,

fX(x)=abexp(−bx)1−exp(−bx)a−1,
FX(x)=1−exp(−bx)a,
GM(X)=a∫01(1−y)a−1log(−logy)dy−logb,
S(X)=−log(ab)−Γ′(1)+Γ′(a+1)Γ(a+1)+a−1a,
R(X)=logb+γloga1−γ+11−γlogBγ,aγ−γ+1

and

CE(X)=1b∑k=1∞1kB(0,ak+1)−1b∑k=1∞1kB(0,ak+a+1)

for x>0 and a>0.

22. Gamma distribution: for this distribution,

fX(x)=baxa−1exp−bxΓ(a),
FX(x)=γa,bxΓ(a),
GM(X)=Γ′a−Γ(a)logbΓa2,
S(X)=a−alogb+logΓ(a)+(1−a)Γ′(a)Γ(a)2−logbΓ(a),
R(X)=logb+γ−aγ−11−γlogγ+11−γlogΓ(aγ−γ+1)−γ1−γlogΓ(a)

and

CE(X)=−∫0∞Γa,bxΓ(a)logΓa,bxΓ(a)dx

for x>0, a>0 and b>0.

23. Chisquare distribution: for this distribution,

fX(x)=xk2−1exp−x22k2Γk2,
FX(x)=γk2,x2Γk2,
GM(X)=Γ′k2+Γk2log2Γk22,
S(X)=k2+k2log2+logΓk2+k2Γ′k2Γk22+log2Γk2,
R(X)=−log2+γ−k2γ−11−γlogγ+11−γlogΓk2γ−γ+1−γ1−γlogΓk2

and

CE(X)=−∫0∞Γk2,x2Γk2logΓk2,x2Γk2dx

for x>0 and k>0.

24. Chi distribution: for this distribution,

fX(x)=xk−1exp−x222k2−1Γk2,
FX(x)=γk2,x22Γk2,
GM(X)=Γk2log2+Γ′k22Γk2,
S(X)=−12log2+k2−1−k2Γ′k2Γk2+logΓk2,
R(X)=11−γlog2γ−12γγ−γk−12Γk2γΓγk−γ+12

and

CE(X)=−∫0∞Γk2,x22Γk2logΓk2,x22Γk2dx

for x>0 and k>0.

25. Inverse gamma distribution: for this distribution,

fX(x)=bax−a−1exp−bxΓ(a),
FX(x)=Γa,bxΓ(a),
GM(X)=Γalogb−Γ′(a)Γa,
S(X)=−alogb+(a+1)logb−Γ′(1)Γ(a)+a+logΓ(a),
R(X)=logb+1−γ−aγ1−γlogγ−γ1−γlogΓ(a)+logΓ(aγ+γ−1)1−γ

and

CE(X)=−∫0∞γa,bxΓ(a)logγa,bxΓ(a)dx

for x>0, a>0 and b>0.

26. Inverse chisquare distribution: for this distribution,

fX(x)=x−k2−1exp−12x2k2Γk2,
FX(x)=Γk2,12xΓk2,
GM(X)=−Γk2log2−Γ′k2Γk2,
S(X)=k2log2−k2+1log2+Γ′(1)Γk2+k2+logΓk2,
R(X)=−log2+1−γ−kγ21−γlogγ−γ1−γlogΓk2+logΓk2γ+γ−11−γ

and

CE(X)=−∫0∞γk2,12xΓk2logγk2,12xΓk2dx

for x>0 and k>0.

27. Inverse chi distribution: for this distribution,

fX(x)=x−k−1exp−12x22k2−1Γk2,
FX(x)=Γk2,12x2Γk2,
GM(X)=−Γk2log2+Γ′k22Γk2,
S(X)=−32log2−k2−1+k2Γ′k2Γk2+logΓk2,
R(X)=11−γlog23(γ−1)2γ1−γ−γk2Γk2γΓγ+γk−12

and

CE(X)=−∫0∞γk2,12x2Γk2logγk2,12x2Γk2dx

for x>0 and k>0.

28. Rayleigh distribution: for this distribution,

fX(x)=2b2xexp−(bx)2,
FX(x)=1−exp−(bx)2,
GM(X)=12Γ′1−logb,
S(X)=1−log(2b)−12Γ′(1),
R(X)=−log(2b)−logγ2−γlogγ1−γ+11−γlog1+γ2

and

CE(X)=π4b

for x>0 and b>0.

29. Weibull distribution [32]: for this distribution,

fX(x)=abaxa−1exp−(bx)a,
FX(x)=1−exp−(bx)a,
GM(X)=1aΓ′1−logb,
S(X)=1−log(ab)+1−aaΓ′(1),
R(X)=−log(ab)−logγa−γlogγ1−γ+11−γlog1−γa+γ

and

CE(X)=1abΓ1+1a

for x>0, a>0 and b>0.

30. Inverse Rayleigh distribution: for this distribution,

fX(x)=2ax−3exp−ax−2,
FX(x)=exp−ax−2,
GM(X)=loga−Γ′(1)2,
S(X)=1+loga2−log2−Γ′(1)b,
R(X)=12loga−log2+3γ−12logγ1−γ+11−γlogΓ3γ−12

and

CE(X)=a2Γ−12∑k=1∞k−12−a2Γ−12∑k=1∞k+1k

for x>0 and a>0.

31. Inverse Weibull distribution: for this distribution,

fX(x)=abx−b−1exp−ax−b,
FX(x)=exp−ax−b,
GM(X)=loga−Γ′(1)b,
S(X)=1+logab−logb−Γ′(1)b,
R(X)=1bloga−logb+γ+γ−1blogγ1−γ+11−γlogΓγ+γ−1b

and

CE(X)=a1bbΓ−1b∑k=1∞k1b−1−a1bbΓ−1b∑k=1∞(k+1)1bk

for x>0, a>0 and b>0.

32. Gumbel distribution [33]: for this distribution,

fX(x)=1aexp−x−baexp−exp−x−ba,
FX(x)=exp−exp−x−ba,
GM(X)=1a∫−∞∞logxexp−x−baexp−exp−x−badx,
S(X)=1+loga−Γ′(1),
R(X)=11−γlogΓ(γ)aγ−1γγ

and

CE(X)=∫−∞∞1−exp−exp−x−balog1−exp−exp−x−badx

for −∞<x<∞, a>0 and −∞<b<∞.

33. Generalized extreme value distribution [34]: for this distribution,

fX(x)=1a1+ξx−ba−ξ+1ξexp−1+ξx−ba−1ξ,
FX(x)=exp−1+ξx−ba−1ξ,
GM(X)=1a∫−∞∞logx1+ξx−ba−ξ+1ξexp−1+ξx−ba−1ξdx,
S(X)=1+loga−(ξ+1)Γ′(1),
R(X)=11−γlogΓγξ−ξ+γaγ−1γγξ−ξ+γ

and

CE(X)=aΓ−ξ∑k=1∞kξ−aΓ−ξ∑k=1∞(k+1)ξ+1k

for b−aξ<x<∞ if ξ>0, −∞<x<b−aξ if ξ<0, −∞<b<∞ and a>0.

34. Generalized gamma distribution [35]: for this distribution,

fX(x)=padxd−1exp−(ax)pΓdp,
FX(x)=γdp,(ax)pΓdp,
GM(X)=1pΓ′dp−ΓdplogaΓdp3,
S(X)=−logp−dloga+Γ1+dp+logΓdp+1−dpΓ′dpΓdp3−(1−d)logaΓdp2,
R(X)=−logp1−γ−loga−dγ−γ+1plogγ1−γ−γ1−γlogΓdp+11−γlogΓdγ−γ+1p

and

CE(X)=−∫0∞Γdp,(ax)pΓdplogΓdp,(ax)pΓdpdx

for x>0, a>0, d>0 and p>0.

35. Pareto distribution of type I [36]: for this distribution,

fX(x)=aKaxa+1,
FX(x)=1−Kxa,
GM(X)=logK+1a,
S(X)=1−a+1a+logK,
R(X)=logK+γloga1−γ−logaγ+γ−11−γ

and

CE(X)=−Kaa−12

for x≥K, K>0 and a>0.

36. Pareto distribution of type II [37]: for this distribution,

fX(x)=aba(x+b)a+1,
FX(x)=1−ba(x+b)a,
GM(X)=logb+Γ′(1)−Γ′(a)Γ(a),
S(X)=−loga−alogb+(a+1)(alogb+1),
R(X)=logb+γloga1−γ−log(aγ+γ−1)1−γ

and

CE(X)=aba−12

for x>0, a>0 and b>0.

37. Generalized Pareto distribution [38]: for this distribution,

fX(x)=1+ξx−ξ+1ξ,
FX(x)=1−1+ξx−1ξ,
GM(X)=−logξ+Γ′(1)−Γ′1ξξΓ1+1ξ,if ξ>0,−log(−ξ)+Γ′(1)−Γ′1−1ξξΓ1−1ξ,if ξ<0,
S(X)=ξ+1,
R(X)=1γ(ξ+1)−ξ

and

CE(X)=1ξ−12

for 0<x<∞ if ξ>0 and 0<x<−1ξ if ξ<0.

38. Uniform distribution: for this distribution,

fX(x)=1b−a,
FX(x)=x−ab−a,
GM(X)=blogb−aloga−b+ab−a,
S(X)=log(b−a),
R(X)=log(b−a)

and

CE(X)=−b−a4

for a<x<b and ∞>b>a>−∞.

39. Power function distribution of type I: for this distribution,

fX(x)=axa−1,
FX(x)=xa,
GM(X)=−1a,
S(X)=1−1a−loga,
R(X)=γloga1−γ−logaγ−γ+11−γ

and

CE(X)=ψ1a+2−ψ(2)

for 0<x<1 and a>0.

40. Power function distribution of type II: for this distribution,

fX(x)=a(1−x)a−1,
FX(x)=1−(1−x)a,
GM(X)=−1a,
S(X)=1−1a−loga,
R(X)=γloga1−γ−logaγ−γ+11−γ

and

CE(X)=a(a+1)2

for 0<x<1 and a>0.

41. Arcsine distribution: for this distribution,

fX(x)=1πx(1−x),
FX(x)=2πarcsinx,
GM(X)=Γ′12π−Γ′1,
S(X)=logπ+Γ′12π−Γ′(1),
R(X)=11−γlogBγ2−γ+1,γ2−γ+1πγ

and

CE(X)=−∫0∞1−2πarcsinxlog1−2πarcsinxdx

for 0<x<1.

42. Beta distribution: for this distribution,

fX(x)=xa−1(1−x)b−1B(a,b),
FX(x)=Ix(a,b),
GM(X)=Γ′aΓa−Γ′a+bΓa+b,
S(X)=logB(a,b)+(1−a)Γ′(a)Γ(a)+(1−b)Γ′(b)Γ(b)−(2−a−b)Γ′(a+b)Γ(a+b),
R(X)=11−γlogBaγ−γ+1,bγ−γ+1B(a,b)γ

and

CE(X)=−∫0∞I1−x(b,a)logI1−x(b,a)dx

for 0<x<1, a>0 and b>0.

43. Inverted beta distribution: for this distribution,

fX(x)=xa−1(1+x)−a−bB(a,b),
FX(x)=Ix1+x(a,b),
GM(X)=Γ′aΓa−Γ′a+bΓa+b,
S(X)=logB(a,b)+(1−a)Γ′(a)Γ(a)+(a+b)Γ′(a+b)Γ(a+b)−(1+b)Γ′(b)Γ(b),
R(X)=11−γlogBaγ−γ+1,bγ+γ−1B(a,b)γ

and

CE(X)=−∫0∞I11+x(b,a)logI11+x(b,a)dx

for 0<x<1, a>0 and b>0.

44. Kumaraswamy distribution [39]: for this distribution,

fX(x)=abxa−11−xab−1,
FX(x)=1−1−xab,
GM(X)=bΓ′(1)−bΓ′1+1aΓ1+1a,
S(X)=1−1b−log(ab)+(1−a)bΓ′(1)−(1−a)bΓ′1a+1Γ1a+1,
R(X)=−log(ab)+γlogb1−γ+11−γlogBγ+1−γa,bγ+1−γ

and

CE(X)=baB1a,b+1ψ(b+1)−ψ1a+b+1

for 0<x<1, a>0 and b>0.

45. Inverted Kumaraswamy distribution [40]: for this distribution,

fX(x)=ab(1+x)−a−11−(1+x)−ab−1,
FX(x)=1−(1+x)−ab,
GM(X)=b∫01logy−1a−1(1+y)b−1dy,
S(X)=−log(ab)+1+1aΓ′(b+1)Γ(b+1)−Γ′1+1−1b,
R(X)=−loga+γlogb1−γ+11−γlogBγ+γ−1a,bγ−γ+1

and

CE(X)=1a∑k=1∞1kB−1a,kb+1−1a∑k=1∞1kB−1a,kb+b+1

for x>0, a>0 and b>0.

46. Normal distribution: for this distribution,

fX(x)=12πaexp−(x−b)22a2,
FX(x)=Φx−ba,
GM(X)=12πa∫−∞∞logxexp−(x−b)22a2dx,
S(X)=log2πa+12,
R(X)=log2πa−logγ2(1−γ)

and

CE(X)=−2a4∫−∞∞erfc(x)logerfc(x)dx

for −∞<x<∞, a>0 and −∞<b<∞.

47. Lognormal distribution: for this distribution,

fX(x)=12πaxexp−(logx−b)22a2,
FX(x)=Φlogx−ba,
GM(X)=b,
S(X)=log2πa+b+12,
R(X)=2πaexp(b)+(1−γ)a22γ−logγ2(1−γ)

and

CE(X)=−∫0∞Φb−logxalogΦb−logxadx

for x>0, a>0 and −∞<b<∞.

48. Half normal distribution: for this distribution,

fX(x)=2πaexp−x22a2,
FX(x)=erfx2a,
GM(X)=log22+loga+1πΓ′12,
S(X)=12−12log2π+loga,
R(X)=a2π−12logγ1−γ

and

CE(X)=−2a∫−∞∞erf(x)logerf(x)dx

for x>0 and a>0.

49. Student’s t distribution [41]: for this distribution,

fX(x)=Γa+12aπΓa21+x2a−a+12,
FX(x)=12−xΓa+12aπΓa22F112,a+12;32;−x2a,
GM(X)=Γa+12aπΓa2∫−∞∞logx1+x2a−a+12dx,
S(X)=logaπΓa2Γa+12+a(a+1)2Γ′a+12Γa+12−Γ′a2Γa2,
R(X)=11−γlog2Γa+12aπΓa2γBaγ+γ−12,12

and

CE(X)=−∫−∞∞12+xΓa+12aπΓa22F112,a+12;32;−x2alog12+xΓa+12aπΓa22F112,a+12;32;−x2adx

for −∞<x<∞ and a>0.

50. Cauchy distribution: for this distribution,

fX(x)=1π1+x2,
FX(x)=12+1πarctan(x),
GM(X)=1π∫−∞∞logx1+x2dx,
S(X)=logπ+Γ′1−Γ′12π,
R(X)=11−γlog2πγBγ−12,12

and

CE(X)=−∫−∞∞12−1πarctan(x)log12−1πarctan(x)dx

for −∞<x<∞.

51. Laplace distribution [42]: for this distribution,

fX(x)=12aexp−∣x−b∣a,
FX(x)=12expx−ba,if x≤b,1−12exp−x−ba,if x≥b,
GM(X)=12a∫−∞∞logxexp−∣x−b∣adx,
S(X)=1+log(2a),
R(X)=log(2a)−logγ1−γ

and

CE(X)=a2+a2log2−a∂∂αB120,2+αα=0

for −∞<x<∞, a>0 and −∞<b<∞.

52. Logistic distribution of type I: for this distribution,

fX(x)=acexp(−cx)1+exp(−cx)a+1,
FX(x)=11+exp(−cx)a,
GM(X)=ac∫−∞∞logxexp(−cx)1+exp(−cx)a+1dx,
S(X)=−loga−logc+(a+1)ψ(a+1)−aψ(a)−Γ′(1),
R(X)=−logc+11−γlogaγBaγ,γ

and

CE(X)=−∫−∞∞1−11+exp(−cx)alog1−11+exp(−cx)adx

for −∞<x<∞, a>0 and c>0.

53. Logistic distribution of type II: for this distribution,

fX(x)=acexp(−acx)1+exp(−cx)a+1,
FX(x)=1−11+exp(cx)a,
GM(X)=ac∫−∞∞logxexp(−acx)1+exp(−cx)a+1dx,
S(X)=−loga−logc+(a+1)ψ(a+1)−Γ′(1)−aψ(a),
R(X)=−logc+11−γlogaγBγ,aγ

and

CE(X)=a∫−∞∞1+exp(−cx)−alog1+exp(−cx)dx

for −∞<x<∞, a>0 and c>0.

54. Logistic distribution of type III: for this distribution,

fX(x)=cexp(−acx)B(a,a)1+exp(−cx)2a,
FX(x)=I11+exp(−cx)(a,a),
GM(X)=cB(a,a)∫−∞∞logxexp(−acx)1+exp(−cx)2adx,
S(X)=logB(a,a)−logc+2aψ(2a)−2aψ(a),
R(X)=−logc+11−γlogBaγ,aγB(a,a)γ

and

CE(X)=−∫−∞∞Iexp(−cx)1+exp(−cx)(a,a)logIexp(−cx)1+exp(−cx)(a,a)dx

for −∞<x<∞, a>0 and c>0.

55. Logistic distribution of type IV [43]: for this distribution,

fX(x)=cexp(−bcx)B(a,b)1+exp(−cx)a+b,
FX(x)=I11+exp(−cx)(a,b),
GM(X)=cB(a,b)∫−∞∞logxexp(−bcx)1+exp(−cx)a+bdx,
S(X)=logB(a,b)−logc+(a+b)ψ(a+b)−aψ(a)−bψ(b),
R(X)=−logc+11−γlogBaγ,bγB(a,b)γ

and

CE(X)=−∫−∞∞Iexp(−cx)1+exp(−cx)(b,a)logIexp(−cx)1+exp(−cx)(b,a)dx

for −∞<x<∞, a>0, b>0 and c>0.

56. Burr distribution [44]: for this distribution,

fX(x)=ckxc−11+xc−k−1,
FX(x)=1−1+xc−k,
GM(X)=Γ′(1)Γ(k)−Γ′kcΓ(k),
S(X)=1+1k−log(ck)+1−ccΓ(k)Γ′(1)Γ(k)−Γ′(k),
R(X)=γlog(ck)1−γ+11−γlogBkγ+γ−1c,γ+1−γc

and

CE(X)=−kcB1c,k−1cψ1c−ψ(k)

for x>0, k>0 and c>0.

57. Dagum distribution [45]: for this distribution,

fX(x)=apxap−11+xa−p−1,
FX(x)=1+xa−p,
GM(X)=−Γ′(1)a+Γ′(p)aΓ(p),
S(X)=−log(ap)+(p+1)Γ′(1)−Γ′(p+1)Γ(p+1)+1a−p−Γ′(1)+Γ′(p)Γ(p),
R(X)=11−γlogaγ−1pγBγ−1a,pγ+1−γa

and

CE(X)=∑k=1∞1kBpk−1a,1a−∑k=1∞1kBpk+p−1a,1a

for x>0, a>0 and p>0.

58. J shaped distribution [46]: for this distribution,

fX(x)=2a(1−x)x(2−x)a−1,
FX(x)=x(2−x)a,
GM(X)=a2a∂∂α1a+α2F1a+α,1−a;a+α+1;12α=0,
S(X)=−log(2a)+a(1−a)2a∂∂α1a+α2F1a+α,1−a;a+α+1;12α=0−a2a∂∂αB(a,α+2)2F1a,1−a;a+α+2;12α=0+2a(1−a)1+a∂∂α2α2F1a,1−α−a;a+1;12α=0,
R(X)=11−γlogaγ2aγBaγ−γ+1,γ+12F1aγ−γ+1,γ−aγ;aγ+2;12

and

CE(X)=∑k=1∞2akk(ak+1)2F1ak+1,−ak;ak+2;12−∑k=1∞2a(k+1)k(ak+a+1)2F1ak+a+1,−ak−a;ak+a+2;12

for 0<x<1 and a>0.

59. Nadarajah–Haghighi distribution [47]: for this distribution,

fX(x)=ab(1+bx)a−1exp1−(1+bx)a,
FX(x)=1−exp1−(1+bx)a,
GM(X)=−elogb+e∫0∞logy1a−1exp(−y)dy,
S(X)=−log(ab)+(1−a)e∂∂αΓαa+1,1α=0+1,
R(X)=γ1−γ−log(ab)1−γ−γ+1−γalogγ1−γ+11−γlogΓγ+1−γa,γ

and

CE(X)=1b+eb1a−1Γ1a+1,1

for x>0, a>0 and b>0.

60. Two-sided power distribution [48]: for this distribution,

fX(x)=axθa−1,if 0<x≤θ,a1−x1−θa−1,if θ≤x<1,
FX(x)=θxθa,if 0<x≤θ,1−(1−θ)1−x1−θa,if θ≤x<1,
GM(X)=θlogθ−θa+a(1−θ)a−1∂∂αB1−θ(a,α+1)α=0,
S(X)=−loga−1−aa,
R(X)=11−γlogaγaγ−γ+1

and

CE(X)=∑k=1∞θk+1k(kθ+1)−∑k=1∞1k∑m=0kkm(−1)m(1−θ)m+1am+1−∑k=1∞θk+2k(kθ+k+1)+∑k=1∞1k∑m=0k+1k+1m(−1)m(1−θ)m+1am+1

for a>0.

61. Power Lindley distribution [49]: for this distribution,

fX(x)=ab2b+11+xaxa−1exp−bxa,
FX(x)=1−1+bxab+1exp−bxa,
GM(X)=bΓ′(1)+Γ′(2)a(b+1)−logba,
S(X)=−logabb+1−logba+b(1−a)a(b+1)Γ′(1)+1bΓ′(2)+b+2b+1−exp(b)b+1∂∂αΓ(α+2,b)α=0,
R(X)=−loga−γ1−γlog(b+1)+11−γlogΓγ+1−γaΨγ+1−γa,1−γa+1;bγ

and

CE(X)=1ab1aΓ1a+1+1b+1Γ1a+2−Γ1a(1+b)1aab1a∂∂αΨ1a,1a+α+2;b+1α=0

for x>0, a>0 and b>0.

62. Modified slash Lindley–Weibull distribution [50]: for this distribution,

fX(x)=2a3b2xa−1a+1(a+2)xa+2baaxa+2ba3,
FX(x)=a2xaa+1(a+1)xa+2baaxa+2ba2,
GM(X)=(a+2)log24(a+1)−(a+2)loga4(a+1)+(a+2)logb2(a+1)Γ′(2)−a+2a(a+1)Γ′(1)+b1−aa2−1alog2252(a+1)Γ1aΓ3−1a+b1−aa2−1alogb2a−12(a+1)Γ1aΓ3−1a−b1−aalog2232(a+1)Γ1aΓ3−1a+b1−aa1−1a232(a+1)Γ′1aΓ3−1a−b1−aa1−1a232(a+1)Γ1aΓ′3−1a,
S(X)=−log2a3baa+1+(1−a)(a+2)log24(a+1)−(1−a)(a+2)loga4(a+1)+(1−a)(a+2)logb2(a+1)Γ′(2)−(1−a)(a+2)a(a+1)Γ′(1)+(1−a)b1−aa2−1alog2252(a+1)Γ1aΓ3−1a+(1−a)b1−aa2−1alogb2a−12(a+1)Γ1aΓ3−1a−(1−a)b1−aalog2232(a+1)Γ1aΓ3−1a+(1−a)b1−aa1−1a232(a+1)Γ′1aΓ3−1a−(1−a)b1−aa1−1a232(a+1)Γ1aΓ′3−1a−2abaa+1∂∂αa+2aα+1∫0∞y+2abaa+2α+1y+2ba−3dyα=0+3aa+1a+2a1+log2b2−a−241+2log2b2,
R(X)=11−γlog2a2baa+1γaγ−1a−1∫0∞yγ+1−γaa+2ay+2baγy+2ba−3γdy

and

CE(X)=−log2baa+121aba1a+2a+1aΓ1aΓ1−1a−(a+1)1a2ba1aa1a+1(a+2)1a∂∂α2(a+1)baαB1a,1−α−1a2F11a,2;1−α;1a+2α=0−21a+1blog2a1a+1Γ1aΓ2−1a−21a+1blogba1aΓ1aΓ2−1a+21a+1ba1aΓ1aΓ′2−1a−21a+1ba1a+1Γ1aΓ2−1aΓ′(2)−21a+1b(a+2)log2a1a+1(a+1)Γ1+1aΓ1−1a−21a+1b(a+2)logba1a(a+1)Γ1+1aΓ1−1a+21a+1b(a+2)a1a+1(a+1)Γ1+1aΓ′1−1a−21a+1b(a+2)log2a1a+1(a+1)Γ1aΓ2−1aΓ′(2)

for x>0, a>0 and b>0.

63. Reciprocal distribution: for this distribution,

fX(x)=1xlogb−loga,
FX(x)=logx−logalogb−loga,
GM(X)=logb+loga2,
S(X)=−loglogb−loga+logb+loga2,
R(X)=11−γlogb1−γ−a1−γ1−γlogb−logaγ

and

CE(X)=(b−2a)loglogb−logalogb−loga−blogb−loga∂∂αγα+2,logb−logaα=0

for 0<a≤x≤b<∞.

4. Conclusions

We have derived the most comprehensive collection of explicit expressions for the geometric mean, Shannon entropy, Rényi entropy and the cumulative residual entropy for the following continuous univariate distributions: 1. Gauss hypergeometric beta distribution, 2. q Weibull distribution, 3. q exponential distribution, 4. Weighted exponential distribution, 5. Teissier distribution, 6. Maxwell distribution, 7. Inverse Maxwell distribution, 8. Power Maxwell distribution, 9. Inverse power Maxwell distribution, 10. Omega distribution, 11. Colak et al.’s distribution, 12. Bimodal beta distribution, 13. Confluent hypergeometric beta distribution, 14. Libby and Novick’s beta distribution, 15. Generalized beta distribution, 16. Log-logistic distribution, 17. Inverse Gaussian distribution, 18. Gompertz distribution, 19. Exponential distribution, 20. Inverse exponential distribution, 21. Exponentiated exponential distribution, 22. Gamma distribution, 23. Chisquare distribution, 24. Chi distribution, 25. Inverse gamma distribution, 26. Inverse chisquare distribution, 27. Inverse chi distribution, 28. Rayleigh distribution, 29. Weibull distribution, 30. Inverse Rayleigh distribution, 31. Inverse Weibull distribution, 32. Gumbel distribution, 33. Generalized extreme value distribution, 34. Generalized gamma distribution, 35. Pareto distribution of type I, 36. Pareto distribution of type II, 37. Generalized Pareto distribution, 38. Uniform distribution, 39. Power function distribution of type I, 40. Power function distribution of type II, 41. Arcsine distribution, 42. Beta distribution, 43. Inverted beta distribution, 44. Kumaraswamy distribution, 45. Inverted Kumaraswamy distribution, 46. Normal distribution, 47. Lognormal distribution, 48. Half normal distribution, 49. Student’s t distribution, 50. Cauchy distribution, 51. Laplace distribution, 52. Logistic distribution of type I, 53. Logistic distribution of type II, 54. Logistic distribution of type III, 55. Logistic distribution of type IV, 56. Burr distribution, 57. Dagum distribution, 58. J shaped distribution, 59. Nadarajah–Haghighi distribution, 60. Two-sided power distribution, 61. Power Lindley distribution, 62. Modified slash Lindley–Weibull distribution, 63. Reciprocal distribution. This collection could be a useful reference for both theoreticians and practitioners of entropies. Future work will be to derive similar collections of explicit expressions for entropies of discrete univariate distributions, continuous bivariate distributions, discrete bivariate distributions, continuous multivariate distributions, discrete multivariate distributions, continuous matrix variate distributions, discrete matrix variate distributions, continuous complex variate distributions, and discrete complex variate distributions.

Acknowledgments

The authors would like to thank the Editor and the two referees for careful reading and comments which improved the paper.

Author Contributions

Conceptualization, S.N. and M.K.; methodology, S.N. and M.K.; writing—original draft preparation, S.N.; writing—review and editing, S.N. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

Authors declare no conflicts of interest.

Funding Statement

This research received no external funding.

Footnotes

Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

References

  • 1.Feng C., Wang H., Tu X.M. Geometric mean of nonnegative random variable. Commun. Stat. Theory Methods. 2013;42:2714–2717. doi: 10.1080/03610926.2011.615637. [DOI] [Google Scholar]
  • 2.Vogel R.M. The geometric mean? Commun. Stat. Theory Methods. 2022;51:82–94. doi: 10.1080/03610926.2020.1743313. [DOI] [Google Scholar]
  • 3.Shannon C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948;27:379–423. doi: 10.1002/j.1538-7305.1948.tb01338.x. [DOI] [Google Scholar]
  • 4.Rényi A. On measures of information and entropy. In: Neyman J., editor. Proceedings of the 4th Berkeley Symposium on Mathematics, Statistics and Probability; Berkeley, CA, USA. 20 June–30 July 1960; Berkeley, CA, USA: University of California Press; 1960. pp. 547–561. [Google Scholar]
  • 5.Rao M., Chen Y., Vemuri B.C., Wang F. Cumulative residual entropy: A new measure of information. IEEE Trans. Inf. Theory. 2004;50:1220–1228. doi: 10.1109/TIT.2004.828057. [DOI] [Google Scholar]
  • 6.Lazo A.V., Rathie P. On the entropy of continuous probability distributions. IEEE Trans. Inf. Theory. 1978;24:120–122. doi: 10.1109/TIT.1978.1055832. [DOI] [Google Scholar]
  • 7.Ahmed N.A., Gokhale D.V. Entropy expressions and their estimators for multivariate distributions. IEEE Trans. Inf. Theory. 1989;35:688–692. doi: 10.1109/18.30996. [DOI] [Google Scholar]
  • 8.Darbellay G.A., Vajda I. Entropy expressions for multivariate continuous distributions. IEEE Trans. Inf. Theory. 2000;46:709–712. doi: 10.1109/18.825848. [DOI] [Google Scholar]
  • 9.Nadarajah S., Zografos K. Expressions for Rényi and Shannon entropies for bivariate distributions. Inf. Sci. 2005;170:173–189. doi: 10.1016/j.ins.2004.02.020. [DOI] [Google Scholar]
  • 10.Zografos K., Nadarajah S. Expressions for Rényi and Shannon entropies for multivariate distributions. Stat. Probab. Lett. 2005;71:71–84. doi: 10.1016/j.spl.2004.10.023. [DOI] [Google Scholar]
  • 11.Khan M.Z., Khan M.A. Explicit expressions for three entropies of Dagum distribution; Proceedings of the 13th International Conference on Statistical Sciences; Peshawar, Pakistan. 16–18 March 2015; pp. 193–196. [Google Scholar]
  • 12.Cheraghchi M. Expressions for the entropy of binomial-type distributions; Proceedings of the 2018 IEEE International Symposium on Information Theory; Vali, CO, USA. 17–22 June 2018; pp. 2520–2524. [Google Scholar]
  • 13.Giuclea M., Popescu C.-C. On geometric mean and cumulative residual entropy for two random variables with Lindley type distribution. Mathematics. 2022;10:1499. doi: 10.3390/math10091499. [DOI] [Google Scholar]
  • 14.Prudnikov A.P., Brychkov Y.A., Marichev O.I. Integrals and Series. Volume 1–3 Gordon and Breach Science Publishers; Amsterdam, The Netherlands: 1986. [Google Scholar]
  • 15.Gradshteyn I.S., Ryzhik I.M. Table of Integrals, Series, and Products. 6th ed. Academic Press; San Diego, CA, USA: 2000. [Google Scholar]
  • 16.Armero C., Bayarri M.J. Prior assessments for prediction in queues. Statistician. 1994;43:139–153. doi: 10.2307/2348939. [DOI] [Google Scholar]
  • 17.Picoli S., Jr., Mendes R.S., Malacarne L.C. q-exponential, Weibull, and q-Weibull distributions: An empirical analysis. Phys. Stat. Mech. Its Appl. 2003;324:678–688. doi: 10.1016/S0378-4371(03)00071-2. [DOI] [Google Scholar]
  • 18.Teissier G. Recherches sur le vieillissement et sur les lois de mortalite. Ann. Physiol. Phys. Chim. Biol. 1934;10:237–284. [Google Scholar]
  • 19.Maxwell J.C. Illustrations of the dynamical theory of gases. Part I. On the motions and collisions of perfectly elastic spheres. Lond. Edinb. Dublin Philos. Mag. J. Sci. 1860;19:19–32. doi: 10.1080/14786446008642818. [DOI] [Google Scholar]
  • 20.Maxwell J.C. Illustrations of the dynamical theory of gases. Part II. On the process of diffusion of two or more kinds of moving particles among one another. Lond. Edinb. Dublin Philos. Mag. J. Sci. 1860;20:21–37. doi: 10.1080/14786446008642902. [DOI] [Google Scholar]
  • 21.Yadav A.S., Bakouch H.S., Singh S.K., Singh U. Power Maxwell distribution: Statistical properties, estimation and application. arXiv. 2022 doi: 10.1080/02664763.2021.1899143.1807.01200 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Al-Kzzaz H.S., Abd El-Monsef M.M.E. Inverse power Maxwell distribution: Statistical properties, estimation and application. J. Appl. Stat. 2022;49:2287–2306. doi: 10.1080/02664763.2021.1899143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Dombi J., Jonas T., Toth Z.E., Arva G. The omega probability distribution and its applications in reliability theory. Qual. Reliab. Eng. Int. 2019;35:600–626. doi: 10.1002/qre.2425. [DOI] [Google Scholar]
  • 24.Colak A.B., Sindhu T.N., Lone S.A., Akhtar M.T., Shafiq A. A comparative analysis of maximum likelihood estimation and artificial neural network modeling to assess electrical component reliability. Qual. Reliab. Eng. Int. 2022 doi: 10.1002/qre.3233. accepted . [DOI] [Google Scholar]
  • 25.Vila R., Alfaia L., Meneze A.F.B., Cankaya M.N., Bourguignon M. A model for bimodal rates and proportions. J. Appl. Stat. 2022 doi: 10.1080/02664763.2022.2146661. accepted . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Gordy M.B. Computationally convenient distributional assumptions for common-value auctions. Comput. Econ. 1988;12:61–78. doi: 10.1023/A:1008645531911. [DOI] [Google Scholar]
  • 27.Libby D.L., Novick M.R. Multivariate generalized beta-distributions with applications to utility assessment. J. Educ. Stat. 1982;7:271–294. doi: 10.3102/10769986007004271. [DOI] [Google Scholar]
  • 28.McDonald J.B., Xu Y.J. A generalization of the beta distribution with applications. J. Econom. 1995;66:133–152. doi: 10.1016/0304-4076(94)01612-4. [DOI] [Google Scholar]
  • 29.Wald A. On cumulative sums of random variables. Ann. Math. Stat. 1944;15:283–296. doi: 10.1214/aoms/1177731235. [DOI] [Google Scholar]
  • 30.Gompertz B. On the nature of the function expressive of the law of human mortality, and on a new mode of determining the value of life contingencies. Philos. Trans. R. Soc. Lond. 1825;115:513–583. doi: 10.1098/rstb.2014.0379. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Gupta R.D., Kundu D. Exponentiated exponential family: An alternative to gamma and Weibull distributions. Biom. J. 2001;43:117–130. doi: 10.1002/1521-4036(200102)43:1<117::AID-BIMJ117>3.0.CO;2-R. [DOI] [Google Scholar]
  • 32.Weibull W. A statistical distribution function of wide applicability. J. Appl. Mech. 1951;18:293–297. doi: 10.1115/1.4010337. [DOI] [Google Scholar]
  • 33.Gumbel E.J. Les valeurs extremes des distributions statistiques. Ann. L’Institut Henri Poincare. 1935;5:115–158. [Google Scholar]
  • 34.Jenkinson A.F. The frequency distribution of the annual maximum (or minimum) values of meteorological elements. Q. J. R. Meteorol. Soc. 1955;81:158–171. doi: 10.1002/qj.49708134804. [DOI] [Google Scholar]
  • 35.Stacy E.W. A generalization of the gamma distribution. Ann. Math. Stat. 1962;33:1187–1192. doi: 10.1214/aoms/1177704481. [DOI] [Google Scholar]
  • 36.Pareto V. La legge della domanda. G. Degli Econ. 1895;10:59–68. [Google Scholar]
  • 37.Lomax K.S. Business failures; Another example of the analysis of failure data. J. Am. Stat. Assoc. 1954;49:847–852. doi: 10.1080/01621459.1954.10501239. [DOI] [Google Scholar]
  • 38.Pickands J. Statistical inference using extreme order statistics. Ann. Stat. 1975;3:119–131. [Google Scholar]
  • 39.Kumaraswamy P. A generalized probability density function for double bounded random processes. J. Hydrol. 1980;46:79–88. doi: 10.1016/0022-1694(80)90036-0. [DOI] [Google Scholar]
  • 40.Abd Al-Fattah A.M., El-Helbawy A.A., Al-Dayian G.R. Inverted Kumaraswamy distribution: Properties and estimation. Pak. J. Stat. 2017;33:37–61. [Google Scholar]
  • 41.Gosset W.S. The probable error of a mean. Biometrika. 1908;6:1–25. [Google Scholar]
  • 42.Laplace P.S. Memoire sur la probabilite des causes par les evenements. Mem. L’Academie R. Des Sci. Present. Par Divers. Savan. 1774;6:621–656. [Google Scholar]
  • 43.Prentice R.L. Discrimination among some parametric models. Biometrika. 1975;62:607–614. doi: 10.1093/biomet/62.3.607. [DOI] [Google Scholar]
  • 44.Burr I.W. Cumulative frequency functions. Ann. Math. Stat. 1942;13:215–232. doi: 10.1214/aoms/1177731607. [DOI] [Google Scholar]
  • 45.Dagum C. A model of income distribution and the conditions of existence of moments of finite order. Bull. Int. Stat. Inst. 1975;46:199–205. [Google Scholar]
  • 46.Topp C.W., Leone F.C. A family of J-shaped frequency functions. J. Am. Stat. Assoc. 1955;50:209–219. doi: 10.1080/01621459.1955.10501259. [DOI] [Google Scholar]
  • 47.Nadarajah S., Haghighi F. An extension of the exponential distribution. Statistics. 2011;45:543–558. doi: 10.1080/02331881003678678. [DOI] [Google Scholar]
  • 48.van Dorp J.R., Kotz S. The standard two-sided power distribution and its properties: With applications in financial engineering. Am. Stat. 2002;56:90–99. doi: 10.1198/000313002317572745. [DOI] [Google Scholar]
  • 49.Ghitany M.E., Al-Mutairi D.K., Balakrishnan N., Al-Enezi L.J. Power Lindley distribution and associated inference. Comput. Stat. Data Anal. 2013;64:20–33. doi: 10.1016/j.csda.2013.02.026. [DOI] [Google Scholar]
  • 50.Reyes J., Arrue J., Venegas O., Gomez H.W. The modified slash Lindley-Weibull distribution with applications to nutrition data. J. Appl. Stat. 2022;49:4206–4224. doi: 10.1080/02664763.2021.1975661. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable.


Articles from Entropy are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES