An entropic functional S is said additive if it satisfies, for any two probabilistically independent systems A and B, that . If not, it is said nonadditive. In the literature, since the pioneering works of Boltzmann (1872, 1877) [1,2], Gibbs (1902, 1948) [3,4], von Neumann (1927) [5], and Shannon (1948, 1949) [6,7], dozens and dozens of entropic functionals have been defined along the years. Only two of them are additive, namely the Boltzmann–Gibbs–von Neumann–Shannon one (hereafter referred to as , where BG stands for Boltzmann–Gibbs), and the Rényi one (1961, 1970) [8,9]. All others are generically nonadditive. Let us mention some of them, namely (Sharma–Mittal 1975) [10], (Tsallis 1988) [11], (Abe 1997) [12], (Borges–Roditi 1998) [13], (Landsberg–Vedral 1998) [14], (Curado 1999) [15], (Anteneodo–Plastino 1999) [16], (Kaniadakis 2001) [17], (Tsallis–Souza 2003) [18], (Schwammle–Tsallis 2007) [19], (Shafee 2007 [20], Tsallis 2009 [21], Ubriaco 2009 [22]), (Tempesta 2011) [23], (Hanel–Thurner 2011 [24]), (Tsallis–Cirto 2013 [25]), (Curado–Tempesta–Tsallis 2016) [26], (Tempesta 2016) [27], (Jensen–Pazuki–Pruessner–Tempesta 2018) [28], among various others. They have many connections and predecessors in areas such as cybernetics, information theory, engineering, communication theory, ecology, and information geometry. All of these entropies recover the celebrated entropy as a particular case, with the unique exception of .
As it is well known, the entropy and its associated statistical mechanics enable the correct calculation of a large variety of thermostatistical properties at or near thermal equilibrium of uncountable so-called simple systems. However, when it comes to wide classes of so-called complex systems the BG theory fails. Due to this fact, many attempts have emerged using either the Rényi entropy or some of the nonadditive ones, most frequently , for a variety of applications in natural, artificial, and social systems.
In the present Special Issue, several approaches have been advanced along those lines. Following the order of appearance, Rodriguez et al. [29] have focused on a classical d-dimensional many-body Hamiltonian with long-range interactions, which numerically appears to exhibit q-Gaussian distributions of velocities, q-exponential distribution of energies, and vanishing maximal Lyapunov exponent in the infinitely-sized limit. Curado et al. [30] focus on a close relationship between the entropy and systems exhibiting power-law frequency of events and behaving similarly to self-organised criticality, like earthquakes, avalanches, and forest fires. Viallon–Galinier et al. [31] experimentally study the rheology of dense granular systems, exhibiting q-Gaussian distributions of displacements with an anomaly in the evolution of the index q directly related to percolating shear bands. Hanel et al. [32] focus, in the context of statistical inference, on a maximum configuration predictor for driven systems with arbitrary driving, and also discuss the associated Legendre structure. Obregon et al. [33] focus on quantum superstatistics and the critical behaviour of generalised ideal Bose gases. Ibrahim et al. [34] perform an analytic study of complex fractional entropy and apply it to complex neural networks. Zhao et al. [35] discuss the hedging for the regime-switching price model based on nonextensive statistical mechanics. Cetin et al. [36] verify a generalised Pesin-like identity and scaling relations at the chaos threshold of the Rössler ordinary differential equations in all three of its continuous variables. In a second contribution by Zhao et al. [37] a non-Gaussian stochastic process based on nonextensive statistical mechanics is employed, which can satisfactorily describe characteristics of long-run dependence of asset prices, and, by using the martingale method, closed form solutions are obtained for geometric average Asian options. Finally, Jensen et al. [38] exhibit how the phase space geometry leads, via group theory, to quite general entropy functionals where the composability plays a relevant role.
The ensemble of these contributions illustrates the power of nonadditive entropies in the realm of complex systems and outlines various interesting perspectives for the future.
Acknowledgments
We express our thanks to the authors of the contributions of this special issue, and to the journal Entropy and MDPI for their support during this work.
Funding
One of us (C.T.) was partially supported by the Brazilian agencies Faperj and CNPq.
Conflicts of Interest
The authors declare no conflict of interest.
References
- 1.Boltzmann L. Weitere Studien uber das Warmegleichgewicht unter Gas molekulen (Further Studies on Thermal Equilibrium Between Gas Molecules) [(accessed on 27 May 2019)];1872 Available online: http://www.eoht.info/page/Further+Studies+on+the+Thermal+Equilibrium+of+Gas+Molecules.
- 2.Boltzmann L. On the Relation of a General Mechanical Theorem to the Second Law of Thermodynamics. In: Brush S., editor. Kinetic Theory: Irreversible Processes. Volume 2. Pergamon Press; Oxford, UK: 1966. pp. 188–193. (English translation of Uber die Beziehung eines allgemeine mechanischen Satzes zum zweiten Haupsatze derWarmetheorie) [Google Scholar]
- 3.Gibbs J.W. Elementary Principles in Statistical Mechanics—Developed with Especial Reference to the Rational Foundation of Thermodynamics (C. Scribner’s Sons, New York, NY, USA, 1902; Yale University Press: New Haven, CT, USA, 1948) OX Bow Press; Woodbridge, CT, USA: 1981. [Google Scholar]
- 4.Gibbs J.W. The Collected Works of J.Willard Gibbs (Vol. 1: Thermodynamics) Yale University Press; New Haven, CT, USA: 1948. [Google Scholar]
- 5.Von Neumann J. Thermodynamik Quantenmechanischer Gesamtheiten. Nachrichten von der Gesellschaft der Wissenschaften zu Gottingen. 1927;1927:273–291. [Google Scholar]
- 6.Shannon C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J. 1948;27:379–423, 623–656. doi: 10.1002/j.1538-7305.1948.tb01338.x. [DOI] [Google Scholar]
- 7.Shannon C.E., Weaver W. The Mathematical Theory of Communication. University of Illinois Press; Urbana, IL, USA: 1949. [Google Scholar]
- 8.Rényi A. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability. Volume 1. University of California Press; Berkeley, LA, USA: 1961. On measures of information and entropy; pp. 547–561. [Google Scholar]
- 9.Rényi A. Probability Theory. North-Holland Co.; Amsterdam, The Netherlands: 1970. [Google Scholar]
- 10.Sharma B.D., Mittal D.P. New non-additive measures of entropy for discrete probability distributions. J. Math. Sci. 1975;10:28. [Google Scholar]
- 11.Tsallis C. Possible generalization of Boltzmann-Gibbs statistics. J. Stat. Phys. 1988;52:479. doi: 10.1007/BF01016429. [DOI] [Google Scholar]
- 12.Abe S. A note on the q-deformation theoretic aspect of the generalized entropies in nonextensive physics. Phys. Lett. A. 1997;224:326. doi: 10.1016/S0375-9601(96)00832-8. [DOI] [Google Scholar]
- 13.Borges E.P., Roditi I. A family of non-extensive entropies. Phys. Lett. A. 1998;246:399. doi: 10.1016/S0375-9601(98)00572-6. [DOI] [Google Scholar]
- 14.Landsberg P.T., Vedral V. Distributions and channel capacities in generalized statistical mechanics. Phys. Lett. A. 1998;247:211. doi: 10.1016/S0375-9601(98)00500-3. [DOI] [Google Scholar]
- 15.Curado E.M.F. General aspects of the thermodynamical formalism. Braz. J. Phys. 1999;29:36. doi: 10.1590/S0103-97331999000100003. [DOI] [Google Scholar]
- 16.Anteneodo C., Plastino A.R. Maximum entropy approach to stretched exponential probability distributions. Phys. A. 1999;32:1089. doi: 10.1088/0305-4470/32/7/002. [DOI] [Google Scholar]
- 17.Kaniadakis G. Non linear kinetics underlying generalized statistics. Phys. A. 2001;296:405. doi: 10.1016/S0378-4371(01)00184-4. [DOI] [Google Scholar]
- 18.Tsallis C., Souza A.M.C. Constructing a statistical mechanics for Beck-Cohen superstatistics. Phys. Rev. E. 2003;67:026106. doi: 10.1103/PhysRevE.67.026106. [DOI] [PubMed] [Google Scholar]
- 19.Schwammle V., Tsallis C. Two-parameter generalization of the logarithm and exponential functions and Boltzmann-Gibbs-Shannon entropy. J. Math. Phys. 2007;48:113301. doi: 10.1063/1.2801996. [DOI] [Google Scholar]
- 20.Shafee F. Lambert function and a new non-extensive form of entropy. IMA J. Appl. Math. 2007;72:785. doi: 10.1093/imamat/hxm039. [DOI] [Google Scholar]
- 21.Tsallis C. Introduction to Nonextensive Statistical Mechanics—Approaching a Complex World. Springer; Berlin/Heidelberg, Germany: 2009. [Google Scholar]
- 22.Ubriaco M.R. Entropies based on fractional calculus. Phys. Lett. A. 2009;373:2516. doi: 10.1016/j.physleta.2009.05.026. [DOI] [Google Scholar]
- 23.Tempesta P. Group entropies, correlation laws, and zeta functions. Phys. Rev. E. 2011;84:021121. doi: 10.1103/PhysRevE.84.021121. [DOI] [PubMed] [Google Scholar]
- 24.Hanel R., Thurner S. A comprehensive classification of complex statistical systems and an axiomatic derivation of their entropy and distribution functions. Europhys. Lett. 2011;93:20006. doi: 10.1209/0295-5075/93/20006. [DOI] [Google Scholar]
- 25.Tsallis C., Cirto L.J.L. Black hole thermodynamical entropy. Eur. Phys. J. C. 2013;73:2487. doi: 10.1140/epjc/s10052-013-2487-6. [DOI] [Google Scholar]
- 26.Curado E.M.F., Tempesta P., Tsallis C. A new entropy based on a group-theoretical structure. Ann. Phys. 2016;366:22. doi: 10.1016/j.aop.2015.12.008. [DOI] [Google Scholar]
- 27.Tempesta P. Beyond the Shannon-Khinchin formulation: The composability axiom and the universal-group entropy. Ann. Phys. 2016;365:180. doi: 10.1016/j.aop.2015.08.013. [DOI] [Google Scholar]
- 28.Jensen H.J., Pazuki R.H., Pruessner G., Tempesta P. Statistical mechanics of exploding phase spaces: Ontic open systems. J. Phys. A Math. Theor. 2018;51:375002. doi: 10.1088/1751-8121/aad57b. [DOI] [Google Scholar]
- 29.Rodriguez A., Nobre F.D., Tsallis C. d-dimensional classical Heisenberg model with arbitrarily-ranged interactions: Lyapunov exponents and distributions of momenta and energies. Entropy. 2019;21:31. doi: 10.3390/e21010031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Curado E.M.F., Nobre F.D., Plastino A. Associating an entropy with power-law frequency of events. Entropy. 2018;20:940. doi: 10.3390/e20120940. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Viallon-Galinier L., Combe G., Richefeu V., Atman A.P.F. Emergence of shear bands in confined granular systems: Singularity of the q-statistics. Entropy. 2018;20:862. doi: 10.3390/e20110862. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Hanel R., Thurner S. Maximum configuration principle for driven systems with arbitrary driving. Entropy. 2018;20:838. doi: 10.3390/e20110838. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Obregon O., Lopez J.L., Ortega-Cruz M. On quantum superstatistics and the critical behavior of nonextensive ideal Bose gases. Entropy. 2018;20:773. doi: 10.3390/e20100773. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Ibrahim R.W., Darus M. Analytic study of complex fractional Tsallis’ entropy with applications in CNNs. Entropy. 2018;20:722. doi: 10.3390/e20100722. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Zhao P., Pan J., Zhou B., Wang J., Song Y. Hedging for the Regime-Switching Price Model Based on Non-Extensive Statistical Mechanics. Entropy. 2018;20:248. doi: 10.3390/e20040248. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Cetin K., Afsar O., Tirnakli U. Generalized Pesin-like identity and scaling relations at the chaos threshold of the Rössler system. Entropy. 2018;20:216. doi: 10.3390/e20040216. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Zhao P., Zhou B., Wang J. Non-Gaussian closed form solutions for geometric average asian options in the framework of non-extensive statistical mechanics. Entropy. 2018;20:71. doi: 10.3390/e20010071. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Jensen H.J., Tempesta P. Group entropies: From phase space geometry to entropy functionals via group theory. Entropy. 2018;20:804. doi: 10.3390/e20100804. [DOI] [PMC free article] [PubMed] [Google Scholar]