Skip to main content
Springer logoLink to Springer
. 2022 Jan 24;93(4):663–690. doi: 10.1007/s11238-021-09861-w

Representing preorders with injective monotones

Pedro Hack 1,, Daniel A Braun 1, Sebastian Gottwald 1
PMCID: PMC9550776  PMID: 36245967

Abstract

We introduce a new class of real-valued monotones in preordered spaces, injective monotones. We show that the class of preorders for which they exist lies in between the class of preorders with strict monotones and preorders with countable multi-utilities, improving upon the known classification of preordered spaces through real-valued monotones. We extend several well-known results for strict monotones (Richter–Peleg functions) to injective monotones, we provide a construction of injective monotones from countable multi-utilities, and relate injective monotones to classic results concerning Debreu denseness and order separability. Along the way, we connect our results to Shannon entropy and the uncertainty preorder, obtaining new insights into how they are related. In particular, we show how injective monotones can be used to generalize some appealing properties of Jaynes’ maximum entropy principle, which is considered a basis for statistical inference and serves as a justification for many regularization techniques that appear throughout machine learning and decision theory.

Keywords: Multi-utility representation, Richter–Peleg function, Majorization, Uncertainty preorder, Maximum entropy

Introduction

The set of all preordered spaces (X,) is structured according to how well their preorder can be represented by real-valued monotones, that is, functions u:XR such that xy implies f(x)f(y) x,yX (Evren & Ok, 2011; Ok, 2002). Two major classification methods can be distinguished depending on whether one considers a single monotone (Alcantud et al., 2016) or a whole family U of monotones encapsulating all the information in , called a multi-utility (Evren & Ok, 2011). More precisely, if U is a multi-utility for (X,) then x,yX we have xy if and only if u(x)u(y) uU. Without further constraints, monotones and multi-utilities are, however, not very useful from a classification perspective as they exist for any preordered space. They become more useful when adding constraints. For example, there are preordered spaces without strict monotones, that is, without monotones u such that, u(x)<u(y) whenever xy.1 Strict monotones, also known as Richter–Peleg functions, have been extensively studied (Alcantud et al., 2013, 2016; Peleg, 1970; Richter, 1966) and are related to other features of the preorder such as its maximal elements. In the case of multi-utilities, the cardinality is an important property for the classification of preordered spaces, with countable multi-utilities playing a central role (Bevilacqua et al., 2018c). Of particular importance are utility functions (Debreu, 1954, 1964), that is, multi-utilities consisting of a single function.2

Here, we introduce injective monotones, which are monotones u such that u(x)=u(y) implies both xy and yx. Preorders for which they exist form a category between preorders with strict monotones and preorders with countable multi-utilities, as we show in Propositions 1,  5 and  8. Hence, we improve on the existing classification of preorders by adding a new distinct class. More precisely, in Sect. 3, we define injective monotones and prove some simple properties. After discussing their relation to optimization in Sect. 4, we take a look at the role of multi-utilities in Sect. 5, in particular, we construct injective monotones from countable multi-utilities and show that the converse does not hold. Finally, in Sect. 6, we consider separability properties of preorders that are sufficient for the existence of strict and injective monotones, introducing a new notion of Debreu separability, that allows to extend previous results on strict monotones to corresponding analogues for injective monotones.

In the following section, we introduce our running example to which we come back several times throughout the development of the general theory. In particular, we discuss the relation between the uncertainty preorder from majorization theory (Arnold, 2018), which has Shannon entropy as a strict monotone, and the maximum entropy principle that appears in many different parts of science.

Example: the uncertainty preorder and Shannon entropy

The outcome of a random variable with a narrow probability distribution is easier to predict than the outcome of a random variable with a less concentrated distribution. For example, the result of throwing an unbalanced coin is easier to predict than the one of a balanced coin. In other words, a wider distribution contains more uncertainty than a narrower distribution. This idea is captured by a binary relation on the space PΩ of probability distributions on a set Ω: the uncertainty preorder U, defined for finite Ω by

pUqui(p)ui(q)i{1,..,|Ω|-1}, 1

where ui(p):=-n=1ipn and p denotes the decreasing rearrangement of p (same components as p but ordered decreasingly). Notice, U is known in mathematics, economics, and quantum physics as majorization (Arnold, 2018; Brandao et al., 2015; Hardy et al., 1952; Marshall et al., 1979), originally developed by Lorenz (1905) and Dalton (1920) among others, to measure wealth and income inequality. An intuitive way to think of pUq is that q is the result of finitely many transfers of pieces of probability from a more likely to a less likely option in p (Gottwald & Braun, 2019). In other words, q is more spread out or less biased, and thus, contains more uncertainty than p. For instance, a Dirac distribution is the smallest, and the uniform distribution is the largest, with respect to U, among all distributions on Ω.

There is, however, a downside to this intuitive notion of uncertainty: what if p and q do not have this relationship? For example, if p=(0.6,0.2,0.2,0,..,0) and q=(0.5,0.4,0.1,0,..,0), then p and q cannot be related by U. Instead, the most common way to measure uncertainty is to use an entropy functional, such as the Shannon entropy, H(p):=-Ep[logp], or one of various alternative entropy proposals, including Renyi entropy (Rényi et al., 1961), Tsallis entropy (Tsallis, 1988), and many more (Csiszár, 2008). Even though, in general, U cannot be fully represented by any of these so-called generalized entropies F, it is noteworthy that all of them are monotones with respect to U.3 While the converse is not true for any single F, there are collections F which constitute a multi-utility, e.g., in the case of finite Ω, F={n=1|Ω|f(pn)|fconcave} (Schur, 1923), or even F={ui}i=1|Ω|-1 by the definition of U (1).

The preference towards unbiased distributions, that is represented by any monotone of U, is of particular relevance in the maximum entropy principle, where (Shannon) entropy serves as a counter-acting force against the bias towards the maximal elements of a given “energy” function E. Going back to the principle of insufficient reason (Bernoulli, 1713), today the maximum entropy principle appears in virtually all branches of science. For example, it is often used as a general principle to explain the raison d’etre behind all kinds of “soft” versions of known machine learning methods, especially in reinforcement learning (Fox et al., 2016; Williams & Peng, 1991), but also in models of robust and resource-aware decision making (Maccheroni et al., 2006; Ortega & Braun, 2013; Still, 2009; Tishby & Polani, 2011). Basically, whenever there appears a trade-off between precision and uncertainty, there is a good chance that the maximum entropy principle is applied (Gottwald & Braun, 2020).

The underlying goal of the maximum entropy principle is to select a typical distribution among a set of candidate distributions satisfying a given constraint, usually of the form Ep=c, where Ep denotes the expectation of a random variable E with respect to the probability measure p. In Wallis’ derivation of the maximum entropy principle, typicality is measured by the number of possibilities of assigning n elements among N groups, under the limit of infinitely many elements (n) such that the statistical probabilities pi=niN of belonging to a specific group i remain finite (ni denotes the number of elements in group i) Jaynes (2003). However, we can also think of typicality as containing the least amount of bias, or in other words, the maximal amount of uncertainty. Thus, when considering the uncertainty preorder U as the most basic way to decide about the difference in uncertainty between two distributions, then the ultimate goal of the maximum entropy principle becomes to obtain the maximal elements of U, inside the given constraint set.

Even though, generally, we are not guaranteed to find all maximal elements of U when maximizing entropy, maximum entropy solutions are in fact maximal elements of U, as entropy is a strict monotone. Furthermore, since the maximum entropy principle maximizes a strictly concave functional H over a convex subset, it yields a unique maximal element of U. In contrast, injective monotones, which exist for U (see Proposition 5), preserve this uniqueness property up to equivalence (see Proposition 3), without asking for the additional structural requirements of concavity.

Injective monotones

A preorder on a set X is a reflexive (xx xX) and transitive (xy and yz implies xz x,y,zX) binary relation. A tuple (X,) is called a preordered space. An antisymmetric (xy and yx imply x=y x,yX) preorder is called a partial order. The relation xy, defined by xy and yx, forms an equivalence relation on X, that is, it fulfills the reflexive, transitive and symmetric (xy if and only if yx x,yX) properties. Notice, a preorder is a partial order on the quotient set X/={[x]|xX}, consisting of all equivalence classes [x]={yX|yx}. In case xy and ¬(xy) for some x,yX we say y is strictly preferred to x, denoted by xy. If ¬(xy) and ¬(yx), we say x and y are incomparable, denoted by xy. Whenever there are no incomparable elements, a preordered space is called total. By the Szpilrajn extension theorem (Szpilrajn, 1930), every partial order can be extended to a total order, that is, to a partial order that is total. Notice, the set PΩ of probability distributions on Ω equipped with the uncertainty preorder U forms a non-antisymmetric preordered space, because equivalent elements are only equal up to permutations (Arnold, 2018).

A real-valued function f:XR is called a monotone if xy implies f(x)f(y). If also the converse is true, then f is called a utility function. Furthermore, if f is a monotone and xy implies f(x)<f(y), then f is called a strict monotone (or a Richter–Peleg function Alcantud et al., 2016).

Definition 1

(Injective monotones) A monotone f:XR on a preordered space (X,) is called an injective monotone if f(x)=f(y) implies xy, that is, if f is injective considered as a function on the quotient set X/.

Clearly, an injective monotone is also a strict monotone, since xy and f(x)=f(y) contradicts injectivity. The converse is not true, for example, Shannon entropy is a strict monotone for the uncertainty preorder U (Appendix A.1) but not an injective monotone, nor a utility. In fact, preorders that have an injective monotone form a class in between preorders that have a strict monotone and preorders that have a utility function.

Proposition 1

  • (i)

    There are preorders with strict monotones but without injective monotones.

  • (ii)

    There are preorders with injective monotones and without utility functions.

Proof

(i)

Consider (P(R),), the power set P(R) of the reals equipped with the preorder defined by UV if and only if U=V, or U={0} and V={1}. Then v:P(R)R, given by v({1})=1 and v(U)=0 U{1}, is a strict monotone. However, there cannot be injective monotones, because here |P(R)/|=|P(R)| and by Cantor’s theorem the cardinality of R is strictly smaller than the cardinality of P(R).

(ii)

Consider (R,), where xy if and only if xy and x,y0 or x=y=0. The identity I:RR is an injective monotone. However, (R,) is non-total since 0x xR/{0} and, thus, has no utility function.

Since every preorder has a monotone (constant functions) and there are preorders without strict monotones (see Appendix A.2.1 for an example), we arrive at the picture shown in Fig. 1. Notice, the closer we are to the center, the better a monotone represents the underlying preorder. In particular, injective monotones contain more information about the preorder than strict monotones.

Fig. 1.

Fig. 1

Classification of preordered spaces according to the existence of various classes of monotones. The newly introduced class of preorders with injective monotones is strictly contained within the class of preorders with strict monotones, is strictly larger than the class of preorders with utility functions, and contains commonly used examples such as the uncertainty preorder and vector optimization. See Sect. 7 and Appendix A.2.1 for a short description of the other examples in the figure. Notice we have classified both trumping and general relativity according to current knowledge, they may have injective monotones (see Sect. 7)

Nevertheless, in well-behaved cases, it is possible to construct an injective monotone out of a strict monotone. A negative example is the strict monotone that appears in the proof of (i) in Proposition 1, which maps uncountably many incomparable elements to a single number (zero). If a strict monotone fails to be an injective monotone because of only countably many points, however, then it can easily be turned into an injective monotone by consecutive elimination.

Proposition 2

A preordered space (X,) has an injective monotone if and only if it has a strict monotone f whose non-injective set

If:={xX|yXs.t.f(x)=f(y)andxy}

is countable.

Proof

By definition, for an injective monotone f, we have If=. Conversely, consider a strict monotone f with a countable non-injective set. Given a numeration {xn}n0 of If, define f0:XR by

f0(x):=f(x)+1iff(x)f(x0)and¬(xx0)f(x)else.

Notice, by definition, x,yX, f(x)f(y) implies f0(x)f0(y), If0If, and f0 is injective up to equivalence at x0, in particular x0If0. Therefore, we can consecutively eliminate the elements in If by defining for all nN, fn(x):=fn-1(x)+2-n if fn-1(x)fn-1(xn) and ¬(xxn), and fn(x):=fn-1(x) otherwise, analogously to f0. It is then straightforward to see that the pointwise limit c(x):=limnfn(x) exists for all xX and that c is an injective monotone.

Notice, the technique in the proof of Proposition 2 does not work if If is uncountable. In particular, it cannot be used to construct an injective monotone from Shannon entropy f=H for the uncertainty preorder U, because if N:=|Ω|3 then for all c(0,logN) there are p,qPΩ with c=H(p)=H(q) but pq (see Appendix A.1). In other words, we can construct an injective map g:(0,logN)IH and thus IH has the same cardinality as R, in particular IH is not countable.

Relating monotones to optimization

An element xX is called a maximal element of if there exists no yX such that xy. For any BX, an element xB is called a maximal element of in B if there exists no yB such that xy.

Definition 2

(Representing maximal elements) We say, a function f:XR is effective for BX if argmaxBf, where argmaxBf:={xB|yBsuch thatf(x)<f(y)}. We say, a function f:XR represents maximal elements of , if for any BX

argmaxBfBM,

where BM denotes the set of maximal elements of in B. Similarly, we say, a function f injectively represents maximal elements of , if for any BX for which f is effective, there exists x0BM such that

argmaxBf=[x0]|B

where [x0]|B is the equivalence class of x0 restricted to B. Moreover, we say, (X,) has an (injective) optimization principle if there exists a function f:XR which (injectively) represents maximal elements of .

Even though Shannon entropy does not represent U as a utility, its property as a strict monotone guarantees that its maxima are in fact maximal elements of U, i.e., H represents maximal elements of the uncertainty preorder according to Definition 2. Indeed, any pargmaxBH is a maximal element of U for any BPΩ on which H is effective, as pq for some qB would lead to the contradiction H(q)>H(p). In fact, representing maximal elements is closely related to being a monotone for preorders in general.

Proposition 3

Given a preordered space (X,) and a monotone u:XR, then

  • (i)

    u is a strict monotone if and only if u represents maximal elements of .

  • (ii)

    u is an injective monotone if and only if u injectively represents maximal elements of .

Proof

(i)

If u is a strict monotone, then argmaxBuBM (by the same argument as for entropy). Conversely, consider x,yX with xy. For B:={x,y}, we have BM={y} and thus {y}=argmaxBu, i.e., u(x)<u(y).

(ii)

For any BX on which u is effective, if xy argmaxBu, we have u(x)=u(y) and, since u is an injective monotone, xy. Conversely, consider x,yX and B:={x,y}. If u(x)=u(y) then by hypothesis {x,y}=argmaxxB{u(x)}=[x0]|B for some x0B. In particular, xy.

Notice, for the “if” part in (ii), we do not have to assume that u is a monotone, that is, if the maxima of some real-valued function u form an equivalence class in the set of maximal elements, then it already follows that u is a monotone.

For any preordered space (X,), thus, the existence of a strict monotone implies the existence of an optimization principle and the existence of an injective monotone is equivalent to the existence of an injective optimization principle. One can contrast the global injective representation of maximal elements which characterizes injective monotones in Proposition 3 with local approaches, for some specific BX, present in the literature (Bevilacqua et al., 2018b; White, 1980).

Choosing a particular strict monotone u and optimizing it in a set B might, however, not yield all the maximal elements in BM. For example, take p,qPΩ with pq and H(p)<H(q), then B={p,q} has the two maximal elements p and q, but argmaxBH={p}. Notice, this is not only an issue for trivial examples like this, but also happens for the maximum entropy principle with linear constraint sets. In particular, if B={p|E=c}, for a given random variable E and some cR, crosses two incomparable elements that turn out to be maximal (see Fig. 2), then only part of the actual maximal elements of U can be found by maximizing entropy.

Fig. 2.

Fig. 2

Example for when the maximum entropy principle does not yield all maximal elements of U in some BPΩ. Here, we show the usual visualization of the 2-simplex, that is, the set of all probability distributions in PΩ for |Ω|=3. Let the energy function E be given by E(x1):=1, E(x2):=-1, and E(x3):=0, and let B be given by the constraint E=14, represented by the vertical line. The distribution p=(1/2,1/4,1/4) is a maximal element in B, because any other element of B is either smaller than p (belongs to an outer blue region) or incomparable (belongs to the white region). However, q=(9/20,4/20,7/20) is in B and H(p)<H(q). As a result, p is a maximal element of B which is not obtained via the maximum entropy principle

Similarly, while optimizing an injective monotone in a set B results in equivalent elements, in general, we only find a slice of the set of all maximal elements in B. In fact, for every maximal element x in BM, we can construct an injective monotone c such that xargmaxc (e.g., in the proof of Proposition 4 below, take cx if xAc and c otherwise). This means that the problem of selecting a maximal equivalence class can be replaced by the problem of selecting an injective monotone.

In the following section, we show that injective monotones exist for a large class of preorders, including the uncertainty preorder.

Relating monotones to multi-utilities

Although it is not possible to capture all information about a non-total preorder using a single real-valued function, a family of functions may be used instead. A family V of real-valued functions v:XR is called a multi-utility (representation) of if

xyv(x)v(y)vV.

Whenever a multi-utility consists of strict monotones, it is called a strict monotone (or Richter–Peleg Alcantud et al., 2016) multi-utility (representation) of . Analogously, if the multi-utility consists of injective monotones, we call it an injective monotone multi-utility (representation) of .

It is straightforward to see that every preordered space (X,) has the multi-utility (χi(x))xX, where χA denotes the characteristic function of a set A and i(x):={yX|xy} (Ok, 2002). Moreover, if there exists a strict monotone u, then a multi-utility U only consisting of strict monotones can easily be constructed from a given multi-utility V by U:={v+αu}vV,α>0 (Alcantud et al., 2013). Even though this construction does not work directly in the case of injective monotones, a simple modification does, where special care is given to incomparable elements.

Proposition 4

Let (X,) be a preordered space. There exists an injective monotone if and only if there exists an injective monotone multi-utility.

Proof

Consider w.l.o.g. an injective monotone c:X(0,1) and

Ac:={xX|yXs.t.xy,c(x)<c(y)}, 2

i.e., the part of X that has incomparable elements y with strictly larger values of c. For all xAc, let cx:=c+χi(x). Notice, by construction cx(y)=c(y)<1cx(x) for all yX with xy. Using c(X)(0,1) and the fact that c is an injective monotone, it is straightforward to see that C:={c}{cx}xAc is an injective monotone multi-utility.

Note that the injective monotone multi-utility in the proof of Proposition 4 can be chosen to have cardinality of at most c, the cardinality of the continuum, because it is enough to have one cx per equivalence class [x]X/, and, whenever an injective monotone exists, |X/|c.

The cardinality of multi-utilities plays an important role. In particular, special interest lies in preordered spaces with countable multi-utilities. In practice, countable multi-utilities are often used to define preordered spaces. For example, the uncertainty preorder U is defined in (1) by a countable (finite) multi-utility. Also, many applications in multicriteria optimization (Bevilacqua et al., 2018b; Ehrgott 2005) rely on preordered spaces defined by countable multi-utilities. It turns out that for the existence of strict monotones, such as entropy for U, it is sufficient to have a countable multi-utility (Alcantud et al., 2016, Section 4). Here, we show that countable multi-utilities actually imply the existence of injective monotones, which, due to Proposition 1, improves upon (Alcantud et al., 2016).

Proposition 5

If, for a given preordered space (X,), there exists a countable multi-utility, then there exists an injective monotone.

This means that the class of preordered spaces where countable multi-utilities exist is contained in the class of preordered spaces where an injective monotone exists (cf. Fig. 1). However, there exist preordered spaces with injective monotones, i.e., by Proposition 4, with injective monotone multi-utilities of cardinality c, but without countable multi-utilities (see Proposition 8).

For the uncertainty preorder U, which is defined in (1) through a finite multi-utility, Proposition 5, therefore, guarantees the existence of injective monotones. Moreover, we can see a possible construction in (3) below.

By a slight adaptation of the proof of Proposition 5, we obtain the stronger.

Proposition 6

For a given preordered space (X,), there exists a countable multi-utility if and only if there exists a countable multi-utility only consisting of injective monotones.

This improves upon (Alcantud et al., 2016, Proposition 4.1), where it is shown that a countable multi-utility exists if and only if a countable strict monotone multi-utility exists. Notice, however, while for the proof in Alcantud et al. (2016), one can simply modify each member of a given multi-utility separately—similarly as we did for the construction in Proposition 4—our proof of Proposition 6 relies on a more indirect technique, where each member of the resulting injective monotone multi-utility does not have a direct relationship to a non-injective member of the given multi-utility.

For the proofs of Propositions 5 and 6, we rely on the following basic facts, the proofs of which can be found in the appendix.

Lemma 1

Let X be a set. Given r(0,12) and a countable family (An)n0 of subsets AnX, define the function c:XR by

c(x):=n0rnχAn(x). 3

Then, c(x)<c(y) if and only if, for the first mN with χAm(x)χAm(y), we have χAm(x)<χAm(y).

The following characterizations of injective monotones and countable multi-utilities follow by straightforward manipulations of their definitions.

Lemma 2

Let (X,) be a preordered space. A monotone u is an injective monotone if and only if

xyu(x)<u(y)andxyu(x)u(y). 4

A collection U of monotones is a multi-utility if and only if

¬(yx)uUs.t.u(x)<u(y). 5

A subset AX of a preordered space (X,) is called decreasing if for all xA, yx implies yA. Analogously, a subset AX is called increasing, if for all xA, xy implies that yA (Mehta, 1986a). We say a family (An)nN of subsets AnX separates x from y, if there exists nN with xAn and yAn.

Lemma 3

Let (An)n0 be a family of increasing sets.

  • (i)

    If, for all x,yX with xy, (An)n0 separates x from y, then the function c:XR defined in (3) is a strict monotone for all r(0,1).

  • (ii)

    If in addition, for all x,yX with xy, (An)n0 separates x from y, or y from x, then c is an injective monotone for all r(0,12).

Notice, the construction of strict and injective monotones in Lemma 3 is based on Lemma 1 and is analogous to constructions that appear in the literature, where one typically uses a value of r=12 (e.g., Alcantud et al., 2016; Mehta, 1977; Ok, 2002). The requirement of r<12 in Lemmas 1 and 3 ensures that the resulting monotone is injective. In fact, as can be seen from the proof of Lemma 1 in the appendix, for r(0,1) we have rm=r1-rn>mrn. A value of r(0,12) thus enables the strict estimate rm>n>mrn, which is exactly where the injectivity up to equivalence of c in Lemma 3 rests.

Proof of Proposition 5

For a countable multi-utility (um)mM and qQ, consider the increasing sets Am,q:=um-1([q,)). It suffices to show that (An)n0, where An:=Amn,qn for some enumeration n(mn,qn) of M×Q, satisfies (i) and (ii) in Lemma 3. If xy or xy, then, by (5), in both cases there exists mM with um(x)<um(y). Hence, we can choose qQ with um(x)<q<um(y), in particular, xAm,q and yAm,q.

Proof of Proposition 6

Let (um)mM be a countable multi-utility and let c be an injective monotone of the form (3) constructed from the increasing sets An in the proof of Proposition 5. We define, for any pair (m,p)N such that m<p, φm,p:NN which permutes m and p without changing any other natural number. For each φm,p, we define an injective monotone cm,p of the form (3) constructed from (Aφm,p(n))n0, the increasing sets used to define c reordered by φm,p. Since {c}{cm,p}(m,p)N2,m<p is composed of injective monotones, it suffices to show (5) holds to conclude there exists a countable multi-utility composed of injective monotones. Consider, thus, x,yX such that ¬(yx). If xy, then c(x)<c(y) by definition. Assume now xy. If c(x)<c(y), then we have finished. Otherwise, we have xAm and yAm for the first mN such that χAm(x)χAm(y) by Lemma 1. Since there exists some pN p>m such that yAp and xAp, the first nN such that χAφm,p(n)(x)χAφm,p(n)(y) is n=m. We conclude cm,p(x)<cm,p(y) by Lemma 1, since we have χAφm,p(m)(x)=χAp(x)<χAp(y)=χAφm,p(m)(y).

Countable separating families such as the ones in Lemma 3 have been used to characterize preordered spaces with continuous utility functions (Herden, 1989), generalizing theorems of Peleg and Mehta (1981). In a similar spirit, Alcantud et al. (2013) extend a result by Bosi and Zuanon (2013) about upper semicontinuous multi-utilities based on separating families, showing that there exists a countable multi-utility if and only if there exists a countable family of decreasing subsets that x,yX with ¬(yx) separates x from y (Alcantud et al., 2013, Proposition 2.13). Using Lemma 3 and the characterizations in Lemma 2, we immediately get the following analogous characterizations for preorders with strict and injective monotones, the proofs of which can be found in Appendix A.2.4.

Proposition 7

Let (X,) be a preordered space.

  • (i)

    There exists a strict monotone if and only if there exists a countable family of increasing subsets that x,yX with xy separates x from y.

  • (ii)

    There exists an injective monotone if and only if there exists a countable family of increasing subsets that satisfies (i) and (ii) in Lemma 3.

Countable separating families are a useful tool to improve the classification of preordered spaces by monotones. In particular, we use them in Proposition 8 to show the converse of Proposition 5 is false, that is, there are preordered spaces where injective monotones exist and countable multi-utilities do not.

Proposition 8

There are preordered spaces with injective monotones and without countable multi-utilities.

Proof

Consider X:=[0,1][2,3] equipped with where

xyx=yx[0,1],y[2,3]andyx+2 6

x,yX (see Fig. 3 for a representation of ). Notice (X,) is a preordered space and the identity map id:XR is an injective monotone. We will show any family (Ai)iI, where AiX is increasing iI and x,yX such that ¬(yx) there exists some iI such that xAi and yAi, is uncountable. Since the existence of some (Ai)iI with those properties and countable I is equivalent to the existence of a countable multi-utility (Alcantud et al., 2013, Proposition 2.13), we will get there is no countable multi-utility for X. Consider a family (Ai)iI with the properties above and, for each x[0,1], yx:=x+2. Since xyx by definition, there exists some Ax(Ai)iI such that xAx and yxAx. We fix such an Ax for each x[0,1] and consider the map f:[0,1](Ai)iI, xAx. Given x,z[0,1] xz, if we assume zAx, then, since Ax is increasing and zyx as yxz+2, we would have yxAx, a contradiction. Notice, analogously, we get a contradiction if we assume xAz and, therefore, AxAz. Thus, Ax=Az implies x=z and we have, by injectivity of f, |[0,1]||(Ai)iI|. As a consequence, X has no countable multi-utility.

Fig. 3.

Fig. 3

Representation of a preordered space, defined in Proposition 8, where injective monotones exist and countable multi-utilities do not. In particular, we show A:=[0,1], B:=[2,3] and how x,y,zA, x<y<z, are related to x+2,y+2,z+2B. Notice an arrow from an element w to an element t represents wt

As we have seen in this section, the concept of separating families is closely related to the existence of monotones. In particular, this link is apparent when considering sets of the form u-1([q,)) for some monotone u and qQ, allowing to translate the two concepts into each other (see the proofs of Propositions 5 and 6). There is another rich class of separability properties of preordered spaces providing necessary conditions for the existence of monotones, which could collectively be described by the term order separability. Many important results from mathematical economics fall into this category, such as the Debreu Open Gap Lemma (Debreu, 1964), the Nachbin Separation Theorem (Nachbin, 1965), Szpilrajn’s theorem (Szpilrajn, 1930), and Fishburn’s theorem (Fishburn, 1970, Theorem 3.1). We discuss the role of injective monotones relative to order separability in the following section.

Relating monotones to order separability

A subset ZX, such that xy implies that there exists zZ with xzy is called order dense (Bridges & Mehta, 2013; Ok, 2002), and Z is called order dense in the sense of Debreu (or Debreu dense for short) if xzy. Accordingly, we say that (X,) is order separable if there exists a countable order dense set (Mehta, 1986a), and Debreu separable if there exists a countable Debreu dense set in (X,). Notice, our definition of order separability is also known as weak separability (Ok, 2002).

It is well known that a total preorder has a utility function if and only if it is Debreu separable (e.g., Bridges & Mehta, 2013, Theorem 1.4.8). Moreover, if is non-total, then Debreu separability still implies the existence of strict monotones (Bridges & Mehta, 2013; Debreu, 1954; Herden & Levin, 2012). The converse, however, is not true, i.e., there are preordered spaces with strict monotones that are not Debreu separable. For example, any Debreu dense subset of (PΩ,U) is uncountable (if |Ω|>2)—see Appendix A.1 for a proof. While Debreu separability is concerned with elements satisfying xy, an analogous condition that is sufficient for the existence of injective monotones must also consider incomparable elements.

We call a subset ZX upper dense if xy implies that there exists a zZ such that xzy, and it is called upper dense in the sense of Debreu (or Debreu upper dense for short) if xzy.4 Accordingly, (X,) is called upper separable if there exists a countable subset of X which is both order dense and upper dense (Ok, 2002), and (X,) is called Debreu upper separable if there exists a countable subset which is both Debreu dense and Debreu upper dense. We list all mentioned order denseness and separability properties in Table 1.

Table 1.

Separability properties of preordered spaces (X,)

Name Object Definition
Order dense ZX x,yX xy zZ: xzy
Debreu dense ZX x,yX xy zZ: xzy
Upper dense ZX x,yX xy zZ: xzy
Debreu upper dense ZX x,yX xy zZ: xzy
Order separable X ZX countable: Z is order dense
Debreu separable X ZX countable: Z is Debreu dense
Upper separable X ZX countable: Z is order dense and upper dense
Debreu upper separable X ZX countable: Z is Debreu dense and Debreu upper dense

Proposition 9

If (X,) is a Debreu upper separable preordered space, then there exists a countable multi-utility; in particular, there exists an injective monotone.

Proof

Consider a countable set D given by Debreu upper separability. We will show

xyχi(d)(x)χi(d)(y)χr(d)(x)χr(d)(y)dD,

where i(d):={yX|dy} and r(d):={yX|dy}. By transitivity xy implies χi(d)(x)χi(d)(y) and χr(d)(x)χr(d)(y) dD. If ¬(xy) then either yx or yx. If yx, then there exists some dD such that either χi(d)(x)>χi(d)(y) or χr(d)(x)>χr(d)(y). If yx then there exists some dD such that ydx which means χi(d)(x)>χi(d)(y). Since there exists a countable multi-utility, as we just showed, there is an injective monotone by Proposition 5.

Since Debreu upper separability still requires a countable Debreu dense set, the converse of Proposition 9 is again false due to the uncertainty preorder not being Debreu separable (Appendix A.1). However, as can be seen from the proof, if we remove Debreu denseness as a requirement, i.e., if we only require D to be Debreu upper dense, then the only part of the proof that does not work is to follow from yx that there exists an element v of the multi-utility with v(x)>v(y). Since a strict monotone has exactly this property, we obtain the following proposition.

Proposition 10

Consider (X,) a preordered space. If there exists a countable Debreu upper dense set, then the following are equivalent:

  • (i)

    There exists a strict monotone.

  • (ii)

    There exists an injective monotone.

  • (iii)

    There exists a countable multi-utility.

Proof

Assume there exists a countable Debreu upper dense set DX. It is enough to show that (i) implies (iii), which follows along the same lines as the proof of Proposition 9, but with the multi-utility consisting of {u}{χi(d)}dD, where u is a strict monotone.

The situation in Proposition 10 corresponds exactly to the situation of the uncertainty preorder, which has a countable Debreu upper dense set (Appendix A.1) and, e.g., Shannon entropy as a strict monotone.

Discussion

In this paper, we are mainly concerned with the introduction of injective monotones, their relation to other monotones, optimization, multi-utilities and order separability, and the application to the uncertainty preorder. The key contributions of our work are the following. First, we refine the classification of preordered spaces based on the existence of monotones. In particular, by extending known results for strict monotones to injective monotones, we find conditions for their existence from different perspectives: other classes of monotones, optimization principles, separating families of increasing sets, and (in particular, countable) multi-utilities. An overview of our conditions in relation to previous work can be found in Fig. 4. Second, we introduce the notion of upper Debreu separability, an order separability property that allows to extend well-known results about the existence of monotones on Debreu separable spaces to countable multi-utilities and injective monotones. Finally, we apply our general results to the uncertainty preorder, defined on the space of probability distributions over finite sets, in particular, by establishing order separability properties.

Fig. 4.

Fig. 4

Classification of preordered spaces (X,) in terms of representations by real-valued functions (boxes) and order properties (ellipses). We include known relations in black and our contributions in red. Notice, by Proposition 10, the blue area is empty whenever there exists a countable Debreu upper dense set in X

Hierarchy of preordered spaces. A number of scientific disciplines rely on preordered spaces and their representation by monotones, as was already pointed out in Campión et al. (2018), Candeal et al. (2001) and Minguzzi (2010). In Fig. 1, we classify the space of preorders in terms of the existence of certain monotones relevant in various disciplines, which leads to a hierarchy of classes of preordered spaces. The conception of injective monotones then allows for a refinement of this hierarchy of preorders.

Historically, much of the early development of real-valued representations has focused on total preordered spaces that allow for the existence of utility functions. In particular, in the field of mathematical economics, utility theory has pioneered the axiomatic study of conditions that ensure the existence of utility functions for a preordered set (X,), where X is a set of commodities and is some total preference relation, a total preorder (Debreu, 1954; Rébillé, 2019). Similarly, we can consider statistical estimation, where the aim is to infer the distribution of a random variable X from some of its realizations. Assuming the distribution belongs to a family {pθ}θRN for some N>0, a loss function :RNR allows rating distributions according to how well they fit with the observed data: pθpθ if and only if -(θ)-(θ) where θ,θRN (Hennig & Kutlukaya, 2007). Choosing a loss function corresponds, thus, to defining a total preorder with a utility representation on {pθ}θRN.

Another example of a preorder with a utility function is equilibrium thermodynamics. Given a thermodynamic system, we consider (X,A) where X is the set of all equilibrium states for the system and xAy if and only if y is adiabatically accessible from x x,yX (Lieb & Yngvason, 1999), that is, one can turn x into y using a device and a weight, with the device returning to its initial configuration at the end and the weight being allowed to change position in some gravitational field. The main concern in the area is the so-called entropy representation problem (Candeal et al., 2001), that is, the existence of a utility function, called entropy function, for (X,A) (Lieb & Yngvason, 1999).

Assuming a total preorder as in the previous examples is necessary for the existence of a utility function, but renders injective monotones uninteresting, as they become equivalent to strict monotones. When the totality assumption is dropped, the classes of preorders with these monotones can be distinguished. A well-known instance of non-total preorders with injective monotones is our running example, the uncertainty preorder. One of its relevant applications lies in the study of quantum entanglement, as it characterizes the possible transformations using local operations and classical communications (Nielsen, 1999, Theorem 1). In physics, the uncertainty preorder given by majorization has recently also been extended. Given 11(R+):={(pi)iN|0pi1,i=1pi=1}, we define infinite majorization IM (Li & Busch, 2013) for any p,q11(R+) like

pIMq:i=1kpii=1kqikN,

where p represents p ordered in a decreasing way. Since IM is defined through a countable multi-utility, there exist injective monotones by Proposition 5. Finally, the uncertainty preorder is also an instance of multicriteria optimization (Ehrgott, 2005), also known as vector optimization (Jahn, 2009), since it is concerned with the simultaneous optimization of a finite number of objective functions (1). Notice strict and injective monotones belong to the scalarization techniques (Bevilacqua et al., 2018b; Ehrgott, 2005; Jahn, 2009) in vector optimization and always exist, again by Proposition 5.

Preordered spaces from the next general class, the ones with strict monotones, include general relativity. Spacetime can be studied as a pair (M,C) where M is a set of events and C is a causal relation, a partial order specifying which events can influence others, which lie to the future of others (Bombelli et al., 1987). A usual question is to establish sufficient conditions on (M,C) for the existence of strict monotones, which are referred to as time functions (Minguzzi, 2010) and are usually required to be continuous according to some topology. The study of physically plausible conditions from which countable multi-utilities or injective monotones can be constructed has, to our knowledge, not been addressed yet in the field. Notice, spacetime was originally approached through a differentiable structure (Mg), where M is a manifold and g a metric, and was only later studied as a partial order (Bombelli et al., 1987).

Another case of preorders with strict monotones is trumping. Consider (PΩ,T) the space of probability distributions over some finite set Ω, PΩ, with the trumping preorder

pTqrPΩ|Ω|<s.t.prMqr,

where pr:=(p1r1,..,p1rΩ,..,pΩr1,..,pΩrΩ) pPΩ, rPΩ and |Ω|< (Müller & Pastena, 2016). Trumping extends majorization taking into account transformations using a third state, a catalyst. As an example, consider p:=(0.4,0.4,0.1,0.1), q:=(0.5,0.25,0.25,0) and r:=(0.6,0.4). Notice ¬(pMq) but prMqr, implying pTq. Questions regarding physically meaningful strict monotones and multi-utilities for trumping are relevant (Turgut, 2007). As no countable multi-utility has been found, it remains a question whether injective monotones do exist.

A final example from the most general class of preorders, the one where only monotones exist, are social welfare relations (SWR) in economics. A SWR is a partial order S defined on the countably infinite product of the unit interval X:=nN[0,1]. A SWR is said to be ethical if (1) given x,yX with some i,jN such that xi=yj, yi=xj and xk=yk k{i,j} we have xSy and (2) given x,yX where xiyi iN and xj<yj for some jN then xSy. Any ethical SWR is an example of a preordered space without strict monotones (Banerjee & Dubey, 2010, Proposition 1) and, thus, without both injective monotones and countable multi-utilities.

Monotones and topology. While we have focused on preordered spaces and left some brief comments regarding topology for Appendix A.3, in the past they have been often studied together. The original interest in functions representing order structures was concerned with (continuous) utility representations of total topological preordered spaces (Debreu, 1954, 1964; Eilenberg, 1941). Of particular importance were results concerning the existence of a continuous utility function for both connected and separable total topological preordered spaces (Eilenberg, 1941) and for second countable total topological preordered spaces (Debreu, 1954). Among the classical results we also find the existence of an order isomorphism between a subset of the real numbers and any total order with countably many jumps whose order topology is second countable (Fleischer, 1961). Based on the work of Nachbin (1965) relating topology and order theory, in particular a generalization of Urysohn’s separation theorem, the classical results where reproved and sometimes generalized for example in Bosi et al. (2020b), Herden (1989) and Mehta (1977, 1986a, b, 1988).

Multi-utility representations. The study of non-total order structures was introduced in Aumann (1962). Representation of non-total preorders by multi-utilities came later and was remarkably developed in Evren and Ok (2011). Although strict monotones can be traced back to Peleg (1970) and Richter (1966), there continue to be advances in the field (Bosi et al., 2020a; Herden & Levin, 2012; Rébillé 2019). In fact, it was only recently in Minguzzi (2013) where strict monotone multi-utilities were introduced and later in Alcantud et al. (2013, 2016) where they were further studied. The relation of these ideas with optimization and the existence of maximal elements is also present in the literature (Bevilacqua et al., 2018a, b; Bosi & Zuanon, 2017; Bosi et al., 2018; White, 1980). Countable multi-utilities where studied particularly in Alcantud et al. (2016), Bevilacqua et al. (2018c), while finite multi-utility representations were notably advanced in Kaminski (2007) and Ok (2002) and, in vector optimization, in Jahn (2009).

Open questions. While we have shown the existence of injective monotones for the widely studied class of preorders with countable multi-utilities, our construction is impractical since it relies on an infinite sum. For specific applications, injective monotones with a simpler representation are of interest. In general, any of the disciplines where these ideas are applied would benefit from a better understanding of the classification of preordered spaces in terms of real-valued monotones. For example, regarding the maximum entropy principle, the classification could be useful to reconsider the reasoning behind the choice of Shannon entropy. Even though there have been many principled approaches to “derive” Shannon entropy as a measure of uncertainty in the past, such as Aczél et al. (1974) and Shore and Johnson (1980), and for many practical purposes its appealing properties overweigh the bias in choosing this particular strict monotone, the question remains whether one should maximize entropy or maximize uncertainty. Quantum physics could also benefit as, for instance, the preorder underlying entanglement catalysis, trumping, is not well understood (Müller & Pastena, 2016). Many relevant open questions related to our work can also be found in Bosi et al. (2020a), for example, while we have focused mostly on preordered spaces and made some remarks on semicontinuity, it would be important to study continuous injective monotones in terms of topological properties of the underlying spaces, as in the classical works on utility functions.

Appendix

Entropy and the uncertainty preorder

In the following, we provide proofs for statements regarding the uncertainty preorder U and entropy H that appear throughout the main part of this article, in particular, all results are stated with respect to the preordered space (PΩ,U), for a finite set Ω.

Lemma 4

(Basic facts)

  • (i)

    Shannon entropy is a strict monotone. If |Ω|3 then it is not an injective monotone.

  • (ii)

    If |Ω|3 then for all c(0,log|Ω|), there is an uncountable set Sc such that H(s)=c sSc. In particular, there are p,qPΩ with c=H(p)=H(q) but pq for all c(0,log|Ω|).

Proof
(i)

Strict monotonicity of H comes from the fact H(p)=i=1|Ωf(pi) where f(x)=-xlog(x) is a strictly convex function. Given any other strictly convex f, strict monotonicity will still hold. One can find the details in (Marshall et al., 1979, C.1.a). H is not an injective monotone for |Ω|3 by (ii).

(ii)

Given p,qPΩ, we denote by pq¯ the segment with endpoints pq. Consider uPΩ the uniform distribution, ei,ejPΩ Dirac distributions for two different elements i,jΩ and some c(0,log|Ω|). Consider some c s.t. 0<c<min{c,H(m)} where m is the middle point of eiej¯. By the intermediate value theorem, there exists some reim¯ such that H(r)=c. Consider now a parametrization of eir¯: {rt}t[0,1] and define t:=rtu¯ for each t[0,1]. Again by the intermediate value theorem, since H(rt)<c t[0,1], there exists some ptt such that H(pt)=c t[0,1]. By construction, given t,t[0,1] tt we have ptpt since tt={u} whenever tt which means {pt}t[0,1] is uncountable. In particular, there are tc,tc[0,1] tctc such that ptcptc and H(ptc)=H(ptc)=c for every c(0,log|Ω|).

Lemma 5

(Debreu separability)

  • (i)

    If |Ω|=2 then (PΩ,U) is order separable. In particular, (PΩ,U) is Debreu separable for |Ω|=2.

  • (ii)

    If |Ω|3 then any subset ZPΩ which is Debreu dense in (PΩ,U) has the cardinality of the continuum |Z|=c.

  • (iii)

    For any |Ω|<, there exists a countable upper dense set ZPΩ.

Proof

For simplicity of notation, in the following, we omit the subscript U and thus write for U (analogously for and ).

(i)

Consider p,qP such that pq. By definition, we have q1<p1. Consider some sQ such that q1<s<p1. Notice by normalization 12q1<s and by normalization again 1-s<s. Thus, prq where r:=(s,1-s) and Q2PΩ is countable and order dense in (PΩ,U) for |Ω|=2. In particular, (PΩ,) is Debreu separable for |Ω|=2 which we could have known applying Theorem 1.4.8 in Bridges and Mehta (2013) since for |Ω|=2 there is a utility function, u1.

(ii)

Fix |Ω|=3. Consider for some x(12,1) some pPΩ such that p1=x. Notice p2+p3<x by normalization. Take some ϵ>0 such that p2+ϵ<x and ϵp3 to define qPΩ where q:=(x,p2+ϵ,p3-ϵ). Notice qp. Notice for any x(12,1) we can define a pair qx,pxPΩ such that qxpx as we did before where for any tPΩ such that qxtpx we have t1=x. Given ZPΩ a subset which is Debreu dense in (PΩ,) there exists for any x(12,1) some zxZ such that qxzxpx. Fix for every x(12,1) some zx. Notice, given x,y(12,1), then zx=zy implies x=(zx)1=(zy)1=y which means that φ:(12,1)Z,xzx is injective, implying c|Z|. Since ZPΩ and |PΩ|=c we have |Z|=c. In case |Ω|>3, any Debreu dense subset would also be Debreu dense in the subset with |Ω|=3. We can thus follow the above lines and get the same conclusion for any |Ω|3.

(iii)
Consider x,yPΩ such that xy. Since xy, there exist n,m|Ω|-1 such that i=1nxi<i=1nyi and i=1mxi>i=1myi. Notice yi<1 i|Ω| since in the opposite case yx xPΩ. Consider 1<k|Ω| the largest integer such that yk>0 and define {ϵi}i=1k-1 where
0<ϵi<min{yk,j=1mxj-j=1myj}ifi=1,0<ϵi<min{yk-j=1i-1ϵj,j=1mxj-j=1myj-j=1i-1ϵj}if1<im,0<ϵi<yk-j=1i-1ϵjifm<i<k.
Notice m<k since the opposite case leads to i=1mxi>i=1myi=i=1kyi=1 contradicting normalization. For all i<k choose qi(yi,yi+ϵi)Q such that qiqi+1 and qk=1-i=1k-1qi. Then z:=(q1,q2,..,qk,0,..,0) has |Ω|-k zeros, the same number of zeros as y, and z=z, since qk<1-i=1k-1yi=ykyk-1<qk-1. By construction, we have j=1izj>j=1iyj i<k implying j=1nxj<j=1nzj, j=1|Ω|zj=j=1kzj=1 and j=1mzj<j=1mxj since
j=1mzj<j=1myj+ϵj<j=1myj+j=1mxj-j=1myj=j=1mxj
where in the first inequality, we applied zj=qj<yj+ϵj jm and in the second, we applied the definition of ϵm by which j=1mϵj<j=1mxj-j=1myj. Thus, xzy. We have shown Q|Ω|PΩ is a countable upper dense set in (PΩ,U) for any |Ω|<.

Proofs

Preorders without strict monotones (Alcantud et al., 2016, Corollary 2.2)

For example, consider the power set of the reals equipped with set inclusion, (P(R),). Since is reflexive, transitive, and antisymmetric (i.e., a partial order), by Szpilrajn extension theorem, there exists a totally ordered space (P(R)¯,) extending (P(R),), respecting the relations that already exist and relating the incomparable elements (e.g., overlapping intervals). Hence, if there was a strict monotone v:P(R)¯R, then v(U)=v(V) for some U,VR would imply that U=V, because w.l.o.g. UV, and UV cannot hold since v is a strict monotone. This contradicts Cantor’s theorem by which the cardinality of the power set P(R) is strictly greater than that of R.

Proof of Lemma 1

First, note that for r(0,1), we have

r(0,12)rm>n=m+1rnm0. 7

This is a direct consequence of the closed-form formula of the geometric series and its partial sums, by which we have for any r(0,1) and m0,

n=m+1rn=11-r-n=0mrn=r1-rrm,

so that rm>n=m+1rn if and only if r<1-r, i.e., r(0,12).

Consider x,yX and mN be the smallest index such that χAm(x)χAm(y). Assume χAm(x)<χAm(y), in particular χAm(x)=0 and χAm(y)=1. Then,

c(x)n=0mrnχAn(x)+n=m+1rn<(a)n=0mrnχAn(x)+rm=(b)n=0m-1rnχAn(y)+rmχAm(y)c(y)

where (a) is due to (7) and (b) follows from the choice of m. Conversely, if c(x)<c(y), then let m be the first index where χAm(x)χAm(y). Clearly, if χAm(y)<χAm(x), then by the same argument as above, c(y)<c(x), contradicting the hypothesis. Hence, χAm(x)<χAm(y).

Proof of Lemma 3

Given a family of increasing sets (An)nN, c in (3) is a monotone. If xy, then by assumption, there exists nN such that xAn and yAn, i.e., χAn(x)<χAn(y), implying that c is a strict monotone by Lemma 1. Furthermore, if xy, there exists nN such that xAn and yAn or yAn and xAn. There exists thus some mN such that χAm(x)χAm(y) implying c(x)c(y) by Lemma 1. By Lemma 2, we have c is an injective monotone.

Proof of Proposition 7
(i)

We only need to show given a strict monotone v there exists a countable set (An)nN that separates any pair x,yX such that xy, the converse is true by Lemma 3 Consider An:=v-1([qn,)) where (qn)nN is a numeration of the rational numbers. If xy, there exists qnQ such that v(x)<qn<v(y) which means yAn and xAn.

(ii)

Relying on Lemma 3 and (i), we can take (An)nN defined as in (i) assuming v is an injective monotone. Given x,yX such that xy, we have v(x)v(y) which implies there exists some qnQ between v(x) and v(y), i.e., either xAn and yAn or yAn and xAn.

Semicontinuity

Much of the economic literature on utility representations in preordered spaces is concerned with topological questions, in particular, under which conditions on the preordered space one can expect that monotones and utilities satisfy certain continuity properties (e.g., Alcantud et al., 2016; Debreu, 1964; Mehta, 1986a). This is particularly important for optimization, since continuous functions attain their maximal elements on compact sets. Therefore, in this section, we collect the continuity properties of the injective monotones that appear in the main part of this article.

Given a topology τ, a triple (X,,τ) is called a preordered topological space. A function f:(X,τ)(R,τnat), where τnat is the topology given by the Euclidean metric, is said to be upper semicontinuous if f-1((-,r))τ rR.

Upper semicontinuous functions retain the property of continuous functions that they assume their maxima on compact sets, that is, they are effective on any compact set BX.

Similarly, we say (X,,τ) is upper semicontinuous if i(x)={zX|xz} is closed xX. We may abuse notation and say that is upper semicontinuous whenever X and τ are clear.

Proposition 11

Let (X,,τ) be a preordered topological space.

  • (i)

    In Proposition 4, we can choose an upper semicontinuous multi-utility if the monotone is upper semicontinuous.

  • (ii)

    In Proposition 5, we can add upper semicontinuous to both the hypothesis and the thesis.

  • (iii)

    In Proposition 6, if the preorder is upper semicontinuous then the equivalence remains true if upper semicontinuous is added to all clauses.

  • (iv)

    In Proposition 7, the monotones can be chosen to be upper semicontinuous if and only if the separating families consist of closed increasing sets.

  • (v)

    In Proposition 10, if the preorder is upper semicontinuous then the equivalence remains true if upper semicontinuous is added to all clauses.

Notice, the uncertainty preorder U is upper semicontinuous with respect to the Euclidean topology, since

i(p)={qPΩ|puq}=i=1|Ω|-1{qPΩ|ui(p)ui(q)}=i=1|Ω|-1ui-1([ui(p),))

where ui-1([ui(p),)) is closed, because all ui are upper semicontinuous.

Proof
(i)

If there exists an upper semicontinuous injective monotone, then we can construct w.l.o.g. an upper semicontinuous injective monotone c:X(0,1). Since is upper semicontinuous, we know χi(x) is upper semicontinuous, and given the fact the class of upper semicontinuous functions is closed under addition by Proposition 1.5.12 in Pedersen (2012), cx in the proof of Proposition 4 is upper semicontinuous xAc. Thus, {c}{cx}xAc is an upper semicontinuous injective monotone multi-utility of (X,,τ).

(ii)

Take (um)mM, (An)nN and c defined as in the proof of Proposition 5. If (um)mM is upper semicontinuous then nN An=umn-1([qn,[)τc and χAn(x) is upper semicontinuous nN. The class of upper semicontinuous function is closed under addition, product by positive scalars and uniform convergence by Proposition 1.5.12 in Pedersen (2012). By the first two cN:=n=0N3-nχAn is upper semicontinuous NN and by the third c=limNcN is upper semicontinuous.

(iii)

Following (ii), we get {c}{cn1,n2}n1<n2 defined as in the proof of Proposition 6 consists of upper semicontinuous injective monotones.

(iv)

Notice whenever (An)nN in the proof of Proposition 7 is defined through an upper semicontinuous function, either a strict monotone or an injective monotone, then An is closed nN. Conversely, we can follow the proof of (ii) to get upper semicontinuity for both a strict monotone and an injective monotone constructed as in Lemma 3.

(v)

We again only show (i) implies (iii) in Proposition 10. If is upper semicontinuous then χi(d) is upper semicontinuous dD and since we can choose u to be an upper semicontinuous strict monotone by hypothesis we get {u}{χi(d)} is an upper semicontinuous countable multi-utility.

Funding

Open Access funding enabled and organized by Projekt DEAL. This research was funded by the European Research Council, grant number ERC-StG-2015-ERC, Project ID: 678082, “BRISC: Bounded Rationality in Sensorimotor Coordination”.

Availability of data and material

Not applicable.

Code availability

Not applicable.

Declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Footnotes

1

Here, xy means xy and ¬(yx).

2

Notice, having a utility function implies is total, that is, any pair of points x,yX can be related by .

3

Since U is not total for any |Ω|>2, it has no utility function

4

Notice that, for a fixed pair x,yX where xy holds, if ZX is upper dense, there exist z1,z2Z such that xz1y and yz2x. The same applies to upper density in the sense of Debreu, substituting by .

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Pedro Hack, Email: pedro.hack@uni-ulm.de.

Daniel A. Braun, Email: daniel.braun@uni-ulm.de

Sebastian Gottwald, Email: sebastian.gottwald@uni-ulm.de.

References

  1. Aczél J, Forte B, Ng CT. Why the shannon and hartley entropies are ‘natural’. Advances in Applied Probability. 1974;6(1):131–146. doi: 10.2307/1426210. [DOI] [Google Scholar]
  2. Alcantud, J. C. R., Bosi, G., & Zuanon, M. (2013). Representations of preorders by strong multi-objective functions. Tech. Rep. MPRA Paper 5232, University Library of Munich.
  3. Alcantud JCR, Bosi G, Zuanon M. Richter–Peleg multi-utility representations of preorders. Theory and Decision. 2016;80(3):443–450. doi: 10.1007/s11238-015-9506-z. [DOI] [Google Scholar]
  4. Arnold BC. Majorization and the Lorenz order with applications in applied mathematics and economics. Springer; 2018. [Google Scholar]
  5. Aumann, R. J. (1962). Utility theory without the completeness axiom. Econometrica: Journal of the Econometric Society, 445–462.
  6. Banerjee, K., & Dubey, R. S. (2010). On multi-utility representation of equitable intergenerational preferences. In Econophysics and Economics of Games, Social Choices and Quantitative Techniques (pp. 175–180). Springer.
  7. Bernoulli J. Ars conjectandi. Thurneysen Brothers; 1713. [Google Scholar]
  8. Bevilacqua P, Bosi G, Zuanon M. Maximal elements of preorders from maximization of transfer upper continuous weak utilities on a compact space. Far East J. Math. Sci. 2018;103:213–221. [Google Scholar]
  9. Bevilacqua, P., Bosi, G., & Zuanon, M. (2018b). Multiobjective optimization, scalarization, and maximal elements of preorders. In Abstract and applied analysis (vol. 2018). Hindawi.
  10. Bevilacqua P, Bosi G, Zuanon M. Representation of a preorder on a topological space by a countable family of upper semicontinuous order-preserving functions. Advances and Applications in Mathematical Sciences. 2018;17(5):417–427. [Google Scholar]
  11. Bombelli L, Lee J, Meyer D, Sorkin RD. Space-time as a causal set. Physical Review Letters. 1987;59(5):521. doi: 10.1103/PhysRevLett.59.521. [DOI] [PubMed] [Google Scholar]
  12. Bosi G, Bevilacqua P, Zuanon M. Upper semicontinuous representability of maximal elements for non total preorders on compact spaces. Res J Econ. 2018;3:2. [Google Scholar]
  13. Bosi G, Campión MJ, Candeal JC, Indurain E. Mathematical topics on representations of ordered structures and utility theory. Springer; 2020. [Google Scholar]
  14. Bosi G, Estevan A, Raventós-Pujol A. Topologies for semicontinuous Richter–Peleg multi-utilities. Theory and Decision. 2020;88(3):457–470. doi: 10.1007/s11238-019-09730-7. [DOI] [Google Scholar]
  15. Bosi G, Zuanon M. Existence of maximal elements of semicontinuous preorders. Int J Math Anal. 2013;7:1005–1010. doi: 10.12988/ijma.2013.13100. [DOI] [Google Scholar]
  16. Bosi G, Zuanon ME. Maximal elements of quasi upper semicontinuous preorders on compact spaces. Economic Theory Bulletin. 2017;5(1):109–117. doi: 10.1007/s40505-016-0106-z. [DOI] [Google Scholar]
  17. Brandao F, Horodecki M, Ng N, Oppenheim J, Wehner S. The second laws of quantum thermodynamics. Proceedings of the National Academy of Sciences. 2015;112(11):3275–3279. doi: 10.1073/pnas.1411728112. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Bridges DS, Mehta GB. Representations of preferences orderings. Springer Science & Business Media; 2013. [Google Scholar]
  19. Campión MJ, Gómez-Polo C, Induráin E, Raventós-Pujol A. A survey on the mathematical foundations of axiomatic entropy: Representability and orderings. Axioms. 2018;7(2):29. doi: 10.3390/axioms7020029. [DOI] [Google Scholar]
  20. Candeal JC, De Miguel JR, Induráin E, Mehta GB. Utility and entropy. Economic Theory. 2001;17(1):233–238. doi: 10.1007/PL00004100. [DOI] [Google Scholar]
  21. Csiszár I. Axiomatic characterizations of information measures. Entropy. 2008;10(3):261–273. doi: 10.3390/e10030261. [DOI] [Google Scholar]
  22. Dalton H. The measurement of the inequality of incomes. The Economic Journal. 1920;30(119):348–361. doi: 10.2307/2223525. [DOI] [Google Scholar]
  23. Debreu G. Representation of a preference ordering by a numerical function. Decision Processes. 1954;3:159–165. [Google Scholar]
  24. Debreu G. Continuity properties of paretian utility. International Economic Review. 1964;5(3):285–293. doi: 10.2307/2525513. [DOI] [Google Scholar]
  25. Ehrgott M. Multicriteria optimization. Springer Science & Business Media; 2005. [Google Scholar]
  26. Eilenberg S. Ordered topological spaces. American Journal of Mathematics. 1941;63(1):39–45. doi: 10.2307/2371274. [DOI] [Google Scholar]
  27. Evren Ö, Ok EA. On the multi-utility representation of preference relations. Journal of Mathematical Economics. 2011;47(4–5):554–563. doi: 10.1016/j.jmateco.2011.07.003. [DOI] [Google Scholar]
  28. Fishburn, P. C. (1970). Utility theory for decision making. Tech. rep., Research analysis corp McLean VA.
  29. Fleischer I. Numerical representation of utility. Journal of the Society for Industrial and Applied Mathematics. 1961;9(1):48–50. doi: 10.1137/0109005. [DOI] [Google Scholar]
  30. Fox, R., Pakman, A., & Tishby, N. (2016). Taming the noise in reinforcement learning via soft updates. In Proceedings of the thirty-second conference on uncertainty in artificial intelligence (pp. 202–211).
  31. Gottwald S, Braun DA. Bounded rational decision-making from elementary computations that reduce uncertainty. Entropy. 2019;21(4):375. doi: 10.3390/e21040375. [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Gottwald S, Braun DA. The two kinds of free energy and the Bayesian revolution. PLoS Computational Biology. 2020;16(12):e1008420. doi: 10.1371/journal.pcbi.1008420. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Hardy GH, Littlewood JE, Pólya G. Inequalities. Cambridge University Press; 1952. p. 89. [Google Scholar]
  34. Hennig C, Kutlukaya M. Some thoughts about the design of loss functions. REVSTAT-Statistical Journal. 2007;5(1):19–39. [Google Scholar]
  35. Herden G. On the existence of utility functions. Mathematical Social Sciences. 1989;17(3):297–313. doi: 10.1016/0165-4896(89)90058-9. [DOI] [Google Scholar]
  36. Herden G, Levin VL. Utility representation theorems for Debreu separable preorders. Journal of Mathematical Economics. 2012;48(3):148–154. doi: 10.1016/j.jmateco.2012.02.005. [DOI] [Google Scholar]
  37. Jahn J. Vector optimization. Springer; 2009. [Google Scholar]
  38. Jaynes ET. Probability theory: The logic of science. Cambridge University Press; 2003. [Google Scholar]
  39. Kaminski B. On quasi-orderings and multi-objective functions. European Journal of Operational Research. 2007;177(3):1591–1598. doi: 10.1016/j.ejor.2005.10.015. [DOI] [Google Scholar]
  40. Li Y, Busch P. Von Neumann entropy and majorization. Journal of Mathematical Analysis and Applications. 2013;408(1):384–393. doi: 10.1016/j.jmaa.2013.06.019. [DOI] [Google Scholar]
  41. Lieb EH, Yngvason J. The physics and mathematics of the second law of thermodynamics. Physics Reports. 1999;310(1):1–96. doi: 10.1016/S0370-1573(98)00082-9. [DOI] [Google Scholar]
  42. Lorenz MO. Methods of measuring the concentration of wealth. Publications of the American statistical association. 1905;9(70):209–219. doi: 10.2307/2276207. [DOI] [Google Scholar]
  43. Maccheroni F, Marinacci M, Rustichini A. Ambiguity aversion, robustness, and the variational representation of preferences. Econometrica. 2006;74(6):1447–1498. doi: 10.1111/j.1468-0262.2006.00716.x. [DOI] [Google Scholar]
  44. Marshall AW, Olkin I, Arnold BC. Inequalities: Theory of majorization and its applications. Springer; 1979. [Google Scholar]
  45. Mehta, G. (1977). Topological ordered spaces and utility functions. International Economic Review, 779–782.
  46. Mehta, G. (1981). Recent developments in utility theory. University of Queensland, Department of Economics.
  47. Mehta G. Existence of an order-preserving function on normally preordered spaces. Bulletin of the Australian Mathematical Society. 1986;34(1):141–147. doi: 10.1017/S0004972700004597. [DOI] [Google Scholar]
  48. Mehta G. On a theorem of fleischer. Journal of the Australian Mathematical Society. 1986;40(2):261–266. doi: 10.1017/S1446788700027233. [DOI] [Google Scholar]
  49. Mehta G. Some general theorems on the existence of order-preserving functions. Mathematical Social Sciences. 1988;15(2):135–143. doi: 10.1016/0165-4896(88)90018-2. [DOI] [Google Scholar]
  50. Minguzzi E. Time functions as utilities. Communications in Mathematical Physics. 2010;298(3):855–868. doi: 10.1007/s00220-010-1048-1. [DOI] [Google Scholar]
  51. Minguzzi E. Normally preordered spaces and utilities. Order. 2013;30(1):137–150. doi: 10.1007/s11083-011-9230-4. [DOI] [Google Scholar]
  52. Müller MP, Pastena M. A generalization of majorization that characterizes shannon entropy. IEEE Transactions on Information Theory. 2016;62(4):1711–1720. doi: 10.1109/TIT.2016.2528285. [DOI] [Google Scholar]
  53. Nachbin, L. (1965). Topology and order. 4. van Nostrand.
  54. Nielsen MA. Conditions for a class of entanglement transformations. Physical Review Letters. 1999;83(2):436. doi: 10.1103/PhysRevLett.83.436. [DOI] [Google Scholar]
  55. Ok EA, et al. Utility representation of an incomplete preference relation. Journal of Economic Theory. 2002;104(2):429–449. doi: 10.1006/jeth.2001.2814. [DOI] [Google Scholar]
  56. Ortega PA, Braun DA. Thermodynamics as a theory of decision-making with information-processing costs. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences. 2013;469(2153):20120683. doi: 10.1098/rspa.2012.0683. [DOI] [Google Scholar]
  57. Pedersen GK. Analysis now. Springer Science & Business Media; 2012. [Google Scholar]
  58. Peleg, B. (1970). Utility functions for partially ordered topological spaces. Econometrica: Journal of the Econometric Society, 93–96.
  59. Rébillé Y. Continuous utility on connected separable topological spaces. Economic Theory Bulletin. 2019;7(1):147–153. doi: 10.1007/s40505-018-0149-4. [DOI] [Google Scholar]
  60. Rényi, A., et al. (1961). On measures of entropy and information. In: Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics. The Regents of the University of California.
  61. Richter, M. K. (1966). Revealed preference theory. Econometrica: Journal of the Econometric Society, 635–645.
  62. Schur I. Uber eine klasse von mittelbildungen mit anwendungen auf die determinantentheorie. Sitzungsberichte der Berliner Mathematischen Gesellschaft. 1923;22(9–20):51. [Google Scholar]
  63. Shore J, Johnson R. Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Transactions on Information Theory. 1980;26(1):26–37. doi: 10.1109/TIT.1980.1056144. [DOI] [Google Scholar]
  64. Still S. Information-theoretic approach to interactive learning. EPL (Europhysics Letters) 2009;85(2):28005. doi: 10.1209/0295-5075/85/28005. [DOI] [Google Scholar]
  65. Szpilrajn E. Sur l’extension de l’ordre partiel. Fundamenta mathematicae. 1930;1(16):386–389. doi: 10.4064/fm-16-1-386-389. [DOI] [Google Scholar]
  66. Tishby, N., & Polani, D. (2011). Information theory of decisions and actions. In Perception-action cycle (pp. 601–636). Springer.
  67. Tsallis C. Possible generalization of Boltzmann-Gibbs statistics. Journal of Statistical Physics. 1988;52(1):479–487. doi: 10.1007/BF01016429. [DOI] [Google Scholar]
  68. Turgut S. Catalytic transformations for bipartite pure states. Journal of Physics A: Mathematical and Theoretical. 2007;40(40):12185. doi: 10.1088/1751-8113/40/40/012. [DOI] [Google Scholar]
  69. White, D. (1980). Notes in decision theory: Optimality and efficiency ii. European Journal of Operational Research.
  70. Williams RJ, Peng J. Function optimization using connectionist reinforcement learning algorithms. Connection Science. 1991;3(3):241–268. doi: 10.1080/09540099108946587. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable.

Not applicable.


Articles from Theory and Decision are provided here courtesy of Springer

RESOURCES