Skip to main content
Entropy logoLink to Entropy
. 2021 Jun 8;23(6):729. doi: 10.3390/e23060729

Random Walks with Invariant Loop Probabilities: Stereographic Random Walks

Miquel Montero 1,2
Editor: Eli Barkai
PMCID: PMC8228639  PMID: 34201220

Abstract

Random walks with invariant loop probabilities comprise a wide family of Markov processes with site-dependent, one-step transition probabilities. The whole family, which includes the simple random walk, emerges from geometric considerations related to the stereographic projection of an underlying geometry into a line. After a general introduction, we focus our attention on the elliptic case: random walks on a circle with built-in reflexing boundaries.

Keywords: random walk, heterogeneous medium, survival analysis, hyperbolic geometry, elliptic geometry

1. Introduction

The random walk (RW) is one of the most widely used mathematical models to express the irregular evolution of certain physical systems [1,2,3]. In its simplest form, a RW can be viewed as a succession of either left-ward or right-ward jumps in the position of a particle according to certain probabilities. These one-step transition probabilities need not be constant to grant that the stochastic process thus defined belongs to the class of Markov chains [4]: the probability should depend only on properties linked to the current status of the walker, as the calendar time if they suffer from aging [5], or the geographic location when particles propagate through an inhomogeneous medium [6,7].

A recurrent consequence of time- and site-dependent transition probabilities is the appearance of some directionality in the evolution of the system: sometimes in the form of an exogenous bias, sometimes in the form of a restoring force. The inhomogeneous transition probabilities that we are going to consider here are affected by this peculiarity but not in a purely local way: we demand that the probability of performing a closed loop be a function of the number of steps taken exclusively. This means that a fluctuation that reverts the particle to the stating point is equally as likely as the mirror-reversed one, irrespective of the initial location chosen.

Despite this, except in the case of the simple RW, the closest-neighbor transition probabilities depend on the explicit locations of both (starting and ending) sites, indicating the presence of some geometry beyond the topological structure of the state space of the system. In a previous work [8], we considered, in detail, the case in which the underlying metric space was hyperbolic: on the one side, there was evidence pointing to the presence of hyperbolic geometries in technological, biological, or social complex networks [9,10,11,12,13,14,15] and, on the other side, there was some existing mathematical literature on related processes, such as the Brownian motion on a hyperbolic plane [16,17,18].

We must point out, however, that we are neither replacing the topological space nor assuming that the metric space is determined by the real-world distances between the sites. Consider, for instance, the case of anomalous diffusion [19] in disordered media [20,21]. Quenched disorder may be the result of the interaction of an initially homogeneous medium with an external (random) potential, which produces uneven transition rates between the sites [22,23,24,25,26]. Therefore, the metric space that induces inhomogeneities in the involved probabilities can be the mathematical expression of an energetic landscape.

In this paper, we will extend the analysis done in [8] by considering the case of elliptic geometry, an underlying geometry that forces the topological space to be finite and, thus, equivalent to a ring with two reflecting sites and a forbidden node. This circular arrangement of the nodes should not distract us from the fact that the process describes the evolution of a particle in a linear but finite medium with arbitrary disposition. Indeed, when the number of sites is large, the particle behaves as a homogeneous RW in almost all the domains and experiences the repulsion of the ending points only in their closest vicinity. Therefore, the process can be useful in modeling homogeneous finite and discrete systems surrounded by repulsive fields with limited penetrating power.

The manuscript is structured as follows: In Section 2, we introduce the process and deduce the most general form of the one-step transition probabilities, compatible with the desired loop invariance. We explore the geometric origin of our inhomogeneous probabilities in Section 3, based on stereographic projections of hyperbolic and elliptic metric spaces. We restrict the analysis to the elliptic case from Section 4 on, where we obtain exact and approximate formulas for the probability function of the process and its expected values: the mean and the variance of the position of the walker on the ring. Section 5 is devoted to our analysis of the statistics of extreme events, as first- and last-visit probabilities. Our conclusions are drawn in Section 6, while we leave to the appendix some lengthy mathematical expressions.

2. Heterogeneous Processes with Invariant Loop Probabilities

Let us consider the one-dimensional random walk Xt in all its generality, a (possibly infinite) Markov chain defined on the integers, i.e., XtZ for tN0, with X0Xt=0 known. The one-step evolution of the process is tied to a set of site-dependent transition probabilities: if, at time t, the walker is at a given location, Xt=n, then at time t+1, one has

Xt+1=n+1,with probability pnn+1,n1,with probability pnn1, (1)

with pnn+1+pnn1=1. We are interested in finding the conditions that yield translationally-invariant loop probabilities, that is, those cases for which

pnn±1·pn±1n=p2, (2)

with p as a constant parameter, 0<p<1, even when pnn±1 depends on n. Note how condition (2) is satisfied in the case of a homogeneous random walk for which p=1/2. Indeed, this value represents a threshold that divides the problem into two well-different domains since one may express p as

p=12cosh(ξ),0<p<12,12cos(θ),12<p<1. (3)

Note that, while 0<ξ<, one must demand that 0<θ<π/3 (These definitions of ξ and θ may seem arbitrary at this point. Beyond being mathematically correct, there is no reason to prioritize them over other proposals. As we will see below, these definitions ease the algebraic treatment and are well adapted to the geometrical interpretation of the problem. Despite this, alternative parameterizations of p can still be considered).

The first possibility, that is, the case for which

p=12cosh(ξ), (4)

has been analyzed in depth in [8]. Observe how Equation (2) leads to

pnn±1=12cosh((n±1)ξ)cosh(ξ)cosh(nξ)=121±tanh(ξ)tanh(nξ), (5)

once symmetry with respect to the origin is demanded: if

pnn±1=pnn1, (6)

then p0±1=1/2 necessarily, and the general expression follows. One can easily check that the one-step transition probabilities in (5) generate a process that behaves as a simple symmetric random walk in the vicinity of n=0, and as a non-reverting, biased random walk in outer regions of the line. We refer the reader to [8] for further information about the statistical properties of a particle moving according with this infinite Markov chain.

The second scenario, when

p=12cos(θ), (7)

is instead more delicate. The one-step probabilities that are derived from Equation (7) with the constraint in (6) read

pnn±1=12cos((n±1)θ)cos(θ)cos(nθ)=121tan(θ)tan(nθ), (8)

an expression that differs from (5) in a very fundamental aspect: while this formula ensures that 0<pnn±1<1 for any choice of ξ, Equation (8) will finally produce bigger-than-one transition probabilities for a general value of θ, even if 0<θ<π/3. A natural way of avoiding this eventuality is to require that θ be such that cos((n+1)θ)=0 for some value of n, i.e., if one has

θ=π2(N+1), (9)

with NN1 (We discard the case N=0, because then no loop can be defined. Even so, some of the expressions below are still valid for this case), then pNN+1=0 and pNN1=1, as well as pNN1=0 and pNN+1=1. Note that now the possible values of θ are restricted to belong to the range 0<θ<π/4, and n{N,N+1,,N1,N}. Therefore, the process evolves again as an ordinary random walk in the neighborhood of the starting point, and like a reverting random walk as the process leaves this region. The strength of the reverting bias increases until it becomes that of a hard wall at positions n=±N.

For clarity reasons, the values of N that we are going to use in the illustrative examples to be introduced along the text are relatively small—about ten; this enhances the peculiarities of the process in front of a homogeneous random walk with hard ending points. However, as N increases, the fraction of sites whose transition probabilities differ significantly from 1/2 decreases as 1/N. This implies, in practice, that our process can be useful in the analysis of homogeneous finite systems bounded by soft walls.

3. A Geometric View of the Problem

Before analyzing the properties of this inhomogeneous random walk equipped with reflexing barriers, let us discuss how one can recover the one-step probabilities that drive the dynamics of Xt from geometric arguments. Once again, we resort to the idea that, coexisting with the topological structure of the state space of the process, there is an auxiliary metric space that assigns distances to the different locations of the chain and the ratio of the transition probabilities depends inversely on the relative distance between the origin and destination points.

In particular, in [8] we show how one can recover (5) from the distances defined in the absolute of a one-dimensional hyperbolic geometry. Here, we derive anew this result by introducing a minor modification: This time, we analyze the stereographic projection of the hyperbola in which the points in the segment are determined from the intersection between the line that connects the hyperbola centered at the origin with the distal point of a tangential circumference also centered at the origin, see Figure 1.

Figure 1.

Figure 1

Projection of a hyperbolic geometry. The points at the hyperbola are placed at the positions xn=rsinh(2nξ), yn=rcosh(2nξ), nZ. The segment in red corresponds to the stereographic projection of the hyperbola, with the points located at the horizontal positions dn=2rtanh(nξ).

In [8], the intersecting line did not end at the south pole of the circumference but at the origin itself, what defines a gnomonic instead of a stereographic projection. In a one-dimensional problem like ours, the difference reduces to some rescaling of the factors involved that does not affect the essence of discussion, and, in our opinion, stereographic projections provide a smoother transition between both scenarios: the present hyperbolic case and the elliptic one.

If the points at the hyperbola are placed at regular positions xn=rsinh(2nξ), yn=rcosh(2nξ), the corresponding points on the segment are sited at horizontal locations

dn2rsinh(2nξ)1+cosh(2nξ)=2rtanh(nξ), (10)

and therefore the L1 distance between any two of them is

dn,mdndm=2rsinh(|nm|ξ)cosh(nξ)cosh(mξ). (11)

Then, if we assume that the probability of a one-step transition is inversely proportional to the distance between nearest neighbors,

pnn+1pnn1=dn1,ndn,n+1=cosh((n+1)ξ)cosh((n1)ξ), (12)

and one recovers Equation (5).

A similar reasoning leads to expression (8), by replacing the hyperbolic geometry by an elliptic geometry: consider a set of 2N+1 points placed in a regular disposition on a circumference of radius r: xn=rsin(2nθ), yn=rcos(2nθ), with the values of n such that n{N,N+1,,N1,N} and θ defined as in Equation (9). Now consider the stereographic projection of these points into the line tangent to the upper part of the circumference: the projected points are at the intersect between this horizontal line, and the line that connects the original spots and the south pole of the circumference, where there is no accessible point, see Figure 2.

Figure 2.

Figure 2

Projection of an elliptic geometry. The points in the circle are placed at regular angular distances, xn=rsin(2n θ), yn = rcos(2n θ), n{N,N+1,,N1,N}. The red line corresponds to the stereographic projection of the circle, with the points sited at locations dn=2rtan(nθ). (N=3 in this figure).

The projected points on the horizontal line are sited at positions marked by

dn2rsin(2nθ)1+cos(2nθ)=2rtan(nθ), (13)

and the L1 distance between them reads

dn,mdndm=2rsin(|nm|θ)cos(nθ)cos(mθ). (14)

If we demand the same kind of interdependence between transition probabilities and distances as in (12), i.e.,

pnn+1pnn1=dn1,ndn,n+1=cos((n+1)θ)cos((n1)θ), (15)

one recovers Equation (8) with the understanding that we assign d±(N+1)=± to these inaccesible points: otherwise one cannot formally recover p±N±(N+1)=0. Note that this is consistent with Equation (13) as well as with the fact that

d±N=±2rtanπ2·NN+1N±, (16)

since, in the original elliptic geometry, both values n=±(N+1) would be coincident with the south pole of the circumference. Indeed, as we will see below, it is operationally convenient to include ±(N+1) within the spectrum of values of Xt, by attaching a null probability to these events.

Finally, we observe how site-to-site distances increase as |n| increases. This behavior is in clear contrast with the hyperbolic case where distances decrease with |n|, because, in the latter, the length of the projective segment is finite. The borderline case corresponds to the (flat) Euclidean geometry, which can be recovered by letting ξ,θ0, and r in such a way that their product remains finite.

4. Probability Functions

Once we have discussed the geometric interpretation of both processes, we will focus our attention on the statistical properties of the elliptic setup, as the hyperbolic case was analyzed in [8]. We will begin with the probability function pn,t, the probability of finding the process at site n at time t, if it started from the origin:

pn,tPXt=n|X0=0, (17)

for n{N1,N,,N,N+1}, with the proviso that pN1,t=pN+1,t=0 for any value of t. Here and hereafter, we denote by P· the probability of its argument.

Let us consider, in the first place, the case in which tN and assume for the moment that n>0. In order to have pn,t0, we need to demand, on the one hand, that n and t have the same parity (i.e., if both are odd or even integers), and, on the other hand, that nt, otherwise the site n is inaccessible. The transition probability p0n,t of a path connecting sites 0 and n in t steps can be expressed under these circumstances as

p0n,t=p01pn1n·ptn=cos(nθ)2cos(θ)n·12cos(θ)tn=cos(nθ)2cos(θ)t, (18)

where we have used (2), (7) and (8). As it can be observed, Equation (18) does not depend on the particular path followed, and therefore pn,t is p0n,t times the number of different paths that go from 0 to n in t steps, a quantity that can be computed by resorting to standard combinatorial arguments, leading to

pn,t=ttn2cos(nθ)2cos(θ)t. (19)

Note how pn,t=pn,t, which implies that Equation (19) is indeed valid for |n|tN, if n and t have the same parity:

pn,t=ttn2cos(nθ)2cos(θ)t1t|n|2N0, (20)

where 1A is equal to one if A is true and zero otherwise.

The condition tN eases the counting problem, since, for t>N, we will have to subtract, from the binomial term, the forbidden paths on Z, those paths that connect 0 and n going through site N+1 and/or N1. Instead of following this route at this point, let us consider the recursion relation that satisfies pn,t,

pn,t=pn1,t1·pn1n+pn+1,t1·pn+1n=12pn1,t1·cos(nθ)cos((n1)θ)cos(θ)+12pn+1,t1·cos(nθ)cos((n+1)θ)cos(θ), (21)

an expression that can be rewritten as

pn,tei2nθ+ei2nθ+2cos(2θ)cos(θ)=pn1,t1ei(2n+1)θ+ei(2n+1)θ+2cos(θ)/2+pn+1,t1ei(2n1)θ+ei(2n1)θ+2cos(θ)/2. (22)

The problem posed can be solved with the use of Discrete Fourier Transform (DFT) pairs

u˜kn=NN+1un·eiπkn/(N+1)=n=NN+1un·ei2knθ, (23)
un12(N+1)k=NN+1u˜k·eiπkn/(N+1)=12(N+1)k=NN+1u˜k·ei2knθ, (24)

definitions that have embedded the following property of periodicity: un+2(N+1)=un, u˜k+2(N+1)=u˜k, for Z. Therefore, the sums in Equations (23) and (24) could alternatively have begun at N1 and ended at N, but we cannot include contemporarily the terms corresponding to N1 and N+1, even though, in our case, pn,t=0 for |n|=N+1. In fact, we must proceed with caution, since we have pn,t=0 for |n|N+1, a boundary condition that is assumed in (22) (In addition, pn,t=0 if n and t have different parity, but this fact does not affect the present discussion).

To find the solution to Equation (22), let us multiply the whole expression by ei2knθ, sum from n equal to N to N, take into account the boundary conditions where they apply, and obtain

p˜k1,t+p˜k+1,t+2cos(2θ)p˜k,tcos(θ)=cos(2k3)θp˜k1,t1+cos(2k+3)θp˜k+1,t1+2cos(θ)cos2kθp˜k,t1. (25)

As in the case of Equation (21), we could use this recursion in conjunction with the fact that p˜k,0=1 to compute p˜k,t. Since pn,t is real and symmetric, so is p˜k,t. Moreover, as p˜k,t is a probability function, p˜0,t=1. Therefore, we can compute p˜±1,1 from (25)

p˜±1,1=cos(3θ)cos(θ)+1cos(2θ)=12sin2(θ), (26)

and then

p˜k+1,1=cos(2k3)θ+cos(2k+3)θcos(θ)+2cos2kθp˜k1,12cos(2θ)p˜k,1, (27)

for k>0. Once we have found all the p˜k,1, we can proceed similarly with p˜k,2 and so on.

Fortunately, we can obtain a closed form for p˜k,t. From (20) we have that, for tN,

p˜k,t=n=NN+1pn,t·ei2knθ=n=ttttn2cos(nθ)2cos(θ)t1t|n|2N0·ei2knθ. (28)

This means that

p˜k,t=j=0ttjcos((2jt)θ)2cos(θ)t·e+i2k(2jt)θ=122cos(θ)tj=0ttje+i(2k+1)(2jt)θ+ei(2k1)(2jt)θ=12cos((2k+1)θ)cos(θ)t+12cos((2k1)θ)cos(θ)t. (29)

Note that, in particular, p˜0,t=1 and

p˜±1,t=12+12cos(3θ)cos(θ)t=12+1214sin2(θ)t, (30)

in concordance with the result found in (26). The point is that expression (29) satisfies relation (25), for any value of t and θ, and thus it is the general solution for p˜k,t.

By no means does this imply that pn,t can be expressed as in Equation (20) for t>N; we must invert (29) to obtain

pn,t=cos(nθ)2cos(θ)t=minmaxttn2(N+1)(1)1t|n|2N0, (31)

with

min=t+n2(N+1), (32)
max=tn2(N+1), (33)

and where · and · are the ceiling function and floor function, respectively.

Figure 3 shows three snapshots of the time evolution of pn,t for N=16. Note how, for both instances, the theoretical curve and the histogram converge to the dashed curve. This curve represents the quasi-steady-state probability function pneven,

pneven=2N+1cos2(nθ)1n2Z, (34)

to which the probability function tends. The reason for calling this a quasi-steady state is because the graph is bipartite: starting from the origin, the particle can be found in odd locations if and only if t is odd, and in even locations if and only if t is even. Therefore, Equation (34) is valid when t is even. Fortunately, the steady state when t (and n) is odd is just the same

pnodd=2N+1cos2(nθ)1n12Z, (35)

and, since these two scenarios have the same likelihood due to the alternation of even and odd values of t, one arrives at

pneq.=12pnodd+12pneven=1N+1cos2(nθ), (36)

the equilibrium distribution in the ergodic sense. The very existence of this steady-state and the expression itself can be deduced from (29). Let p˜k be

p˜klimtp˜k,t=limt12cos((2k+1)θ)cos(θ)t+12cos((2k1)θ)cos(θ)t=12δk,1+δk,0+12δk,1, (37)

where δk, is the Kronecker delta that returns 1 if k= and zero otherwise. The inversion of (37) leads to (36).

Figure 3.

Figure 3

The probability function pn,t. We depict the probability of finding the system at position n after: (a) t=40 steps; (b) t=80 steps; and (c) t=120 steps; if X0=0 and N=16. As the values of t are even quantities, only even values of n are shown. The solid curve corresponds to Equation (31), the red dashed curve to Equation (34), and histograms were obtained from 100,000 numerical simulations of the process, with the binning (here and hereafter) chosen to include only one attainable site in each category.

Let us consider now the counting-path approach. To this end, let us express Equation (31) in the following form

pn,t=cos(nθ)2cos(θ)t=tt(1)n2(N+1)(1)1t|n|2N0, (38)

with the understanding that

ab=0, (39)

if either b or ba are negative integers. The most noticeable change in this formula is the replacement n(1)n. This can be understood on the basis of mirroring arguments: For N<t<3(N+1), the number of paths beginning at 0 and ending at n touching or passing though N+1 is equal to the number of trajectories starting at 0 and reaching the point 2(N+1)n,

tt2(N+1)+n2=tt+n2(N+1)=ttn2+(N+1),

if t and n have the same parity. These paths must be subtracted from the total, as well as the trajectories beginning at 0 and ending at n touching or passing through N1,

tt+2(N+1)+n2=tt+n2+(N+1)=ttn2(N+1).

Therefore, when the starting point is the origin, the change of sign introduced by every refection can be dropped after a rearrangement of the terms.

This is no longer true if m0. In such a case

pn,t;m=cos(nθ)cos(mθ)2cos(θ)t=tt(1)n+m2(N+1)(1)1t|nm|2N0, (40)

that is, for t|mn| and sharing both magnitudes the same parity, one has

pn,t;m=cos(nθ)cos(mθ)2cos(θ)tCn,t;m[N,N], (41)

where the leading factor is just pmn,t, the product of transition probabilities of a path connecting sites m and n in t steps, and

Cn,t;m[L,M]=tt(1)nM+L2+(mM+L2)ML+22(1)1t|nm|2N0 (42)

is the number of paths stating at X0=m and ending at Xt=n, in such a way that one has that LXtM, 0tt. Note that the properties of binomials guarantee that factor (1) can be moved from the parenthesized term with the n to the one with the m after some reordering, as demanded by the “time reversal” symmetry of this magnitude,

Cn,t;m[L,M]=Cm,t;n[L,M]. (43)

In practical implementations of Formula (40), as in the confection of Figure 4, one can replace the limits in (40) with ±L,

Lt+|n|+|m|2(N+1). (44)

This is a good proxy since, at most, one must discard two terms in the sum. A more precise expression leads to a piece-wise definition of pn,t;m that is highly dependent on the particular values of N, n, m, and t, see Appendix A.

Figure 4.

Figure 4

The probability function pn,t;m. We depict the probability of finding the system at position n after: (a) t=10 steps; (b) t=150 steps; and (c) t=1000 steps; if m=8 and N=16. As the values of t are even quantities, only even values of n are shown. The solid curve corresponds to Equation (40), the red dashed curve to Equation (36), and histograms were obtained from 100,000 numerical simulations of the process.

The intricacy of Equation (40) discourages the search for a general expression for the expected value, E·, of the position

μt;mEXt|X0=m=n=mtm+tn·pn,t;m, (45)

although some approximations can be considered. For tN|m|, one has

μt;mk=0ttkm2k+tcos(mθ)cos((m2k+t)θ)2cos(θ)t=mtan(θ)tan(mθ)·t, (46)

the process shows reversion to the origin, and ultimately

limtμt;m=0, (47)

from the existence of the equilibrium probability (40). From this same expression, one can conclude that the time evolution of the standard deviation of the process, σt;m,

σt;m2EXt2|X0=mμt;m2, (48)

will attain a limiting value as well,

limtσt;m2=n=NNn2·1N+1cos2(nθ)=162N2+4N+312sin2(θ), (49)

while, for small values of t, one has

σt;m2k=0ttk(m+2kt)2cos(mθ)cos((m+2kt)θ)2cos(θ)tmtan(θ)tan(mθ)t2=1cos2(θ)ttan2(θ)t2tan2(θ)tan2(mθ)t2=1cos2(θ)ttan2(θ)cos2(mθ)t2. (50)

We can observe in Figure 5 the good agreement between the numerical simulations of the process and the different expressions found: In Figure 5a, we observe the slow return of the mean of the process to the origin, whereas in Figure 5b, we find how the variance of the process exhibits a sigmoid-like shape, tending toward the value dictated by the equilibrium probability. As we will see in the next section, the exponential character of the time-evolution of the process is behind these features.

Figure 5.

Figure 5

Expected values of pn,t;m. In (a), we consider the evolution of μt;m for m=8. The solid black curve is the exact evolution predicted by pn,t;m, Equation (45), the blue dotted curve depicts the linear behavior predicted by Equation (46), and the red dashed line coincides with the origin. In (b), we show the bounded growth σt;m2, for m=8. Again, the solid black curve represents the exact Formula (48), the blue dotted curve corresponds to approximate expression (50), while the red dashed line stems from Equation (49). In both cases, N=16, and the solid circles were obtained from 100,000 numerical simulations of the process.

5. First- and Last-Time Events

Equation (40) can be easily generalized to pn,t;m[L,M],

pn,t;m[L,M]PXt=nX0=m,LXtM,0tt, (51)

the probability that the process Xt goes form X0=m to Xt=n, in such a way that one has that LXtM, 0tt, due to the factorization of this probability as the likelihood of a single path connecting points m and n in t steps (which is always the same irrespective of the trajectory) times the amount of those trajectories that do not exceed the chosen limits, Cn,t;m[L,M], see Equation (42),

pn,t;m[L,M]=cos(nθ)cos(mθ)2cos(θ)tCn,t;m[L,M]. (52)

This quantity can be used to obtain the survival probability, St;m[L,M], the probability that, at time t, the process starting from X0=m has never left the interval [L,M],

St;m[L,M]=n=LMpn,t;m[L,M]. (53)

Please, note that the only restriction in the parameter set affecting the survival probability is that we denoted by L the lower limit of the interval and by M its higher limit, LM. Thus, in this case, St;m[L,M] is well defined having t and m with either the same parity or not.

Survival probabilities are commonly used to compute the probability that the first-visit of the process to site n, starting from site m, has taken place at time t,

ft,n;mPTn;m=t, (54)

where the random variable Tn;m is defined as [3]

Tn;mmint>0:Xt=n|X0=m, (55)

through the relationship

ft,n;m=St1;m[N,n1]St;m[N,n1], (56)

for Nm<nN, and the relationship

ft,n;m=St1;m[n+1,N]St;m[n+1,N], (57)

for Nn<mN. In the present case, these expressions are very intricate to be used in practice due to the abundance of summations, and the following alternative procedure leads to more compact expressions: Consider, in the first place, a configuration that satisfies Nm<nN, then the only way of reaching n at time t for the first time, is being at n1 by t1, without having surpassed this point previously, and a final transition n1n,

ft,n;m=pn1,t1;m[N,n1]×pn1n=cos(nθ)cos(mθ)2cos(θ)tCn1,t1;m[N,n1] (58)

where the typical restrictions to values and parities of n, m, and t considered throughout the text do apply here. If one has that Nn<mN, then

ft,n;m=pn+1,t1;m[n+1,N]×pn+1n=cos(nθ)cos(mθ)2cos(θ)tCn+1,t1;m[n+1,N]. (59)

Figure 6 shows three instances of ft,n;m, for different choices of n and m.

Figure 6.

Figure 6

Probability function ft,n;m. We depict the probability of that the first visit of the process to site n starting from m occurs after t steps: (a) n=4 and m=0; (b) n=8 and m=0; and (c) n=0 and m=8. In all cases N=16. As nm is even, only even values of t are shown. The solid curve corresponds to Equation (58) or (59), and histograms were obtained from 100,000 numerical simulations of the process.

In fact, this approach paves the way for the computation of f2t,n;n, the probability that the process returns for the first time to a given point n after 2t steps, f2t,n;n,

f2t,n;n=pnn1×pn1,2t2;n1[N,n1]×pn1n+pnn+1×pn+1,2t2;n+1[n+1,N]×pn+1n=12cos(θ)2tCn1,2t2;n1[N,n1]+Cn+1,2t2;n+1[n+1,N]. (60)

When tN|n|, the first-return probability does not depend on n and satisfies a well-known identity for regular random walks,

f2t,n;n=12t112cos(θ)2t2tt=12t1pn,2t;n, (61)

but this formula ceases to be valid as t grows. On the one side, as we have already seen, pn,2t;n tends to a time-independent function of n, see Equations (34) and (35),

pn,2t;n2N+1cos2(nθ),

and, on the other side, f2t,n;n decays exponentially with t, as we will prove next. To this end, we have to analyze Cn,t;m[L,M] for tML. Indeed, from very existence of the steady-state distribution and using symmetry arguments, one concludes that we can approximate this magnitude by the following expression:

Cn,t;m[L,M]4ML+2cosπ22nMLML+2cosπ22mMLML+22cosπML+2t. (62)

According to Equation (60), we need to evaluate

Cn1,t;n1[N,n1]4N+n+1sin2πN+n+12cosπN+n+1t, (63)

and

Cn+1,t;n+1[n+1,N]4Nn+1sin2πNn+12cosπNn+1t, (64)

to assess the behavior of f2t,n;n for large values of t. If n=0, Equations (63) and (64) are coincident, and we arrive to the following compact expression:

f2t,0;02N+1tan22θcos2θcosθ2t. (65)

In general, the most stringent term is the one for which N±n+1 is smaller, i.e.,

f2t,n;n1N|n|+1tan2πN|n|+1cosπN|n|+1cosθt. (66)

In Figure 7, we can observe how the approximate formulas are still valid for values of t well apart from those used in their respective derivations. In Figure 7a, there is an effective crossover between both limiting behaviors that takes place at t40, beyond the restriction tN|n|, as n=0 and N=16. This means that, for any value of t, one has a surrogate, compact expression for f2t,0;0. In Figure 7b, we find that (61) is still valid outside the region where tN|n|, n=8 now; however, there is no intersection between the expressions (61) and (66). This is due to the presence of the second, transitory exponential regime that dominates the evolution for values of t in the range 20t40.

Figure 7.

Figure 7

The probability function f2t,n;n. We depict the probability of that the first return of the process to site n occurs after 2t steps: (a) n=0; (b) n=8. In both cases, N=16. The solid curve corresponds to Equation (60), the blue dotted curve depicts Equation (61), and the red dashed lines correspond to Equations (65) and (66), respectively. Histograms were obtained from 100,000 numerical simulations of the process.

Consider now g2t,n;2T,n, the probability that the last return of process to the initial point n after 2T steps takes place at time 2t. This probability can be obtained from the likelihood of being in the initial spot at time 2t multiplied by the probability of staying either above of below this value for the remaining period,

g2t,n;2T,n=pn,2t;npnn1×S2(Tt)1;n1[N,n1]+pnn+1×S2(Tt)1;n+1[n+1,N]. (67)

with

S2(Tt)1;n1[N,n1]=m=Nn1pm,2(Tt)1;n1[N,n1]=1cos((n1)θ)2cos(θ)2(Tt)1m=Nn1cos(mθ)Cm,2(Tt)1;n1[N,n1],

and similarly

S2(Tt)1;n+1[n+1,N]=m=n+1Npm,2(Tt)1;n1[n+1,N]=1cos((n+1)θ)2cos(θ)2(Tt)1m=n+1Ncos(mθ)Cm,2(Tt)1;n+1[n+1,N];

with the understanding that the whole term inside the parentheses reduces to one if t=T.

In this case, due to the nature of Equation (67), to obtain an approximate formula, one must use contemporarily small and large t approximations. Let us focus exclusively on the case n=0 to reduce the mathematical complexity, and consider in the first place that tNT. For tN, we can express the leading factor as

p0,2t;0=12cos(θ)2t2tt,

whereas for TtN, we have

Cm,2(Tt)1;1[1,N]=Cm,2(Tt)1;1[N,1]4N+1sin2θsin2mθ2sin2θ2(Tt)1,

for m{2,4,,2N/2}. This symmetry leads to

g2t,n;2T,n8N+12tt2cos(2θ)2(Tt)12cos(θ)2Tsin(2θ)k=1N/2cos(2kθ)sin(4kθ)=2N+12tt2cos(2θ)2(Tt)2cos(θ)2Tsin2(2θ)sin(θ)sin(3θ), (68)

where we have further assumed that N is an even magnitude to avoid the floor function. The reverse situation corresponds to tNTt. Here, we have that the task is simpler if we consider the following alternative expression for g2t,n;2T,n,

g2t,n;2T,n=pn,2t;nt=Tt+1f2t,n;n, (69)

that is, the probability of being in the initial site at time 2t multiplied by the probability that the next return to this location takes longer than the remaining period. Indeed, to perform the desired analysis, it is better to express (69) as

g2t,n;2T,n=pn,2t;n1t=1Ttf2t,n;n, (70)

since we already know that

f2t,n;n=12t112cos(θ)2t2tt,

for tN. Then, if we combine this expression with

p0,2t;02N+1,

tN, we obtain

g2t,0;2T,02N+11t=1Tt12t112cos(θ)2t2tt. (71)

As TtN, the sum contains a reduced number of terms, and it can be formally expressed in terms of the Gaussian hypergeometric function (Note in particular that the sum does not converge for Tt). In Figure 8a, we can observe the goodness of both approximate formulas which, one more time, intersect at t40.

Figure 8.

Figure 8

The probability function g2t,n;2T,n. We depict the probability that the last return of the process to site n after 2T steps occur at time 2t: (a) n=0 and (b) n=8. In both cases, T=75 and N=16. The solid curve corresponds to Equation (67) in both panels. In panel (a), the blue dotted curve shows Equation (68), and the red dashed line corresponds to the approximate Equation (71). In panel (b), the green dotted line follows the heuristic Equation (72). Histograms were obtained from 100,000 numerical simulations of the process.

Equation (71) can be easily extended to encompass arbitrary values of n,

g2t,n;2T,n=2N+1cos2(nθ)1t=1Tt12t112cos(θ)2t2tt,

but we must be aware that T must be long enough to allow the system to reach the steady state, which is not the case if N=16 and T=75, cf. Figure 4b. However, for these intermediate situations, heuristic expressions with a clear inspiration in the arcsin law of regular random walks like

g2t,n;2T,n14(Tt)+1pn,2t;n (72)

may become useful, see Figure 8b.

6. Conclusions and Future Work

The random walks with invariant loop probabilities constitute a family of Markov processes which, having site-dependent transition probabilities, can be addressed using simple analytical tools. This new class of stochastic processes splits in two different subclasses delimited by the simple random walk in one dimension; however, despite that, the complete family can be obtained by resorting to a single geometrical argument—the stereographic projection of an underlying metric space.

The case in which this associated metric space leads to hyperbolic probabilities was analyzed in depth in a previous work. Here, we concentrated our efforts in the complementary case, the stereographic projection of a circle into the real line that defines a set of elliptic probabilities. The formalism induces the automatic emergence of two ending, reflexing nodes in the ring that surrounds a forbidden site with a regular disposition of the rest of the nodes.

We derived the probability function of the process in the first place, a function that tends to a steady-state distribution. After that, we considered the statistical properties related to extreme events: the waiting time until the first visit to a target if the process is presently at some given location, or the probability of having witnessed the last visit to a target if the observation time is finite.

We leave, for future work, the search for physical implementations of the underlying metric space that can account for the transformation of a regular layout into an inhomogeneous medium whose properties can be satisfactorily captured by one of these stereographic random walks.

Another interesting extension of this model, also left for future publications, consists in the concatenation of finite chains (of different lengths) by their ending points, a setup that may describe a series of basins of attraction. In this case, the final nodes must be partially reflexing and partially transmitting sites, which will break the exact loop invariance assumed here and have a possible impact on the ergodicity of the system.

Abbreviations

The following abbreviations are used in this manuscript:

UB Universitat de Barcelona
UBICS Universitat de Barcelona Institute of Complex Systems
RW Random walk
DFT Discrete Fourier Transform
AGAUR Agència de Gestió d’Ajuts Universitaris i de Recerca
AEI Agencia Estatal de Investigación
FEDER Fondo Europeo de Desarrollo Regional
UE Unión Europea

Appendix A

Assume that N, n, m, and t are even quantities, and that 2mN2,

pn,t;m=cos(nθ)cos(mθ)2cos(θ)tCn,t;m[N,N]. (A1)

Then, for 0tNm one has

Cn,t;m[N,N]=0,Nnmt2,ttn+m2,mtnm+t,0,m+t+2nN,

where the last condition cannot be satisfied for t=Nm. For Nm+2tN+m, one has

Cn,t;m[N,N]=0,Nnmt2,ttn+m2,mtn2Nmt,ttn+m2tt+n+m2(N+1),2(N+1)mtnN,

where the first condition cannot be satisfied for t=N+m. For N+m+2t2N, one has

Cn,t;m[N,N]=ttn+m2tt+n+m2+(N+1),Nntm2(N+1),ttn+m2,tm2Nn2Nmt,ttn+m2tt+n+m2(N+1),2(N+1)mtnN.

For 2(N+1)t3Nm,

Cn,t;m[N,N]=ttn+m2tt+n+m2+(N+1),Nn2Nmt,ttn+m2tt+n+m2+(N+1)tt+n+m2(N+1),2(N+1)mtntm2(N+1),ttn+m2tt+n+m2(N+1),tm2NnN.

For instance, the example shown in panel (a) of Figure 4 corresponds to the case N=16, t=10, and m=8. Therefore, one has

pn,10;8=0,16n4,cos(nθ)cos(8θ)2cos(θ)101018n2,2n14,cos(16θ)cos(8θ)2cos(θ)10101100,n=16,

with θ=π/34 and n even. Elementary calculus proves that

n=1616pn,10;8=1cos(8θ)2cos(θ)10k=0810kcos(2(k1)θ)+9cos(16θ)=11cos(8θ)2cos(θ)1010cos(16θ)+cos(18θ)9cos(16θ)=1,

since cos(18θ)=cos(16θ).

Funding

This research was funded by AGAUR, grant number 2017SGR1064, by AEI, grant number RED2018-102518-T, and by AEI/FEDER, UE, grant number PID2019-106811GB-C33.

Data Availability Statement

The data generated in this study are available on request from the author.

Conflicts of Interest

The author declares no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Weiss G.H. Aspects and Applications of the Random Walk. Springer; North Holland, NY, USA: 1994. [Google Scholar]
  • 2.Van Kampen N.G. Stochastic Processes in Physics and Chemistry, Revised and Enlarged Edition. North-Holland; Amsterdam, The Netherlands: 1992. [Google Scholar]
  • 3.Redner S. A Guide to First-Passage Processes. Cambridge University Press; Cambridge, UK: 2001. [Google Scholar]
  • 4.Feller W. An Introduction to Probability Theory and Its Applications. Volume I John Wiley and Sons; New York, NY, USA: 1968. [Google Scholar]
  • 5.Barkai E. Aging in Subdiffusion Generated by a Deterministic Dynamical System. Phys. Rev. Lett. 2003;90:104101. doi: 10.1103/PhysRevLett.90.104101. [DOI] [PubMed] [Google Scholar]
  • 6.Metzler R. Non-homogeneous random walks, generalised master equations, fractional Fokker-Planck equations, and the generalised Kramers-Moyal expansion. Eur. Phys. J. B. 2001;19:249–258. doi: 10.1007/s100510170333. [DOI] [Google Scholar]
  • 7.Menshikov M., Popov S., Wade A. Non-Homogeneous Random Walks: Lyapunov Function Methods for Near-Critical Stochastic Systems. Cambridge University Press; Cambridge, UK: 2017. [Google Scholar]
  • 8.Montero M. Random walks with hyperbolic probabilities. J. Stat. Mech. Theory Exp. 2020;2020:013203. doi: 10.1088/1742-5468/ab535b. [DOI] [Google Scholar]
  • 9.Serrano M.Á., Krioukov D., Boguñá M. Self-similarity of complex networks and hidden metric spaces. Phys. Rev. Lett. 2008;100:078701. doi: 10.1103/PhysRevLett.100.078701. [DOI] [PubMed] [Google Scholar]
  • 10.Boguñá M., Papadopoulos F., Krioukov D. Sustaining the Internet with Hyperbolic Mapping. Nat. Commun. 2010;1:62. doi: 10.1038/ncomms1063. [DOI] [PubMed] [Google Scholar]
  • 11.Krioukov D., Papadopoulos F., Kitsak M., Vahdat A., Boguñá M. Hyperbolic geometry of complex networks. Phys. Rev. E. 2010;82:036106. doi: 10.1103/PhysRevE.82.036106. [DOI] [PubMed] [Google Scholar]
  • 12.Alanis-Lobato G., Mier P., Andrade-Navarro M.A. Efficient embedding of complex networks to hyperbolic space via their Laplacian. Sci. Rep. 2016;6:30108. doi: 10.1038/srep30108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Allard A., Serrano M.Á., García-Pérez G., Boguñá M. The geometric nature of weights in real complex networks. Nat. Commun. 2017;8:14103. doi: 10.1038/ncomms14103. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kleineberg K.K. Metric clusters in evolutionary games on scale-free networks. Nat. Commun. 2018;8:1888. doi: 10.1038/s41467-017-02078-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.García-Pérez G., Boguñá M., Serrano M.Á. Multiscale unfolding of real networks by geometric renormalization. Nat. Phys. 2018;14:583–589. doi: 10.1038/s41567-018-0072-5. [DOI] [Google Scholar]
  • 16.Comtet A., Monthus C. Diffusion in a one-dimensional random medium and hyperbolic Brownian motion. J. Phys. A Math. Gen. 1996;29:1331–1345. doi: 10.1088/0305-4470/29/7/006. [DOI] [Google Scholar]
  • 17.Monthus C., Texier C. Random walk on the Bethe lattice and hyperbolic Brownian motion. J. Phys. A Math. Gen. 1996;29:2399. doi: 10.1088/0305-4470/29/10/019. [DOI] [Google Scholar]
  • 18.Comtet A., Monthus C., Yor M. Exponential functionals of Brownian motion and disordered systems. J. Appl. Prob. 1998;35:255–271. doi: 10.1239/jap/1032192845. [DOI] [Google Scholar]
  • 19.Metzler R., Jeon J.-H., Cherstvya A.G., Barkai E. Anomalous diffusion models and their properties: Non-stationarity, non-ergodicity, and ageing at the centenary of single particle tracking. Phys. Chem. Chem. Phys. 2014;16:24128. doi: 10.1039/C4CP03465A. [DOI] [PubMed] [Google Scholar]
  • 20.Havlin S., Ben-Avraham D. Diffusion in disordered media. Adv. Phys. 2002;51:187–292. doi: 10.1080/00018730110116353. [DOI] [Google Scholar]
  • 21.Comolli A., Dentz M. Impact of diffusive motion on anomalous dispersion in structured disordered media: From correlated Lévy flights to continuous time random walks. Phys. Rev. E. 2018;97:052143. doi: 10.1103/PhysRevE.97.052146. [DOI] [PubMed] [Google Scholar]
  • 22.Derrida B., Pomeau Y. Classical Diffusion on a Random Chain. Phys. Rev. Lett. 1982;48:627–630. doi: 10.1103/PhysRevLett.48.627. [DOI] [Google Scholar]
  • 23.Monthus C. Diffusive transport in a one-dimensional disordered potential involving correlations. Phys. Rev. E. 1995;52:2569–2573. doi: 10.1103/PhysRevE.52.2569. [DOI] [PubMed] [Google Scholar]
  • 24.Monthus C. Random Walks and Polymers in the Presence of Quenched Disorder. Lett. Math. Phys. 2006;78:207–233. doi: 10.1007/s11005-006-0122-2. [DOI] [Google Scholar]
  • 25.Sadjadi Z., Miri M.F. Persistent random walk on a one-dimensional lattice with random asymmetric transmittances. Phys. Rev. E. 2008;78:061114. doi: 10.1103/PhysRevE.78.061114. [DOI] [PubMed] [Google Scholar]
  • 26.Sheinman M., Bénichou O., Voituriez R., Kafri Y. First-passage time distribution for a random walker on a random forcing energy landscape. J. Stat. Mech. Theory Exp. 2010;2010:P09005. doi: 10.1088/1742-5468/2010/09/P09005. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data generated in this study are available on request from the author.


Articles from Entropy are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES