Skip to main content
Advanced Science logoLink to Advanced Science
. 2020 Nov 7;7(24):2001126. doi: 10.1002/advs.202001126

Generalized Solutions of Parrondo's Games

Jin Ming Koh 1,2, Kang Hao Cheong 1,3,
PMCID: PMC7740106  PMID: 33344113

Abstract

In game theory, Parrondo's paradox describes the possibility of achieving winning outcomes by alternating between losing strategies. The framework had been conceptualized from a physical phenomenon termed flashing Brownian ratchets, but has since been useful in understanding a broad range of phenomena in the physical and life sciences, including the behavior of ecological systems and evolutionary trends. A minimal representation of the paradox is that of a pair of games played in random order; unfortunately, closed‐form solutions general in all parameters remain elusive. Here, we present explicit solutions for capital statistics and outcome conditions for a generalized game pair. The methodology is general and can be applied to the development of analytical methods across ratchet‐type models, and of Parrondo's paradox in general, which have wide‐ranging applications across physical and biological systems.

Keywords: analytical methods, Brownian ratchets, game theory, generalized solutions, noise, non‐linear dynamics, Parrondo's paradox


The game‐theoretic Parrondo's paradox refers to the attainment of winning outcomes by alternating between losing strategies. Closed‐form solutions are presented for capital statistics in a stochastically mixed game pair with drawing outcomes, and in a further generalization with independently tunable game branches; the solutions accommodate arbitrary symmetry modulus M. The approach can be adapted to other ratchet‐type models.

graphic file with name ADVS-7-2001126-g004.jpg

1. Introduction

Particles can exhibit bulk drift when exposed to asymmetric periodic potentials, even when the space‐averaged force is zero or in an opposing direction[ 1 , 2 , 3 ]; underlying the unexpected motion is an agitation‐ratcheting mechanism, formed from alternating diffusive and localizing temporal phases as the potential oscillates. This has accordingly been termed the flashing Brownian ratchet, in similarity to the Brownian ratchet‐and‐pawl system of Smoluchowski and Feynman,[ 4 , 5 ] and has been applied successfully in the control of particle ensembles.[ 6 ] An abstraction of the phenomenon is Parrondo's paradox, in which switching between two game‐theoretic losing strategies in a random or deterministic order can result in winning outcomes.[ 7 ]

Molecular motors and enzyme transport had been analyzed through Brownian ratchet models[ 8 , 9 , 10 ]; more recently, the broader class of Parrondo's paradox has been used to describe a large range of phenomena, including stability in mixed chaotic systems,[ 11 , 12 ] unexpected drifts in granular flow[ 13 ] and switched diffusion processes,[ 14 ] and entropic behaviour in information thermodynamics.[ 15 , 16 ] Quantum paradoxical systems have also been studied, some suggesting implications on quantum information processing,[ 17 ] and algorithms exploiting the paradox have been devised for engineering optimization.[ 18 , 19 ] In biophysics, evolutionary processes,[ 20 , 21 , 22 , 23 , 24 , 25 ] population biology,[ 26 ] ecological dynamics,[ 27 , 28 , 29 ] cellular machinery,[ 30 , 31 , 32 ] and social behavior[ 33 , 34 , 35 ] have all been linked to the paradox, and a degree of universality across scales is suspected.[ 36 ] The seminal results in genetics include the possibility of proliferation and fixation of lower‐fitness autosomal alleles amidst antagonistic selection and epistasis,[ 37 ] and selection for random phase variation[ 23 , 38 ] and phenotypic switching[ 24 , 25 ] in microorganisms, despite the strategy being likely locally maladaptive; in ecological systems, environmental fluctuations have been shown to enable the persistence of rare species in invaded habitats.[ 39 ] The framework of Parrondo's games has even seen applications in the modeling and control of cancer tumours, to varying degrees of approximation.[ 40 , 41 , 42 ]

Minimally, the classical Parrondo's paradox can be represented by a pair of games[ 43 ]—the first a coin‐flipping game, analogous to a linear potential supporting diffusive spread in the flashing Brownian ratchet, and the second having two branches, one played when the capital is a multiple of a modulus M and the other played otherwise, analogous to an asymmetric periodic potential supporting localization of particle density. Stochastically mixing the games can produce winning outcomes (positive capital drift) despite both being losing individually. Despite the significant research interest, current descriptions of the properties of the paradox is incomplete.[ 17 , 36 , 43 , 44 ] Perturbative and asymptotic analyses have been presented,[ 45 , 46 ] alongside simulational studies,[ 47 ] but explicit solutions for capital statistics for arbitrary modulus M have not been reported; known solutions for natural generalizations of the games also remain sparse.

In this paper, we present explicit closed‐form solutions for capital mean and variance in Parrondo's games generalized to include drawing outcomes; solutions for a further generalization into M‐branch games are also derived, for arbitrary probability configuration and M. The boundaries of winning, drawing, and losing parameter spaces are similarly found in closed‐form. These results are exact in steady‐state, and accurate to O(1/n) for n rounds in transient conditions; extensive verification against simulations is provided. This work essentially gives a complete solution to single‐agent capital‐dependent Parrondo's games, extensible to the multitude of variants modelable on discrete‐time Markov chains.

2. Generalized Game Pair

A generalized capital‐dependent Parrondo's game structure with drawing outcomes is first considered. In game A, winning, drawing, and losing outcomes, respectively, occur with probability p, r, and q=1pr in each round; in game B, they respectively occur with probability p1, r1, and q1=1p1r1 when capital c is divisible by M3 and p2, r2, and q2=1p2r2 otherwise. Stochastic mixing is controlled by parameter γ, reflecting probabilities γ and 1γ of playing game A and B, respectively, at each round. Each winning and losing outcome results in a unit capital increment (ηp=1) and decrement (ηq=1), respectively, and each draw results in unchanged capital (ηr=0). Lose–win ratios are ϕ=q/p, ϕ1=q1/p1, and ϕ2=q2/p2.

2.1. Conditions

The conditions for winning, fair, and losing outcomes can be deduced by considering the probability of reaching zero capital. With mixed transition probabilities si=γs+(1γ)si and mixed lose–win ratios ϕi=qi/pi for s{p,r,q} and i{1,2}, the conditions are remarkably simple

winningifφ<1fairifφ=1losingifφ>1 (1)

where φ=φR=ϕ1ϕ2M1 for stochastically mixed games. For pure game A, γ=1, reducing si=s, and φA=ϕ; whereas for pure game B, γ=0, reducing si=si, and φB=ϕ1ϕ2M1. A derivation of this result is given in Appendix A1.

2.2. Capital Statistics

We now use an explicit Markov chain formulation, seeking analytical solutions for expected capital μ(n) and capital variance σ2(n) at round n. Capital states {S1,S2,,SM} satisfying c(i1)modM for state Si are considered. The distribution between these states ω=[ω1ω2ωM] at a game round can be found from that of the previous ω1 as ω=ω1H where H is the transition matrix, defined by

Hij=p2δ1iifj(imodM)+1q2δ1iifi(jmodM)+1r2δ1iifi=j0otherwise (2)

where δij is the Kronecker delta. The corresponding payoff matrix W is of similar form as H but with siηs for s{p,r,q} and i{1,2}, and Q=HW is defined, where denotes the Hadamard product. The stationary distribution is characterized by the eigenvector equation ω=ωH, which can be converted to a coupled recurrence system and solved with a normalization constraint (see Appendix A2) to yield the solution

ωm=p2/p1δ1mαϕ2m+βα=p2q2p2q1p1q2ϕ2/λβ=p2q2p1ϕ2Mq2p2q1/λλ=p2q2ϕ2M1p2p1q2q1Mp2q2p2q1p1q2ϕ2M (3)

for m[1,M]. The average outcome probabilities p¯, r¯, and q¯, are

s¯=ω1s1+(1ω1)s2 (4)

for s{p,r,q}. The steady‐state per‐round change in expected capital Δμ and the capital mean μ(n) are therefore

Δμ=E[η]=p¯q¯ (5a)
μ(n)=nΔμ (5b)

Equivalently, Δμ=ωQ where is a column vector of ones; an alternative derivation via the capital distribution is given in Appendix A3. Next, obtaining the capital variance σ2(n) necessitates computing the fundamental matrix of the Markov chain,[ 45 , 48 ] Z=I+n=1(HnΩ)=(IH+Ω)1, where Ω is the limiting matrix comprising ω as rows and identity Z(IH)=IΩ applies. A similar solving method can be used; the derivation and full solution for Z is detailed in Appendix A4. The steady‐state per‐round change in capital variance Δσ2 and capital variance σ2(n) are

Δσ2=E[η2]E[η]2+2m=1cov(η,ηm)=p¯+q¯p¯q¯2+2d (6a)
σ2(n)=nΔσ2 (6b)

where cov(η,ηm) is the covariance in capital change between m game rounds and d=ωQ(ZΩ)Q. This yields

d=p1q1p2q2i=1Mp2δi2ωiq2δiMωi+Zi1ω1 (7)

where we denote i±=1+(i1±1)modM as the modular successor and predecessor of index i, and ωm is given in Equation (3). Substituting d into Equation (6) completes the closed‐form solution for σ2(n). In summary, we have analytical solutions for parameter space boundaries in Equation (1), and capital statistics μ(n) and σ2(n) in Equations (5) and (6). We note μ(n) and σ2(n) are constructed from exact steady‐state Δμ and Δσ2, and therefore neglect initial transients in the game; accuracy is O(1/n) when transients are present.

2.3. Validation

Monte Carlo simulations of the game structure were run to validate these analytical results. A comparison of Δμ and Δσ2 from Equations (5) and (6) against simulation results for differing M is presented in Figure 1. The strong Parrondo effect arises when ΔμR>0 but ΔμA<0 and ΔμB<0, and the weak effect arises so long as ΔμR>ΔμA and ΔμR>ΔμB. Phase plots of paradoxical regions and their boundaries are shown in Figure 1, and an example of μ(n) and σ2(n) exhibiting the strong paradox is shown in Figure  2a. Lastly, fair boundaries (Δμ=0) as predicted by Equation (1) are shown in Figure 2b,c, alongside simulation results. Excellent agreement across all theoretical and simulation results is observed. We provide implementation details of the simulation package in Appendix C.

Figure 1.

Figure 1

Comparison of Δμ and Δσ2 from theory and simulations across p1p2 parameter space, for differing M. Relative error between theory and simulation is <0.1% throughout. Phase diagrams are also shown; background colors represent theory and dots represent simulation. Dotted lines denote theoretical boundaries, for ΔμR=ΔμB (black), ΔμR=ΔμA (gray), ΔμR=0 (red), and ΔμB=0 (blue). Parameters are p=0.39, r=r1=r2=0.2, γ=0.5.

Figure 2.

Figure 2

a) Plot of μ(n) and σ2(n) comparing theory (lines) and simulation (circles), realizing the strong Parrondo effect. Parameters are p=0.39, p1=0.02, p2=0.6, r=r1=r2=0.2, and γ=0.5. b,c) Δμ=0 fair isoclines in ϕ1ϕ2 parameter space for differing M and γ, comparing theory (lines) and simulation (circles). Parameters are p1=0.35 and r=r1=r2=0.1, with M=4 for (b) and γ=0.5 for (c).

3. Generalized M‐Branch Game Pair

A further generalization is considered, in which game B comprises M3 branches {B1,,BM}, with branch Bi played when c(i1)modM. Each Bi is associated with winning, drawing, and losing probabilities pi, ri, and qi=1piri, respectively, and lose‐win ratio ϕi=qi/pi. Game A remains unchanged. As before, ηp=1, ηq=1, and ηr=0.

3.1. Conditions

Again, winning, fair, and losing conditions may first be derived. M capital states {S1,S2,,SM} satisfying cmodM=i1 for state Si are considered. By analyzing the probability of winning through M consecutive states, a simple condition of identical form can be deduced

winningifφ<1fairifφ=1losingifφ>1 (8)

where φ=φR=i=1Mϕi for stochastically mixed games and ϕi=qi/pi are the mixed lose‐win ratios. For pure game A, γ=1, so a reduced φA=ϕ is obtained, consistent with Equation (1) for the two‐branch structure; for pure game B, γ=0, and φB=i=1Mϕi is obtained. It is noted, furthermore, that under the conditions si=s2 for s{p,r,q} and i[2,M], the two‐branch results φR=ϕ1ϕ2M1 and φB=ϕ1ϕ2M1 are indeed recovered. The derivation of this result is detailed in Appendix B1.

3.2. Capital Statistics

Now we seek solutions for μ(n) and σ2(n). The transition matrix H is generalized to

Hij=piifj(imodM)+1qiifi(jmodM)+1riifi=j0otherwise (9)

The payoff matrix W can again be obtained from H with siηs for s{p,r,q} and i{1,2}, and likewise Q=HW. The eigenvector equation ω=ωH characterizing the stationary distribution between states ω=[ω1ω2ωM] can likewise be converted to a coupled recurrence system, but the recurrence now involves non‐constant coefficients, so the usual method of characteristic polynomials cannot be used. Instead, a tracking method can be used on the recursion tree to yield the solution

ωm=Fm1+ΛGm1+δ1m1+i=2MFi1+Λi=2MGi1Λ=p1+q1pMFM1pMGM1+q2 (10)

for m[1,M], and where counting functions

3.2. (11a)
πm(k)=i=1|k|δ1kipmσi(k)+qmσi(k)qmσi(k)+1δ2kipmσi(k)qmσi(k)+2, (11b)

and ξd(m) is the non‐negative solution set to the Diophantine equation m(n1+2n2)=d, parametrizable as {(m2td,t):tZ,0t(md)/2}, K(n1,n2) comprises all order permutations of n1 ones and n2 twos, and accumulator σi(k)=j=1ikj. The derivation of this solution is detailed in Appendix B2.

The average outcome probabilities are

s¯=m=1Mωmsm (12)

for s{p,r,q}. Substituting p¯ and q¯ into Equation (5) yields Δμ and μ(n) for this generalized M‐branch structure. Obtaining σ2(n) likewise necessitates computing the fundamental matrix Z. A similar procedure as that for the two‐branch structure can be used, but again, as the recurrence is non‐constant, a tracking method has to be employed. The derivation and full solution for Z is given in Appendix B3. Expanding and simplifying d=ωQ(ZΩ)Q gives

d=i=1Mj=1Mpiωiqi+ωi+Zijωjpjqj (13)

Substituting d into Equation (6) completes the closed‐form solution for σ2(n). In summary, we have closed‐form solutions for parameter space boundaries in Equation (8), and capital statistics μ(n) and σ2(n) in Equations (5), (6), (12), and (13). Again, since μ(n) and σ2(n) are constructed from exact steady‐state Δμ and Δσ2 and neglect transients, an accuracy of O(1/n) is expected.

3.3. Validation

Monte Carlo simulations were likewise run to validate these theoretical results. Contour plots of Δμ and Δσ2 as computed from Equations (12) and (13) across pi parameter space for M=4 are illustrated in Figure 3a, for which simulation results match to excellent accuracy. A comparison of Δμ and Δσ2 from theory and simulations across pγ parameter space is also given in Figure 3b. The theoretical capital statistics and phase boundaries match simulations extremely well. Implementation details of the simulations are provided in Appendix C.

Figure 3.

Figure 3

a) Theoretical results on Δμ and Δσ2 across pi parameter space for M=4. The full parameter space is 4D and cannot be directly illustrated; slices across pip2p3 space are shown, for two values of p4. To preserve visual clarity, simulation results are not plotted, but relative error is <0.1% throughout. Parameters are p=0.39, r=ri=0.2 for i[1,4], and γ=0.5. b) Δμ and Δσ2 from theory and simulations across pγ parameter space, and phase plot, where background colors represent theory and dots represent simulation. Dotted lines denote theoretical boundaries, for ΔμR=ΔμB (black), ΔμR=ΔμA (gray), ΔμR=0 (red), and ΔμA=0 (blue). Parameters are r=ri=0.2, p1=0.02, and pi=0.5 for i[2,6].

4. General Outlook

This paper has presented much‐sought explicit closed‐form solutions for capital statistics and parameter space boundaries for a family of generalized Parrondo's games, of which the canonical game pair[ 7 ] is a special case. The results are exact in steady‐state conditions, and of O(1/n) accuracy when initial transients are present; the effect of transients is dependent on initial conditions and game configuration, and will manifest as a small offset in capital statistics against steady‐state predictions. Importantly, the solutions accommodate arbitrary modulus M and probability configurations; this work hence reports a fully general closed‐form solution for single‐agent capital‐dependent games. In comparison to usual Markov‐chain propagation calculations in predicting capital statistics, these solutions enable computational cost improvements in the treatment of related models (see Appendix D).

Recent developments in physics of living systems[ 20 , 21 , 36 ] and noise‐induced phenomena[ 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 ] have renewed interest in stochastic ratchet‐type mechanisms and the broader Parrondo framework—the methodology developed here is general to the multitude of Parrondo‐type model variants, so long as modelable as discrete‐time Markov chains (of arbitrary order), and can enable a paradigm shift from the current reliance on numerical simulations toward analytical methods. In particular, the theoretical treatment of ratcheting eco‐evolutionary and biomechanical models may benefit from the presented results. It may be of interest, in the future, to extend a similar analysis to history‐dependent game structures or multi‐agent games on arbitrary graph topologies.

Conflict of Interest

The authors declare no conflict of interest.

Supporting information

Supporting Information

Acknowledgements

This project was supported by the Singapore University of Technology and Design (Grant No. SRG SCI 2019 142). The authors thank the three anonymous reviewers for aiding them in improving the paper.

Koh J. M., Cheong K. H., Generalized Solutions of Parrondo's Games. Adv. Sci. 2020, 7, 2001126 10.1002/advs.202001126

References

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supporting Information


Articles from Advanced Science are provided here courtesy of Wiley

RESOURCES