Skip to main content
Journal of the Royal Society Interface logoLink to Journal of the Royal Society Interface
. 2020 Aug 12;17(169):20200491. doi: 10.1098/rsif.2020.0491

The evolution of trust and trustworthiness

Aanjaneya Kumar 1, Valerio Capraro 2,, Matjaž Perc 3,4,5
PMCID: PMC7482572  PMID: 32781937

Abstract

Trust and trustworthiness form the basis for continued social and economic interactions, and they are also fundamental for cooperation, fairness, honesty, and indeed for many other forms of prosocial and moral behaviour. However, trust entails risks, and building a trustworthy reputation requires effort. So how did trust and trustworthiness evolve, and under which conditions do they thrive? To find answers, we operationalize trust and trustworthiness using the trust game with the trustor’s investment and the trustee’s return of the investment as the two key parameters. We study this game on different networks, including the complete network, random and scale-free networks, and in the well-mixed limit. We show that in all but one case, the network structure has little effect on the evolution of trust and trustworthiness. Specifically, for well-mixed populations, lattices, random and scale-free networks, we find that trust never evolves, while trustworthiness evolves with some probability depending on the game parameters and the updating dynamics. Only for the scale-free network with degree non-normalized dynamics, we find parameter values for which trust evolves but trustworthiness does not, as well as values for which both trust and trustworthiness evolve. We conclude with a discussion about mechanisms that could lead to the evolution of trust and outline directions for future work.

Keywords: trust, trustworthiness, prosociality, evolution

1. Introduction

While we live in a time where the average individual is much healthier and safer than ever before [1,2], we are also daunted by several political conflicts, health threats, and extreme poverty in many parts of the world. New innovations and technological breakthroughs often seem to promise a better tomorrow, but the privileges remain restricted to only a tiny fraction of the population. While the issues of equality and egalitarianism are certainly multi-faceted, it is clear that solutions would require us to act prosocially, giving up parts of our personal benefits to help others. But the caveat is that behaving prosocially is costly and not optimal for the individual, and thus will not present itself unless additional mechanisms are at play. No wonder, thus, that understanding the mechanisms that favour the evolution of prosocial behaviour has been declared one of the greatest challenges of the twenty-first century, and that scholars from disciplines as diverse as sociology, psychology, anthropology, economics, biology and physics have tried to solve the puzzle [312].

An exciting development during the past two decades has been the coming of age of network science [1316], which combined with other methods of statistical physics [1719], has reached a level of maturity that allows us to tackle some of the greatest challenges of our time. The study of social dynamics [20], traffic [21], crime [22], epidemic processes [23], climate inaction [24] and vaccination [25] are all examples of this exciting development, which can be put under the umbrella of social physics [26]. Prosocial behaviour is no exception either and, in particular, the Monte Carlo (MC) method for the simulation of evolutionary games and related models on networks has been used prolifically to shed light on the mechanism that may promote it. Most previous works have focussed on three kinds of prosocial behaviour, namely cooperation [2736], strategic fairness [3744] and altruistic punishment [4547].

However, recent empirical research in experimental economics and psychology suggests that two of these behaviours—cooperation and altruistic punishment—can be seen as a special form of a more general class of behaviour, namely moral behaviour [4853]. This observation opens up the possibility of using the same methods that have been used to study the evolution of cooperation and altruistic punishment to effectively study also the evolution of other types of moral behaviour [54]. Following this idea, recent work has explored the evolution of lying and found a number of intriguing conditions for the evolution of truth-telling [55,56]. Therefore, motivated by the success of this new line of work, we here apply the same methods to study the evolution of trust and trustworthiness.

While the precise definition of trust and trustworthiness depends upon the specific context in which it is being used, a general feature that it exhibits is the willingness of an agent—the trustor—to act in such a way that she is placed in a vulnerable situation with respect to another agent—the trustee, especially when the trustor has no direct ability to monitor the trustee’s actions. Thus, trust invariably involves putting oneself in a vulnerable situation in the hope of high returns. High returns that, in the absence of any mechanism to enforce the reciprocation of the trust, might never come, because the trustee can maximize his gain by simply walking away with the profit obtained by betraying the trustor. Knowing this, the trustor should not trust in the first place. Therefore, both trust and trustworthiness go against the assumptions of narrow self-interest. They in fact correlate with several measures of morality, including cooperation and altruism [57]. Moreover, trustworthiness, in the form of ‘returning favours’, has been recently found to be a universal moral rule across 60 societies around the world [58]. Yet, despite the fact that both trust and trustworthiness go against the assumption of narrow self-interest, we see them in action everyday—from travellers preferring to look for accommodation through Airbnb rather than spending money on booking a hotel room, to computers in a network deciding to receive information from a source outside of their network. Trust and trustworthiness are ubiquitous in our society, which suggests that, in reality, some mechanisms that favour the evolution of trust and trustworthiness must be at play. The question is which are these mechanisms?

Real interactions do not happen in a vacuum, nor are they random. They are inherently limited to a subset of the population. Some interactions are more frequent than others, and some individuals have many more contacts than others. We are far more likely to interact with friends, family members and co-workers, than we are with random people. The very fact that interactions are structured has been shown to promote cooperation, along the logic of network reciprocity: cooperators can form clusters to protect themselves from the invasion of defectors [8]. Similarly, it has been shown that spatial structure favours the evolution of fairness and altruistic punishment [38,45], as well as the evolution of truth-telling, at least in some cases [56]. In this paper, we take inspiration from this line of research and we ask whether network reciprocity promotes also the evolution of trust and trustworthiness.

The plan of the paper is as follows: in §2.1, we will describe the trust game and give a brief overview of the research attention that it has attracted since its introduction. In §2.2, we will provide a description of the MC method used to numerically evaluate the stationary state frequencies of different strategies in the trust game, played in well-mixed as well as in networked populations. We will present our results in §3, and we will end with a summary and outlook for future research in §4.

2. Methods

2.1. The trust game

Berg et al. [59] proposed the trust game in 1995 as an elegant way to measure trust and trustworthiness between two agents. Player A (the trustor) is initially given some amount of money, normalized to 1. In the first step of the game, player A can choose to trust player B (the trustee) and transfer a proportion x ∈ [0, 1] of her endowment to player B. A transfer of x = 0 corresponds to player A choosing to not trust B and to walk away with her money; in this case, the game ends. Instead, if A transfers some amount x > 0 to B, the amount of money transferred to player B is tripled (i.e. B gets 3x units of money while A is left with 1 − x) and the game continues. In the second step, player B chooses a fraction r ∈ [0, 1] of the money he possesses to return to player A. This marks the end of the game. Therefore, the final payoffs of player A and player B are, respectively, 1 − x + 3xr and 3x(1 − r) units of money.

In a one-shot anonymous trust game, it is clear that a self-interested player B has no incentive to return any amount of money to player A. This backward induction argument suggests that the best strategy for player A would be to not trust player B. However, experimental research has repeatedly reported that a significant proportion of people choose to transfer a non-zero amount of money to their co-player and a substantial amount of money is also returned [5965]. Importantly, this behaviour cannot be explained by lack of comprehension [66] or risk aversion [6770]. Specifically, one observes trust and trustworthiness also among experimental participants who have a clear understanding of what their payoff-maximizing strategy is. And trust does not seem to be driven by risk seeking: many individuals who choose to trust in the trust game are averse to taking the risk in an equivalent lottery. In summary, the empirical literature on the trust game provides a clear indication that, while trust and trustworthiness go against monetary payoff maximization, they often emerge. In order to better comprehend the origin and evolution of trust and trustworthiness, experimental studies need to be complemented with extensive numerical simulations which can help us shed light on when and how trust can be selected in a population and what role does the structure of the population has on its evolution.

At this stage, one might wonder whether trust and trustworthiness are fundamentally different from other forms of social behaviour that have been studied with methods of statistical physics. The answer is positive. This is easy to see in the case of the ultimatum game (used to measure strategic fairness and altruistic punishment) and the sender–receiver game or other deception games (used to measure lying), because they, compared to the trust game, have a completely different payoff structure and set of Nash equilibria. If anything, the trust game looks similar to Prisoner’s Dilemma, the symmetric game in which both players have to decide whether to cooperate or defect: cooperation means paying a cost to give a greater benefit to the other player; defecting means doing nothing. Although the trust game and Prisoner’s Dilemma might superficially look similar, they are actually fundamentally different. Not only the trust game differs from Prisoner’s Dilemma on the technical fact that the latter is symmetric, while the former is not, but, more crucially, it fundamentally differs in the evolutionary patterns that it generates, as we will now show.

2.2. The Monte Carlo method

In the trust game, the amount x that player A transfers to player B is considered as an individual measure of trust, whereas the fraction r that player B returns to player A is taken as a measure of trustworthiness. While in theory any amount of trust x ∈ [0, 1] and any amount of trustworthiness r ∈ [0, 1] can be possible, in practice, people in the position of player A often have a binary decision to make, whether to trust or not to trust people in the position of player B; similarly, people in the position of player B often have a binary decision to make, whether to return a previously agreed amount of money or not [71,72]. We follow this line of work and we also consider a binary version of the trust game, in which player A can either choose to trust (T) or not trust (N), whereas player B can either reciprocate (R) player A’s trust or betray (B). This yields a payoff bimatrix

T N
R 1 + (3r − 1)x, 3(1 − r)x 1, 0
B 1 − x, 3x 1, 0

A particularly interesting case is when x = 1 and r = 0.5, corresponding to the case in which the trustor invests all her money which is normalized to 1 and the amount that the trustee can return corresponds to an equal split between them.

We carried out simulations of the trust game for well-mixed populations as well as several network structures (hexagonal, square, and triangular lattices, as well as random networks and scale-free networks) using the MC method. For a well-mixed population with N players, the following are the elementary steps: The simulation starts by randomly distributing the four strategies (T,R), (T,B), (N,R) and (N,B) among N agents. Two players P1 and P2 are then randomly picked and they play the trust game with four randomly chosen neighbours. We note that since these players are picked randomly without restricting the selection to nearest neighbours or linked players in a network, the procedure thus yields well-mixed conditions. In each of the eight games, the roles of players are assigned randomly. P1 and P2 collect payoffs ΠP1 and ΠP2, respectively. Then player P2 copies the strategy of player P1 with probability

w=1/(1+exp(ΠP2ΠP1)/K), 2.1

where we choose K = 0.1. This step is repeated N times, which by definition completes one full MC step [73]. During the repetition of many full MC steps, every player will thus (since N is also the population size) have a chance once, on average, to change its strategy for each full MC step that is made. Indeed, in our simulations, we have performed the MC method for up to 10 000 full MC steps. This completes one realization. We conducted 5000 realizations, using randomized initial conditions and the evolution described in the Results section is obtained by averaging over these realizations.

For structured populations, we introduce the constraint in the above-mentioned elementary steps that P1 and P2 must necessarily be neighbours, or directly linked players in a network. In the case of heterogeneous networks, we use two different imitation rules—the normalized and the unnormalized replicator dynamics. In the unnormalized dynamics, the probability with which P2 replicates the strategy of P1 is as before

w=1/(1+exp(ΠP2ΠP1)/K). 2.2

The normalized replication probability differs from the unnormalized one in that payoffs are scaled down by the degree of the players, that is,

w=1/(1+exp(ΠP2ΠP1)/K), 2.3

where ΠPi=ΠPi/ki and ki is the degree of player i. In practice, this means that, in the normalized replicator dynamics, players take into account their degree and the degree of other players; whereas, this does not happen in the unnormalized dynamics. Both dynamics are useful in their domain of applicability. The normalized replicator dynamics is useful in situations in which the degrees are visible, and the individuals make a fair comparison with their neighbours—this often happens online, as social media allows people to visualize the connections of an agent with other agents. The unnormalized dynamics is useful in situations in which the imitation of strategies happens on the basis of how well the other player is doing, without taking into account the number of connections they have—for example, people trying to mimic the habits of successful people without accounting for the number of resources that they have at their disposal compared to the person they are copying.

3. Results

3.1. Well-mixed populations

We first report the final densities of the four strategies (T,R), (T,B), (N,R) and (N,B), as a function of the parameters x and r, in a well-mixed population consisting of 500 agents. Figure 1 highlights that, in this case, trust does not evolve, as both the strategies (T,R) and (T,B) appear with density 0 at the steady state, irrespective of the parameters x and r. By contrast, the final density of trustworthiness highly depends on the parameter r, while being insensitive to the parameter x. Specifically, for each x, the prevalence of trustworthiness is about 50% for very small values of r, and then monotonically decreases as r increases.

Figure 1.

Figure 1.

The stationary density of the four strategies plotted on a 20 × 20 grid of (x, r) values with both x and r ranging from 0 to 1. Well-mixed population.

In order to gain a better understanding of the evolution of trust and trustworthiness, we also conducted several simulations to study the time evolution of the frequencies. We do not report the outputs in the figures, as they are all very similar and certainly not surprising. For example, for x = 1 and r = 0.5, consistent with figure 1, we found that the frequencies of the strategies (T,R) and (T,B) go to zero after about 40 MC steps. On the other hand, the strategy (N,B) survives with very high frequency, around 85%. The remaining frequency, about 15%, is taken by the remaining strategy (N,R).

3.2. Lattices

To understand the role of the spatial structure on the evolution of trust and trustworthiness, we simulate the trust game on different lattices. Figure 2 reports the stationary densities of the four strategies as a function of x and r on the square lattice. It is immediately evident that the trends in the evolution of different strategies remain the same, compared to the well-mixed populations (figure 1). We obtain very similar trends in the case of the triangular and the hexagonal lattices (figures reported in the electronic supplementary material) with the results differing only by a small numerical value.

Figure 2.

Figure 2.

The stationary density of the four strategies plotted on a 20 × 20 grid of (x, r) values with both x and r ranging from 0 to 1. Square lattice.

In order to provide further evidence that the lattice structure has very little effect on the evolution of trust and trustworthiness, we also conducted several simulations to study the time evolution of the four strategies in the three lattices (figures not reported in the paper). Consistent with the results mentioned above, we found that the time evolution in the lattice is very similar to the well-mixed case. For example, for x = 1 and r = 0.5, we found that the frequencies of (T,R) and (T,B) quickly go to zero, whereas the final density of (N,R) is slightly larger that it was in well-mixed populations, but the numerical difference is very small (around 5%); consequently, the final density of (N,B) is slightly smaller in the lattices than it was in well-mixed populations.

To better understand the spatial evolution of the strategies, figure 3 presents snapshots of the game on a square lattice after a long duration. In most realizations of the game, the whole population adopts a single strategy and the system enters an absorbing state. However, in a few realizations, (N,B) and (N,R) both survive for long time. We have picked one such realization for representation purposes. It is clearly seen that the two surviving strategies tend to cluster together, forming metastable clusters. It is also noted that, apart from clusters, there are patches where the two surviving strategies appear alternatively.

Figure 3.

Figure 3.

Snapshots of the evolution of strategies in the trust game played on a 40 × 40 square lattice. In most realizations of the game, the entire system enters an absorbing state. However, in a few realizations, (N,B) and (N,R) both survive for a long time. We have picked one such realization for representation purposes.

3.3. Random and scale-free networks

To investigate the role of the spatial structure on the evolution of trust and trustworthiness further, we simulate the trust game on a scale-free network generated by the Barabási–Albert algorithm and an Erdös–Rényi random network, with 500 agents each (both with an average degree close to 10). Since these networks are not regular, we consider both the normalized and the unnormalized replicator dynamics.

In the case of random networks, we obtain results very similar to the well-mixed populations and the three lattices. This holds using both the normalized and unnormalized dynamics (see electronic supplementary material) and it provides further evidence that spatial correlations alone do not lead to the evolution of trust.

To study the effects of heterogeneity in the network of contacts, we study the trust game on scale-free networks. In this case, evolution turns out to be more nuanced and interesting, as it appears to depend on the choice of replicator dynamics. When agents imitate other agents using the normalized replicator dynamics, trust does not evolve and the results are virtually the same as in the previous cases. However, when agents imitate other agents using the unnormalized replicator dynamics, we observe rich behaviour in terms of the evolution of different strategies. Figure 4 is a heat map of the steady-state density of the four strategies, and it shows clear differences with figure 1. The strategy (T,R), which in the other cases never evolved, this time evolves for small values of x. Similarly, the strategy (T,B), which generally vanished in the other cases, now evolves for x < 0.5. The difference is particularly evident for x small and r large, where there appears to be an island in which (T,B) actually evolves with frequency close to 50%.

Figure 4.

Figure 4.

The stationary density of the four strategies plotted on a 20 × 20 grid of (x, r) values with both x and r ranging from 0 to 1. Scale-free network (unnormalized replicator dynamics).

To have a better understanding of these differences, we next explore the time evolution of the four strategies in three prototypical cases, one in which we expect virtually no differences compared to the well-mixed case (x = 1 and r = 0.5) and two in which we expect large differences (x = 0.1, r = 0.8 and x = 0.1, r = 0.3). Note indeed that figure 4 suggests that, for x = 1 and r = 0.5, the final densities according to the unnormalized replicator dynamics should be very similar to those according to the normalized replicator dynamics, which are in turn very similar to those in well-mixed populations. By contrast, we chose the values x = 0.1 and r = 0.8 to illustrate the evolution in correspondence to the island described above where we expect trust but not trustworthiness to evolve. And we chose the values x = 0.1 and r = 0.3 to illustrate a situation in which we expect both trust and trustworthiness to evolve.

Figure 5 reports the time evolution of the four strategies for x = 1 and r = 0.5 using the unnormalized dynamics (figure 5a) and the normalized dynamics (figure 5b). As expected, the bottom panel is virtually identical to the well-mixed population (not reported in the figures, but discussed earlier in the text). The top panel differs from the bottom panel only in a very small detail: the strategy (T,B) evolves with a very small frequency.

Figure 5.

Figure 5.

Time evolution of the four strategies in a scale-free network for values x = 1 and r = 0.5, for the unnormalized (a) and normalized (b) replicator dynamics.

Figure 6a reports the evolution of the four strategies for x = 0.1 and r = 0.8, only for the unnormalized replicator dynamics. As expected, this time we see very large differences compared to the normalized replicator dynamics, which we do not report in the paper, being virtually identical to figure 5. In particular, the biggest difference can be observed in the evolution of the strategy (T,B). In the previous case (x = 1, r = 0.5), this strategy almost vanished when agents imitate other agents using the unnormalized replicator dynamics, and completely vanished when they used the normalized replicator dynamics. In stark contrast, the strategy (T,B) now evolves with frequency close to 50%. Another difference can be noticed in the case of the strategy (T,R). This strategy vanished in all the earlier cases. By contrast, it now survives, although with a very small probability around 2%. Finally, figure 6b reports the evolution of the four strategies for x = 0.1 and r = 0.3, again only for the unnormalized replicator dynamics. As expected, this time the strategy (T,R) evolves with a non-negligible frequency around 15%. The strategy (N,R) evolves with an even higher frequency around 25%, compared to the 5% for x = 0.1 and r = 0.8. These increases in frequency come mainly at the expenses of the strategy (T,B), which, for x = 0.1 and r = 0.8 evolved with very high frequency (about 45%), whereas it now evolves only with frequency around 20%; and to a lesser extent at the expenses of the strategy (N,B), which, for x = 0.1 and r = 0.8 evolved with frequency around 45%, whereas it now evolves with frequency below 40%.

Figure 6.

Figure 6.

Time evolution of the four strategies in a scale-free network (unnormalized replicator dynamics) for values x = 0.1 and r = 0.8 (a) and for x = 0.1 and r = 0.3 (b).

4. Discussion

We have used the MC method to study the evolution of trust and trustworthiness in well-mixed populations, three different types of lattices, random networks and scale-free networks. Since the latter two networks are not regular, in these cases we have studied the evolution of trust and trustworthiness both when agents imitate other agents by taking into account their degree (normalized replicator dynamics) and when they do not (unnormalized replicator dynamics). As a measure of trust and trustworthiness, we have used a binary version of the trust game [59]. The choice made by player 1 (the trustor) was taken as a measure of trust; the choice made by player 2 (the trustee) was taken as a measure of trustworthiness. We parameterized the game through two parameters: x ∈ [0, 1] describes the amount of money that the trustor can send to the trustee; r ∈ [0, 1] represents the proportion of the amount received by the trustee that he can return to the trustor.

Our exploration provided evidence of several results. First, in well-mixed populations, trust never evolves, whereas the evolution of trustworthiness depends monotonically decreasingly on r (and shows very little dependence on x). Second, to understand the effects of spatial correlations on the evolution of different strategies, we simulated the trust game on homogeneous and heterogeneous networks. On lattices, random networks (using both the imitation dynamics), and scale-free networks with normalized replicator dynamics, we observe that trust does not evolve, and in these cases, the final densities of the four strategies are very similar to the corresponding final densities in well-mixed populations. This conclusively points to the fact that solely spatial structure does not lead to the evolution of trust. Third, scale-free networks with unnormalized replicator dynamics give rise to the most nuanced evolution: for small values of r and x, both trust and trustworthiness evolve, although with a relatively small frequency around 15%; for small values of x and large values of r, trust evolves with a relatively large frequency around 50%, but this time trustworthiness does not evolve. These results can readily be compared to the evolutionary Prisoner’s Dilemma on scale-free networks [74] with normalized and unnormalized replicator dynamics where the evolution of cooperation is possible in both cases. The heterogeneous scale-free network provides a mechanism for the survival of cooperators up to larger values of temptation to defect, when compared to well-mixed populations. However, it is interesting to note that when the payoffs of an individual are normalized by their degrees, the fraction of surviving cooperators is significantly lesser. Our results hint that while heterogeneity also provides a route for the evolution of trust, it only does so when the payoff of the players is accumulated over all its interactions with its neighbours, and not averaged over them, like in the normalized dynamics.

In sum, we have operationalized trust and trustworthiness using the trust game with the trustor’s investment and the trustee’s return of the investment as the two key parameters and we have studied their evolution in a number of networks and our results have shown that trust and trustworthiness very rarely evolve in these networks, and even more rarely do they do it together: when trustworthiness evolves, then trust does not; when trust evolves, trustworthiness does not. Only in a relatively small region (both r and x small) and only in the case of scale-free networks and unnormalized replicator dynamics, the strategy (T,R) evolved with a non-negligible, although still relatively small (around 15%) probability.

This is the first systematic study on the evolution of trust and trustworthiness on networks. Most previous work applied the MC method to study the evolution of cooperation in Prisoner’s Dilemma [2736], the evolution of strategic fairness and altruistic punishment in the ultimatum game [3744], and the evolution of truth-telling in the sender–receiver game [55,56] or in other deception games [7579]. These games are fundamentally different from the trust game used in the current analysis. The trust game is obviously different from the sender–receiver game and the ultimatum game, because they have completely different strategic structure and, consequently, sets of equilibria. But it is also different from Prisoner’s Dilemma: while this game is symmetric, the trust game is not. This is probably the reason that leads to the fact that, in general, the spatial structure favours the evolution of cooperation in Prisoner’s Dilemma, while having very little effect on the evolution of trust and trustworthiness. A handful of papers have studied the evolution of trust and trustworthiness using the trust game or some variants thereof. However, most of these works focused on well-mixed populations [8084]. These works typically show that, with no additional mechanisms, such as choice visibility, trust and trustworthiness do not evolve in well-mixed populations. Our findings are thus in line with this preceding research. A variant of the trust game has also been studied on networks; however, the analysis was mainly focused more on group effects, and on one specific network—the email network of a university in Tarragona [85].

The fact that the spatial structure, apart from one special case, does not promote the evolution of trust and trustworthiness together with the observation that, in reality, we do see a lot of trust and trustworthiness, generates the following question: what mechanisms promote the evolution of trust and trustworthiness? In figure 7a, a plot of the evolution of the strategies of 499 agents for values x = 1 and r = 0.5 in a well-mixed population of 500 agents where the excluded individual is a ‘good samaritan’ who always chooses the strategy (T,R). We emphasize that the plot only considers the evolution of the strategies of the 499 agents which does not include the good samaritan. It can be seen that a finite, albeit small fraction of trustors, survive in the stationary state upon the inclusion of a single good samaritan agent at a value of x and r where previously trust did not evolve. It is well known that zealots can drive the evolution of cooperation in Prisoner’s Dilemma game [86] and a detailed study of the effects of good samaritans on the evolution of trust and other moral behaviours provides an interesting avenue for future research. Figure 7b explores the influence of noisy imitation on the dynamics. Noise can be interpreted as the lack of perfect information about the payoffs of other people, or as suboptimal decision making. We show a comparison of the evolution of increased noise in the imitation process for x = 1, r = 0.5, and K = 1, 10 and 100). It is expected in the limit of K → ∞ that each strategy survives with equal probability as the dynamics is random. However, even at K = 10, we can see that trust evolves to steady-state density of around 10% and the strategy (T,R) which accounts for trusting, and trustworthy individuals also evolve to a final density of around 1%. Studying further the effects of noisy imitation as a function of the parameters of the game could lead us to novel insights.

Figure 7.

Figure 7.

(a) The evolution of the four strategies as a function of time in the case of a well-mixed population after adding a ‘good samaritan’ agent that always chooses the strategy (T,R). We look at the evolution of the 499 agents in the population (excluding the good samaritan) for the values x = 1 and r = 0.5. (b) Time evolution of the four strategies (without any good samaritan) for x = 1, r = 0.5, and varying levels of noise (K = 1, 10, 100).

Several other mechanisms could be responsible for the evolution of trust [87]. Possible candidates could be reward and punishment as well as apology, forgiveness, and emotions such as guilt. We know that these mechanisms promote the evolution of cooperation [8897]. Along similar lines, it is possible that they also promote the evolution of trust and trustworthiness. In fact, in reality, we know that, for example, online transactions, which are fundamentally based on a relationship of trust, are supported by rating systems that provide a measure of the trustworthiness of the agents. Therefore, it is likely that the presence of a reputation mechanism promotes the evolution of trust. Following recent works of Fudenberg & Imhof [98] and Veller & Hayward [99], it would also be interesting to study the problem where not only do the agents evolve using imitation, but also can spontaneously mutate and adopt different strategies. Additionally, we note that our results were obtained on particular networks and imitation rules; it is possible that other networks and/or other imitation rules lead to the evolution of trust and trustworthiness. Finally, individual differences for example in gender, age, dominance status, number of neighbours, kinship, which are well-known to affect cooperative and altruistic behaviour [36,100104], can also affect the evolution of trust and trustworthiness. Future work should explore these possibilities.

Supplementary Material

Robustness tests
rsif20200491supp1.pdf (183.8KB, pdf)

Acknowledgements

We thank Shraddha Pathak and Sandeep Chowdhary for many useful discussions.

Data accessibility

This paper has no additional data.

Authors' contributions

A.K., V.C., M.P. designed the study, A.K. conducted the simulations, A.K., V.C., M.P. discussed the results and wrote the paper.

Competing interests

We declare we have no competing interest.

Funding

A.K. acknowledge the Prime Minister’s Research Fellowship for financial support. M.P. was supported by the Slovenian Research Agency (grant nos. J4-9302, J1-9112 and P1-0403).

References

  • 1.Pinker S. 2011. The better angels of our nature: why wiolence has declined. New York, NY: Viking. [Google Scholar]
  • 2.Pinker S. 2018. Enlightenment now: the case for reason, science, humanism, and progress. London, UK: Penguin. [Google Scholar]
  • 3.Hardin G. 1968. The tragedy of the commons. Science 162, 1243–1248. ( 10.1126/science.162.3859.1243) [DOI] [PubMed] [Google Scholar]
  • 4.Trivers RL. 1971. The evolution of reciprocal altruism. Q. Rev. Biol. 46, 35–57. ( 10.1086/406755) [DOI] [Google Scholar]
  • 5.Axelrod R, Hamilton WD. 1981. The evolution of cooperation. Science 211, 1390–1396. ( 10.1126/science.7466396) [DOI] [PubMed] [Google Scholar]
  • 6.Milinski M, Semmann D, Krambeck HJ. 2002. Reputation helps solve the ‘tragedy of the commons’. Nature 415, 424–426. ( 10.1038/415424a) [DOI] [PubMed] [Google Scholar]
  • 7.Boyd R, Gintis H, Bowles S, Richerson PJ. 2003. The evolution of altruistic punishment. Proc. Natl Acad. Sci. USA 100, 3531–3535. ( 10.1073/pnas.0630443100) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Nowak MA. 2006. Five rules for the evolution of cooperation. Science 314, 1560–1563. ( 10.1126/science.1133755) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Hilbe C, Sigmund K. 2010. Incentives and opportunism: from the carrot to the stick. Proc. R. Soc. B 277, 2427–2433. ( 10.1098/rspb.2010.0065) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Capraro V. 2013. A model of human cooperation in social dilemmas. PLoS ONE 8, e72427 ( 10.1371/journal.pone.0072427) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Rand DG, Nowak MA. 2013. Human cooperation. Trends Cogn. Sci. 17, 413–425. ( 10.1016/j.tics.2013.06.003) [DOI] [PubMed] [Google Scholar]
  • 12.Perc M, Jordan JJ, Rand DG, Wang Z, Boccaletti S, Szolnoki A. 2017. Statistical physics of human cooperation. Phys. Rep. 687, 1–51. ( 10.1016/j.physrep.2017.05.004) [DOI] [Google Scholar]
  • 13.Barrat A, Barthélemy M, Vespignani A. 2008. Dynamical processes on complex networks. Cambridge, UK: Cambridge University Press. [Google Scholar]
  • 14.Newman MEJ. 2010. Networks: an introduction. Oxford, UK: Oxford University Press. [Google Scholar]
  • 15.Estrada E. 2012. The structure of complex networks: theory and applications. Oxford, UK: Oxford University Press. [Google Scholar]
  • 16.Barabási AL. 2015. Network science. Cambridge, UK: Cambridge University Press. [Google Scholar]
  • 17.Stanley HE. 1971. Introduction to phase transitions and critical phenomena. Oxford, UK: Clarendon Press. [Google Scholar]
  • 18.Liggett TM. 1985. Interacting particle systems. New York, NY: Springer. [Google Scholar]
  • 19.Landau DP, Binder K. 2000. A guide to Monte Carlo simulations in statistical physics. Cambridge, UK: Cambridge University Press. [Google Scholar]
  • 20.Castellano C, Fortunato S, Loreto V. 2009. Statistical physics of social dynamics. Rev. Mod. Phys. 81, 591–646. ( 10.1103/RevModPhys.81.591) [DOI] [Google Scholar]
  • 21.Helbing D. 2001. Traffic and related self-driven many-particle systems. Rev. Mod. Phys. 73, 1067 ( 10.1103/RevModPhys.73.1067) [DOI] [Google Scholar]
  • 22.D’Orsogna MR, Perc M. 2015. Statistical physics of crime: a review. Phys. Life Rev. 12, 1–21. ( 10.1016/j.plrev.2014.11.001) [DOI] [PubMed] [Google Scholar]
  • 23.Pastor-Satorras R, Castellano C, Van Mieghem P, Vespignani A. 2015. Epidemic processes in complex networks. Rev. Mod. Phys. 87, 925 ( 10.1103/RevModPhys.87.925) [DOI] [Google Scholar]
  • 24.Pacheco JM, Vasconcelos VV, Santos FC. 2014. Climate change governance, cooperation and self-organization. Phys. Life Rev. 11, 573–586. ( 10.1016/j.plrev.2014.02.003) [DOI] [PubMed] [Google Scholar]
  • 25.Wang Z, Bauch CT, Bhattacharyya S, d’Onofrio A, Manfredi P, Perc M, Perra N, Salathé M, Zhao D. 2016. Statistical physics of vaccination. Phys. Rep. 664, 1–113. ( 10.1016/j.physrep.2016.10.006) [DOI] [Google Scholar]
  • 26.Perc M. 2019. The social physics collective. Sci. Rep. 9, 16549 ( 10.1038/s41598-019-53300-4) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Santos FC, Pacheco JM. 2005. Scale-free networks provide a unifying framework for the emergence of cooperation. Phys. Rev. Lett. 95, 098104 ( 10.1103/PhysRevLett.95.098104) [DOI] [PubMed] [Google Scholar]
  • 28.Pacheco JM, Traulsen A, Nowak MA. 2006. Coevolution of strategy and structure in complex networks with dynamical linking. Phys. Rev. Lett. 97, 258103 ( 10.1103/PhysRevLett.97.258103) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Gómez-Gardenes J, Campillo M, Floría LM, Moreno Y. 2007. Dynamical organization of cooperation in complex topologies. Phys. Rev. Lett. 98, 108103 ( 10.1103/PhysRevLett.98.108103) [DOI] [PubMed] [Google Scholar]
  • 30.Ohtsuki H, Nowak MA, Pacheco JM. 2007. Breaking the symmetry between interaction and replacement in evolutionary dynamics on graphs. Phys. Rev. Lett. 98, 108106 ( 10.1103/PhysRevLett.98.108106) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Lee S, Holme P, Wu ZX. 2011. Emergent hierarchical structures in multiadaptive games. Phys. Rev. Lett. 106, 028702 ( 10.1103/PhysRevLett.106.028702) [DOI] [PubMed] [Google Scholar]
  • 32.Tanimoto J, Brede M, Yamauchi A. 2012. Network reciprocity by coexisting learning and teaching strategies. Phys. Rev. E 85, 032101 ( 10.1103/PhysRevE.85.032101) [DOI] [PubMed] [Google Scholar]
  • 33.Wang Z, Kokubo S, Jusup M, Tanimoto J. 2015. Universal scaling for the dilemma strength in evolutionary games. Phys. Life Rev. 14, 1–30. ( 10.1016/j.plrev.2015.04.033) [DOI] [PubMed] [Google Scholar]
  • 34.Javarone MA. 2016. Statistical physics of the spatial Prisoner’s Dilemma with memory-aware agents. Eur. Phys. J. B 89, 42 ( 10.1140/epjb/e2016-60901-5) [DOI] [Google Scholar]
  • 35.Amaral MA, Javarone MA. 2018. Heterogeneous update mechanisms in evolutionary games: mixing innovative and imitative dynamics. Phys. Rev. E 97, 042305 ( 10.1103/PhysRevE.97.042305) [DOI] [PubMed] [Google Scholar]
  • 36.Vilone D, Capraro V, Ramasco JJ. 2018. Hierarchical invasion of cooperation in complex networks. J. Phys. Commun. 2, 025019 ( 10.1088/2399-6528/aaab2e) [DOI] [Google Scholar]
  • 37.Szolnoki A, Perc M, Szabó G. 2012. Defense mechanisms of empathetic players in the spatial ultimatum game. Phys. Rev. Lett. 109, 078701 ( 10.1103/PhysRevLett.109.078701) [DOI] [PubMed] [Google Scholar]
  • 38.Page KM, Nowak MA, Sigmund K. 2000. The spatial ultimatum game. Proc. R. Soc. Lond. Ser. B 267, 2177–2182. ( 10.1098/rspb.2000.1266) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Kuperman M, Risau-Gusman S. 2008. The effect of the topology on the spatial ultimatum game. Eur. Phys. J. B 62, 233–238. ( 10.1140/epjb/e2008-00133-x) [DOI] [Google Scholar]
  • 40.Eguíluz VM, Tessone CJ. 2009. Critical behavior in an evolutionary ultimatum game with social structure. Adv. Complex Syst. 12, 221–232. ( 10.1142/S0219525909002179) [DOI] [Google Scholar]
  • 41.da Silva R, Kellermann GA, Lamb LC. 2009. Statistical fluctuations in population bargaining in the ultimatum game: static and evolutionary aspects. J. Theor. Biol. 258, 208–218. ( 10.1016/j.jtbi.2009.01.017) [DOI] [PubMed] [Google Scholar]
  • 42.Deng L, Tang W, Zhang J. 2011. The coevolutionary ultimatum game on different network topologies. Physica A 390, 4227–4235. ( 10.1016/j.physa.2011.06.076) [DOI] [Google Scholar]
  • 43.Gao J, Li Z, Wu T, Wang L. 2011. The coevolutionary ultimatum game. EPL (Europhys. Lett.) 93, 48003 ( 10.1209/0295-5075/93/48003) [DOI] [Google Scholar]
  • 44.Szolnoki A, Perc M, Szabó G. 2012. Accuracy in strategy imitations promotes the evolution of fairness in the spatial ultimatum game. EPL (Europhys. Lett.) 100, 28005 ( 10.1209/0295-5075/100/28005) [DOI] [Google Scholar]
  • 45.Helbing D, Szolnoki A, Perc M, Szabó G. 2010. Evolutionary establishment of moral and double moral standards through spatial interactions. PLoS Comput. Biol. 6, e1000758 ( 10.1371/journal.pcbi.1000758) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Szolnoki A, Perc M. 2013. Correlation of positive and negative reciprocity fails to confer an evolutionary advantage: phase transitions to elementary strategies. Phys. Rev. X 3, 041021 ( 10.1103/physrevx.3.041021) [DOI] [Google Scholar]
  • 47.Szolnoki A, Perc M. 2017. Second-order free-riding on antisocial punishment restores the effectiveness of prosocial punishment. Phys. Rev. X 7, 041027 ( 10.1103/physrevx.7.041027) [DOI] [Google Scholar]
  • 48.Dal Bó E, Dal Bó P. 2014. ‘Do the right thing’: the effects of moral suasion on cooperation. J. Public Econ. 117, 28–38. ( 10.1016/j.jpubeco.2014.05.002) [DOI] [Google Scholar]
  • 49.Biziou-van Pol L, Haenen J, Novaro A, Occhipinti Liberman A, Capraro V. 2015. Does telling white lies signal pro-social preferences? Judgment Decis. Mak. 10, 538–548. ( 10.2139/ssrn.2617668) [DOI] [Google Scholar]
  • 50.Kimbrough EO, Vostroknutov A. 2016. Norms make preferences social. J. Eur. Econ. Assoc. 14, 608–638. ( 10.1111/jeea.12152) [DOI] [Google Scholar]
  • 51.Eriksson K, Strimling P, Andersson PA, Lindholm T. 2017. Costly punishment in the ultimatum game evokes moral concern, in particular when framed as payoff reduction. J. Exp. Soc. Psychol. 69, 59–64. ( 10.1016/j.jesp.2016.09.004) [DOI] [Google Scholar]
  • 52.Capraro V, Rand DG. 2018. Do the right thing: experimental evidence that preferences for moral behavior, rather than equity or efficiency per se, drive human prosociality. Judgment Decis. Mak. 13, 99–111. ( 10.2139/ssrn.2965067) [DOI] [Google Scholar]
  • 53.Capraro V, Jagfeld G, Klein R, Mul M, van de Pol I. 2019. Increasing altruistic and cooperative behaviour with simple moral nudges. Sci. Rep. 9, 11880 ( 10.1038/s41598-019-48094-4) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Capraro V, Perc M. 2018. Grand challenges in social physics: in pursuit of moral behavior. Front. Phys. 6, 107 ( 10.3389/fphy.2018.00107) [DOI] [Google Scholar]
  • 55.Capraro V, Perc M, Vilone D. 2019. The evolution of lying in well-mixed populations. J. R. Soc. Interface 16, 20190211 ( 10.1098/rsif.2019.0211) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Capraro V, Perc M, Vilone D. 2020. Lying on networks: the role of structure and topology in promoting honesty. Phys. Rev. E 101, 032305. [DOI] [PubMed] [Google Scholar]
  • 57.Peysakhovich A, Nowak MA, Rand DG. 2014. Humans display a ‘cooperative phenotype’ that is domain general and temporally stable. Nat. Commun. 5, 1–8. ( 10.1038/ncomms5939) [DOI] [PubMed] [Google Scholar]
  • 58.Curry OS, Mullins DA, Whitehouse H. 2019. Is it good to cooperate? Testing the theory of morality-as-cooperation in 60 societies. Curr. Anthropol. 60, 47–69. ( 10.1086/701478) [DOI] [Google Scholar]
  • 59.Berg J, Dickhaut J, McCabe K. 1995. Trust, reciprocity, and social history. Games Econ. Behav. 10, 122–142. ( 10.1006/game.1995.1027) [DOI] [Google Scholar]
  • 60.Glaeser EL, Laibson DI, Scheinkman JA, Soutter CL. 2000. Measuring trust. Q. J. Econ. 115, 811–846. ( 10.1162/003355300554926) [DOI] [Google Scholar]
  • 61.Bohnet I, Zeckhauser R. 2004. Trust, risk and betrayal. J. Econ. Behav. Organ. 55, 467–484. ( 10.1016/j.jebo.2003.11.004) [DOI] [Google Scholar]
  • 62.Malhotra D. 2004. Trust and reciprocity decisions: the differing perspectives of trustors and trusted parties. Organ. Behav. Hum. Decis. Process. 94, 61–73. ( 10.1016/j.obhdp.2004.03.001) [DOI] [Google Scholar]
  • 63.Kosfeld M, Heinrichs M, Zak PJ, Fischbacher U, Fehr E. 2005. Oxytocin increases trust in humans. Nature 435, 673–676. ( 10.1038/nature03701) [DOI] [PubMed] [Google Scholar]
  • 64.Fehr E. 2009. On the economics and biology of trust. J. Eur. Econ. Assoc. 7, 235–266. ( 10.1162/JEEA.2009.7.2-3.235) [DOI] [Google Scholar]
  • 65.Johnson ND, Mislin AA. 2011. Trust games: a meta-analysis. J. Econ. Psychol. 32, 865–889. ( 10.1016/j.joep.2011.05.007) [DOI] [Google Scholar]
  • 66.Ortmann A, Fitzgerald J, Boeing C. 2000. Trust, reciprocity, and social history: a re-examination. Exp. Econ. 3, 81–100. ( 10.1023/A:1009946125005) [DOI] [Google Scholar]
  • 67.Fetchenhauer D, Dunning D. 2009. Do people trust too much or too little? J. Econ. Psychol. 30, 263–276. ( 10.1016/j.joep.2008.04.006) [DOI] [Google Scholar]
  • 68.Dunning D, Fetchenhauer D, Schlösser TM. 2012. Trust as a social and emotional act: noneconomic considerations in trust behavior. J. Econ. Psychol. 33, 686–694. ( 10.1016/j.joep.2011.09.005) [DOI] [Google Scholar]
  • 69.Corgnet B, Espín AM, Hernán-González R, Kujal P, Rassenti S. 2016. To trust, or not to trust: cognitive reflection in trust games. J. Behav. Exp. Econ. 64, 20–27. ( 10.1016/j.socec.2015.09.008) [DOI] [Google Scholar]
  • 70.Ben-Ner A, Halldorsson F. 2010. Trusting and trustworthiness: what are they, how to measure them, and what affects them. J. Econ. Psychol. 31, 64–79. ( 10.1016/j.joep.2009.10.001) [DOI] [Google Scholar]
  • 71.Ermisch J, Gambetta D, Laurie H, Siedler T, Noah Uhrig S. 2009. Measuring people’s trust. J. R. Stat. Soc.: Ser. A (Stat. Soc.) 172, 749–769. ( 10.1111/j.1467-985X.2009.00591.x) [DOI] [Google Scholar]
  • 72.Espín AM, Exadaktylos F, Neyse L. 2016. Heterogeneous motives in the trust game: a tale of two roles. Front. Psychol. 7, 728 ( 10.3389/fpsyg.2016.00728) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Binder K, Hermann DK. 1988. Monte Carlo simulations in statistical physics. Heidelberg, Germany: Springer. [Google Scholar]
  • 74.Masuda N. 2012. Evolution of cooperation driven by zealots. Sci. Rep. 2, 646 ( 10.1038/srep00646) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Grafen A. 1990. Biological signals as handicaps. J. Theor. Biol. 144, 517–546. ( 10.1016/S0022-5193(05)80088-8) [DOI] [PubMed] [Google Scholar]
  • 76.Catteeuw D, Han TA, Manderick B. 2014. Evolution of honest signaling by social punishment. In Proc. of the 2014 Annual Conf. on Genetic and Evolutionary Computation, pp. 153–160.
  • 77.Han TA, Pereira LM, Santos FC, Lenaerts T. 2013. Good agreements make good friends. Sci. Rep. 3, 2695. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Han TA, Pereira LM, Lenaerts T. 2015. Avoiding or restricting defectors in public goods games? J. R. Soc. Interface 12, 20141203 ( 10.1098/rsif.2014.1203) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Pereira LM, Lenaerts T. et al. 2017. Evolution of commitment and level of participation in public goods games. Auton. Agents Multi-Agent Syst. 31, 561–583. ( 10.1007/s10458-016-9338-4) [DOI] [Google Scholar]
  • 80.McNamara JM, Stephens PA, Dall SR, Houston AI. 2009. Evolution of trust and trustworthiness: social awareness favours personality differences. Proc. R. Soc. B 276, 605–613. ( 10.1098/rspb.2008.1182) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 81.Manapat ML, Nowak MA, Rand DG. 2013. Information, irrationality, and the evolution of trust. J. Econ. Behav. Organ. 90, S57–S75. ( 10.1016/j.jebo.2012.10.018) [DOI] [Google Scholar]
  • 82.Manapat ML, Rand DG. 2012. Delayed and inconsistent information and the evolution of trust. Dyn. Games Appl. 2, 401–410. ( 10.1007/s13235-012-0055-6) [DOI] [Google Scholar]
  • 83.Abbass H, Greenwood G, Petraki E. 2015. The N-player trust game and its replicator dynamics. IEEE Trans. Evol. Comput. 20, 470–474. ( 10.1109/TEVC.2015.2484840) [DOI] [Google Scholar]
  • 84.Rauwolf P, Bryson JJ. 2018. Expectations of fairness and trust co-evolve in environments of partial information. Dyn. Games Appl. 8, 891–917. ( 10.1007/s13235-017-0230-x) [DOI] [Google Scholar]
  • 85.Chica M, Chiong R, Ramasco JJ, Abbass H. 2019. Effects of update rules on networked N-player trust game dynamics. Commun. Nonlinear Sci. Numer. Simul. 79, 104870 ( 10.1016/j.cnsns.2019.104870) [DOI] [Google Scholar]
  • 86.Santos FC, Pacheco JM. 2006. A new route to the evolution of cooperation. J. Evol. Biol. 19, 726–733. [DOI] [PubMed] [Google Scholar]
  • 87.Andras P. et al. 2018. Trusting intelligent machines: deepening trust within socio-technical systems. IEEE Technol. Soc. Mag. 37, 76–83. ( 10.1109/MTS.2018.2876107) [DOI] [Google Scholar]
  • 88.Rand DG, Dreber A, Ellingsen T, Fudenberg D, Nowak MA. 2009. Positive interactions promote public cooperation. Science 325, 1272–1275. ( 10.1126/science.1177418) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 89.Gürerk Ö, Irlenbusch B, Rockenbach B. 2006. The competitive advantage of sanctioning institutions. Science 312, 108–111. ( 10.1126/science.1123633) [DOI] [PubMed] [Google Scholar]
  • 90.Szolnoki A, Perc M. 2012. Evolutionary advantages of adaptive rewarding. New J. Phys. 14, 093016 ( 10.1088/1367-2630/14/9/093016) [DOI] [Google Scholar]
  • 91.Milinski M, Semmann D, Krambeck HJ, Marotzke J. 2006. Stabilizing the Earth’s climate is not a losing game: supporting evidence from public goods experiments. Proc. Natl Acad. Sci. USA 103, 3994–3998. ( 10.1073/pnas.0504902103) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.Martinez-Vaquero LA, Han TA, Pereira LM, Lenaerts T. 2015. Apology and forgiveness evolve to resolve failures in cooperative agreements. Sci. Rep. 5, 10639 ( 10.1038/srep10639) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Capraro V, Giardini F, Vilone D, Paolucci M. 2016. Partner selection supported by opaque reputation promotes cooperative behavior. Judgment Decis. Mak. 11, 589–600. [Google Scholar]
  • 94.Melo CD, Marsella S, Gratch J. 2016. People do not feel guilty about exploiting machines. ACM Trans. Comput.-Hum. Interact. (TOCHI) 23, 1–17. ( 10.1145/2890495) [DOI] [Google Scholar]
  • 95.Martinez-Vaquero LA, Han TA, Pereira LM, Lenaerts T. 2017. When agreement-accepting free-riders are a necessary evil for the evolution of cooperation. Sci. Rep. 7, 1–9. ( 10.1038/s41598-017-02625-z) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Pereira LM, Lenaerts T, Martinez-Vaquero LA, Han TA. 2017. Social manifestation of guilt leads to stable cooperation in multi-agent systems. In AAMAS '17: Proc. of the 16th Conf. on Autonomous Agents and MultiAgent Systems, 8–12 May, São Paulo, Brazil, pp. 1422–1430. New York, NY: ACM.
  • 97.Fang Y, Benko TP, Perc M, Xu H, Tan Q. 2019. Synergistic third-party rewarding and punishment in the public goods game. Proc. R. Soc. A 475, 20190349 ( 10.1098/rspa.2019.0349) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98.Fudenberg D, Imhof LA. 2006. Imitation processes with small mutations. J. Econ. Theor. 131, 251–262. ( 10.1016/j.jet.2005.04.006) [DOI] [Google Scholar]
  • 99.Veller C, Hayward LK. 2016. Finite-population evolution with rare mutations in asymmetric games. J. Econ. Theory 162, 93–113. ( 10.1016/j.jet.2015.12.005) [DOI] [Google Scholar]
  • 100.Taylor PD, Irwin AJ. 2000. Overlapping generations can promote altruistic behavior. Evolution 54, 1135–1141. ( 10.1111/j.0014-3820.2000.tb00549.x) [DOI] [PubMed] [Google Scholar]
  • 101.Bao M, Wild G. 2012. Reproductive skew can provide a net advantage in both conditional and unconditional social interactions. Theor. Popul. Biol. 82, 200–208. ( 10.1016/j.tpb.2012.06.006) [DOI] [PubMed] [Google Scholar]
  • 102.Rand DG, Brescoll VL, Everett JA, Capraro V, Barcelo H. 2016. Social heuristics and social roles: intuition favors altruism for women but not for men. J. Exp. Psychol.: Gen. 145, 389 ( 10.1037/xge0000154) [DOI] [PubMed] [Google Scholar]
  • 103.Rand DG. 2017. Social dilemma cooperation (unlike Dictator Game giving) is intuitive for men as well as women. J. Exp. Soc. Psychol. 73, 164–168. ( 10.1016/j.jesp.2017.06.013) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104.Brañas-Garza P, Capraro V, Rascon-Ramirez E. 2018. Gender differences in altruism on Mechanical Turk: expectations and actual behaviour. Econ. Lett. 170, 19–23. ( 10.1016/j.econlet.2018.05.022) [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Robustness tests
rsif20200491supp1.pdf (183.8KB, pdf)

Data Availability Statement

This paper has no additional data.


Articles from Journal of the Royal Society Interface are provided here courtesy of The Royal Society

RESOURCES