Abstract
Economic inequality is associated with preferences for smaller, immediate gains over larger, delayed ones. Such temporal discounting may feed into rising global inequality, yet it is unclear whether it is a function of choice preferences or norms, or rather the absence of sufficient resources for immediate needs. It is also not clear whether these reflect true differences in choice patterns between income groups. We tested temporal discounting and five intertemporal choice anomalies using local currencies and value standards in 61 countries (N = 13,629). Across a diverse sample, we found consistent, robust rates of choice anomalies. Lower-income groups were not significantly different, but economic inequality and broader financial circumstances were clearly correlated with population choice patterns.
Subject terms: Human behaviour, Economics, Social policy
Ruggeri et al. find in a study of 61 countries that temporal discounting patterns are globally generalizable. Worse financial environments, greater inequality and high inflation are associated with extreme or inconsistent long-term decisions.
Main
Effective financial choices over time are essential for securing financial well-being1,2, yet individuals often prefer immediate gains at the expense of future outcomes3,4. This tendency, known as temporal discounting5, is often treated as a behavioural anomaly measured by presenting a series of choices that vary values, timelines, framing (for example, gains or losses) and other trade-offs6. Responses can then be aggregated or indexed in ways that test different manifestations of the anomaly, whether strictly the trade-off of immediate versus future or the threshold at which individuals are willing to change their preference6.
Anomalies identified under temporal discounting are routinely associated with lower wealth7–14, which is especially concerning given incongruent impacts on economic inequality brought about by the COVID-19 pandemic15. Inequality and low incomes have also routinely been associated with greater discounting of future outcomes13,16,17, so it is not surprising that global studies would find temporal discounting (to varying degrees) in populations around the world8. However, the prevailing interpretations (that is, that lower-income groups show more extreme discounting18,19) may result from narrow measurement approaches, such as only assessing immediate gains versus future gains.
Another limitation of interpretations regarding discounting and economic classes involves the relative aspect of financial choices compared to income and wealth. Consider the patterns presented in Fig. 1a, which represent six months of spending patterns for 15,568 individuals in the United States who received stimulus payments as part of the 2020 CARES Act20. If the average amount spent 60 days prior to receiving the payment is used as a baseline, the lower-income group spent over 23 times more than baseline immediately after receipt, compared with around 10 times more than baseline for middle- and higher-income individuals. Apart from those days immediately following receipt, the relative spending patterns are almost identical for all three groups. However, as indicated on the right, those with higher incomes spent more in raw values, indicating that behaviours are more extreme only relative to income, and in fact, high-income individuals spent the most on average after receiving stimulus payments. While relative values may differentiate the consequences of spending, the spending patterns were generally about the same.
In this research, we aimed to test how broadly generalizable patterns of temporal discounting are around the world, incorporating social and economic factors as well as multiple measures of intertemporal choice. With broader testing of more anomalies, rather than being limited to indifference points (a threshold value for preferring now versus later), more robust conclusions can be drawn about choice patterns. In this vein, the most comprehensive related study found that lower-income countries had lower trust in systems and had the steepest rates of discounting (that is, the threshold for giving up an immediate gain for a later, larger one was much higher)8,21. As the indifference point was the primary indicator, these results are extremely important but do not necessarily mean that lower-income populations have distinct decision-making patterns. Three similar studies also tested temporal choice in large, multi-national populations, some including more than 50,000 participants from more than 50 countries18,22. These studies largely focused on smaller-sooner versus larger-later constructs of temporal discounting. Most concluded that lower income and wealth, among other micro and macro variables, were strong predictors of higher discounting (or lower patience). However, these studies did not incorporate a broad range of temporal choice constructs, as their focus was typically specific to time preferences.
To avoid the limitations of relying only on indifference points and to assess the generalizability of temporal discounting on a near-global scale, we used a similar method to those studies but tested multiple intertemporal choice domains. Our approach allows the rates of certain anomalies to be considered along with specific value thresholds. Our aim was to test each of these patterns for generalizability while also factoring in multiple economic aspects across populations, primarily wealth, inequality, debt and inflation. We pre-registered (https://osf.io/jfvh4) six primary hypotheses, anticipating that temporal discounting would be observed in all countries to varying extents, though mean differences between countries would be less extreme than variability within countries, both overall and for specific anomalies. We also anticipated that economic inequality would be a strong predictor of national discounting averages.
Inflation, which tends to be higher in lower-income countries23, is also associated with stronger preferences for immediate gains24,25. In our final hypothesis, we expected to confirm this pattern, indicating that such preferences may be associated with increased probability that future gains will be worth substantially less than their current value. We expected that this might be even more broadly impactful than income or wealth, though each interacts in some way and all should be considered. We limited our hypotheses to inflation versus extreme inflation: we expected that differences in preferences would emerge only at substantially larger inflation rates (over 10%) and hyperinflation (over 50%), and less so between regions with varied but less extreme differences (substantively below 10%).
To test our hypotheses, we used four choice anomalies outlined in one of the most influential articles26 on intertemporal choice—absolute magnitude, gain–loss asymmetry, delay–speedup asymmetry and common difference (we refer to this as present bias, which is the more common term)—plus a fifth, subadditivity, to complete three inter-related time intervals27. In contrast to most discounting research, using a series of intertemporal choice anomalies28 identified in WEIRD labs allows us to test including patterns that choice models often ignore. When multiple anomalies are tested alongside a simplified indifference measure (derived from the first set of choices), the prevalence of each anomaly provides a more robust determination of the generalizability of the construct than an indifference point alone.
By addressing both the depth of the method used and concerns about the generalizability of behavioural research29, the richer perspective of our approach to measuring intertemporal decision-making in a global sample allows us to assess the presence and prevalence of anomalies in local contexts. It also allows us to test potential relationships with economic inequality to determine whether low-income groups are somehow more extreme decision-makers or whether the environment, beyond simply individual circumstances, is a more impactful factor across populations.
Most research on temporal preferences uses indifference points6, which determine the threshold at which individuals will shift from immediate to delayed (and vice versa). Data from that approach are robust and converge on an inverse relationship between income/wealth and discounting rate. However, multiple binary choice comparisons are ideal for demonstrating multidimensional choice patterns, as in prospect theory, expected utility and other choice paradoxes or cognitive biases. They are also better suited for testing in multiple countries30,31 when multiple small adaptations to values in different currencies are necessary. Taking this into consideration, our method leveraged one of the most widely cited papers on decision-making26, which proposed four critical intertemporal choice anomalies. While studies of individual anomalies exist from various regions32–34, our approach aimed to produce a comprehensive multi-country assessment that simultaneously tested the generalizability of all four:
Absolute magnitude: Increased preference for delayed gains when values become substantially larger, even when relative differences are constant (for example, prefer $500 now over $550 in 12 months and prefer $5,500 in 12 months over $5,000 now4,7).
Gain–loss asymmetry: Gains are discounted more than losses, though differences (real and relative) are constant (for example, prefer to receive $500 now over $550 in 12 months, but also prefer to pay $500 now over paying $550 in 12 months).
Delay–speedup asymmetry: Accepting an immediate, smaller gain if the delay is framed as added value, but preferring the larger, later amount if an immediate gain is framed as a reduction (for example, prefer to receive a gain of $500 rather than wait 12 months for an additional $50 and prefer to wait for 12 months to receive $550 rather than to pay $50 and receive the gain now).
Present bias: Lower discounting over a given time interval when the start of the interval is shifted to the future (for example, prefer $500 now over $550 in 12 months and prefer $550 in two years over $500 in 12 months).
We also assess subadditivity27 effects, which adds an interval of immediate to 24 months, thereby allowing us to fully assess discounting over three time intervals (0–12, 12–24 and 0–24 months)35. Subadditivity is considered present if discounting is higher for the two 12-month intervals than for the 24-month interval.
All data were collected independent of any other study or source, with a 30-item instrument developed specifically for assessing a base discounting level and then the five anomalies. To validate the metric, a three-country pilot study (Australia, Canada and the United States) was conducted to confirm that the method elicited variability in choice preferences. We did not assess what specific patterns of potential anomalies emerged to avoid biasing methods or decisions related to currency adaptations.
For the full study, all participants began with choosing either approximately 10% of the national monthly household income average (either median or mean, depending on the local standard) immediately, or 110% of that value in 12 months. For US participants, this translated into US$500 immediately or US$550 in one year. Participants who chose the immediate option were shown the same option set, but the delayed value was now 120% (US$600). If they continued to prefer the immediate option, a final option offered 150% (US$750) as the delayed reward. If participants chose the delayed option initially, subsequent choices were 102% (US$510) and 101% (US$505). This progression was then inverted for losses, with the same values presented as payments, increasing for choosing delayed and decreasing for choosing immediate. Finally, the original gain set was repeated using 100% of the average monthly income to represent higher-magnitude choices (Supplementary Table 1).
After the baseline scenarios, the anomaly scenarios incorporated the simplified indifference point (the largest value at which the participants chose the delayed option in the baseline items; see Supplementary Methods). Finally, the participants answered ten questions on financial circumstances, (simplified) risk preference, economic outlook and demographics. The participants could choose between the local official language (or languages) and English. By completion, 61 countries (representing approximately 76% of the world population) had participated (Supplementary Tables 2 and 3).
We assessed temporal choice patterns in three ways. First, we used the three baseline scenarios to determine preferences for immediate or delayed gains (at two magnitudes) and losses (one). Second, we calculated the proportion of participants who exhibited the theoretically described anomaly for each anomaly scenario (Supplementary Table 4). We also calculated proportions of participants who exhibited inconsistent decisions even if not specifically aligned with one of the defined anomalies. Finally, we computed a discounting score based on responses to all choice items, ranging from 0 (always prefer delayed gains or earlier losses) to 19 (always prefer immediate gains or delayed losses). The score then represents the consistency of discounting behaviours, irrespective of the presence of other choice anomalies (see Supplementary Information for details on reliability and validity).
To explore individual and country-level differences, we performed a series of multilevel linear and generalized mixed models that predicted standardized temporal discounting scores and anomalies, respectively. We ran a set of increasingly complex models, including inequality indicators, while controlling for individual debt and assets, age, education, employment, log per-capita gross domestic product (GDP) and inflation at the individual and country levels. Because the raw scores (0–19) have no standard to compare against, we primarily used standardized scores (with a mean of 0 and standard deviation of 1) for analysis and visualization.
We detected several relevant nonlinear effects (debt, financial assets and inflation; Supplementary Tables 5–7), which we incorporated into our final models via spline modelling36. The models were estimated using both frequentist (Supplementary Tables 8 and 9 and Supplementary Figs. 1 and 2) and Bayesian techniques (Supplementary Tables 10 and 11), assessing the consistency of the results. Support for potential null effects was evaluated using a variety of Bayesian approaches (Supplementary Table 12).
There are some limitations in our approach. The most noteworthy is that we are limited to hypothetical scenarios in which the participants had no motivation to give a particular answer, which might have impacted responses had true monetary awards been offered. Though Japanese participants received payment, it was not contingent on their choices, so the same limitation holds. While that might have been an ideal approach, substantial evidence indicates that such hypothetical scenarios do not differ substantively from actual choices, and many such approaches have been validated to correlate with real-world behaviours37–42. Naturally, this does not provide a perfect replacement for comprehensive real-world behavioural observations, but there is sufficient evidence to indicate that hypothetical approaches yield reasonably valid results. The second limitation is that our approach to minimizing bias through highly randomized and broad data collection yielded demographics that varied in representativeness. For indications of how this may have impacted the results, we included a complementary demographics table for comparison between the sample and true national characteristics (Supplementary Table 18).
Finally, in terms of robustness in our methods, we opted for five anomalies tested in relatively short form rather than a smaller number of domains in long form. We did this in part because it would be a meaningful contribution to the field as well as because it was more important to demonstrate the existence of anomalies than to emphasize precise thresholds (for example, indifference points). Though it was impractical to do comprehensive, adaptive measures for our approach, we strongly encourage future studies involving both a broad number of choice domains and extensive measures within each to offer greater precision.
Results
For 13,629 participants from 61 countries, we find that temporal discounting is widely present in every location, indicating consistency and robustness (with some variability) across all five intertemporal choice anomalies (Fig. 2). Income, economic inequality, financial wealth and inflation demonstrated clear links to the shape and magnitude of intertemporal choice patterns. Better financial environments were consistently associated with lower rates of temporal discounting, whereas higher levels of inequality and inflation were associated with higher rates of discounting. Yet, the overall likelihood of exhibiting anomalies remained stable irrespective of most factors.
Differences between locations are evident, though remarkable consistency of variability exists within countries. Such patterns demonstrate that temporal discounting and intertemporal choice anomalies are widely generalizable, and that differences between individuals are wider than differences between countries. Being low-income is not alone in relating to unstable decision-making; being in a more challenging environment is also highly influential.
The scientific and policy implications from these findings challenge simple assumptions that low-income individuals are fundamentally extreme decision-makers. Instead, these data indicate that anyone facing a negative financial environment—even with a better income within that environment—is likely to make decisions that prioritize immediate clarity over future uncertainty. While we do not explicitly test risk in the temporal measures, all future prospects inherently hold a risk component, which is compounded by temporal distance and environmental instability (that is, the further the distance between two prospects and the less stable the future may be, the greater the inherent risk difference may be perceived between an immediate and a future prospect)43–45. Likewise, the data indicate that all individuals at all income levels in all regions are more likely than not to demonstrate one or more choice anomalies.
Detailed analysis of temporal choice anomalies
We collected 13,629 responses from 61 countries (median sample size of 209, Supplementary Tables 2 and 3). Though the absolute minimum sample size necessary was 30 per country, the sliding scale used for ensuring full power (see Selection of countries) started at 120, increasing to 360 for larger countries. Forty-six countries achieved the target sample size, and 56 had at least 120 (with at least four countries per continent at 120), thus providing a wide range of economic and cultural environments. Only two countries, where data collection was exceptionally challenging, had below 90 participants, but all locations were still substantially above the absolute minimum. As well as exceeding the minimum sample size, we chose to retain these participants in the analyses because they represent groups often not included in behavioural science46,47.
In line with related research8, Fig. 3 shows how countries with lower incomes typically had greater temporal discounting levels in the baseline items (Supplementary Table 14). This was most evident in the tendency to prefer immediate gains, even as delayed prospects increased. This pattern was not found for the loss scenario. However, as noted, these items give a useful measure for the indifference level for each individual but do not give a robust indication of whether temporal choice anomalies are present.
Between-countries random-effect meta-analyses estimated pooled and unpooled effects for aggregate scores and individual anomalies (Supplementary Figs. 3–8). Temporal discounting was present in all countries, with only modest variability in national means (aggregate mean, 10.3; prediction interval, (6.8, 13.8); from Japan (mean = 7.1, s.d. = 3.9) to Argentina (mean = 14.1, s.d. = 3.0); Fig. 4). Overall, 54% of participants showed at least one anomaly, with 33% presenting multiple and only 2% showing four (Supplementary Table 15). Anomalies were present in all locations, and aggregate values indicated the widespread presence of the four primary anomalies (from 13.8% for absolute magnitude to 40.1% for gain–loss asymmetry, Fig. 3). Gain–loss rates were the most common anomaly in 80.3% (49) of the countries, with substantially higher rates observed than for the other anomalies. While only 10.7% of the sample engaged in subadditivity behaviour (range, 2.7% (Lebanon) to 20.7% (New Zealand)), the criteria were stricter for this anomaly.
In all cases, significant Q-tests and I2 values over 70% suggested that effect size variation at the country level could not be accounted for by sampling variation alone. There were strong relationships between the individual and aggregate scores and some anomalies (that is, positive for absolute magnitude and negative for present bias and delay–speedup; Supplementary Fig. 9). Additionally, we found a negative link between GDP and temporal discount scores (β = −0.07; P = 0.001; 95% confidence interval, (−0.12, −0.03)), and positive effects for present bias (odds ratio (OR), 1.09; P = 0.003; 95% confidence interval, (1.03, 1.16)) and delay–speedup (OR = 0.95; P = 0.002; 95% confidence interval, (0.91, 0.99)). We found no evidence of an association for the remaining anomalies (0.95 < OR < 1.01, 0.027 < P < 0.688). We note that some ORs in the non-significant anomalies were similar to those that were significant, but given the sample size, we adhered to a strict cut-off for significance; future research may benefit from reanalysing these data within each country to explore whether more delineated patterns may exist between aggregate wealth and temporal choice anomalies.
Despite between-country differences in mean scores and anomaly rates, there was substantial overlap between response distributions. Accordingly, results from multilevel models indicated that no more than 20% of the variance was ever explained by between-country differences for scores and was between 2% (absolute magnitude) and 8% (present bias) for anomalies. We thus find temporal discounting to be globally generalizable, robust and highly consistent (in line with expectations) (Supplementary Table 6 and Supplementary Fig. 10), where within-country differences between individuals are substantially greater than between-country differences. In other words, we find temporal discounting to be a globalizable (though not universal) construct. We also find that there is nothing WEIRD about intertemporal choice anomalies.
Inequality
We defined inequality at the level of the country and at the level of the individual. For countries, we used the most recently published Gini coefficients48. For individuals, we calculated the difference between their reported income and the adjusted net median local (country) income. At the country level, Gini had a positive relationship with temporal discounting scores (β = 0.09; P = 0.002; 95% confidence interval, (0.02, 0.06); Supplementary Table 8), yet no such pattern emerged for specific anomalies, as we observed no significant effect for the remaining cases (0.92 < OR < 1.01, 0.023 < P < 0.825, Supplementary Table 8). Individual income inequality did not predict temporal discounting scores (β = −0.01; P = 0.121; 95% confidence interval, (−0.03, 0.001)) or rates of anomalies (0.96 < OR < 1.04, 0.045 < P < 0.867, Supplementary Tables 8 and 9), except two small effects for present bias (OR = 1.07; P = 0.006; 95% confidence interval, (1.03, 1.13)) and absolute magnitude (OR = 0.92; P = 0.006; 95% confidence interval, (0.87, 0.98); Supplementary Table 9).
As shown in Fig. 5, these patterns are largely in line with expectations, indicating that, in aggregate, greater inequality is associated with increased rates of discounting. However, as indicated in Fig. 3, intertemporal choice anomalies overall are not unique to a specific income level, and worse financial circumstances may be associated with more consistent choice patterns (that is, fewer anomalies) due to sustained preference for sooner gains. Whether this aligns with arguments that scarcity leads individuals to focus on present challenges is worthy of further exploration49. It also reiterates that patterns in population (that is, country) aggregates are not the same as predicting individual choices50.
Assets and debt
We found consistently that greater willingness to delay larger gains tends to be associated with greater wealth (financial assets), except for the extremely wealthy. Temporal discounting scores generally decreased as wealth increased, except for the wealthiest individuals (expected degrees of freedom (e.d.f.) (see ‘Further details on modeling temporal discounting’ in the Supplementary Information), 2.88; P < 0.0001; Supplementary Table 8 and Supplementary Fig. 2). We also observed assets being associated with present bias (e.d.f. = 1.01, P < 0.0001) and with delay–speedup (e.d.f. = 2.78, P < .0001). We observed the reverse pattern for absolute magnitude (e.d.f. = 1.96, P = 0.0009). For gain–loss asymmetry (e.d.f. = 0.474, P = 0.144) and subadditivity (e.d.f. = 0.001, P = 0.472), we found no meaningful relationship between assets and the likelihood of observing either (Supplementary Table 9 and Supplementary Fig. 2). Higher levels of debt were associated with lower discount rates, particularly for people with lower to medium debt (e.d.f. = 2.91, P < 0.0001, Supplementary Fig. 1), though there was no significant effect observed regarding debt and the likelihood of engaging in any specific anomaly (0.95 < OR < 1.01, 0.035 < P < 0.944, Supplementary Table 9).
Inflation
We observed strong relationships between inflation rates and temporal discounting scores as well as all anomalies. There was a particularly strong effect of hyperinflation on temporal discounting (e.d.f. = 1.81, P < 0.0001, Supplementary Table 8 and Supplementary Fig. 1), with some levelling out at the extremes. Countries experiencing severe hyperinflation demonstrate extreme discounts only for gains but not for payments, which minimizes the effect on total scores. However, if limiting to only gains, the effect remains extreme, as indicated by the two gain scenarios in Fig. 3.
We observed a reverse trend of higher inflation being associated with a lower likelihood of engaging in anomalies (Supplementary Table 9 and Supplementary Fig. 2)—namely, for present bias (e.d.f. = 1.63, P < 0.0001), absolute magnitude (e.d.f. = 1.92, P < 0.0001), delay–speedup (e.d.f. = 1.75, P < 0.0001) and subadditivity (e.d.f. = 1.37, P = 0.0019). The only positive (but weaker) effect in the case of anomalies was found for gain–loss asymmetry (e.d.f. = 1.675, P = 0.0051).
Discussion
For good reason, psychological theory has come under considerable recent criticism due to a number of failed replications of previously canonical constructs51. There is also wide support to consider that the absence of testing (or adapting methods to test) across populations limits the presumed generalizability of conclusions in the field29. To the extent that it is possible for any behavioural phenomenon, we find temporal discounting and common intertemporal choice anomalies to be globally generalizable. This is largely based on finding remarkable consistency and robustness in patterns of intertemporal choice across 61 countries, with substantially more variability within each country than between their means. We emphasize that while discounting may be stronger in worse financial circumstances, particularly those with poorer economic outlooks, it exists in all locations at measurable levels.
We do not imply that temporal discounting and specific intertemporal choice anomalies are universal (that is, present in all individuals at all times). Instead, our findings provide extreme confidence that the constructs tested are robust on a global level. In our view, they also disrupt some notions that lower-income individuals are somehow inherently unstable decision-makers, as negative environments are widely influential. Under such circumstances, it is both rational and, as our data show, entirely typical to follow the choice preferences we present.
We hope these findings will be considered in both science and policy, particularly in how governments and institutions can directly impact inequality. Consider excessive savings requirements to acquire mortgages52, less favourable lending terms for low earners53, harmful interest rates on financing necessities such as education, restricting access to foreign currency and focusing taxes on income without considering wealth, assets or capital54. Some of these are based on assumptions of how income and wealth are primary indicators of long-term decision-making, but in fact those policies alone can create economic barriers that impact upward economic mobility. On top of impeding mobility, these policies risk institutional resilience by offering better terms (and therefore taking on greater risk) to higher-wealth groups on the basis of reductionist presumptions about who has the lowest discounting rates, or ignoring how inflation may impact spending and saving behaviours among the most financially vulnerable.
The scope of the work, particularly the diversity of these 13,629 participants across 61 countries, should encourage more tests of global generalizability of fundamental psychological theory that adapt to local standards and norms. Similarly, policymakers should consider the effects of economic inequality and inflation beyond incomes and growth and give greater consideration to how they directly impact individual choices for entire populations, affecting long-term well-being.
Methods
Ethical approval was given by the Institutional Review Board at Columbia University for both the pilot study and the full study. For the full study, all countries involved had to provide attestations of cultural and linguistic appropriateness for each version of the instrument. Because this was not possible for the pilot study, ethical approval was given only to check the quality, flow and appropriateness of the survey instrument, but not to analyse or report data. For all data, all participants provided informed consent at the start of the survey, and no forms of deception or hidden purpose existed, so all aspects were fully explained.
The materials and methods followed our pre-registered plan (https://osf.io/jfvh4). Substantive deviations from the original plan are highlighted in each corresponding section, alongside the justification for the deviation. All details on the countries included, translation, testing and sampling are included in the Supplementary Information.
Participants
The final dataset was composed of 13,629 responses from 61 countries. The original sample size was 25,877, which was reduced almost by half after we performed pre-registered data exclusions. We removed 6,141 participants (23.7%) who did not pass our attention check (a choice between receiving 10% of monthly income now or paying the same amount in one year). We removed 69 participants for presenting non-sensical responses to open data text (for example, ‘helicopter’ as gender). We removed 13 participants claiming to be over 100 years old. We included additional filters to our original exclusion criteria. Regarding the length of time for responses, individuals faster than three times the absolute deviation below the median time or that took less than 120 seconds to respond were removed. This criterion allowed us to identify 5,870 inappropriate responses. We further removed responses from IP addresses identified as either ‘tests’ or ‘spam’ by the Qualtrics service (264 answers identified). Lastly, we did not consider individuals not completing over 90% of the survey (9,434 responses failed this criterion). Note that these values add up to more than 100% because participants could fail multiple criteria.
For analyses including income, assets and debt, we conducted additional quality checks. We first removed 38 extreme income, debt or assets (values larger than 1 × 108) responses. Next, we removed extreme outliers larger than 100 times the median absolute deviation above the country median for income and 1,000 times larger than the median absolute deviation for national median assets. We further removed anyone that simultaneously claimed no income while also being employed full-time. These quality checks identified 54 problematic responses, which were removed from the data. The final sample and target size are presented in Supplementary Table 2. We provide descriptive information on the full and by-country samples in Supplementary Table 3 and the main variables in Supplementary Table 4.
Instrument
The instrument was designed by evaluating methods used in similar research, particularly those with a multi-country focus8,21,29 or that covered multiple dimensions of intertemporal choice13,28. On the basis of optimal response and participation in two recent studies6,49 of a similar nature, we implemented an approach that could incorporate these features while remaining brief. This design increased the likelihood of reliable and complete responses.
To confirm the viability of our design, we assessed the overall variability of pilot study data from 360 participants from the United States, Australia and Canada. The responses showed that the items elicited reasonable answers, and the three sets of baseline measures yielded responses that would be expected for the three countries. Specifically, it was more popular to choose earlier gains over larger, later ones for the smaller magnitude and closer to 50–50 for the larger magnitude and the payment set. The subsequent choice anomalies also yielded variability within items, which showed some variability between countries. These results confirmed that using baseline choices to set trade-off values in anomaly items was appropriate and would capture relevant differences. We did not analyse these data in full per our Institutional Review Board approval, as we did not want a detailed analysis of subsequent bias decisions. The pilot was completed in April 2021 with participants on the Prolific platform (compensated for participation, not for choices made).
The final version of the instrument required the participants to respond to as few as 10 to as many as 13 anomaly items. All items were binary. During the first three anomaly sets, if a participant chose immediate and then delay (or vice versa), they proceeded to the next anomaly, so only two questions were required. If they decided on immediate–immediate or delay–delay, they would see the third set. After the anomalies, the participants answered ten questions about financial preferences, circumstances and outlook (most of these will be analysed in independent research). Finally, the participants provided age, race/ethnicity/immigration status, gender, education, employment and region of residence. Supplementary Table 1 presents all possible values for each set of items used in the final version of the instrument.
All materials associated with the method are available in the pre-registration repository.
Selection of countries
By design, there was no systematic approach to country inclusion. Through a network of early career researchers worldwide, multiple invitations were sent and posted to collaborate. We explicitly emphasized including countries that are not typically included in behavioural research, and in almost every location, we had at least one local collaborator engaged. All contributors are named authors.
Following data collection, 61 countries were fully included, using 40 languages. All countries also had an English version to include non-native speakers who were uncomfortable responding in the local language. Of the 61 countries, 11 were from Asia, 8 were from the Americas, 5 were from sub-Saharan Africa, 6 were from the Middle East and North Africa, 2 were from Oceania, and 29 were from Europe (19 from the European Union). Several additional countries were attempted but were unable to fulfil certain tasks or were removed for ethical concerns.
Translation of survey items
All instruments went through forward-and-back translation for all languages used. In each case, this required at least one native speaker involved in the process. All versions were also available in English, applying the local currencies and other aspects, such as race and education reporting standards. A third reviewer was brought in if discrepancies existed that could not be solved through simple discussion. Similar research methods were also used for wording. The relevant details where issues arose are included in the Supplementary Information. For cultural and ethical appropriateness, demographic measures varied heavily. For example, in some countries, tribal or religious categories are used as the standard. Other countries, such as the US, have federal guidelines for race and ethnicity, whereas France disallows measures for racial identity. The country-by-country details are posted on the pre-registration page associated with this project.
All data were collected through Qualtrics survey links. For all countries, an initial convenience sampling of five to ten participants was required to ensure that comprehension, instrument flow and data capture were functional. Minor issues were corrected before proceeding to ‘open’ collection. Countries aimed to recruit approximately 30 participants before pausing to ensure functionality and that all questions were visible. We also checked that currency values had been appropriately set by inspecting responses’ variability (that is, if options were poorly selected, this would be visible in having all participants make the same choices across items). Minimal issues arose and are outlined in the Supplementary Information.
For data circulation, all collaborators were allowed a small number of convenience participants. This decision limited bias while ensuring the readiness of measures and instruments, as multiple collaborators in each country used different networks, thereby reducing bias. Once assurances were in place, we implemented what we refer to as the Demić–Većkalov method, which two prior collaborators in recent studies developed. This method involves finding news articles online (on social media, popular forums, news websites, discussion threads, sports team supporter discussion groups/pages and so on) and posting in active discussions, encouraging anyone interested in the subject to participate. Circulation included direct contact with local organizations (non-governmental organizations and non-profits, often with thematic interests in financial literacy, microcredit and so on) to circulate with stakeholders and staff, email circulars, generic social media posts, informal snowballing and paid samples (in Japan only; no other participants were compensated). We note that this approach to data collection with a generally loose structure was intentional to avoid producing a common bias across countries. Similar to recent, successful multi-country trials30,55, this generates more heterogeneous backgrounds, though it still skews toward populations with direct internet access (that is, younger, higher education and somewhat higher income).
As described in the pre-registration (https://osf.io/jfvh4), the minimum sample threshold to achieve a power of 0.95 for the models presented was 30 participants per country. However, to produce a more robust sample, we used three tiers for sample targets: population ≤ 10 million, 120 participants; 10 million ≤ population ≤ 100 million, 240 participants; and population > 100 million, 360 participants.
Comprehensive details about methods, guidelines, measurement building and instruments are available in the Supplementary Information and on the pre-registration site.
Procedure
For the full study, all participants began by choosing from two gains of approximately 10% of the national household income average (either median or mean, depending on the local standard) immediately, or 110% of that value in 12 months. For US participants, this translated into US$500 immediately or US$550 in one year. Participants who chose the immediate option were shown the same option set, but the delayed value was now 120% (US$600). If they preferred the immediate prospect, a final option offered 150% (US$750) as the delayed reward. If participants chose the delayed option initially, subsequent choices were 102% (US$510) and 101% (US$505). This progression was then inverted for losses, with the identical values presented as payments, increasing for choosing delayed and decreasing for choosing immediately. Finally, the original gain set was repeated using 100% of the monthly income to represent higher-magnitude choices.
Following the baseline scenarios, the anomaly scenarios incorporated the simplified indifference point, the largest value at which the participants chose the delayed option in the baseline items. For example, if an individual chose US$500 immediately over US$550 in 12 months, but US$600 in 12 months over US$500 immediately, then US$600 was the indifference value for subsequent scenarios. Those choices were then between US$500 in 12 months versus US$600 in 24 months (present bias), US$500 immediately versus US$700 in 24 months (subadditivity) and either being willing to wait 12 months for an additional US$100 in one set or being willing to lose US$100 to receive a reward now rather than in 12 months (delay–speedup). For consistency, the values were initially derived from local average income (local currency) and then from constant proportions based on the initial values (Supplementary Information). This approach was chosen over directly converting fixed amounts in each country due to the substantial differences in currencies and income standards.
Participants answered four additional questions related to the choice anomalies (gain–loss and magnitude effects were already collected in the first three sets). Due to contingencies in the instrument, all participants were then shown a present bias scenario (choice between 12 months and 24 months) followed by a subadditivity scenario (choice between immediate and 24 months). They were then randomly presented one of two delay–speedup scenarios (one framed as a bonus to wait, the other stated as a reduction to receive the gain earlier). After two similar but general choice and risk measures, they were presented with the second delay–speedup scenario. Due to the similarity in their wording, these scenarios were anticipated to have the lowest rates of anomalous choice. Finally, participants answered ten questions on financial circumstances, (simplified) risk preference, outlook and demographics. Participants could choose between the local official language (or languages) and English. By completion, 61 countries (representing approximately 76% of the world population) had participated.
We assessed temporal choice patterns in three ways. First, we tested discounting patterns from three baseline scenarios to determine preference for immediate or delayed choices for gains (at two magnitudes) and losses (one). Second, we analysed the prevalence of all choice anomalies using three additional items. Finally, with this information, we computed a discounting score based on responses to all choice items and anomalies, which ranged from 0 (always prefer delayed gains or earlier losses) to 19 (always prefer immediate gains or delayed losses).
Deviations from the pre-registered method
There were minor deviations from the pre-registered method in terms of procedure. First, we did include an attention check, and the statement that we would not should have been removed; this was an error. Second, we had initially not planned to include students in the main analyses. Still, our recruitment processes turned out to be generally appropriate in terms of engaging students (16%) and non-students (84%) in the sample. We are therefore not concerned about skew and instead consider this a critical population. The impact of these deviations in the analyses is explained in the Supplementary Information.
Statistical analysis
Hierarchical generalized additive models36 were estimated using fast restricted maximum likelihood and penalized cubic splines56. We selected the shrinkage version of cubic splines to avoid overfitting and foster the selection of only the most relevant nonlinear smooths57. Robustness checks were performed for the selection of knots (Supplementary Fig. 10) and spline basis (Supplementary Table 7), leaving the results unchanged. In these models, we estimated all effects of continuous variables as smooths to identify potential nonlinear variables, plus country of residence as random effects.
Relevant nonlinear effects were incorporated into our main linear and generalized mixed models. These models were fitted using a restricted maximum likelihood. Model convergence and assumptions were visually inspected. Bayesian versions of these models were estimated using four chains with 500 warmups and 1,000 iteration samples (4,000 total samples). We confirmed that all parameters presented values equal to or below 1.01 and tail effective sample sizes above 1,000. We set the average proposal acceptance probability (delta) to 0.90 and the maximum tree depth to 15 (ref. 58) to avoid divergent transitions. We employed a set of weakly informative priors, including t distributions with three degrees of freedom and a standard deviation of 10 for model intercept and random effect standard deviations, a normal distribution with a zero mean, and a standard deviation of three for the fixed effect regression coefficient. For the standard deviation of the smooth parameter, we employed an exponential distribution with a rate parameter of one59.
For smooth terms, we analysed whether each term was significant for the generalized additive model and presented substantial variance in the final models. We explored 95% confidence/credibility intervals for fixed effects58 and examined support for potential null effects. All reported tests were two-tailed. Our power estimation considered unstandardized fixed regression effects of |0.15| and |0.07| as ultra-low effect sizes (categorical and continuous variables). Thus, assuming a null effect of a similar or lower magnitude (|0.10|), we computed log Bayes factors to quantify evidence favouring null effects of this range60. To understand the sensitivity of our results, we explored support for narrower null effects (ranges of |0.05| and |0.01|). As Bayes factors depend on prior specification, we also estimated the percentage of posterior samples within these regions (which could be understood as a region of practically equivalence analysis61). Both statistics provide sensitive, complementary evidence of whether null effects were supported or not60,61. Unfortunately, such analyses could not be conducted for smooth effects, as no single parameter could resume the relationship between the predictor and the dependent variable.
The analyses were conducted in R v.4.0.2 (ref. 62) using the Microsoft R Open distribution63. The meta-analyses were conducted using the meta package. Nonlinear effects were studied using the mgcv64 package, with the main models being estimated using the gamm4 (ref. 65) and the brms58 packages for frequentist and Bayesian estimation, respectively. All graphs were created using the ggplot2 (ref. 66) (v.3.3.3) package. Data manipulations were conducted using the tidyverse67 family of packages (v.1.3.0).
Deviation from the pre-registered plan
We aimed to follow our pre-registration analyses as closely as possible. On certain occasions, we decided to amplify the scope of the analyses and present robustness checks for the results presented by employing alternative estimation and inference techniques.
There was only one substantive deviation from our pre-registered analyses aside from the delay–speedup calculation. In the original plan, we intended to explore the role of financial status. In our final analysis, we employed individual assets and debts to this end. Assets and debts were included as raw indicators instead of inequality measures because we did not find reliable national average assets or individual debt sources.
One minor adaptation from our pre-registration involved our plan to test for nonlinear effects and use Bayesian estimation only as part of our exploratory analyses. However, as we identified several relevant nonlinear effects, we modified our workflow to accommodate those as follows: (1) we initially explored nonlinear effects using hierarchical generalized additive (mixed) models, (2) we included relevant nonlinear effects in our main pre-registered models and (3) we estimated Bayesian versions of these same models to test whether null effects could be supported in certain cases.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Supplementary information
Source data
Acknowledgements
The authors received no specific funding for this work. A small amount of discretionary funding provided by K.R.’s institution paid for the pilot study participants and for honoraria to organizations that assisted with data collection in several locations. These were provided by Columbia University Undergraduate Global Engagement and the Department of Health Policy and Management. Funds to support open-access publication were provided by the MRC-CBU at the University of Cambridge through a UKRI grant (UKRI-MRC grant no. MC_UU_00005/6). None of these funders had any role in or influence over design, data collection, analysis or interpretation. All collaborators contributed in a voluntary capacity. We thank the Columbia University Office for Undergraduate Global Engagement. We also thank X. Li and L. Njozela, as well as the Centre for Business Research in the Judge Business School at the University of Cambridge.
Author contributions
Conceptualization: K.R. Methodology: K.R., A.P., E.G.-G. and M.Vdo. Project coordination and administration: K.R. and Ta.Du. Supervision: K.R., J.K.B.L., Ma.Fr., P.K., Jo.Raz., C.E.-S., L.W. and Z.Z. Writing: K.R., E.G.-G., A.P., R.S.R. and Ir.Sob. Advisory: A.P. and R.S.R. Instrument adaptation, translation, circulation and recruitment: all authors. Analysis and visualization: E.G.-G. and K.R.
Peer review
Peer review information
Nature Human Behaviour thanks Matúš Adamkovič, David Hardisty and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.
Data availability
All data will be posted at https://osf.io/njd62 on September 1, 2022, while additional work is completed on an interactive tool with these data. Prior to this date, the data are available on request. Source data are provided with this paper.
Code availability
All code will be posted at https://osf.io/njd62 on September 1, 2022, while additional work is completed on an interactive tool with these data. Prior to this date, the code is available on request.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
The online version contains supplementary material available at 10.1038/s41562-022-01392-w.
References
- 1.Angrisani, M., Burke, J., Lusardi, A. & Mottola, G. The Stability and Predictive Power of Financial Literacy: Evidence from Longitudinal Data Working Paper No. 28125 (NBER, 2020); 10.3386/w28125
- 2.Haushofer J, Fehr E. On the psychology of poverty. Science. 2014;344:862–867. doi: 10.1126/science.1232491. [DOI] [PubMed] [Google Scholar]
- 3.Chapman GB. Temporal discounting and utility for health and money. J. Exp. Psychol. Learn. Mem. Cogn. 1996;22:771–791. doi: 10.1037/0278-7393.22.3.771. [DOI] [PubMed] [Google Scholar]
- 4.Green L, Myerson J, Mcfadden E. Rate of temporal discounting decreases with amount of reward. Mem. Cogn. 1997;25:715–723. doi: 10.3758/BF03211314. [DOI] [PubMed] [Google Scholar]
- 5.Critchfield TS, Kollins SH. Temporal discounting: basic research and the analysis of socially important behavior. J. Appl. Behav. Anal. 2001;34:101–122. doi: 10.1901/jaba.2001.34-101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Basile AG, Toplak ME. Four converging measures of temporal discounting and their relationships with intelligence, executive functions, thinking dispositions, and behavioral outcomes. Front. Psychol. 2015;6:728. doi: 10.3389/fpsyg.2015.00728. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Green L, Myerson J, Lichtman D, Rosen S, Fry A. Temporal discounting in choice between delayed rewards: the role of age and income. Psychol. Aging. 1996;11:79–84. doi: 10.1037/0882-7974.11.1.79. [DOI] [PubMed] [Google Scholar]
- 8.Falk A, et al. Global evidence on economic preferences. Q. J. Econ. 2018;133:1645–1692. doi: 10.1093/qje/qjy013. [DOI] [Google Scholar]
- 9.Adamkovič M, Martončik M. A review of consequences of poverty on economic decision-making: a hypothesized model of a cognitive mechanism. Front. Psychol. 2017;8:1784. doi: 10.3389/fpsyg.2017.01784. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Brown JR, Ivković Z, Weisbenner S. Empirical determinants of intertemporal choice. J. Financ. Econ. 2015;116:473–486. doi: 10.1016/j.jfineco.2015.04.004. [DOI] [Google Scholar]
- 11.Shah AK, Mullainathan S, Shafir E. Some consequences of having too little. Science. 2012;338:682–685. doi: 10.1126/science.1222426. [DOI] [PubMed] [Google Scholar]
- 12.Sheehy-Skeffington, J. & Rea, J. How Poverty Affects People’s Decision-Making Processes (JRF, 2017); https://www.jrf.org.uk/report/how-poverty-affects-peoples-decision-making-processes
- 13.Epper T, et al. Time discounting and wealth inequality. Am. Econ. Rev. 2020;110:1177–1205. doi: 10.1257/aer.20181096. [DOI] [Google Scholar]
- 14.Lawrance EC. Poverty and the rate of time preference: evidence from panel data. J. Polit. Econ. 1991;99:54–77. doi: 10.1086/261740. [DOI] [Google Scholar]
- 15.Deaton, A. COVID-19 and Global Income Inequality Working Paper No. 28392 (NBER, 2021); 10.3386/w28392 [DOI] [PMC free article] [PubMed]
- 16.Ludwig RM, Flournoy JC, Berkman ET. Inequality in personality and temporal discounting across socioeconomic status? Assessing the evidence. J. Res. Pers. 2019;81:79–87. doi: 10.1016/j.jrp.2019.05.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Ruggeri, K. & Folke, T. Unstandard deviation: the untapped value of positive deviance for reducing inequalities. Perspect. Psychol. Sci.10.31234/osf.io/8wky5 (2021). [DOI] [PubMed]
- 18.Burro G, McDonald R, Read D, Taj U. Patience decreases with age for the poor but not for the rich: an international comparison. J. Econ. Behav. Organ. 2022;193:596–621. doi: 10.1016/j.jebo.2021.11.005. [DOI] [Google Scholar]
- 19.Carvalho LS, Meier S, Wang SW. Poverty and economic decision-making: evidence from changes in financial resources at payday. Am. Econ. Rev. 2016;106:260–284. doi: 10.1257/aer.20140481. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Baker, S. R., Farrokhnia, R. A., Meyer, S., Pagel, M. & Yannelis, C. Income, Liquidity, and the Consumption Response to the 2020 Economic Stimulus Payments Working Paper No. 27097 (NBER, 2020); 10.3386/w27097
- 21.Falk A, Hermle J. Relationship of gender differences in preferences to economic development and gender equality. Science. 2018;362:eaas9899. doi: 10.1126/science.aas9899. [DOI] [PubMed] [Google Scholar]
- 22.Rieger MO, Wang M, Hens T. Universal time preference. PLoS ONE. 2021;16:e0245692. doi: 10.1371/journal.pone.0245692. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Ha, J., Ivanova, A., Montiel, P. & Pedroni, P. Inflation in Low-Income Countries Working Paper No. 8934 (World Bank, 2019); 10.1596/1813-9450-8934
- 24.Gong L. Endogenous time preference, inflation, and capital accumulation. J. Econ. 2006;87:241–255. doi: 10.1007/s00712-006-0177-7. [DOI] [Google Scholar]
- 25.De Mello LR, Jr., Carneiro FG. Consumption behaviour and persistently high inflation: evidence from Latin America. Rev. Bras. Econ. 2000;54:227–246. doi: 10.1590/S0034-71402000000200005. [DOI] [Google Scholar]
- 26.Loewenstein G, Prelec D. Anomalies in intertemporal choice: evidence and an interpretation. Q. J. Econ. 1992;107:573–597. doi: 10.2307/2118482. [DOI] [Google Scholar]
- 27.Read D. Is time-discounting hyperbolic or subadditive? J. Risk Uncertain. 2001;23:5–32. doi: 10.1023/A:1011198414683. [DOI] [Google Scholar]
- 28.Read, D. & Scholten, M. in Economic Psychology (ed. Ranyard, R.) 35–50 (John Wiley & Sons, 2017); 10.1002/9781118926352.ch3
- 29.Yarkoni, T. The generalizability crisis. Behav. Brain Sci.10.1017/S0140525X20001685 (2020). [DOI] [PMC free article] [PubMed]
- 30.Ruggeri K, et al. Replicating patterns of prospect theory for decision under risk. Nat. Hum. Behav. 2020;4:622–633. doi: 10.1038/s41562-020-0886-x. [DOI] [PubMed] [Google Scholar]
- 31.Macchia L, Plagnol AC, Reimers S. Does experience with high inflation affect intertemporal decision making? Sensitivity to inflation rates in Argentine and British delay discounting choices. J. Behav. Exp. Econ. 2018;75:76–83. doi: 10.1016/j.socec.2018.05.006. [DOI] [Google Scholar]
- 32.Clot S, Stanton CY. Present bias predicts participation in payments for environmental services: evidence from a behavioral experiment in Uganda. Ecol. Econ. 2014;108:162–170. doi: 10.1016/j.ecolecon.2014.07.026. [DOI] [Google Scholar]
- 33.Blumenstock, J. E., Callen, M. & Ghani, T. Mobile-Izing Savings with Automatic Contributions: Experimental Evidence on Present Bias and Default Effects in Afghanistan Discussion Paper No. DP11400 (CEPR, 2016); https://papers.ssrn.com/abstract=2814075
- 34.Ebrahimi Sarv Olia MH, Salimi MJ, Bolo G, Ghouchifard H. Sign effect, speedup–delay asymmetry and gender effect in the Tehran stock exchange. Int. J. Finance Manage. Account. 2020;5:41–53. [Google Scholar]
- 35.Scholten M, Read D, Sanborn A. Weighing outcomes by time or against time? Evaluation rules in intertemporal choice. Cogn. Sci. 2014;38:399–438. doi: 10.1111/cogs.12104. [DOI] [PubMed] [Google Scholar]
- 36.Pedersen EJ, Miller DL, Simpson GL, Ross N. Hierarchical generalized additive models in ecology: an introduction with mgcv. PeerJ. 2019;7:e6876. doi: 10.7717/peerj.6876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Wiseman DB, Levin IP. Comparing risky decision making under conditions of real and hypothetical consequences. Organ. Behav. Hum. Decis. Process. 1996;66:241–250. doi: 10.1006/obhd.1996.0053. [DOI] [Google Scholar]
- 38.Kühberger A, Schulte-Mecklenbeck M, Perner J. Framing decisions: hypothetical and real. Organ. Behav. Hum. Decis. Process. 2002;89:1162–1175. doi: 10.1016/S0749-5978(02)00021-3. [DOI] [Google Scholar]
- 39.Amlung M, MacKillop J. Further evidence of close correspondence for alcohol demand decision making for hypothetical and incentivized rewards. Behav. Process. 2015;113:187–191. doi: 10.1016/j.beproc.2015.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Madden GJ, Begotka AM, Raiff BR, Kastern LL. Delay discounting of real and hypothetical rewards. Exp. Clin. Psychopharmacol. 2003;11:139–145. doi: 10.1037/1064-1297.11.2.139. [DOI] [PubMed] [Google Scholar]
- 41.Locey ML, Jones BA, Rachlin H. Real and hypothetical rewards. Judgm. Decis. Mak. 2011;6:552–564. doi: 10.1017/S1930297500002515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Brañas-Garza P, Estepa-Mohedano L, Jorrat D, Orozco V, Rascón-Ramírez E. To pay or not to pay: measuring risk preferences in lab and field. Judgm. Decis. Mak. 2021;16:1290–1313. doi: 10.1017/S1930297500008433. [DOI] [Google Scholar]
- 43.Halevy Y. Strotz meets Allais: diminishing impatience and the certainty effect. Am. Econ. Rev. 2008;98:1145–1162. doi: 10.1257/aer.98.3.1145. [DOI] [Google Scholar]
- 44.Chakraborty A, Halevy Y, Saito K. The relation between behavior under risk and over time. Am. Econ. Rev. Insights. 2020;2:1–16. doi: 10.1257/aeri.20190051. [DOI] [Google Scholar]
- 45.Epper, T. F. & Fehr-Duda, H. The missing link: unifying risk taking and time discounting. SSRN J.10.2139/ssrn.2175461 (2012).
- 46.Urassa M, et al. Cross-cultural research must prioritize equitable collaboration. Nat. Hum. Behav. 2021;5:668–671. doi: 10.1038/s41562-021-01076-x. [DOI] [PubMed] [Google Scholar]
- 47.IJzerman, H. et al. Psychological science needs the entire globe. APS Obs.34 (2021).
- 48.Gini Index (World Bank) (2021); https://data.worldbank.org/indicator/SI.POV.GINI
- 49.Shah AK, Mullainathan S, Shafir E. An exercise in self-replication: replicating Shah, Mullainathan, and Shafir (2012) J. Econ. Psychol. 2019;75:102127. doi: 10.1016/j.joep.2018.12.001. [DOI] [Google Scholar]
- 50.Hensher, D. A. & Johnson, L. W. Applied Discrete-Choice Modelling (Routledge, 2018).
- 51.Camerer CF, et al. Evaluating replicability of laboratory experiments in economics. Science. 2016;351:1433–1436. doi: 10.1126/science.aaf0918. [DOI] [PubMed] [Google Scholar]
- 52.Desmond M, Wilmers N. Do the poor pay more for housing? Exploitation, profit, and risk in rental markets. Am. J. Sociol. 2019;124:1090–1124. doi: 10.1086/701697. [DOI] [Google Scholar]
- 53.Cardaci A. Inequality, household debt and financial instability: an agent-based perspective. J. Econ. Behav. Organ. 2018;149:434–458. doi: 10.1016/j.jebo.2018.01.010. [DOI] [Google Scholar]
- 54.Causa, O., Hermansen, M., Ruiz, N., Klein, C. & Smidova, Z. Inequality in Denmark through the Looking Glass (OECD, 2016).
- 55.Ruggeri, K. et al. The general fault in our fault lines. Nat. Hum. Behav.10.1038/s41562-021-01092-x (2021). [DOI] [PubMed]
- 56.Wood, S. N. Generalized Additive Models: An Introduction with R 2nd edn (CRC, 2017).
- 57.Wood, S. mgcv: Mixed GAM computation vehicle with automatic smoothness estimation. R package, version 1.8-39 (2021).
- 58.Bürkner P-C. brms: an R package for Bayesian multilevel models using Stan. J. Stat. Softw. 2017;80:1–28. doi: 10.18637/jss.v080.i01. [DOI] [Google Scholar]
- 59.Wesner JS, Pomeranz JPF. Choosing priors in Bayesian ecological models by simulating from the prior predictive distribution. Ecosphere. 2021;12:e03739. doi: 10.1002/ecs2.3739. [DOI] [Google Scholar]
- 60.Makowski D, Ben-Shachar MS, Chen SHA, Lüdecke D. Indices of effect existence and significance in the Bayesian framework. Front. Psychol. 2019;10:2767. doi: 10.3389/fpsyg.2019.02767. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Kelter, R. How to choose between different Bayesian posterior indices for hypothesis testing in practice. Multivariate Behav. Res.10.1080/00273171.2021.1967716 (2021). [DOI] [PubMed]
- 62.R Core Team. R: a language and environment for statistical computing. https://www.R-project.org/ (R Foundation for Statistical Computing, 2021).
- 63.Microsoft R Open: The Enhanced R Distribution (MRAN) (2021); https://mran.microsoft.com/open
- 64.Balduzzi S, Rücker G, Schwarzer G. How to perform a meta-analysis with R: a practical tutorial. Evid. Based Ment. Health. 2019;22:153–160. doi: 10.1136/ebmental-2019-300117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Simon, W. & Scheipl, F. gamm4: Generalized additive mixed models using ‘mgcv’ and ‘lme4’. R package, version 0.2-6 (2021).
- 66.Wickham, H. ggplot2: Elegant graphics for data analysis (Springer, 2016).
- 67.Wickham H, et al. Welcome to the tidyverse. J. Open Source Softw. 2019;4:1686. doi: 10.21105/joss.01686. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data will be posted at https://osf.io/njd62 on September 1, 2022, while additional work is completed on an interactive tool with these data. Prior to this date, the data are available on request. Source data are provided with this paper.
All code will be posted at https://osf.io/njd62 on September 1, 2022, while additional work is completed on an interactive tool with these data. Prior to this date, the code is available on request.