Skip to main content
SSM - Population Health logoLink to SSM - Population Health
. 2017 Jul 27;3:639–648. doi: 10.1016/j.ssmph.2017.07.010

Wealth, justice and freedom: Objective and subjective measures predicting poor mental health in a study across eight countries

Saskia Scholten 1,, Julia Velten 1, Torsten Neher 1, Jürgen Margraf 1
PMCID: PMC5769050  PMID: 29349252

Abstract

Background

Macro-level factors (MF) such as wealth, justice and freedom measured with objective country-level indicators (objective MF), for instance the Gross Domestic Product (GDP), have been investigated in relation to health and well-being, but rarely in connection with depression, anxiety and stress subsumed as poor mental health. Also, a combination of different objective MF and of how individuals perceive those MF (subjective MF) has not been taken into consideration. In the present study, we combined subjective and objective measures of wealth, justice and freedom and examined their relationship with poor mental health.

Method

Population-based interviews were conducted in France, Germany, Poland, Russia, Spain, Sweden, U.K. and U.S.A. (n ≈ 1000 per country). GDP, GINI coefficient, Justice Index and Freedom Index were used as objective MF, whereas subjective MF were perceived wealth, justice and freedom measured at the individual level. Poor mental health was assessed as a combination of symptoms of depression, anxiety and stress.

Results

In a random-intercept-model, GINI coefficient and Freedom Index were significant positive country-level, and perceived wealth, justice, and freedom significant negative individual-level predictors of symptoms of poor mental health.

Conclusion

Multiple subjective and objective MF should be combined to assess the macrosystem’s relationship with poor mental health more precisely. The relationship between MF and poor mental health indicates that the macrosystem should be taken into account as relevant context for mental health problems, too.

Keywords: Depression, Anxiety, Stress, Mental health, Justice, Freedom, National income, Income inequality, Macrosystem

Highlights

  • Poor mental health was examined in relation to subjective and objective macro-level factors.

  • GINI-coefficient and Freedom Index were significant positive country-level predictors of poor mental health.

  • Perceived wealth, justice and freedom were significant negative country-level predictors of poor mental health.

  • Future research should study subjective and objective macro-level factors in larger country samples.

Introduction

The macrosystem reflecting consistencies in larger social entities impacts both physical and mental health (Bronfenbrenner, 1979). The relationship between health and macro-level factors (MF), also discussed as social or structural determinants of health, is widely acknowledged (CSDH, 2008, Eikemo et al., 2008, Marmot, 2003, Pickett et al., 2006, Shim et al., 2014, Veenhoven, 2000, Wilkinson and Pickett, 2006, World Health Organization, 2013). Despite the fact that the interplay between social determinants of health and mental health is complex (Eckersley, 2015) and a number of ecological confounding factors need to be considered in combination to regard this complexity (Diener and Diener, 1995, Subramanian and Kawachi, 2004), many existing studies focus on only one MF, mostly income (inequality) (e.g., Kondo et al., 2009; Stevenson & Wolfers, 2013; Zagorski, Evans, Kelley & Piotrowska, 2014). Beyond that, research on the subjective socio-economic status suggests that the subjective perception is more relevant for health outcomes than the objective measures (e.g., Callan, Kim & Matthews, 2015; Demakakos, Nazroo, Breeze & Marmot, 2008; Ostrove, Adler, Kuppermann & Washington, 2000). Hence, it could be valuable to add a subjective assessment of MF to the existing evidence on the relationship between objective MF measures and health. Finally, a large body of research focuses on measures of health or positive mental health (including happiness, life satisfaction, and well-being) as outcome variable, but less so on combined measures of poor mental health (Fischer & Boer, 2011).

Building upon current research findings, the present preliminary study investigated MF with respect to the combination of symptoms of depression, anxiety and stress (subsequently subsumed as poor mental health) because depression and anxiety belong to the most common mental disorders (Kessler et al., 2009). Since explanatory models of poor mental health are probably not one-dimensional (Gerring, 2010), a combination of MF was investigated. Besides wealth, we focused on justice and freedom because of the long philosophical tradition emphasizing debates on justice and freedom as central macro-level characteristics (Falkenberg, 1998). Additionally, besides objective country-level indicators such as the Gross Domestic Product (GDP), individual-level data were used to assess subjective perceptions and evaluations of MF.

Macro-level factors under study

Mental health disparities have often been described in relation to wealth as one of the most commonly MF under study (Sacks et al., 2012, Subramanian and Kawachi, 2006a). MF as characteristics of a country are normally measured objectively (objective MF). This means that indicators are used that describe a country such as national income or number of doctors per 1000 persons. GDP is a country-level indicator that is commonly used as objective MF to measure wealth. It indicates the economic performance of a country and is used to compare countries. Even after 30 years of research, the relationship between income and well-being remains largely in the eye of the beholder (Arthaud-Day & Near, 2005, p. 512). A linear positive relationship has been found between the mean income in nations (usually GDP) and subjective well-being (e.g., Arthaud-Day & Near, 2005; Diener, Diener & Diener, 1995; Diener & Biswas-Diener, 2002), happiness (e.g., Hagerty & Veenhoven, 2003; Schyns, 1998) and life satisfaction (e.g., Kahneman & Deaton, 2010; Tay, Morrison & Diener, 2014). More recent research found a log-linear rather than a linear relationship indicating that each additional dollar of income yielded greater improvement to measured happiness for the poor than for the rich (e.g., Deaton, 2009; Deaton & Stone, 2013; Stevenson and Wolfers, 2013, Stevenson and Wolfers, 2008).

Another line of research suggests that income inequality might explain mental health disparities instead or beyond a country’s absolute wealth (e.g., Pickett & Wilkinson, 2015; Subramanian & Kawachi, 2006a; Wilkinson & Pickett, 2006). Income inequality is most often measured with the GINI coefficient (Gini, 1921) and has been found to be adversely associated with mortality, population and self-rated health (e.g, Kondo et al., 2012, Kondo et al., 2009; Subramanian & Kawachi, 2006b; Wilkinson and Pickett, 2009, Wilkinson and Pickett, 2006), happiness (Oishi, Kesebir & Diener, 2011) and positively with social dysfunction (Wilkinson & Pickett, 2009) and mental disorders (e.g., Pickett et al., 2006; Pickett & Wilkinson, 2011; Subramanian & Kawachi, 2004). However, more recent research has found that income inequality did not have a significant effect on well-being measures if GDP was included in the model (Kelley and Evans, 2012, Zagorski et al., 2014). This finding stresses the importance to consider both GDP and the GINI coefficient to control for each other’s effects in order to uncover the actual relationship between them and poor mental health.

Hypothesis 1a

: Higher GDP of a country is associated with fewer symptoms of poor mental health.

Hypothesis 1b

: Larger income inequality is related to more symptoms of poor mental health.

Including justice as third objective MF, enlarges the scope of potential factors of stratification because justice or equality not only concern income inequality, but also unequal distributions of political power, education and resources (Subramanian & Kawachi, 2004). Research yielding to a relation between justice and mental health outcomes exists mainly on organizational justice (Cohen-Charash and Spector, 2001, Colquitt et al., 2001, Elovainio et al., 2010). Evidence shows that procedural and relational justice are related with mental health in prospective studies (Ndjaboué, Brisson & Vézina, 2012). Less research has focused on justice as a characteristic of the macrosystem that describes equal and fair conditions as consistencies of large social entities such as countries. However, for example human rights have been found to be a significant predictor of subjective well-being (Diener et al., 1995). Therefore, we included justice as relevant MF.

Hypothesis 2

Higher levels of justice are related to fewer symptoms of poor mental health.

More research exists on the relationship between freedom and mental health (e.g., Haller & Hadler, 2004; Welsch, 2003). A linear relationship between freedom and well-being is proposed in the human development model (Welzel, Inglehart & Klingemann, 2003). The model states that due to the maximization of free choice and control over one’s life, people have more opportunities to pursue their personal goals which ultimately leads to increasing happiness (Inglehart et al., 2008, Inglehart and Welzel, 2005, Johnson and Krueger, 2006, Welzel et al., 2003). In contrast, Fischer and Boer (2011) argue that the association between freedom and well-being might be curvilinear: While low levels of choice are associated with negative well-being, increasing levels of freedom allow the satisfaction of basic and personal needs leading to well-being, whereas high levels of choice imply opportunity costs and postdecision regret that in turn lead to negative well-being again. Both assumptions are plausible, but to date empirical findings support a linear relationship (Falkenberg, 1998, Veenhoven, 2000, Welsch, 2003).

Hypothesis 3

Higher levels of freedom are associated with fewer symptoms of poor mental health.

Measuring macro-level factors

Another potential approach to measure MF besides country-level indicators (objective MF) are perceived measures of MF assessed at the individual level (subjective MF). This means that individuals are questioned about their evaluation of MF (e.g., “How is the governmental effectiveness in your country?”) and these assessments are used for further analysis. The two approaches probably operate complementarily, because one cannot assume that a certain environmental condition will have a specific effect on any outcome if the psychological or subjective variables are not considered (Johnson & Krueger, 2006). However, up till now research including individual-level evaluation of MF is scarce. Some exceptions are outlined subsequently for wealth, justice and freedom:

Most people give high priority to earning money and being wealthy even though money by itself does not make people happy (Boyce, Brown & Moore, 2010). One factor that seems to be relevant is the subjective evaluation of wealth. For example, a twin study showed that the association between measures of actual wealth and life satisfaction was mediated by the perceived financial situation (Johnson & Krueger, 2006, p. 680). Even after taking the covariates wealth, education, and occupational class into consideration, the subjective socioeconomic status significantly predicted self-rated health, depression and long-standing illness (Demakakos et al., 2008). Similarly, personal relative deprivation predicted self-rated physical and mental health better than subjective or objective socioeconomic status across six studies (Callan et al., 2015). Hence, the evaluation of wealth might act as a moderator in the relationship between national income and well-being (Arthaud-Day & Near, 2005).

In justice research, the subjective evaluation has a longer tradition. The “Belief in a Just World (BJW)” was introduced in the 1980s and conceptualizes a person’s conviction that the world is fair and everyone gets what he or she deserves (general BJW; Lerner, 1980). Positive affect, life satisfaction and self-esteem are positively related to the perception that the world is unjust for the self (personal BJW), but not the general BJW (Dzuka & Dalbert, 2002). Also, the impact of childhood perceived relative deprivation and poor well-being was mediated by the personal BJW (Wickham, Shryane, Lyons, Dickins & Bentall, 2014). Yet, whereas the personal BJW concerns only that the world is unjust for the self, we address the evaluation of justice for the country, adding further to the existing literature. An example for such an investigation is a study by Oishi et al. (2011) who found that perceived fairness explained the relation between less income inequality and higher levels of happiness.

Similar findings have been reported for freedom: The macro-social condition of freedom is only relevant for the happiness of a person through his or her perception of individual freedom (Haller & Hadler, 2004). However, Inglehart et al. (2008) argue that the increasing impact of personal freedom becomes evident only as societies get wealthier and that the general atmosphere of freedom in a society affects subjective well-being more than the individual sense of freedom. This reasoning also points out that various MF might interact with each other. Hence, combining objective and subjective measures of freedom in the present study adds knowledge to this dispute.

Hypothesis 4

Higher perceived wealth, justice and freedom predicts lower levels of poor mental health.

The present study

The aim of the present study was to combine objective and subjective MF to investigate the relationship between the macrosystem and poor mental health. For the first time, in addition to the “classic” country-level indicators, we assessed perceived wealth, justice and freedom and mental health comparably across eight countries.

Materials and methods

Indicators and individual assessment

With respect to country-level indicators, we used GDP per capita to measure wealth of the countries. “GDP per capita is GDP divided by midyear population (and) GDP is the sum of gross value added by all resident producers in the economy plus any product taxes and minus any subsidies not included in the value of products.” (The World Bank, 2016). According to the GDP per capita in 2014, the wealthiest people live in Liechtenstein (178,713.23$), Luxembourg (117,507.81$), and Norway (97,005.5X$) and the poorest people live in Malawi (362.69$), Central African Republic (354.45$) and Burundi (286.X$).

The GINI coefficient was included to represent income inequality. It is based on the Lorenz curve plotting the distribution of income in a population. A GINI coefficient of 0 indicates perfect income equality whereas a coefficient of 100 suggests perfect inequality (Gini, 1921). Of all available data between 2011 and 2013, Czech Republic (26.1), Finland, (27.1), Iceland (26.9), Norway, (25.5), Slovenia (24.9), Sweden (27.3) and Uganda (24.6) are among the countries with the lowest GINI coefficients and Haiti (60.8), Honduras (53.7) and South Africa (63.4) belong to the countries with the greatest inequality (The World Bank, 2014).

The Justice Index was used to measure justice in a country (Enste & Wies, 2013). It is an aggregated index with 0 indicating the least justice and 100 the best justice that comprises six justice dimensions: Distributional justice, justice of performance, equal opportunities, income equality, procedural justice and intergenerational justice. Each dimensions consists of several indicators that allow the quantification of the dimension (e.g., distributional justice includes child poverty and public health care among others). According to this Justice Index, Norway (79), Sweden (74) and Denmark (74) belong to the most just and Greece (43), Romania (41) and Turkey (30) to the three most unjust countries in the Western world.

The Worldwide Index of Human Freedom was chosen to quantify freedom (McMahon, 2012). It combines the Economic Freedom of the World Index (Gwartney, Lawson & Hall, 2012) with an Index of Personal Freedom (Vásquez & Štumberger, 2012). The Economic Freedom of the World Index combines 42 variables from five broad areas (size of government, legal system and property rights, sound money, freedom to trade internationally, and regulation) into one aggregated index. The Index of Personal Freedom is an aggregation of 34 variables from four categories (security and safety, freedom of movement, freedom of expression, and relationship freedoms). The combined index has a 0–10 scale with 10 indicating the most freedom. Among the countries with the most freedom are New Zealand (8.73), the Netherlands (8.47), and Hong Kong (8.39) while Pakistan (4.47), Burma (3.72), and Zimbabwe (3.38) have the lowest freedom levels.

Individual-level data were assessed with three single items for wealth, justice and freedom (“When you compare [your country] to other countries, how wealthy/fair/free do you find [your country]?”). Responses could be given on a scale from ‘0 = not at all wealthy/fair/free’ to ‘100 = very wealthy/fair/free’. In Poland, the U.K., and the U.S.A., poor mental health was assessed with the 21-item version of the Depression, Anxiety and Stress Scales (DASS-21; Antony, Bieling, Cox, Enns & Swinson, 1998; Lovibond & Lovibond, 1995). The first 21-items of the DASS-42 were used in France, Germany, Russia, Spain and Sweden which are comparable to the DASS-21 (Lovibond and Lovibond, 2016, Velten et al., 2016). Nevertheless, we adjusted the scores to give the best possible estimate of the DASS-21 (Lovibond & Lovibond, 2016). The scale has been tested to be measurement invariant on a metric level (Mellor et al., 2014, Oei et al., 2013, Scholten et al., 2017). Overall, the total scale showed good internal consistency (Range α = .91–.95). If instruments were not accessible in the required language (Lovibond, 2015), they were translated following the procedure proposed by Wild et al. (2005).

Procedure and sample characteristics

Eight countries were chosen for the study due to their variation in welfare systems (Arts and Gelissen, 2002, Esping-Andersen, 1990) which were expected to be associated with different values of objective MF. Additionally, the availability of the country-level indicators for the objective MF, and the feasibility of reliable population-based surveys were practical criteria to guide the country selection. The chosen countries were U.K. and U.S.A. (liberal type of welfare state), France and Germany (conservative-corporatist countries), Sweden (social democratic welfare state) and Spain (Mediterranean/Southern type of welfare state). We also added Poland and Russia as Post-Soviet countries.

GDP per capita and the GINI coefficient were taken from the data pool provided by the world bank (World Bank Open Data; The World Bank, 2016). A proxy of the Justice Index as proposed by Enste and Wies (2013) was calculated to capture the level of justice in a country. Because a Justice Index for Russia was missing in the original work, we used a proxy that comprised only the indicators that were also available for Russia. Data were extracted from different open access data pools (see Appendix A for more details). Standardization and aggregation of the data was realized according to the original procedure (Enste & Wies, 2013). The values for the combined Freedom Index were taken from the Worldwide Index of Freedom (, 2012, Vásquez and Štumberger, 2012).

For individual-level data, computer-assisted telephone interviews were conducted in population-based surveys of the adult residential populations in the countries under study from June to October 2014. Each sample was drawn from the residential population aged 18 years and above that was accessible via landline or mobile phones. Kish selection grid was implemented to identify the member within a household to be interviewed. The interviewer gathered participants’ informed consent verbally prior to each telephone interview. The total response rate, based on the proportion of actual eligible cases out of cases of unknown eligibility (The American Association for Public Opinion Research, 2016), was 16.6%. The Ethics Committee of the Faculty of Psychology at the authors’ university approved the study.

In total, 8050 interviews were completed with about 1000 participants per country. Percentage of female participants varied significantly between 48% in Poland and 58% in Russia, χ2(7) = 20.68, p = .004. Average age ranged from 45 years in Poland to 58 years in the UK and differed significantly across countries, F(7) = 75.97, p < .001. The countries’ samples also differed in terms of their highest level of education, χ2(21) = 1281.3, p < .001 (Table 1).

Table 1.

Sociodemographic variables of the participants.

ES FR GE PL RU SV UK US Test statistica
Participants N 1006 1001 1001 1003 1010 1002 1002 1025
Gender % female 52 53 53 48 58 51 54 53 20.68(7)**
Age M(SD) 48 (17) 51 (18) 52 (19) 45 (16) 45 (17) 56 (19) 58 (18) 51 (17) 75.97(7, 7,999)***
Highest level of educationb 1281.3(21)***
10 years of school and below 36 15 7 22 3 17 20 6
High school graduation (12–13 years of school) 28 42 51 41 14 35 26 40
Vocational training, college graduation 18 24 21 10 36 26 35 35
Post-graduate / University degree 18 18 21 27 47 22 18 18

Note. *p ≤ .05;

3Levene’s test indicated heteroginity of variances (F =5.17***)

a

Group differences are calculated with ??2-test or oneway anova.

b

Frequencies are presented in percent.

**

p ≤ .01;

***

p≤ .001

Statistical analysis

Statistical analyses were conducted in R using the packages psych, lavaan, ggplot2 and nlme (Pinheiro et al., 2015, R Development Core Team, 2013, Revelle, 2011, Wickham, 2016). Cronbach’s alpha indicated internal reliability and was considered acceptable above α ≥ .70 (Cronbach, 1951).

Individual data were nested within countries indicating a two-level structure of the data. Multi-level analysis is the state-of-the-art approach to examine this data structure. Yet, the precondition for multi-level analysis that the groups are a random sample from a population of groups is violated due to the selection of the countries and the small sample of countries on level-2 (Diez-Roux, 2000). Hence, the analysis must be seen as preliminary and results should not be generalized at this point.

First, two baseline models were fitted to calculate the Intraclass-Coefficient (ICC) and to assess the need for a multi-level model (Field, Miles & Field, 2012). The first baseline model had a fixed intercept; the second a random intercept without further fixed effects. ICC indicated the percentage of total variability attributable to the countries. An ICC close to 0 indicates that a multi-level structure is not present in the data or that the level-2 entities have not been chosen well. In contrast, an ICC close to 1 indicates complete variation between groups and almost no variation between individuals (Merlo, Chaix, Yang, Lynch & Råstam, 2005). Both models were compared using χ2-difference test and evaluating AIC and BIC. If the empty random-intercept-model had lower AIC and BIC and differed significantly from the fixed-random-intercept-model, a multi-level analysis is indicated (Field et al., 2012).

Then, a random-intercepts-model with fixed effects for gender, age and education as control variables at level-1, perceived wealth, justice and freedom as level-1 predictor variables and logGDP,1 GINI coefficient, Justice Index and Freedom index as level-2 predictor variables was specified. The regression equation can be expressed as follows:

DASSci=π0i+b1(gender)ci+b2(age)ci+b3(education)ci+b4(perceivedwealth)ci+b5(perceivedjustice)ci+b5(perceivedfreedom)ci+εci
π0i=b0+b7(logGDP)c+b8(GINI)c+b9(JusticeIndex)c+b10(FreedomIndex)c+rc

where i is the index for individual, c is the index for country, ε is the random effect on Level-1 and r the random effect of Level-2. Level-1 predictor variables were centered around the group mean to control for between-cluster variation whereas level-2 predictor variables were centered around the grand mean (Enders & Tofighi, 2007). To calculate the standardized regression coefficient (β), we standardized all variables and repeated the analysis. Missing values were excluded in the multi-level analyses to ensure the same number of observations in all models.

Results

The descriptive properties of country-level indicators are presented in Table 2. Sweden had the highest GDP and Justice Index. In contrast, the US scored highest on the Freedom Index. Perceived wealth, justice and freedom were rated highest in Sweden and lowest in Spain and Poland (see Table 3). Cronbach’s α was excellent (α = .91–.95). Across all samples and variables, missing values varied between 0.3% for perceived wealth in the German sample and 12.0% for perceived justice in the Spanish sample (Table 4).

Table 2.

Descriptive properties of the msv-indicators for all countries.

Justice Inequality Freedom Wealth
Justice Indexa GINI coefficient (2011–2013)b Freedom indexc GDP per capita in $US (2014)d
France 49.11 33.10 7.78 42,732.60
Germany 61.27 30.10 7.75 47,821.90
Poland 44.95 32.40 7.73 14,342.90
Russia 50.88 41.60 6.25 12,735.90
Spain 43.66 35.90 8.00 29,767.40
Sweden 73.43 27.30 7.91 58,938.80
U.K. 41.50 32.60 8.08 46,332.00
U.S.A. 32.99 41.10 8.30 54,629.50
a

Proxy of the Justice Index

c

An Index of freedom of the world, p. 63

Table 3.

Descriptive properties (mean, standard deviation skew, kurtosis, inter-item correlations Cronbach’s alpha) for all subjective MLF and negative psychological symptoms by country.

Country Variable n M SD Skewness Kurtosis Pearson Correlations
α Missings
pj pf nmh %
France
Perceived wealth 958 54.14 20.52 -0.13 -0.29 .42 .35 -.07 4.30
Perceived justice 944 58.64 20.83 -0.37 -0.25 .49 -.05 5.69
Perceived freedom 972 74.39 20.44 -1.08 0.98 -.07 2.90
Poor mental health 918 27.84 22.22 1.00 0.72 .91 8.29
Germany
Perceived wealth 998 79.50 16.55 -1.43 3.52 .36 .36 -.15 0.30
Perceived justice 995 69.54 18.35 -0.93 1.07 .52 -.17 0.60
Perceived freedom 991 82.72 17.69 -1.61 3.32 -.21 1.00
Poor mental health 971 24.55 20.79 1.52 2.87 .92 3.00
Poland
Perceived wealth 963 45.82 19.56 0.03 -0.34 .48 .42 -.13 3.99
Perceived justice 904 45.19 21.32 0.14 -0.50 .49 -.17 9.87
Perceived freedom 963 69.23 22.26 -0.67 -0.15 -.19 3.99
Poor mental health 988 27.42 22.81 1.12 0.82 .92 1.50
Russia
Perceived wealth 903 60.67 21.69 -0.12 -0.26 .51 .42 -.03 10.59
Perceived justice 922 59.48 23.18 -0.11 -0.44 .49 -.07 8.71
Perceived freedom 924 75.68 22.29 -0.79 0.02 -.06 8.51
Poor mental health 946 23.35 19.28 1.18 1.45 .91 6.34
Spain
Perceived wealth 948 53.75 22.87 -0.02 -0.60 .45 .48 -.14 5.77
Perceived justice 885 44.72 21.60 0.18 -0.41 .50 -.16 12.03
Perceived freedom 950 66.26 24.36 -0.52 -0.53 -.10 5.57
Poor mental health 940 27.69 24.81 1.15 0.91 .93 6.56
Sweden
Perceived wealth 999 79.77 14.03 -0.88 0.74 .47 .37 -.15 0.30
Perceived justice 997 75.22 15.62 -0.96 1.39 .49 -.12 0.50
Perceived freedom 992 85.09 14.50 -1.67 3.73 -.11 1.00
Poor mental health 987 17.52 18.32 1.69 3.15 .92 1.50
U.K.
Perceived wealth 959 72.13 16.43 -0.83 0.66 .37 .34 -.23 4.29
Perceived justice 971 72.00 19.27 -0.85 0.59 .50 -.20 3.09
Perceived freedom 974 82.14 17.72 -1.52 2.48 -.20 2.79
Poor mental health 967 22.42 21.48 1.54 2.47 .93 3.49
U.S.A.
Perceived wealth 982 77.93 19.46 -1.16 1.20 .40 .39 -.09 4.20
Perceived justice 970 73.50 20.78 -0.87 0.66 .58 -.11 5.37
Perceived freedom 995 81.93 19.54 -1.43 1.83 -.11 2.93
Poor mental health 965 23.94 24.13 1.40 1.68 .95 5.85

Note. pj = perceived justice; pf: perceived freedom; nmh: poor mental health

Table 4.

Multi-level analysis to predict poor mental health (DASS-21 Sumscore).

Model
Empty random-intercept model
Full random-intercept model
Fixed effects b SE(b) t(df) p value b SE(b) t(df) p value β
(Intercept) 23.76031 1.153062 20.61(6029) 0.00 25.22 0.40 63.19(6023) < .001 .00
Gender -2.67 0.53 -4.99279 < .001 -.06
Age -0.02 0.02 1.23319 0.2176 -.02
Education -2.07 0.28 -7.45131 < .001 -.10
logGDP 0.84 1.13 0.73917 0.5368 .03
GINI coefficient 1.05 0.24 4.44108 0.0471 .22
Justice Index -0.08 0.07 -1.19095 0.3559 -.05
Freedom Index 256.07 31.05 8.24766 0.0144 6.38
Freedom Index (squared) -17.64 2.13 -8.2715 0.0143 -6.34
Perceived wealth -.07 0.02 -4.1021 < .001 -.07
Perceived justice -0.06 0.02 -3.46562 < .001 -.06
Perceived freedom -0.08 0.02 -4.85109 < .001 -.08
Random effects Variance (SD) Variance (SD)
Between countries 3.17 .37
Between individuals 21.82 20.66
Intraclass Correlation .13 .02

Note. N (Level 2) = 8, N (Level1) = 6037. All Level-1 predictors were group-mean centered. All Level-2 predicotrs were grand-mean centered. Maximum-likelihood was used for estimation.

Results of the multi-level analysis are presented in Table 4. The ICC indicated that 13% of variability for poor mental health is due to the country. The empty random-intercept model had significantly lower AIC and BIC than the fixed-intercept-model indicating better model fit, χ2(1) = 121.56, p < .001. Hence, multi-level modeling was indicated. The full random-intercepts-model showed negative effects for gender, age, education, the Justice Index, the squared Freedom Index, and perceived wealth, justice and freedom. Positive predictors were logGDP, the GINI coefficient and the Freedom Index. The control variables gender (male=1), b = -2.67, SE = .53, t = -4.99, p < .001, and education, b = -2.07, SE = .28, t = -.45, p < .001, were significant negative predictors of poor mental health. The GINI coefficient, b = 1.05, SE = .24, t = -44, p = .047, the Freedom Index, b = 256.07, SE = 31.05, t = -8.25, p = .014, and the squared Freedom Index, b = -17.64, SE = 2.13, t = -8.27, p = .014, were significant Level-2 predictors whereas logGDP and the Justice Index did not predict poor mental health significantly. Perceived wealth, b = -.07, SE = .02, t = -4.10, p < .001, perceived justice, b = -.06, SE = .02, t = -3.47, p < .001, and perceived freedom, b = -.08, SE = .02, t = -4.85, p < .001, were significant negative Level-1 predictors of poor mental health. Only 2% of the unexplained variance was still due to country. Testing the empty and the full random-intercept models against each other showed that the full random-intercept model had a better fit, χ2(1) = 254.04, p < .001.

Discussion

The present study aimed to investigate the relationship between a combination of multiple subjective and objective MF and symptoms of depression, anxiety and stress subsumed as poor mental health. For the first time, objective and subjective wealth, justice and freedom as well as symptoms of depression, anxiety and stress were assessed simultaneously with comparable instruments across eight countries. Restrictively, it must be kept in mind that the analysis to test these hypotheses was based on only eight countries and hence the following discussion should stimulate further research rather than the presentation and discussion of facts.

Concerning objective measures of wealth, namely GDP per capita and GINI coefficient, we expected that log(GDP) would be a negative predictor whereas the GINI coefficient would be a positive predictor of symptoms of poor mental health (Hypotheses 1a and 1b). Hypothesis 1b was confirmed as the GINI coefficient significantly and positively predicted poor mental health which is in line with previous research on income inequality (cf., Oishi et al., 2011; Pickett et al., 2006). In contrast, Hypothesis 1a was not confirmed because log(GDP) was a positive predictor of poor mental health, too, but the effect was not significant. In the past, a large body of research has shown that higher GDP is significantly related to higher levels of happiness (e.g., Hagerty & Veenhoven, 2003), life satisfaction (e.g., Tay et al., 2014), well-being (e.g., Eger & Maridal, 2015) and depression (e.g., Van Hemert, van de Vijver & Poortinga, 2002). Our study might not have replicated these findings for the relationship between GDP and poor mental health because the country sample was not representative and might have exemplified an arbitrary distribution of GDP and poor mental health. However, the same argument could be used to justify why the positive relationship between GDP and poor mental health found in this study might not have been significant. Another study has found a positive relationship, too (Steptoe, Tsuda, Tanaka & Wardle, 2007). Hence it is interesting to ask why individuals in countries with a higher GDP should report higher levels of poor mental health than people in countries with a lower GDP. Generally, this finding would also be in line with research showing that many mental disorders have higher prevalence rates in more affluent countries rendering them “disorders of development” (Helliwell, Layard & Sachs, 2013). The negative outcome measure could make a difference in studying the relationship with GDP. Whereas national income seems to have a positive spillover on life-evaluation, it has been shown to have a negative spillover on affective well-being (Tay et al., 2014). Our assessment of poor mental health did not include a reference to an evaluation of life in general, as might be the case for measures of happiness or life satisfaction. Therefore, the approach to measure symptoms of depression, anxiety and stress might be able to capture a conceptually different relationship between national wealth and poor mental health (Arthaud-Day & Near, 2005). Hence, future research should include emotional outcomes other than happiness or well-being to investigate a potentially differential pattern (Kushlev, Dunn & Lucas, 2015) and to clarify the actual direction of the relationship.

Concerning the Justice Index, we expected that higher levels of justice would be related to fewer symptoms of poor mental health (Hypothesis 2). The result was not significant, but the direction of the effect matched the hypothesis. It still underlines the assumption that just and equal conditions are relevant for mental health not only in regard to income (McLeod, 2015, Subramanian and Kawachi, 2004). Further research with larger samples should include other measures of equality besides the GINI coefficient for income inequality in order to capture effects of justice or equality on mental health. Additionally, it would be interesting to explore the mechanisms underlying the relationship between equality or inequality and mental health. For example, persistent conditions of injustice might lead to suffering through internalization, helplessness and upward comparison whereas optimal conditions of justice can lead to thriving through the prevention of threat and avoidance of comparisons (Prilleltensky, 2011).

Higher levels of freedom significantly predicted more symptoms of poor mental health (Hypothesis 3). The coefficient of the squared Freedom Index was significantly negative. The finding should be interpreted with caution because of our small country sample and because the Freedom Index is not normally distributed among those countries. Instead, the Russian score is an extreme outlier in the sample. Taking the finding as it is, at least the result for high levels of freedom is in line with the assumption that poor mental health decreases with increasing freedom as proposed by the Human Development Model (Welzel et al., 2003), but the inverse u-shape of the squared Freedom Index contradicts the consideration that little freedom is as harmful as extreme freedom (Fischer & Boer, 2011). The positive effect of high level of freedom is in line with research that has shown that providing individuals with autonomy reduces poor mental health even independent of wealth (Fischer & Boer, 2011). Also, more freedom might lead to more opportunities and free choices that in turn allow an increased pursue of happiness (Welzel et al., 2003). In contrast, a moderate level of freedom might lead to learned helplessness and reactance. Although, the potential to take responsibility and change something does exist, it is not available to everyone (Brehm & Brehm, 1981) which could in turn result in increasing symptoms of poor mental health due to frustrating experiences. People living in an environment with minimal freedom do not have the illusion of being free and able to influence their lives. This might be frustrating in general, but could actually prevent frustrating personal experiences that would impact poor mental health. Further research should clarify and investigate this relationship in more depth.

In addition to the objective MF outlined above, we expected that perceived wealth, justice and freedom would be significant negative predictors of poor mental health (Hypothesis 4). The assumption was fully confirmed as all three subjective MF were significant protective factors for symptoms of poor mental health. This finding stresses the importance to take into account the subjective perception of MF (Johnson & Krueger, 2006). It would be interesting to carry on this line of research further with larger country samples in order to test whether the subjective perception of MF is a mediating factor between objective MF and poor mental health as has been found for wealth (Arthaud-Day & Near, 2005) and fairness (Oishi et al., 2011).

The fact that our analyses are based on only eight countries is the major limitation of the present study. Objective MF of individual countries might be idiosyncratic and influence the results strongly without being representative. Therefore, the results must be interpreted with caution and considered preliminary evidence. Ideally, analyses should be repeated with a larger sample of countries. The single-item questions used to assess individual-level data can also be regarded as a limitation. They correlated highly with each other. It might have been difficult to differentiate these concepts that generally have more than one meaning, (Jost, Kay & Thorisdottir, 2009). A qualitative approach could shed light on the subjective meaning of these concepts across individuals and different countries. Finally, the study is cross-sectional and associations do not imply causal relationships. Longitudinal studies are necessary to shed light on the direction of the relationships reported in the present paper (Arthaud-Day & Near, 2005). It seems likely that mental health may influence self-perceived wealth, justice and freedom. However, the fact that country-level indicators were relevant predictors gives reason to believe that the associations exist at least in part, regardless of the impact that mental health might have on the subjective perception.

To sum up, objective MF are relevant predictors of poor mental health. However, it is important to consider multiple MF simultaneously to examine differential patterns of the associations. Also, adding subjective MF explains additional variance indicating that the subjective evaluation of MF should be taken into account as a supplementary perspective.

Ethical statement

Authorship of the paper

Saskia Scholten is the first author. She conducted the study, analyzed the data and wrote the manuscript. Dr. Julia Velten contributed to the study design and procedure as well as to the successive writing, reviewing and editing process. Saskia Scholten conducted statistical analysis in collaboration with Dr. Torsten Neher. Prof. Jürgen Margraf and Saskia Scholten designed the study. Additionally, he supervised the study proceeding and contributed to the writing, reviewing and especially to the final editing process.

Originality and plagiarism

The work is entirely written by the authors and if the authors have used the work and/or words of others it has been appropriately cited or quoted.

Data access and retention

Data can be received upon request by the authors.

Multiple, redundant or concurrent publication

The research presented in the manuscript has not been published elsewhere.

Acknowledgement of sources

Support by the Alexander von Humboldt Professorship awarded to Jürgen Margraf by the Alexander von Humboldt Foundation is gratefully acknowledged.

Disclosure and conflicts of interest

The authors declare that they do not have any conflict of interest.

Fundamental errors in published works

The authors will promptly notify the journal editor or publisher and cooperate with the editor to retract or correct the paper if they should discover a significant error or inaccuracy in our published work.

Reporting standards

An accurate account of the work performed as well as an objective discussion of its significance is presented.

Use of patient images or case details

The study was approved by the ethical committee of the faculty of psychology of the Ruhr-Universität Bochum, Germany.

Footnotes

1

We included the natural logarithm of the GDP values (log(GDP)) as independent variable for wealth to test a nonlinear saturating relationship between GDP and the outcome variable.

Appendix A

See Table A1.

Table A1.

Approximative justice index.

Dimension Indicator Source Short Description Link
Distributional justice
Health care OECD Doctors: Total, Per 1 000 inhabitants, 2012 Source: Health care resources https://data.oecd.org/healthres/doctors.htm
Public health protection Worldbank Out-of-pocket health expenditure (% of total expenditure on health) http://data.worldbank.org/indicator/SH.XPD.OOPC.TO.ZS?name_desc=true&view=chart
Equal opportunities
Early childhood education Worldbank Gross enrolment ratio, pre-primary, both sexes (%) http://data.worldbank.org/indicator/SE.PRE.ENRR?view=chart
Public investigations in health Worldbank Expenditure on education as % of total government expenditure (%) http://data.worldbank.org/indicator/SE.XPD.TOTL.GB.ZS?view=chart
Quality of education in schools Eurostat Pupil-teacher ratio in primary education (headcount basis) http://data.worldbank.org/indicator/SE.PRM.ENRL.TC.ZS?view=chart
General employment opportunities Worldbank Unemployment, total (% of total labor force) (modeled ILO estimate) http://data.worldbank.org/indicator/SL.UEM.TOTL.ZS?view=chart
Women in leadership positions Worldbank Female legislators, senior officials and managers (% of total) http://data.worldbank.org/indicator/SG.GEN.LSOM.ZS?view=chart
Income equality
Income equality Worldbank GINI coefficient (World Bank estimate) http://data.worldbank.org/indicator/SI.POV.GINI?view=chart
Employed women Worldbank Labor force, female (% of total labor force) http://data.worldbank.org/indicator/SL.TLF.TOTL.FE.ZS?view=chart
Employment protection OECD Strictness of employment protection legislation: individual and collective dismissals http://www.oecd-ilibrary.org/employment/data/employment-protection-legislation/strictness-of-employment-protection-legislation-individual-and-collective-dismissals_data-00658-en
Procedural justice
Rule of law Worldwide Governance Indicators (WGI) Perceptions of the extent to which agents have confidence in and abide by the rules of society, and in particular the quality of contract enforcement, property rights, the police, and the courts, as well as the likelihood of crime and violence. http://info.worldbank.org/governance/wgi/index.aspx#home
Government effectiveness Worldwide Governance Indicators (WGI) Perceptions of the quality of public services, the quality of the civil service and the degree of its independence from political pressures, the quality of policy formulation and implementation, and the credibility of the government’s commitment to such policies. http://info.worldbank.org/governance/wgi/index.aspx#home
Regulatory quality Worldwide Governance Indicators (WGI) Perceptions of the ability of the government to formulate and implement sound policies and regulations that permit and promote private sector development. http://info.worldbank.org/governance/wgi/index.aspx#home
Control of corruption Worldwide Governance Indicators (WGI) Perceptions of the extent to which public power is exercised for private gain, including both petty and grand forms of corruption, as well as “capture” of the state by elites and private interests. http://info.worldbank.org/governance/wgi/index.aspx#home
Intergenerational justice
Budget consolidation Worldbank Cash surplus/deficit (% of GDP) http://data.worldbank.org/indicator/GC.BAL.CASH.GD.ZS?view=chart
Protection of natural ressources Worldbank Energy use (kg of oil equivalent per capita) http://data.worldbank.org/indicator/EG.USE.PCAP.KG.OE?view=chart
Consumption of renewable energy Worldbank Renewable energy consumption (% of total final energy consumption) http://data.worldbank.org/indicator/EG.FEC.RNEW.ZS

References

  1. Antony M.M., Bieling P.J., Cox B.J., Enns M.W., Swinson R.P. Psychometric properties of the 42-item and 21-item versions of the depression anxiety stress scales in clinical groups and a community sample. Psychological Assessment. 1998;10:176–181. [Google Scholar]
  2. Arthaud-Day M.L., Near J.P. The wealth of nations and the happiness of nations: Why “accounting” matters. Social Indicators Research. 2005;74:511–548. [Google Scholar]
  3. Arts W., Gelissen J. Three worlds of welfare capitalism or more? Journal of European Social Policy. 2002;12:137–158. [Google Scholar]
  4. Boyce C.J., Brown G.D.A., Moore S.C. Money and happiness: Rank of income, not income, affects life satisfaction. Psychological Science. 2010;21:471–475. doi: 10.1177/0956797610362671. [DOI] [PubMed] [Google Scholar]
  5. Brehm S.S., Brehm J.W. Academic Press; New York: 1981. Psychological reactance: A theory of freedom and control. [Google Scholar]
  6. Bronfenbrenner U. Harvard University Press; Cambridge, Massachusetts, and London: 1979. The ecology of human development: Experiments by nature and design. [Google Scholar]
  7. Callan M.J., Kim H., Matthews W.J. Predicting self-rated mental and physical health: The contributions of subjective socioeconomic status and personal relative deprivation. Frontiers in Psychology. 2015;6:1–14. doi: 10.3389/fpsyg.2015.01415. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Cohen-Charash Y., Spector P.E. The role of justice in organizations: A meta-analysis. Organizational Behavior and Human Decision Processes. 2001;86:278–321. [Google Scholar]
  9. Colquitt J.A., Conlon D.E., Wesson M.J., Porter C.O., Ng K.Y. Justice at the millennium: A meta-analytic review of 25 years of organizational justice research. Journal of Applied Psychology. 2001 doi: 10.1037/0021-9010.86.3.425. [DOI] [PubMed] [Google Scholar]
  10. Cronbach L.J. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334. [Google Scholar]
  11. CSDH (2008). Closing the gap in a generation: health equity through action on the social determinants of health. Final report of the Commission on Social Determinants of Health. Geneva. doi: 〈http://dx.doi.org/10.1080/17441692.2010.514617〉.
  12. Deaton A. Income, health and well-being around the world: Evidence from the Gallup World Poll. Journal of Economic. 2009;22:53–72. doi: 10.1257/jep.22.2.53. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Deaton A., Stone A.A. Two happiness puzzles. American Economic Review. 2013;103:591–597. doi: 10.1257/aer.103.3.591. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Demakakos P., Nazroo J., Breeze E., Marmot M. Socioeconomic status and health: The role of subjective social status. Social Science & Medicine. 2008;67:330–340. doi: 10.1016/j.socscimed.2008.03.038. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Diener E., Biswas-Diener R. Will money increase subjective well-being? Social Indicators Research. 2002;57:119–169. [Google Scholar]
  16. Diener E., Diener M., Diener C. Factors predicting the subjective well-being of nations. Journal of Personality and Social Psychology. 1995;69:851–864. doi: 10.1037//0022-3514.69.5.851. [DOI] [PubMed] [Google Scholar]
  17. Diener E.D., Diener C. The wealth of nations revisited: Income and quality of life. Social Indicators Research. 1995;36:275–286. [Google Scholar]
  18. Diez-Roux A.V. Multilevel analysis in public health research. Annual Review of Public Health. 2000;21:171–192. doi: 10.1146/annurev.publhealth.21.1.171. [DOI] [PubMed] [Google Scholar]
  19. Dzuka J., Dalbert C. Mental health and personality of Slovak unemployed adolescents: The impact of belief in a just world. Journal of Applied Social Psychology. 2002;32:732–757. [Google Scholar]
  20. Eckersley R. Beyond inequality: Acknowledging the complexity of social determinants of health. Social Science & Medicine. 2015;147:121–125. doi: 10.1016/j.socscimed.2015.10.052. [DOI] [PubMed] [Google Scholar]
  21. Eger R.J., Maridal J.H. A statistical meta-analysis of the wellbeing literature. International Journal of Wellbeing. 2015;5:45–74. [Google Scholar]
  22. Eikemo T.A., Bambra C., Judge K., Ringdal K. Welfare state regimes and differences in self-perceived health in Europe: A multilevel analysis. Social Science & Medicine. 2008;66:2281–2295. doi: 10.1016/j.socscimed.2008.01.022. [DOI] [PubMed] [Google Scholar]
  23. Elovainio M., Heponiemi T., Sinervo T., Magnavita N. Organizational justice and health; review of evidence. Giornale Italiano Di Medicina Del Lavoro Ed Ergonomia. 2010;32:B5–B9. [PubMed] [Google Scholar]
  24. Enders C.K., Tofighi D. Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods. 2007;12:121–138. doi: 10.1037/1082-989X.12.2.121. [DOI] [PubMed] [Google Scholar]
  25. Enste, D.H., Wies, J. (2013). International Justice Monitor 2013: A comparison of 28 countries for the years 2000 to 2012 across six justice dimensions [Internationaler Gerechtigkeitsmonitor 2013: Ein Vergleich von 28 Ländern für die Jahre 2000 bis 2012 über sechs Gerechtigkeitsdimens. Köln.
  26. Esping-Andersen G. Polity Press; Cambridge: 1990. The three worlds of welfare capitalism. [Google Scholar]
  27. Falkenberg A.W. Quality of life: Efficiency, equity and freedom in the United States and Scandinavia. Journal of Socio-Economics. 1998;27:1–27. [Google Scholar]
  28. Field A., Miles J., Field Z. Sage Publications; London, Thousand Oaks, New Delhi, Singapore: 2012. Discovering statistics using R. [Google Scholar]
  29. Fischer R., Boer D. What is more important for national well-being: Money or autonomy? A meta-analysis of well-being, burnout, and anxiety across 63 societies. Journal of Personality and Social Psychology. 2011;101:164–184. doi: 10.1037/a0023663. [DOI] [PubMed] [Google Scholar]
  30. Gerring J. Causal Mechanisms: Yes, But. Comparative Political Studies. 2010;43:1499–1526. [Google Scholar]
  31. Gini C. Measurement of inequality of incomes. Economic Journal. 1921;31:124–126. [Google Scholar]
  32. Gwartney, J., Lawson, R., Hall, J. (2012). Economic Freedom of the World: 2012 [WWW Document]. URL 〈http://www.freetheworld.com/2012/EFW2012-complete.pdf〉.
  33. Hagerty M.R., Veenhoven R. Wealth and happiness revisited - Growing national income DOES go with greater happiness. Social Indicators Research. 2003;64:1–27. [Google Scholar]
  34. Haller M., Hadler M. Happiness as an expression of freedom and self-determination: A comparative multi-level analysis. In: Glatzer W., Von Below S., Stoffregen M., editors. Challenges for quality of life in the contemporary world. Springer; Netherlands, Amsterdam: 2004. pp. 207–231. [Google Scholar]
  35. Helliwell, J., Layard, R. & Sachs, J. (2013). World happiness report 2013, World Happiness Report 2013. doi:10.1093/acprof:oso/978099732739.001.0001.
  36. Inglehart R.F., Foa R., Peterson C., Welzel C. Development, freedom, and rising happiness. Psychological Science. 2008;3:264–285. doi: 10.1111/j.1745-6924.2008.00078.x. [DOI] [PubMed] [Google Scholar]
  37. Inglehart R.F., Welzel C. Cambridge University Press; New York: 2005. Modernization, cultural change and democracy: The human development sequence. [Google Scholar]
  38. Johnson W., Krueger R.F. How money buys happiness: Genetic and environmental processes linking finances and life satisfaction. Journal of Personality and Social Psychology. 2006;90:680–691. doi: 10.1037/0022-3514.90.4.680. [DOI] [PubMed] [Google Scholar]
  39. Jost J.T., Kay A.C., Thorisdottir H. Oxford University Press; New York: 2009. Social and psychological bases of ideology and system justification. [Google Scholar]
  40. Kahneman D., Deaton A. High income improves evaluation of life but not emotional well-being. Proceedings of the National Academy of Sciences of the United States of America. 2010;107:16489–16493. doi: 10.1073/pnas.1011492107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Kelley, J., & Evans, M.D.R. (2012). Societal inequality and individual subjective well-being: Results from 96 societies and 300,000 individuals, 1981–2008. In Proceedings of the annual meeting of the american sociological association. Denver.
  42. Kessler R.C., Aguilar-Gaxiola S., Alonso J., Chatterji S., Lee S., Ormel J.…Wang P.S. The global burden of mental disorders: An update from the WHO World Mental Health (WMH) surveys. Epidemiologia e Psichiatria Sociale. 2009;18:23–33. doi: 10.1017/s1121189x00001421. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Kondo N., Sembajwe G., Kawachi I., van Dam R.M., Subramanian S.V., Yamagata Z. Income inequality, mortality, and self rated health: Meta-analysis of multilevel studies. British Medical Journal. 2009;339:b4471. doi: 10.1136/bmj.b4471. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Kondo N., van Dam R.M., Sembajwe G., Subramanian S.V., Kawachi I., Yamagata Z. Income inequality and health: The role of population size, inequality threshold, period effects and lag effects. Journal of Epidemiology and Community Health. 2012;66:e11. doi: 10.1136/jech-2011-200321. [DOI] [PubMed] [Google Scholar]
  45. Kushlev K., Dunn E.W., Lucas R.E. Higher income Is associated with less daily sadness but not more daily happiness. Social Psychological and Personality Science. 2015;6:483–489. doi: 10.1177/1948550616657599. [DOI] [PMC free article] [PubMed] [Google Scholar]
  46. Lerner M.J. Springer; New York: 1980. The belief in a just world: A fundamental delusion. [Google Scholar]
  47. Lovibond, P.F. (2015). DASS translations [WWW Document]. URL 〈http://www2.psy.unsw.edu.au/groups/dass/translations.htm〉 (Accessed 19 November 2015).
  48. Lovibond, P.F.& Lovibond, S.H. (2016). DASS FAQ (Frequently Asked Questions) [WWW Document]. URL 〈http://www2.psy.unsw.edu.au/DASS/DASSFAQ.htm〉 Accessed 4.1.16.
  49. Lovibond P.F., Lovibond S.H. Manual for the depression anxiety stress scales. 2nd ed. Psychology Foundation; Sydney: 1995. [Google Scholar]
  50. Marmot M. The influence of income on health: Views of an epidemiologist. Health Affairs. 2003:31–46. doi: 10.1377/hlthaff.21.2.31. [DOI] [PubMed] [Google Scholar]
  51. McLeod J.D. Why and how inequality matters. Journal of Health and Social Behavior. 2015;56:149–165. doi: 10.1177/0022146515581619. [DOI] [PubMed] [Google Scholar]
  52. McMahon, F (Ed.), Towards a worldwide index of human freedom 2012. Fraser Institute.
  53. Mellor D., Vinet E.V., Xu X., Mamat N.H.B., Richardson B., Román F. Factorial invariance of the DASS-21 among adolescents in four countries. European Journal of Psychological Assessment. 2014;31:138–142. [Google Scholar]
  54. Merlo J., Chaix B., Yang M., Lynch J., Råstam L. A brief conceptual tutorial of multilevel analysis in social epidemiology: Linking the statistical concept of clustering to the idea of contextual phenomenon. Journal of Epidemiology & Community Health. 2005;59:443–449. doi: 10.1136/jech.2004.023473. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Ndjaboué R., Brisson C., Vézina M. Organisational justice and mental health: A systematic review of prospective studies. Occupational and Environmental Medicine. 2012;69:694–700. doi: 10.1136/oemed-2011-100595. [DOI] [PubMed] [Google Scholar]
  56. Oei T.P.S., Sawang S., Goh Y.W., Mukhtar F. Using the depression anxiety stress scale 21 (DASS-21) across cultures. International Journal of Psychology. 2013;48:1018–1029. doi: 10.1080/00207594.2012.755535. [DOI] [PubMed] [Google Scholar]
  57. Oishi S., Kesebir S., Diener E.E. Income inequality and happiness. Psycholical Science. 2011;22:1095–1100. doi: 10.1177/0956797611417262. [DOI] [PubMed] [Google Scholar]
  58. Ostrove J.M., Adler N.E., Kuppermann M., Washington A.E. Objective and subjective assessments of socioeconomic status and their relationship to self-rated health in an ethnically diverse sample of pregnant women. Health Psychology. 2000;19:613–618. doi: 10.1037//0278-6133.19.6.613. [DOI] [PubMed] [Google Scholar]
  59. Pickett K.E., James O.W., Wilkinson R.G. Income inequality and the prevalence of mental illness: A preliminary international analysis. Journal of Epidemiology and Community Health. 2006;60:646–647. doi: 10.1136/jech.2006.046631. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Pickett K.E., Wilkinson R.G. Income inequality and health: A causal review. Social Science & Medicine. 2015;128:316–326. doi: 10.1016/j.socscimed.2014.12.031. [DOI] [PubMed] [Google Scholar]
  61. Pickett K.E., Wilkinson R.G. Penguin; London: 2011. The spirit level: Why equality is better for everyone. [Google Scholar]
  62. Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D. & R Development Core Team (2015). nlme: Linear and nonlinear mixed effects models. R package version 3.1-128.
  63. Prilleltensky I. Wellness as fairness. American Journal of Community Psychology. 2011:21. doi: 10.1007/s10464-011-9448-8. [DOI] [PubMed] [Google Scholar]
  64. R Development Core Team (2013). R: A language and environment for statistical computing.
  65. Revelle, W. (2011). An overview of the psych package.
  66. Sacks D.W., Stevenson B., Wolfers J. The new stylized facts about income and subjective well-being. Emotion. 2012;12:1181–1187. doi: 10.1037/a0029873. [DOI] [PubMed] [Google Scholar]
  67. Scholten S., Velten J., Bieda A., Zhang X.C., Margraf J. Testing measurement invariance of the depression, anxiety, and stress scales (DASS-21) across four countries. Psychological Assessment. 2017 doi: 10.1037/pas0000440. [DOI] [PubMed] [Google Scholar]
  68. Schyns P. Crossnational differences in happiness: Economic and cultural factors explored. Social Indicators Research. 1998;43:3–26. [Google Scholar]
  69. Shim R., Koplan C., Langheim F.J.P., Manseau M.W., Powers R.A., Compton M.T. The social determinants of mental health: An overview and call to action. Psychiatr Ann. 2014;44:22–26. [Google Scholar]
  70. Steptoe A., Tsuda A., Tanaka Y., Wardle J. Depressive symptoms, socio-economic background, sense of control, and cultural factors in university students from 23 countries. International Journal of Behavioral Medicine. 2007;14:97–107. doi: 10.1007/BF03004175. [DOI] [PubMed] [Google Scholar]
  71. Stevenson B., Wolfers J. Subjective well-being and income: Is there any evidence of satiation? American Economic Review. 2013;103:598–604. [Google Scholar]
  72. Stevenson, B.& Wolfers, J. (2008). Economic growth and subjective well-being: reassessing the Easterlin paradox.
  73. Subramanian S.V., Kawachi I. Being well and doing well: On the importance of income for health. International Journal of Social Welfare. 2006;15:13–22. [Google Scholar]
  74. Subramanian S.V., Kawachi I. Whose health is affected by income inequality? A multilevel interaction analysis of contemporaneous and lagged effects of state income inequality on individual self-rated health in the United States. Health Place. 2006;12:141–156. doi: 10.1016/j.healthplace.2004.11.001. [DOI] [PubMed] [Google Scholar]
  75. Subramanian S.V., Kawachi I. Income inequality and health: What have we learned so far? Epidemiologic Reviews. 2004;26:78–91. doi: 10.1093/epirev/mxh003. [DOI] [PubMed] [Google Scholar]
  76. Tay L., Morrison M., Diener E. Living among the affluent: Boon or bane? Psychological Science. 2014;25:1235–1241. doi: 10.1177/0956797614525786. [DOI] [PubMed] [Google Scholar]
  77. The American Association for Public Opinion Research (2016). Standard definitions - Final dispostions of case codes and outcome rates for surveys, 9th edition. doi: 〈http://dx.doi.org/10.1111/J.1600-6143.2005.00812.X〉.
  78. The World Bank (2016). GDP per capita (current US$) [WWW Document]. URL 〈http://data.worldbank.org/indicator/NY.GDP.PCAP.CD〉. (Accessed 1 April 2016).
  79. The World Bank (2014). GINI index (World Bank estimate) [WWW Document]. URL 〈http://data.worldbank.org/indicator/SI.POV.GINI〉. (Accessed 20 April 2016).
  80. Van Hemert D.A., van de Vijver F.J.R., Poortinga Y.H. The Beck depression inventory as measure of subjective well-being: A cross-national study. Journal of Happiness Studies. 2002;3:257–286. [Google Scholar]
  81. Vásquez I., Štumberger T. An index of freedom in the world. In: McMahon F., editor. Towards a worldwide index of human freedom. Fraser Institute; 2012. pp. 55–112. [Google Scholar]
  82. Veenhoven R. Freedom and happiness: A comparative study in forty-four nations in the early 1990s. In: Diener E., Suh E.M., editors. Culture and subjective well-being. MIT press; Cambridge: 2000. pp. 257–288. [Google Scholar]
  83. Velten J., Lavallee K.L., Scholten S., Meyer A.H., Zhang X., Schneider S. Erratum to: Lifestyle choices and mental health: A representative population survey. BMC Psychology. 2016;4 doi: 10.1186/s40359-016-0106-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Welsch H. Freedom and rationality as predictors of cross-national happiness patterns: The role of income as mediating variable. Journal of Happiness Studies. 2003;4:295–321. [Google Scholar]
  85. Welzel C., Inglehart R.F., Klingemann H.-D. The theory of human development: A cross-cultural analysis. European Journal of Political Research. 2003;42:341–379. [Google Scholar]
  86. Wickham, H. (2016). The ggplot Package License GPL.
  87. Wickham S., Shryane N., Lyons M., Dickins T., Bentall R. Why does relative deprivation affect mental health? The role of justice, trust and social rank in psychological wellbeing and paranoid ideation. Journal of Public Mental Health. 2014;13:114–126. [Google Scholar]
  88. Wild D., Grove A., Martin M., Eremenco S., McElroy S., Verjee-Lorenz A., Erikson P. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures. Value Heal. 2005;8:95–104. doi: 10.1111/j.1524-4733.2005.04054.x. [DOI] [PubMed] [Google Scholar]
  89. Wilkinson R.G., Pickett K. Income inequality and social dysfunction. Annual Review of Sociology. 2009;35:493–511. [Google Scholar]
  90. Wilkinson R.G., Pickett K.E. Income inequality and population health: A review and explanation of the evidence. Social Science & Medicine. 2006;62:1768–1784. doi: 10.1016/j.socscimed.2005.08.036. [DOI] [PubMed] [Google Scholar]
  91. World Health Organization (2013). Mental health action plan 2013 - 2020. Geneva. doi:10.1017/CBO9781107415324.004.
  92. Zagorski K., Evans M.D.R., Kelley J., Piotrowska K. Does national income inequality affect individuals' quality of life in Europe? Inequality, happiness, finances, and health. Social Indicators Research. 2014;117:1089–1110. [Google Scholar]

Articles from SSM - Population Health are provided here courtesy of Elsevier

RESOURCES