Validity and Reliability of the Flourishing Scale in a Sample of Older Adults in Iran

Abstract

Background

Flourishing is related to positive outcomes for physical and mental health, as well as overall wellbeing. The aim of the present study was to determine the validity and reliability of the Flourishing Scale (FS) among a sample of older participants in Iran.

Methods

In this validation study, 300 older people were selected by cluster sampling method. Data were collected using a checklist for demographic characteristics, the FS, and the Oxford happiness questionnaire. The validity (face, content, convergent, and construct) and reliability (Cronbach’s alpha, test-retest) of the FS was evaluated in this cross-sectional study.

Results

The exploratory factor analysis demonstrated a one-dimensional structure consisting of 8 items with an eigenvalue of 3.583. The model had a good fit [χ² = 52.983, p < 0.001, χ²/df = 2.944, GFI = 0.958, CFI = 0.915, IFI = 0.949, TLI = 0.919, AGFI = 0.948, and RMSEA = 0.081, SRMR = 0.086] with all factor loadings greater than 0.5 and statistically significant. A test of concurrent validity showed a direct and significant association between the FS and the Oxford happiness questionnaire (r = 0.647, p < 0.001). The results of the reliability tests confirmed that the values of Cronbach’s alpha coefficient (0.819) and test-retest (0.821) were acceptable.

Conclusion

The Persian version of the FS demonstrated suitable validity and reliability among a sample of older participants.

Introduction

There is a growing body of literature that recognises the importance of successful and positive aging to cater to the growing aging population experienced by most countries around the world.^1–4 According to estimates, older people 65 years and over have an annual global growth rate of 2.5% per year.⁵ About two thirds of the world’s older people now live in developing countries such as Iran.⁶ According to Iran’s 2016 census of population and housing, 9.3% of the population is 60 years or older.⁷ The rapid increase in the number of older people creates important concerns, especially in relation to their wellbeing and mental health, and how practitioners and clinicians can best support the strengths of a growing older population.⁸

Mental health and wellbeing are widely recognized as imperative dimensions of positive aging.⁹ Assisting people to flourish in the later stages of life has been found to have a positive impact on moderating depression, as well as increasing happiness and life satisfaction.¹⁰ Positive psychology – that is, the scientific study of human flourishing and an applied approach to optimal functioning – is a growing field of scientific enquiry.^11,12 Positive psychology is concerned with human abilities and strengths and seeks to improve wellbeing through increasing positive feelings, behaviours, and thoughts, such as happiness, enjoyment, and optimism.¹³ Positive psychology interventions have been applied to a variety of contexts, including aged care, in order to help individuals thrive and improve their subjective wellbeing.¹⁴

Subjective wellbeing has been described as an individual’s perception of the quality of their life and includes behavioral, emotional, and cognitive components.¹⁵ According to Diener¹⁶ subjective wellbeing has a wide variety of causal influences and is related to positive affect and life satisfaction and includes dimensions of happiness, purposefulness, and vitality. The feeling of vitality is closely linked to happiness and is one of the most important human experiences.¹⁷ Vitality is directly related to life satisfaction and inversely related to anxiety, depression, and other physical and mental disorders.¹⁸

Flourishing is a state of optimal functioning synonymous with high levels of positive emotions, wellbeing, mental health, and psychological and social wellbeing.^19,20 Researchers have found human flourishing to have a range of benefits related to psychological and physical health, including reduced risk mortality.^21,22 Therefore, the literature provides sufficient evidence for nurses and other healthcare professionals to be attuned to strategies and interventions that promote flourishing amongst older adults.²³

In the literature, several measures are available for flourishing assessment. The Flourishing Scale (FS)²⁴ is one of the most commonly used scales to examine flourishing. The scale consists of 8 items and is applicable to people 12 years or older.²⁵ One of the benefits of this scale is that it is short and fluent with plain-language items that facilitate comprehension and suitability for older populations. In most of the studies that have been conducted on the FS, the sample consisted of adults or young adults.^26–30 In our knowledge, only two studies specifically assessed the validity and reliability of the FS in an older adult sample.^31,32 Momtaz, Hamid, Haron & Bagat³² and Didino, Taran, Baryshev & Casati³¹ conducted studies on samples of community-dwelling older Malaysians and Russians, respectively. They found that the Russian and Malaysian version of the FS seemed to have good psychometric properties and could serve as a valid and reliable instrument to evaluate flourishing among Russian and Malaysian older adults.

In addition to the research conducted on the cultural differences in the way flourishing is perceived and understood,³³ the psychometric properties of the FS have been studied in several countries including Spain,²⁶ China,³⁴ the Netherlands,²⁷ Japan,²⁸ Turkey,³⁵ Portugal,²⁹ New Zealand,³⁶ Singapore,²⁴ Malaysia,³² Russia,³¹ and Italy³⁷ with efficacious results. In Iran, the validity and reliability of this scale has been evaluated among Isfahan medical students and third-year female high school students.^25,30

Given that previous research has demonstrated that cultural influences play a significant role in people’s perceptions of flourishing,³³ it is necessary to validate the flourishing measurement instrument in Iran as well. A limited number of studies have been conducted to evaluate flourishing in Iranian older adults.^15,38 These studies used the Ryan and Frederick subjective vitality scale for measuring flourishing, and no prior research, to the authors’ knowledge, has psychometrically evaluated the FS in Iranian older adults. Therefore, the current study addresses this issues by providing the first validation of the FS in a sample of older participants in Iran. The level of psychological well-being in older adults is probably related to the local socio-economic and cultural situation and thus different countries could show different patterns.

Methods

In this validation study, 300 older people were selected using a multi-stage cluster sampling technique. In the first stage, the Qazvin city was divided into 5 clusters: North, South, East, West, and Center. Next, one mosque and one park were randomly selected from each cluster. Eligible older people were selected from these places using convenience sampling method. Participants were required to be 60 years or older and hold Iranian citizenship to be included in the study. Participants who reported having psychiatric problems (eg, Alzheimer’s disease or other forms of dementia), a physical disability or limitation (eg, confinement to bed or wheel chair use), or terminal illness, were excluded from the study.

For a confirmatory factor analysis (CFA), 10 subjects per item, a minimum sample size of 300, and a KMO > 0.6 is acceptable.^39,40 The Oxford happiness questionnaire with 29 items had the most items among the scales used in the study. This indicates that 290 (29x10) subjects are needed for the Oxford happiness questionnaire. As this number is fewer than the minimum required for a CFA, 300 participants were used in this study. Furthermore, the KMO value was 0.852, indicating that the data and sample size were adequate for the factor analysis.⁴¹ A total of 330 participants were recruited to supply a final sample size of 300. The study had a 90% response rate and 10% of the participants (N= 30) felt tired and did not answer all the questions. Sampling continued until 300 participants were recruited in order to make up for the uncompleted responses. Data were collected through face-to-face interviews in the study places (mosques and parks) from April to August 2017 by one researcher.

Instruments

Data were collected through the use of a socio-demographic checklist, the FS, and the Oxford happiness questionnaire. The socio-demographic checklist elicited information from participants that included age, gender, marital status, employment details, and educational background.

The Flourishing Scale

Flourishing was measured by the FS which was developed by Diener et al (2010). The FS is an eight-item scale that has been designed to measure wellbeing in the domains of relationships, life purpose, self-esteem, and optimism. This scale assesses eudemonic dimensions of wellbeing. All 8 items of the scale are expressed in a positive direction and the responses are based on a 7-point Likert scale, ranging from “strongly disagree” to “strongly agree.” A higher score indicates higher levels of respondents’ wellbeing.^24,36

The present study employed the use of the Persian version of the FS that was translated by Moradi Siah Afshadi M, Ghasemi³⁰ based on World Health Organization protocol.

The Oxford happiness questionnaire

The Oxford happiness questionnaire was developed by Hills and Argyle (2002)⁴² at Oxford University to measure psychological wellbeing. It consists of 29 items rated on a 5-point Likert-type scale. According to Hone et al (2014), a total score of 48 or above is considered high.³⁶ In the present study, the FS demonstrated an excellent internal reliability of consistency (Cronbach’s alpha = 0.95).

Face Validity Assessment

The face validity of the Persian version of the FS was evaluated both qualitatively and quantitatively. In order to evaluate the qualitative face validity of the Persian version of the FS, ten older adults assessed and commented on the appropriateness and relevance of the items.⁴³ The scale was corrected according to their comments.

To assess the quantitative face validity, ten older adults were asked to determine the importance of the items on a 5-point Likert-type scale, ranging from “not important” to “completely important”. The item impact score of the items was measured by using the following formula: impact score = frequency × importance. In this formula, frequency is equal to the number of older people who regard each item as “important” or “completely important”, noted by scores of ‘4ʹ and ‘5ʹ, respectively. If the impact score of the item was greater than 1.5, the item was suitable and was therefore maintained in the scale.⁴⁴

Content Validity Assessment

The content validity of the Persian version of the FS was evaluated both qualitatively and quantitatively. For the qualitative content validity assessment, the Persian version of the FS was provided to fifteen experts in sociology, gerontology, psychology, and educational nursing, and they were requested to give feedback on the items of the scale in terms of wording, item allocation, grammar, and scaling.⁴⁵ A final version of the scale was created after applying their comments.

The Content Validity Ratio (CVR) and the Content Validity Index (CVI) were used for the quantitative content validity analysis. CVR reflects whether the items are essential or not. Accordingly, fifteen experts were requested to rate the essentiality of the FS items on a 3-point Likert-type scale consisting of “not essential”, “useful but not essential”, and “essential”. A higher score of CVR indicates greater agreement among the experts. The formula for the CVR is: CVR = (Ne – N/2)/(N/2), where Ne is the number of experts indicating an item as “essential” and N is the total number of experts.^43,46 According to Lawshe (1975), the minimum acceptable value for CVR is 0.49 when the number of experts is fifteen.⁴⁷

The Items Content Validity Index (I-CVI) shows the degree to which the items of the intended scale are relevant. At the item level, I-CVI is calculated from the number of experts who rate the item as either a 3 or 4 on a 4-point likert scale, divided by the total number of experts. Judgment on each item is made as follows: when the number of experts is fifteen, the I-CVI value of 0.79 or greater shows the item to be appropriate; between 0.70 and 0.79, it needs revision; and less than 0.70, it is eliminated.⁴⁸ The CVR and I-CVI for the FS items are presented in Table 1.

Table 1.

The I-CVI and CVR for the Flourishing Scale Items

Items	I-CVI	CVR
	Relevancy (1–4)	Essential (1–3)
1. I lead a purposeful and meaningful life	0.86	1.00
2. My social relationships are supportive and rewarding	0.80	0.60
3. I am engaged and interested in my daily activities	0.93	1.00
4. I actively contribute to the happiness and wellbeing of others	0.93	0.73
5. I am competent and capable in the activities that are important to me	0.73	0.60
6. I am a good person and live a good life	0.80	0.60
7. I am optimistic about my future	1.00	0.86
8. People respect me	0.73	0.60

Notes: Copied from Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D., Oishi, S., & Biswas-Diener, R. (2009). New measures of well-being: Flourishing and positive and negative feelings. Social Indicators Research, 39, 247-266.

Abbreviations: I-CVI, items content validity index; CVR, content validity ratio.

Construct Validity Assessment

The construct validity of the Persian version of the FS was assessed by conducting an exploratory factor analysis (EFA) with Varimax rotation. First, the adequacy of using EFA was assessed through the Kaier-Meyer-Olkin (KMO) criterion and the Bartlett Sphericity test. Recommended KMO values should be equal to or above 0.60, and the Bartlett Chi-Square test should be statistically significant to support this type of statistical analysis.⁴⁹ The number of components was determined based on eigenvalues and a scree plot. Items with absolute loading values of 0.30 or greater were regarded as appropriate.⁵⁰ Second, a confirmatory factor analysis (CFA) was carried out to confirm the EFA. Due to the covariance matrix, Maximum Likelihood (ML) method was adopted. Reporting multiple fit indices to estimate the good-fitting models is necessary to evaluate consistency among different indices.⁴⁹ Various indices to evaluate fit were used: Chi-Square (χ²), Chi-Square/degrees of freedom (χ²/df); an adjusted model showing a value between 2 and 3, although values up to 5 can be accepted as evidence of adequacy; GFI and AGFI (values near 0.90 are recommended); CFI, values close to or higher than 0.90 suggest an adequate fit; TLI, values close to 1.00 are satisfactory, but those between 0.80 and 0.90 are also acceptable; SRMR, values less than 0.5 are considered satisfactory, however values close to 0.8 may also be acceptable; and RMSEA, values between 0.05 and 0.08 are recommended, accepting those up to 0.10.⁵¹

Reliability Assessment

The reliability of the Persian FS was assessed by calculating Cronbach’s alpha and test-retest.

Ethical Consideration

The study was approved by the Ethics Committee of Qazvin University of Medical Sciences, Qazvin, Iran (IR.QUMS.REC.1396.494). The participants were informed about the objectives, procedures, potential benefits, and drawbacks of the study. Furthermore, they were instructed that participation was voluntary and that confidentiality of the obtained information was guaranteed. The participant consent was written informed consent and this study was conducted in accordance with the Declaration of Helsinki.

Statistical Analysis

We used Statistical Package for Social Sciences version 21.0 software for Windows (IBM SPSS Statistics for Windows, Version 21.0. Armonk, NY: IBM Corp., USA) and AMOS for statistical calculations. The normal distributions of the data were examined and approved by skewness and kurtosis.

Results

The mean age of the participants of the present study was 66.1±6.5 years old, ranging from 60 to 98. The majority of the participants were male (N = 164, 54.7%), married (N = 236, 78.7%), retired (N = 135, 45.0%), and literate (N = 241, 80.3%) (Table 2).

Table 2.

Demographic Profiles of the Participants

Characteristics	N (%)
Gender
Male	164 (54.7%)
Female	136 (45.3%)
Marital Status
Single	64 (21.3%)
Married	236 (78.7%)
Education
Illiterate	59 (19.7%)
Primary	31 (10.3%)
Under Diploma	117 (39.0%)
Diploma	54 (18.0%)
Academic	39 (13.0%)
Job
Retired	135 (45.0%)
Employed	37 (12.3%)
Housewife	96 (32.0%)
Unemployed	32 (10.7%)

Abbreviation: N, number.

Table 3 reports the results of the Exploratory Factor Analysis (EFA) of the 300 participants. The Kaiser-Meyer-Olkin value (KMO = 0.852) and the results of Bartlett’s test of sphericity (691.796, df = 28, p < 0.001) indicated that the data were suitable for conducting the EFA. Using the scree plot (Figure 1) and eigenvalue >1 criteria, the EFA revealed one factor comprised of 8 items, accounting for 44.792% of the variance.

Table 3.

Factor Structure of the Flourishing Scale

Items	Mean±SD	Component	Factor Loading	Eigenvalue	Explained Variance	Cronbach’s Alpha	Average Variance Extracted
Item 3	5.86±1.49	0.790	0.760	3.583	44.792	0.819	0.443
Item 6	5.99±1.20	0.787	0.747
Item 7	5.76±1.59	0.707	0.654
Item 1	5.60±1.60	0.643	0.586
Item 5	6.11±1.12	0.643	0.578
Item 4	6.31±1.13	0.636	0.563
Item 8	6.41±1.12	0.564	0.487
Item 2	5.73±1.61	0.539	0.454

Abbreviations: SD, standard deviation.

Figure 1.

Scree plot of exploratory factor analysis.

As reported in Table 3, Cronbach’s alpha (0.819) demonstrated good internal consistency among the items. The result of the test–retest reliability (0.821) was also in the acceptable range.

The results of a Pearson correlation analysis showed a significant positive relationship between the FS and the Oxford happiness questionnaire (r = 0.647, p < 0.001), providing support for the concurrent validity of the scale.

The CFA sought to test the structure of the EFA, grouping the 8 items of the FS into a single factor. The main results of this model are shown in Figure 2. The model was shown to be a good fit [χ² = 52.983, p < 0.001, χ²/df = 2.944, GFI = 0.958, CFI = 0.915, IFI = 0.949, TLI = 0.919, AGFI = 0.948, and RMSEA = 0.081, SRMR = 0.086]. Average variance extracted of the construct was 0.443, which is due to the conservativeness of this measure.

Figure 2.

The final structural model of the Persian version of the FS among a sample of older adults in Iran.

Discussion

The purpose of this study was to determine the psychometric properties of the Persian version of the FS amongst older participants in Iran. Exploratory and confirmatory factor analysis methods were used to investigate the underlying structure of this scale. The results of the exploratory factor analysis showed that the FS is a one-dimensional structure accounting for 44.792% of the variance among the older adults. Results from national²⁵ and international^{24,26,29,32,34,35} studies on a range of age groups have also confirmed the one-dimensionality of the scale. For example, Diener E, Wirtz D (24) reported the FS to have a one-dimensional structure explaining 53% of the variance. Furthermore, Moradi Siah Afshadi et al (2015) demonstrated a one-factor structure explaining 46% of the variance with 200 medical students at the Isfahan University of Medical Sciences.³⁰ Momtaz et al³² also recognized the presence of one strong factor with an eigenvalue above 1 (5.86), explaining 73.20% of the variance among older Malaysians. Likewise, Didino et al³¹ reported one strong factor with an eigenvalue of 3.56, explaining 37% of the total variance among older Russians.

A CFA model was applied to determine the validity of the Persian version of the FS in the present study. The results showed that all fitness indicators were in suitable ranges in line with previous research. Giuntoli et al³⁷ reported good fitness characteristics for the Italian version of the FS. However, the CFA of the Bahasa Melayu version of the FS indicated satisfactory model fit for older people after modifying the model by correlating the errors.³² Furthermore, in a study among Russian older adults, the model showed a better fit after error correlations were used, and all indices had satisfactory values within the acceptable range.³¹ Tong and Wang (2017)³⁴ showed a better fit after the modification index using one error covariance in the Chinese version of the FS.

In the present study, items 2 (“My social relationships are supportive and rewarding”) and 8 (“People respect me”) showed the lowest factor loadings. Similarly, in the study by Hassani and Nadi (2015), these two items showed the lowest factor loading compared to the other items of the scale.²⁵ The weak factor loading on item 2 can be due to the ambiguity of this question, which may result in the participants interpreting the phrases in different ways. Regarding item 8, it may be related to the Iranian culture, which believes that a positive response to this question is a sign of selfishness and being far from humble. Because of this, respondents-especially older people – may refuse to give a truthful answer.

Item 3, “I am engaged and interested in my daily activities”, had the highest factor loading (0.76), as those who feel more energetic are more likely to engage in daily activities, and would be expected to perceive physical activity as easier. Likewise, Ju (2017) indicated that physical activity was positively associated with both meaning in life and subjective vitality.⁵² Other research has shown that participation in a physical activity program has positive effects on participants’ sense of vitality due to the mediation of physical functioning.⁵³

The results of this study showed a significant and direct correlation between flourishing and happiness that is consistent with the results of studies by Keshavarz et al (2005)¹⁸ and Diener et al (2010).²⁴ One reason for this finding may be that both constructs (flourishing and happiness) are associated with positive emotions. Also, it has been established that flourishing increases happiness through improving physical health, mobility, mental health, and social functioning.¹⁸ Therefore, using the FS could be an appropriate alternative to the Oxford happiness questionnaire in the field of older adult research.

The results of the present study showed that the reliability tests (Cronbach’s alpha and test-retest) were in the acceptable ranges. It is clear that when Cronbach’s alpha is closer to 1, the internal consistency of the items will be more homogeneous. It also indicates the scale’s items are measuring a similar concept, and that there is no conceptual dispersion. In previous studies on different age groups in Singapore,²⁴ New Zealand,³⁶ France,⁵⁴ Italy,⁵⁵ Japan,²⁸ Turkey,³⁵ Portugal,²⁹ and Iran,^25,30 Cronbach’s alpha coefficients were reported from 0.80 to 0.91, which is within the acceptable range (ie, above 0.7). Therefore, it can be assumed that the items of the scale assess a similar flourishing concept. The test–retest reliability was 0.70 with a two-week interval, which is in accordance with the results of the study by Diener et al (2010) in the USA (0.70), which was performed with a one-month interval.²⁴ Furthermore, the test-retest of another study in Japan (2014) on 336 students aged 18 to 24 years with a one-month interval was equal to 0.87.²⁸ Hassani and Nadi (2015) estimated the test–retest reliability coefficient of a vitality questionnaire to be 0.83 on 103 students with a two-week interval.²⁵ As a whole, the results of all previous studies showed the optimal level of test–retest reliability. The difference in the amount of correlation coefficients in the aforementioned studies can be attributed to the sample under investigation, as the cognitive functioning of the students may be significantly better than older participants.

Limitations

The sample of this study was comprised of community‑dwelling older adults, which limits the potential to generalize the results to older people living in institutions. A second limitation of the study relates to the use of self-report questionnaires to elicit information from participants. Although partially addressed through inclusion criteria, the cognitive capacity of respondents at the time the study took place may have had some influence on the results of the study. Another limitation of the study is that only the older people in public places such as parks and mosques were studied, and those unable to be present in these places (eg, due to illness or disability) were not examined. It is also reasonable to suggest the older adults residing in the city of Qazvin may not necessarily represent all older adults in Iran.

Future Research

Findings of the present study suggest the FS is an efficacious tool for evaluating flourishing in older populations in Iran. Given that the tool can be used for children as young as 12, future research should consider evaluating the psychometric properties of the Persian version of the tool for Iranian youth. There has been no previous research that has investigated this cohort and a reliable and valid measure of this type has great potential for informing proactive interventions concerned with mental health and wellbeing in secondary school.^56,57 There is also growing evidence on the role of euthymia on positive aging and flourishing.^58,59 Therefore, it is suggested that future studies use the FS in conjunction with the Euthymia Scale. Additionally, the clinimetric properties of the FS, consisting of clinical validity, utility, sensitivity, and scalability were not evaluated in this study. It is suggested that future studies evaluate the clinimetric features of the FS, as this scale can be reasonably used amongst older adults in a clinical setting.

Conclusions

This study confirmed adequate psychometric properties and factor structure of the FS in a sample of older Iranian participants. Findings suggest that the scale can be used as a valid and reliable tool for the assessment of flourishing experienced by Iranian older adults. The ease of implementation (and brief number of items) provides researchers and clinicians with a time-saving tool that could be used extensively to assess human flourishing in Iran.

Disclosure

The authors report no conflicts of interest in this work.