Abstract
Our aim was to examine measurement invariance of the Flourishing Scale (FS)—a concise measure of psychological wellbeing—across two study samples and by population characteristics among Canadian adolescents. Data were retrieved from 74,501 Canadian secondary school students in Year 7 (2018–2019) of the COMPASS Study and from the original validation of the FS (n = 689). We assessed measurement invariance using a confirmatory factor analysis in which increasingly stringent equality constraints were specified for model parameters between the following groups: study sample (i.e., adolescents vs. adults), gender, grade, and ethno-racial identity. In all models, full measurement invariance of the FS across all sub-groups was demonstrated. Our findings support the validity of the FS for measuring psychological wellbeing among Canadian adolescents in secondary school. Observed differences in FS score among subgroups therefore represent true differences in wellbeing rather than artifacts of differential interpretation.
Keywords: wellbeing, adolescent wellbeing, adolescent health, measurement, validity
1. Introduction
In recent years, there has been increased focus on positive psychology within adolescent health literature. Rather than an emphasis on dysfunction and psychopathology, shifts toward positive psychology are commensurate with shifting dual continua models of mental health and illness [1,2] and newer theories of positive youth development [3,4,5]. Factors grounded in positive mental health and resilience—such as social and psychological wellbeing—have been identified as protective against the development of mental disorders (e.g., anxiety, depression) [6,7]. Flourishing, for example, is a state of overall wellbeing used to describe the presence of mental health [1]. Among adolescents, those who are flourishing are more likely to thrive academically [8] and may be less likely to engage in potentially harmful behaviours including bullying involvement [9], binge drinking [10], and cannabis use [11,12]. Importantly, recognizing adolescence as a developmental period often involving risk-taking and experimentation [13,14], individuals’ overall sense of wellbeing may even buffer the mental health sequelae of such behaviours [11,15].
The secondary school environment presents an opportunity for interventions which aim to foster adolescents’ psychological wellbeing and resilience. Large data systems, such as the COMPASS Study [16] in Canada, serve as valuable infrastructure by which such school-based interventions can be evaluated. However, this work requires robust methods of measuring (and meaningfully quantifying changes in) wellbeing among adolescents. More broadly in Canada, there is an expressed need for population-level indicators of positive mental health and wellbeing in surveillance research, and colleagues have placed effort on finding an appropriate measure [17]. While the measurement of concepts such as wellbeing is inherently challenging [18], several tools exist. The Scale of Positive and Negative Experience (SPANE) and Flourishing Scale (FS), for example, were developed by Diener and colleagues [19] in light of contemporary theories of subjective wellbeing. Whereas researchers have been traditionally concerned with either hedonic (i.e., positive feelings) or eudemonic (i.e., positive functioning) beliefs [20], more recent theorists have argued in favour of an integrative approach to conceptualizing wellbeing [21,22,23] rather than one in which hedonia and eudemonia are considered mutually exclusive. Definitions of flourishing have referred to a state in which hedonic and eudemonic wellbeing are simultaneously present [21,24].
Our current study is concerned specifically with the FS, which consists of eight concise items related to concepts such as autonomy, self-esteem, optimism, and relationships. The FS provides a single score of respondents’ self-perceived psychological wellbeing [19]. Over the last decade, the tool has been validated across several populations (e.g., post-secondary students [25,26,27,28], older adults [29] and with respect to different cultural contexts and languages (e.g., Arabic [30], Chinese [31,32,33], Dutch [34,35], French [36], Greek [37], Persian [38], Portuguese [39,40], Spanish [41,42,43], Urdu [44])). Yet, while the FS has been shown to have strong psychometric properties across adult age groups [26,45], research among adolescents in Canada or elsewhere has been limited.
One particular question in psychometric research relates to whether a given scale measures the actual construct it was intended to measure (e.g., psychological wellbeing), and whether measurement of the construct is interpreted consistently despite differences in respondents’ characteristics. This property—referred to as measurement invariance—is a prerequisite for meaningfully comparing a measure between groups [46], thus limiting risk of bias as a function of differential interpretation [47]. To our knowledge, no previous studies have sought to test measurement invariance of the FS among adolescents in Canada. Relying on a large, school-based sample of Canadian students in the COMPASS Study [16], the primary objectives of our present study were twofold: first, to test measurement invariance of the FS between our study sample (i.e., adolescents) and Diener’s original study sample (i.e., adults); second, to test measurement invariance of the FS among adolescents by sociodemographic subgroups. These included gender, grade (age), and ethno-racial identity given their relevance as determinants of health and wellbeing among adolescents. Our secondary objective sought to estimate differences in FS scores across adolescent subgroups (i.e., by gender, grade, and ethno-racial identity).
2. Materials and Methods
2.1. Design and Samples
The present study used student-level data from Year 7 (Y7 (2018, 2019)) of the COMPASS Study—a large, prospective cohort study (2012–2021) of secondary school students in Canada [16]. Students self-reported various behavioural (e.g., physical activity, substance use) and mental (e.g., depression, anxiety) health indicators using the COMPASS student questionnaire (Cq), administered annually within participating schools during class time. In Y7, a total of 74,501 students across 136 schools (8 in Alberta, 15 in British Columbia, 51 in Ontario, 52 in Québec) completed the Cq. Data were collected using active-information, passive-consent data collection protocols [48] that have been approved by the University of Waterloo Office of Research Ethics and participating school boards. Further COMPASS Study details are available elsewhere in print [16] and online (www.compass.uwaterloo.ca).
Additional data were obtained from the original, multi-site validation study of Diener’s FS [19]. The study sample included 689 adult participants recruited across six post-secondary institutions in the United States and Singapore. Using these data, the FS was shown to have good psychometric properties and strong convergent validity with existing measures of wellbeing [19]. Findings of the original FS validation are available in print [19].
2.2. Instrument
The FS [19] was included as a component of the Cq’s mental health module (MH-M; [49,50]). The FS consists of the following statements: (1) I lead a purposeful and meaningful life, (2) my social relationships are supportive and rewarding, (3) I am engaged and interested in my daily activities, (4) I actively contribute to the happiness and wellbeing of others, (5) I am competent and capable in the activities that are important to me, (6) I am a good person and live a good life, (7) I am optimistic about my future, and (8) people respect me. In Diener’s original FS [19], individuals are asked to rate their level of agreement to each statement using a 7-point Likert scale (1 = strongly disagree, 2 = disagree, 3 = slightly disagree, 4 = neither agree nor disagree, 5 = slightly agree, 6 = agree, 7 = strongly agree), where possible sum scores range from 8 to 56 and higher scores indicate greater psychological wellbeing. For the purpose of suitability in large-scale school data collections through COMPASS [49], the FS response options were modified on the Cq to a 5-point Likert scale (1 = strongly agree, 2 = agree, 3 = neither agree nor disagree, 4 = disagree, 5 = strongly disagree) yielding a score between 8 and 40, but where higher scores were indicative of poorer psychological wellbeing.
We reverse-coded the FS scoring in the Cq MH-M for consistency with Diener’s original FS, and collapsed the strongly agree/agree and strongly disagree/agree Likert response options of the original FS for consistency with the Cq MH-M. As a result of these changes, composite FS scores collected from both samples ranged between 8 and 40 and higher scores indicated greater psychological wellbeing. Internal consistency of the FS was high within the adolescent COMPASS Study sample (α = 0.87) as well as in Diener’s original sample (α = 0.87).
The Cq also allows students to self-report on various sociodemographic characteristics including gender (“male, female” in the Cq and hereafter referred to as “boy, girl”), grade (9,10,11,12, and “other,” which included students in Québec enrolled in Secondaire I and II—equivalent to grades 7 and 8 in other provinces), as well as those enrolled in a secondary school class with no official grade equivalent (e.g., “new immigrant” classes in Québec). Note that there is no grade 12 in Québec. Age and weekly spending/saving money (CAD 0, 1–20, 20–100, 100+, don’t know) were used as a proxy measure of student-level socioeconomic status and part-time employment. Students also reported their ethno-racial identity by selecting from one or more listed identities in the Cq. Using these responses, we re-categorized students as racialized (Black, Asian, Latin American, Indigenous, other, mixed) or non-racialized (white).
2.3. Statistical Analysis Strategies
Measurement invariance of the FS was investigated using a four-step procedure in which increasingly stringent equality constraints were specified for model parameters between groups (e.g., adolescents vs. adults; boys vs. girls) within a multiple-group confirmatory factor analysis. In the first step, the configural model imposed no equality constraints on parameters and was the origin for subsequent tests [51]. Configural invariance suggests that the same underlying factor structure is observed between comparison groups. Second, the metric model examined the extent to which the factor loadings for each item were equivalent between groups. Invariant factor loadings are a prerequisite for making valid group comparisons [52]. Third, the scalar model tested for evidence that item intercepts were equivalent [46], so as to verify whether mean differences at the item level are fully explained by mean differences at the factor level. In the final step, the strict model was specified to determine whether the variances of the regression equations for each item were equivalent across groups (i.e., item residuals). Strict invariance is required for defensible item-level comparisons [53]. This systematic approach to adding constraints allows the identification of specific parameters that contribute to model misfit and, ultimately, differences in the interpretation of the latent construct [47]. When model fit is adequate and change in fit indices negligible, equal factor loadings (i.e., metric invariance) suggest that groups attribute the same meaning to the construct; equal factor loadings and intercepts (i.e., scalar invariance) suggest that meaning of the items that comprise the construct is the same between groups; and equal factor loadings, intercepts, and residuals suggest that the explained variance is the same and the construct is measured identically.
We relied on two criteria to establish measurement invariance. The first required adequate model fit at each level of testing. We determined a priori that at least two fit indices (comparative fit index (CFI), square root mean residual (SRMR), or root mean standard error of approximation (RMSEA)) needed to meet established cut-points to declare adequate model fit [54,55,56]. The cut-points were CFI ≥ 0.950; SRMR ≤ 0.080 and RMSEA ≤ 0.080 [46]. The second specified that changes in fit indices (i.e., from the model with fewer equality constraints on parameters to the more constrained model) must not exceed established cut-points. We determined a priori that of ΔCFI, ΔSRMR, or ΔRMSEA scores, at least two needed to meet this criterion to establish measurement invariance at any given level of testing. The cut points for change in model fit indices were ΔCFI ≤ −0.010, ΔSRMR ≥ 0.030, or ΔRMSEA ≥ 0.015 [57]. Given that χ2 goodness-of-fit and Δχ2 are highly influenced by sample size, we did not rely on them as indices of model fit.
If model fit was inadequate at the configural level, we reviewed modification indices to identify potential correlations between like items that could be specified to improve model fit. Where measurement invariance at a given level of testing was not established (i.e., substantial worsening of model fit), we reviewed modification indices and identified constraints on relevant non-invariant parameters that could be removed to improve model fit. We then tested the prespecified model against the less constrained model and computed change scores again. This approach, known as partial invariance, argues that only a subset of model equivalent parameters is needed for substantive analyses between groups [58].
Measurement invariance testing was conducted with robust standard errors [59,60] using Mplus version 6.11 (Muthén & Muthén, Los Angeles, CA, USA) [61]. Additional descriptive (t and one-way ANOVA tests) and parametric (mixed linear regression) analyses were conducted in SAS version 9.4 (SAS Institute Inc., Cary, NC, USA) [62]. Adjusted β-estimates (controlling for province and weekly spending/saving money) were reported alongside 95% confidence intervals. We calculated the intra-class correlation coefficient (ICC) explaining potential variation in students’ FS score as a result of school-level clustering (ICCFS = 0.033). Although we detected a marginal amount of within-school variation, we proceeded to adjust for students’ clustering by schools within all measurement invariance tests and regression modelling. We used the full information maximum likelihood function in Mplus and SAS (PROC MIXED) to preserve cases with missing data [63].
3. Results
3.1. Sample Characteristics
Among COMPASS Y7 participants (N = 74,501), the mean FS score was 32.19 (SD = 5.72). Students’ sum scores ranged from 8 to 40, and the median FS score was 32; 41% (N = 28,553) of students reported FS scores below the mean. Half of students (50%) were girls, and 31% reported a racialized identity. Students’ mean age was 15 years (SD: 1.5 years, range: 12 to 19 years) and roughly 81% were within grades 9–12. The majority of students were from Ontario (41%) or Québec (30%). Student characteristics are presented with mean FS score in Table 1; FS total and item-level means are further shown by subgroup in Appendix A. Refer to Table 2 for FS score norms (as percentile rankings) among students in our sample.
Table 1.
Flourishing Scale 1 Score | ||||
---|---|---|---|---|
Measure | n (%) | Mean (SD) | F, t | p |
Gender | ||||
Boys (ref.) | 37,126 (50.4) | 32.64 (5.60) | 19.80 | <0.0001 |
Girls | 36,546 (49.6) | 31.78 (5.75) | ||
Grade | ||||
9 (ref.) | 17,294 (23.5) | 32.14 (5.67) | 362.47 | <0.0001 |
10 | 17,201 (23.3) | 31.86 (5.63) | ||
11 | 15,940 (21.6) | 31.77 (5.69) | ||
12 | 9357 (12.7) | 31.29 (5.86) | ||
Other 2 | 13,891 (18.9) | 33.83 (5.43) | ||
Ethno-Racial Identity | ||||
Non-racialized (ref.) | 51,017 (69.1) | 32.63 (5.53) | 30.88 | <0.0001 |
Racialized | 22,822 (30.9) | 31.18 (6.00) | ||
Weekly Spending Money | ||||
CAD 0 or “don’t know” (ref.) | 24,669 (33.6) | 31.83 (5.93) | 51.98 | <0.0001 |
CAD 1–20 | 17,744 (24.2) | 32.26 (5.55) | ||
CAD 21–100 | 16,793 (22.9) | 32.51 (5.41) | ||
CAD 100+ | 14,216 (19.3) | 32.35 (5.88) | ||
Province | ||||
Alberta (ref.) | 3301 (4.4) | 31.63 (5.79) | 664.79 | <0.0001 |
British Columbia | 10,402 (14.0) | 30.95 (5.75) | ||
Ontario | 30,675 (41.2) | 31.54 (5.82) | ||
Québec | 30,123 (40.4) | 33.31 (5.41) | ||
Total sample | 74,501 (100.0) | 32.19 (5.72) |
Note. ref. = reference category; SD = standard deviation. 1 Higher scores indicate greater psychological wellbeing. 2 Includes Secondaire I and II in Québec.
Table 2.
Percentile Rank | Flourishing Scale 1 Score |
---|---|
0 | 8 |
1 | 15 |
5 | 22 |
10 | 25 |
25 | 29 |
50 | 32 |
75 | 37 |
90 | 40 |
95 | 40 |
99 | 40 |
100 | 40 |
Note. Flourishing Scale scores range from 8 to 40; percentile rankings for scores not shown can be approximated by interpolation. 1 Higher scores indicate greater psychological wellbeing.
A total of 6% (n = 4,486) of COMPASS Y7 students were missing FS scores. Some item non-response was also observed across measures of gender (1%, n = 829), grade (1%, n = 818), ethno-racial identity (<1%, n = 662), and spending money (<2%, n = 1079). Additional analyses predicting missingness in the FS by student characteristics are available in Appendix B. Students were more likely to have missing FS scores if they were boys or racialized; log-odds of missingness decreased with increasing school grade.
3.2. Measurement Invariance by Sample
Given that a total composite score is used for the FS, we proceeded directly to fitting the single-factor model in the confirmatory factor analysis. Fit of the one-factor model was good among the adolescent (χ220 = 7,067.17; CFI = 0.959; SRMR = 0.028; RMSEA = 0.070 [90% CI, 0.068–0.071]) and adult samples (χ220 = 56.97; CFI = 0.966; SRMR = 0.031; RMSEA = 0.052 [90% CI, 0.036–0.068]), independently and in the configural model (Table 3). As shown in Table 3, equality constraints placed on the factor loadings (metric model) did not substantially worsen model fit: ΔCFI = 0.000 and ΔRMSEA = −0.006. Similar results were found when constraining item intercepts (scalar model: ΔCFI = −0.006; ΔRMSEA = 0.000) and residuals (strict model: ΔCFI = −0.001; ΔRMSEA = −0.003).
Table 3.
Parameter | χ2 (df) | CFI | SRMR | RMSEA (90% CI) | Δχ2 (df) | ΔCFI | ΔSRMR | ΔRMSEA |
---|---|---|---|---|---|---|---|---|
Configural | 7447.84 (40) | 0.959 | 0.028 | 0.071 (0.070, 0.073) | - | - | - | - |
Metric | 7463.04 (48) | 0.959 | 0.082 | 0.065 (0.064, 0.066) | 8.2 (8) | 0.000 | 0.054 | −0.006 |
Scalar | 8528.16 (55) | 0.953 | 0.101 | 0.065 (0.064, 0.066) | 687.6 (7) | −0.006 | 0.019 | 0.000 |
Strict | 8785.83 (63) | 0.952 | 0.094 | 0.062 (0.060, 0.063) | 165.4 (8) | −0.001 | −0.007 | −0.003 |
Note. df = degrees of freedom; CFI = comparative fit index; SRMR = square root mean residual; RMSEA = root mean standard error of approximation; CI = confidence interval.
3.3. Measurement Invariance by Gender, Grade, and Ethno-Racial Identity
Having established full measurement invariance between adolescents and adults, invariance across gender, grade, and ethno-racial identity was tested among the adolescent sample (Table 4). The configural models (no equality constraints) demonstrated excellent fit to the data for gender (χ240 = 4777.31; CFI = 0.994; SRMR = 0.026; RMSEA = 0.059 [90% CI, 0.057–0.061]), grade (χ240 = 1622.78; CFI = 0.979; SRMR = 0.024; RMSEA = 0.058 [90% CI, 0.056–0.061]), and ethno-racial identity (χ240 = 6270.29; CFI = 0.990; SRMR = 0.029; RMSEA = 0.065 [90% CI, 0.064–0.067]). Constraints imposed at the metric, scalar, and strict levels did not result in substantial worsening of model fit; full gender, grade, and ethno-racial identity invariance was demonstrated.
Table 4.
Parameter | χ2 (df) | CFI | SRMR | RMSEA (90% CI) | Δχ2 (df) | ΔCFI | ΔSRMR | ΔRMSEA |
---|---|---|---|---|---|---|---|---|
Gender 1 | ||||||||
Configural | 4777.31 (40) | 0.994 | 0.026 | 0.059 (0.057, 0.060) | - | - | - | - |
Metric | 5496.54 (48) | 0.993 | 0.083 | 0.057 (0.056, 0.059) | 323.2 (8) | −0.001 | 0.057 | −0.002 |
Scalar | 6277.60 (55) | 0.992 | 0.082 | 0.057 (0.056, 0.059) | 409.5 (7) | −0.001 | −0.001 | 0.000 |
Strict | 6396.81 (63) | 0.991 | 0.081 | 0.054 (0.052, 0.055) | 57.8 (8) | −0.001 | −0.001 | −0.003 |
Grade 2 | ||||||||
Configural | 1622.78 (40) | 0.979 | 0.024 | 0.058 (0.056, 0.061) | - | - | - | - |
Metric | 2058.53 (48) | 0.973 | 0.094 | 0.059 (0.057, 0.061) | 263.7 (8) | −0.006 | 0.070 | 0.001 |
Scalar | 2364.05 (55) | 0.969 | 0.094 | 0.059 (0.057, 0.061) | 266.8 (7) | −0.004 | 0.000 | 0.000 |
Strict | 2683.41 (63) | 0.965 | 0.098 | 0.057 (0.056, 0.059) | 159.4 (8) | −0.004 | 0.004 | −0.002 |
Ethno-Racial Identity 3 | ||||||||
Configural | 6270.29 (40) | 0.990 | 0.029 | 0.065 (0.064, 0.067) | - | - | - | - |
Metric | 7413.03 (48) | 0.988 | 0.108 | 0.065 (0.064, 0.066) | 474.8 (8) | −0.002 | 0.079 | 0.000 |
Scalar | 7604.73 (55) | 0.987 | 0.108 | 0.061 (0.060, 0.063) | 104.0 (7) | −0.001 | 0.000 | −0.004 |
Strict | 7958.49 (63) | 0.987 | 0.114 | 0.059 (0.058, 0.060) | 145.6 (8) | 0.000 | 0.006 | −0.002 |
Note. df = degrees of freedom; CFI = comparative fit index; SRMR = square root mean residual; RMSEA = root mean standard error of approximation; CI = confidence interval. 1 Boys vs. girls. 2 Grade 12 vs. 9. 3 Racialized vs. non-racialized.
3.4. Flourishing Scale Scores Among COMPASS Y7 Students
Results from a mixed linear regression model predicting a one-point increase in the FS, on average, are presented in Table 5 (Model I). Lower average FS scores were present among girls (β = −0.88, p < 0.0001) compared to boys, as well as students who reported a racialized identity (β = −0.83, p < 0.0001) compared to those who did not. Compared to students in grade 9, average FS scores were lower in grades 10 (β = −0.35, p < 0.0001), 11 (β = −0.54, p < 0.0001), and 12 (β = −0.63, p < 0.0001) but higher for those in the “other” grade category (β = 0.92, p < 0.0001). All estimates are adjusted for province and weekly spending money.
Table 5.
Model I | ||
---|---|---|
Measure | β | (95% CL) |
Gender | ||
Boys (ref.) | 0.00 | |
Girls | −0.88 *** | −0.88, −0.88 |
Grade | ||
9 (ref.) | 0.00 | |
10 | −0.35 *** | −0.35, −0.35 |
11 | −0.54 *** | −0.54, −0.54 |
12 | −0.63 *** | −0.63, −0.62 |
Other 1 | 0.92 *** | 0.91, 0.93 |
Ethno-Racial identity | ||
Non-racialized (ref.) | 0.00 | |
Racialized | −0.83 *** | −0.83, −0.82 |
Model I: Predicts a one-point increase, on average, in Flourishing Scale score. Note. ref. = reference category; CL = confidence limit. All estimates are adjusted for province and weekly spending money. 1 Includes Secondaire I and II in Québec. *** p < 0.001.
4. Discussion
Using recent data collected from a large sample of secondary school students enrolled in the COMPASS Study, our findings support the validity of the FS among the Canadian adolescent population. We demonstrated full measurement invariance between our sample and the adult sample among whom the FS was originally validated [19], thereby confirming that the FS in fact measures the same construct (i.e., psychological wellbeing) among adolescents. Additionally, we identified strict invariance in FS measurement across gender, grade, and ethno-racial identity. This finding confirms that statistical differences observed between student subgroups within the COMPASS Study represent true differences, rather than artifactual differences in interpretation of the FS. Given the importance of psychological wellbeing to adolescent health and strong psychometric properties demonstrated by the FS, future youth-focused surveillance research should strongly consider incorporating the FS as a measure of youth wellbeing.
While the FS has been previously validated across a number of populations and languages, our present work continues to fill important gaps within the existing literature. Our study is the first to test measurement invariance with the sample of participants used in the original development and validation of the FS. To our knowledge, the COMPASS Study also represents the largest sample in which FS validation has been investigated, followed by a study from colleagues in New Zealand who relied on a nationally representative sample of 10,009 adults [45]. With two exceptions, the majority of existing FS validation studies have focused solely on adult populations and/or university students; Singh, Junnarker, and Jaswal found good fit of a single-factor structure for the FS items among adolescents in India [64], as did Duan and Xie among 12–17-year-old adolescents in China [32]. Findings from these studies may not generalize to Canadian adolescents.
Upon establishing measurement invariance across gender, grade, and ethno-racial identity among students in the COMPASS Study, further extending the validity of the FS, we examined differences in FS scores across these subgroups. First, we identified lower levels of psychological wellbeing among girls than boys. This finding is consistent with existing research indicating relatively poor wellbeing among adolescent girls compared to boys [65,66,67] yet is inconsistent with findings from a smaller Canadian study in which female undergraduate students scored higher on the FS than males once validity was established [26]. Other findings have shown no differences by sex among youth [32]. While previous studies of the FS have demonstrated measurement invariance by sex and gender [27,32,37], few have gone on to test for the presence of differences that describe gendered experiences of wellbeing. Our current findings may reflect the ways in which girls are disproportionately impacted by socio-cultural norms and pressures during adolescence, experiences of which may influence their wellbeing [68].
We also found a pattern of decreasing psychological wellbeing with increasing secondary school grade. Consistent with other school-based and youth health literature, positive indicators of wellbeing generally appear to decrease with adolescent age toward young adulthood [65,66]–perhaps as a function of factors including perceived academic and social stress and pubertal and psychosocial development. As grade and age are highly correlated among students in the COMPASS Study, we chose to adopt grade in our analyses as a proxy for age to improve the interpretability of our findings for school-based knowledge users. Given measurement invariance of the FS by grade was established within our sample ranging in age from 12 to 19 years, we highlight an ability to detect age-related differences in psychological wellbeing among adolescents using the FS.
After confirming measurement invariance by ethno-racial identity among COMPASS Y7 students, we found that racialized students reported lower average psychological wellbeing compared to non-racialized students. An existing body of knowledge recognizes racial and ethnic discrimination as linked to various health outcomes and disparities [69,70] as well as self-perceived and psychological wellbeing [71,72,73]. Here, we provide evidence of measurement invariance of the FS by ethno-racial identity. It is important to note that due to sample size restrictions, we were unable to assess wellbeing across racial or ethnic identity groups as self-reported by students. However, our findings continue to highlight the ways in which individuals’ experiences of wellbeing may be differentially impacted by socio-political and systemic processes of racism, discrimination, and stigmatization—even among adolescents in Canada.
4.1. Strengths and Limitations
These findings are primarily strengthened by the nature of our data. The COMPASS Study represents the largest school-based sample of adolescents in Canada—data from whom are collected across several provinces (Alberta, British Columbia, Ontario, Québec) through a hierarchical design. Despite our inability to test convergent validity of the FS with other measures of wellbeing, we were uniquely able to use existing data originally collected by Diener and colleagues [19] to validate the FS; thus allowing us to establish measurement invariance of the FS across adolescents and adults. Analytically, our findings are further strengthened by (1) our use of full-information maximum likelihood to handle missing data, rather than relying on complete-case analysis and (2) our multi-level modelling approach to control for variability due to school-level clustering.
We note some limitations. First, these self-reported data are not nationally representative, and the generalizability of our findings to all adolescents in Canada is thus limited. However, the COMPASS Study relies on purposive sampling procedures that contribute to our large sample size, and use of active-information, passive-consent data collection protocols helps mitigate bias introduced by students’ self-reporting [48,74,75,76,77,78]. Second, while we assessed differences in wellbeing by gender and ethno-racial identity, we were not able to account for non-binary gender identities and heterogeneity among racialized groups. Moreover, we did not investigate interactions across sub-groups of gender, grade, and ethnicity/race; intersectional analyses are necessary to further understand differential experiences of wellbeing. Third, our findings are only relevant to secondary school-aged adolescents in Canada and not to younger students. Future studies are needed to investigate the applicability of the FS for measuring wellbeing among primary and elementary school-aged children.
4.2. Implications
These findings have practical implications for health researchers and practitioners interested in using the FS to measure wellbeing among adolescents. We have shown here that the FS can be used as a valid tool for assessing and monitoring the psychological wellbeing of Canadian adolescents, as it not only measures the construct as originally intended but does so consistently despite differences in students’ gender, grade, and ethno-racial identity. Data collected using the FS can inform targeted interventions meant to promote the overall psychological wellbeing of adolescents within secondary school settings. Notably, our findings are situated within the secondary school context, thus highlighting the potential utility of findings in demonstrating the FS as an indicator of successful school-based interventions and programs. Through robust data systems such as the COMPASS Study, the impact of these interventions and policies (i.e., at the school-, provincial-level, etc.) can be evaluated in real time as natural experiments [16,79].
5. Conclusions
In summary, our findings demonstrate full measurement invariance of the FS between study samples, and across the adolescents’ gender, grade, and ethno-racial identity. These findings further support the validity of the FS for measurement of psychological wellbeing among Canadian adolescents in the secondary school context. Further, this study provides evidence that efforts to improve psychological wellbeing should especially consider the needs of adolescent girls, those in older secondary school grades, and racialized students. Using existing data systems, such as the COMPASS Study, Canadian programs and interventions that target students’ wellbeing can be evaluated as robust yet feasible natural experimental studies.
Appendix A
Table A1.
Item Mean (SD) | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
Gender | Grade | Ethno-Racial Identity | ||||||||
Flourishing Scale 1 Item | Boys | Girls | 9 | 10 | 11 | 12 | Other 2 | Non-Racialized | Racialized | |
1 | I lead a purposeful… | 4.05 (1.00) | 3.86 (1.02) | 3.95 (1.01) | 3.88 (1.02) | 3.87 (1.02) | 3.78 (1.03) | 4.27 (0.96) | 4.03 (1.00) | 3.79 (1.06) |
2 | My social relationships are… | 4.06 (0.89) | 3.96 (0.89) | 3.99 (0.88) | 3.96 (0.88) | 3.96 (0.88) | 3.91 (0.90) | 4.23 (0.86) | 4.07 (0.87) | 3.88 (0.93) |
3 | I am engaged and interested… | 4.02 (0.92) | 3.84 (0.98) | 3.95 (0.95) | 3.88 (0.95) | 3.83 (0.96) | 3.74 (0.99) | 4.20 (0.89) | 3.99 (0.93) | 3.79 (1.00) |
4 | I actively contribute… | 4.05 (0.84) | 4.13 (0.80) | 4.09 (0.82) | 4.05 (0.82) | 4.05 (0.83) | 4.01 (0.85) | 4.22 (0.82) | 4.13 (0.80) | 3.99 (0.89) |
5 | I am competent… | 4.29 (0.79) | 4.20 (0.82) | 4.24 (0.80) | 4.21 (0.80) | 4.21 (0.80) | 4.14 (0.84) | 4.40 (0.78) | 4.30 (0.77) | 4.12 (0.89) |
6 | I am a good person… | 4.15 (0.90) | 4.03 (0.94) | 4.08 (0.93) | 4.04 (0.92) | 4.05 (0.91) | 3.99 (0.93) | 4.28 (0.92) | 4.15 (0.89) | 3.95 (0.98) |
7 | I am optimistic… | 4.03 (0.99) | 3.90 (1.03) | 3.96 (1.01) | 3.92 (1.01) | 3.89 (1.04) | 3.84 (1.05) | 4.18 (0.94) | 4.02 (0.99) | 3.83 (1.07) |
8 | People respect me | 3.95 (0.92) | 3.85 (0.92) | 3.86 (0.93) | 3.87 (0.92) | 3.89 (0.90) | 3.86 (0.91) | 4.02 (0.93) | 3.93 (0.91) | 3.81 (0.95) |
1 Higher scores indicate greater psychological wellbeing. 2 Includes Secondaire I and II in Québec.
Appendix B
Table A2.
Model I | ||
---|---|---|
Measure | aOR | (95% CL) |
Gender | ||
Boys (ref.) | 1.00 | |
Girls | 0.70 *** | 0.65, 0.75 |
Grade | ||
9 (ref.) | 1.00 | |
10 | 0.77 *** | 0.71, 0.84 |
11 | 0.67 *** | 0.60, 0.75 |
12 | 0.62 *** | 0.53, 0.72 |
Other1 | 1.85 *** | 1.65, 2.09 |
Ethno-racial identity | ||
Non-racialized (ref.) | 1.00 | |
Racialized | 1.51 *** | 1.34, 1.69 |
Weekly spending money | ||
CAN 0 or ‘don’t know’ (ref.) | 1.00 | |
CAD 1–20 | 0.87 ** | 0.81, 0.97 |
CAD 21–100 | 0.88 * | 0.80, 0.97 |
CAD 100+ | 0.91 | 0.81, 1.01 |
Province | ||
Alberta (ref.) | 1.00 | |
British Columbia | 1.36 | 0.97, 1.91 |
Ontario | 1.28 | 0.98, 1.68 |
Québec | 0.72 * | 0.54, 0.95 |
Model I: Predicts the log-odds of missing data in Flourishing Scale score (ref. = not missing). Note. ref. = reference category; aOR = adjusted odds ratio; CI = confidence interval. All estimates are adjusted for province and weekly spending money. 1 Includes Secondaire I and II in Québec. * p < 0.05, ** p < 0.01, *** p < 0.001.
Author Contributions
Conceptualization, M.A.F., K.A.P., and S.T.L.; formal analysis, M.A.F. and I.R.; writing—original draft preparation, I.R.; writing—review and editing, M.A.F., K.A.P., S.T.L., and E.D.; funding acquisition, S.T.L. and K.A.P.; supervision, S.T.L. All authors have read and agreed to the published version of the manuscript.
Funding
The COMPASS study has been supported by a bridge grant from the CIHR Institute of Nutrition, Metabolism and Diabetes (INMD) through the “Obesity–Interventions to Prevent or Treat” priority funding awards (OOP-110788; awarded to SL), an operating grant from the CIHR Institute of Population and Public Health (IPPH) (MOP-114875; awarded to SL), a CIHR project grant (PJT-148562; awarded to SL), a CIHR bridge grant (PJT-149092; awarded to K.P./S.L.), a CIHR project grant (PJT-159693; awarded to K.P.), and by a research funding arrangement with Health Canada (#1617-HQ-000012; contract awarded to S.L.). The COMPASS-Quebec project additionally benefits from funding from the Ministère de la Santé et des Services sociaux of the province of Québec, and the Direction régionale de santé publique du CIUSSS de la Capitale-Nationale.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Keyes C.L. The mental health continuum: From languishing to flourishing in life. J. Health Soc. Behav. 2002:207–222. doi: 10.2307/3090197. [DOI] [PubMed] [Google Scholar]
- 2.Howell A.J., Keyes C.L., Passmore H.A. Research, Applications, and Interventions for Children and Adolescents. Springer; Dordrecht, The Netherlands: 2013. Flourishing among Children and Adolescents: Structure and Correlates of Positive Mental Health, and Interventions for Its Enhancement; pp. 59–79. [Google Scholar]
- 3.Larson R.W. Toward a psychology of positive youth development. Am. Psychol. 2000;55:170. doi: 10.1037/0003-066X.55.1.170. [DOI] [PubMed] [Google Scholar]
- 4.Geldhof G.J., Bowers E.P., Lerner R.M. Special section introduction: Thriving in context: Findings from the 4-H study of positive youth development. J. Youth Adolesc. 2013;42:1–5. doi: 10.1007/s10964-012-9855-7. [DOI] [PubMed] [Google Scholar]
- 5.Viejo C., Gómez-López M., Ortega-Ruiz R. Adolescents’ psychological well-being: A multidimensional measure. Int. J. Environ. Res. Public Health. 2018;15:2325. doi: 10.3390/ijerph15102325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Ryff C.D. Eudaimonic well-being, inequality, and health: Recent findings and future directions. Int. Rev. Econ. 2017;64:159–178. doi: 10.1007/s12232-017-0277-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Patalay P., Fitzsimons E. Correlates of mental illness and wellbeing in children: Are they the same? Results from the UK Millennium Cohort Study. J. Am. Acad. Child Adolesc. Psychiatry. 2016;55:771–783. doi: 10.1016/j.jaac.2016.05.019. [DOI] [PubMed] [Google Scholar]
- 8.Suldo S., Thalji A., Ferron J. Longitudinal academic outcomes predicted by early adolescents’ subjective well-being, psychopathology, and mental health status yielded from a dual factor model. J. Posit. Psychol. 2011;6:17–30. doi: 10.1080/17439760.2010.536774. [DOI] [Google Scholar]
- 9.Hinduja S., Patchin J.W. Cultivating youth resilience to prevent bullying and cyberbullying victimization. Child Abus. Negl. 2017;73:51–62. doi: 10.1016/j.chiabu.2017.09.010. [DOI] [PubMed] [Google Scholar]
- 10.Holligan S.D., Qian W., de Groh M., Jiang Y., Patte K.A., Battista K., Leatherdale S.T. Binge Drinking and Educational Participation among Youth in the COMPASS Host Study (Year 5: 2016/2017): School Connectedness and Flourishing as Compensatory Factors. Canadian Journal of Family and Youth/Le. J. Can. Fam. Jeun. 2020;12:55–77. [Google Scholar]
- 11.Butler A., Patte K.A., Ferro M.A., Leatherdale S.T. Interrelationships among depression, anxiety, flourishing, and cannabis use in youth. Addict. Behav. 2019;89:206–215. doi: 10.1016/j.addbeh.2018.10.007. [DOI] [PubMed] [Google Scholar]
- 12.Romano I., Williams G., Butler A., Aleyan S., Patte K.A., Leatherdale S.T. Psychological and Behavioural Correlates of Cannabis use among Canadian Secondary School Students: Findings from the COMPASS Study. Can. J. Addict. 2019;10:10–21. doi: 10.1097/CXA.0000000000000058. [DOI] [Google Scholar]
- 13.Duell N., Steinberg L. Positive risk taking in adolescence. Child Dev. Perspect. 2019;13:48–52. doi: 10.1111/cdep.12310. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Romer D., Reyna V.F., Satterthwaite T.D. Beyond stereotypes of adolescent risk taking: Placing the adolescent brain in developmental context. Dev. Cogn. Neurosci. 2017;27:19–34. doi: 10.1016/j.dcn.2017.07.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Romano I., Butler A., Patte K.A., Ferro M.A., Leatherdale S.T. High School Bullying and Mental Disorder: An Examination of the Association with Flourishing and Emotional Regulation. Int. J. Bullying Prev. 2019:1–12. doi: 10.1007/s42380-019-00035-5. [DOI] [Google Scholar]
- 16.Leatherdale S.T., Brown K.S., Carson V., Childs R.A., Dubin J.A., Elliott S.J., Faulkner G., Hammond D., Manske S., Sabiston C.M., et al. The COMPASS Study: A longitudinal hierarchical research platform for evaluating natural experiments related to changes in school-level programs, policies and built environment resources. BMC Public Health. 2014;14:331. doi: 10.1186/1471-2458-14-331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Orpana H., Vachon J., Dykxhoorn J., McRae L., Jayaraman G. Monitoring positive mental health and its determinants in Canada: The development of the Positive Mental Health Surveillance Indicator Framework. Health Promot. Chronic Dis. Prev. Can. Res. Policy Pract. 2016;36:1. doi: 10.24095/hpcdp.36.1.01. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Diener E. Assessing Well-Being: The Collected Works of Ed Diener. Volume 331 Springer; New York, NY, USA: 2009. [Google Scholar]
- 19.Diener E., Wirtz D., Tov W., Kim-Prieto C., Choi D., Oishi S., Biswas-Diener R. New measures of well-being: Flourishing and positive and negative feelings. Soc. Indic. Res. 2010;39:247–266. [Google Scholar]
- 20.Ryan R.M., Deci E.L. On happiness and human potentials: A review of research on hedonic and eudaimonic well-being. Annu. Rev. Psychol. 2001;52:141–166. doi: 10.1146/annurev.psych.52.1.141. [DOI] [PubMed] [Google Scholar]
- 21.Seligman M.E. Flourish: A Visionary New Understanding of Happiness and Well-Being. Simon & Schuster; New York, NY, USA: 2012. [Google Scholar]
- 22.Henderson L.W., Knight T. Integrating the hedonic and eudaimonic perspectives to more comprehensively understand wellbeing and pathways to wellbeing. Int. J. Wellbeing. 2012;2:196–221. doi: 10.5502/ijw.v2i3.3. [DOI] [Google Scholar]
- 23.Kashdan T.B., Biswas-Diener R., King L.A. Reconsidering happiness: The costs of distinguishing between hedonics and eudaimonia. J. Posit. Psychol. 2008;3:219–233. doi: 10.1080/17439760802303044. [DOI] [Google Scholar]
- 24.Huppert F.A., So T.T. Flourishing across Europe: Application of a new conceptual framework for defining well-being. Soc. Indic. Res. 2013;110:837–861. doi: 10.1007/s11205-011-9966-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Sumi K. Reliability and validity of Japanese versions of the Flourishing Scale and the Scale of Positive and Negative Experience. Soc. Indic. Res. 2014;118:601–615. doi: 10.1007/s11205-013-0432-6. [DOI] [Google Scholar]
- 26.Howell A.J., Buro K. Measures and predictors of student well-being: Further evidence in support of the Flourishing Scale and the Scale of Positive and Negative Experiences. Soc. Indic. Res. 2015;121:903–915. doi: 10.1007/s11205-014-0663-1. [DOI] [Google Scholar]
- 27.de la Fuente R., Parra A., Sánchez-Queija I. Psychometric properties of the flourishing scale and measurement invariance between two samples of Spanish University students. Eval. Health Prof. 2017;40:409–424. doi: 10.1177/0163278717703446. [DOI] [PubMed] [Google Scholar]
- 28.Giuntoli L., Ceccarini F., Sica C., Caudek C. Validation of the Italian versions of the flourishing scale and of the scale of positive and negative experience. Sage Open. 2017;7:2158244016682293. doi: 10.1177/2158244016682293. [DOI] [Google Scholar]
- 29.Didino D., Taran E.A., Barysheva G.A., Casati F. Psychometric evaluation of the Russian version of the flourishing scale in a sample of older adults living in Siberia. Health Qual. Life Outcomes. 2019;17:34. doi: 10.1186/s12955-019-1100-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Salama-Younes M. Psychometric properties of the Psychological Flourishing Scale in an Egyptian setting. J. Psychol. Afr. 2017;27:310–315. doi: 10.1080/14330237.2017.1347749. [DOI] [Google Scholar]
- 31.Tang X., Duan W., Wang Z., Liu T. Psychometric evaluation of the simplified Chinese version of flourishing scale. Res. Soc. Work Pract. 2016;26:591–599. doi: 10.1177/1049731514557832. [DOI] [Google Scholar]
- 32.Duan W., Xie D. Measuring adolescent flourishing: Psychometric properties of flourishing scale in a sample of Chinese adolescents. J. Psychoeduc. Assess. 2019;37:131–135. doi: 10.1177/0734282916655504. [DOI] [Google Scholar]
- 33.Tong K.K., Wang Y.Y. Validation of the flourishing scale and scale of positive and negative experience in a Chinese community sample. PLoS ONE. 2017;12:e0181616. doi: 10.1371/journal.pone.0181616. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Rump S. Master’s Thesis. University of Twente; Enschede, Netherlands: 2015. The Flourishing Scale in Comparison with Other Well-Being Scales: The Examination and Validation of a New Measure. [Google Scholar]
- 35.Schotanus-Dijkstra M., Peter M., Drossaert C.H., Pieterse M.E., Bolier L., Walburg J.A., Bohlmeijer E.T. Validation of the Flourishing Scale in a sample of people with suboptimal levels of mental well-being. BMC Psychol. 2016;4:12. doi: 10.1186/s40359-016-0116-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Villieux A., Sovet L., Jung S.C., Guilbert L. Psychological flourishing: Validation of the French version of the Flourishing Scale and exploration of its relationships with personality traits. Personal. Individ. Differ. 2016;88:1–5. doi: 10.1016/j.paid.2015.08.027. [DOI] [Google Scholar]
- 37.Kyriazos T.A., Stalikas A., Prassa K., Yotsidi V., Galanakis M., Pezirkianidis C. Validation of the Flourishing Scale (FS), Greek Version and Evaluation of Two Well-Being Models. Psychology. 2018;9:1789. doi: 10.4236/psych.2018.97105. [DOI] [Google Scholar]
- 38.Khodarahimi S. Hope and flourishing in an Iranian adults sample: Their contributions to the positive and negative emotions. Appl. Res. Qual. Life. 2013;8:361–372. doi: 10.1007/s11482-012-9192-8. [DOI] [Google Scholar]
- 39.Silva A.J., Caetano A. Validation of the flourishing scale and scale of positive and negative experience in Portugal. Soc. Indic. Res. 2013;110:469–478. doi: 10.1007/s11205-011-9938-y. [DOI] [Google Scholar]
- 40.da Fonseca P.N., da Silva Nascimento B., Macêdo Barbosa L.H.G., Vione K.C., Veloso Gouveia V. Flourishing Scale: Evidence of its suitability to the Brazilian context. Soc. Inquiry Well-Being. 2015;1:33–40. [Google Scholar]
- 41.Pozo-Muñoz C., Garzón-Umerenkova A., Bretones-Nieto B., Ligia-Charry C. Psychometric properties and dimensionality of the” Flourishing Scale” in Spanish-speaking population. Electron. J. Res. In Educ. Psychol. 2016;14:175–192. [Google Scholar]
- 42.Ramirez-Maestre C., Correa M., Rivas T., Lopez-Martinez A.E., Serrano-Ibáñez E.R., Esteve R. Psychometric characteristics of the Flourishing Scale-Spanish Version (FS-SV). The factorial structure in two samples: Students and patients with chronic pain. Personal. Individ. Differ. 2017;117:30–36. doi: 10.1016/j.paid.2017.05.035. [DOI] [Google Scholar]
- 43.Checa I., Perales J., Espejo B. Spanish validation of the Flourishing Scale in the general population. Curr. Psychol. 2018;37:949–956. doi: 10.1007/s12144-017-9581-0. [DOI] [Google Scholar]
- 44.Choudhry F.R., Al-Worafi Y.M., Akram B., Ahmed M.A., Anwar ul Haq M., Khan T.M., Rehman I.U., Barki N., Munawar K., Kamal A., et al. Factor structure of urdu version of the flourishing scale. Front. Psychol. 2018;9:1513. doi: 10.3389/fpsyg.2018.01513. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Hone L., Jarden A., Schoefield G. Psychometric properties of the Flourishing Scale in a New Zealand sample. Soc. Indic. Res. 2014;119:1031–1045. doi: 10.1007/s11205-013-0501-x. [DOI] [Google Scholar]
- 46.Brown T.A. Confirmatory Factor Analysis for Applied Research. The Guilford Press; New York, NY, USA: 2015. [Google Scholar]
- 47.van de Schoot R., Lugtig P., Hox J. Developmetrics. A checklist for testing measurement invariance. Eur. J. Dev. Psychol. 2012;9:486–492. doi: 10.1080/17405629.2012.686740. [DOI] [Google Scholar]
- 48.Thompson-Haile A., Bredin C., Leatherdale S.T. Rationale for using an Active-Information Passive-Consent Permission Protocol in COMPASS. Volume 1. University of Waterloo; Waterloo, ON, Canada: 2013. [(accessed on 8 October 2020)]. (COMPASS Technical Report Series). Available online: www.compass.uwaterloo.ca. [Google Scholar]
- 49.Patte K.A., Bredin C., Henderson J., Elton-Marshall T., Faulkner G., Sabiston C., Battista K., Leatherdale S.T. Development of a Mental Health Module for the COMPASS System: Improving Youth Mental Health Trajectories. Part 1: Draft Development and Design. Volume 4. University of Waterloo; Waterloo, ON, Canada: 2017. p. 2. [Google Scholar]
- 50.Patte K.A., Bredin C., Henderson J., Elton-Marshall T., Faulkner G., Sabiston C., Battista K., Ferro M., Cole A., Doggett A., et al. Development of a Mental Health Module for the COMPASS System: Improving Youth Mental Health Trajectories. Part 2: Pilot Test and Focus Group Results. Volume 4. University of Waterloo; Waterloo, ON, Canada: 2017. p. 3. [Google Scholar]
- 51.Byrne B.M. Structural Equation Modeling with Mplus: Basic Concepts, Applications, and Programming. Taylor & Francis Group, LLC; New York, NY, USA: 2012. [Google Scholar]
- 52.Bollen K.A. Structural Equations with Latent Variables. John Wiley & Sons, Inc.; New York, NY, USA: 1989. [Google Scholar]
- 53.Steinmetz H., Schmidt P., Tina-Booh A., Wieczorek S., Schwartz S.H. Testing measurement invariance using multiple group CFA: Differences between educational groups in human values measurement. Qual. Q. 2009;43:599–616. doi: 10.1007/s11135-007-9143-x. [DOI] [Google Scholar]
- 54.Tompke B.K., Ferro M.A. Measurement invariance and informant discrepancies of the KIDSCREEN-27 in children with mental disorder. Appl. Res. Qual. Life. 2019 doi: 10.1007/s11482-019-09801-5. [DOI] [Google Scholar]
- 55.Tompke B.K., Tang J., Oltean I.I., Buchan M.C., Reaume S.V., Ferro M.A. Measurement Invariance of the WHODAS 2.0 Across youth with and without physical or mental conditions. Assessment. 2018 doi: 10.1177/1073191118816435. [DOI] [PubMed] [Google Scholar]
- 56.Ferro M.A., Boyle M.H. Longitudinal invariance of measurement and structure of global self-concept: A population-based study examining trajectories among adolescents with and without chronic illness. J. Pediatr. Psychol. 2013;38:425–437. doi: 10.1093/jpepsy/jss112. [DOI] [PubMed] [Google Scholar]
- 57.Chen F.F. Sensitivity of goodness of fit indices to lack of measurement invariance. Struct. Equ. Modeling Multidiscip. J. 2007;14:464–504. doi: 10.1080/10705510701301834. [DOI] [Google Scholar]
- 58.Byrne B.M., Shavelson R.J., Muthén B. Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychol. Bull. 1989;105:456–466. doi: 10.1037/0033-2909.105.3.456. [DOI] [Google Scholar]
- 59.Lei P.W., Shiverdecker L.K. Performance of Estimators for Confirmatory Factor Analysis of Ordinal Variables with Missing Data. Struct. Equ. Model. Multidiscip. J. 2019;27:584–601. doi: 10.1080/10705511.2019.1680292. [DOI] [Google Scholar]
- 60.Li C.H. Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behav. Res. Methods. 2016;48:936–949. doi: 10.3758/s13428-015-0619-7. [DOI] [PubMed] [Google Scholar]
- 61.Muthén L.K., Muthén B.O. Mplus User’s Guide. 8th ed. Muthén & Muthén; Los Angeles, CA, USA: 1998–2017. [Google Scholar]
- 62.SAS Institute Inc. SAS 9.4 [Computer Program] SAS Institute Inc.; Cary, NC, USA: 2016. [Google Scholar]
- 63.Enders C.K., Bandalos D.L. The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Struct. Equ. Modeling. 2001;8:430–457. doi: 10.1207/S15328007SEM0803_5. [DOI] [Google Scholar]
- 64.Singh K., Junnarkar M., Jaswal S. Validating the flourishing scale and the scale of positive and negative experience in India. Ment. Health Relig. Cult. 2016;19:943–954. doi: 10.1080/13674676.2016.1229289. [DOI] [Google Scholar]
- 65.Patalay P., Fitzsimons E. Development and predictors of mental ill-health and wellbeing from childhood to adolescence. Soc. Psychiatry Psychiatr. Epidemiol. 2018;53:1311–1323. doi: 10.1007/s00127-018-1604-0. [DOI] [PubMed] [Google Scholar]
- 66.Booker C.L., Kelly Y.J., Sacker A. Gender differences in the associations between age trends of social media interaction and well-being among 10-15 year olds in the UK. BMC Public Health. 2018;18:1–12. doi: 10.1186/s12889-018-5220-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Inchley J., Currie D., Young T., Samdal O., Torsheim T., Augustson L., Mathison F., Aleman-Diaz A., Molcho M., Weber M.W., et al., editors. “Growing Up Unequal Gender and Socioeconomic Differences in Young People’s Health and Well-Being: Health Behaviour in School-Aged Children Study” in International Report from the 2013/2014 Survey. World Health Organization; Geneva, Switzerland: 2016. [Google Scholar]
- 68.Žukauskienė R. Adolescence and well-being. In: Ben-Arieh A., Casas F., Frønes I., editors. Handbook of Child Well-Being: Theories, Methods and Policies in Global Perspective. Springer; Dordrecht, The Netherlands: 2014. pp. 1713–1738. [Google Scholar]
- 69.Walker R.J., Williams J.S., Egede L.E. Influence of race, ethnicity and social determinants of health on diabetes outcomes. Am. J. Med Sci. 2016;351:366–373. doi: 10.1016/j.amjms.2016.01.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Rivera L.M. Ethnic-racial stigma and health disparities: From psychological theory and evidence to public policy solutions. J. Soc. Issues. 2014;70:198–205. doi: 10.1111/josi.12055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Yoo H.C., Kim A.Y., Lee R.M. Race and subjective well-being: Critical race perspective and empirical review of key predictors. In: Diener E., Oishi S., Tay L., editors. Handbook of Well-Being. DEF Publishers; Salt Lake City, UT, USA: 2018. [Google Scholar]
- 72.Keyes C.L. The Black–White paradox in health: Flourishing in the face of social inequality and discrimination. J. Personal. 2009;77:1677–1706. doi: 10.1111/j.1467-6494.2009.00597.x. [DOI] [PubMed] [Google Scholar]
- 73.Benner A.D., Wang Y., Shen Y., Boyle A.E., Polk R., Cheng Y.P. Racial/ethnic discrimination and well-being during adolescence: A meta-analytic review. Am. Psychol. 2018;73:855. doi: 10.1037/amp0000204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.White V.M., Hill D.J., Effendi Y. How does active parental consent influence the findings of drug-use surveys in schools? Eval. Rev. 2004;28:246–260. doi: 10.1177/0193841X03259549. [DOI] [PubMed] [Google Scholar]
- 75.Hollmann C.M., McNamara J.R. Considerations in the use of active and passive parental consent procedures. J. Psychol. 1999;133:141–156. doi: 10.1080/00223989909599729. [DOI] [Google Scholar]
- 76.Shaw T., Cross D., Thomas L.T., Zubrick S.R. Bias in student survey findings from active parental consent procedures. Br. Educ. Res. J. 2015;41:229–243. doi: 10.1002/berj.3137. [DOI] [Google Scholar]
- 77.Gallagher M., Haywood S.L., Jones M.W., Milne S. Negotiating informed consent with children in school-based research: A critical review. Child. Soc. 2010;24:471–482. doi: 10.1111/j.1099-0860.2009.00240.x. [DOI] [Google Scholar]
- 78.Chartier M., Stoep A.V., McCauley E., Herting J.R., Tracy M., Lymp J. Passive versus active parental consent. Implications for the ability of school-based depression screen to reach youth at risk. J. Sch. Health. 2008;78:157–186. doi: 10.1111/j.1746-1561.2007.00278.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Leatherdale S.T. Natural experiment methodology for research: A review of how different methods can support real-world research. Int. J. Soc. Res. Methodol. 2019;22:19–35. doi: 10.1080/13645579.2018.1488449. [DOI] [Google Scholar]