Abstract
Background
Relative to their application with adults there is currently little information about the application of preference-based health-related quality of life (HRQL) instruments among populations of young people. The Child Health Utility 9D (CHU9D) is a paediatric-specific generic preference-based HRQL instrument, recently translated and linguistically validated into Danish (CHU9D-DK). The purpose of this study was to investigate the construct validity of the CHU9D-DK in a sample of Danish high school students.
Methods
All students attending a Danish High School were invited to participate in a web-based survey in January 2018 (N = 272). The survey included the CHU9D-DK, the young adult version of the Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales (PedsQL), self-reported health status, presence/absence of disability/chronic diseases, life satisfaction, and socio-economic questions. CHU9D-DK utility scores were generated by employing the two scoring algorithms developed from adults in the UK and adolescents in Australia, respectively. Internal consistency, reliability and construct validity of the CHU9D-DK instrument were investigated.
Results
Two hundred and twenty-eight (84%) students consented to participate and completed the survey. The mean ± (standard deviation) values of the CHU9D-DK utilities were 0.84 (0.11) when the UK adult algorithm was applied and 0.70 (0.22), when the Australian adolescent algorithm was applied. The mean PedsQL score was 82.32 (13.14). The CHU9D-DK showed good internal consistency reliability (Cronbach’s alpha = 0.803). Higher levels of health status and life satisfaction were significantly associated with higher CHU9D-DK utility scores regardless of which scoring algorithm was applied (p-values < 0.001). Students living with a disability/chronic disease exhibited significantly lower utility scores relative to their healthy peers (p-values < 0.05). Higher socio-economic status (approximated by financial situation and frequency of family vacations) was also associated with higher utility scores (p-values < 0.005).
Conclusion
The CHU9D-DK demonstrated good psychometric performance overall and shows potential as a valid and reliable instrument for assessing the HRQL of Danish young people.
Trial registration
ClinicalTrials.gov identifier: NCT03391999, Registered 15 October 2017.
Keywords: Young adults, Adolescents, Health related quality of life, Outcome assessment, Patient-reported outcomes, CHU9D, PedsQL, High school, Construct validity
Background
The adolescent phase is a transitional stage of physical and psychological development that occurs during the period from puberty to legal adulthood (age of majority), which in Denmark is 18 years. Whilst adolescence is usually associated with the teenage years, its physical, psychological or cultural expressions may begin earlier and end later. For example, puberty now typically begins during preadolescence, particularly in females. Physical growth (particularly in males), and cognitive development can extend into the early twenties. Thus biological age provides only a rough marker of adolescence and young adulthood and scholars have found it difficult to agree upon a precise definition of adolescence [1].
Adolescence and young adulthood is also a period of multiple transitions involving education, training, and first employment, as well as changes from one living circumstance to another [2, 3]. This phase of life is critical for the individual’s future lifestyle and behaviour and may play an important role in the development and persistence of lifestyle diseases [4, 5]. In general, in contrast to adult populations, there is sparse information available about younger age groups’ health-related quality of life (HRQL) in Denmark, in particular in relation to individuals’ subjective assessment of their own HRQL through the use of validated instruments.
HRQL instruments can be divided into non-preference-based and preference-based instruments [6]. The unique feature of preference-based instruments is their scoring algorithms, which are typically generated from large general population samples and are based on the relative weights or utilities attached to HRQL states defined by the instrument on a cardinal scale, where 0.0 represent dead and 1.0 represents full health [6, 7]. Preference-based HRQL instruments can be applied to generate quality-adjusted life-years (QALYs). QALYs combines length of life and quality of life into a single composite measure of outcome, which is preferable for health economic evaluation [8].
The Child Health Utility 9D (CHU9D) is a relatively new preference-based instrument for the measurement and valuation of HRQL in children and adolescents developed in the United Kingdom (UK) in 2009 [9]. Relative to other preference based HRQL instruments, the CHU9D has the advantage that it was developed specifically for application in pediatric populations and young people were involved in its original development. The CHU9D was developed from its inception with young people using qualitative research methods about what quality of life means to them. The identified dimensions of HRQL within the CHU9D instrument emanate from young people’s descriptions of what HRQL means to them and how they would define it [10, 11].
Since its original development the CHU9D has shown good psychometric performance in samples of young people in other countries beyond the UK including translation and validation into China (CHU9D-CHN) and validation in Australia [12–14]. CHU9D has recently been translated and linguistically validated into Danish (CHU9D-DK). The translation and linguistic validation were performed by the professional language service company ICON Language services (certificate number 2920-TX-0002), which is an ISO 17100-certified translation provider, specializing in the translation of documentation related to global clinical research and in the translation and linguistic validation of patient-reported outcomes including utility instruments [15].
In Denmark, there is currently a dearth of validated instruments available for assessing HRQL in child and adolescent populations. This is particularly the case for preference-based instruments suitable for application in health economic evaluation [16, 17]. The main purpose of this study was therefore to investigate the construct validity of the newly translated and validated CHU9D-DK instrument in a young community-based sample of adult/adolescent high school students.
Methods
Sample
The school in which this study was undertaken was a randomly selected Danish high school among the 27 geographically accessible high schools to the University of Aalborg (the employment location of the lead researcher) in the Northern part of Jutland. The study was undertaken during the academic school year 2017/2018. In January 2018 following agreement from the school principal to participate in the research, all 272 students in the high school were invited via email to participate in a web-based survey of approximately 15 min duration. The survey was developed specifically for this study via the Scandinavian tool SurveyXact, a software package for creating and conducting customised questionnaire-based surveys [18]. By clicking on a person-unique link provided in the email, students completed the survey online. According to Danish and international laws, the students were informed about the purpose of the study and that it was voluntarily to participate. The voluntary completion of the survey by the students constituted their implied consent to participate in the study.
Survey
The online survey contained three components. The main component comprised the Danish versions of the two generic HRQL instruments (CHU9D-DK and PedsQL - introduced in more detail below). The other components included students’ self-assessed general self-reported health status, whether they had a disability or chronic disease, their life satisfaction and two items about their family’s socioeconomic situation. General health was reported on an ordinal scale (Excellent, Very good, Moderate, Not so good or Bad). The presence or absence of disability or chronic diseases was reported as Yes or No. The student’s overall life satisfaction was reported on an ordinal scale ranging from 1 to 10, Not satisfied (1–3), Medium satisfied (4–7), Very satisfied (8–10) or Don’t know, which was coded as missing.
Finally, family socio-economic status was approximated using two questions that have previously been applied in this context in the literature [19–21]. The first question was about financial situation. The students were asked, “Compared to other families where you live, do you think your family has (a lot of money, a reasonable amount of money, neither a lot or a little amount of money, little money or very little money)”. This item has been used in other Danish national investigations of children and adolescents welfare and well-being [19]. The item has shown that those who themselves experience having ‘little’ or ‘very little’ money, to a high degree are also those, who in more objective calculations of poverty, had relatively few financial resources.
The second question was about vacation/holiday experience in the last year. Students were asked, “Have you been on vacation in the last year? (Holiday stay with a minimum of four nights outside your usual place of residence – disregard for weekend trips) (Yes, several times, Yes, one time, No)”. This item is similar to an item used in the widely validated Family Affluence Scale (FAS), designed for self-report by adolescents aged 11–17 years [20]. This item has also been used in Danish contexts before, where it has been showed to exhibit strong positive associations with family financial situation [21]. Background information relating to the students’ age, gender, school programme and year of study was also collected for each consenting respondent by extracting this information from the high school register.
Child Health Utility 9D (CHU9D)
The CHU9D has been validated for self-completion by young people aged 7–17 years [16], and it has also been adapted for use and successfully applied in young adult populations aged 18–29 years [22, 23]. The CHU9D contains nine main dimensions (worried, sad, pain, tired, annoyed, schoolwork/homework, sleep, daily routine, and activities), each with five increasing levels of severity/impairment see Appendix. The individual responses to the CHU9D were converted to utilities by application of the existing UK adult general population scoring algorithm based on the standard gamble method [24]. For comparative purposes the responses were also converted to utilities using the recently developed Australian (AUS) adolescent-specific scoring algorithm based upon the best-worst scaling method [25, 26]. Application of the UK/AUS adult/adolescent scoring algorithms results in CHU9D utility scores ranging from 0.3261/− 0.1059 (reflecting the respective utilities attached to the most severe CHU9D health state: “PITS”) to 1.000 (reflecting full health for both scoring algorithms).
Pediatric quality of life inventory (PedsQL) 4.0 generic Core scales
The PedsQL is a generic, non-preference-based 23-item instrument assessing four main health dimensions: ‘Physical Functioning’ (8 items), ‘Emotional Functioning’ (5 items), ‘Social Functioning’ (5 items) and ‘School Functioning’ (5 items). The last three dimensions can also form a ‘Psychosocial health’ dimension, whilst the first dimension can also be called the ‘Physical health’ dimension. Respondents rate their answers on a 5-point Likert scale with one of the following preferences: 0 ‘never a problem’, 1 ‘almost never a problem’, 2 ‘sometimes a problem’, 3 ‘often a problem’, 4 ‘almost always a problem’. Items are then reverse-scored and linearly transformed into a total score ranging from 0 to 100 (where 0 = 100, l = 75, 2 = 50, 3 = 25, 4 = 0). Higher total scores represent better HRQL. The mean total score is a summation of all the items over the number of items answered, thereby accounting for missing data if present. This total scale score measures overall generic HRQL [27, 28]. The PedsQL is available and linguistically validated into Danish and it has been applied previously in several Danish contexts [29–31]. The PedsQL young adult’s version (age 18–25) was applied in this study as a key component to assess construct validity through relevant empirical comparisons with the CHU9D-DK [32].
Statistical analysis
Statistical analyses were performed using Stata version 14.2 (StataCorp LP, College Stadion, Texas, USA). Continuous variables were described as mean ± standard deviation (SD). Categorical variables were described as frequencies. Chi-squared tests were used to test differences in categorical variables, whereas Students t-test/ANOVA was used for continuous variables whenever appropriate. The distribution of utility scores was tested for normality using the Shapiro-Francia test. When the normality assumption was not met, a non-parametric test was used. A 5% significance level was used in all tests.
Validation
Internal consistency reliability
Cronbach’s alpha (α) was used for describing the internal consistency reliability of the CHU9D-DK instrument. The α coefficient was calculated based on the inter-item correlation [33]. The general accepted rule for using Cronbach’s alpha to assess internal consistency is: 0.9 ≤ α excellent; 0.8 ≤ α < 0.9 good; 0.7 ≤ α < 0.8 acceptable; 0.6 ≤ α < 0.7 questionable; 0.5 ≤ α < 0.6 poor; α < 0.5 unacceptable [34]. It was anticipated that the CHU9D-DK would demonstrate acceptable to excellent internal consistency indicating that the items are tapping into the same general construct, i.e. HRQL.
Construct validity (known-groups validation)
Known-groups validation was used to examine the extent to which the CHU9D-DK discriminates between groups with known differences. Other studies have demonstrated differences in utility scores by gender, age, clinical conditions and socio-demographic factors [32, 35–37].
General health, disability and chronic disease
It was expected a priori that respondents who rated their general health as high with no chronic disease and no disabilities would exhibit higher utility scores according on the CHU9D-DK relative to those who rated themselves in poorer general health overall and with chronic diseases and disabilities [36–38].
Life satisfaction
It was expected a priori, that respondents who rated their overall satisfaction with life high would exhibit higher utility scores according to the CHU9D relative to those who rated their overall satisfaction with life low [39].
Socio-economic status
Finally, it was expected a priori that students from higher income families, as accessed by the “Money” and “Holiday” variables, would exhibit higher utility scores according to the CHU9D relative to those from lower income backgrounds [19–21, 35, 40].
Convergent validity
As both generic instruments, the PedsQL and CHU9D, are designed to measure the same concept, HRQL in young adults/adolescents [32], we hypothesised that there would be conceptual overlap between them and that their related dimensions and overall scores would have a moderate to high correlation. The level of association between the CHU9D and the PedsQL was investigated using Spearman’s correlation coefficient (r). Correlations less than 0.3 were considered weak, 0.3–0.6 moderate, and > 0.6 strong [41]. A dimension level correlation matrix was generated of the CHU9D-DK and the PedsQL instruments combined to assess correlations between like-dimensions, particularly those that were conceptually related.
Ethics
This study was registered at ClinicalTrials.gov with the identifier: NCT03391999, and can be found at clinicaltrials.gov. The study was also recorded at the Danish Data Protection Agency (study number: 2015-57-0001).
Results
A total of 228 high school’s students consented to respond and fully completed the questionnaire (participation rate 83.8%). Table 1 presents the characteristics of the study sample, the CHU9D utilities, and the PedsQL scores. The mean age of all 272 students at the high school was 18.45 ± 1.07, and the mean age of the 228 responding/participating students was the same. Among students, there were significantly more boys (62.8%) than girls (37.2%), who fully completed the survey, corresponding to the fact that more boys were attending the high school. The group mean gender differences in HRQL utilities/scores were found to be highly statistically significant (p < 0.0001).
Table 1.
Mean (SD) CHU9D-utilities and PedsQL-scores by student’s characteristics
| N (%) | CHU9D-utilities - adolescent scoring algorithm applied (best-worst scaling method) | CHU9D-utilities - adult scoring algorithm applied (standard gamble method) | PedsQL-scores | |
|---|---|---|---|---|
| Mean (SD) | Mean (SD) | Mean (SD) | ||
| Whole sample | 228 | 0.70 (0.22) | 0.84 (0.11) | 82.32 (13.14) |
| Gender | ||||
| Girls | 85 (37.2) | 0.62 (0.23) | 0.80 (0.12) | 76.50 (13.45) |
| Boys | 143 (62.8) | 0.75 (0.20) | 0.86 (0.09) | 85.79 (11.68) |
| P-value | * < 0.006a | * < 0.001t | * < 0.001t | * < 0.001t |
| Year of study | ||||
| 1st year | 74 (32.5) | 0.73 (0.23) | 0.85 (0.12) | 84.15 (13.87) |
| 2nd year | 83 (36.4) | 0.69 (0.22) | 0.83 (0.10) | 81.05 (12.96) |
| 3rd year | 71 (31.1) | 0.68 (0.21) | 0.83 (0.11) | 81.90 (12.52) |
| P-value | 0,743a | 0.394b | 0.448b | 0.321b |
| General health | ||||
| Excellent | 45 (19.7) | 0.83 (0.15) | 0.91 (0.07) | 92.00 (7.40) |
| Very good | 129 (56.6) | 0.72 (0.20) | 0.84 (0.10) | 83.17 (10.70) |
| Middle | 43 (18.9) | 0.59 (0.22) | 0.79 (0.10) | 75.58 (12.84) |
| Not so good/poor | 11 (4.8) | 0.42 (0.26) | 0.69 (0.14) | 59.09 (17.33) |
| P-value | * < 0.001a | * < 0.001b | * < 0.001b | * < 0.001b |
| Disability or chronic disease | ||||
| No | 202 (88.6) | 0.71 (0.21) | 0.84 (0.10) | 83.50 (12.09) |
| Yes | 26 (12.4) | 0.60 (0.26) | 0.78 (0.13) | 73.20 (17.18) |
| P-value | * < 0.001a | *0.012t | *0.006t | * < 0.001t |
| Satisfaction with lifec | ||||
| Not satisfied (1–3) | 19 (8.7) | 0.48 (0.22) | 0.74 (0.11) | 69.91 (17.04) |
| Medium satisfied (4–7) | 65 (30.0) | 0.62 (0.23) | 0.79 (0.11) | 75.08 (13.10) |
| Very satisfied (8–10) | 133 (61.3) | 0.77 (0.18) | 0.87 (0.09) | 86.92 (9.59) |
| P-value | * < 0.001a | * < 0.001b | * < 0.001b | * < 0.001b |
| Money: My family has | ||||
| A lot of money | 5 (2.2) | 0.81 (0.24) | 0.89 (0.11) | 85.22 (15.46) |
| A reasonable amount of money | 71 (31.1) | 0.78 (0.17) | 0.87 (0.08) | 86.21 (9.93) |
| Neither a lot or a little amount of money | 136 (59.6) | 0.66 (0.23) | 0.82 (0.11) | 80.63 (13.36) |
| Little or very little money | 16 (7.1) | 0.64 (0.24) | 0.81 (0.12) | 78.53 (19.14) |
| P-value | * < 0.001a | *0.002b | *0.003b | *0.017b |
| Holidays last year | ||||
| No | 45 (19.7) | 0.66 (0.21) | 0.82 (0.10) | 80.12 (13.76) |
| Yes, one time | 93 (40.8) | 0.65 (0.23) | 0.81 (0.11) | 79.74 (13.61) |
| Yes, several times | 90 (39.5) | 0.77 (0.19) | 0.87 (0.10) | 86.10 (11.46) |
| P-value | * < 0.001a | * < 0.001b | * < 0.001b | *0.002b |
CHU9D Child Health Utility 9 Dimension, PedsQL Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales, SD Standard deviation. aPearsons Chi2-test, bANOVA, c“don’t know” answers were categorised as missing (N = 217), tTwo sample t-test. *P < 0.05
For the participating sample, the mean ± SD values of the CHU9D utilities were 0.84 ± 0.11 when the UK adult scoring algorithm was applied and 0.70 ± 0.22, when the AUS adolescent scoring algorithm was applied. For comparison, the mean PedsQL score was 82.32 ± 13.14. CHU9D utilities (both algorithms) and PedsQL scores were not normally distributed (all p < 0.01).
Table 1 shows, that students who self-reported themselves to have a better general health status, no disability or chronic disease, high life satisfaction, more money and had been on several holidays in the last year, exhibited higher HRQL scores on average for all three instruments relative to other students. Overall, Table 1 also shows that although the direction of the relationships between each instrument and sociodemographic variables was very similar, the mean CHU9D utilities (UK adult scoring algorithm) were on average, higher and exhibited lower SDs than the corresponding PedsQL scores (when PedsQL scores were re-scaled by dividing through by 100). Divergent to this, the corresponding mean utilities (AUS adolescent scoring algorithm) were all lower than the mean PedsQL scores and exhibited higher SDs.
Internal consistency reliability
Cronbach’s alpha was 0.797 (the standardised Cronbach’s alpha was 0.803), indicating a good level of internal consistency for the CHU9D-DK.
Known-groups validation
Hypothesis a. General health, disability, and chronic disease; there were significant differences in CHU9D utilities (both adult and adolescent scoring algorithms) and PedsQL scores between the levels of self-reported general health, living with or without disability or chronic disease in the expected directions, demonstrating that the two instruments were able to distinguish between groups with self-reported health differences.
Hypothesis b. Life satisfaction; Students who indicated that they were very satisfied with their lives had significant higher HRQL utilities (both adult and adolescent scoring algorithms) and PedsQL-scores compared to those who indicated that they were not satisfied with their lives (p-values < 0.001).
Hypothesis c. Socio-economic status; it was found that students who came from families with higher levels of socio-economic status (as approximated by the “Money” and “Holiday” variables) generally exhibited higher HRQL scores, and these differences were statistically significant for both the PedsQL scores and the CHU9D utilities (p-values < 0.01). One minor exception was in relation to the money variable and the PedsQL instrument where students scored slightly higher on average if they felt they had “a reasonable amount of money” (mean-score 86.21) compared to “a lot of money” (mean-score 85.22). The corresponding CHU9D-scores were however more consistent in this regard.
Convergent validity
Table 2 summarises the relationship between the dimensions of the CHU9D and the PedsQL regarding Spearman’s correlation coefficients. Overall, as hypothesised, a strong degree of correlation was observed between the two measures (overall r = 0.69; p < 0.001), when the adult scoring algorithm was applied and (overall r = 0.68; p < 0.001), when the adolescent scoring algorithm was applied. At the dimension level, the strongest degree of correlation was found between the ‘Emotional function’ dimension in the PedsQL and the ‘Worried’, ‘Sad’ and ‘Annoyed’ dimensions on the CHU9D (r = 0.47, 0.53 and 0.50, respectively; p < 0.001), corresponding to moderate agreement. A moderate degree of correlation was also found between similar dimensions for both instruments, ‘Schoolwork/homework’ in the CHU9D and ‘School functioning’ in the PedsQL (r = 0.38; p < 0.001). Finally, a moderate degree of correlation was found between ‘Psychosocial Health’ in the PedsQL and the dimensions ‘Worried’, ‘Sad’ and ‘Annoyed’ in the CHU9D (r = 0.46, 0.43, 0.48, respectively; p < 0.001). The weakest degree of correlation was found between the ‘Social function’ in the PedsQL and ‘Pain’, ‘Tired’ and ‘Sleep’ dimensions in the CHU9D (r = 0.21, 0.22 and 0.21, respectively; p < 0.001).
Table 2.
Correlations between CHU9D1 dimensions and PedsQL2 dimensions
| Worried | Sad | Pain | Tired | Annoyed | Schoolwork Homework |
Sleep | Daily routine | Activities | CHU9D utility | |
|---|---|---|---|---|---|---|---|---|---|---|
| Physical Health | 0.35 | 0.38 | 0.44 | 0.44 | 0.34 | 0.39 | 0.38 | 0.39 | 0.48 |
0.64 0.62 |
| Psychosocial Health | 0.46 | 0.43 | 0.34 | 0.38 | 0.48 | 0.44 | 0.37 | 0.41 | 0.46 |
0.65 0.65 |
| - Emotional function | 0.47 | 0.53 | 0.38 | 0.31 | 0.50 | 0.41 | 0.45 | 0.40 | 0.41 |
0.68 0.69 |
| - Social function | 0.28 | 0.31 | 0.21 | 0.22 | 0.38 | 0. 31 | 0.21 | 0.33 | 0.35 |
0.44 0.43 |
| - School function | 0.33 | 0.29 | 0.26 | 0.38 | 0.36 | 0.38 | 0.26 | 0.36 | 0.40 |
0.51 0.50 |
| PedsQL total score | 0.45 | 0.44 | 0.40 | 0.43 | 0.46 | 0.45 | 0.40 | 0.43 | 0.49 |
0.69 0.68 |
CHU9D Child Health Utility 9 Dimension, PedsQL Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales
The last column shows the CHU9D utility correlations when the adult scoring algorithm (standard gamble-method) was applied, underlined numbers when the adolescent scoring algorithm (best-worst scaling-method) was applied
All Spearman’s correlations are statistically significant (all p values < 0.001). The correlations between like dimensions are indicated in boldface. The three least correlated dimensions are indicated in italic
Figure 1 presents the scatter plot comparison of the two instruments with the best-fitted line (line fitted by ordinary least squares). For the CHU9D-DK, 17 (7.5%) respondents reported themselves in full health (utility value =1.0, reflecting the best level for all nine dimensions). No participants reported themselves at the worst level of impairment for the CHU9D-DK instrument. For the PedsQL instrument, 17 (7.5%) respondents reported themselves to be in full health (PedsQL = 100), but only five (2.2%) of these were respondents who also reported themselves at full health for the CHU9D-DK instrument.
Fig. 1.
Scatter plot of the CHU9D-DK utilities and the PedsQL-scores, lines showing the corresponding fitted values
In general, both scatterplots show moderate agreement between the instruments with the utilities and the scores converging towards the highest end of the scale, where the maximum utility of 1.0 on the CHU9D-DK scale corresponds to the maximum score of 100 on the PedsQL.
Two Bland-Altman scatter plots of the differences between the CHU9D-DK-utilities and the PedsQL-scores (re-scaled by dividing through by 100) are presented in Fig. 2. These two plots also illustrate moderate levels of agreements.
Fig. 2.
Bland-Altman plot of the CHU9D-utilities and the PedsQL-scores including 95% limits of agreements
The paired comparison of CHU9D-DK and PedsQL again shows, that the mean CHU9D-DK utilities were on average slightly higher (mean 0.013) than the rescaled PedsQL scores when the adult scoring algorithm was applied) (p-value paired t-test =0.025), and lower (mean − 0.123) when the adolescent scoring algorithm was applied (p-value paired t-test < 0.001). As the Bland-Altman plots also show, there were few outliers from the 95% limits of agreement with 13 (5.7%) outliers for the plot based on the adult scoring algorithm for the CHU9D-DK, and ten (4.4%) outliers for the plot based on the adolescent scoring algorithm for the CHU9D-DK.
Table 3 summarises the distribution of mean PedsQL-scores across the dimension levels of the CHU9D-DK. It shows that as expected in a community-based sample of students attending high school, the vast majority of students reported themselves in good health according to the CHU9D-DK.
Table 3.
Distributions of PedsQL-scores across dimension levels of the CHU9D-DK
| CHU9D-DK dimension and levels | Frequency (%) | Mean *PedsQL-scores |
|---|---|---|
| Worried | ||
| I don’t feel worried today | 134 (58.8) | 86.87 |
| I feel a little bit worried today | 49 (21.5) | 80.12 |
| I feel a bit worried today | 16 (7.02) | 74.12 |
| I feel quite worried today | 27 (11.8) | 71.46 |
| I feel very worried | 2 (0.9) | 44.02 |
| Sad | ||
| I don’t feel sad today | 169 (74.1) | 85.84 |
| I feel a little bit sad today | 38 (16.7) | 73.63 |
| I feel a bit sad | 15 (6.6) | 74.49 |
| I feel quite sad today | 6 (2.6) | 57.79 |
| I feel very sad today | 0 (0.0) | |
| Pain | ||
| I don’t have any pain today | 143 (62.7) | 85.92 |
| I have a little bit of pain today | 50 (21.9) | 79.87 |
| I have a bit of pain today | 18 (7.9) | 72.28 |
| I have quite a lot of pain today | 14 (6.1) | 70.73 |
| I have a lot of pain today | 3 (1.3) | 66.30 |
| Tired | ||
| I don’t feel tired today | 29 (12.7) | 91.83 |
| I feel a little bit tired today | 74 (32.5) | 86.02 |
| I feel quite tired today | 61 (26.8) | 81.00 |
| I feel quite tired today | 43 (18.9) | 76.09 |
| I feel very tired today | 21 (9.2) | 72.77 |
| Annoyed | ||
| I don’t feel annoyed today | 153 (67.1) | 86.69 |
| I feel a little bit annoyed today | 46 (20.1) | 76.87 |
| I feel a bit annoyed today | 21 (9.2) | 70.60 |
| I feel quite annoyed today | 6 (2.6) | 63.95 |
| I feel very annoyed today | 2 (0.9) | 51.63 |
| School Work/Homework | ||
| I have no problems with my schoolwork/ homework today | 107 (46.9) | 87.78 |
| I have a few problems with my schoolwork/ homework today | 77 (33.8) | 81.23 |
| I have some problems with my schoolwork/ homework today | 35 (15.4) | 71.65 |
| I have many problems with my schoolwork/ homework today | 7 (3.1) | 66.15 |
| I can’t do my schoolwork/homework today | 2 (0.9) | 76.09 |
| Sleep | ||
| Last night, I had no problems sleeping | 125 (54.8) | 86.4 |
| Last night, I had a few problems sleeping | 62 (27.2) | 81.9 |
| Last night, I had some problems sleeping | 25 (11.0) | 73.5 |
| Last night, I had many problems sleeping | 14 (6.1) | 66.5 |
| Last night, I couldn’t sleep at all | 2 (0.9) | 62.5 |
| Daily routine | ||
| I have no problems with my daily routine today | 155 (68.0) | 86.3 |
| have a few problems with my daily routine today | 48 (21.1) | 78.2 |
| I have some problems with my daily routine today | 16 (7.0) | 71.4 |
| I have many problems with my daily routine today | 6 (2.6) | 57.2 |
| Can’t do my daily routine today | 3 (1.3) | 51.8 |
| Able to join in activities | ||
| I can join in with any activities today | 132 (57.9) | 87.8 |
| I can join in with most activities today | 52 (22.8) | 77.0 |
| I can join in with some activities today | 30 (13.2) | 73.7 |
| I can join in with a few activities today | 9 (4.0) | 70.4 |
| I can join in with no activities today | 5 (2.2) | 66.5 |
CHU9D Child Health Utility 9 Dimension, PedsQL Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales
The largest proportion of students reported themselves at the highest dimension level for all dimensions, except for the “Tired” dimension where the highest proportion reported themselves at the second level “I feel a bit tired today”. In general, mean PedsQL-scores corresponded with the CHU9D-DK, with increasing levels of severity on each dimension being associated with lower mean PedsQL-scores. One minor exception was in the School Work/Homework dimension, where seven students reported, “I have many problems with my schoolwork/ homework today” and two students reported, “I can’t do my schoolwork/homework today,” respectively. The seven who reported having many problems on the CHU9D-DK scored lower mean PedsQL (66.15) than the two, who reported, “I can’t do my schoolwork/homework mean PedsQL (76.09). However, only a very small proportion of the total responses exhibited this inconsistency. It is also noticeable that the dimension “Worried” has a more diverse PedsQL range of score, than all other CHU9D-DK dimensions (from 86.87 to 44.02).
Discussion
To the best of our knowledge, this is the first study in Denmark and Scandinavia to assess the construct validity of the Danish CHU9D-DK instrument. This study compared the measurement properties of the CHU9D-DK with the PedsQL, which is one of the few available generic HRQL instruments linguistically translated into Danish and validated for Danish young people. Both instruments were able to discriminate between students according to their self-reported general health status, living with or without a disability or chronic disease, satisfaction with life and socio-economic status.
Overall, the results of this study indicate that the CHU9D-DK exhibits good construct validity in relation to assessment of the HRQL of high school students in Denmark. Hence, the practical implications are that the CHU9D-DK could potentially be more widely applied with young people in Denmark, especially in the context of health economic evaluations since the CHU9D is a preference-based instrument. However, a limitation in this regard is that no Danish population specific scoring algorithm exists yet. As such, we applied both the existing Australian adolescent scoring algorithm based on the best worst scaling method and the UK adult scoring algorithm based on the standard gamble method. The study shows, as is seen in many other studies, that the utility scores, heavily depend on the measure/algorithm that is used to elicit them [42]. In this study, as has been found elsewhere, systematic differences in utility scores were evident according to the scoring algorithm applied. In general, when the UK adult scoring algorithm was applied, the mean CHU9D-DK utilities were higher and exhibited lower SD than the mean PedsQL scores (the PedsQL rescaled by dividing it by 100). Divergent to this, the mean utilities were lower than the mean PedsQL scores and exhibited higher SD, when the Australian adolescent specific scoring algorithm was applied.
Best practice guidance in the literature indicates that it is preferable to apply country-specific scoring algorithms if available because they better reflect cultural differences and are therefore more likely to represent societal preferences more accurately than scoring algorithms originating from other countries [43–45]. In the future therefore, it will be desirable to develop a Danish valuation set for CHU9D-DK.
The results of this study support the consistency and construct validity of the CHU9D-DK. The level of internal consistency for the CHU9D-DK was good as measured by the Cronbach’s alpha (0.803), and is similar to that found in two other studies, one in Australia [46] and one in China [12], where Chronbach’s alpha was (0.781) and (0.771), respectively. CHU9D-DK utility scores discriminated well in relation to general self-reported health status and life satisfaction. Better general health status and higher life satisfaction were significantly associated with higher utility scores regardless of which scoring algorithm was applied [39]. Further students living with a disability or chronic disease had significantly lower utility scores [36–38]. The same discrimination was seen concerning the two socio-economic questions. The wealthier the family and the more holidays experienced in the preceding year, the higher the utility scores, which is also in line with other studies [19–21, 35, 40].
The findings for this Danish student sample were similar to those reported in another recent Australian study conducted in a similar population of community-based adolescents aged 15–17 years [37]. For example, the CHU9D utility scores were moderately correlated with PedsQL total scores in both studies; although, the overall correlation coefficients found in this study (r = 0.68 (adolescent scoring algorithm) and 0.69 (adult scoring algorithm)) were slightly higher than the Australian study (r = 0.63). The main reason for the moderate correlations between the overall scores generated from the two instruments is that they measure similar concepts [32]. At the dimensional level, however, more discrepancies in correlations are evident between the two instruments. There are various reasons that may explain these discrepancies. Firstly, similar dimensions are not perfectly overlapping in phraseology and descriptions between the two instruments. Secondly, it is severity that is measured in the CHU9D, as compared to frequency in the PedsQL. Thirdly, the recall time is ‘today’ in the CHU9D versus ‘in the past month’ in the PedsQL. Finally, the PedsQL has more items and theoretically covers a broader range of health states than the CHU9D. In contrast whilst the CHU9D has fewer items it includes some unique dimensions not covered by the PedsQL e.g. ‘pain’, which exhibits weak correlations with the PedsQL ‘social’ dimension. Overall, therefore whilst these two instruments are complementary in capturing HRQL, they are also different in terms of how HRQL is described and the time frame applied in HRQL assessment.
Limitations
There are some limitations to this study. Firstly, the survey was performed in a single high school with a relative small sample size of 228 respondents. This means that all included respondents resided in the same locality and therefore the study sample may not be entirely representative of the Danish high school population in this age group. However, we achieved a high participation rate of 83.8% and this represents a strength of this study.
A second limitation is that the majority of the survey participants were healthy. It is crucial, therefore, to investigate if these findings can be replicated in specific clinical patient samples. Thirdly, the composition of our study sample was such that it fell between two versions of the PedsQL instrument according to age categories, the version for teens (13–18 years) and the version for young adults (18–25 years). We chose not to use two PedsQL versions since the mean age of our sample was very close to 18 years, and opted for the most applicable version for the majority of our sample, the version for young adults.
Whilst the CHU9D is validated for young people aged 7–17 years, it has also been found to perform well in other similar samples of young adults internationally, especially for those in school settings, where the mean age is even higher than in this Danish sample, implying that CHU9D is also valid for application with young adults [22, 23]. The validation results from this study further enrich the evidence base for the applicability of the CHU9D in populations of young adults.
A potential further limitation of our study relates to the measurement of socio-economic status whereby only one of the four items from the Family Affluence Scale, the holiday item was applied. The main reason for not applying the Family Affluence Scale in its entirety was that some of the other items were not so relevant in a Danish setting, e.g., the item “Do you have your own computer?”, since all schoolchildren and young school adults have their own computer in DK. The money item is also a simple way of self-reporting family income and may not represent an accurate reflection of family income in all circumstances. However, this item has been used previously and has been found to perform well in a Danish context [19].
Conclusions
The findings from this study show that the newly translated and linguistically validated CHU9D-DK demonstrated good psychometric performance overall and shows potential as a valid and reliable instrument for assessing the HRQL of Danish young people. As a preference based instrument, the CHU9D-DK may also be usefully applied in economic evaluations targeted to interventions designed to improve the quality of life of young adults and adolescents in Denmark. Development of a Danish population specific scoring algorithm/s would further facilitate its applicability in this regard.
Acknowledgements
We would like to thank all the high school students who kindly gave up their time to participate in this study.
Abbreviations
- AUS
Australian
- CHU9D
Child Health Utility 9 Dimension
- CHU9D-DK
Child Health Utility 9 Dimension Danish version
- HRQL
Health Related Quality of Life
- PedsQL™
Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales
- QALY
Quality Adjusted Life Years
- SD
Standard deviation
- UK
United Kingdom
Appendix
CHU9D
Thinking about today….
| A1. Worried | |
| O I don’t feel worried today | |
| O I feel a little bit worried today | |
| O I feel a bit worried today | |
| O I feel quite worried today | |
| O I feel very worried today | |
| A2. Sad | |
| O I don’t feel sad today | |
| O I feel a little bit sad today | |
| O I feel a bit sad today | |
| O I feel quite sad today | |
| O I feel very sad today | |
| A3. Pain | |
| O I don’t have any pain today | |
| O I have a little bit of pain today | |
| O I have a bit of pain today | |
| O I have quite a lot of pain today | |
| O I have a lot of pain today | |
| A4. Tired | |
| O I don’t feel tired today | |
| O I feel a little bit tired today | |
| O I feel a bit tired today | |
| O I feel quite tired today | |
| O I feel very tired today | |
| A5. Annoyed | |
| O I don’t feel annoyed today | |
| O I feel a little bit annoyed today | |
| O I feel a bit annoyed today | |
| O I feel quite annoyed today | |
| O I feel very annoyed today | |
| A6. Schoolwork/Homework (Such as reading, writing, doing lessons) | |
| O I have no problems with my schoolwork/homework today | |
| O I have a few problems with my schoolwork/homework today | |
| O I have some problems with my schoolwork/homework today | |
| O I have many problems with my schoolwork/homework today | |
| O I can’t do my schoolwork/homework today | |
| A7. Sleep | |
| O Last night I had no problems sleeping | |
| O Last night I had a few problems sleeping | |
| O Last night I had some problems sleeping | |
| O Last night I had many problems sleeping | |
| O Last night I couldn’t sleep at all | |
| A8. Daily routine (Things like eating, having a bath./shower, getting dressed) | |
| O I have no problems with my daily routine today | |
| O I have a few problems with my daily routine today | |
| O I have some problems with my daily routine today | |
| O I have many problems with my daily routine today | |
| O I can’t do my daily routine today | |
| A9. Able to join in activities (Things like playing out with your friends, doing sports, joining in things) | |
| O I can join in with any activities today | |
| O I can join in with most activities today | |
| O I can join in with some activities today | |
| O I can join in with a few activities today | |
| O I can join in with no activities today |
Authors’ contributions
KDP conceived the original concept, designed the study, performed the analyses and drafted the initial manuscript. AVO, GC and JR contributed to the study design and assisted with the analyses. DS and CSF contributed to the study design. All authors critically reviewed the manuscript and approved the final version.
Funding
The study was not funded directly by any grants, but indirectly by the authors’ employment at the three Universities and the Vocational Colleges.
Availability of data and materials
The dataset and materials used in this study are available from the corresponding author upon request.
Ethics approval and consent to participate
Aalborg University, Faculty of Social Sciences approved this study under the Danish Data Protection Agency (study number: 2015-57-0001). Informed consent was obtained from all participants.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Biro F, Dorn L. Puberty and its measurement. A decade in review [review] J Res Adolesc. 2011;21:180–195. doi: 10.1111/j.1532-7795.2010.00722.x. [DOI] [Google Scholar]
- 2.Williams PG, Holmbeck GN, Greenley RN. Adolescent health psychology. J Consult Clin Psychol. 2002;70:828–842. doi: 10.1037/0022-006X.70.3.828. [DOI] [PubMed] [Google Scholar]
- 3.Larson R, Wilson S. Adolescence across place and time: globalization and the changing pathways to adulthood. In R. Lerner and L. Steinberg. Handbook of adolescent psychology. New York: Wiley; 2004. [Google Scholar]
- 4.Kleinert S. Adolescent health: an opportunity not to be missed. Lancet. 2007;369:1788–1789. doi: 10.1016/S0140-6736(07)60374-2. [DOI] [PubMed] [Google Scholar]
- 5.Alberga AS, Sigal RJ, Goldfield G, et al. Overweight and obese teenagers: why is adolescence a critical period? Pediatr Obes. 2012;7:261–273. doi: 10.1111/j.2047-6310.2011.00046.x. [DOI] [PubMed] [Google Scholar]
- 6.Brazier J, Ratcliffe J, Saloman J, et al. Measuring and valuing health benefits for economic evaluation. 2. Oxford: Oxford University Press; 2016. [Google Scholar]
- 7.Drummond MF, Sculpher MJ, Claxton K, et al. Methods for the economic evaluation of health care Programmes. Fourth. York: Oxford University Press; 2015. [Google Scholar]
- 8.Robinson R. Cost-utility analysis. BMJ. 1993;307(6908):859–862. doi: 10.1136/bmj.307.6908.859. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Stevens Katherine. Developing a descriptive system for a new preference-based measure of health-related quality of life for children. Quality of Life Research. 2009;18(8):1105–1113. doi: 10.1007/s11136-009-9524-9. [DOI] [PubMed] [Google Scholar]
- 10.Stevens KJ. Working with children to develop dimensions for a preference-based, generic, pediatric, health-related quality-of-life measure. Qual Health Res. 2010;20:340–351. doi: 10.1177/1049732309358328. [DOI] [PubMed] [Google Scholar]
- 11.Stevens K. Assessing the performance of a new generic measure of health-related quality of life for children and refining it for use in health state valuation. Appl Health Econ Health Policy. 2011;9:157–169. doi: 10.2165/11587350-000000000-00000. [DOI] [PubMed] [Google Scholar]
- 12.Yang P, Chen G, Wang P, et al. Psychometric evaluation of the Chinese version of the child health utility 9D (CHU9D-CHN): a school-based study in China. Qual Life Res. 2018;27:1921–1931. doi: 10.1007/s11136-018-1864-x. [DOI] [PubMed] [Google Scholar]
- 13.Stevens Katherine, Ratcliffe Julie. Measuring and Valuing Health Benefits for Economic Evaluation in Adolescence: An Assessment of the Practicality and Validity of the Child Health Utility 9D in the Australian Adolescent Population. Value in Health. 2012;15(8):1092–1099. doi: 10.1016/j.jval.2012.07.011. [DOI] [PubMed] [Google Scholar]
- 14.Chen Gang, Flynn Terry, Stevens Katherine, Brazier John, Huynh Elisabeth, Sawyer Michael, Roberts Rachel, Ratcliffe Julie. Assessing the Health-Related Quality of Life of Australian Adolescents: An Empirical Comparison of the Child Health Utility 9D and EQ-5D-Y Instruments. Value in Health. 2015;18(4):432–438. doi: 10.1016/j.jval.2015.02.014. [DOI] [PubMed] [Google Scholar]
- 15.ICON, by Anderson H, Vasile C. The translation and linguistic validation of the Child Health Utility 9D (CHU9D) from English into Danish. Dublin: 2016.
- 16.Chen G, Ratcliffe J. A review of the development and application of generic multi-attribute utility instruments for Paediatric populations. Pharmacoeconomics. 2015;33:1013–1028. doi: 10.1007/s40273-015-0286-7. [DOI] [PubMed] [Google Scholar]
- 17.Griebsch I, Coast J, Brown J. Quality-adjusted life-years lack quality in pediatric care: a critical review of published cost-utility studies in child health. Pediatrics. 2005;115:e600–e614. doi: 10.1542/peds.2004-2127. [DOI] [PubMed] [Google Scholar]
- 18.Ramböll Management. SurveyExact. Available at: https://www.surveyxact.dk/. .
- 19.Ottosen MH, Andersen D, Dahl KM, et al. BØRN OG UNGE I DANMARK: VELFÆRD OG TRIVSEL. Eng. translation: CHILDREN AND ADOLESCENTS IN DENMARK; WELFARE AND WELL-BEING. Copenhagen: The Danish Center for Social Science Research, Danish Translation: VIDEN Til VELFÆRD (VIVE): 2018.
- 20.Boyce W, Torsheim T, Currie C, et al. Family affluence scale as a measure of national wealth: validation of an adolescent self-report measure. Soc Indic Res. 2006;78:473–487. doi: 10.1007/s11205-005-1607-6. [DOI] [Google Scholar]
- 21.Benjaminsen L, Birkelund JF, Enemark MH, et al. Fattigdom og afsavn: om materielle og sociale afsavn blandt økonomisk fattige og ikke-fattige. Eng. translation: Poverty and deprivation: on material and social deprivation among economically poor and non-poor. Copenhagen: The Danish Center for Social Science Research, Danish Translation: VIDEN Til VELFÆRD (VIVE): 2016.
- 22.Ratcliffe Julie, Stevens Katherine, Flynn Terry, Brazier John, Sawyer Michael G. Whose Values in Health? An Empirical Comparison of the Application of Adolescent and Adult Values for the CHU-9D and AQOL-6D in the Australian Adolescent General Population. Value in Health. 2012;15(5):730–736. doi: 10.1016/j.jval.2012.04.005. [DOI] [PubMed] [Google Scholar]
- 23.Ratcliffe Julie, Chen Gang, Stevens Katherine, Bradley Sandra, Couzner Leah, Brazier John, Sawyer Michael, Roberts Rachel, Huynh Elisabeth, Flynn Terry. Valuing Child Health Utility 9D Health States with Young Adults: Insights from a Time Trade Off Study. Applied Health Economics and Health Policy. 2015;13(5):485–492. doi: 10.1007/s40258-015-0184-3. [DOI] [PubMed] [Google Scholar]
- 24.Stevens Katherine. Valuation of the Child Health Utility 9D Index. PharmacoEconomics. 2012;30(8):729–747. doi: 10.2165/11599120-000000000-00000. [DOI] [PubMed] [Google Scholar]
- 25.Ratcliffe Julie, Huynh Elisabeth, Chen Gang, Stevens Katherine, Swait Joffre, Brazier John, Sawyer Michael, Roberts Rachel, Flynn Terry. Valuing the Child Health Utility 9D: Using profile case best worst scaling methods to develop a new adolescent specific scoring algorithm. Social Science & Medicine. 2016;157:48–59. doi: 10.1016/j.socscimed.2016.03.042. [DOI] [PubMed] [Google Scholar]
- 26.Ratcliffe Julie, Couzner Leah, Flynn Terry, Sawyer Michael, Stevens Katherine, Brazier John, Burgess Leonie. Valuing Child Health Utility 9D Health States with a Young Adolescent Sample. Applied Health Economics and Health Policy. 2011;9(1):15–27. doi: 10.2165/11536960-000000000-00000. [DOI] [PubMed] [Google Scholar]
- 27.Varni JW, Seid M, Kurtin PS. PedsQL™ 4.0: reliability and validity of the pediatric quality of life inventory™ version 4.0 generic Core scales in healthy and patient populations. Med Care. 2001;39:800–812. doi: 10.1097/00005650-200108000-00006. [DOI] [PubMed] [Google Scholar]
- 28.Varni James W., Burwinkle Tasha M., Seid Michael, Skarr Douglas. The PedsQL™* 4.0 as a Pediatric Population Health Measure: Feasibility, Reliability, and Validity. Ambulatory Pediatrics. 2003;3(6):329–341. doi: 10.1367/1539-4409(2003)003<0329:TPAAPP>2.0.CO;2. [DOI] [PubMed] [Google Scholar]
- 29.Soee ABL, Skov L, Skovgaard LT, et al. Headache in children: effectiveness of multidisciplinary treatment in a tertiary paediatric headache clinic. Cephalalgia. 2013;33:1218–1228. doi: 10.1177/0333102413490349. [DOI] [PubMed] [Google Scholar]
- 30.Mollerup PM, Nielsen TRH, Bøjsøe C, et al. Quality of life improves in children and adolescents during a community-based overweight and obesity treatment. Qual Life Res. 2017;26:1597–1608. doi: 10.1007/s11136-017-1504-x. [DOI] [PubMed] [Google Scholar]
- 31.Brandhøj M, Højgaard B. Indsatser til børn og unge med overvægt. En afdækning af effektmål, erfaringer med tværsektorielt samarbejde samt beskrivelse af lovende indsatser. Copenhagen, The Danish Center for Social Science Research, Danish Translation: VIDEN Til VELFÆRD (VIVE): 2016.
- 32.Walters SJ. Quality of life outcomes in clinical trials and healthcare evaluation: a practical guide to analysis and interpretation. Chichester: Wiley; 2009. [Google Scholar]
- 33.Chronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334. doi: 10.1007/BF02310555. [DOI] [Google Scholar]
- 34.Fleiss JL, Cohen J. The equivalence of weighted kappa and the Intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–619. doi: 10.1177/001316447303300309. [DOI] [Google Scholar]
- 35.Von Rueden U, Gosch A, Rajmil L, et al. Socioeconomic determinants of health related quality of life in childhood and adolescence: results from a European study. J Epidemiol Community Health. 2006;60:130–135. doi: 10.1136/jech.2005.039792. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Varni JW, Limbers CA, Burwinkle TM. Impaired health-related quality of life in children and adolescents with chronic conditions: A comparative analysis of 10 disease clusters and 33 disease categories/severities utilizing the PedsQL™ 4.0 Generic Core Scales. Health Qual Life Outcomes. 2007;5:43. [DOI] [PMC free article] [PubMed]
- 37.Petersen K, Chen G, Mpundu-Kaambwa C, et al. Measuring health-related quality of life in adolescent populations. Patient. 2018;11:29–37. doi: 10.1007/s40271-017-0265-5. [DOI] [PubMed] [Google Scholar]
- 38.Kind P., Dolan P., Gudex C., Williams A. Variations in population health status: results from a United Kingdom national questionnaire survey. BMJ. 1998;316(7133):736–741. doi: 10.1136/bmj.316.7133.736. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Johansen H, Dammann B, Andresen IL, et al. Health-related quality of life for children with rare diagnoses, their parents’ satisfaction with life and the association between the two. Health Qual Life Outcomes. 2013;11:1–7. doi: 10.1186/1477-7525-11-152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Petersen KD, Kronborg C, Gyrd-Hansen D, et al. Characteristics of patients receiving allergy vaccination: to which extent do socio-economic factors play a role? Eur J Pub Health. 2011;21:323–328. doi: 10.1093/eurpub/ckq063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Anderson T. W., Finn Jeremy D. The New Statistical Analysis of Data. New York, NY: Springer New York; 1996. [Google Scholar]
- 42.Zhao Yue, Li Shun-Ping, Liu Liu, Zhang Jiang-Lin, Chen Gang. Does the choice of tariff matter? Medicine. 2017;96(34):e7840. doi: 10.1097/MD.0000000000007840. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Norman Richard, Cronin Paula, Viney Rosalie, King Madeleine, Street Deborah, Ratcliffe Julie. International Comparisons in Valuing EQ-5D Health States: A Review and Analysis. Value in Health. 2009;12(8):1194–1200. doi: 10.1111/j.1524-4733.2009.00581.x. [DOI] [PubMed] [Google Scholar]
- 44.Viney Rosalie, Norman Richard, King Madeleine T., Cronin Paula, Street Deborah J., Knox Stephanie, Ratcliffe Julie. Time Trade-Off Derived EQ-5D Weights for Australia. Value in Health. 2011;14(6):928–936. doi: 10.1016/j.jval.2011.04.009. [DOI] [PubMed] [Google Scholar]
- 45.Oddershede L, Petersen KD. Adjustment of foreign EQ-5D-3L utilities can increase their transferability. Clin Outcomes Res. 2015;7:629–636. doi: 10.2147/CEOR.S93280. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Furber Gareth, Segal Leonie. The validity of the Child Health Utility instrument (CHU9D) as a routine outcome measure for use in child and adolescent mental health services. Health and Quality of Life Outcomes. 2015;13(1):22. doi: 10.1186/s12955-015-0218-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The dataset and materials used in this study are available from the corresponding author upon request.