EQ-5D-Y Value Set for Slovenia

Abstract

Background

A value set for the EuroQoL 5-Dimensions (EQ-5D)-Y in Slovenia is not yet available, making the calculation of quality-adjusted life-years (QALYs) for children and adolescents using this generic instrument impossible.

Objective

The main objective of our study was to obtain adult preferences towards EQ-5D-Y health states in Slovenia, following the EQ-5D-Y-3L international valuation protocol. The adults were asked to take the perspective of a hypothetical 10-year-old child.

Method

A sample of 1074 adults in Slovenia completed an online discrete-choice experiment (DCE) survey on EQ-5D-Y health states. The latent scale issue was addressed by obtaining the value of the anchor (33333) with 200 composite time trade-off (cTTO) interviews. A mixed (random coefficients) logit model was used to estimate the value set.

Results

All the estimated coefficients of the mixed logit model were statistically significant at the 1% level and had an expected negative sign. The most important health dimension in EQ-5D-Y is pain/discomfort, followed by anxiety/depression, usual activities, and mobility, with self-care being the least important health dimension.

Conclusions

The study addresses an important research gap and presents the EQ-5D-Y value set for Slovenia. At the time of writing, no published value sets are available for the EQ-5D-Y-3L appropriate for use in QALY calculations, making this value set the first EQ-5D-Y value set in the world.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40273-020-00994-4.

Key Points for Decision Makers

This paper presents the first childhood/adolescent EuroQoL 5-Dimensions (EQ-5D)-Y-3L value set in the world.

An EQ-5D-Y-3L value set for Slovenia was obtained following the international valuation protocol for the EQ-5D-Y-3L published in early 2020.

The childhood/adolescent EQ-5D-Y-3L value set allows future cost-utility analysis in the child and adolescent population in Slovenia.

Introduction

In most countries [1, 2], the preferred outcome measure for economic evaluation purposes is quality-adjusted life-years (QALYs), which requires the employment of generic preference-based measures of health for calculation. The development of generic measures has been rapid in the past few decades, and many instruments are available, such as the EQ-5D [3], the Health Utilities Index (HUI) [4], the Short Form 6D (SF-6D) [5], the 15D instrument [6], and the Assessment of Quality of Life (AQOL) [7]. In addition to a descriptive system, a generic preference-based instrument usually presents a scoring algorithm or value set, which reflects the values for the health states it describes. National value sets for the EQ-5D, based on general population preferences, are available for many countries, including Slovenia, where the directly measured visual analogue scale (VAS) and time trade-off (TTO)-based three-level [8] and five-level crosswalk [9] sets are available.

With ever more active discussion on the inclusion of young people in decision making, more attention has recently been given to the development of multi-attribute health status classification systems specific to children and adolescents [10]. Recent reviews [11, 12] have identified nine generic preference-based instruments developed specifically for young people (children and adolescents): the Adolescent Health Utility Measure (AHUM) [13]; the Assessment of Quality of Life-6 Dimensions (AQoL-6D) [14]; the Child Health Utility instrument (CHU9D) [15]; the EQ-5D-Y [16]; the HUI Mark 2 [17]; the HUI Mark 3 [18]; the Quality of Well-Being (QWB) [19]; the 16-Dimension (16D) [20]; and the 17-dimension (17D) [21]. In addition to multi-attribute health status classification systems, other approaches are also available to estimate the QALYs of children and adolescents.

Scoring algorithms using samples from children and adolescents are currently available only for the 16D, the AQoL-6D and the CHU9D [22]. Canaway and Frew [23] established that the use of an adult EQ-5D value set with the EQ-5D-Y health states resulted in values worse than dead for children who were actually considered well enough to be in school at the time. Further studies [24, 25] established a need for specific EQ-5D-Y value sets, as the current EQ-5D-Y is not complete without a value set focused on children and adolescents. Progress in developing child- and adolescent-specific value sets has been slow; however, some studies have estimated EQ-5D-Y health state values based on general adult population preferences or have explored ways of valuing EQ-5D-Y health states. Craig et al. [26] developed an experimental value set for the EQ-5D-Y by asking adults a series of questions, including the choice between loss of health-related quality of life (HRQoL) and loss of lifespan for a child. In a study that aimed to explore ways of valuing the EQ-5D-Y-3L, Kreimeier et al. [27] used a composite TTI (cTTO) and a discrete-choice experiment (DCE) in a survey of the general adult population in Germany, asking them to value the health states of children and adolescents. Recently, the first version of the EQ-5D-Y-3L international valuation protocol was published, which suggests that preferences should be obtained from a sample of the general adult population [28].

A value set for the EQ-5D-Y in Slovenia is not yet available, making the calculation of QALYs for children and adolescents directly via the EQ-5D instrument impossible. The main objective of our study was to fill this gap and to obtain and present adult preferences towards EQ-5D-Y health states in Slovenia following the EQ-5D-Y valuation protocol. The study presents the first EQ-5D-Y-3L value set in the world.

Methods

An online DCE survey was administered to a representative sample of Slovenian adults to enable the calculation of latent scale coefficients. To obtain the value of the anchor (33333), a further 202 cTTO face-to-face interviews were conducted.

Sampling

For the DCE survey, a sample of 1276 adults in Slovenia was obtained through an online panel of a market research company (Valicon Ljubljana). The quota samples were formed according to age groups (adults: 18–29, 30–39, 40–49, 50–59, 60–69, ≥ 70 years) and sex (female/male), as well as by statistical region (west Slovenia, east Slovenia). The DCE technique produces relative preferences on a latent scale, meaning that this technique does not automatically provide utilities that are anchored to a dead–full health scale. A further 200 cTTO interviews with a non-representative sample of the adult population (aged ≥ 18 years) in one of the Slovenian regions were conducted. Age-based sampling weights were used to reinstate the original importance of each age group within the population. Weights reflecting the population age distribution were applied to the estimation of the mean value of the anchor (33333).

EQ-5D-Y

The EQ-5D-Y is a patient-reported outcome measure that was designed by the EuroQol Group to measure the HRQoL of children and adolescents aged 8–15 years [16]. The EQ-5D-Y uses adapted wording in its descriptive system to make it more understandable for young people. It contains five dimensions (mobility [MO, ‘walking about’], self-care [SC, ‘looking after myself’], usual activities [UA, ‘doing usual activities’], pain or discomfort [PD, ‘having pain or discomfort’], and anxiety or depression [AD, ‘feeling worried, sad or unhappy’]) with three levels of severity (level 1, describing no problems/no pain/not worried; level 2, describing some problems/some pain/a bit worried; and level 3, measuring a lot of problems/a lot of pain/very worried) in each dimension [29]. The respondents used the youth version of the EQ-5D-Y instrument to value the EQ-5D-Y health states, taking the perspective of a hypothetical 10-year-old child [29]. The label version from the proxy version was used in the DCE and in the cTTO survey. In the interests of brevity, the traditional dimension labels used in the adult questionnaire and their acronyms are used throughout this paper. For the same reason, in the PD and AD dimensions, we retained the level descriptions ‘no problems’, ‘some problems’ and ‘a lot of problems’.

Online Discrete-Choice Experiment and Face-to-Face Composite Time Trade-off Survey

In the online survey, a series of DCE tasks was used to obtain health state preferences from adults taking the perspective of a 10-year-old child. Within each DCE task, two health states were presented together, and the respondents were asked to choose their preferred health state (forced choice).

The experimental design took the form of a D-efficient design, with main effects and all two-way interactions, a minimal number of unrealistic health states, overlapping of health states in two dimension levels, and the right level and utility balance. Each respondent completed 15 tasks, and the design was divided into ten blocks yielding a total of 150 pairs. The design allowed the estimation of a multinomial logit model with 50 parameters (ten main effects parameters and all 40 two-way interaction parameters). We randomly selected 150 pairs that maximised the Fisher information matrix. The DCE technique produces relative preferences on a latent scale, meaning that this technique does not automatically provide utilities. Hence, the overall utilities were multiplied to ensure that the value of the pits state (33333) in the DCE survey matched the weighted average value of the pits state in the cTTO survey. The online survey was programmed using LimeSurvey.

All 202 cTTO surveys were conducted in the Primorska region. After a full day’s training in October 2019, three interviewers carried out the interviews with the non-probability purposive sample between November 2019 and February 2020, following the EuroQol protocol. The interviewers explained all the elements of the cTTO task (e.g. ‘worse than dead’ health states, ‘better than dead’ health states) using the wheelchair example.

The respondents received compensation in the form of a €10 voucher. The interviewees were asked to value ten cTTO states and complete an EQ-5D-Y descriptive profile and the VAS, as well as the EQ-5D-5L questionnaire and some socio-demographic questions. Respondents performed an initial rating exercise using three practice health states to familiarize themselves with the task.

The respondents were asked to imagine a 10-year-old child experiencing the health states to be valued. The valuation protocol recommends using the perspective of a 10-year-old child [28], and earlier studies have also done so [26, 30–32].

Quality Control

To identify any respondents whose choices suggested a reduced level of attentiveness, engagement or understanding, all the responses in the DCE tasks were checked for rationality through three fixed dominant pairs (quality control [QC] task), in which one health state was considered logically dominant. The dominant pairs were excluded from the modelling exercise. The participants were not included in the analysis if they failed two or more of the three QC tasks. Additionally, participants were excluded if the minimum amount of time spent on all the DCE tasks was less than 150 s; in this case, their responses were excluded from the analysis as it was assumed that these respondents were speeders who had not appropriately answered the tasks.

The EuroQol QC protocol was followed in the cTTO data collection [33]. First of all, the interview script was translated into the Slovenian language, as this was to be used by the interviewers. The text provided instructions on the aim of the interviews and the role of the interviewer. As the cTTO interviews were expected to be complicated, the script was quite detailed [29]. The interview was discarded if any of the following criteria were met:

1. No explanation of the ‘worse than dead’ task (lead time) in the wheelchair example was given.

2. Not enough time was spent on the wheelchair example (less than 3 min).

3. Apparent inconsistency in the cTTO ratings (33333 was not the lowest and it was at least 0.5 higher than the state with the lowest value).

4. Not enough time was spent on the cTTO task (less than 5 min for the ten cTTO tasks).

The QC reports were prepared every ten interviews for the cTTO tasks and at least once a week for the DCE survey. The data were collected between November 2019 and February 2020.

Data Analysis

Choice data were modelled using a random utility model, where utility, U, for a person i choosing alternative j is given by Eq. (1):

$$U_{\mathit{ij}}=V_{\mathit{ij}}+{ϵ}_{\mathit{ij}},$$ 1

where $V_{\mathit{ij}}$ is an observable component and ${ϵ}_{\mathit{ij}}$ is unknown and treated as random. To allow for multiple-choice tasks per subject, we rewrote a random utility for a person i, an alternative j, and a choice occasion t as:

$$U_{\mathit{ijt}}=x_{\mathit{ijt}}^T{\beta }_i+{ϵ}_{\mathit{ijt}},i=1,\dots ,N,j=1,\dots ,J,t=1,\dots T_i,$$

where x_ijt is a K × 1 vector of observed alternative attributes; ${ϵ}_{\mathit{ijt}}$ is the idiosyncratic error term, and is i.i.d. extreme value type 1; the parameter vector ${\beta }_i$ is unobserved for each i and is assumed to vary in the population following the continuous density $f({\beta }_i|\theta )$, where $\theta$ is the parameters of this distribution. We assume that the parameters are distributed as multivariate normal, ${\beta }_i\sim \text{MNV}\left(\beta ,\mathrm{\Sigma }\right)$, and the vector ${\beta }_i$ can be rewritten as:

$${\beta }_i=\beta +L{\eta }_i,$$

where ${\eta }_i\sim N(0,I)$, and L is the lower-triangular Cholesky factor of $\mathrm{\Sigma }$ such that $L{L}^T=VAR({\beta }_i)=\mathrm{\Sigma }$. A mixed (with correlated random coefficients) logit model was used to estimate adult preferences for children and adolescents. It has been shown that the mixed logit is associated with better fit than the multinomial model [34] and that there are insignificant differences between these models with regard to deriving a latent scale value set.

A linear additive utility model was estimated with all variables dummy coded (‘no problems’ was used as the base level). Estimated coefficients were divided by the overall utility range and rescaled to the weighted censored average value of the pits state (33333) obtained through the cTTO survey, to produce a value set.

Because cTTO does not permit the reporting of values lower than − 1, censoring was applied. All observations at − 1 were treated as equal to or below − 1. The average value was obtained via the Tobit model, including only the constant as the regressor on the data for the pits state. Sampling weights were applied to the sample before estimation. In essence, observations were repeated until the age distribution of responses from the cTTO task matched the original importance of each age group within the population. Standard errors were obtained through bootstrapping (simulation of 10 million value sets). The data analysis was carried out using R.

Results

Altogether, 1276 adults were included in the estimation of the EQ-5D-Y value set, after excluding those who did not meet minimum quality criteria. A total of 1074 (of 1210 [88.8%]) respondents completed the DCE tasks with satisfactory quality, and 202 (of 210 [96.2%]) completed the cTTO tasks that met the quality criteria. The descriptive statistics of the DCE and cTTO samples are shown in Table 1.

Table 1.

Descriptive statistics of the discrete-choice experiment and composite time trade-off samples

Characteristics	DCE	cTTO
Sample size, N	1074	202
Sex
Female	529 (49.3%)	111 (45.1%)
Male	545 (50.7%)	91 (54.9%)
Age group
18–29	154 (14.3%)	118 (58.4%)
30–39	172 (16.0%)	30 (14.8%)
40–49	194 (18.1%)	24 (11.9%)
50–59	194 (18.1%)	14 (6.9%)
60–69	183 (17.0%)	13 (6.4%)
≥ 70	177 (16.5%)	3 (1.5%)
Mobility
No problems	818 (76.2%)	189 (93.6%)
Some problems	230 (21.4%)	13 (6.4%)
A lot of problems	26 (2.4%)	0 (0%)
Self-care
No problems	1003 (93.4%)	200 (99.0%)
Some problems	66 (6.2%)	2 (1.0%)
A lot of problems	5 (0.5%)	0 (0%)
Usual activities
No problems	873 (81.3%)	188 (93.1%)
Some problems	189 (17.6%)	14 (6.9%)
A lot of problems	12 (1.1%)	0 (0%)
Pain/discomfort
No problems	627 (58.4%)	146 (72.3%)
Some problems	415 (38.6%)	56 (27.7%)
A lot of problems	32 (3.0%)	0 (0%)
Anxiety/depression
No problems	583 (54.3%)	172 (85.2%)
Some problems	456 (42.5%)	28 (13.9%)
A lot of problems	35 (3.3%)	2 (1.0%)
Visual analogue scale
Mean	79.9	83.3
Standard deviation	15.7	12.4
Minimum	0	38
Maximum	100	100
Median	82	85

The sample of adults in the DCE survey slightly under-represents women aged > 70 years in east Slovenia (− 23%) and slightly over-represents men in the same age group residing in the west Slovenian region (+ 20%). All other groups were well represented, as shown in Fig. 1. Sampling weights were not used in the estimation.

Fig. 1.

Discrete-choice experiment task example

The sample of adults in the cTTO survey was not representative of the Slovenian population, as the aim of the survey was only to obtain the anchor. The respondents in the cTTO survey were, on average, younger, as 58.4% of the respondents were aged < 30 years, whereas 14.3% in the DCE survey were aged < 30 years. The cTTO respondents also had fewer problems with health on all health dimensions, presumably due to age. Moreover, both the mean and the median VAS scores were slightly higher in the cTTO sample. Sampling weights were used in the estimation of mean values to ensure representability.

The mean cTTO scores of the health states valued in the cTTO survey are shown in Fig. 2. The pits state (33333) value was used in the rescaling of coefficients from the mixed logit model shown in Table 2. The mean cTTO scores ranged from − 0.691 for state 33333 to 1.000 for state 11111 (Fig. 3). In total, 50 health states (20.6%) had negative values (‘worse than dead’), whereas 10 health states (4.12%) had mean values higher than 0.8 (the full value set is given in the Electronic Supplementary Material).

Fig. 2.

Sample representativeness in the DCE survey by age, sex and region. DCE discrete-choice experiment

Table 2.

Regression results of mixed logit model and rescaled coefficients using anchor score

	Mixed logit		Rescaleda
	Coeff.	Std. dev.	Coeff.
Mobility 2	− 0.562*** (0.070)	0.215 (0.171)	− 0.083*** (0.011)
Mobility 3	− 2.062*** (0.122)	1.346*** (0.156)	− 0.305*** (0.016)
Self-care 2	− 0.314*** (0.067)	0.372** (0.122)	− 0.046*** (0.009)
Self-care 3	− 1.491*** (0.100)	0.923*** (0.129)	− 0.221*** (0.013)
Usual activities 2	− 0.714*** (0.058)	0.502*** (0.101)	− 0.106*** (0.009)
Usual activities 3	− 2.177*** (0.097)	1.275*** (0.109)	− 0.322*** (0.013)
Pain/discomfort 2	− 1.097*** (0.065)	0.890*** (0.0838)	− 0.162*** (0.010)
Pain/discomfort 3	− 3.126*** (0.125)	2.101*** (0.123)	− 0.463*** (0.016)
Anxiety/depression 2	− 0.793*** (0.064)	0.738*** (0.084)	− 0.117*** (0.009)
Anxiety/depression 3	− 2.565*** (0.110)	1.907*** (0.104)	− 0.380*** (0.014)
Log-Likelihood	− 7369.1
AIC	14868.27
BIC	15367.93
Observations	16110
Respondents	1074

*p < 0.001

^aBootstrapped (10,000,000 simulations)

Fig. 3.

Mean cTTO scores and the anchor score. cTTO composite time trade-off

All the estimated coefficients of the mixed logit model were statistically significant at the 0.1% level and had an expected negative sign, as shown in Table 2. Relatively, in the adults’ opinion, the most important health dimension in EQ-5D-Y was pain/discomfort, followed by anxiety/depression, usual activities, mobility and, finally, self-care as the least important health dimension, as shown in Fig. 4 and Table 3.

Fig. 4.

Relative importance of health dimensions

Table 3.

Childhood/adolescent value set summary statistics

Parameter	EQ-5D-Y
Number of health states	243
Range	− 0.691 to 1
Mean ± SD	0.265 ± 0.326
Median	0.326
Skewness	− 0.194
Kurtosis	2.640
States worse than dead (index < 0), n (%)	50 (20.6%)
States with index > 0.8, n (%)	10 (4.12%)

Discussion

In this study, 1074 adults participated in a DCE survey valuing 15 pairs of health states defined by the EQ-5D-Y instrument, resulting in relative preferences towards health states on a latent scale. A further 202 cTTO face-to-face interviews were performed with Slovenian adults to obtain the value for the worst state (33333). The interviewees valued ten health states using the cTTO protocol. The EQ-5D-Y-3L value set was estimated using a mixed (random coefficients) logit model. The study closely followed the EQ-5D-Y-3L international valuation protocol [28].

The EQ-5D-Y value set shows the high importance of the pain/discomfort dimension for children and adolescents. This is followed by anxiety/depression, usual activities and mobility. Self-care seems to be far less important for children and adolescents, presumably because it is difficult to imagine what the problems with the self-care component might encapsulate in children and adolescents. Also, it might be difficult to imagine children and adolescents not being able to care for themselves to a level adults expect them to.

The representativeness of the DCE sample was controlled with regard to age, sex and region by formed quotas. The sample is not necessarily representative according to other variables, such as education, disease history or having children. It is difficult to say whether these further characteristics would impact the values of health states: having children could affect the preferences, depending on the degree of closeness between parents and children. Also, the respondents with higher education might understand the survey better, which could result in more credible and consistent results; however, their preferences might differ from those who are less educated, leading to biased results. Because the cTTO sample was not representative, sampling weights were applied. A more balanced group of respondents in terms of age or region could result in the anchor being at a different level.

One of the weaknesses of the study was that it was mainly conducted as an online survey. For this reason, it could not reach part of the population with limited access to the internet or those without sufficient technical skills, such as certain groups of the elderly population or those living in remote areas. Online survey methods have been linked to concerns about whether the participants properly engage with and understand the task [35]. As the researchers had no face-to-face contact with the participant, it was not possible to directly estimate any lack of understanding, engagement or interest of the participant in the task. To lower the impact of this limitation, we used the QC procedure as described.

Following the published international valuation protocol [28], the framing of the valuation task was “Considering your views of a 10-year-old child, which health state do you prefer?” The given age of the child (10 years) could influence the result of the valuation task, as the preferences of people could differ when considering an 8-year-old or a 15-year-old adolescent. Craig et al. [26] showed that the values attached to HRQoL losses differ according to the imagined ages of a child. The EQ-5D-Y-3L questionnaire was developed to measure the HRQoL of children and adolescents aged 8–15 years, and the specific age of 10 years was chosen to help the respondents imagine a child within the recommended age range. With such an instruction, the age of child that the respondent is thinking about is known to the researcher. The differences in health state values that adults attach to children of different ages within the EQ-5D-3L-Y recommended age brackets need to be explored further. Further research is also required to examine issues from previous studies (e.g. Kreimeier and Greiner [36]) that suggest values attached to health states may differ if a person is asked to value the health state for ‘your own child’, ‘a child you know’ or ‘a hypothetical child’.

Conclusions

This study addresses a critical research gap and presents an EQ-5D-Y-3L value set for Slovenia that is, at the same time, the first EQ-5D-Y value set in the world. The value set presents adult preferences towards EQ-5D-Y health states in Slovenia, following the EQ-5D-Y-3L international valuation protocol. This childhood/adolescent EQ-5D-Y-3L value set should inform future cost-utility analyses in child and adolescent populations in Slovenia.

Supplementary Information

Below is the link to the electronic supplementary material.

Declarations

Funding

This research was funded by the European Union’s Horizon 2020 research and innovation programme (H2020) and undertaken under the auspices of IMPACT_HTA (Grant number 779312; http://www.impact-hta.eu) and the EuroQol Group (EQ Project no. 20180510). The European Commission had no role in the study design, collection and analysis of data, the writing of the report or the submission of the paper for publication. The views expressed by the authors in the publication do not necessarily reflect the views of the EuroQol Group.

Conflict of interest

Valentina Prevolnik Rupel, Wolfgang Greiner, Simone Kreimeier, Kristina Ludwig and Juan Manuel Ramos-Goni are members of the EuroQol organisation. Marko Ogorevc has no conflicts of interest that are directly relevant to the content of this article.

Availability of data and material

All the data and material will be stored and publicly available at the certified data repository Zenodo, hosted by CERN.

Code availability

Available from the authors on request.

Author contributions

JMRG prepared the concept and the design of the study; all the authors contributed to the preparation of the material and data collection. The analysis was performed by VPR and MO. The first draft of the manuscript was written by VPR and MO, and all the authors commented on previous versions of the manuscript. All the authors read and approved the final manuscript.

Ethics approval

The ethical approval for the research project using the DCE method was provided by the Committee of the Republic of Slovenia for Medical Ethics on 15 May 2018, No. 0120-154/2018/8, and annexed on 15 October 2019, No. 0120-154/2018/15. The ethical approval for the elicitation of preferences using the cTTO method was provided by the Committee of the Republic of Slovenia for Medical Ethics on 22 October 2019, No. 0120-471/2019/6.