Abstract
Background
The EQ-5D-Y is a generic preference-weighted measure for children and adolescents which was developed within Europe. Two versions exist, the EQ-5D-Y-3L (Y-3L) and EQ-5D-Y-5L (Y-5L). This study aimed to cross-culturally adapt the Y-3L and Y-5L for use in Singapore and to assess the content validity, specifically, the relevance and comprehensiveness of the EQ-5D-Y descriptive system (DS) in Asia.
Methods
To culturally adapt the instruments, an expert panel consisting of paediatricians and primary school educators were consulted. Modifications suggested by the expert panel were tested via cognitive debriefing interviews with children aged 8–12 in Singapore. To assess the content validity of the EQ-5D-Y DS, interviews were conducted with both healthy (n = 8) and ill children (n = 6) aged 8–15. In the interviews, children discussed their experience with poor health and commented on the comprehensiveness and relevance of the EQ-5D-Y DS.
Results
The cross-cultural adaptation process led to minor modifications to the UK English Y-3L and Y-5L versions, including using phrases familiar to the local children and adding examples to facilitate understanding. The five health dimensions in the EQ-5D-Y DS were spontaneously elicited when children discussed their experience with poor health. All health dimensions related to poor health elicited from the interviews fell into three broad categories: physical health (e.g. Appetite, Mobility, and Sleep), mental well-being (e.g. Annoyed/Frustrated and Scared/Worried), and social relationships (e.g. Family and Friends). The EQ-5D-Y DS was generally found to be relevant and comprehensive, although some health dimensions that may be relevant to the local population (Social relationship and Appetite) were not covered.
Conclusions
The UK English EQ-5D-Y instruments were adapted to produce the Singapore English EQ-5D-Y instrument that were comprehensible to local children as young as 8 years old. The EQ-5D-Y DS was generally relevant and comprehensive to measure poor health of local children. Future studies should ascertain the benefits of adding bolt-on items related to social relationships and appetite to the EQ-5D-Y DS.
Keywords: EQ-5D-Y, Preference-weighted measure, Cross-cultural adaptation, Content validity, Asia, Singapore
Background
The EQ-5D-Y-3L (Y-3L) is a generic, preference-weighted, patient-reported outcome measure (PROM) designed to be suitable for self-completion by children and adolescents. An international collaborative effort by researchers within Europe produced the Y-3L, by adapting a pre-existing instrument, the EQ-5D-3L, which was designed for use in adults. Differences between EQ-5D-3L and Y-3L include simplified language and modified wording of some of the dimensions to be more relevant to the child and adolescent population [1]. The descriptive system (DS) of the Y-3L contains five health dimensions: mobility, looking after myself, doing usual activities, experiencing pain or discomfort, and feeling worried, sad, or unhappy, with response options covering three levels of severity in each dimension (no problems, some problems/a bit, and a lot of problems/ very). The instrument also contains a visual analogue scale (EQ VAS), ranging from 0 (the worst health you can imagine) to 100 (the best health you can imagine). More recently, a version of the same DS but with five levels of severity, EQ-5D-Y-5L (Y-5L) has been developed [2].
Since its development, the UK English Y-3L and Y-5L have been adapted/translated for use in different local contexts and languages. To date, several adaptations and translations of the Y-3L and Y-5L exist in languages such as Australian English, Brazilian Portuguese, Canadian English, mainland Chinese, and French. Given the different cultural contexts and language nuances, these adaptations/translations are necessary to ensure linguistic equivalence [3]. It is important to note that there is currently no adapted version for use in Singapore. While English is the primary language spoken and written by children and adolescents in Singapore, the local variant differs from UK English due to influences from native languages such as Chinese, Malay, and Tamil. Furthermore, Singapore’s unique cultural norms and etiquette, possibly stemming from its multicultural environment and roots, may affect how respondents understand and interpret the questionnaire, as well as how they respond to it. Cognitive debriefing can help to delineate these aspects.
With their worldwide application, the EQ-5D-Y instruments have also been widely studied, with numerous studies demonstrating their construct validity [4–6]. However, little has been done to investigate the content validity of the EQ-5D-Y DS. Unlike construct validity which refers to the degree to which an instrument measures the theoretical construct it is intended to measure [7], content validity refers to the extent to which the content of an instrument adequately covers and measures the construct(s) it aims to measure [8, 9]. It concerns the comprehensibility, comprehensiveness, and relevance of a PROM in its context of use and is considered one of the most important measurement properties of a PROM by researchers [9]. Some efforts have been made to study the content validity of the EQ-5D-Y DS [10, 11], however, these studies did not directly ascertain the comprehensiveness and relevance of the DS with the instrument’s intended users, children and adolescents, but with proxies instead. To our knowledge, only one study [11] directly interviewed children and adolescents on the content validity of the EQ-5D-Y DS. However, the findings were limited to paediatric patients who needed psychiatric inpatient care. Further, no studies have been conducted to assess the content validity of the EQ-5D-Y DS in Asian settings.
Therefore, the aims of this study are to (i) report on the cross-cultural adaption process of the Y-3L and Y-5L to produce a Singapore English version that is linguistically equivalent to the UK English version and (ii) assess the content validity (comprehensiveness and relevance) of the EQ-5D-Y DS in children and adolescents in Singapore.
Methods
This study followed the standards for reporting qualitative research studies [12]. The procedure and materials used in this study were approved by the National Healthcare Group Domain Specific Review Board (Ref: 2020/00282) and the National University of Singapore- Institutional Review Board (Ref: NUS-IRB-2021-423). Children and their legal guardians provided assent and informed consent, respectively, prior to completing the study procedures.
All interviews were conducted by RLYT and LAC, who had no pre-existing relationships with any of the study participants. As researchers, they made conscious efforts not to accept potentially common assumptions at face value. All interviews were conducted in a private area convenient for the children and were audio-recorded. Data collected from the adaptation process were entered into a data collection form while data collected during interviews to assess content validity of the DS were voice recorded and transcribed verbatim. All interviews were anonymized, and each interviewee was assigned a code number.
Cross cultural adaptation process
The study team followed the cultural adaptation guidelines recommended by the EuroQol Group [13, 14] with slight modification. On top of the recommended process in the guidelines, the study team invited a group of local experts (including paediatricians and primary school teachers who have frequent communication with local children) to review and assess the suitability of the language used in the UK English version for Singapore. The focus was on the comprehensibility of the questionnaire in the local context, for children as young as 8 years old. Feedback and suggestions from the expert team, together with input from the questionnaire developer, the EuroQol Research Foundation were used to develop the draft Singapore English Y-3L and Y-5L. Following EuroQol Group’s translation guidelines, cognitive debriefing interviews focusing on comprehensibility of the instruments were conducted between June 2020- August 2020, with 5 Singaporean children per instrument. Children included were of varying ages and the study team sought to understand if they understood the instructions, interpreted the items as intended, and understood and appropriately selected from the response options. Methods such as verbal probes and having participants paraphrase were employed. In the case of the Y-5L, a ranking exercise [15] was also conducted to determine whether the children ordered the severity labels (presented in separate showcards and in random order) in the intended order.
Content validation
Content validation of EQ-5D-Y DS adhered closely to the COSMIN guidelines [8, 9]. Qualitative methods involving semi-structured, one-on-one in-person interviews with Singaporean children were conducted. Children who participated in the cognitive debriefing interviews for cross cultural adaption were not eligible to take part in the content validity testing. All interviews were conducted in English.
Study participants
This study recruited both healthy children and children with chronic condition. Healthy children from the general public were recruited using social media via their parents while children with chronic diseases were referred by a team member who was a paediatrician from a local hospital. Purposive sampling was conducted to ensure maximum variation in age, gender, ethnicity, and experience with chronic disease(s). Sample size was determined by data saturation. Data saturation was deemed achieved when no new themes and information emerged from the last three transcripts.
Procedures
Semi-structured interviews were conducted between December 2021- January 2023 using an interview guide developed by the study team, designed to evaluate the content validity (comprehensiveness and relevance) of the EQ-5D-Y DS. The semi-structured one-on-one interview consisted of two parts: In the first part of the interviews, children were asked to discuss their direct and indirect experience with poor health. Open-ended questions (e.g. Can you describe a time when you felt very ill/ someone you know who felt very ill? How did you feel/ how do you think he/she felt? How did that [health problem] affect you/him/her?) were used to elicit health concepts that children considered relevant components of poor health without suggestions from the interviewer or a health questionnaire. In the second part of the interviews, children were asked to complete the Singaporean English Y-3L independently (the Y-5L was not presented as the focus of the cognitive interview was the EQ-5D-Y DS and not the response levels). After that, cognitive debriefing was used to consult participants on the comprehensiveness of the EQ-5D-Y DS (e.g., Do you think we should add any more questions to improve this health questionnaire for children like yourself? Are there any important questions you think we missed out to measure health of children like yourself?), and relevance (e.g., Is this question on walking suitable to measure health of children like yourself? Why?). As the cognitive debriefing interviews during cross-cultural adaptation showed that local children had no problems understanding and differentiating the severity levels, we decided they should not be a focus of content validity testing. In this way, we hoped to reduce respondent burden on the child participants. The parent/caregiver of the recruited children were not invited to participate in the interview; however, they were allowed to sit in the interview, away from sight of the children to minimize distraction.
Data analysis
Framework analysis [16, 17] was used to analyse data from the first part of the semi-structured interviews where dimensions of poor health were spontaneously elicited. The framework used to analyse data from this study was developed by a local study team which did similar work on the general adult population in Singapore [18]. It organized themes and subthemes related to being in poor health and consists of five broad domains: Physical health, mental well-being, social relationship, medical conditions & treatment, and health promotion knowledge and behaviours. Health dimensions mentioned by respondents that were not already defined in the existing framework were considered unique and were discussed and reviewed by the study team to determine their relevance. Once deemed relevant, these dimensions were defined and added to the framework. The codebook previously developed by the local study team was used as a guide during the coding process to maintain consistency. Each transcript was coded line by line by 2 independent coders. The principal investigator was consulted whenever the two coders did not reach consensus on any discrepancy. Comprehensiveness and relevance of the EQ-5D-Y DS can be deduced by comparing the framework of spontaneously elicited health dimensions to the health dimensions included in the EQ-5D-Y DS. The definition of the health dimensions included in the EQ-5D-Y [13] were compared with the definition of the health dimensions in the framework to ensure thorough and unbiased comparison. Content analysis [19] was used to analyse data from the second part of the interviews which provides further evidence on the comprehensiveness, and relevance of the EQ-5D-Y DS.
Results
The Singapore english Y-3L and Y-5L
Modifications with justification proposed by the expert panel (6 paediatricians and 2 primary school teachers) are shown in Table 1. For example, ‘washing and dressing myself’ was revised for clarification to ‘showering or wearing clothes myself’ to better fit the phrases local children are familiar with. These modifications were included in the draft Singapore English version tested with children during the cognitive debriefing interviews as part of the cross cultural adaptation process. In total 11 children completed the cognitive debriefing (6 and 5 children interviewed to test Y-3L and Y-5L, respectively). Due to external interference (environmental noise and interruption by other people) during one interview, one additional child was recruited to test the Y-3L to ensure data quality. The mean age of the recruited sample was 9.8 years old (SD = 1.7) (Table 2). All children appropriately ranked the severity levels of the Y-5L without difficulty in all dimensions during the ranking exercise. Based on findings from the cognitive interviews, slight modifications were further proposed by the study team (Table 1) to produce the final Singapore English Y-3L and Y-5L. For example, examples of discomfort (aches, breathlessness, itching, and feeling like vomiting) were added in parentheses to facilitate children’s understanding of ‘discomfort’. These added examples of discomfort were drawn from a standard list of examples which the EuroQol group uses as needed to support understanding of the term ‘discomfort’ during translation processes. They were tested during cognitive debriefing to assess if local children understood them and only examples from the standard list which were understood by all local children interviewed were used in the final Singapore English versions. All modifications have been endorsed by the EuroQol Research Foundation.
Table 1.
Modifications made to develop the Singapore English EQ-5D-Y-3L and EQ-5D-Y-5L
| UK English EQ-5D-Y-3L and EQ-5D-Y-5L | Modifications after consulting expert panel | Modifications after consulting cognitive interviews | |||
|---|---|---|---|---|---|
| Location | Original Phrasing | Modification | Justification | Modification | Justification |
| Instructions | Under each heading, please tick ONE box that best describes your health TODAY | Under each question, please tick ONE box that best describes your health TODAY | More Colloquial | NA | NA |
| Domain | Mobility (Walking about) | Mobility (Walking around) | More Colloquial | Mobility (Walking) | Prevent confusion with the act of walking and walking around in circles. |
| Domain | Looking After Myself | Taking Care of Myself | More Colloquial & more relevant to response options | NA | NA |
| Phrasing for response options | Washing or dressing myself | showering or wearing clothes myself | More colloquial | NA | NA |
| Domain | Discomfort | NA (Though expert panel highlighted that some children might have trouble understanding ‘discomfort’) | HAVING PAIN OR DISCOMFORT (for example: aches, breathlessness, itching, feeling like vomiting) | Prevent interpretation of discomfort to be non-health related (e.g., discomfort caused by sitting on an uncomfortable chair) | |
| EQ VAS instructions | Please mark an X on the line that shows how your health is TODAY. Now, write the number you marked on the line in the box below. | Please mark an X on the line to show how your health is TODAY. Then, write the number you marked on the line in the box below. | Make it clearer to children that they need to do both (draw an ‘X’ then write the number down) | NA | NA |
NA=not applicable, Note: Modifications to the instruments are underlined and italicized in this table
Table 2.
Characteristics of participants who took part in the cognitive interviews for cross-cultural adaptation
| EQ-5D-Y-3L | EQ-5D-Y-5L | ||
|---|---|---|---|
| Gender | Age | Gender | Age |
| Male | 8 | Male | 8 |
| Male | 8 | Female | 11 |
| Male | 12 | Female | 11 |
| Female | 10 | Male | 12 |
| Female | 8 | Male | 8 |
| Female | 10 | - | - |
Content validation
A total of 14 children aged between 8 and 15 years old (mean: 10.4; SD: 2.1) completed the cognitive interviews to assess the content validity of the EQ-5D-Y DS. Half of the recruited sample were female and half were Chinese; eight children were healthy, four had a chronic condition, one had an acute condition, and one had both a chronic and acute condition. Chronic conditions experienced by the recruited sample included alopecia, eczema, haemophilia, immune thrombocytopenic purpura (ITP), and sleep apnea. Acute conditions included a leg fracture and severe hand burns. Table 3 illustrates the full demographics of the recruited sample.
Table 3.
Demographics of the recruited children who took part in the interviews to assess content validity
| Gender, n (%) | |
| Female | 7 (50%) |
| Male | 7 (50%) |
| Age, n (%) | |
| 8–9 | 6 (42.9%) |
| 10–11 | 3 (21.4%) |
| 12–15 | 5 (35.7%) |
| Ethnicity, n (%) | |
| Chinese | 7 (50%) |
| Malay | 3 (21.4%) |
| Indian | 4 (28.6%) |
| Health Status*, n (%) | |
| Healthy | 8 (57.1) |
| Chronic condition | 5 (53.7%) |
| Acute condition | 2 (14.3%) |
*The total percentage exceeds 100% because 1 participant had both acute and chronic condition
All themes and subthemes identified from part 1 of the interviews fit into the three overarching domains of Physical Health, Mental Well-being, and Social Relationship of the framework. The operational definition of the domains and themes are described in Table 4. Most of the themes and subthemes of poor health identified in the interviews fell under the domain of physical health. Four of the physical health dimensions (mobility, doing usual activities, taking care of myself, and having pain or discomfort) included in the Y-3L descriptive system were spontaneously elicited from part 1 of the interviews. The health dimension ‘feeling worried, sad, or unhappy’ was identified under the mental well-being domain. ‘having pain or discomfort’ and ‘doing usual activities’ were the two health dimensions most discussed by children in the interviews. The full framework is illustrated in Fig. 1. Exemplar quotes for each theme and subthemes are provided in Table 4.
Table 4.
Operation definition of themes and exemplars
| Domain | Theme | Operational Definition | Subtheme | Example Quote |
|---|---|---|---|---|
| Physical Health | Appearance | Outward physical traits of a person | Pale Looking | “I could tell (how she was feeling) by her face because she looks…very pale already.” C010, Female, Age 8 |
| Spots |
“I had spots all over my face…like pimples…it looked very bad.” C005, Male, Age 11 “I had to go to the A&E…(I had) dots. Dots all over my body (due to Eczema).” C011, Male, Age 9 |
|||
| Appetite | Physiological desire for food | “I cannot…eat well. a bout a few bites of food only.” C013, Male, Age 9 | ||
| Basic Functions | Persons’ basic bodily functions | Breathing |
“I couldn’t breathe properly…all blocked up, very thick mucus and pus inside.” C009, Male, Age 13 “I had breathing difficulties.” C010, Female, Age 8 |
|
| Hearing | “Hearing lost? Because there might be some kind of bleeding at the ear.” C012, Male, Age 12 | |||
| Vision | “I couldn’t see.” C013, Male, Age 9 | |||
| Food restrictions | Dietary restrictions due to health condition |
“I cannot drink sweet drinks.” C001, Female, Age 8 “My food got restricted…like ice cream, chocolate, certain types of cookies, and a lot more.” C011, Male, Age 9 |
||
| Mobility | Ability to walk and move around |
“I couldn’t…move around a lot…it (chickenpox) was almost (all over) my whole body.” C009, Male, Age 13 “Sometimes there might be bleeding…then I can’t walk or I can’t move my arm.” C012, Male, Age 12 “I did go through a lot of difficulties because I wasn’t able to move around at that time…like walking around the house… I limped a lot in order to move. And even with…the temporary cast on my leg – the one that’s very stretchable and removable – even with that I still limped a lot.” C012, Male, Age 12 “When you (are)…bedridden you feel a bit disturbed that you are encouraged not to move around. And the fact moving around is also a bit difficult.” C012, Male, Age 12 |
||
| Pain & Discomfort | Experience of physical pain or negative sensations | Dizzy/Faint |
“Very, very dizzy, I thought I’d faint.” C009, Male, Age 13 “I felt like dizzy…like almost going to faint.” C010, Female, Age 8 |
|
| Itchy |
“Felt the most sick (when I had) Chicken pox…very itchy” C001, Female, Age 8 “When I play in the hot sun, I sweat and then I get very itchy (due to eczema).” C011, Male, Age 9 |
|||
| Nauseous |
“When I eat cod last time… I mistook the food…and I vomit all over the house…that felt very miserable…Some of the vomit even got up to my nose” C002, Male, Age 8 “(Seasick)… it made me very nauseous.” C002, Male, Age 8 “My nose bled, then I suddenly vomited blood! I accidentally swallowed some, I lost a whole litre of blood…(and) I feel like vomiting blood again.” C013, Male, Age 9 |
|||
| Pain |
“I got hot water spill on my hand… Then my skin all come out…pain!” C006, Female, Age 8 “I had very bad stomach ache…painful” C007, Male, Age 10 “Chicken Pox…very painful…I want to pop everything.” C009, Male, Age 13 |
|||
| Self-care | Ability to partake in activities related to personal grooming and basic needs |
“Could not eat (by myself)… (and) I cannot wash my hand at all (due to heat injury on her hand).” C006, Female, Age 8 “They take care of me…helping me take water and feeding me food (when I was sick)” C008, Female, Age 10 |
||
| Sleep | Ability sleep at night | “I couldn’t…sleep” C013, Male, Age 9 | ||
| Tiredness/Feeling weak | A state of physical fatigue or lack of energy |
“Felt very weak and couldn’t even…stand up properly.” C008, Female, Age 10 “(I felt) very tired, like got no energy… cannot move” C010, Female, Age 8 “I had fever…I was so tired I keep sleeping.” C014 |
||
| Usual Activities | Ability to carry out physical activities | Play |
“Cannot go out with my friends…Cannot go to the park” C001, Female, Age 8 “He wanted to go down(stairs) to play with my cousin, but he couldn’t go down because he had chicken pox.” C008, Female, Age 10 “(Due to nose bleeding) I couldn’t play screen time (digital games)” C013, Male, Age 9 “I cannot play…as much as other kids.” C013, Male, Age 9 |
|
| School |
“My friends (were) at school, but I couldn’t (go)” C007, Male, Age 10 “Felt upset that he cannot go to school that week, because that week got some celebration.” C008, Female, Age 10 “I couldn’t do my homework.” C013, Male, Age 9 |
|||
| Sports |
“I cannot go out of the house and cannot go out to warm up (exercise).” C002, Male, Age 8 “Asked her to go for swim… she cannot go (due to COVID-19)” C002, Male, Age 8 “In school, I missed out PE (physical education) class.” C008, Female, Age 10 “I don’t take part in vigorous activities and I don’t usually do any kind of sports. The only sport I do is just walking.” C012, Male, Age 12 “But mainly they can’t do sports because the fact that their heart is outside of their body makes them even more vulnerable, and when they’re doing sports, their heart might get injured. It will be a very serious problem for them.” C012, Male, Age 12 “Physical activities cannot be done as well…it has to be safe.” C013, Male, Age 9 |
|||
| Vital Signs | Physiological aspects of the body | “(Health is) Your heart rate, blood pressure, oxygen level.” C013, Male, Age 9 | ||
| Mental Well-Being | Anger | Feeling of fury or rage | “Every time I get very angry…I do something really really bad.” C013, Male, Age 9 | |
| Annoyed/Frustrated | Sense of irritation |
“My father had COVID…all of us needed to be in lockdown…so annoying” C002, Male, Age 8 “It’s just really frustrating to have a fever. (You) get really tired, cannot move. Frustrating.” C010, Female, Age 8 |
||
| Depressed/Sad | A state of low mood, loss of interest |
“A little bit sad…I didn’t even drink cold water or eat anything sweet but then I (still) got sick.” C008, Female, Age 10 “Felt upset that he cannot go to school that week, because that week got some celebration.” C008, Female, Age 10 “The person might be feeling depressed. Not just about the fact that he can’t do a lot of things, but about the fact that people also comment on his disability.” C012, Male, Age 12 |
||
| Scared/Worried | A state of anxiety or fear |
“I got to go to the hospital…and (I felt) scared.” C007, Male, Age 10 “Sometimes it (dizziness from low blood pressure) just comes like randomly. Like I don’t like expect it. So it’s kind of scary.” C010, Female, Age 8 |
||
| Social Relationship | Family | Degree of harmony and interaction between family | “Interaction with your family members, (is affected) because chicken pox is a contagious disease. Their family members might contract it, and more importantly their siblings might contract it.” C012, Male, Age 12 | |
| Friends | Degree of harmony and interaction between non-family members | “If they go to a school…they might also get harassed or bullied on the fact that they do not have a leg and must move around, always in a wheelchair.” C012, Male, Age 12 |
Fig. 1.

Framework of poor health
Findings from part 2 of the cognitive interviews focusing on the comprehensiveness and relevance of the five health dimensions included in the descriptive system of the EQ-5D-Y are reported below:
Mobility
Generally, the children shared that mobility was an important health dimension as it could be compromised due to an injury, which is a reflection of their health status. This is shown in the excerpt below:
Boy, 12 years-old: The time in which the problem walking comes is when, is (when I have an) injury. But other than that, normally, I don’t have any problems walking.
Taking care of myself
All children agreed that assessing children on their ability to shower and wear clothes themselves was important to measure the health of children. Excerpt below shows how poor health can affect self-care:
Girl, 8 years-old (with severe hand burns): Yes, this is important… I cannot touch water (to shower).
Doing usual activities
Children generally defined usual activities as going to school or engaging in play or sports. All children agreed that having poor health will affect their ability to conduct their usual activities and was therefore an important health dimension to be included in the health questionnaire. It is, however, worth noting that one child answered this item using a non-health lens (the child rated that she had problems doing her usual activities, which she defined as not being able to rollerblade as her roller blades were not with her.) One child shared that having problems with usual activities can also reflect one’s mental health:
Girl, 15 years-old: Some people… have an interest in… playing sports, and then suddenly… they don’t feel like doing the things they love or like… like those people who have depression. I think by asking this kind of question… it’s suitable for the younger generation… (to) know how they’re feeling.
Having pain or discomfort
Except for one child who interpreted this item as both mental and physical pain, all other children interpreted it as only physical. All children agreed that pain and discomfort was an important health dimension to be included. The children shared that pain or discomfort can manifest as symptoms of a certain illness and can be an indicator of poor health. Excerpt below shows how pain and discomfort reflect poor health:
Boy, 12 years-old: Having pain or discomfort is even more important…because it could be life threatening.
Feeling worried, sad, or unhappy
All children agreed that this was an important health dimension. Reasons provided include the item’s ability to capture information about a child’s mental health, as shown in the excerpt below:
Boy, 12 years-old: Feeling worried, said or unhappy is also important because it describes their mental health.
Though most children indicated that the EQ-5D-Y DS was sufficient to capture the health of children, a few children suggested adding more items to increase comprehensiveness. Items suggested by children include more items relating to mental health on top of the existing single item measuring “worried, sad, or anxiety” (Boy, 13 years old), an item on having problems sleeping (Boy, 9 years old), an item on appetite (Girl, 12 years old) and an item on quality of relationship with friends and family (Boy, 12 years old). Examples of items related to quality of relationship with friends and family are highlighted in the excerpt as follows:
Boy, 12 years-old: I would say (add these items)… How are your relationships? Do you have any problem with relationships like friendship?…Any conflicts with your friends? Do you have some friends who don’t like you/avoid you/do not want to talk to you…And how is your family…like any bad relationship with family members?
Discussion
This study reported on the adaptation of the UK English Y-3L and Y-5L to Singapore English and assessed for content validity of the EQ-5D-Y DS in Singaporean children. To our knowledge, this is the first study to assess content validity of the EQ-5D-Y DS in Asian settings. This study found that the dimensions included in the EQ-5D-Y DS were generally considered to be relevant aspects of poor health by the local children, but some areas of poor health that may be relevant to the local population including social relationship and appetite were not covered. Though with the addition of more health concepts could improve the comprehensiveness of the EQ-5D-Y DS, it is important to note that instead of comprehensiveness, the EQ-5D-Y instruments, like their predecessors (EQ-5D-3L and EQ-5D-5L), were designed with brevity as priority. It was intended to be a short generic HRQoL measure that could capture fundamental aspects of health deemed important to both healthy and paediatric disease populations. To improve the comprehensives of the EQ-5D descriptive system for specific populations, bolt-on research has been undertaken [20–22]. This research involves the addition of supplementary health dimensions to the five existing ones. For example, a cognition bolt-on was found to improve the discriminatory power of EQ-5D-Y for children in Germany [20].
Interestingly, like the study conducted to assess the content validity of the adult version EQ-5D DS in Singapore [18], ‘appetite’ was raised as one of the items that could be added as a bolt-on to improve comprehensiveness. In addition, a previous study conducted to evaluate participants’ attitudes towards health and pleasure with regard to eating found that “eating pleasure” was important for a large majority of Singaporeans [23]. Future studies can consider testing ‘appetite’ as a bolt-on for the Singaporean EQ-5D versions due to its cultural relevance in Singapore to assess if any improvements in psychometric properties is worth the additional respondent burden of the added bolt-on.
Although this study established the content validity of Y-3L for use in Singapore, it is important that researchers thoroughly assess the instrument’s psychometric performance prior to administering it in Singapore. The instrument was originally developed in the UK [1] and has been psychometrically validated in various counties and populations [24], however, due to cultural, context, and language differences between those countries and Singapore, findings from those studies might not be generalizable. Psychometric properties important to such HRQoL instruments includes construct validity, test-retest reliability, and responsiveness [7].
Study limitation
There are some limitations to this study. Firstly, children as young as 8 years-old were recruited for this study to assess content validity. Young children might not have enough experience with poor health to comment on the comprehensiveness and relevance of a health questionnaire. This is mitigated by the study team asking children about their indirect experience with poor health and recruiting children with chronic conditions. As the instrument was designed to be suitable for children aged 8 and older, recruitment of children as young as 8 is crucial to understand the instrument’s performance within the lower age bound group. Secondly, while health dimensions associated with poor health were elicited from children, the relative importance of these health dimensions, including health dimensions in the EQ-5D-Y DS, were not explored in this study. Lastly, this study only assessed the content validity of the EQ-5D-Y DS and not the EQ VAS. Although part of the same instrument (Y-3L and Y-5L), the instructions, labels, and response options are different. Hence, results from this study cannot be applied to the EQ VAS. Future research can assess the content validity of the EQ VAS, including the understandability of the instructions and interpretation of labels ‘worst imaginable health’ and ‘best imaginable health’ by the younger population.
Conclusion
The Singapore English version of the Y-3L and Y-5L questionnaires were adapted from their original UK English versions. Content validity was also established for the EQ-5D-Y DS. Specifically, its DS was found to be comprehensive and relevant to measure the health of Singaporean children and adolescents.
Acknowledgements
Not applicable.
Abbreviations
- Y-3L
EQ-5D-Y-3L
- Y-5L
EQ-5D-Y-5L
- DS
Descriptive system
- PROM
Patient reported outcome measure
- EQ VAS
EQ visual analogue scale
- ITP
Immune thrombocytopenic purpura
- SD
Standard deviation
Author contributions
NL, MH, ZMN, and RTLY contributed to the conception and design of the study. ZMN screened and recruited participants for the study. RTLY and LAC collected data, analyzed and interpreted the data. RTLY was the major contributor in writing the manuscript. NL and MH critically revised the manuscript for intellectual content. All authors read and approved the final manuscript.
Funding
The research study was funded by the EuroQoL Research Foundation (a non-profit organization) and is gratefully acknowledged.
Data availability
Dataset is available on reasonable request.
Declarations
Ethics approval and consent to participate
Ethical approval was obtained from the National Healthcare Group Domain Specific Review Board (Ref: 2020/00282) and the National University of Singapore- Institutional Review Board (Ref: NUS-IRB-2021-423). Permission was then sought from the various institutions at which the study took place. Parents signed informed consent, allowing their child to participate in the study. Children signed informed assent forms.
Consent for publication
No individual’s personal data is included.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Wille N, Badia X, Bonsel G, Burström K, Cavrini G, Devlin N, et al. Development of the EQ-5D-Y: a child-friendly version of the EQ-5D. Qual Life Res. 2010;19(6):875–86. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Kreimeier S, Åström M, Burström K, Egmar A-C, Gusi N, Herdman M, et al. EQ-5D-Y-5L: developing a revised EQ-5D-Y with increased response categories. Qual Life Res. 2019;28:1951–61. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Maxwell B. Translation and cultural adaptation of the survey instruments. Third international mathematics and science study (TIMSS) technical report. 1996;1:159 – 69.
- 4.Ravens-Sieberer U, Wille N, Badia X, Bonsel G, Burström K, Cavrini G, et al. Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study. Qual Life Res. 2010;19(6):887–97. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Burström K, Bartonek Å, Broström E, Sun S, Egmar AC. EQ-5 D‐Y as a health‐related quality of life measure in children and adolescents with functional disability in S weden: testing feasibility and validity. Acta Paediatr. 2014;103(4):426–35. [DOI] [PubMed] [Google Scholar]
- 6.Fitriana TS, Purba FD, Rahmatika R, Muhaimin R, Sari NM, Bonsel G, et al. Comparing measurement properties of EQ-5D-Y-3L and EQ-5D-Y-5L in paediatric patients. Health Qual Life Outcomes. 2021;19(1):1–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Prinsen CA, Mokkink LB, Bouter LM, Alonso J, Patrick DL, De Vet HC, Terwee CB. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27:1147–57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Terwee CB, Prinsen C, Chiarotto A, De Vet H, Bouter LM, Alonso J, et al. COSMIN methodology for assessing the content validity of PROMs–user manual. Amsterdam: VU University Medical Center; 2018. [Google Scholar]
- 9.Terwee CB, Prinsen CA, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res. 2018;27:1159–70. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Blackmore AM, Mulhern B, Norman R, Reddihough D, Choong CS, Jacoby P, Downs J. How well does the EQ-5D-Y-5L describe children with Intellectual Disability?There’Sa Lot more to my child than that she can’t wash or dress herself. Value Health. 2024;27(2):190–8. [DOI] [PubMed] [Google Scholar]
- 11.Krig S, Åström M, Kulane A, Burström K. Acceptability of the health-related quality of life instrument EQ‐5D‐Y‐5L among patients in child and adolescent psychiatric inpatient care. Acta Paediatr. 2021;110(3):899–906. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.O’Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245–51. [DOI] [PubMed] [Google Scholar]
- 13.Rabin R, Gudex C, Selai C, Herdman M. From translation to version management: a history and review of methods for the cultural adaptation of the EuroQol five-dimensional questionnaire. Value Health. 2014;17(1):70–6. [DOI] [PubMed] [Google Scholar]
- 14.Translation Guidelines-. New adaptations of language versions of the EQ-5D (3L, 5L and Y) developed by the EuroQol Research Foundation (‘adaptation’). EuroQol Research Foundation; 2018.
- 15.Derrett S, Herdman M, Ngwira LG, Moore EY, Jelsma J. A new approach to assessing children’s interpretation of severity qualifiers in a multi-attribute utility instrument–the EQ-5D-Y-5L: development and testing. Patient-Patient-Centered Outcomes Res. 2021;14:591–600. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Furber C. Framework analysis: a method for analysing qualitative data. Afr J Midwifery Women’s Health. 2010;4(2):97–100. [Google Scholar]
- 17.Goldsmith LJ. Using Framework Analysis in Applied qualitative research. Qualitative Rep. 2021;26(6).
- 18.Lee GL, Tan RL, Herdman M, Luo N. Assessing the content validity of the EQ-5D questionnaire among asians in Singapore: a qualitative study. Ann Acad Med Singap. 2020;49(5):294–305. [PubMed] [Google Scholar]
- 19.Mayring P. Qualitative content analysis. Companion Qualitative Res. 2004;1(2):159–76. [Google Scholar]
- 20.Ludwig K, Surmann B, Räcker E, Greiner W. Developing and testing a cognitive bolt-on for the EQ-5D-Y (youth). Qual Life Res. 2022;31(1):215–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Yang Y, Rowen D, Brazier J, Tsuchiya A, Young T, Longworth L. An exploratory study to test the impact on three bolt-on items to the EQ-5D. Value Health. 2015;18(1):52–60. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Gandhi M, Ang M, Teo K, Wong CW, Wei YC-H, Tan RL-Y, et al. A vision ‘bolt-on’increases the responsiveness of EQ-5D: preliminary evidence from a study of cataract surgery. Eur J Health Econ. 2020;21:501–11. [DOI] [PubMed] [Google Scholar]
- 23.Lim CG, van Dam RM. Attitudes and beliefs regarding food in a multi-ethnic Asian population and their association with socio-demographic variables and healthy eating intentions. Appetite. 2020;144:104461. [DOI] [PubMed] [Google Scholar]
- 24.Tan RL-Y, Soh SZY, Chen LA, Herdman M, Luo N. Psychometric properties of generic preference-weighted measures for children and adolescents: a systematic review. PharmacoEconomics. 2023;41(2):155–74. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Dataset is available on reasonable request.
