Abstract
An important outcome of any clinical intervention is the change in the subject's own perceived state of health. This can be categorized as health-related quality of life (HRQL), utility (preference-based health state), and daily life performance. 174 Swedish subjects with chronic obstructive pulmonary disease (COPD) (mean age 64.3 ± 12 years) completed five self-administered questionnaires: Short Form 36 (SF-36), St George's Respiratory Questionnaire (SGRQ), EuroQol-5D (EQ-5D), Health States-COPD (HS-COPD), and Work Productivity and Activity Impairment Questionnaire for COPD (WPAI-COPD). The subjects scored these outcomes instruments for ease of completion using a 5-point scale. The time taken to complete them was noted and the administrators' opinion of the subjects' comprehension of the questionnaires recorded using a 4-point scale.
A score of 1–3 ("very easy" to "acceptable") was recorded by 92% of subjects for the SF-36, 90% for SGRQ, 80% for EQ-5D, 83% for WPAI-COPD, and 53% for HS-COPD. The HS-COPD was graded "very difficult" to complete by 21% of subjects compared with 3–5% of subjects for the other questionnaires. The mean time taken to complete all questionnaires was 39 minutes, and the large majority of subjects scored "good" for understanding by the administrator. Age correlated significantly with the degree of the subject's opinion of the ease of completion of five outcomes instruments, while the influence of gender, socio-economic status and disease severity was not statistically significant.
Keywords: health-related quality of life, COPD, questionnaires, ease of completion
Introduction
Chronic obstructive pulmonary disease (COPD) is a progressive and largely irreversible airways disease characterized by emphysema and chronic bronchitis, resulting in breathlessness, cough and sputum. As the disease progresses, subjects with COPD experience increasing deterioration of their health-related quality of life (HRQL), with greater impairment in their ability to work and declining participation in social and physical activities.
COPD is currently the fourth leading cause of death in the US and its incidence is increasing [1]. Typically, COPD affects today middle-aged to elderly men with significant smoking histories. As a result of changing smoking habits, the incidence of COPD in women is rapidly increasing [2]. Respiratory diseases are among the three principal causes of lost working days worldwide and COPD is responsible for the majority of the loss [3].
HRQL, utility, and productivity impairment outcomes instruments are increasingly used in clinical studies. Although their use is established in many fields, such as the gastrointestinal and oncology fields, questionnaires are rarely used as primary endpoints in clinical studies of respiratory disease. The European Agency for the Evaluation of Medicinal Products (EMEA) states that, in clinical studies of COPD, symptomatology should be a primary endpoint, and the use of a disease-specific HRQL questionnaire is recommended [4]. Several disease-specific and generic questionnaires suited to the respiratory field have been developed in recent years.
Instruments to measure health outcomes
The Short Form 36 (SF-36) and St George's Respiratory Questionnaire (SGRQ) are generic and disease-specific HRQL questionnaires, respectively [5], [6]. The SF-36 has been used in a number of therapeutic areas including COPD. The SF-36 includes 36 items in 8 domains; Physical Functioning, Role Physical, Bodily Pain, General Health, Vitality, Social Functioning, Role Emotional and Mental Health. Two component summary scores are used, the Physical Component Summary (PCS) and the Mental Component Summary (MCS). The SGRQ has been widely used in both COPD and asthma research and includes 56 items (76 weighted responses) across three domains, symptoms, activity and impact.
The EuroQol-5D (EQ-5D) and Health States-COPD (HS-COPD) are generic and disease-specific utility measures, respectively. Utility measures are preference-based measures of health-related quality of life. These measures can be used in economic evaluations [7]. Generally, these measures evaluate subjective preferences for multi-dimensional HRQL on a scale of 0 to 1 (or 100), where 0 usually represents worst possible health and 1 (100) represents perfect health [8], [9]. EQ-5D has been used in a number of therapeutic areas. EQ-5D includes a vertical rating scale from 0 to 100 and in addition five items including mobility, self-care, usual activity, pain/discomfort and anxiety/depression [10]. The HS-COPD is still under development (personal communication, Gordon Guyatt, McMaster University, Hamilton, Canada) although a preliminary version, tested both in Canada and Sweden, is available. Also the HS-COPD includes a vertical rating scale ranging from 0 (worst possible health-state) to 100 (best possible health-state). Three pre-defined health marker states are to be indicated on the rating scale by the subjects. The subjects then register their own health state using the same scale. The pre-defined health marker states are drafted as narratives with extensive information but are considered as a guide for subjects and are not used in analyses.
The Work Productivity and Activity Impairment Questionnaire for COPD (WPAI-COPD) is a productivity and activity impairment instrument covering seven items on the limitations that impact on work and daily activity. It has been applied in some therapeutic areas, such as rhinitis and gastroenterology [11], [12].
Evidence suggests that the indirect assessment of a subject's HRQL, via relatives, care providers or health professionals, tends to underestimate the level of HRQL impairment [13], [14] and is thus preferable for the subjects to be assessed directly. At present, no data have been published to describe whether subjects with COPD have difficulty completing self-administered questionnaires. Such data on burden of completion are important in evaluating the feasibility of these assessments in clinical studies of COPD and for the interpretation of results.
The present study investigated the ease/difficulty of completion as well as the time of completion of the five outcomes instruments, including the two HRQL questionnaires, the two utility questionnaires and the productivity/activity questionnaire by subjects with COPD.
Material and methods
The study was performed in a three-month period during the winter of 2000. The study was approved by the Ethics Committee of the University Hospital of Northern Sweden in Umeå.
Study sample
The study sample has been described in previous publications and was used in a recently completed study of cost-of-illness [15] and a study of exacerbations [16]. In summary, the sample was derived from large-scale population studies of the epidemiology of obstructive airway diseases in Northern Sweden, the OLIN studies. Longitudinal studies of a number of cohorts are in progress since 1985, today including approximately 40,000 people of the general population, including also children and elderly [15].
The inclusion criterion, a diagnosis of COPD, was based on spirometry tests. This diagnosis was defined according to the British Thoracic Society's (BTS) criteria; FEV1 /VC ratio <70% and FEV1 <80% of predicted values, and furthermore, due to the FEV1, divide COPD into mild, moderate and severe disease [17]. In addition, persons with an FEV1 /VC ratio <70% and an FEV1 ≥ 80% of the predicted value were also included in the study. The inclusion of this mild type of COPD is fully in agreement with the recent Global Initiative of Chronic Obstructive Pulmonary Disease (GOLD) guidelines [18].
When stratifying by age, range 28–80 years, and disease severity, some strata contain a low number of subjects. Thus, all subjects having FEV1 < 60% of predicted were included in the study sample, and for subjects with an FEV1 ≥ 60% of predicted, a random sample was drawn from each stratum.
The study sample is shown in Table 1. Of the 202 invited, 174 (70 women) participated, which corresponds to 86% of the invited. All but one completed all five questionnaires. One subject completed only the first three questionnaires (SF-36, SGRQ and EQ-5D).
Table 1.
Subject characteristics
| Number | 174 |
| Women / men | 70 / 104 |
| Age, years | |
| Mean ± SD | 64.3 ± 12 |
| Range | 28–80 |
| FEV1, L | |
| Mean ± SD | 1.76 ± 0.78 |
| Range | 0.46 – 4.12 |
| FEV1, % pred | |
| Mean ± SD | 62 ± 20 |
| Range | 18–118 |
| GOLD classification | |
| Number of subjects: | |
| Stage I | 19 |
| Stage IIA | 82 |
| Stage IIB | 32 |
| Stage III | 9 |
Three categories of socio-economic groups were included. The first category was manual workers in industry and in service (n = 78). The second category was non-manual employees and included intermediates, civil servants and professionals (n = 60). The last category comprised all others, including unemployed and housewives (n = 36). Of the 138 'employees', 65 were still working but 73 had retired, of whom 40 had retired early.
The mean FEV1 of the subjects was 1.76 ± 0.78 L (range 0.46.– 4.12 L) and 62 ± 20% of predicted normal value (range 18. – 118%). Using the FEV1 classification from the GOLD guidelines, 19 subjects were categorized as being in stage I, 'mild' COPD (FEV1 ≥ 80% pred.), 82 subjects were in stage IIA, 'moderate' COPD (FEV1 50–79% pred.), 32 subjects were in stage IIB, 'moderate' COPD (FEV1 30–49% pred.), and 9 subjects were in stage III 'severe' COPD (FEV1 <30% pred.) [18].
Methods
An initial, brief instruction from the administrator, an appointed nurse, was given to all subjects including the following information: all questionnaires should be completed in the given order, no explanation of any question would be given and if a question was not understood, the subjects were told to go to the next question. All questionnaires were completed, unaided, by all subjects in the same and following order: SF-36, EQ-5D, SGRQ, WPAI-COPD and HS-COPD. This order was chosen on the basis of the recommendation that generic measures, such as SF-36 and EQ-5D, should be completed before disease-specific measures, such as SGRQ and HS-COPD, and that HRQL measures should be completed before utility measures. Since EQ-5D and HS-COPD both use a similar rating scale, the WPAI-COPD questionnaire was scheduled between these two questionnaires.
Subjects scored questionnaires for ease/difficulty of completion on a scale of 1–5 (1 = very easy, 2 = easy, 3 = acceptable, 4 = difficult and 5 = very difficult) (Table 2).
Table 2.
Question to the subject
| A. | You have now completed 5 various questionnaires | |||
| Please indicate on a rating scale scored 1–5 the degree of difficulty to complete them: | ||||
| 1 = very easy | 2 = easy | 3 = acceptable | ||
| 4 = difficult | 5 = very difficult | |||
| 1) | SF-36 | ____ | ||
| 2) | SGRQ | ____ | ||
| 3) | EQ-5D | ____ | ||
| 4) | WPAI | ____ | ||
| 5) | HS-COPD | ____ | ||
| To be completed by administrator. | ||||
| B. | Time for completion: ____ min | |||
| C. | The administrator's opinion of how the subject understands the meaning of the questionnaires | |||
| Good understanding | (1) | |||
| Probably understood | (2) | |||
| Possibly understood | (3) | |||
| Did not understand | (4) | |||
In addition, the administrator gave her opinion of how she felt about the subjects' comprehension of the instruments using a 4-point scale (1 = good understanding, 2 = probably understood, 3 = possibly understood and 4 = did not understand) (Table 2). The time taken by subjects to complete all of the outcomes instruments was also recorded by the administrator.
Analysis
Data were analysed using a linear model with factors for gender, disease severity and socio-economic group and with age as covariate. Trend for disease severity was tested by use of a linear contrast.
The Global Initiative for Chronic Obstructive Lung Disease (GOLD) guidelines were used for classification of disease severity [18].
Results
A score of 1–3 ("very easy" to "acceptable") was recorded by 92% of the subjects for SF-36, by 90% for SGRQ, by 83% for WPAI-COPD, 80% for EQ-5D, and by 53% for HS-COPD. Ten to fifteen percent of the subjects found SF-36, SGRQ or EQ-5D "very easy" to complete, with only 3–4% finding these questionnaires "very difficult" to complete (Table 3). The administrator's opinion of the subjects' understanding was generally good, with only 2 subjects graded as having "not understood" (Table 4).
Table 3.
Subjects' scorin g of questionnaires
| Questionnaire (n) | Score | ||||
| Very easy (1) | Easy (2) | Acceptable (3) | Difficult (4) | Very difficult (5) | |
| n (%) | n (%) | n (%) | n (%) | n (%) | |
| SF-36 (174) | 26 (15) | 80 (46) | 54 (31) | 9 (5) | 5 (3) |
| SGRQ (174) | 22 (13) | 79 (45) | 55 (32) | 13 (7) | 5 (3) |
| EQ-5D (174) | 18 (10) | 70 (40) | 51 (29) | 28 (16) | 7 (4) |
| WPAI-COPD (173) | 22 (13) | 79 (46) | 43 (25) | 17 (10) | 12 (7) |
| HS-COPD (173) | 8 (5) | 34 (20) | 49 (28) | 46 (27) | 36 (21) |
Table 4.
Subjects' understanding according to the administrator
| Score | Good understanding (1) | Probably understood (2) | Possibly understood (3) | Did not understand (4) |
| n (%) | 118 (68%) | 40 (23%) | 14 (8%) | 2 (1%) |
The results demonstrate that older subjects have more difficulties completing the questionnaires. The test for trend in difficulty was statistically significant for all questionnaires when all groups were compared: SF-36 p = 0.003, SGRQ p < 0.001, EQ-5D p < 0.001, WPAI-COPD p < 0.001, and HS-COPD p < 0.001. Data from the six age groups and SF-36, SGRQ and EQ-5D are shown in figure 1.
Figure 1.
Subjects' mean scoring by age groups (according to the cohort of subjects included)
The severity of COPD also influenced the difficulty experienced by subjects in completing questionnaires (Figure 2). Although higher scores were seen for increasing severity, the trend was not statistically significant after correction for other factors included in the model.
Figure 2.
Subjects' mean scoring according to severity of COPD (GOLD criteria: FEV1 % predicted normal values, ≥ 80% = Stage I mild, 50. – 79% = Stage IIA moderate, 40. – 49% = Stage IIB moderate, <30% = Stage III severe)
Female subjects reported greater difficulty completing all five outcome instruments than male subjects did. However, the gender difference was statistically significant only for the EQ-5D (43% of the women scored 1 and 2 compared with 57% of the men, p = 0.026). The three socio-economic groups did not show any significant differences for any of the comparisons made in this study. The scores 1 or 2 of ease of completion of SF-36 were as follows: manual employees 50%, non-manual-employees 77%, and unemployed 58%. For the SGRQ the values were: manual employees 58%, non-manual employees 68%, and unemployed 42%. Similar values were recorded for the other three instruments. Nominal differences were seen but without statistical significance.
The recorded mean time for completion of all five questionnaires was 39 ± 13 minutes (range 10–80 minutes). There was also a tendency that the disease severity affects the subject's need of time to complete the questionnaires. However, 95% of the subjects completed the questionnaires within one hour.
Discussion
In clinical research and in daily life, subjects are often required to complete questionnaires. The ability to understand and complete these forms correctly has not been studied to any great extent. Today COPD is a progressive condition, most prevalent in older men of low socio-economic status. Thus, the impact of age, disease severity, gender, and socio-economic status on the ability of subjects with COPD to complete a battery of questionnaires has relevance. The present study identified how subjects experience the difficulty of completing a number of well-used as well as new questionnaires. The number of questionnaires was high, however, in clinical research it may happen that more than two questionnaires are included.
Compliance by subjects in this study was very high (only one subject failed to complete all questionnaires), probably due to careful and detailed counselling of subjects. Other studies have reported considerably poorer compliance, with illiteracy, visual impairment, poor physical and mental condition, and refusal cited as influencing factors [19].
Subjects consistently found the HS-COPD questionnaire more difficult to complete than the other questionnaires. Reasons for this may be the complexity of the questionnaire or subject fatigue. HS-COPD was the last of five questionnaires completed by the subjects. In retrospect, the order of the questionnaires should maybe have been given in a randomized order to prevent a possible tiredness when completing the last questionnaire. However, in the present study we chose the same order to all subjects. One reason for doing so was that the common use of questionnaires in clinical research is in the same order. Otherwise the results of the assessments may differ. However, with the aim of this study, a randomized order would have been recommended.
The HS-COPD utility measure is still under development and may need some refinement before it can be administered and completed with ease in future clinical studies (personal communication, Gordon Guyatt).
The majority of the subjects taking part in this study was considered by the study nurse to have a good understanding of the questionnaires, and was able to complete them quickly and without difficulty. Despite this, certain issues did become apparent. Age appeared to correlate with the degree of difficulty experienced by subjects to complete these outcomes measures. The increasing incidence of concomitant diseases in the elderly with increasing age may influence their reading, writing, or cognitive abilities, and may explain the correlation. Disease severity probably also affects the ease of completing the outcomes instruments and this may be related to the subject's physical condition.
Gender differences identified in this study could not easily be explained, however, a statistically significant difference was only noticed for one questionnaire, the EQ-5D. Unlike previous studies, no statistically significant differences between socio-economic groups were observed [20]. In Sweden, the great majority of the population has quite good reading skills.
Health-related quality of life, utility and productivity outcome instruments have an important role to play in the assessment of the general well-being of subjects with COPD. The ease with which these questionnaires can be understood and completed is pertinent to issues of compliance and therefore of accuracy in assessing the impact of this progressive, chronic disease. The importance of completing questionnaires in a reasonably short time should be highlighted. The burden of the subjects, as well as the burden of the clinic, can be high if a subject should need more than one hour to complete questionnaires. In the present study, the large majority of the subjects with COPD succeeded to complete the questionnaires during a relatively short time: 95% needed 26–52 minutes totally for all 5 questionnaires.
In conclusion, the correlation of age with difficulty in completing questionnaires needs to be a consideration when using such measures in clinical studies of COPD. Disease severity may also affect the ease of completion. Further research in a large population is needed to have confidence of the collected data on subjects' ease of completion of outcomes instruments.
Contributor Information
Elisabeth Ståhl, Email: elisabeth.stahl@astrazeneca.com.
Sven-Arne Jansson, Email: sven-arne.jansson@trasnidaren.nu.
Ann-Christin Jonsson, Email: ann-christin.jonsson@nll.se.
Klas Svensson, Email: klas.svensson@astrazeneca.com.
Bo Lundbäck, Email: bo.lundback@telia.com.
Fredrik Andersson, Email: fredrik.l.andersson@astrazeneca.com.
References
- Vollmer WM, Osborne ML, Buist AS. 20-year trends in the prevalence of asthma and chronic airflow obstruction in an HMO. Am J Respir Crit Care Med. 1998;157:1079–1084. doi: 10.1164/ajrccm.157.4.9704140. [DOI] [PubMed] [Google Scholar]
- WHO The World Health Report, 1998. Life in the 21st century: A vision for all. WHO The World Health Report. 1998.
- WHO The World Health Report 1997 – conquering suffering, enriching humanity. World Health Forum. 1997;18:248–260. [PubMed] [Google Scholar]
- CPMP CfPMP Points to consider on clinical investigation of medicinal products in the chronic treatment of patients with chronic obstructive pulmonary disease (COPD) London: EMEA, The European Agency for the Evaluation of Medicinal Products. 1999. pp. 1–3.
- Ware JE, Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30:473–483. [PubMed] [Google Scholar]
- Jones PW, Quirk FH, Baveystock CM. The St George's Respiratory Questionnaire. Respir Med. 1991;85:25–31. doi: 10.1016/s0954-6111(06)80166-6. [DOI] [PubMed] [Google Scholar]
- Torrance GW. Utility approach to measuring health-related quality of life. J Chronic Dis. 1987;40:593–600. doi: 10.1016/0021-9681(87)90019-1. [DOI] [PubMed] [Google Scholar]
- Weinstein MC, Siegel JE, Gold MR, Kamlet MS, Russell LB. Recommendations of the panel on cost-effectiveness in health and medicine. JAMA. 1996;276:1253–1258. doi: 10.1001/jama.276.15.1253. [DOI] [PubMed] [Google Scholar]
- Bennett KJ, Torrance GW. Measuring health state preferences and utilities: rating scale, time trade-off, and standard gamble techniques. In: Spilker B, editor. Quality of Life and Pharmacoeconomics in Clinical Trials. 2. Philadelphia: Lippincott-Raven Publishers; 1996. pp. 253–265. [Google Scholar]
- Kind P. Chapter 22. The EuroQoL instrument: an index of health-related quality of life. In: Spilker B, editor. Quality of Life and Pharmacoeconomics in Clinical Trials. 2. Philadelphia: Lippincott-Raven Publishers; 1996. pp. 191–201. [Google Scholar]
- Reilly MC, Tanner A, Meltzer EO. Work, classroom and activity impairment instruments. Validation studies in allergic rhinitis. Clin Drug Invest. 1996;11:278–288. [Google Scholar]
- Wahlqvist P, Carlsson J, Stalhammar N-O, Wiklund I. Measuring lost productivity in patients with GORD using a productivity questionnaire (WPAI-GORD) Qual Life Res. 1999;8:576s. [Google Scholar]
- Nekolaichuk CL, Bruera E, Spachynski K, MacEachern T, Hanson J, Maguire TO. A comparison of patient and proxy symptom assessments in advanced cancer patients. Palliat Med. 1999;13:311–323. doi: 10.1191/026921699675854885. [DOI] [PubMed] [Google Scholar]
- Fossa SD, Aaronson NK, Newling D, Van Cangh PJ, Denis L, Kurth KH, De Pauw M. Quality of life and treatment of hormone resistant metastatic prostatic cancer. Eur J Cancer. 1990;26:1133–1136. doi: 10.1016/0277-5379(90)90269-y. [DOI] [PubMed] [Google Scholar]
- Jansson SA, Andersson F, Borg S, Ericsson A, Jonsson E, Lundback B. Costs of COPD in Sweden According to Disease Severity. Chest. 2002;122:1994–2002. doi: 10.1378/chest.122.6.1994. [DOI] [PubMed] [Google Scholar]
- Andersson F, Borg S, Jansson SA, Jonsson AC, Ericsson A, Prutz C, Ronmark E, Lundback B. The costs of exacerbations in chronic obstructive pulmonary disease (COPD) Respir Med. 2002;96:700–708. doi: 10.1053/rmed.2002.1334. [DOI] [PubMed] [Google Scholar]
- Anonymous BTS guidelines for the management of chronic obstructive pulmonary disease. The COPD Guidelines Group of the Standards of Care Committee of the BTS. Thorax. 1997;52:S1–28. [PMC free article] [PubMed] [Google Scholar]
- Pauwels RA, Buist AS, Ma P, Jenkins CR, Hurd SS, Committee GS. Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: National Heart, Lung, and Blood Institute and World Health Organization Global Initiative for Chronic Obstructive Lung Disease (GOLD): executive summary. Respir Care. 2001;46:798–825. [PubMed] [Google Scholar]
- Anonymous Patient compliance with quality of life questionnaires. Italian Group for Evaluation of Outcomes in Oncology (I.G.E.O.) Tumori. 1997;85:92–95. [PubMed] [Google Scholar]
- de Silva N, Samarasinghe D. Acceptance of a psychiatric screening questionnaire by general practice attenders. Ceylon Med J. 1990;35:105–108. [PubMed] [Google Scholar]