Abstract
Background: Randomized controlled trials (RCTs) often recruit patients from low and high socioeconomic status (SES) countries, but little is known about the effect of SES on clinical outcomes, particularly patient-centered measures of symptomatic benefit.
Methods: Combined individual chronic obstructive pulmonary disease (COPD) patient data from the placebo and long-acting bronchodilator arms of 17 RCTs (from the COPD Biomarkers Qualification Consortium database) were analyzed. Health status was measured using the St George’s Respiratory Questionnaire (SGRQ) (minimum clinically important difference [MCID]: 4 units). Trials were grouped into short-term (≤12 months) and medium-term (>12 months to 48 months). A participant’s country of residence was categorized into Low/Medium or High SES using World Health Organization criteria.
Results: Data from 19765 individuals (6109 Low/Medium SES) were available. Patients in Low/Medium SES countries had more severe disease at baseline. Improvement in SGRQ score with placebo was ≈2 units greater in Low/Medium than in High SES countries; at its greatest, the improvement from baseline exceeded the MCID in Low/Medium countries. This difference was maintained for at least 1 year. Improvement with bronchodilator was also greater in Low/Medium versus High SES countries; overall there was no evidence that the treatment effect versus placebo was different between countries of different SES status.
Conclusions: Participants in Low/Medium SES countries experienced significantly larger treatment effects, irrespective of treatment group (placebo and bronchodilator). Despite this, COPD patients in Low/Medium SES countries experienced a health status gain from long-acting bronchodilator treatment that is similar to that seen in High SES countries.
Keywords: copd, chronic obstructive pulmonary disease, SGRQ, health status, St George’s Respiratory Questionnaire, socioeconomic status
Introduction
Many clinical trials in chronic obstructive pulmonary disease (COPD) are conducted globally, recruiting patients from multiple countries and representing varied populations, including those with both lower and higher socioeconomic status (SES).1,2 Patients with lower SES have poorer outcomes that is multi-factorial in origin, but is likely to include less access to health care.3 In countries with lower SES, patients entering a clinical trial may move into a system of health care similar to that found in highly developed countries. Increasing numbers of trials are now being performed solely in countries with developing economies, in which recruited patients may be naïve to the class of drug being tested.4 These factors could all impact the measured response to treatment.
Health status instruments such as the St George’s Respiratory Questionnaire (SGRQ)5 are often used to quantify the overall benefit of treatment by providing a standardized measure of the impact of disease on patients’ wellbeing and daily activities.6,7 It can be used across patient groups and was designed to provide a score that is not influenced by the mode of therapeutic action, thereby permitting comparisons of treatment effect across populations and modalities.7 When used together with its minimum clinically important difference (MCID), its scores can provide an indication of whether the treatment effect is worthwhile.8,9 In clinical trials, changes are often seen in the placebo arm across a range of outcomes, particularly those that measure symptoms and health status10,11 The responsible mechanisms are not well understood, but are likely to include better care and a Hawthorne effect,12 in which the patient’s (and perhaps their health care provider’s) behavior changes due to the fact that they are being observed. Such changes could include: better compliance with, and use of, trial-permitted concomitant therapy, earlier treatment of acute episodes, and adoption of a healthier life style including smoking cessation.
The effects due to trial participation, coupled with the possible influences of SES on health outcomes, raise important questions for the interpretation of clinical trial results from countries of differing SES. For example: Do patients recruited from low SES countries experience the same benefit as those in wealthier countries? Does the clinical trial effect differ between countries of high and low SES? Is the size of the measured treatment effect influenced by SES? Can therapeutic data from countries of differing SES be combined to produce a meaningful dataset?
To address these questions in COPD - a common, chronic and worldwide condition13 - we carried out a pooled analysis using individual patient clinical trial data from a newly created comprehensive database using the SGRQ as the outcome measure.5 The SGRQ is particularly suitable for this type of analysis since it is very widely used and available in many linguistically and culturally validated translations.
Methods
Identification of Clinical Trials
Studies where SGRQ was included as an outcome were identified in the COPD Biomarkers Qualification Consortium (CBQC) database of clinical trials in COPD.14 Twenty-one studies were identified with SGRQ scores measured at baseline and during follow-up in each trial arm: 18 randomized controlled trials (RCTs) and 3 observational studies. For the current analysis, RCTs that included an intervention arm with long-acting bronchodilators only (long-acting beta2-agonists and long-acting anti-muscarinic agents) or placebo were evaluated (N=17). The observational studies were not incorporated in this analysis, nor were other treatment arms. Details of the RCTs included in the analysis are described elsewhere.15 All participants in these trials who had a baseline SGRQ score were included in these analyses.
The 17 RCTs were grouped by study duration, categorized as short-term (≤1-year duration) comprising 14 trials with 10802 COPD patients (placebo=3670; bronchodilator=7132), and medium-term (2-4 years in duration) comprising 3 trials with 8963 patients (placebo=4184; bronchodilator=4779). Comparable numbers of study participants are included in each category. The 2 groups of trials were analyzed separately to test for consistency of findings across studies of different duration. The World Health Organization (WHO) socioeconomic grading system was used to group countries into High and Low/Medium SES (the latter 2 combined to achieve a similar balance of patient numbers between groups).16
Outcome Measures
The main outcome of interest was SGRQ total score. A range of other demographic and disease-related measures were available, including forced expiratory volume in 1 second (FEV1), modified Medical Research Council (mMRC) dyspnea score and history of COPD exacerbations.
Statistical Analysis
For each of the short-term and medium-term analysis samples used in the current analysis, demographic characteristics are presented as mean and standard deviation (SD). Analysis of covariance (ANCOVA) models were conducted with treatment, SES status, and treatment x SES status as independent variables, and change from baseline in SGRQ score as the dependent variable to evaluate the impact of SES status on SGRQ. Sex, body mass index (BMI), year of study, smoking status (current versus past), Global initiative for chronic Obstructive Lung Disease (GOLD) FEV1 grade,13 and baseline SGRQ score were included as covariates. Separate models were conducted for different time points. In the short-term dataset, models were conducted with change from baseline to 1, 3, 6 and 12 months. In the medium-term dataset, models were conducted with change from baseline to 6, 12, 24, and 36 months. Scheffe tests were used for post-hoc comparisons.
Results
Baseline Characteristics
The baseline demographics of the patients were similar between SES groups, although in Low/Medium SES countries the proportion of males was higher and the patients were slightly younger (by approximately 2 years) (Tables 1 and 2). In the short-term trials, patients in Low/Medium SES countries had more severe disease as shown by FEV1, SGRQ score, mMRC dyspnea score, COPD exacerbation rate and hospitalizations due to exacerbation; although generally the differences were not clinically important (Table 1). The 2.0 unit difference in mean SGRQ total score between groups at baseline shows that, on average, the health status of patients from Low/Medium SES countries was worse than in those from High SES countries at entry to the study, but the difference did not reach the MCID.
A similar pattern was observed in the medium-term trials, with the exception that the mean difference in SGRQ was 3.5, showing that at study entry, patients from Low/Medium SES countries had health status that was clearly worse than that of participants from High SES countries (Table 2). There was no difference in FEV1 between the SES groups in the medium-term trials, but patients from Low/Medium SES countries reported worse dyspnea grades, more exacerbations and more hospitalizations due to an exacerbation.
Patient Withdrawal Rates
The withdrawal rate in Low/Medium SES countries was almost half that seen in High SES countries. In short-term trials the dropout rates (placebo and bronchodilator combined) were: Low/Medium SES 20% (496/2476); High SES 37% (1828/4927). In the medium-term trials the dropout rates were similar to those seen in the short-term trials: Low/Medium SES 18% (363/2040); High SES 34% (2312/6823).
Response to Placebo
A significant improvement in mean SGRQ score was seen with placebo in Low/Medium and High SES countries in both short-term and medium-term trials (Figures 1A & 2A). The pattern was different between short- and medium-term trials. In the short-term trials (Figure 1A), the improvement developed progressively to be maximal at 3-6 months; it exceeded the 4-unit MCID in countries with Low/Medium SES. The greater response in Low/Medium SES countries was statistically significant, even at 1 month and at 3-6 months it was over 2 units more than that seen in the High SES countries. The wide and overlapping 95% confidence intervals at 12 months was associated with a much smaller number of patients which precludes any firm inferences being drawn at this time point.
In the medium-term trials (Figure 2A), the improvement was similar in both groups of patients and around 2 units. This effect was maintained for 12 months, but was gone by 36 months in both groups. It is noteworthy that a similar pattern can been seen at 6 and 12 months in both groups of studies. During that interval, there is a trend for the patients in the High SES group to worsen, but for the improvement to be maintained up to 12 months in the Low-Medium SES group
Treatment Response to Long-acting Bronchodilator
There was a significant main effect for treatment in each of the ANCOVA models for the short-term and medium-term studies (all p values <0.001), with greater improvement in SGRQ over time in bronchodilator relative to placebo. In the short-term trials (Figure 1B), there was a significant improvement from baseline, which either attained (High SES) or well-exceeded (Low/Medium SES) the 4-unit MCID, and in both groups of patients this benefit was maintained for 12 months. The difference in response to bronchodilator between groups increased up to 6 months and was statistically significant at all time points. At 6 and 12 months, the difference was over 3 units. There was a similar pattern of sustained difference over 3 years (Figure 2B), but it was smaller (≈1.5 units) and only statistically significant at 6 and 12 months (Table 3).
Treatment x Socioeconomic Response
The interaction between treatment versus placebo and SES group was not significant in the majority of the analyses, with 1 exception. In the medium-term dataset when evaluating change from baseline to 36 months the difference between bronchodilator and placebo was significantly greater in the Low/Medium SES patients (Table 3). This may be related to the fact that patients in the Low SES group receiving placebo initially experienced a greater improvement relative to those in the High SES group, but by month 36 they experienced a greater deterioration relative to patients in High SES groups (Figures 2A & B).
Discussion
This is the first major analysis of the effect of socioeconomic status on health status in response to treatment for COPD. It shows that individuals from both High and Low/Medium SES countries experience an improvement in health status on entering a clinical trial, even if they receive placebo. This effect is larger and appears to be sustained for longer in study participants from Low/Medium SES countries, although it is lost after 2 years. With long-acting bronchodilator treatment there is an improvement from baseline that almost reaches (High SES) or exceeds (Low-Medium SES) the 4 unit SGRQ MCID, thereafter the improvement in the High SES patients is relatively small (< 1 unit), but in Low-Medium SES patients it appears to be larger (>2 units).
The greater improvement in Low-Medium SES patients is maintained for 3 years; however, there appears to be no difference in treatment response compared to placebo, since the larger clinical trial effect with placebo is matched by a larger active treatment effect. The only possible exception to this is at 36 months and is due to the greater worsening in placebo treated patients in the Low-Medium SES group. It is known that SGRQ deteriorates over time and the apparently greater worsening in Low-Medium SES patients may be a function of the lower withdrawal rate in this group, since it is known that patients with worse SGRQ scores are more likely to withdraw early from a trial.17 Overall, these results suggest that data from patients in countries of different SES status may be combined and that results from one country should be generalizable to countries of different SES status.
At baseline, study participants in Low/Medium SES countries had slightly more severe COPD across a range of measures, including SGRQ score, but the differences were small and largely consistent between short- and medium-term studies. Previously, we have shown that demographic factors other than SES have a very small effect on SGRQ scores.18 The mean baseline SGRQ scores in the patients analyzed here were in the range 46-48 units, which is in contrast to a mean score of 64.8 reported in an audit of severe COPD patients in a routine care setting in the United States.19 Whereas in an observational study in China, the baseline SGRQ score was 46.3 units20 suggesting that in both higher and lower SES countries, the more severe patients are not recruited to clinical studies.
The onset of the clinical trial effect appeared to follow a relatively consistent pattern across countries, increasing to a maximum at around 6 to 12 months. It was progressive in onset, rather than being apparent from the outset of the trial, which suggests that the benefit was acquired progressively over time, rather than as a step response to entering the study. The effect was larger and sustained for longer in poorer countries. The responsible mechanisms cannot be identified from this analysis, but a Hawthorne effect12 producing changes in health behaviors and treatment compliance on entering a trial is one possible factor. In addition, a patient may have an improved sense of confidence in their ability to manage their disease, since on joining the trial they gain access to free and regular health care, which they may not have experienced previously. In support of this conclusion is the demonstration that more intensive monitoring during a randomized trial was associated with a better outcome compared to that seen in patients who received the same pharmacological treatment, but less intensive monitoring.21
This analysis used individual participant data, rather than a meta-analysis of reported study results, but it does have limitations. All the trials were randomized and double blind, so the treatment arms will have been well-matched at an individual trial level, but differing trial durations and different dropout rates would have led to the treatment groups becoming less well matched over time. However, it is noteworthy that the overall pattern of results was very similar in trials of quite different duration. The assessment time-points differed between trials, so not all patients were assessed at each time point, however; the large sample sizes appear to have minimized this effect at a group level, since the time trends showed quite smooth curves across the assessment points. Another limitation is our use of the World Health Organization classification for determining a country’s health care system, since the proportion of gross domestic product spent on health varies a great deal between countries. More importantly, it treats each patient as having the same SES status. Within all countries there is a wide variation in income and the effect of this on health may be increasing since a widening mortality gap was shown in Canada between 1996/7 and 2012/3 in COPD patients with low SES compared to those who were more affluent.22 Despite this limitation, we have shown, in 2 separate analyses in a large number of individuals, that the pattern in the results appeared remarkably consistent.
These findings have implications for those involved in performing and evaluating clinical trials. Any influence of SES on the size of treatment effect compared with placebo appears to be relatively small. The inclusion of patients from Low/Medium SES countries into multi-national trials with patients from High SES countries should not greatly influence the size of effect compared to a study that recruited patients solely from High SES countries. This conclusion is supported by an analysis of one of the primary trials included here, which showed that world region did not influence the size of treatment effect on SGRQ.23 The current analysis also shows that there may be an advantage to the recruitment of patients from Low/Medium SES countries, since they have lower withdrawal rates, which would reduce the effect of an important uncontrolled bias in the trials.
Finally, this analysis shows that in a chronic disease, such as COPD, a patient’s health may be improved by a substantial amount just through regular clinical review without additional treatment, whether in a higher or lower income country. There is a broader message here for all health care systems
Abbreviations
randomized controlled trials, RCTs; socioeconomic status, SES; chronic obstructive pulmonary disease, COPD; St George’s Respiratory Questionnaire, SGRQ; minimum clinically important difference, MCID; COPD Biomarkers Qualification Consortuim, CBQC; forced expiratory volume in 1 second, FEV1; modified Medical Research Council, mMRC; standard deviation, SD; analysis of covariance, ANCOVA; body mass index, BMI; Global initiative for chronic Obstructive Lung Disease, GOLD
Funding Statement
Funding for this COPD Biomarkers Qualification Consortium working group was provided by AstraZeneca, Boehringer-Ingelheim, GlaxoSmithKline, Novartis and Pfizer.
References
- 1. Lang T,Siribaddana S. Clinical trials have gone global: Is this a good thing? . PLoS Med. 2012;9(6):e1001228. doi: https://doi.org/10.1371/journal.pmed.1001228 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Thiers FA,Sinskey AJ,Berndt ER. Trends in the globalization of clinical trials. Nat Rev Drug Discov. 2008;7:13-14. doi: https://doi.org/10.1038/nrd2441 [Google Scholar]
- 3. Gershon AS,Dolmage TE,Stephenson A,Jackson B. Chronic obstructive pulmonary disease and socioeconomic status: A systematic review. COPD. 2012;9(3):216-226. doi: https://doi.org/10.3109/15412555.2011.648030 [DOI] [PubMed] [Google Scholar]
- 4. Zheng J-P,Yang L,Wu YM,et al. The efficacy and safety of combination salmeterol (50 µg)/fluticasone propionate (500 µg) inhalation twice daily via Accuhaler in Chinese patients with COPD. Chest. 2007;132(6):1756-1763. doi: https://doi.org/10.1378/chest.06-3009 [DOI] [PubMed] [Google Scholar]
- 5. Jones PW,Quirk FH,Baveystock CM,Littlejohns P. A self-complete measure of health status for chronic airflow limitation: The St. George's Respiratory Questionnaire. Am Rev Respir Dis. 1992;145(6):1321-1327. doi: https://doi.org/10.1164/ajrccm/145.6.1321 [DOI] [PubMed] [Google Scholar]
- 6. Jones PW. Health status measurement in chronic obstructive pulmonary disease. Thorax. 2001;56(11): 880-887. doi: https://doi.org/10.1136/thorax.56.11.880 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Cazzola M,MacNee W,Martinez FJ,et al. (etal on behalf of the American Thoracic Society/European Respiratory Society Task Force on outcomes of COPD). Outcomes of COPD pharmacological trials: From lung function to biomarkers. Eur Respir J. 2008;31(2): 416-469. doi: https://doi.org/10.1183/09031936.00099306 [DOI] [PubMed] [Google Scholar]
- 8. Jones PW. St George's Respiratory Questionnaire: MCID. COPD. 2005;2(1):75-79. doi: https://doi.org/10.1081/COPD-200050513 [DOI] [PubMed] [Google Scholar]
- 9. Jones PW,Beeh KM,Chapman KR,Decramer M,Mahler DA,Wedzicha JA. Minimal clinically important differences in pharmacological trials. Am J Respir Crit Care Med. 2014;189(3):250-255. doi: https://doi.org/10.1164/rccm.201310-1863PP [DOI] [PubMed] [Google Scholar]
- 10. Calverley PMA,Anderson JA,Celli B,et al. Salmeterol and fluticasone propionate and survival in chronic obstructive pulmonary disease. N Engl J Med. 2007;356:775-789. doi: https://doi.org/10.1056/NEJMoa063070 [DOI] [PubMed] [Google Scholar]
- 11. Tashkin DP,Celli B,Senn S,et al. A 4-Year trial of tiotropium in chronic obstructive pulmonary disease. N Engl J Med. 2008;359:1543-1554. doi: https://doi.org/10.1056/NEJMoa0805800 [DOI] [PubMed] [Google Scholar]
- 12. McCambridge J,Witton J,Elbourne DR. Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67:267-277. doi: https://doi.org/10.1016/j.jclinepi.2013.08.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Global Initiative for Chronic Lung Disease (GOLD) Global Strategy for the Diagnosis, Management and Prevention of COPD. GOLD website. http://www.goldcopd.org Published 2016 Accessed January 2017. [Google Scholar]
- 14. Merrill DD,Rennard SI,Tal-Singer R. New biomarkers: Why are they critical to the future of COPD Research? How the COPD Biomarkers Qualification Consortium (CBQC) work will deliver results . Lung Health Prof Mag. 2013;4: 30-36. [Google Scholar]
- 15. Tabberer M,Benson VS,Gelhorn H,et al. The COPD Biomarkers Qualification Consortium database: Baseline characteristics of the St George's Respiratory Questionnaire dataset. Chronic Obstr Pulm Dis. 2017;4(2): 112-123. doi: https://doi.org/10.15326/jcopdf.4.2.2017.0128 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. World Health Organization; Global health risks: Mortality and burden of disease attributable to selected major risks. World Health Organization website. http://www.who.int/healthinfo/global_burden_disease/GlobalHealthRisks_report_full.pdf2009 Published 2009 Accessed January 2017. [Google Scholar]
- 17. Vestbo J,Anderson JA,Calverley PMA,et al. Bias due to withdrawal in long-term randomised trials in COPD: Evidence from the TORCH study . Clin Respir J. 2011;5(1):44-49. doi: https://doi.org/10.1111/j.1752-699X.2010.00198.x [DOI] [PubMed] [Google Scholar]
- 18. Jones PW,Tabberer M,Gelhorn H,et al. Demographic and disease-related determinants of St George's Respiratory Questionnaire (SGRQ) score identified using the CBQC SGRQ database. Am J Respir Crit Care Med. 2014;189: abstract 5032. [Google Scholar]
- 19. Solem CT,Sun SX,Liu S,et al. Comparison of disease-severity measures within severe and very severe COPD patients: Results from a nationally representative chart review and patient survey. Int J COPD. 2014;9(1): 991-998. doi: https://doi.org/10.2147/COPD.S66798 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Xu W,Collet J-P,Shapiro S,et al. Validation and clinical interpretation of the St George's Respiratory Questionnaire among COPD patients, China. Int J Tuberc Lung Dis. 2009;13:181-189. [PubMed] [Google Scholar]
- 21. McCarney R,Warner J,Iliffe S,van Haselen R,Griffin M,Fisher P. The Hawthorne effect: A randomised, controlled trial. BMC Med Res Methodol. 2007;7:30. doi: https://doi.org/10.1186/1471-2288-7-30 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Gershon AS,Hwee J,Victor J,Wilton AS,To T. Trends in socioeconomic status related differences in mortality among people with chronic obstructive pulmonary disease (COPD). Ann Am Thorac Soc. 2014;(11)8:1195-1202. doi: https://doi.org/10.1513/AnnalsATS.201403-094OC [DOI] [PubMed] [Google Scholar]
- 23. Jones PW,Anderson JA,Calverley PMA,et al. Health status in the TORCH study of COPD: treatment efficacy and other determinants of change. Respir Res. 2011;12:71. doi: https://doi.org/10.1186/1465-9921-12-71 [DOI] [PMC free article] [PubMed] [Google Scholar]