An experiment is a question which science poses to Nature, and a measurement is the recording of Nature’s answer.—Max Planck, Scientific Autobiography and Other Papers
By definition, acute exacerbations of chronic obstructive pulmonary disease (COPD) are themselves morbid clinical events. However, investigators have also found that the frequency and severity of exacerbations are associated with poor long-term outcomes in patients with COPD, including worsened lung function (1), a decline in health status (2), and mortality (3). Indeed, an important benefit associated with many approved therapies for COPD is a reduction in the frequency of exacerbations (4). Therefore, it is reasonable to expect that improved tools to quantify the frequency and grade the severity of exacerbations of COPD might improve our ability to identify patients at high risk for adverse outcomes and target them for more intensive interventions.
There is consensus on the treatment of acute exacerbations (4) with a combination of therapies including bronchodilators, systemic glucocorticoids, and antibiotics. The use of short-acting bronchodilators is a mainstay of therapy; however, there have been no randomized trials demonstrating their efficacy, in part because such trials would be difficult to design in an ethical manner. Therefore, the evidence for this recommendation was graded level C in the most recent Global Initiative for Chronic Obstructive Lung Disease (GOLD) guidelines (4). Systemic glucocorticoids have been demonstrated in randomized clinical trials to improve lung function, reduce hypoxemia, and reduce treatment failures, and are therefore recommended with an evidence grade level A. Antibiotics are recommended at evidence level B for all patients in whom all three cardinal symptoms—cough, sputum, and dyspnea—are present, and in patients who require mechanical ventilation. If only two symptoms are present, antibiotics are recommended with evidence graded at level C. Apart from general support and addressing comorbidities, no other therapies are recommended in the GOLD guidelines. Clearly, well-designed trials of novel or existing therapies in patients with COPD exacerbations focused on both short- and long-term outcomes are needed to improve therapy for COPD. Such trials are hampered by our limited ability to measure exacerbation frequency and severity. The article by Mackay and colleagues in this issue of the Journal (pp. 1218–1224) provides a new tool, the COPD Assessment Test (CAT), that may address this limitation (5).
The CAT is a self-administered questionnaire developed with rigorous psychometric techniques to generate a severity score from self-reported COPD symptoms (6, 7). Because its measurement properties were developed to allow statistical comparisons, it is well suited for use in clinical trials. Mackay and coworkers used the CAT to assess exacerbation severity in a well-characterized prospective cohort of COPD patients in London. In that cohort, they found that the CAT increased with exacerbations. More importantly, the magnitude of the CAT increase was directly related to the decline in lung function during the exacerbation, the duration of the exacerbation as determined by symptom scores, and the change in C-reactive protein (CRP). The investigators were able to show that within the group of patients with moderate exacerbations, event severity can be further quantified and related to clinical endpoints. Importantly, event severity was not related to baseline comorbidity, suggesting that the CAT measures the severity of the event, not baseline severity of disease.
The CAT provides an important advance over the most common current method to assess COPD severity using health care utilization (8). According to these criteria, a self-managed event is mild, an outpatient-managed event is moderate, and an event requiring hospitalization is severe. While this measure has important advantages, it is confounded by baseline health care status—individuals with very severe disease are much more likely to be hospitalized. The CAT appears to overcome this limitation; however, all the subjects included in the Mackay study would be classified according to these criteria as having “moderate” exacerbations. How the CAT will perform for patients who would be “mild” and “severe” according to the health care utilization criteria is an important, yet unanswered question.
There are limitations to these relationships that will attract the attention of many “naysayers.” The CAT is a single number, which collapses several distinct measures of disease activity into a single variable. The CAT, therefore, does not reflect the heterogeneity of COPD, only its severity. In addition, the relationships with lung function (r = 0.20) and with CRP (r = 0.26) are weak and the relationship with exacerbation duration is a bit circular, because the CAT is largely based on symptoms, which were used to define duration. Furthermore, the London cohort completed diary cards daily. Although all events were assessed and confirmed by study staff, data from these diary cards were used to define exacerbation events. It is therefore impossible to exclude the possibility that the diary cards cued the subjects to seek health care.
It is important to recognize that the CAT was not evaluated as a diagnostic test for a COPD exacerbation in the Mackay article. In fact, several of the subjects had a decline in their CAT score with exacerbation, and several more had no change. These would represent “false negatives” if CAT were used diagnostically to define events. Similarly, it is not known what changes occur in the CAT when there is no exacerbation. Thus, a false-positive rate cannot be estimated. Similarly, it is not known how other acute conditions with symptoms similar to COPD exacerbations, for example, congestive heart failure, might reduce the specificity of the CAT.
Finally, there may be better tests than the CAT to assess COPD exacerbation severity. The EXAcerbations of Chronic Obstructive Pulmonary Disease Tool (EXACT) was developed with rigorous psychometric methods specifically to define events permitting rigorous assessment of COPD exacerbations (9–11). It has measurement characteristics that make it suitable as a gauge of severity. EXACT requires repeated measures over a period of time to establish both baseline status and exacerbation events, which may complicate its use for some clinical investigators. EXACT is currently under review with the United States Food and Drug Administration (FDA) and European Medicines Agency to determine if it will be qualified for the assessment of exacerbations for use in drug development. If approved, it will provide a measure that drug developers can use with confidence. The CAT is not currently being reviewed in this capacity. Whether the CAT will be accepted for this purpose will depend on the acquisition of a robust dataset that demonstrates its utility and a sponsor willing to prepare a dossier for FDA review. Finally, how these patient-reported outcomes will compare with biochemical measures that increase with exacerbation as gauges of severity remains to be determined (12).
So, with these limitations, why is the Mackay article so important? It is because it gives us another tool that can be easily applied by the clinical investigator to measure the severity of COPD exacerbations. This methodology provides a means to address crucial clinical questions such as the following: Is the impact of exacerbation on FEV1 decline, subsequent mortality, or impact on health status related to event severity? Do treatments reduce severity of exacerbations in addition to reducing their frequency? Does reduction in exacerbation severity have an impact on disease progression? These questions are of paramount importance to clinicians and patients alike and absolutely require an adequate tool to measure exacerbation severity. The demonstration that this is possible promises an explosion of understanding of COPD exacerbations.
Footnotes
Author Contributions: S.I.R. is the primary author of this editorial. K.L.B. contributed critical analysis and secondary authorship.
References
- 1.Donaldson GC, Seemungal TA, Bhowmik A, Wedzicha JA. Relationship between exacerbation frequency and lung function decline in chronic obstructive pulmonary disease. Thorax 2002;57:847–852. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Spencer S, Calverley PM, Burge PS, Jones PW. Impact of preventing exacerbations on deterioration of health status in COPD. Eur Respir J 2004;23:698–702. [DOI] [PubMed] [Google Scholar]
- 3.Soler-Cataluña JJ, Martínez-García MA, Román Sánchez P, Salcedo E, Navarro M, Ochando R. Severe acute exacerbations and mortality in patients with chronic obstructive pulmonary disease. Thorax 2005;60:925–931. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Global Initiative for Chronic Obstructive Lung Disease (GOLD). Global strategy for diagnosis, management and prevention of COPD [Internet]. c2011 [accessed 2012 Mar 26]. Available from: http://www.goldcopd.org/
- 5.Mackay AJ, Donaldson GC, Patel ARC, Jones PW, Hurst JR, Wedzicha JA. Usefulness of the Chronic Obstructive Pulmonary Disease Assessment Test to evaluate severity of chronic obstructive pulmonary disease exacerbations. Am J Respir Crit Care Med 2012;185:1218–1224. [DOI] [PubMed] [Google Scholar]
- 6.Jones PW, Harding G, Berry P, Wiklund I, Chen WH, Kline Leidy N. Development and first validation of the COPD Assessment Test. Eur Respir J 2009;34:648–654. [DOI] [PubMed] [Google Scholar]
- 7.Dodd JW, Hogg L, Nolan J, Jeffor H, Grant A, Lord VM, Falzon C, Garrod R, Lee C, Polkey MI, et al. . The COPD assessment test (CAT): response to pulmonary rehabilitation. A multicentre, prospective study. Thorax 2011;66:425–429. [DOI] [PubMed] [Google Scholar]
- 8.Rodriguez-Roisin R. Toward a consensus definition for COPD exacerbations. Chest 2000;117:398S–401S. [DOI] [PubMed] [Google Scholar]
- 9.Jones PW, Chen WH, Wilcox TK, Sethi S, Leidy NK. Characterizing and quantifying the symptomatic features of COPD exacerbations. Chest 2011;139:1388–1394. [DOI] [PubMed] [Google Scholar]
- 10.Leidy NK, Wilcox TK, Jones PW, Murray L, Winnette R, Howard K, Petrillo J, Powers J, Sethi S. Development of the EXAcerbations of Chronic Obstructive Pulmonary Disease Tool (EXACT): a patient-reported outcome (PRO) measure. Value Health 2010;13:965–975. [DOI] [PubMed] [Google Scholar]
- 11.Leidy NK, Wilcox TK, Jones PW, Roberts L, Powers JH, Sethi S. Standardizing measurement of chronic obstructive pulmonary disease exacerbations: reliability and validity of a patient-reported diary. Am J Respir Crit Care Med 2011;183:323–329. [DOI] [PubMed] [Google Scholar]
- 12.Sethi S, Wrona C, Eschberger K, Lobbins P, Cai X, Murphy TF. Inflammatory profile of new bacterial strain exacerbations of chronic obstructive pulmonary disease. Am J Respir Crit Care Med 2008;177:491–497. [DOI] [PubMed] [Google Scholar]