Abstract
Background:
To assist physicians with difficult decisions about hospital admission for patients with acute exacerbation of chronic obstructive pulmonary disease (COPD) presenting in the emergency department, we sought to identify clinical characteristics associated with serious adverse events.
Methods:
We conducted this prospective cohort study in 6 large Canadian academic emergency departments. Patients were assessed for standardized clinical variables and then followed for serious adverse events, defined as death, intubation, admission to a monitored unit or new visit to the emergency department requiring admission.
Results:
We enrolled 945 patients, of whom 354 (37.5%) were admitted to hospital. Of 74 (7.8%) patients with a subsequent serious adverse event, 36 (49%) had not been admitted after the initial emergency visit. Multivariable modelling identified 5 variables that were independently associated with adverse events: prior intubation, initial heart rate ≥ 110/minute, being too ill to do a walk test, hemoglobin < 100 g/L and urea ≥ 12 mmol/L. A preliminary risk scale incorporating these and 5 other clinical variables produced risk categories ranging from 2.2% for a score of 0 to 91.4% for a score of 10. Using a risk score of 2 or higher as a threshold for admission would capture all patients with a predicted risk of adverse events of 7.2% or higher, while only slightly increasing admission rates, from 37.5% to 43.2%.
Interpretation:
In Canada, many patients with COPD suffer a serious adverse event or death after being discharged home from the emergency department. We identified high-risk characteristics and developed a preliminary risk scale that, once validated, could be used to stratify the likelihood of poor outcomes and to enable rational and safe admission decisions.
Chronic obstructive pulmonary disease (COPD), a respiratory disorder caused largely by smoking and characterized by progressive, incompletely reversible airflow obstruction, is a leading cause of hospital admission among older people. Patients who experience frequent exacerbations of COPD are at higher risk of death.1 Return to the emergency department within 30 days because of worsening respiratory symptoms was reported for 35% of COPD patients discharged from Canadian academic emergency departments.2
An important challenge facing physicians when treating patients with COPD exacerbation is deciding who should be admitted. Many of these patients will have a response to therapy in the emergency department and will not benefit from admission to hospital. A small but important number of patients have serious adverse events after hospital admission, such as death, mechanical ventilation or myocardial infarction. Others are discharged after prolonged management in the emergency department, only to experience a serious adverse event or return later to be admitted. These outcomes are important because many jurisdictions have a shortage of hospital beds and many emergency departments are overcrowded. There is, however, little evidence about risk factors for adverse events in patients with COPD to aid with disposition decisions in the emergency department, and existing guidelines are consensus based and have not been validated.3–5
The overall goal of this study was to evaluate patients with acute exacerbation of COPD seen in the emergency department to determine the clinical characteristics associated with short-term serious adverse events. Once validated, this information should help in efforts to improve and standardize admission practices for patients with COPD seeen in the emergency department, diminishing both unnecessary admissions and unsafe discharge decisions.
Methods
Design and setting
We conducted a prospective observational cohort study in 6 Canadian teaching hospitals in Ottawa, Ontario (2 sites); Toronto, Ont.; Kingston, Ont.; Montréal, Quebec; and Edmonton, Alberta. The combined annual emergency department volume for these hospitals was about 350 000 patient visits.6
Study population
We included a convenience sample of adults 50 years of age or older who presented during weekday hours to the emergency department because of symptoms of acute shortness of breath secondary to exacerbation of COPD. Exacerbation of COPD was defined as an increase in at least 2 of 3 specified symptoms (breathlessness, sputum volume, sputum purulence) requiring an urgent visit to the emergency department for additional treatment.2 For all included patients, COPD had been diagnosed previously or was diagnosed during the index emergency department visit on the basis of 1-year history of chronic dyspnea or cough with sputum production. Patients must have had a history of 15 pack-years or more of cigarette smoking and prior or current evidence of moderate airflow obstruction.5
We excluded patients who were obviously too ill to be considered for discharge or who were otherwise unsuitable for the study because of resting oxygen saturation < 85%; heart rate ≥ 130/minute; systolic blood pressure < 85 mm Hg; confusion, disorientation or severe dementia; ischemic chest pain requiring treatment on arrival; acute ST elevation by electrocardiography on arrival; death from chronic illness expected within weeks; arrival from a nursing home or chronic care facility; or enrolment in the study within previous 2 months.
The research ethics boards of all 6 hospitals provided approval for this study. The research ethics boards of 3 of the hospitals specified that patients’ written informed consent was required, whereas those at the other 3 sites waived the need for written consent.
Data collection
The patients were assessed by trained registered respiratory therapists or registered nurses. The target assessment period was 4 to 8 hours after initial treatment, but patients could be considered for enrolment from 2 to 15 hours after treatment. A central study nurse coordinator regularly evaluated the quality of the patient assessments.
We selected the variables to be assessed in the study on the basis of our clinical experience and reports in the literature.2,7–9 We collected data from each patient’s history, general examination, laboratory tests and a standardized 3-minute walk test, during which the patient walked at his or her own pace for 3 minutes, regardless of distance.10–13 Patients could use their normal walking aids but could not be supported by another person. During this test, patients used no supplementary oxygen or used their usual home oxygen flow level. The same model of recording pulse oximeter (Criticare 504DXP) was used at all sites to record heart rate and oxygen saturation levels.
Outcome measures
The primary outcome was a serious adverse event, defined as either death from any cause within 30 days of the index emergency department visit or any of the following events within 14 days of the index emergency department visit, regardless of whether the patient was initially admitted: admission to a monitored unit, excluding monitoring by telemetry; endotracheal intubation or need for noninvasive ventilation after hospital admission, unless already receiving non-invasive ventilation at home; myocardial infarction, as defined by international consensus standards;14 major procedure (coronary artery bypass graft, percutaneous coronary intervention, other cardiac surgery or new hemodialysis); or, for patients who were discharged after the initial visit, return to the emergency department for any related medical problem within 14 days followed by admission to hospital (return to the emergency department without associated admission was not considered an adverse event). We used hospital records and provincial death records to assess the primary outcome measure, with blinding as to patient status for the predictor variables.
Data analyses
We used appropriate univariable analyses to assess associations between the primary outcome (a serious adverse event) and clinical variables. We categorized continuous variables using the most discriminative cut points. We conducted logistic regression with stepwise selection for those variables found to be associated with serious adverse events on univariable analysis (p < 0.05), as well as for clinically sensible interaction terms. We conducted the analyses by visit rather than by individual patient. Using accepted approaches, we created a risk scale by rounding up the lowest logistic regression β coefficient to 1, which then served as the lowest common denominator for assigning point values to the score items.15 We assessed the classification performance of the risk score by internal validation using the bootstrap method,16,17 whereby we drew 1000 resamples with replacement from the original sample. We applied the COPD risk scale and calculated the classification performance measures (sensitivity, specificity, positive likelihood ratio and negative likelihood ratio) for each of the 1000 replicate samples. We evaluated the optimism of the bootstrap samples by comparing the averages of performance measures taken over 1000 replicates and the performance measures calculated in the original sample.
Results
Study sample
Of 1993 patient visits between September 2007 and April 2010, 945 met the inclusion criteria and were included in the analysis (Table 1). The other 1048 visits were excluded primarily because the patients presented when research staff were not available. The characteristics of excluded patient visits were similar (Appendix 1, available at www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.130968/-/DC1). Among the enrolled patients, there were 74 (7.8%) serious adverse events. Of concern, 36 (49%) of these occurred in the 591 patients who were not admitted at the time of the initial visit (Table 2). In addition, 2 (22%) of the 9 deaths occurred within 30 days among patients initially discharged home from the emergency department.
Table 1:
Characteristics of patients with exacerbation of chronic obstructive pulmonary disease seen in the emergency department
| Characteristic | No. (%) of patients* n = 945 |
|---|---|
| Age, yr, mean ± SD | 72.6 ± 10.7 |
| Range | 49–99 |
| Sex, male | 488 (51.6) |
| Hospital site | |
| Kingston General | 218 (23.1) |
| Ottawa Hospital – Civic Campus | 255 (27.0) |
| Ottawa Hospital – General Campus | 256 (27.1) |
| University of Alberta (Edmonton) | 110 (11.6) |
| Mount Sinai (Toronto) | 85 (9.0) |
| Jewish General (Montréal) | 21 (2.2) |
| Arrival status | |
| Arrival by ambulance | 456 (48.3) |
| Temperature, °C, mean ± SD | 36.6 ± 0.9 |
| Heart rate, per minute, mean ± SD | 93.0 ± 19.5 |
| Respiratory rate, per minute, mean ± SD | 23.6 ± 5.9 |
| Systolic blood pressure, mm Hg, mean ± SD | 140.9 ± 25.6 |
| Sao2 by oximetry,† %, mean ± SD | 93.3 ± 5.5 |
| Duration of respiratory distress, h, mean ± SD | 87.0 ± 114.4 |
| Canadian Triage Acuity Scale score,‡ median (IQR) | 3 (2–4) |
| Secondary diagnosis of heart failure in emergency department | 96 (10.2) |
| Medical history | n = 943 |
| Heart failure | 199 (21.1) |
| Admission for respiratory distress | 268 (28.4) |
| Intubation for respiratory distress | 27 (2.9) |
| Myocardial infarction or angina | 254 (26.9) |
| Coronary bypass graft surgery or percutaneous coronary intervention | 103 (10.9) |
| Pacemaker | 43 (4.6) |
| Atrial fibrillation | 146 (15.5) |
| Peripheral vascular disease intervention | 36 (3.8) |
| Cancer | 137 (14.5) |
| Hypertension | 423 (44.9) |
| Stroke or transient ischemic attack | 81 (8.6) |
| Diabetes mellitus | 186 (19.7) |
| Chronic liver disease | 3 (0.3) |
| Mild dementia | 13 (1.4) |
| Chronic renal failure | 53 (5.6) |
| Smoker | n = 792 |
| Current | 250 (31.6) |
| Former | 432 (54.5) |
| Pack-years, mean ± SD (n = 546) | 41.8 ± 28.8 |
| n = 945 | |
| Home oxygen | 118 (12.5) |
| Current cardiac medications | 691 (73.1) |
| Angiotensin-converting enzyme inhibitors | 262 (27.7) |
| Antiarrhythmics | 29 (3.1) |
| Anticoagulants | 160 (16.9) |
| Antiplatelet medications | 279 (29.5) |
| β-Blockers | 259 (27.4) |
| Calcium channel blockers | 201 (21.3) |
| Digoxin | 63 (6.7) |
| Diuretics | 337 (35.7) |
| Nitrates | 136 (14.4) |
| Statins | 323 (34.2) |
| Vasodilators | 13 (1.4) |
| Current respiratory medications | 847 (89.6) |
| Antibiotics | 190 (20.1) |
| Inhaled anticholinergics | 580 (61.4) |
| Inhaled β-agonists | 684 (72.4) |
| Inhaled steroids | 564 (59.7) |
| Oral steroids | 151 (16.0) |
| Theophylline | 31 (3.3) |
Note: IQR = interquartile range, Sao2 = arterial saturation of oxygen, SD = standard deviation.
Except where indicated otherwise.
Arterial saturation of oxygen by oximetry was measured on room air for ambulatory patients and on oxygen for patients who arrived by ambulance.
Canadian Triage Acuity Scale ranges from 1 (most urgent) to 5 (least urgent).
Table 2:
Outcomes for patients with exacerbation of chronic obstructive pulmonary disease seen in the emergency department
| Characteristic | No. (%) of patients n = 945 |
|---|---|
| Emergency department disposition | |
| Admitted to hospital | 354 (37.5) |
| Discharged from emergency department | 591 (62.5) |
| Serious adverse events | 74 (7.8) |
| Admitted patients (n = 354) | 38 (10.7) |
| Discharged patients (n = 591) | 36 (6.1) |
| Details of serious adverse events | |
| For admitted patients | n = 354 |
| Critical care or other monitored unit | 23 (6.5) |
| Noninvasive ventilation required after admission | 15 (4.2) |
| Intubation required after admission | 6 (1.7) |
| Myocardial infarction after admission | 4 (1.1) |
| Death after admission | 7 (2.0) |
| For patients discharged from emergency department | n = 591 |
| Return to emergency department and admitted to hospital within 14 d | 34 (5.8) |
| Death within 30 d | 2 (0.3) |
| Return to emergency department within 14 d, whether admitted or not | 94 (15.9) |
| Reason for return visit* | n = 94 |
| Dyspnea | 72 (76.6) |
| Fever | 2 (2.1) |
| Sepsis | 2 (2.1) |
| Chest pain | 9 (9.6) |
| Ambulation problems | 3 (3.2) |
| Other | 19 (20.2) |
For any patient, there could be more than one reason for return.
Univariable and multivariable data analyses
Tables 3 and 4 show the association between a serious adverse event and variables from the history, physical examination and laboratory investigations. Some continuous variables were further categorized using cut points (Table 5).
Table 3:
Univariable correlation with serious adverse events for variables from history for 945 patients with chronic obstructive pulmonary disease
| Characteristic* | Status for serious adverse event; no. (%) of patients† | p value | |
|---|---|---|---|
| Yes n = 74 |
No n = 871 |
||
| Age, yr, mean ± SD | 73.4 ± 9.9 | 72.6 ± 10.8 | 0.5 |
| Sex, male | 38 (51.4) | 450 (51.7) | > 0.9 |
| Arrival by ambulance (n = 73 and 871) | 39 (53.4) | 417 (47.9) | 0.4 |
| Medical history | |||
| Admission for respiratory distress | 29 (39.2) | 239 (27.4) | 0.03 |
| Intubation for respiratory distress | 6 (8.1) | 21 (2.4) | 0.005 |
| Heart failure | 29 (39.2) | 170 (19.5) | < 0.001 |
| Myocardial infarction | 13 (17.6) | 136 (15.6) | 0.7 |
| Angina | 9 (12.2) | 96 (11.0) | 0.8 |
| Coronary bypass graft surgery | 10 (13.5) | 58 (6.7) | 0.03 |
| Percutaneous coronary intervention | 2 (2.7) | 33 (3.8) | 0.6 |
| Pacemaker | 4 (5.4) | 39 (4.5) | 0.7 |
| Atrial fibrillation | 15 (20.3) | 131 (15.0) | 0.2 |
| Peripheral vascular disease intervention | 8 (10.8) | 28 (3.2) | 0.001 |
| Cancer | 10 (13.5) | 127 (14.6) | 0.8 |
| Hypertension | 44 (59.5) | 379 (43.5) | 0.008 |
| Stroke or transient ischemic attack | 3 (4.1) | 78 (9.0) | 0.2 |
| Diabetes mellitus | 14 (18.9) | 172 (19.7) | 0.9 |
| Chronic renal failure | 6 (8.1) | 47 (5.4) | 0.3 |
| Duration of respiratory distress, h, mean ± SD (n = 42 and 728) | 85.3 ± 82.0 | 87.2 ±116.0 | 0.9 |
| Home oxygen therapy (n = 72 and 869) | 14 (19.4) | 104 (12.0) | 0.07 |
| Smoker, pack-years, mean ± SD (n = 25 and 521) | 41.5 ± 21.9 | 41.8 ± 29.1 | > 0.9 |
| Current respiratory medications (n = 73 and 865) | 67 (91.8) | 780 (90.2) | 0.7 |
| Antibiotics (n = 73 and 864) | 14 (19.2) | 176 (20.4) | 0.8 |
| Inhaled anticholinergics (n = 73 and 864) | 51 (69.9) | 529 (61.2) | 0.2 |
| Inhaled β-agonists (n = 73 and 864) | 56 (76.7) | 628 (72.7) | 0.5 |
| Inhaled steroids (n = 73 and 864) | 48 (65.8) | 516 (59.7) | 0.3 |
| Oral steroids (n = 73 and 864) | 10 (13.7) | 141 (16.3) | 0.6 |
| Current cardiac medications (n = 73 and 862) | 60 (82.2) | 631 (73.2) | 0.09 |
| Angiotensin-converting enzyme inhibitors (n = 73 and 859) | 23 (31.5) | 239 (27.8) | 0.5 |
| Antiarrhythmics (n = 73 and 859) | 1 (1.4) | 28 (3.3) | 0.4 |
| Anticoagulants (n = 73 and 859) | 14 (19.2) | 146 (17.0) | 0.6 |
| Antiplatelet medications (n = 73 and 858) | 28 (38.4) | 251 (29.3) | 0.1 |
| β-Blockers | 30 (40.5) | 229 (26.3) | 0.008 |
| Calcium channel blockers (n = 73 and 859) | 18 (24.7) | 183 (21.3) | 0.5 |
| Digoxin (n = 73 and 859) | 9 (12.3) | 54 (6.3) | 0.05 |
| Diuretics | 36 (48.6) | 301 (34.6) | 0.02 |
| Nitrates (n = 73 and 858) | 12 (16.4) | 124 (14.5) | 0.7 |
| Statins (n = 73 and 858) | 32 (43.8) | 291 (33.9) | 0.09 |
| Caretaker at home | 44 (59.5) | 455 (52.2) | 0.4 |
| Able to drink fluids in emergency department (n = 40 and 688) | 40 (100.0) | 673 (97.8) | > 0.9 |
Note: SD = standard deviation.
Where data were not available for all patients in both groups, n values for both groups are shown parenthetically.
Except where indicated otherwise.
Table 4:
Univariable correlation with serious adverse events for variables from physical examination and investigations for 945 patients with chronic obstructive pulmonary disease
| Characteristic* | Status for serious adverse event | p value | |
|---|---|---|---|
| Yes (n = 74) | No (n = 871) | ||
| Vital signs on arrival, mean ± SD | |||
| Temperature, °C (n = 70 and 840) | 36.5 ± 0.85 | 36.6 ± 0.85 | 0.5 |
| Heart rate, per minute (n = 73 and 869) | 96.0 ± 23.1 | 92.8 ± 19.1 | 0.3 |
| Respiratory rate, per minute (n = 74 and 816) | 24.3 ± 5.6 | 23.5 ± 5.9 | 0.2 |
| Systolic blood pressure, mm Hg (n = 74 and 863) | 138.5 ± 28.9 | 141.2 ± 25.2 | 0.4 |
| Sao2, % (n = 74 and 868) | 91.3 ± 7.2 | 93.5 ± 5.3 | 0.01 |
| CTAS score (n = 73 and 848) | 2.5 ± 0.6 | 2.7 ± 0.6 | 0.02 |
| Laboratory test results, mean ± SD | |||
| Urea, mmol/L (n = 71 and 794) | 9.8 ± 6.5 | 7.3 ± 7.5 | 0.004 |
| Creatinine, mmol/L (n = 71 and 799) | 112.0 ± 100.0 | 96.5 ± 55.9 | 0.2 |
| Serum CO2, mmol/L (n = 70 and 800) | 29.3 ± 9.6 | 27.5 ± 4.0 | 0.1 |
| Glucose, mmol/L (n = 70 and 773) | 8.2 ± 3.9 | 7.1 ± 2.5 | 0.03 |
| Arterial pCO2, mm Hg (n = 23 and 160) | 60.2 ± 26.1 | 43.6 ± 11.1 | 0.01 |
| Arterial pO2, mm Hg (n = 23 and 157) | 91.8 ± 58.4 | 75.3 ± 35.4 | 0.2 |
| Arterial pH (n = 23 and 159) | 7.4 ± 0.2 | 7.4 ± 0.1 | 0.1 |
| NT-proBNP level, ng/L (n = 12 and 95) | 3126.2 ± 5674.1 | 2446.3 ± 5327.6 | 0.7 |
| Hemoglobin, g/L (n = 70 and 812) | 122.8 ± 22.7 | 133.7 ± 17.5 | < 0.001 |
| ECG findings, no. (%) of patients† (n = 67 and 722) | |||
| Atrial fibrillation or flutter | 11 (16.4) | 90 (12.5) | 0.4 |
| Acute ischemia | 5 (7.5) | 14 (1.9) | 0.005 |
| Atrioventricular conduction disturbance | 4 (6.0) | 64 (8.9) | 0.4 |
| Intraventricular conduction disturbance | 15 (22.4) | 141 (19.5) | 0.6 |
| Old infarct | 5 (7.5) | 57 (7.9) | 0.9 |
| QRS duration, mm, mean ± SD (n = 67 and 714) | 100.2 ± 28.9 | 97.9 ± 24.7 | 0.5 |
| Chest radiographic findings, no. (%) of patients (n = 74 and 856) | 74 (100.0) | 841 (98.2) | 0.3 |
| Pulmonary congestion | 19 (25.7) | 78 (9.1) | < 0.001 |
| Pleural effusion | 17 (23.0) | 117 (13.7) | 0.03 |
| Pneumonia | 10 (13.5) | 163 (19.0) | 0.2 |
| Cardiomegaly | 17 (23.0) | 114 (13.3) | 0.02 |
| Too ill to do walk test, no. (%) of patients | 31 (41.9) | 113 (13.0) | < 0.001 |
| Findings on 3-min walk test, mean ± SD | |||
| Baseline heart rate, per minute (n = 43 and 758) | 88.3 ± 15.9 | 89.9 ± 16.5 | 0.6 |
| Baseline Sao2, % (n = 43 and 758) | 93.9 ± 2.9 | 93.5 ± 3.1 | 0.3 |
| Baseline Borg score (n = 41 and 730) | 2.1 ± 1.7 | 2.1 ± 1.9 | 0.8 |
| Highest heart rate, per minute (n = 43 and 749) | 98.7 ± 16.8 | 104.0 ± 17.1 | 0.05 |
| Lowest Sao2, % (n = 43 and 751) | 89.7 ± 4.6 | 89.1 ± 4.8 | 0.4 |
| Borg score at 3 min (n = 40 and 672) | 4.1 ± 1.9 | 3.7 ± 2.3 | 0.4 |
| Heart rate 1 min after walk test, per minute (n = 43 and 737) | 90.9 ± 18.8 | 94.4 ±17.3 | 0.2 |
| Sao2 1 min after walk test, % (n = 43 and 734) | 93.1 ± 3.9 | 92.6 ± 4.0 | 0.5 |
| Change in heart rate from arrival, per minute (n = 43 and 758) | 4.3 ± 11.0 | 2.1 ± 15.8 | 0.2 |
| Change in Sao2 from arrival, percentage points (n = 43 and 757) | 0.2 ± 4.6 | 0.7 ± 4.4 | 0.5 |
| Walk test completed, no. (%) (n = 43 and 758) | 28 (65.1) | 573 (75.6) | 0.1 |
Note: CTAS = Canadian Triage Acuity Scale, ECG = electrocardiogram, NT-proBNP = N-terminal B-type natriuretic peptide, pCO2 and pO2 = partial pressure of carbon dioxide and oxygen, Sao2 = arterial oxygen saturation, SD = standard deviation.
Where data were not available for all patients in both groups, n values for both groups are shown parenthetically.
Except where indicated otherwise.
Table 5:
Univariable correlation with serious adverse events for continuous variables with discriminative cut points
| Characteristic* | Status for serious adverse event; no. (%) of patients | p value | |
|---|---|---|---|
| Yes n = 74 |
No n = 871 |
||
| Age ≥ 85 yr | 11 (14.9) | 126 (14.5) | 0.9 |
| Heart rate on arrival (n = 73 and 869) | |||
| ≥ 110/min | 27 (37.0) | 171 (19.7) | < 0.001 |
| ≥ 120/min | 12 (16.4) | 70 (8.1) | 0.02 |
| Respiratory rate ≥ 30/min (n = 74 and 816) | 15 (20.3) | 119 (14.6) | 0.2 |
| Sao2 | |||
| < 90% on arrival | 25 (33.8) | 134 (15.4) | < 0.001 |
| < 88% on room air (n = 35 and 454) | 5 (14.3) | 43 (9.5) | 0.4 |
| < 90% on room air (n = 35 and 454) | 10 (28.6) | 74 (16.3) | 0.06 |
| CTAS level 1 or 2 (n = 73 and 848) | 32 (43.8) | 306 (36.1) | 0.2 |
| Onset of respiratory distress < 4 h (n = 42 and 730) | 4 (9.5) | 37 (5.1) | 0.2 |
| Chest radiograph showing heart failure or cardiomegaly | 29 (39.2) | 155 (17.8) | < 0.001 |
| Hemoglobin < 100 g/L (n = 70 and 812) | 13 (18.6) | 25 (3.1) | < 0.001 |
| Urea ≥ 12 mmol/L (n = 71 and 794) | 18 (25.4) | 79 (9.9) | < 0.001 |
| Creatinine ≥ 150 mmol/L (n = 71 and 799) | 9 (12.7) | 63 (7.9) | 0.2 |
| Glucose ≥ 18 mmol/L (n = 70 and 773) | 1 (1.4) | 7 (0.9) | 0.7 |
| Serum CO2 ≥ 35 mmol/L (n = 70 and 800) | 9 (12.9) | 38 (4.8) | 0.004 |
| Arterial pCO2 ≥ 70 mm Hg (n = 23 and 160) | 8 (34.8) | 8 (5.0) | < 0.001 |
| Arterial pH | |||
| < 7.3 (n = 23 and 159) | 7 (30.4) | 7 (4.4) | < 0.001 |
| < 7.35 (n = 23 and 159) | 8 (34.8) | 20 (12.6) | 0.006 |
| ≥ 7.48 (n = 23 and 159) | 2 (8.7) | 6 (3.8) | 0.3 |
| NT-proBNP, ng/L | |||
| ≥ 5000 (n = 12 and 95) | 2 (16.7) | 10 (10.5) | 0.5 |
| ≥ 25 000 (n = 12 and 95) | 0 (0.0) | 3 (3.2) | 0.5 |
| Troponin T or I | |||
| ≥ 99th percentile (n = 45 and 317) | 6 (13.3) | 41 (12.9) | 0.9 |
| ≥ MI level (n = 45 and 317) | 0 (0.0) | 4 (1.3) | 0.5 |
| Walk test highest heart rate ≥ 110/min (n = 43 and 749) | 11 (25.6) | 286 (38.2) | 0.1 |
| Walk test lowest Sao2 < 88% (n = 43 and 751) | 12 (27.9) | 236 (31.4) | 0.6 |
| Borg score ≥ 5 (n = 40 and 672) | 14 (35.0) | 203 (30.2) | 0.5 |
| Walk test duration ≤ 1 min (n = 43 and 761) | 3 (7.0) | 26 (3.4) | 0.2 |
| Highest heart rate 1 min after walk test ≥ 110/min (n = 43 and 737) | 6 (14.0) | 148 (20.1) | 0.3 |
| Sao2 1 min after walk test < 90% (n = 43 and 734) | 7 (16.3) | 144 (19.6) | 0.6 |
Note: CTAS = Canadian Triage Acuity Scale, MI = myocardial infarction, NT-proBNP = N-terminal B-type natriuretic peptide, Sao2 = arterial oxygen saturation.
Where data were not available for all patients in both groups, n values for both groups are shown parenthetically.
The multivariable logistic regression model was developed from a reduced dataset of the 844 cases (89.3%) without missing values (Table 6). The Hosmer–Lemeshow χ2 goodness-of-fit statistic was nonsignificant (p = 0.7), which indicated a good fit to the data. The area under the receiver operating characteristic curve was 0.80 (95% confidence interval 0.74–0.85), meaning that the model correctly classified serious adverse events for 80% of cases. Variables that were not significant in the final model included age, walk test performance, disposition status (admitted or discharged) and several interaction terms. We conducted a secondary analysis using multiple imputation with 50 samples, and the resultant model had the same 10 variables, with only minor changes to the scores of 2 variables (Appendices 2 and 3, available at www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.130968/-/DC1).
Table 6:
Independent predictors of a serious adverse event, as determined by stepwise logistic regression analysis (for 844 patients with chronic obstructive pulmonary disease)*
| Variable | β coefficient | Odds ratio (95% CI) |
|---|---|---|
| Intercept | −3.82 | |
| History of peripheral vascular disease | 0.90 | 2.46 (0.92–6.61) |
| Prior coronary bypass graft | 0.71 | 2.03 (0.84–4.92) |
| Prior intubation for respiratory distress | 1.32 | 3.73 (1.38–10.12) |
| ECG with acute ischemic changes | 1.18 | 3.25 (0.95–11.04) |
| Chest radiography shows pulmonary congestion | 0.63 | 1.88 (0.94–3.78) |
| Too ill to do walk test after treatment in emergency department | 1.25 | 3.50 (1.93–6.35) |
| Heart rate on arrival in emergency department ≥ 110/min | 1.12 | 3.05 (1.68–5.55) |
| Hemoglobin < 100 g/L | 1.59 | 4.90 (2.05–11.68) |
| Urea ≥ 12 mmol/L | 0.89 | 2.43 (1.20–4.93) |
| Serum CO2 ≥ 35 mmol/L | 0.66 | 1.91 (0.77–4.72) |
Note: CI = confidence interval, ECG = electrocardiogram.
Hosmer–Lemeshow goodness-of-fit p = 0.7; area under receiver operating characteristic curve = 0.796 (95%CI 0.739–0.852).
Preliminary risk scale
The preliminary COPD risk scale (Tables 7 and 8) consisted of 10 elements from the history (coronary bypass graft, intervention for peripheral vascular disease, intubation for respiratory distress), examination (heart rate on arrival ≥ 110/min, post-treatment oxygen saturation < 90% or heart rate ≥ 120/min) and investigations (acute ischemic changes on electrocardiography, pulmonary congestion on chest radiography, hemoglobin < 100 g/L, urea ≥ 12 mmol/L, serum carbon dioxide ≥ 35 mmol/L). The risk scale had a maximum score of 16. We found that the risk of a serious adverse event ranged from 2.2%, for a score of 0, to 91.4%, for a total score of 10. There was good calibration between observed and expected probabilities of a serious adverse event up to a score of 6 (Figure 1), beyond which there was variability because of small numbers.
Table 7:
Clinical variables contributing to preliminary Ottawa COPD Risk Scale to identify patients with COPD seen in the emergency department who are at high risk of a serious adverse event
| Variable | Points |
|---|---|
| History | |
| Coronary bypass graft | 1 |
| Peripheral vascular disease intervention | 1 |
| Intubation for respiratory distress | 2 |
| Examination | |
| Heart rate on arrival in ED ≥ 110/min | 2 |
| Too ill to do walk test after treatment in ED (Sao2 < 90% or heart rate ≥ 120/min) | 2 |
| Investigations | |
| Acute ischemic changes on ECG | 2 |
| Pulmonary congestion evident on chest radiography | 1 |
| Hemoglobin < 100 g/L | 3 |
| Urea ≥ 12 mmol/L | 1 |
| Serum CO2 ≥ 35 mmol/L | 1 |
| Total score (possible range 0–16) | |
Note: COPD = chronic obstructive pulmonary disease, ECG = electrocardiogram, ED = emergency department, Sao2 = arterial oxygen saturation.
Table 8:
Risk categories for a serious adverse event in patients with acute exacerbation of COPD seen in the emergency department
| Total score | Risk of adverse event, % | Risk category |
|---|---|---|
| 0 | 2.2 | Low |
| 1 | 4.0 | Medium |
| 2 | 7.2 | Medium |
| 3 | 12.5 | High |
| 4 | 20.9 | High |
| 5 | 32.9 | Very high |
| 6 | 47.5 | Very high |
| 7 | 62.6 | Very high |
| 8 | 75.6 | Very high |
| 9 | NA | Very high |
| 10 | 91.4 | Very high |
| > 10 | NA | Very high |
Note: COPD = chronic obstructive pulmonary disease, NA = not applicable (no patient had a score of 9 or >10).
Figure 1:
Observed versus expected probability of serious adverse event score in patients with chronic obstructive pulmonary disease. Hosmer–Lemeshow goodness-of-fit: p = 0.7.
We compared the classification performance and expected admission proportions for the Ottawa COPD Risk Scale with current practice (as reflected by current study data) at the 6 study hospitals (Table 9). Use of the scale could improve upon the sensitivity of current practice, which had only 51% (38/74) of patients who subsequently experienced a serious adverse event being admitted on the first emergency department visit. For example, choosing total point scores of 1, 2 or 3 as the threshold for admission would be associated with sensitivities for a serious adverse event of 91.2%, 80.9% or 60.3%, respectively. These theoretical admission thresholds would result in admission rates of 57.6%, 43.2% or 20.0%, respectively, as compared with the observed admission rate of 37.5% at the study sites.
Table 9:
Classification performance and expected admission rates for preliminary COPD Risk Scale scores, compared with current practice at study hospitals
| Total score | No. of patients | Sensitivity | Specificity | Estimated probability of serious adverse event | Estimated proportion admitted, %* |
|---|---|---|---|---|---|
| Current practice | 945 | 0.514 | 0.625 | 0.078 | 37.5 |
| COPD Risk Scale score | 844† | ||||
| 0 | 358 | 1.000 | 0 | 0.022 | 100.0 |
| 1 | 121 | 0.912 | 0.454 | 0.040 | 57.6 |
| 2 | 196 | 0.809 | 0.601 | 0.072 | 43.2 |
| 3 | 54 | 0.603 | 0.835 | 0.125 | 20.0 |
| 4 | 74 | 0.515 | 0.897 | 0.209 | –‡ |
| 5 | 19 | 0.250 | 0.969 | 0.329 | – |
| 6 | 14 | 0.191 | 0.988 | 0.475 | – |
| 7 | 3 | 0.074 | 0.996 | 0.626 | – |
| 8 | 3 | 0.059 | 0.999 | 0.756 | – |
| 10 | 2 | 0.029 | 1 | 0.914 | – |
Note: COPD = chronic obstructive pulmonary disease.
For each COPD Risk Scale score, the value shown is the estimated hospital admission rate if threshold were greater than or equal to the specified point total (e.g., if threshold were set to point total ≥ 2, 43.2% of the patients would have been admitted).
Model was developed using data from the 844 patients who had no missing values.
Threshold values ≥ 4 were deemed not clinically reasonable because of poor sensitivity.
The classification performance of the final score categories was validated using the sensitivity, specificity, positive likelihood ratio and negative likelihood ratio. This internal validation showed the risk scores to be highly accurate across 1000 replications with the bootstrap method (Appendix 4, available at www.cmaj.ca/lookup/suppl/doi:10.1503/cmaj.130968/-/DC1).16
Interpretation
Among patients who presented to the emergency department with acute exacerbation of COPD, we found a relatively high frequency of serious adverse events, a modest hospital admission rate and a concerning proportion of poor outcomes among patients initially discharged home. We found that some 20 clinical and laboratory predictors were strongly associated with the development of serious adverse events. Multivariable analyses resulted in a concise and accurate model involving 10 unique, independent, high-risk factors, 4 from the initial clinical assessment, 5 from bedside investigations and 1 from reassessment after emergency department treatment. These high-risk factors are readily available and do not require sophisticated imaging or expensive testing to assist decision-making, yet have not been explicitly presented in previous models. These factors could assist physicians in identifying patients most at risk for adverse outcomes and most in need of hospital admission. The 10-element preliminary COPD risk scale provides a quantitative estimate of the risk of poor outcomes. We expect that this risk scale, once fully validated, will be widely used to improve both hospital admission practices and the safety of management decisions in the emergency department.18–20
We are concerned by the number of serious adverse events among patients with COPD who were discharged from the emergency department. Identification of high-risk characteristics by physicians has the potential to substantially improve patient safety by helping to ensure that patients who are most at risk for poor outcomes are admitted. Although Canadian hospitals would struggle to admit 80% of patients with COPD, as we understnad is currently done in US hospitals, we believe that even a modest increase in admission rates (e.g., to 50% from the current 37.5%) would very likely lead to safer management practices. More important than increasing the admission percentage is ensuring admission of the correct patients, i.e., those at greatest risk of a poor outcome. Alternatively, the scale could be used to identify at-risk patients who should have guaranteed early follow-up, perhaps in specialized COPD clinics.
There have been no large, robust evaluations of risk factors to assist with admission decisions for patients with COPD in the emergency department. Previous prospective studies conducted in the emergency department had one or more of these limitations: small sample size, no inclusion of response to therapy, no functional testing such as a walk test and no prospective validation.7,21–24 A larger study (in France) was limited by no evaluation of response to therapy and lack of follow-up mortality data.25 Other prospective studies conducted only after admission to hospital have been limited by similar concerns, and most of these attempted only to predict mortality.26–30 Others involved retrospective analyses of existing databases, were focused on inpatients or mortality, and were not directly applicable to the emergency department.31–35
Strengths and limitations
Our study had several strengths, including multicentre and rigorous prospective collection of real-time clinical data, comprehensive follow-up and unique use of the 3-minute walk test. Nonetheless, some aspects of the study warrant discussion. First, the study included both admitted and discharged patients, which we believe is the correct methodologic approach. Admission status may confound the likelihood of a serious adverse event, since it is possible that some admitted patients will not experience an adverse event because they receive more intensive therapy in hospital. Conversely, those same patients might have experienced an adverse event if they had been discharged home. Our objectives, however, were to identify high-risk characteristics and develop a preliminary risk scale that ensures appropriate admission of high-risk patients (i.e., sensitivity) while minimizing the admission of low-risk patients (i.e., specificity). We could do this only by evaluating admitted patients. We also note that admitted status was not significantly associated with serious adverse events in the multivariable model.
We chose not to evaluate spirometry findings in the emergency department, because this modality is often unavailable and was thought to be of limited usefulness for predicting short-term outcomes. We believe that use of the “monitored unit” (not telemetry) as a criterion for a serious adverse event is an important outcome that almost always reflects severity of illness. Patients treated in a monitored unit would likely have experienced substantial morbidity if they had been discharged, because they were bedridden and required constant cardiac monitoring. This preliminary risk scale should be prospectively validated in a new set of emergency department patients with COPD. Although we had few outcomes relative to the number of predictors, internal validation with bootstrapping showed that the estimate and classification performance for risk scores were stable.36 We chose not to adjust the analysis, despite the fact that some patients were enrolled more than once. We were unable to enrol a large number of eligible patients who presented outside of normal business hours, but we detected no selection bias. Some readers may be surprised that 4 cardiovascular variables were associated with serious adverse events in patients with a respiratory condition, but cardiovascular disease and COPD are well known as common comorbidities that lead to worse outcomes than either condition alone.3,5,25,37 In addition, we know that some exacerbations of COPD are accompanied by simultaneous exacerbation of heart failure. Finally, it is possible, although unlikely, that some return emergency department visits were not identified among patients who returned to a different hospital. If such events did occur, we believe that they would not have had a significant effect on the results.
Conclusion
Patients with exacerbation of COPD are commonly admitted to hospital, but many such patients are discharged home from the emergency department and then experience serious adverse events or death. We have identified high-risk characteristics and developed a unique risk scale that can be used to stratify the risk of poor outcomes for patients with COPD seen in the emergency department and to enable rational and safe disposition decisions. Once validated, this scale will ultimately benefit both patients and health care systems by ensuring appropriate admissions, targeting those who need early follow-up and diminishing unnecessary hospital admissions.
Supplementary Material
Acknowledgements
The authors gratefully acknowledge the invaluable assistance of the following individuals from the study sites: Antoinette Colacone RN, Chris Tselios BSc and Yanka Mihaylova, Jewish General Hospital, Montréal, Que.; Katherine Bowes RN and Jane Reid RN, Kingston General Hospital, Kingston, Ont.; Michelle Loftus RN, Mount Sinai Hospital, Toronto, Ont.; Sara Dorrington RRT, James Acheson RRT, Michael Gatta RRT, Michelle Saulnier RRT, Krista Bangs RRT, Christine Belisle RRT and Vanessa Lawlor RRT, The Ottawa Hospital, Civic and General campuses, Ottawa, Ont.; Debbie Boyko RN and Dion Pasichnyk, University of Alberta Hospital, Edmonton, Alta. In addition, the authors thank the following individuals from the coordinating centre in Ottawa: Tami Clavet RN, Jennifer Brinkhurst, Connor Sheehan, Angela Marcantonio, Sheryl Domingo and My-Linh Tran, Ottawa Hospital Research Institute; Carol Ann Jodouin, Department of Pathology and Laboratory Medicine, The Ottawa Hospital; and Li Chen, University of Ottawa Heart Institute. Finally, the authors are grateful to the many physicians, nurses and respiratory therapists at the study hospitals for their helpful assistance with patient identification and data collection.
Footnotes
Competing interests: For studies outside the work reported here, Brian Rowe’s institution has received grants from GlaxoSmithKline and Electrocore (investigator-initiated) and from MedImmune/AstraZeneca (industry-initiated). Brian Rowe has also received payment for lectures to general practitioners from Bristol Myers Squibb and AstraZeneca. Bjug Borgundvaag has received payment for lectures to general practitioners from Bristol Myers Squibb. No competing interests declared by other authors.
This article has been peer reviewed.
Disclaimer: George Wells is a statistical consultant for CMAJ. He was not involved in the editorial decision-making for this article.
Contributors: Ian Stiell conceived the idea, secured research funding and prepared the manuscript. Catherine Clement coordinated the study, collected data and contributed to writing the manuscript. Shawn Aaron, Brian Rowe, Jeffrey Perry, Robert Brison, Lisa Calder, Eddy Lang, Bjug Borgundvaag and Alan Forster assisted with study design, supervised the recruitment of patients and management of data, and revised the manuscript. George Wells provided considerable statistical assistance and revised the manuscript. All authors contributed to supervising the conduct of the trial and data collection and to drafting or revising the manuscript, and all approved the final version. Ian Stiell had full access to all of the study data and takes responsibility for integrity of the data and accuracy of the data analysis.
Funding: This study was supported by peer-reviewed funding from the Canadian Institutes of Health Research (MOP 82742). Ian Stiell holds a Distinguished Professorship and University Health Research Chair from the University of Ottawa. Shawn Aaron holds a Clinical Research Chair from the University of Ottawa. Brian Rowe is supported by a Tier I Canada Research Chair in Evidence-based Emergency Medicine. Jeffrey Perry holds a New Investigator Award from the Canadian Institutes of Health Research and a Clinical Research Chair from the University of Ottawa.
References
- 1.Seemungal TAR, Donaldson GC, Paul EA, et al. Effect of exacerbation on quality of life in patients with chronic obstructive pulmonary disease. Am J Respir Crit Care Med 1998;157:1418–22 [DOI] [PubMed] [Google Scholar]
- 2.Aaron SD, Vandemheen K, Hebert P, et al. Outpatient oral prednisone after emergency treatment of chronic obstructive pulmonary disease. N Engl J Med 2003;348:2618–25 [DOI] [PubMed] [Google Scholar]
- 3.O’Donnell DE, Aaron S, Bourbeau J, et al. Canadian Thoracic Society recommendations for management of chronic obstructive pulmonary disease — 2007 update. Can Respir J 2007;14 Suppl B:5B–32B [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Chronic obstructive pulmonary disease: management of chronic obstructive pulmonary disease in adults in primary and secondary care. London (UK): National Institute for Health and Clinical Excellence; 2010 [Google Scholar]
- 5.Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease. Global Initiative for Chronic Obstructive Lung Disease; updated 2014. Available: www.goldcopd.org/guidelines-global-strategy-for-diagnosis-management.html (accessed 2014 Feb. 11). [Google Scholar]
- 6.Stiell IG, Clement CM, Brison RJ, et al. A risk scoring system to identify emergency department patients with heart failure at high risk for serious adverse events. Acad Emerg Med 2013;20:17–26 [DOI] [PubMed] [Google Scholar]
- 7.Kim S, Emerman CL, Cydulka RK, et al. Prospective multicenter study of relapse following emergency department treatment of COPD exacerbation. Chest 2004;125:473–81 [DOI] [PubMed] [Google Scholar]
- 8.Soler JJ, Sanchez L, Roman P, et al. Risk factors of emergency care and admissions in COPD patients with high consumption of health resources. Respir Med 2004;98:318–29 [DOI] [PubMed] [Google Scholar]
- 9.Roberts CM, Ryland I, Lowe D, et al. Audit of acute admissions of COPD: standards of care and management in the hospital setting. Eur Respir J 2001;17:343–9 [DOI] [PubMed] [Google Scholar]
- 10.Enright PL. The six-minute walk test. Respir Care 2003;48:783–5 [PubMed] [Google Scholar]
- 11.Brooks D, Parson J, Tran D, et al. The two-minute walk test as a measure of functional capacity in cardiac surgery patients. Arch Phys Med Rehabil 2004;85:1525–30 [DOI] [PubMed] [Google Scholar]
- 12.Sciurba F, Criner GJ, Lee SM, et al. Six-minute walk distance in chronic obstructive pulmonary disease. Am J Respir Crit Care Med 2003;167:1522–7 [DOI] [PubMed] [Google Scholar]
- 13.Pan AM, Stiell IG, Clement CM, et al. Feasibility of a structured 3-minute walk test as a clinical decision tool for patients presenting to the emergency department with acute dyspnea. Emerg Med J 2009;26:278–82 [DOI] [PubMed] [Google Scholar]
- 14.Alpert JS, Thygesen K, Antman E, et al. Myocardial infarction redefined — a consensus document of the Joint European Society of Cardiology/American College of Cardiology Committee for the redefinition of myocardial infarction. J Am Coll Cardiol 2000; 36:959–69 [DOI] [PubMed] [Google Scholar]
- 15.Le Gal G, Righini M, Roy PM, et al. Prediction of pulmonary embolism in the emergency department: the revised Geneva score. Ann Intern Med 2006;144:165–71 [DOI] [PubMed] [Google Scholar]
- 16.Efron B, Tibshirani R. Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Stat Sci 1986;1:54–77 [Google Scholar]
- 17.Steyerberg EW, Harrell FE, Jr, Borsboom GJ, et al. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 2001;54:774–81 [DOI] [PubMed] [Google Scholar]
- 18.Stiell IG, Wells G, Laupacis A, et al. A multicentre trial to introduce clinical decision rules for the use of radiography in acute ankle injuries. BMJ 1995;311:594–7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Stiell IG, Clement C, McKnight RD, et al. The Canadian C-spine Rule versus the NEXUS low-risk criteria in patients with trauma. N Engl J Med 2003;349:2510–8 [DOI] [PubMed] [Google Scholar]
- 20.Stiell IG, Clement CM, Grimshaw J, et al. Implementation of the Canadian C-Spine Rule: prospective 12-centre cluster randomised trial. BMJ 2009;339:b4146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Emerman CL, Connors AF, Lukens T, et al. Relationship between arterial blood gases and spirometry in acute exacerbations of chronic obstructive pulmonary disease. Ann Emerg Med 1989; 18:523–7 [DOI] [PubMed] [Google Scholar]
- 22.Emerman CL, Effron D, Lukens TW. Spirometric criteria for hospital admission of patients with acute exacerbation of COPD. Chest 1991;99:595–9 [DOI] [PubMed] [Google Scholar]
- 23.Tsai CL, Clark S, Cydulka RK, et al. Factors associated with hospital admission among emergency department patients with chronic obstructive pulmonary disease exacerbation. Acad Emerg Med 2007;14:6–14 [DOI] [PubMed] [Google Scholar]
- 24.Rowe BH, Willis V, Mackey D, et al. Prospective multicenter study of treatment and relapse following emergency department discharge for acute COPD. Acad Emerg Med 2009;16:316–24 [DOI] [PubMed] [Google Scholar]
- 25.Roche N, Zureik M, Soussan D, et al. Predictors of outcomes in COPD exacerbation cases presenting to the emergency department. Eur Respir J 2008;32:953–61 [DOI] [PubMed] [Google Scholar]
- 26.Mohan A, Bhatt SP, Mohan C, et al. Derivation of a prognostic equation to predict in-hospital mortality and requirement of invasive mechanical ventilation in patients with acute exacerbation of chronic obstructive pulmonary disease. Indian J Chest Dis Allied Sci 2008;50:335–42 [PubMed] [Google Scholar]
- 27.Ranieri P, Bianchetti A, Margiotta A, et al. Predictors of 6-month mortality in elderly patients with mild chronic obstructive pulmonary disease discharged from a medical ward after acute nonacidotic exacerbation. J Am Geriatr Soc 2008;56:909–13 [DOI] [PubMed] [Google Scholar]
- 28.Chang CL, Sullivan GD, Karalus NC, et al. Predicting early mortality in acute exacerbation of chronic obstructive pulmonary disease using the CURB65 score. Respirology 2011;16:146–51 [DOI] [PubMed] [Google Scholar]
- 29.Matkovic Z, Huerta A, Soler N, et al. Predictors of adverse outcome in patients hospitalised for exacerbation of chronic obstructive pulmonary disease. Respiration 2012;84:17–26 [DOI] [PubMed] [Google Scholar]
- 30.Steer J, Gibson J, Bourke SC. The DECAF Score: predicting hospital mortality in exacerbations of chronic obstructive pulmonary disease. Thorax 2012;67:970–6 [DOI] [PubMed] [Google Scholar]
- 31.Jones RC, Donaldson GC, Chavannes NH, et al. Derivation and validation of a composite index of severity in chronic obstructive pulmonary disease: the DOSE Index. Am J Respir Crit Care Med 2009;180:1189–95 [DOI] [PubMed] [Google Scholar]
- 32.Sharma G, Kuo YF, Freeman JL, et al. Outpatient follow-up visit and 30-day emergency department visit and readmission in patients hospitalized for chronic obstructive pulmonary disease. Arch Intern Med 2010;170:1664–70 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Asiimwe AC, Brims FJ, Andrews NP, et al. Routine laboratory tests can predict in-hospital mortality in acute exacerbations of COPD. Lung 2011;189:225–32 [DOI] [PubMed] [Google Scholar]
- 34.Sundh J, Janson C, Lisspers K, et al. The Dyspnoea, Obstruction, Smoking, Exacerbation (DOSE) index is predictive of mortality in COPD. Prim Care Respir J 2012;21:295–301 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Tabak YP, Sun X, Johannes RS, et al. Development and validation of a mortality risk-adjustment model for patients hospitalized for exacerbations of chronic obstructive pulmonary disease. Med Care 2013;51:597–605 [DOI] [PubMed] [Google Scholar]
- 36.Vittinghoff E, McCulloch CE. Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol 2007; 165:710–8 [DOI] [PubMed] [Google Scholar]
- 37.Scala R, Bartolucci S, Naldi M, et al. Co-morbidity and acute decompensations of COPD requiring non-invasive positive-pressure ventilation. Intensive Care Med 2004;30:1747–54 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.