Abstract
Objective
To determine the extent to which hospitals vary in the use of intensive care, and the proportion of variation attributable to differences in hospital practice that is independent of known patient and hospital factors.
Data Source
Hospital discharge data in the State Inpatient Database for Maryland and Washington States in 2006.
Study Design
Cross-sectional analysis of 90 short-term, acute care hospitals with critical care capabilities.
Data Collection/Methods
We quantified the proportion of variation in intensive care use attributable to hospitals using intraclass correlation coefficients derived from mixed-effects logistic regression models after successive adjustment for known patient and hospital factors.
Principal Findings
The proportion of hospitalized patients admitted to an intensive care unit (ICU) across hospitals ranged from 3 to 55 percent (median 12 percent; IQR: 9, 17 percent). After adjustment for patient factors, 19.7 percent (95 percent CI: 15.1, 24.4) of total variation in ICU use across hospitals was attributable to hospitals. When observed hospital characteristics were added, the proportion of total variation in intensive care use attributable to unmeasured hospital factors decreased by 26–14.6 percent (95 percent CI: 11, 18.3 percent).
Conclusions
Wide variability exists in the use of intensive care across hospitals, not attributable to known patient or hospital factors, and may be a target to improve efficiency and quality of critical care.
Keywords: Intensive care, critical illness, variation, hospitals
Critical care is the care of patients at high risk for a life-threatening deterioration, such as those with myocardial infarction, acute respiratory failure, trauma, or severe sepsis. Although provided in diverse settings, critical care is often also defined by the location of care delivery—a critical care unit, commonly an intensive care unit (ICU) or coronary care unit (CCU)—that is defined by the intensive monitoring, high nurse to patient ratio, and availability of invasive technology for organ support. Over the last 20 years there has been a dramatic rise in the use of intensive care in the United States. From 1985 to 2005, critical care beds increased by 36 percent (69,300–93,995), whereas noncritical care beds decreased by 35 percent (820,300–534,414). (Halpern, Pastores, and Greenstein 2004; Halpern et al. 2007; Halpern and Pastores 2009). Because care provided in the ICU is costly, critical care spending is a major contributor to the rapidly escalating health care costs in the United States and now represents ∼1 percent of the U.S. gross domestic product.(Halpern and Pastores 2009).
The rise in ICU costs may result, in part, from specific differences in practice patterns at individual hospitals. Certain hospitals may overuse ICUs by admitting patients either with no meaningful chance of recovery, or, conversely, patients who do not require life-sustaining therapies (Zimmerman et al. 1995; Rosenthal et al. 1998; Barnato et al. 2007). Financial incentives for both hospitals and physicians due to reimbursement for intensive care may also drive variation in practice (Garland et al. 2006). In addition, relative overuse of the ICU may result from understaffing of general medical/surgical floors in pursuit of lower costs for common noncritical illness diagnosis-related groups (DRGs); such an understaffed floor might be unable to care for modest acuity patients (requiring a lower threshold for transfer to the ICU) or might be late to detect incipient critical illness or fail to rescue such patients.(Ghaferi, Birkmeyer, and Dimick 2009) To address the etiology and consequences of under or overuse, researchers and policy makers must first measure the extent to which varying use of intensive care is present.
One way to indirectly measure the potential for overuse is to examine how critical care practice varies across hospitals.
The decision to admit a patient to the ICU and provide critical care is complex, and results from the interaction of specific characteristics of the patient (e.g., illness severity or comorbidity), and specific organizational and cultural aspects of a hospital. The fraction of patients receiving care in an ICU will vary between hospitals not only because of variation in patients' needs for life-sustaining therapies, the decision to admit individual patients, but also because of compositional differences between hospitals in the array of services they offer, some of which may have different requirements for ICU care (e.g., caring for advanced burns or cardiac surgery). A simple conceptual model that integrates these factors is shown in the Supplemental Digital Content (eFigure S1), drawing on the work of Andersen and Aday (Andersen et al. 1987) and Penchansky and Thomas (1981).
Our primary goal is to understand the extent to which variation between hospitals in the use of intensive care is explained by patients and hospital factors. We further wish to understand the extent to which hospital-to-hospital variation is a feature of objective differences between hospitals, particularly with regard to their case mix and offering of specialty services, as opposed to more idiosyncratic local cultural variation in use of the ICU for observationally equivalent patients. This last category of variation—whereby comparable patients may be treated differently merely as a function of where they are hospitalized—is the area of greatest policy interest. For example, the existence of wide variation in the use of intensive care across hospitals that is not attributable to measured patient or hospital differences may suggest that some hospitals are using critical care disproportionately. By then identifying hospital outliers, researchers and policy makers can focus their efforts on select hospitals—taking advantage of this variation as natural laboratories in hospital process.
To address these questions, we used all-payer State Inpatient Data (SID) from the Agency for Healthcare Research and Quality (AHRQ) to measure variation in ICU use across hospitals without accounting for any known differences. Using multilevel regression analysis, we adjust for known patient differences to determine the proportion of total variation that remained due to hospital-level factors. We add patient factors, including case mix adjustment, in a priori fashion, to understand the impact of more granular adjustment. We then adjust for several measured hospital characteristics to determine the residual hospital-level variation, which was independent of known patient and hospital characteristics (Merlo et al. 2005a). To further understand whether hospital-level variation in intensive care is consistent across more homogeneous diagnoses or procedures, we evaluate our models in patients hospitalized with acute myocardial infarction, pneumonia, congestive heart failure, or surgery for colorectal cancer. We chose these diagnoses because they are common, have a reasonable likelihood of requiring ICU admission, and are reliably identified using administrative data.
Methods
Patient Data: Health Care Cost and Utilization Project State Inpatient Database
We used the SID for Maryland and Washington to identify all adult patients (age ≥18 years) who were hospitalized at an acute care, short-term hospital in 2006. We selected these two states as they submit data to the Agency for Healthcare Research and Quality (AHRQ) as part of the health care utilization project (HCUP) and report revenue codes (UB-92 billing codes) for each hospitalization that allows for identification of a stay in intensive care. They are also diverse states, in distinct geographic regions, including both major urban areas as well as large rural components, and with both high and low health maintenance organization penetration. The SID includes administrative data derived from UB-92 hospital discharge forms and provides a rich collection of variables. We used the AHRQ Clinical Classifications Software (CCS 2009) to generate multilevel diagnosis categories for case mix adjustment, a strategy which compares favorably to other administrative adjustment tools (Ash et al. 2003). We also used a select group of codes for medical critical illness codes (Ehlenbach et al. 2010), acute cardiovascular disease (Wennberg et al. 2004), and cardiac surgery (Ghali et al. 1999) to explore more granular case mix adjustment. A full description of patient-level adjustment variables is provided in the Supplemental Digital Content (see eMethods, eTable S1).
Hospital Data: Healthcare Cost Report Information System, AHA Annual Survey
We linked eligible hospitalizations to the 2006 Healthcare Cost Report Information System (HCRIS) data from the Center for Medicare and Medicaid Services (2006). HCRIS is a federally mandated and annually submitted Hospital Cost Report file, previously used in many studies of critical care services (Halpern, Pastores, and Greenstein 2004; Halpern et al. 2007; Halpern and Pastores 2009). We also linked hospitalizations to the 2005 American Hospital Association (2005) annual survey, a widely used electronic dataset of self-reported data on hospital ownership, staffing, facilities, and capabilities. The AHA surveys achieve a high annual response rate and are considered highly reliable for the variables we used (Mullner 2002). Matching to hospital-level data was successful in all but six facilities (Figure 1). We used commonly considered variables to capture hospital characteristics, which are further detailed in the Supplemental Digital Content (see Methods).
Identification of Intensive Care Hospitalizations
We categorized each admission by the presence or absence of Medicare UB-92 billing codes for intensive care any time during hospitalization (Halpern, Pastores, and Greenstein 2004; Halpern and Pastores 2009; Iwashyna et al. 2009). We defined ICU admission as the presence of any critical care revenue code, excluding psychiatric, pediatric, or intermediate critical care. To determine intensive care use across hospitals, we determined the reliability-adjusted proportion of intensive care hospitalizations of all eligible hospitalizations at each center. Reliability adjustment reduces spurious variation in hospital-level proportions by eliminating statistical noise among hospitals with low caseloads ( Hayward et al. 2007; Dimick, Staiger, and Birkmeyer 2010). This approach is now advocated by multiple organizations for quality monitoring, including the AHRQ and The LeapFrog Group (2010).
Statistical Analyses
We present continuous descriptive data as mean ± SD or median [interquartile range], depending on normality determined from graphical distributions. We present categorical variables as proportions. The range and variability in proportion of intensive care unit use across hospitals are illustrated using histograms.
Because of the hierarchical structure of the data (patients nested within hospitals), we used the latent response formulation of multilevel logistic regression analyses and constructed three models (Rabe-Hesketh and Skrondal 2008). Patients are indexed i and hospitals h. Model 1 (the empty model) is the probability (pi,h) of a critical care hospitalization only as a function of the hospital:
(1) |
βo = mean log odds of ICU admission in the sample
ζh = hospital random effect (independent across hospitals), ∼N(0, ψ)
εi,h = is the residual variance (independent across hospitals and patients),∼N(0,θ)
In Model 2, the probability of a critical care hospitalization is a function of the patient-level factors (Xi,h):
(2) |
β1 = vector of coefficients for patient-level factors
Xi,h = vector of patient-level factors for patient i in hospital h
Using empirical Bayes methods, we determined the adjusted predicted ICU use rate and 95 percent confidence intervals at the hospital level for an average patient (Morris 1983; Normand, Glickman, and Gatsonis 1997). Then, we displayed the ranked order of adjusted rates across hospitals in a caterpillar plot. To illustrate the sensitivity of our result to more detailed case mix adjustment, patient factors were added to Model 2 in a stepwise fashion. Please see the Supplemental Digital Content for more detail (see eMethods).
In Model 3, the probability of a critical care hospitalization is a function of the hospital, patient factors, and observed hospital characteristics (Zh):
(3) |
δ = coefficient vector for the vector of hospital-specific variables (Z) in hospital h
Zh = vector of hospital-level variables in hospital h
To determine the proportion of variance in intensive care use attributable to hospitals, we determined the intraclass correlation (ICC) calculated, as is conventional (Merlo et al. 2005a,b), as:
(4) |
To determine the proportional change in variance (PCV) between a simple model and a model with more adjustment variables, we used an approach suggested by Merlo et al. (2005c):
(5) |
Sensitivity Analyses
We explored if hospital-level variation in ICU use was consistent for more homogeneous conditions. We restricted our models to patients with acute myocardial infarction (Wennberg et al. 2004), pneumonia (Fry et al. 2005), congestive heart failure(Casper et al. 2010), and surgery for colorectal cancer (Ho et al. 2006), respectively, using ICD-9-CM diagnosis and procedure codes. We also hypothesized that inter-facility transfer of patients may influence variation in hospitals' use of intensive care (Iwashyna et al. 2010). We subsequently excluded all patients with admission source coded as “acute care hospital” and reestimated our models. To ensure that the observed hospital-level variation in ICU use was true and not a result of random noise, we performed a specification test (Huesch 2011). We chose patient marital status (married/unmarried) as an arbitrary characteristic that we did not expect to have significant variation at the hospital level. We restricted this analysis to hospitalizations in Maryland, in which marital status is reported in the SID. All models were re-estimated using this alternative outcome, and we generated corresponding ICCs for our random effects.
We used STATA/SE version11.1 (College Station, TX, USA) for all analyses. Research involving the patient-level de-identified SID, AHA annual survey, and HCRIS was not considered human subjects research and was exempted review by the University of Washington Institutional Review Board.
Results
Patients who were cared for in an ICU were older, more often men, and were more likely to be admitted from other medical facilities, compared to patients not receiving critical care (Table 1). Among all hospitals with critical care capability (N = 90), most were nonteaching facilities (n = 62, 69 percent), half offered interventional cardiac catheterization (n = 50, 56 percent), and few provided specialty services such as burn care or organ transplantation (<10 percent, respectively). Facilities had a median 17 ICU beds [IQR: 9, 34], whereas intermediate care ICU beds were uncommon (see Supplemental Digital Content, eTable S2).
Table 1.
Variable | Critical Care Hospitalizations (N = 143,118) | Noncritical Care Hospitalizations (N = 868,291) |
---|---|---|
Age, years | 64 [51–77] | 55 [37–73] |
Male gender, N (%) | 76,729 (53) | 322,011 (37) |
Weighted Charlson comorbidity score | 1 [1–3] | 1 [0–2] |
Admission source, N (%) | ||
Routine | 129,280 (90) | 832,419 (96) |
Acute care hospital | 8,671 (6) | 21,343 (2) |
Long-term care facility | 5,167 (2.8) | 14,534 (2) |
Weekend admission, N (%) | 30,661 (21) | 161,812 (19) |
Race/ethnicity* | ||
White | 47,761 (67) | 309,549 (60) |
Black | 20,038 (28) | 168,597 (33) |
Hispanic ethnicity | 1,092 (2) | 15,506 (3) |
Asian or Pacific islander | 959 (1) | 8,022 (2) |
Other | 2,216 (3) | 12,257 (2) |
Primary payer status, N (%) | ||
Medicare | 75,535 (53) | 338,206 (39) |
Medicaid | 14,904 (10) | 134,903 (16) |
Private insurance | 42,023 (29) | 330,069 (38) |
Self-pay | 6,915 (4) | 41,301 (5) |
No charge | 643 (<1) | 4,090(<1) |
Urbanicity | ||
Central county, (>1 million pop.) | 34,492 (24) | 195,638 (23) |
Fringe county, (>1 million pop.) | 61,416 (43) | 434,803 (50) |
Metropolitan county (250–999,999 pop.) | 6,410 (5) | 35,308 (4) |
Metropolitan county (50–250,000 pop.) | 23,376 (16) | 120,749 (14) |
Micropolitan county | 13,040 (9) | 59,504 (7) |
Noncore county | 4,384 (3) | 22,294 (3) |
Median household income national quartile by ZIP code, N (%) | ||
Quartile 1 | 24,017 (17) | 149,061 (17) |
Quartile 2 | 28,786 (21) | 153,494 (18) |
Quartile 3 | 45,502 (32) | 275,092 (32) |
Quartile 4 | 44,813 (31) | 290,649 (33) |
Died during hospitalization, N (%) | 13,005 (9) | 9,789 (1) |
Length of stay, days† | 5 [2–9] | 3 [2–4] |
Among Maryland hospitalizations only, missing for N = 760 (0.3%).
Among hospital survivors.
We observed broad variation in the use of intensive care (eFigure S2). The reliability-adjusted proportion of total hospitalizations admitted to an ICU across hospitals ranged from 3 to 55 percent (median 12 percent; IQR: 9, 17 percent). Table 2 reports the results from our mixed effects logistic regression models. In our unadjusted model, 10 percent of variation in the use of intensive care was attributed to the hospitals (ICC = 10.3 percent (95 percent CI: 7.6, 13 percent). When patient characteristics, including comorbid status, age, gender, and case mix, were added to the model (Model 2), we observed an increase in the proportion of variance attributable to hospitals (ICC = 19.7 percent, 95 percent CI: 15.1, 24.4 percent). This broad variation is also reflected in the caterpillar plot where each hospital was ranked according to their case mix adjusted rate of ICU use (Figure 2). For example, hospitals in the 90th percentile were 17 times more likely to use intensive care than those in the lowest 10th percentile (54 percent vs. 3.3 percent). When patient factors were added in stepwise fashion, we observed that increasing granularity of case mix adjustment increased variation at the hospital level (see Supplemental Digital Content, eTable S3), suggesting that any omitted patient-level comorbidity variables do not confound our hospital-level estimates.
Table 2.
Empty Model | Model with Patient Factors | Model with Patient and Hospital Factors | |
---|---|---|---|
Model 1 | Model 2 | Model 3 | |
Random effects variance* | |||
Hospital-level variance (95% CI) | 0.38 (0.06, 0.28) | 0.81 (0.60, 1.1) | 0.57 (0.42, 0.76) |
Intraclass correlations**(%) | |||
Hospital (95% CI) | 10.3 (7.6, 13) | 19.7 (15.1, 24.4) | 14.6 (11, 18.3) |
Residual | 89.7 | 80.3 | 85.4 |
Observations | 1,011,363 | 1,011,354 | 1,011,354 |
The residual (patient) variance in a mixed logistic regression model is fixed at π(2/3).
ICC calculated as proportion of hospital variance divided by total variance where total variance is the sum of hospital variance and residual variance π(2/3).
CI, confidence interval.
When measured hospital characteristics were included (Model 3), we observed that hospitals still accounted for 14.6 percent (95 percent CI: 11, 18.3 percent) of the variation in intensive care use. Addition of known hospital characteristics only attenuated the variance attributable to hospitals by 26 percent. In general, we note that the sum of the contribution of estimated effects was small compared to residual, unexplained effects, which varied from 81 to 89 percent. Among the hospital-level effects, nonteaching status, availability of intermediate care beds, presence of neurological services, and increasing hospital beds were associated with reduced hospital-level intensive care use (see Supplemental Digital Content, eTable S4).
In our sensitivity analyses, we observed no change in our estimates after we excluded all patients transferred from acute care hospitals. For specific conditions, we observed significant variation in hospital-level ICU use among patients with congestive heart failure, a modest reduction for pneumonia, and surgery for colorectal cancer, and even greater variation for acute myocardial infarction (Table 3). In our specification analysis, we substituted marital status (married—yes/no) for ICU use, where little unexplained variability should be captured by hospital effects (Table 3). We observed, as expected, that the contribution of hospitals to these models was minimal and substantially less than our models of ICU use. In fact, the hospital-level contribution to marital status was estimated at 0.9 percent (95 percent CI: 0.5, 1.3 percent) after full adjustment.
Table 3.
Pneumonia | Congestive Heart Failure | Surgery for Colorectal Cancer | Acute Myocardial Infarction | Excluding Acute Care Transfers | Specification Test† | |
---|---|---|---|---|---|---|
Random effects variance* | ||||||
Hospital-level variance (95% CI) | 0.27 (0.20, 0.38) | 0.64 (0.48, 0.87) | 0.29 (0.19, 0.44) | 1.24 (0.89, 1.75) | 0.57 (0.43, 0.77) | 0.03 (0.02, 0.05) |
Intraclass correlations** % | ||||||
Hospital (95% CI) | 7.7 (5.4, 10.0) | 16.4 (12.2, 20.6) | 8.0 (4.9, 11.2) | 27.5 (20.7, 34.2) | 14.9 (11.1, 19.6) | 0.9 (0.5, 1.3) |
Residual | 92.3 | 83.6 | 92 | 72.5 | 85.1 | 99.1 |
Hospitals | 90 | 90 | 89 | 88 | 90 | 42 |
Observations | 36,525 | 76,439 | 10,232 | 22,086 | 981,341 | 581,503 |
Notes: All analyses derive from Model 3 refit in after restriction to complete cases; critical illness diagnosis codes eliminated from adjustment variables for pneumonia and surgery models due to model convergence.
Specification test, where outcome replaced patient-level marital status (married—yes/no), fit only among Maryland state records.
The residual (patient) variance in a mixed logistic regression model is fixed at π(2/3).
ICC calculated as proportion of hospital variance divided by total variance, where total variance is the sum of hospital variance and residual variance π(2/3).
ICU, intensive care unit.
Discussion
Intensive care is among the most resource intensive, costly, and rapidly growing components of acute hospital care. We observed wide variation in the use of intensive care among hospitals, even after adjusting for known patient- and hospital-level variables. We found that hospitals at the 90th percentile were 17 times more likely than those at the 10th percentile to admit a comparable patient to the intensive care unit. Our findings were robust to disease-specific cohorts, including acute myocardial infarction and congestive heart failure. These data suggest important, unmeasured hospital factors may contribute to the variability in intensive care unit admission for patients, and they highlight the opportunity for future quality improvement and system efficiency interventions.
Despite rising critical care expenditures and critical care bed growth,(Halpern and Pastores 2009), few studies have examined the variability in intensive care across individual hospitals. Many authors describe ICU admission practice among select populations, such as those at the end of life, with low acuity disease, or of advanced age, demonstrating variation across hospitals (Rosenthal et al. 1998; Angus et al. 2004; Barnato et al. 2007; Wunsch et al. 2009). We present the first study that demonstrates the breadth of variation across hospitals in the use of intensive care for a general, acute care population. When quantified using intraclass correlations, variation in ICU use across hospitals, which we measure at 14.3 percent, is comparable to those reported for other areas of health services utilization. For example, hospitals may account for 10 percent of the variation in transfusion after coronary artery bypass graft surgery, 30 percent of variation in adherence to medication guidelines for secondary prevention of myocardial infarction(Rasmussen et al. 2008; Rogers et al. 2009; Bennett-Guerrero et al. 2010; Huesch 2011), and up to 18 percent of the variation in the quality of care for acute stroke.(Reeves et al. 2010). These hospital-level effects also exceed the proportion of variation generally attributable to providers (Fung et al. 2010). Importantly, as in other areas of medicine, this degree of variance attribution may be responsive to targeted efforts to reduce practice variability (Selby et al. 2010).
Although we are unable to determine whether intensive care was over- or underutilized within hospitals, it seems very unlikely that this degree of variation can be explained without significant overuse. Our models reveal that factors other than case mix contributed to broad variation in ICU utilization. This is an important finding as it suggests that hospitals play a significant role in determining how their ICUs are used that is not attributable to simple, clinically defined patient need. Several measured hospital characteristics helped explain some of the variability in ICU use that we observed. Specifically, smaller volume, nonteaching hospitals without intermediate care beds were more likely to use intensive care in a greater number of patients. This finding corroborates earlier data demonstrating that nonteaching and minor teaching facilities are more likely to admit lower acuity patients to the ICU (Rosenthal et al. 1998). But these measurable characteristics account for only 26 percent of the hospital effect—these data imply that there may be a large, seemingly discretionary aspect to the use of a very expensive component of hospital care.
There are several additional factors that likely contribute to the wide variation in ICU use across hospitals that we observed. First, hospitals that admit more patients to the ICU than average may operate under the assumption that delivering more critical care improves patient outcomes. Limited data support this hypothesis. A single study in Pennsylvania that examined patients at high risk of death found that odds of death were lower for those who were treated in hospitals with greater end-of-life treatment intensity (Barnato et al. 2010). Several other studies, however, suggest that greater intensive care, particularly among those who may not need it, may increase a patient's risk for iatrogenic complications and subsequent death (Levy et al. 2008; Thomas et al. 2009). Additional factors may include the absence of objective guidelines for who should be admitted to the ICU (Truog et al. 2008), or the availability of ICU beds (Joynt et al. 2001). These are only a few potential mechanisms that may contribute to variation in ICU use across hospitals that warrant furthermore investigation.
Our data have important implications for both policy makers and researchers seeking to optimize the efficiency of critical care delivery. Because U.S. hospitals receive a fixed DRG-based payment for each patient regardless of whether the ICU is required, they should have strong financial incentives to minimize unnecessary ICU use for DRG-based patients. Some of the variations we observed may reflect a given hospital improving efficiency to ensure that the ICU is reserved for the most “profitable” patients (e.g., those undergoing cardiac bypass surgery). Hospitals outside the United States may be less susceptible to this incentive. The dramatic variation in ICU use we observed suggests that there are opportunities for some hospitals to reduce critical care expenditures. To do so, hospital leaders could compare their hospital's adjusted rate of ICU use to that of others, and if it deviates from the mean, examine their local practice patterns to identify the drivers of use of this expensive resource. Researchers can use a ranking of critical care capable hospitals to identify outliers and, through quantitative and qualitative study, determine the extent to which the hospital's structure of critical care delivery, norms of care, or the professionals providing care within these hospitals to explain their deviation from average hospitals, and how this deviation associates with outcome (Barnato et al. 2009). Importantly, our data suggest, similar to quality monitoring in other areas of health care (Dimick, Staiger, and Birkmeyer 2010), that any effort to rank hospitals should first ensure that rates of ICU use are fully adjusted for patient differences and for the reliability of ICU user purely as a result of patient differences or infrequent admissions.
However, there may also be physician incentives to utilize the ICU that are independent of a hospital's approach to efficiency. The majority of critically ill patients in the United States are older than 65 years, a population of individuals largely insured by fee-for-service Medicare (Angus et al. 2004; Milbrandt et al. 2008). During the care of fee-for-service beneficiaries, nonsalaried physicians may overuse intensive care to maximize their billings. For example, by admitting patients who may not need intensive care to the ICU, physicians have more justification to bill for greater complexity or comprehensiveness of care. The greater availability of technology in the ICU provides opportunities for physicians to perform additional diagnostic tests and invasive procedures—this may not only offer both financial incentives (more billing) but also nonpecuniary incentives in a world where “doing everything” is sometimes considered the hallmark of an effective and conscientious physician (Garland et al. 2006; Song et al. 2010). These physician incentives occur in the context of an increasing supply of critical care beds in the United States (Halpern and Pastores 2010). In this respect, physicians' opportunity to admit patients to the ICU has never been greater. Together, these issues may in part drive the variation in ICU use we observed. In the future, bundled payments which reward quality and efficiency may alleviate some of the financial incentives for physicians and hospitals which drive ICU variation. The imminent implementation of bundled payments and more broadly, accountable care organizations (ACO)—where physicians and hospitals share a fixed price for an episode of care (Mechanic and Altman 2009)—may be an effective way to eliminate ICU overuse caused by physician incentives.
We recognize several limitations to our study. First, our estimates for hospital-level variation in intensive care use are limited by the completeness of case mix adjustment. Importantly, we used several case mix adjustment tools (Ash et al. 2003; Quan et al. 2005; Ehlenbach et al. 2010) to account for patient differences across hospitals, yet these tools were not developed to predict intensive care utilization and may not fully capture an individual's propensity for needing the ICU. Compared to a model without patient variables, we observed that the hospital-level ICC increased after more complete adjustment for patient-level heterogeneity. These results are reassuring, but they do not remove with certainty the potential for unmeasured severity of illness to alter our estimates of variation in ICU use across hospitals. We also evaluated our models in specific conditions for which ICU admission may be more standardized (congestive heart failure, acute myocardial infarction) and found that significant hospital-level variation remained. Second, we were unable to account for physician practice variation in intensive care use within hospitals. Although debated (Krein et al. 2002), physician-level variation may be a measurable contributor to differences in health care utilization across several areas of medicine (Hershman et al. 2009; Huesch 2011), including critical care,(Escher, Perneger, and Chevrolet 2004; Garland et al. 2006), but was unmeasured in our datasets. Rather, we focused on hospitals, which have organizational characteristics and ICU structures that are inherently modifiable components of a critical care system (Angus and Black 2004; Kim et al. 2010) and have some degree of responsibility for which physicians practice within their walls. Third, we used a dichotomous variable for the availability of intermediate care within hospitals. This variable may not capture the full breadth of structural differences that comprise individual hospitals' critical care capabilities outside the ICU. Finally, as in much literature on variation in practice patterns (Fung et al. 2010; Reeves et al. 2010; Selby et al. 2010), our data do not evaluate the impact of variation and patient outcomes such as mortality and morbidity. Additional measures for case mix adjustment, severity of illness, and patient-centered outcomes such as 30-day mortality and functional status, not available in our dataset, would be required for these important future analyses. As such, we can only hypothesize about the impact on patients of the observed variation in intensive care use.
In summary, there is significant variability in the use of intensive care across hospitals that is not accounted for by differences in patient characteristics or most typically measured hospital characteristics. With the goal of improving efficiency and stemming the increase in critical care costs, the present work demonstrates that there is a potential policy opportunity for a greater focus on modifiable hospital practice patterns which may contribute to the broad hospital-level variation in the use of intensive care.
Acknowledgments
Funding support: Dr. Seymour was supported in part by an National Institutes of Health (NIH) award from the National Center for Research Resources (KL2 RR025015). Dr. Wunsch is supported in part by an NIH award from the National Institutes on Aging (K08AG038477). Dr. Iwashyna is supported in part by an NIH award from the National Heart, Lung, and Blood Insitute (K08HL091249-01). Dr. Cooke was supported in part by the Robert Wood Johnson Foundation Clinical Scholars Program.
SUPPORTING INFORMATION
Additional supporting information may be found in the online version of this article:
Appendix SA1: Author Matrix.
Appendix S1. eMethods.
eTable S1. ICD-9-CM Diagnosis and Procedures Codes for Additional Case Mix Adjustment in Model 2.
eTable S2. Hospital Characteristics$.
eTable S3. Stepwise Adjustment for Patient Factors in Model 2.
eTable S4. Regression Coefficients from Final Logistic Mixed Effects Model of Intensive Care Unit Utilization, Showing Hospital Variables.*
eFigure S1. Simple Conceptual Framework for Intensive Care Use.
eFigure S2. Proportion of Total Hospitalizations across Hospitals Who Received Intensive Care. (Proportions are generated from hierarchical models with reliability adjustment.)
Please note: Wiley-Blackwell is not responsible for the content or functionality of any supporting materials supplied by the authors. Any queries (other than missing material) should be directed to the corresponding author for the article.
References
- Agency for Healthcare Research and Quality (AHRQ) 2008. “Inpatient Quality Indicators (IQI) Composite Measure Workgroup Final Report, March 2008” [accessed on October 1, 2010]. Available at http://www.qualityindicators.ahrq.gov/downloads/iqi/AHRQ_IQI_Workgroup_Final.pdf. [DOI] [PubMed]
- American Hospital Association. American Hospital Association Annual Survey Database for Fiscal Year 2001. Chicago, IL: American Hospital Association; 2001. [Google Scholar]
- Andersen R, Chen MS, Aday LA, Cornelius L. “Health Status and Medical Care Utilization”. Health Affairs (Millwood) 1987;6(1):136–56. doi: 10.1377/hlthaff.6.1.136. [DOI] [PubMed] [Google Scholar]
- Angus DC, Black N. “Improving Care of the Critically Ill: Institutional and Health-Care System Approaches”. Lancet. 2004;363(9417):1314–20. doi: 10.1016/S0140-6736(04)16007-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Angus DC, Barnato AE, Linde-Zwirble WT, Weissfeld LA, Watson RS, Rickert T, Rubenfeld GD. “Use of Intensive Care at the End of Life in the United States: An Epidemiologic Study”. Critical Care Medicine. 2004;32(3):638–43. doi: 10.1097/01.ccm.0000114816.62331.08. [DOI] [PubMed] [Google Scholar]
- Ash AS, Posner MA, Speckman J, Franco S, Yacht AC, Bramwell L. “Using Claims Data to Examine Mortality Trends Following Hospitalization for Heart Attack in Medicare”. Health Services Research. 2003;38(5):1253–62. doi: 10.1111/1475-6773.00175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barnato AE, Bost JE, Farrell MH, Lave JR, Arnold RM, Rubio DM, Angus DC. “Relationship Between Staff Perceptions of Hospital Norms and Hospital-Level End-of-Life Treatment Intensity”. Journal of Palliative Medicine. 2007;10(5):1093–100. doi: 10.1089/jpm.2006.0258. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barnato AE, Farrell MH, Chang CC, Lave JR, Roberts MS, Angus DC. “Development and Validation of Hospital “End-of-Life” Treatment Intensity Measures”. Medical Care. 2009;47(10):1098–105. doi: 10.1097/MLR.0b013e3181993191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barnato AE, Chang CC, Farrell MH, Lave JR, Roberts MS, Angus DC. “Is Survival Better at Hospitals with Higher “End-of-Life” Treatment Intensity?”. Medical Care. 2010;48(2):125–32. doi: 10.1097/MLR.0b013e3181c161e4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bennett-Guerrero E, Zhao Y, O'Brien SM, Ferguson TB, Jr, Peterson ED, Gammie JS, Song HK. “Variation in Use of Blood Transfusion in Coronary Artery Bypass Graft Surgery”. Journal of the American Medical Association. 2010;304(14):1568–75. doi: 10.1001/jama.2010.1406. [DOI] [PubMed] [Google Scholar]
- Casper M, Nwaise I, Croft JB, Hong Y, Fang J, Greer S. “Geographic Disparities in Heart Failure Hospitalization Rates among Medicare Beneficiaries”. Journal of the American College of Cardiology. 2010;55(4):294–9. doi: 10.1016/j.jacc.2009.10.021. [DOI] [PubMed] [Google Scholar]
- Centers for Medicare and Medicaid Services. 2006. “Cost Reports” [accessed on October 1, 2010]. Available at http://www.cms.hhs.gov.offcampus.lib.washington.edu/CostReports/
- Clinical Classifications Software (CCS) 2009. “Clinical Classifications Software (CCS) for ICD-9-CM” [accessed on June 1, 2009]. Available at http://www.hcup-us.ahrq.gov/toolssoftware/ccs/ccs.jsp.
- Dimick JB, Staiger DO, Birkmeyer JD. “Ranking Hospitals on Surgical Mortality: The Importance of Reliability Adjustment”. Health Services Research. 2010;45(6 Pt 1):1614–29. doi: 10.1111/j.1475-6773.2010.01158.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ehlenbach WJ, Hough CL, Crane PK, Haneuse SJ, Carson SS, Curtis JR, Larson EB. “Association between Acute Care and Critical Illness Hospitalization and Cognitive Function in Older Adults”. Journal of the American Medical Association. 2010;303(8):763–70. doi: 10.1001/jama.2010.167. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Escher M, Perneger TV, Chevrolet JC. “National Questionnaire Survey on What Influences Doctors' Decisions about Admission to Intensive Care”. British Medical Journal. 2004;329(7463):425. doi: 10.1136/bmj.329.7463.425. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fry AM, Shay DK, Holman RC, Curns AT, Anderson LJ. “Trends in Hospitalizations for Pneumonia among Persons Aged 65 Years or Older in the United States, 1988-2002”. Journal of the American Medical Association. 2005;294(21):2712–9. doi: 10.1001/jama.294.21.2712. [DOI] [PubMed] [Google Scholar]
- Fung V, Schmittdiel JA, Fireman B, Meer A, Thomas S, Smider N, Hsu J, Selby JV. “Meaningful Variation in Performance: A Systematic Literature Review”. Medical Care. 2010;48(2):140–8. doi: 10.1097/MLR.0b013e3181bd4dc3. [DOI] [PubMed] [Google Scholar]
- Garland A, Shaman Z, Baron J, Connors AF., Jr “Physician-Attributable Differences in Intensive Care Unit Costs: A Single-Center Study”. American Journal of Respiratory and Critical Care Medicine. 2006;174(11):1206–10. doi: 10.1164/rccm.200511-1810OC. [DOI] [PubMed] [Google Scholar]
- Ghaferi AA, Birkmeyer JD, Dimick JB. “Complications, Failure to Rescue, and Mortality with Major Inpatient Surgery in Medicare Patients”. Annals of Surgery. 2009;250(6):1029–34. doi: 10.1097/sla.0b013e3181bef697. [DOI] [PubMed] [Google Scholar]
- Ghali WA, Ash AS, Hall RE, Moskowitz MA. “Variation in Hospital Rates of Intraaortic Balloon Pump Use in Coronary Artery Bypass Operations”. Annals of Thoracic Surgery. 1999;67(2):441–5. doi: 10.1016/s0003-4975(98)01138-2. [DOI] [PubMed] [Google Scholar]
- Halpern NA, Pastores SM. “Critical Care Medicine in the United States 2000-2005: An Analysis of Bed Numbers, Occupancy Rates, Payer Mix, and Costs*”. Critical Care Medicine. 2009;38(1):65–71. doi: 10.1097/CCM.0b013e3181b090d0. [DOI] [PubMed] [Google Scholar]
- Pastores SM. “Critical Care Medicine in The United States 2000-2005: An Analysis of Bed Numbers, Occupancy Rates, Payer Mix, and Costs”. Critical Care Medicine. 2010;38(1):65–71. doi: 10.1097/CCM.0b013e3181b090d0. [DOI] [PubMed] [Google Scholar]
- Halpern NA, Pastores SM, Greenstein RJ. “Critical Care Medicine in the United States 1985-2000: An Analysis of Bed Numbers, Use, and Costs”. Critical Care Medicine. 2004;32(6):1254–9. doi: 10.1097/01.ccm.0000128577.31689.4c. [DOI] [PubMed] [Google Scholar]
- Halpern NA, Pastores SM, Thaler HT, Greenstein RJ. “Critical Care Medicine Use and Cost among Medicare Beneficiaries 1995-2000: Major Discrepancies between Two United States Federal Medicare Databases”. Critical Care Medicine. 2007;35(3):692–9. doi: 10.1097/01.CCM.0000257255.57899.5D. [DOI] [PubMed] [Google Scholar]
- Hayward RA, Heisler M, Adams J, Dudley RA, Hofer TP. “Overestimating Outcome Rates: Statistical Estimation When Reliability Is Suboptimal”. Health Services Research. 2007;42(4):1718–38. doi: 10.1111/j.1475-6773.2006.00661.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hershman DL, Buono D, McBride RB, Tsai WY, Neugut AI. “Influence of Private Practice Setting and Physician Characteristics on the Use of Breast Cancer Adjuvant Chemotherapy for Elderly Women”. Cancer. 2009;115(17):3848–57. doi: 10.1002/cncr.24448. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ho V, Heslin MJ, Yun H, Howard L. “Trends in Hospital and Surgeon Volume and Operative Mortality for Cancer Surgery”. Annals of Surgical Oncology. 2006;13(6):851–8. doi: 10.1245/ASO.2006.07.021. [DOI] [PubMed] [Google Scholar]
- Huesch MD. “Provider-Hospital ‘Fit’ and Patient Outcomes: Evidence from Massachusetts Cardiac Surgeons, 2002-2004”. Health Services Research. 2011;46(1Pt 1):1–26. doi: 10.1111/j.1475-6773.2010.01169.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Iwashyna TJ, Christie JD, Moody J, Kahn JM, Asch DA. “The Structure of Critical Care Transfer Networks”. Medical Care. 2009;47(7):787–93. doi: 10.1097/MLR.0b013e318197b1f5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Iwashyna TJ, Kahn JM, Hayward RA, Nallamothu BK. “Interhospital Transfers among Medicare Beneficiaries Admitted for Acute Myocardial Infarction at Nonrevascularization Hospitals”. Circ Cardiovasc Qual Outcomes. 2010;3(5):468–75. doi: 10.1161/CIRCOUTCOMES.110.957993. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Joynt GM, Gomersall CD, Tan P, Lee A, Cheng CA, Wong EL. “Prospective Evaluation of Patients Refused Admission to an Intensive Care Unit: Triage, Futility and Outcome”. Intensive Care Medicine. 2001;27(9):1459–65. doi: 10.1007/s001340101041. [DOI] [PubMed] [Google Scholar]
- Kim MM, Barnato AE, Angus DC, Fleisher LA, Kahn JM. “The Effect of Multidisciplinary Care Teams on Intensive Care Unit Mortality”. Archives of Internal Medicine. 2010;170(4):369–76. doi: 10.1001/archinternmed.2009.521. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krein SL, Hofer TP, Kerr EA, Hayward RA. “Whom Should We Profile? Examining Diabetes Care Practice Variation among Primary Care Providers, Provider Groups, and Health Care Facilities”. Health Services Research. 2002;37(5):1159–80. doi: 10.1111/1475-6773.01102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Levy MM, Rapoport J, Lemeshow S, Chalfin DB, Phillips G, Danis M. “Association between Critical Care Physician Management and Patient Mortality in the Intensive Care Unit”. Annals of Internal Medicine. 2008;148(11):801–9. doi: 10.7326/0003-4819-148-11-200806030-00002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mechanic RE, Altman SH. “Payment Reform Options: Episode Payment Is a Good Place to Start”. Health Aff (Millwood) 2009;28(2):w262–71. doi: 10.1377/hlthaff.28.2.w262. [DOI] [PubMed] [Google Scholar]
- Merlo J, Chaix B, Yang M, Lynch J, Rastam L. “A Brief Conceptual Tutorial of Multilevel Analysis in Social Epidemiology: Linking the Statistical Concept of Clustering to the Idea of Contextual Phenomenon”. Journal of Epidemiology and Community Health. 2005a;59(6):443–9. doi: 10.1136/jech.2004.023473. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Merlo J, Gerdtham UG, Eckerlund I, Hakansson S, Otterblad-Olausson P, Pakkanen M, Lindqvist PG. “Hospital Level of Care and Neonatal Mortality in Low- and High-Risk Deliveries: Reassessing the Question in Sweden by Multilevel Analysis”. Medical Care. 2005b;43(11):1092–100. doi: 10.1097/01.mlr.0000182484.14608.b9. [DOI] [PubMed] [Google Scholar]
- Merlo J, Yang M, Chaix B, Lynch J, Rastam L. “A Brief Conceptual Tutorial on Multilevel Analysis in Social Epidemiology: Investigating Contextual Phenomena in Different Groups of People”. Journal of Epidemiology and Community Health. 2005c;59(9):729–36. doi: 10.1136/jech.2004.023929. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Milbrandt EB, Kersten A, Rahim MT, Dremsizov TT, Clermont G, Cooper LM, Angus DC, Linde-Zwirble WT. “Growth of Intensive Care Unit Resource Use and Its Estimated Cost in Medicare”. Critical Care Medicine. 2008;36(9):2504–10. doi: 10.1097/CCM.0b013e318183ef84. [DOI] [PubMed] [Google Scholar]
- Morris CN. “Parametric Empirical Bayes Inference: Theory and Applications”. Journal of the American Statistical Association. 1983;78(22):47–55. [Google Scholar]
- Mullner R CK. “The American Hospital Association's Annual Survey of Hospitals: A Critical Appraisal”. Journal of Consumer Marketing. 2002;19:614–61. [Google Scholar]
- Normand ST, Glickman ME, Gatsonis CA. “Statistical Methods for Profiling Providers of Medical Care: Issues and Applications”. Journal of the American Statistical Association. 1997;92(439):803–14. [Google Scholar]
- Penchansky R, Thomas JW. “The Concept of Access: Definition and Relationship to Consumer Satisfaction”. Medical Care. 1981;19(2):127–40. doi: 10.1097/00005650-198102000-00001. [DOI] [PubMed] [Google Scholar]
- Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA. “Coding Algorithms for Defining Comorbidities in ICD-9-Cm and ICD-10 Administrative Data”. Medical Care. 2005;43(11):1130–9. doi: 10.1097/01.mlr.0000182534.19832.83. [DOI] [PubMed] [Google Scholar]
- Rabe-Hesketh S, Skrondal A. Multilevel and Longitudinal Modeling Using Stata. 2d edition. College Station, Texas: StataCorp LP; 2008. [Google Scholar]
- Rasmussen S, Abildstrom SZ, Rasmussen JN, Gislason GH, Schramm TK, Folke F, Kober L, Torp-Pedersen C, Madsen M. “Hospital Variation in Use of Secondary Preventive Medicine after Discharge for First Acute Myocardial Infarction during 1995-2004”. Medical Care. 2008;46(1):70–7. doi: 10.1097/MLR.0b013e3181484952. [DOI] [PubMed] [Google Scholar]
- Reeves MJ, Gargano J, Maier KS, Broderick JP, Frankel M, LaBresh KA, Moomaw CJ, Schwamm L. “Patient-Level and Hospital-Level Determinants of the Quality of Acute Stroke Care: A Multilevel Modeling Approach”. Stroke. 2010;41(12):2924–31. doi: 10.1161/STROKEAHA.110.598664. [DOI] [PubMed] [Google Scholar]
- Rogers MA, Blumberg N, Saint S, Langa KM, Nallamothu BK. “Hospital Variation in Transfusion and Infection after Cardiac Surgery: A Cohort Study”. BMC Medical. 2009;7:37. doi: 10.1186/1741-7015-7-37. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rosenthal GE, Sirio CA, Shepardson LB, Harper DL, Rotondi AJ, Cooper GS. “Use of Intensive Care Units for Patients with Low Severity of Illness”. Archives of Internal Medicine. 1998;158(10):1144–51. doi: 10.1001/archinte.158.10.1144. [DOI] [PubMed] [Google Scholar]
- Selby JV, Schmittdiel JA, Lee J, Fung V, Thomas S, Smider N, Crosson FJ, Hsu J, Fireman B. “Meaningful Variation in Performance: What Does Variation in Quality Tell Us about Improving Quality?”. Medical Care. 2010;48(2):133–9. doi: 10.1097/MLR.0b013e3181c15a6e. [DOI] [PubMed] [Google Scholar]
- Song Y, Skinner J, Bynum J, Sutherland J, Wennberg JE, Fisher ES. “Regional Variations in Diagnostic Practices”. New England Journal of Medicine. 2010;363(1):45–53. doi: 10.1056/NEJMsa0910881. [DOI] [PMC free article] [PubMed] [Google Scholar]
- The LeapFrog Group. 2010. [accessed on October 1, 2010]. Available at http://www.leapfroggroup.org/media/file/SurvivalPredictorWhitepaper.pdf.
- Thomas EJ, Lucke JF, Wueste L, Weavind L, Patel B. “Association of Telemedicine for Remote Monitoring of Intensive Care Patients with Mortality, Complications, and Length of Stay”. Journal of the American Medical Association. 2009;302(24):2671–8. doi: 10.1001/jama.2009.1902. [DOI] [PubMed] [Google Scholar]
- Truog RD, Campbell ML, Curtis JR, Haas CE, Luce JM, Rubenfeld GD, Rushton CH, Kaufman DC. “Recommendations for End-of-Life Care in the Intensive Care Unit: A Consensus Statement by The American College [Corrected] of Critical Care Medicine”. Critical Care Medicine. 2008;36(3):953–63. doi: 10.1097/CCM.0B013E3181659096. [DOI] [PubMed] [Google Scholar]
- Wennberg DE, Lucas FL, Siewers AE, Kellett MA, Malenka DJ. “Outcomes of Percutaneous Coronary Interventions Performed at Centers without and with Onsite Coronary Artery Bypass Graft Surgery”. Journal of the American Medical Association. 2004;292(16):1961–8. doi: 10.1001/jama.292.16.1961. [DOI] [PubMed] [Google Scholar]
- Wunsch H, Linde-Zwirble WT, Harrison DA, Barnato AE, Rowan KM, Angus DC. “Use of Intensive Care Services during Terminal Hospitalizations in England and the United States”. American Journal of Respiratory and Critical Care Medicine. 2009;180(9):875–80. doi: 10.1164/rccm.200902-0201OC. [DOI] [PubMed] [Google Scholar]
- Zimmerman JE, Wagner DP, Knaus WA, Williams JF, Kolakowski D, Draper EA. “The Use of Risk Predictions to Identify Candidates for Intermediate Care Units. Implications for Intensive Care Utilization and Cost”. Chest. 1995;108(2):490–9. doi: 10.1378/chest.108.2.490. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.