Abstract
Objective
To determine whether and to what extent the lower mortality rates for patients undergoing abdominal aortic aneurysm (AAA) repair in high volume hospitals is explained by better nursing.
Data Sources
State hospital discharge data, Multi-State Nursing Care and Patient Safety Survey, and hospital characteristics from the AHA Annual Survey.
Study Design
Cross-sectional analysis of linked patient outcomes for individuals undergoing AAA repair in four states.
Data Collection
Secondary data sources.
Principal Findings
Favorable nursing practice environments and higher hospital volumes of AAA repair are associated with lower mortality and fewer failures-to-rescue in main effects models. Further, nurse staffing interacts with volume such that there is no mortality advantage observed in high volume hospitals with poor nurse staffing. When hospitals have good nurse staffing, patients in low volume hospitals are 3.4 times as likely to die and 2.6 times as likely to die from complications as patients in high volume hospitals (p<0.001).
Conclusions
Nursing is part of the explanation for lower mortality after AAA repair in high volume hospitals. Importantly, lower mortality is not found in high volume hospitals if nurse staffing is poor.
Keywords: nurse staffing, nurse practice environment, volume-outcomes, abdominal aortic aneurysm
One of the most consistently observed and frequently reported relationships in health services research is that of the volume-outcomes relationship. Hospitals in which specific surgical procedures are performed more often, or in some cases hospitals in which the volume of specific medical conditions is greater, experience mortality rates for patients that are significantly lower than in other hospitals. This volume-outcomes relationship has led many to endorse referral of high risk surgeries to high volume hospitals under the assumption that higher hospital surgical volumes will be associated with better patient outcomes and decreased costs of health care (Leapfrog Group, Evidence Based Hospital Referral, 2010). Similarly, a volume-outcomes relationship has been suggested between provider volume and patient outcomes. However, the causal mechanisms that underlie the relationship between volumes, whether it is hospital or surgeon volume, and outcomes are not well understood. This study seeks to examine a potential mediator of the hospital volume-outcomes relationship, specifically nursing.
In the hundreds of papers appearing in the literature on the hospital volumes and mortality association, very few have considered nursing. It has been well established that nursing varies considerably across hospitals and that variation is found in nurse staffing, nurse education and the quality of the nurse practice environment, and both of these characteristics are associated with mortality (Aiken et al., 2008; Kane, et al., 2007). Since nursing is a major intervention provided by hospitals, this paper seeks to determine whether, and to what extent, nurse staffing, nurse education and the nurse practice environment explain the relationship between increased hospital volumes of high risk operations and better patient outcomes. Specifically, this article examines the role of nurse staffing, nurse education and the nurse practice environment and hospital surgical volume after abdominal aortic aneurysm (AAA) repair to further examine the underlying mechanisms leading to the volume-outcomes relationship.
Background and Significance
Two common hypotheses dominate the discussion of the underlying cause of the volume-outcomes relationship. First, the “practice-makes-perfect” hypothesis suggests that with increased volume, providers become more adept at caring for a specific patient population and thus provide more effective care (Luft, Garnick, Mark, & McPhee, 1990). The appeal of this hypothesis is the focus on both the attending physician and the hospital team. Nurses and other staff members who are more familiar with specific patient populations are likely to have increased knowledge of patient needs and more refined surveillance skills (Kutney-Lee, Lake, & Aiken, 2009; Luft et al., 1990). The second hypothesis is one of “selective referral”. This hypothesis posits that volume is higher in hospitals with better outcomes because patients seek care at facilities with a priori reputations of superior performance (Luft et al., 1990). While there are studies in support of both hypotheses, there is little research showing that increasing volume is actually associated with improved outcomes. Since the causal pathways by which volume affects outcomes are not well understood, policies derived from this research may not achieve their expected results.
Notably absent from studies examining the volume-outcomes relationship is the role of the largest group of health care providers in hospitals - nurses. This exclusion occurs despite a large number of studies in the health services research literature showing an association between nursing care and patient outcomes. Better nurse staffing, higher proportions of bachelors prepared nurses and nurse practice environments have been found to have an association with improved patient outcomes. Research suggests nurse staffing, nurse education and the nurse practice environment play significant roles in the outcomes of patients, including but not limited to patients undergoing general, vascular and orthopedic operations, surgical oncology patients, and patients hospitalized for Acquired Immunodeficiency Syndrome (AIDS), acute myocardial infarction (MI), congestive heart failure, chronic obstructive pulmonary disease, pneumonia, stroke and septicemia (Aiken et al., 2008; Aiken, Sloane, Lake, Sochalski, & Weber, 1999; Estabrooks, Midodzi, Cummings, Ricker, & Giovannetti, 2005; Friese, Lake, Aiken, Silber, & Sochalski, 2008; Needleman, Buerhaus, Mattke, Stewart, & Zelevinsky, 2002; Needleman et al., 2011; Tourangeau, Giovannetti, Tu, & Wood, 2002; Van del Heede et al., 2009).
Our interest in the role of nurses in the volumes-outcomes relationship was motivated by our earlier study (Aiken et al., 1999) of the outcomes of dedicated AIDS units where we found, contrary to other AIDS studies (Cunningham et al., 1999), that low volume hospitals with excellent nursing had significantly better outcomes than hospitals with dedicated AIDS units or specialized AIDS services and higher volumes of AIDS patients. Of the hundreds of articles published on the volume-outcomes relationship, we could identify only five others that considered the role of nursing at all, and none directly studied how nursing might account for the volume-outcomes relationship (Elting et al., 2005; Farley and Ozminkowski, 1992; Person, et al., 2004; Pronovost et al., 1999; Smith, Elting, Learn, Raut, & Mansfield, 2007). These five studies suggest the potential importance of nursing when examining the volume-outcomes relationship, although no studies specifically examine the possibility of nursing as the underlying cause of the volume-outcomes relationship, nor do they consider possible interactions between hospital volume and nursing.
Volumes and outcomes in abdominal aortic aneurysm repair
Research on the relationship between hospital surgical volume of AAA repair and patient outcomes has established an association between higher hospital surgical volume and lower patient mortality. Two systematic reviews examining the hospital volume of AAA repairs and patient outcomes found a significant association between the number of AAA repairs a hospital performed and patient mortality (Henebiens, van den Broek, Vahl, & Koelemay, 2007; Holt, Poloniecki, Gerrard, Loftus, & Thompson, 2007). Further, recent studies using the Hospital Episode Statistics database in the United Kingdom, a prospective registry from the German Society for Vascular Surgery, and the national analytic files from the Center for Medicare and Medicaid Services in the United States all suggest a significant volume-outcomes relationship in AAA repair (Dimick, & Upchurch, 2008; Eckstein et al., 2007; Holt, Poloniecki, Loftus, Michaels, & Thompson, 2007).
Patients undergoing AAA repair were chosen for this study because of recent research finding a significant volume-outcomes effect with AAA repair, the relatively high average national mortality rate (3–6%), and their availability in discharge abstract data (Fleming, Whitlock, Beil, & Lederle, 2005). Further, AAA repairs are high risk surgical interventions that do not require specialized, expensive operating equipment (e.g. cardiopulmonary bypass), allowing for greater variability in the types of hospitals performing the operation. Although technologically advanced vascular services may perform endovascular AAA repairs in hybrid theater suites, this is not required for AAA repair. Finally, states do not currently have laws that require minimum volume thresholds for performing AAA repairs.
In this study, we examine the association between nursing care and hospital AAA repair volume and patient outcomes. We extend the scope of the volume-outcomes work published to date by examining the extent to which the relationship between hospital surgical volume and patient outcomes is conditional upon nursing, specifically whether the effect of hospital volume interacts with nursing factors such as nurse staffing, nurse education and the nurse practice environment to explain the better outcomes for high volume hospitals.
Methods
The current study is a cross-sectional study of secondary data for hospitals in four states. The study linked data from nurse surveys, hospital patient discharge records, and administrative databases. The data sources included the Multi-State Nursing Care and Patient Safety Survey; 2005–2006 patient discharge data from California, New Jersey, and Pennsylvania; 2006–2007 patient discharge data from Florida; and the 2005 and 2007 American Hospital Association (AHA) Annual Survey. The databases were merged using unique hospital identifiers common to all of the data sources. Included in this analysis are 517 hospitals for which there was data from 10 or more respondents to the nurse survey and for which there was evidence from the state discharge database that at least one annual AAA repair had occurred. On average, the hospitals in the study had 49 nurse respondents and 39 discharged patients who had undergone AAA repair. The outcomes of interest included 30-day mortality and failure to rescue (FTR), defined as the death of a patient within thirty days of admission after experiencing a postoperative complication in the hospital (Clarke & Aiken, 2003; Silber et al., 2007; Silber et al., 1995; Silber et al., 1995; Silber et al., 1992). The units of analysis in the study are 517 hospitals, but the units of observation are variously hospitals, patients and nurses, and the statistical modeling is with reference to a hierarchical model in which patients are nested within hospitals. The final sample for this study of AAA repair included, 25,265 nurses and 20,409 patients in the 517 hospitals.
Nurse Survey Data
The Multi-State Nursing Care and Patient Safety Survey was collected by Aiken and colleagues at the University of Pennsylvania Center for Health Outcomes and Policy Research (Aiken et al., 2011; Aiken et al., 2010; Kendall-Gallagher, Aiken, Sloane & Cimiotti, 2011; McHugh, Kutney-Lee, Cimiotti, Sloane & Aiken, 2011; McHugh, Shang, Sloane & Aiken, 2011; Neff, Cimiotti, Heusinger & Aiken, 2011). The primary research team collected nurse survey data from California, Pennsylvania and New Jersey between September 2005 and August 2006 and in Florida between November 2007 and April 2008. Surveys were mailed to 272,783 nurses in the four states: 106,532 in California, 49,385 in Florida, 52,545 in New Jersey, and 64,321 in Pennsylvania. This large mail survey had a response rate of 39%, owing to the impossibility of targeting the mailings to hospital staff nurses, providing monetary incentives, or undertaking extensive follow-ups with such a large sample. Overall, the researchers obtained information from nine out of every ten hospitals in all four states. Additionally, a re-survey of 1,300 original non-responders had a 91% response rate and was evaluated for possible bias. The results of this survey suggested no difference in responders and non-responders in reports of hospital-level organizational features of nursing (Aiken et al., 2010; Aiken et al., 2011; Smith, 2008). Of those nurses who responded to the initial survey, 35,000 identified themselves as hospital staff nurses and further indicated on the survey their primary place of employment, including both the name of the hospital and the type of unit in which they worked.
The three primary nurse predictor variables employed in our analyses — nurse staffing, nurse education and the nurse practice environment — were measured at the hospital level, using data obtained from the nurse surveys. Nurses were asked how many nurses and patients were on their units during their last shift, and nurse staffing was calculated for each hospital by dividing the average number of patients reported by nurses on their unit on their last shift by the average number of nurses reported to be working on that unit during the same shift. These measures were aggregated across all of the nurse respondents in a given hospital to estimate the average number of patients per RN (Aiken et al., 2002; Aiken et al., 2003; Aiken et al., 2008). Nurses were also asked about their educational credentials, and nurse education was also measured at the hospital level by calculating the proportion of nurses at each hospital with a Bachelors degree or higher. Finally, the nurse survey included an inventory of questions referred to as the Practice Environment Scale of the Nursing Work Index (PES-NWI), and three of the five subscales of that index that did not overlap empirically with nurse staffing and nurse education measures were used in our analyses. These included nursing foundations for quality of care; nurse manager ability, leadership and support; and collegial nurse/physician relationships (Aiken et al., 2008; Lake, 2002). This survey measure has been extensively validated (Aiken et al., 2008; Bonneterre et al., 2008; Friese et al., 2008; Lake, 2007; Warshawsky & Havens, 2011.). Nurse responses were aggregated to obtain hospital level means for each of the subscales. Hospitals were then coded to distinguish those that were above and below the medians for each subscale. Hospitals above the median on all three subscales were classified as having good nurse practice environments, hospitals above the median on one or two of the subscales were classified as having mixed nurse practice environments and hospitals below the median on all three subscales were classified as having poor nurse practice environments.
Patient Discharge Data
Individual-level patient discharge data were linked to the hospital level measures derived from nurse survey data that are described above using hospital identifiers that were common to both data sets. Discharge data from 2005 to 2006 were used for California, New Jersey and Pennsylvania and patient discharge data from 2006 to 2007 were used for Florida, because of the slight difference in the timing of the surveys. Patient discharge data were obtained from the Office of Statewide Healthcare Planning and Development in California, The Agency for Health Care Administration in Florida, the Department of Health and Senior Services in New Jersey, and the Department of Health Care Cost Containment Council in Pennsylvania.
Hospital surgical volume was measured by the number of AAA repairs performed in each hospital over the two year period. This information was determined by scanning both the primary and secondary procedure codes in the patient discharge databases for each of the four states. Patients were included in the study if they had procedure codes 38.34, 38.44, 38.64 or 39.71, based on the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM). A total of 20,409 patients were included.
Hospitals were initially separated into tertiles based on annual volume of AAA repairs. However, the low and medium volume tertiles were combined and then compared with the high volume category after preliminary analyses revealed no differences in mortality and failure-to-rescue rates between the low and medium volume groups. The low/medium volume hospitals performed an average of 22 AAA repairs per year, while the high volume group performed an average of 142 AAA repairs per year.
Elixhauser et al’s risk adjustment approach was used, which involved coding 28 comorbidities that were identified in the patient discharge data (excluding fluid and electrolyte disorders and coagulopathy) as present or absent and including them as dummy variables in our regression analyses (Elixhauser et al., 1998). Additional risk adjustment factors included patient age, race/ethnicity, transfer status, type of medical insurance, type of AAA repair (open versus endovascular), and exigency of the repair (urgent, emergent or elective). The full list of risk adjustment variables included in the analyses can be found in the body and footnote of Table 2.
Table 2.
All Patients (n = 20,409)
|
||
---|---|---|
Characteristic | No. | (%) |
Men | 16,177 | (79.3) |
Age, mean (SD) | 73 | (9) |
Race | ||
White | 17,992 | (88.2) |
Black | 728 | (3.6) |
Other | 1,689 | (8.3) |
Type of Admission | ||
Urgent/Emergent | 9,639 | (47.3) |
Elective | 10,761 | (52.8) |
Type of Repair | ||
Open | 8,603 | (42.2) |
Endovascular | 11,806 | (57.8) |
Medical History (comorbidity)* | ||
Hypertension | 13,457 | (65.9) |
Peripheral Vascular Disorders | 7,098 | (34.8) |
Chronic Pulmonary Disease | 7,032 | (34.5) |
Diabetes, Uncomplicated | 2,773 | (13.6) |
Deficiency Anemias | 2,048 | (10.0) |
Renal Failure | 1,900 | (9.3) |
Hypothyroidism | 1,214 | (6.0) |
Obesity | 1,084 | (5.3) |
Other Neurologic Disorders | 547 | (2.7) |
Depression | 543 | (2.7) |
Solid Tumor Without Metastasis | 498 | (2.4) |
Alcohol Abuse | 484 | (2.4) |
Mortality | 1,243 | (6.1) |
Complications | 7,486 | (36.7) |
Other comorbidities used to risk adjust our models included Congestive heart failure, Cardiac arrhythmias, Valvular disease, Diabetes with complications, Liver disease, Metastatic cancer, Rheumatoid arthritis/Collagen vascular diseases, Weight loss, Pulmonary circulation disorders, Paralysis, Blood loss anemias, Drug abuse, Psychoses, Peptic ulcer disease, HIV and AIDS, and Lymphoma. All of these comorbidities were exhibited by fewer than 2 percent of all patients.
AHA Annual Survey Data
Adjustments in our models for differences in patient outcomes due to hospital characteristics not related to nursing included measures of teaching status and technology. Measurements for these two variables were obtained from the AHA Annual Survey data from 2005 for California, New Jersey and Pennsylvania, and from AHA data from 2007 for Florida. Hospitals were placed into one of three teaching categories based on the number of residents and/or fellows per hospital bed: non-teaching hospitals had zero residents/fellows; minor teaching hospitals had a ratio of 1:4 or less; and major teaching hospitals had a ratio greater than 1:4. The level of technological sophistication within a hospital was analyzed as a dichotomous variable. A hospital was defined as having a high level of technological sophistication if it provided services for open heart operations and/or major organ transplantation.
Outcome Variables
The outcomes of interest included 30-day mortality and failure to rescue (FTR). Patient discharge files from each state were examined for patients expiring within thirty days of admission. The use of 30-day mortality allowed the delay between hospital admission and presumably poor quality of care to manifest within thirty days of admission rather than within the limited timeframe of inpatient hospitalization which varied by hospital and by state (Chassin, Park, Lohr, Keesey, & Brook, 1989). FTR was defined as the death of a patient within thirty days of admission after experiencing a postoperative complication in the hospital (Clarke & Aiken, 2003; Silber et al., 2007; Silber et al., 1995; Silber et al., 1995; Silber et al., 1992). Patients experiencing complications were identified from the patient discharge databases from each state using a previously defined compilation of secondary diagnoses and procedure codes documented by Silber and colleagues (Silber et al., 2007).
Data Analysis
Descriptive statistics are presented showing 1) the characteristics of the study hospitals, 2) the numbers and percentages of patients and nurses in each of the types of hospitals defined by these characteristics, and 3) the characteristics of the patients who underwent AAA repair, including the percentages with different comorbidities and the percentages that died. Both logistic regression and random effects models were used to estimate the effects of hospital volume of AAA repairs, nurse staffing, and the nurse practice environment on both patient mortality and FTR before and after controlling for patient and hospital characteristics. The final model we describe includes a significant interaction between nurse staffing and surgical volume, and we use main and interaction effect coefficients from that model to estimate how the effect of staffing varies as a function of hospital volume, and vice-versa. While multivariate analysis included both robust regression models and random effects models, the results were unaffected by the choice of modeling procedure. Thus, we show only the logistic regression models in this paper in keeping with prior studies use of these models when studying the volume-outcomes effect. All models were corrected for the lack of independence (or the clustering) of nurses and patients within hospitals by using Huber-White (robust) procedures to adjust the standard errors. All analyses were conducted using STATA version 11 (STATA Corp., College Station, TX), using p < 0.5 to indicate statistical significance.
Results
Table 1 provides information about the characteristics of the 517 hospitals included in the study, including the numbers and percentages of patients and nurses in each of the types of hospitals defined by these characteristics. More than one-third of the study hospitals were located in California (38%), while Florida (28%) and Pennsylvania (22%) had slightly fewer hospitals. New Jersey had the fewest number of hospitals in the study, representing 12% of the sample. Roughly 45% of the hospitals had average patient to nurse ratios of 4 or less, while about one in four of the hospitals had average patient to nurse ratios of 6 or more. The nurse practice environment varied across hospitals, with nearly 30% of hospitals having poor practice environments and nearly 30% having good nurse practice environments. Twice as many hospitals were designated as low/medium volume hospitals with respect to AAA repairs (347 or 67%) compared with hospitals designated as high volume (170 or 33%). A similar number of hospitals in the sample were identified as institutions with increased levels of technological sophistication (50%) compared with hospitals with less technology available to them (50%). The majority of hospitals in the sample were either non-teaching hospitals (47%) or minor teaching hospitals (45%), with only 8% of hospitals in the sample being characterized as major teaching institutions. It is noteworthy that while less than one third of the hospitals in our sample were high volume and less than half were high technology, high volume and high technology hospitals provided care to more than three fourths of the patients in the study. Major teaching hospitals also provided care to a disproportionately high number of AAA patients.
Table 1.
Hospitals (n=517) | Patients (n=20,409) | Nurses (n=25,265) | ||||
---|---|---|---|---|---|---|
| ||||||
Hospital Characteristic | No. | (%) | No. | (%) | No. | (%) |
Location | ||||||
California | 196 | (37.9) | 5,945 | (29.1) | 7,794 | (30.8) |
Florida | 145 | (28.0) | 6,914 | (33.9) | 5,594 | (22.1) |
New Jersey | 64 | (12.4) | 2,090 | (10.2) | 5,521 | (21.9) |
Pennsylvania | 112 | (21.7) | 5,460 | (26.8) | 6,356 | (25.2) |
Nurse Staffing (Patients/Nurse) | ||||||
4 or fewer | 230 | (44.5) | 906 | (4.4) | 12,265 | (60.4) |
5 | 153 | (29.6) | 3,400 | (16.7) | 2,564 | (12.6) |
6 | 76 | (14.7) | 5,821 | (28.5) | 2,061 | (10.1) |
7 or more | 58 | (11.2) | 10,282 | (50.4) | 3,422 | (16.8) |
Nurse Practice Environment | ||||||
Poor | 150 | (29.0) | 4,108 | (20.1) | 5,833 | (23.2) |
Mixed | 216 | (41.8) | 9,131 | (44.7) | 10,750 | (42.7) |
Good | 151 | (29.2) | 7,170 | (35.1) | 8,575 | (34.1) |
Volume | ||||||
Low/Medium | 347 | (67.1) | 4,596 | (22.5) | 11,786 | (46.8) |
High | 170 | (32.9) | 15,813 | (77.5) | 13,372 | (53.2) |
Technology | ||||||
Not High Technology | 261 | (50.5) | 4,719 | (23.1) | 9,170 | (36.5) |
High Technology | 256 | (49.5) | 15,690 | (76.9) | 15,988 | (63.5) |
Teaching Status | ||||||
None | 240 | (47.2) | 7,496 | (37.0) | 9,973 | (40.0) |
Minor | 226 | (44.5) | 8,828 | (43.6) | 11,112 | (44.6) |
Major | 42 | (8.3) | 3,931 | (19.4) | 3,835 | (15.4) |
Table 2 provides information on selected characteristics of the patients included in the analyses. Of the 20,409 AAA patients included in the study, the vast majority were male (79%) and white (88%). The average age of the patients in the sample was 73. Slightly more than half of the study sample underwent elective AAA repair (53%), and the majority of patients had an endovascular repair (58%). The most common comorbidity exhibited by the sample was hypertension (66%), followed by peripheral vascular disease (35%), chronic pulmonary disease (35%), and diabetes (14%). Roughly 36% of these AAA patients had complications during their hospitalization. Overall, 6% of the patients died within 30-days of admission.
Table 3 shows odds ratios, as well as 95% confidence intervals and the probabilities associated with them, from various models that were fit to describe the effects of hospital volume, nurse staffing, nurse education and the nurse practice environment on mortality (in the upper panel of the table) and FTR (lower panel) subsequent to AAA surgeries. The odds ratios in the first row of each panel are unadjusted odds ratios from bivariate models which estimate the effect of each factor on mortality and failure when the other factors, and other potential confounds more generally, are ignored. The odds ratios in the second row of each panel are from fully adjusted “main-effects” models, which estimate the effects of each factor simultaneously while controlling for differences in patient characteristics and other hospital characteristics. The odds ratios in the third row of each panel are from multivariate models that are like the main-effects models in that they include all three of the hospital variables identified in the table as well as the different patient characteristics and other hospital characteristics. However, in this model the effects of nurse staffing and hospital volume are allowed to interact, and the odds ratios describing these interactions are shown in the third row of each panel. We also evaluated models that included an interaction between the nurse practice environment and hospital volumes, and nurse education and hospital volumes, but the interactions were found to be insignificant.
Table 3.
Odds Ratios from Models for Patient Mortality | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
Nurse Staffing (Patients per nurse) | Nurse Practice Environment (Favorable/ Unfavorable) | Nurse Education (Proportion of nurses with BSN) | Hospital AAA Repair Volume (# of AAA repairs annually) | Staffing x AAA Volume (Interaction) | ||||||
|
||||||||||
Model | OR (95% CI) | P | OR (95% CI) | P | OR (95% CI) | P | OR (95% CI) | P | OR (95% CI) | P |
Unadjusted | 1.12 (1.038–1.202) | 0.003 | 0.85 (0.762–0.957) | 0.007 | 0.35 (0.189–0.631) | 0.001 | 0.25 (0.203–0.320) | <0.001 | ||
Fully Adjusted* | 1.07 (0.990–1.165) | 0.086 | 0.89 (0.796–0.986) | 0.027 | 0.58 (0.304–1.125) | 0.108 | 0.45 (0.337–0.589) | <0.001 | ||
Fully Adjusted* with Staffing Interaction/Regression | 0.84 (0.721–0.988) | 0.034 | 0.89 (0.800–0.989) | 0.031 | 0.63 (0.326–1.230) | 0.177 | 0.09 (0.036–0.233) | <0.001 | 1.34 (1.127–1.583) | 0.001 |
Odds Ratios from Models for Failure to Rescue | ||||||||||
| ||||||||||
Nurse Staffing (Patients per nurse) | Nurse Practice Environment (Favorable/ Unfavorable) | Nurse Education (Proportion of nurses with BSN) | Hospital AAA Repair Volume (# of AAA repairs annually) | Staffing x AAA Volume (Interaction) | ||||||
|
||||||||||
Model | OR (95% CI) | P | OR (95% CI) | P | OR (95% CI) | P | OR (95% CI) | P | OR (95% CI) | P |
Unadjusted | 1.08 (1.015–1.156) | 0.016 | 0.88 (0.792–0.975) | 0.015 | 0.57 (0.323–1.004) | 0.052 | 0.41 (0.323–0.510) | <0.001 | ||
Fully Adjusted* | 1.07 (0.985–1.156) | 0.113 | 0.90 (0.804–0.998) | 0.047 | 0.85 (0.436–4.641) | 0.621 | 0.51 (0.390–0.672) | <0.001 | ||
Fully Adjusted* with Staffing Interaction /Regression | 0.91 (0.775–1.074) | 0.270 | 0.90 (0.806–1.000) | 0.050 | 0.89 (0.458–1.735) | 0.734 | 0.19 (0.071–0.485) | 0.001 | 1.21 (1.013–1.436) | 0.036 |
Odds ratios and CIs were derived from robust regression models that accounted for clustering of observations within hospitals and adjusted for patient’s age, sex, race, type of admission, insurance status, comorbidities, state, and hospital technology and teaching status.
The unadjusted odds ratios suggest that, when the effect of each variable is considered independently, staffing, practice environment, and volume have significant effects on both mortality and FTR. Higher workload (or each additional patient per nurse) increases the odds on patients dying and being involved in a FTR, by factors of 1.12 and 1.08, respectively. Better practice environments decrease the odds on deaths and failures, by factors of 0.85 and 0.88, respectively. Finally, patients in low volume hospitals have higher odds on deaths and failures than patients in high volume hospitals by factors of 4.0 and 2.4.
The estimated effects of the nurse practice environment are largely unaffected by estimating it while controlling for patient characteristics and other hospital characteristics. That is, the odds ratios from the fully adjusted main effects model for the nurse practice environment are similar to the unadjusted odds ratios. Interestingly, the effect of hospital volume is somewhat attenuated in the adjusted model, from 0.25 to 0.45 in the case of mortality and from 0.41 to 0.51 in the case of FTR. So after taking account of differences in nurse staffing and practice environments, patients in low volume hospitals have higher odds on deaths and failures than patients in high volume hospitals, by factors of 2.2 (rather than 4.0) and 1.9 (rather than 2.4). Ultimately, we find that the main-effects specification is not entirely consistent with the data and that the significant interaction between staffing and volume on both outcomes (shown in the far right column of Table 3) is significant and provides a better fit of model to data. The implications of the interaction are shown in Table 4.
Table 4.
When the Hospital Volume of AAA Repairs is… | The Odds Ratio Indicating the Effect of Nurse Staffing is… | |
---|---|---|
| ||
On Mortality (95% CI) | On Failure to Rescue (95% CI) | |
|
||
Low/Medium Volume | 0.844* (0.721–0.988) | 0.912 (0.775–1.074) |
High Volume | 1.127* (1.036–1.227) | 1.100* (1.012–1.196) |
The Odds Ratio Indicating the Effect of Hospital Volume of AAA Repairs is… | ||
| ||
When the Hospitals Patient to Nurse Ratio is… | On Mortality (95% CI) | On Failure to Rescue (95% CI) |
|
||
Four patients per nurse | 0.292** (0.207–0.412) | 0.394** (0.278–0.557) |
Six patients per nurse | 0.521** (0.388–0.699) | 0.573** (0.426–0.770) |
Eight patients per nurse | 0.929 (0.545–1.585) | 0.833 (0.482–1.440) |
p value <0.05
p value <0.001
All values were derived from robust regression models that accounted for clustering of observations within hospitals and adjusted for patient’s age, sex, race, type of admission, insurance status, comorbidities, state and hospital technology and teaching status.
The top panel of Table 4 shows the effect of higher patient to nurse ratios on both death and FTR, first in hospitals with a low volume of AAA repairs and then in hospitals with a high volume of AAA repairs. In low volume hospitals the effect of staffing is virtually nil, while in high volume hospitals adding one additional patient per nurse increases the odds of patient death by a factor of 1.13 (or by13%) and the odds of FTR by a factor of 1.10 (or by 10%). The bottom panel of the table shows the effect of hospital volume of AAA repairs on mortality and failure in hospitals with varying levels of nurse staffing. In hospitals with patient to nurse ratios of 8:1, the effect of hospital volume of AAA repairs on both outcomes is insignificant. In hospitals with 6:1 ratios however, patients in hospitals with high volume are less likely to die and fail than patients in low volume hospitals, by factors of 0.52 and 0.57, respectively. And in hospitals with 4:1 patient to nurse ratios, the differences between high and low volume hospitals is even more pronounced. Patients in the high volume hospitals are less likely than those in low volume hospitals to die or fail by factors of 0.29 and 0.39, respectively, which implies that, even after all of the effects of all of the other patient and hospital characteristics are controlled for, patients in well staffed low volume hospitals are 3.4 times as likely to die and 2.6 times as likely to fail as patients in well staffed high volume hospitals.
Discussion
Our findings suggest that the volume of AAA repairs in hospitals to which patients are admitted has a pronounced effect on the likelihood of AAA patients dying, with or without complications, and that nurse staffing and the quality of the nurse practice environment also have effects on both outcomes. We anticipated finding that the two nurse factors might account for the volumes effect, since it seemed likely that high volume hospitals may be better staffed and have better work environments. When we restricted our attention to main effects models, we found some support for this, especially with respect to mortality. Before taking account of the nursing factors, it appeared that patients in low volume hospitals were about 4 times as likely to die as patients in high volume hospitals, but after taking account of the nursing factors, patients in low volume hospitals were only slightly more than two times as likely to die as patients in high volume hospitals. It turned out to be slightly more complicated than that, inasmuch as ultimately we found that the effect of volumes was very much conditional on, if not explained by, nurse staffing. In poorly staffed hospitals increased volume made little difference on mortality, but in well staffed hospitals it made a pronounced difference. In hospitals in which the patient to nurse ratio was around 4:1, patients had lower odds of dying when hospitals had high volumes of AAA patients rather than lower volumes, by factors of 0.39 (or over 60% lower) and 0.57 (over 40 percent lower) for mortality and FTR. Thus, in poorly staffed hospitals, an increased hospital volume of AAA repairs does not affect mortality as it does in well staffed hospitals.
The results of this analysis depart from previous findings examining the role of nurses’ education on patient outcomes (Aiken et al., 2003). Specifically, the association between the proportion of nurses with a bachelor’s degree or higher and patient outcomes was not significant. However, the results of this study are based on a much smaller sample size than previous work. When comparing the education coefficients between previous publications with this work, the size of the coefficients are not that different. This suggests that the absence of a significant association between nurses’ education and mortality outcomes seen in this study may be a result of sample size.
Our data are cross-sectional, which limits the extent to which causal inferences can be made. Further, while our procedure for risk adjusting the patient characteristics in the different hospitals is fairly standard and involves controlling for, among other things, a large number of comorbidities, it is possible that omitted variables could be affecting our estimates. Also, our nurse-based estimates of the workloads and practice environments are subject to some error. This error might be larger in smaller hospitals where the estimates are derived from smaller numbers of nurse respondents, and workload estimates could also be affected by the relative number of nurse respondents in a hospital working in ICUs or other units where workloads are lower. However, our prior research has convinced us that the measure of staffing we are employing is better than alternatives (i.e., has greater predictive validity), and there is no reliable alternative measure of the work environment. Our study focuses on a single patient group, AAA repairs, and our result will need be replicated with other groups. Finally, our data sources are from 2005–2007 and we cannot account for technological advances that may have occurred since that time that could affect patient outcomes.
The results here suggest, quite strongly, that future research should consider whether hospital volume has an effect on other groups of patients, and under what conditions. While a great deal of attention in research is focused on the issue of whether critical variables have been omitted, less attention has been paid to whether the nature of the effects of the variables included in the study have been properly specified, and in particular to whether effects are interactive.
The primary policy recommendation arising from research documenting a volumes outcomes relationship has been to regionalize care. Regionalization, however, poses potential risks for poor outcomes by removing patients from close proximity to their support networks. We show that outcomes are not always better in high volume hospitals. Indeed, there is no mortality advantage for patients undergoing AAA repairs in high volume hospitals in the absence of good nurse to patient staffing ratios. As such, regionalizing care for AAA repairs to improve outcomes might best be accompanied by a consideration of the nurse work environments and most especially the nurse staffing in the hospitals in which the care is provided.
Supplementary Material
Acknowledgments
Joint Acknowledgement/Disclosure Statement: We thank Tim Cheney for his assistance with data analysis throughout this work. This project was funded by the National Institute of Nursing Research, National Institutes of Health, R01-NR-004513 (Aiken, PI) and T32-NR-007104 (Aiken, PI).
Footnotes
Disclosures: None
Disclaimers: None
Contributor Information
Kelly L. Wiltse Nicely, Email: wiltse@nursing.upenn.edu, Center for Health Outcomes and Policy Research, University of Pennsylvania, 418 Curie Boulevard, Philadelphia, PA 19104-4217, 215.746.8362.
Douglas M. Sloane, Email: sloane@nursing.upenn.edu, Center for Health Outcomes and Policy Research, University of Pennsylvania, 418 Curie Boulevard, Philadelphia, PA 19104-4217, 215.898.5673.
Linda H. Aiken, Email: laiken@nursing.upenn.edu, Center for Health Outcomes and Policy Research, University of Pennsylvania, 418 Curie Boulevard, Philadelphia, PA 19104-4217, 215.898.5673.
References
- Aiken LH, Cimiotti JP, Sloane DM, Smith HL, Flynn L, Neff DF. Effects of nurse staffing and nurse education on patient deaths in hospitals with different nurse work environments. Medical Care. 2011;49(12):1047–1053. doi: 10.1097/MLR.0b013e3182330b6e. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aiken LH, Clarke SP, Cheung RB, Sloane DM, Silber JH. Educational levels of hospital nurses and surgical patient mortality. Journal of the American Medical Association. 2003;290(12):1617–1623. doi: 10.1001/jama.290.12.1617. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aiken LH, Clarke SP, Sloane DM, Lake ET, Cheney T. Effects of hospital care environment on patient mortality and nurse outcomes. Journal of Nursing Administration. 2008;38(5):223–229. doi: 10.1097/01.NNA.0000312773.42352.d7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Aiken LH, Clarke SP, Sloane DM, Sochalski J, Silber JH. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. Journal of the American Medical Association. 2002;288(16):1987–1993. doi: 10.1001/jama.288.16.1987. [DOI] [PubMed] [Google Scholar]
- Aiken LH, Sloane DM, Lake ET, Sochalski J, Weber AL. Organization and outcomes of inpatient AIDS care. Medical Care. 1999;37(8):760–772. doi: 10.1097/00005650-199908000-00006. [DOI] [PubMed] [Google Scholar]
- Aiken LH, Sloane DM, Cimiotti JP, Clarke SP, Flynn L, Seago JA, Smith HL. Implications of the California nurse staffing mandate for other states. Health Services Research. 2010;45(4):904–921. doi: 10.1111/j.1475-6773.2010.01114.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chassin MR, Park RE, Lohr KN, Keesey J, Brook RH. Differences among hospitals in medicare patient mortality. Health Services Research. 1989;24(1):1–31. [PMC free article] [PubMed] [Google Scholar]
- Clarke SP, Aiken LH. Failure to rescue: Needless deaths are prime examples of the need for more nurses at the bedside. American Journal of Nursing. 2003;103(1):42–47. doi: 10.1097/00000446-200301000-00020. [DOI] [PubMed] [Google Scholar]
- Cunningham WE, Tisnado DM, Lui HH, Nakazono TT, Carlisle DM. The effect of hospital experience on mortality among patients hospitalized with acquired immunodeficiency syndrome in California. American Journal of Medicine. 1999;107(2):137–143. doi: 10.1016/s0002-9343(99)00195-3. [DOI] [PubMed] [Google Scholar]
- Dimick JB, Upchurch GR. Endovascular technology, hospital volume, and mortality with abdominal aortic aneurysm surgery. Journal of Vascular Surgery. 2008;47(6):1150–1154. doi: 10.1016/j.jvs.2008.01.054. [DOI] [PubMed] [Google Scholar]
- Eckstein HH, Bruckner T, Heider P, Wolf O, Hanke M, Niedermeier HP, et al. The relationship between volume and outcome following elective open repair of abdominal aortic aneurysms in 131 German hospitals. European Journal of Endovascular Surgery. 2007;34(3):260–266. doi: 10.1016/j.ejvs.2007.05.006. [DOI] [PubMed] [Google Scholar]
- Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Medical Care. 1998;36(1):8–27. doi: 10.1097/00005650-199801000-00004. [DOI] [PubMed] [Google Scholar]
- Elting LS, Pettaway C, Bekele BN, Grossman HB, Cooksley C, Avritscher EB, et al. Correlation between annual volume of cystectomy, professional staffing, and outcomes. Cancer. 2005;104(5):975–984. doi: 10.1002/cncr.21273. [DOI] [PubMed] [Google Scholar]
- Estabrooks CA, Midodzi WK, Cummings GG, Ricker KL, Giovannetti P. The impact of hospital nursing characteristics on 30 day mortality. Nursing Research. 2005;54(2):74–84. doi: 10.1097/00006199-200503000-00002. [DOI] [PubMed] [Google Scholar]
- Farley DE, Ozminkowski RJ. Volume-outcome relationships and in-hospital mortality: The effect of changes in volume over time. Medical Care. 1992;30(1):77–94. doi: 10.1097/00005650-199201000-00009. [DOI] [PubMed] [Google Scholar]
- Fleming C, Whitlock EP, Beil TL, Lederle FA. Screening for abdominal aortic aneurysm: A best-evidence systematic review for the U.S. preventive services task force. Annals of Internal Medicine. 2005;142(3):203–211. doi: 10.7326/0003-4819-142-3-200502010-00012. [DOI] [PubMed] [Google Scholar]
- Friese CR, Lake ET, Aiken LH, Silber JH, Sochalski J. Hospital nurse practice environments and outcomes for surgical oncology patients. Health Services Research. 2008;43(4):1145–1163. doi: 10.1111/j.1475-6773.2007.00825.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Henebiens M, van den Broek TA, Vahl AC, Koelemay MJ. Relations between hospital volume and outcome of elective surgery for abdominal aortic aneurysm: A systematic review. European Journal of Endovascular Surgery. 2007;33(3):285–292. doi: 10.1016/j.ejvs.2006.10.010. [DOI] [PubMed] [Google Scholar]
- Holt PJ, Poloniecki JD, Gerrard D, Loftus IM, Thompson MM. Meta-analysis and systematic review of the relationship between volume and outcome in abdominal aortic aneurysm surgery. British Journal of Surgery. 2007;94(4):395–403. doi: 10.1002/bjs.5710. [DOI] [PubMed] [Google Scholar]
- Holt PJ, Poloniecki JD, Loftus IM, Michaels JA, Thompson MM. Epidemiological study of the relationship between volume and outcome after abdominal aortic aneurysm surgery in the UK from 2000 to 2005. British Journal of Surgery. 2007;94(4):441–448. doi: 10.1002/bjs.5725. [DOI] [PubMed] [Google Scholar]
- Kane RL, Shamliyan TA, Mueller C, Duval S, Wilt TJ. The association of registered nurse staffing levels and patient outcomes: Systematic review and meta-analysis. Medical Care. 2007;45(12):1195–1204. doi: 10.1097/MLR.0b013e3181468ca3. [DOI] [PubMed] [Google Scholar]
- Kendall-Gallagher D, Aiken LH, Sloane DM, Cimiotti JP. Nurse specialty certification, inpatient mortality, and failure to rescue. Journal of Nursing Scholarship. 2011;43(2):188–194. doi: 10.1111/j.1547-5069.2011.01391.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kutney-Lee A, Lake ET, Aiken LH. Development of the hospital nurse surveillance capacity profile. Research in Nursing and Health. 2009;32(2):217–228. doi: 10.1002/nur.20316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lake ET. Development of the practice environment scale of the nursing work index. Research in Nursing and Health. 2002;25(3):176–188. doi: 10.1002/nur.10032. [DOI] [PubMed] [Google Scholar]
- Lake ET. The nursing practice environment: Measurement and evidence. Medical Care Research and Review. 2007;64(suppl 2):104S–122S. doi: 10.1177/1077558707299253. [DOI] [PubMed] [Google Scholar]
- Leapfrog Group. Evidence Based Hospital Referral. Retrieved January 30, 2010 from Leapfrog Group at: http://www.leapfroggroup.org/media/file/Leapfrog-Evidence-Based_Hospital_Referral_Fact_Sheet.pdf.
- Luft HS, Garnick DW, Mark DH, McPhee SJ. Hospital volume, physician volume, and patient outcome. Ann Arbor: Health Administration Press Perspectives; 1990. [Google Scholar]
- McHugh MD, Kutney-Lee A, Cimiotti JP, Sloane DM, Aiken LH. Nurses’ widespread job dissatisfaction, burnout, and frustration with health benefits signal problems for patient care. Health Affairs. 2011;30(2):202–210. doi: 10.1377/hlthaff.2010.0100. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McHugh MD, Shang J, Sloane DM, Aiken LH. Risk factors for hospital-acquired ‘poor glycemic control’: a case-control study. International Journal for Quality in Health Care. 2011;23(1):44–51. doi: 10.1093/intqhc/mzq067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Needleman J, Buerhaus P, Mattke S, Stewart M, Zelevinsky K. Nurse-staffing levels and the quality of care in hospitals. New England Journal of Medicine. 2002;346(22):1715–1722. doi: 10.1056/NEJMsa012247. [DOI] [PubMed] [Google Scholar]
- Needleman J, Buerhaus P, Pankratz VS, Leibson CL, Stevens SR, Harris M. Nurse staffing and inpatient hospital mortality. New England Journal of Medicine. 2011;364(11):1037–1045. doi: 10.1056/NEJMsa1001025. [DOI] [PubMed] [Google Scholar]
- Neff DF, Cimiotti JP, Heusinger AS, Aiken LH. Nurse reports from the frontlines: analysis of statewide nurse survey. Nursing Forum. 2011;46(1):4–10. doi: 10.1111/j.1744-6198.2010.00201.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Person SD, Allison JJ, Kiefe CI, Weaver MT, Williams OD, Centor RM, et al. Nurse staffing and mortality for medicare patients with acute myocardial infarction. Medical Care. 2004;42(1):4–12. doi: 10.1097/01.mlr.0000102369.67404.b0. [DOI] [PubMed] [Google Scholar]
- Pronovost PJ, Jenckes MW, Dorman T, Garrett E, Breslow MJ, Rosenfeld BA, et al. Organizational characteristics of intensive care units related to outcomes of abdominal aortic surgery. Journal of the American Medical Association. 1999;281(14):1310–1317. doi: 10.1001/jama.281.14.1310. [DOI] [PubMed] [Google Scholar]
- Silber JH, Romano PS, Rosen AK, Wang Y, Even-Shoshan O, Volpp K. Failure-to-rescue: Comparing definitions to measure quality of care. Medical Care. 2007;45(10):918–925. doi: 10.1097/MLR.0b013e31812e01cc. [DOI] [PubMed] [Google Scholar]
- Silber JH, Rosenbaum PR, Ross RN. Comparing the contributions of groups of predictors: Which outcomes vary with hospital rather than patient characteristics? Journal of the American Statistical Association. 1995;90(429):7–18. [Google Scholar]
- Silber JH, Rosenbaum PR, Schwartz JS, Ross RN, Williams SV. Evaluation of the complication rate as a measure of quality of care in coronary artery bypass graft surgery. Journal of the American Medical Association. 1995;274(4):317–323. [PubMed] [Google Scholar]
- Silber JH, Williams SV, Krakauer H, Schwartz JS. Hospital and patient characteristics associated with death after surgery: A study of adverse occurrence and failure to rescue. Medical Care. 1992;42(Suppl 2):615–629. doi: 10.1097/00005650-199207000-00004. [DOI] [PubMed] [Google Scholar]
- Smith HL. A double sample to minimize bias due to non-response in a mail survey. In: Ruiz-Gazen, Guilbert, Haziza, Tille, editors. Survey methods: Applications to longitudinal studies, to health, to electoral studies, and to studies in developing countries. Paris: Dunod; 2008. [Google Scholar]
- Smith DL, Elting LS, Learn PA, Raut CP, Mansfield PF. Factors influencing the volume-outcome relationship in gastrectomies: A population-based study. Annals of Surgical Oncology. 2007;14(6):1846–1852. doi: 10.1245/s10434-007-9381-0. [DOI] [PubMed] [Google Scholar]
- Tourangeau AE, Giovannetti P, Tu JV, Wood M. Nursing-related determinants of 30-day mortality for hospitalized patients. Canadian Journal of Nursing Research. 2002;33(4):71–88. [PubMed] [Google Scholar]
- Van den Heede K, Lesaffre E, Diya L, Vleugels A, Clarke SP, Aiken LH, Sermeus W. The relationship between inpatient cardiac surgery mortality and nurse numbers and educational level: analysis of administrative data. International Journal of Nursing Studies. 2009;46(6):796–803. doi: 10.1016/j.ijnurstu.2008.12.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Warshawsky NE, Havens DS. Global use of the Practice Environment Scale of the Nursing Work Index. Nursing Research. 2011;60(1):17–31. doi: 10.1097/NNR.0b013e3181ffa79c. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.