Skip to main content
Health Services Research logoLink to Health Services Research
. 2007 Jun;42(3 Pt 1):1085–1104. doi: 10.1111/j.1475-6773.2006.00651.x

Nurse Working Conditions, Organizational Climate, and Intent to Leave in ICUs: An Instrumental Variable Approach

Patricia W Stone, Cathy Mooney-Kane, Elaine L Larson, Diane K Pastor, Jack Zwanziger, Andrew W Dick
PMCID: PMC1955249  PMID: 17489905

Abstract

Objective

To investigate causes of nurse intention to leave (ITL) while simultaneously considering organizational climate (OC) in intensive care units (ICUs) and identify policy implications.

Data Sources/Study Setting

Data were obtained from multiple sources including nurse surveys, hospital administrative data, public use, and Medicare files. Survey responses were analyzed from 837 nurses employed in 39 adult ICUs from 23 hospitals located in 20 separate metropolitan statistical areas.

Study Design

We used an instrumental variable technique to assess simultaneously the relationship between OC and ITL. We estimated ordinary least squares and reduced form regressions to determine the extent of simultaneity bias as well as the sensitivity of our results to the instrumental variable model specification.

Principal Findings

Fifteen percent of the nurses indicated their ITL in the coming year. Based on the structural model, we found that nurses' ITL contributed little if anything directly to OC, but that OC and the tightness of the labor market had significant roles in determining ITL (p values <.05). Furthermore, OC was affected by the average regionally adjusted ICU wages, hospital profitability, teaching, and Magnet status (p values <.05).

Conclusions

OC is an important determinant of ITL among ICU nurses. Because higher wages do not reduce ITL, increased pay alone without attention to OC is likely insufficient to reduce nurse turnover. Implementing interventions aimed at creating a positive OC, as found in Magnet hospitals, may be a more effective strategy.

Keywords: Nurses, workforce, organizational climate, turnover


High turnover has been recognized as a problem in many service industries including health care (Mor Barak et al. 2001). Although it is important to note that turnover, in and of itself, is not necessarily bad, there are inevitably costs experienced by organizations that lose workers. In U.S. hospitals, nursing turnover has been reported to range from 15 to 36 percent per year (Hayes et al. 2006). These turnover rates are much higher than those for other health care professionals, which are estimated to be on average 2.3 percent per year (data retrieved May 13, 2005, http://www.bls.gov/jlt/home.htm#data).

Turnover has been conceptualized as the result of an employee decision making process related to organizational features and perceived alternatives; and intention to leave (ITL) has been found to be an antecedent to turnover (Griffeth et al. 2005). The employees' perceptions of the organizational features such as how decisions are made, leadership, and norms in the work place have been termed organizational climate (OC) (Stone et al. 2005). Staffing policies related to patient acuity, nurse-to-patient ratios, agency nurse use, overtime, and wages have been found to be related to OC and nurses' ITL (General Accounting Office 2001). Employee characteristics such as gender, education, job experience, and employment status (i.e., part-time versus fulltime) have also been found to be related to both OC and ITL (Marchiori and Henkin 2004). Although previous investigators have found inverse relationships between OC and ITL (Gifford et al. 2002), no research was found that investigated a potential simultaneous relationship between OC and ITL. That is, a poor OC may motivate workers to leave and, at the same time, high turnover may negatively affect employees' perceptions of OC.

The aims of this study were to investigate causes of nurse turnover, as measured by ITL in ICUs, while simultaneously considering OC and identify policy implications. Because hospital nurse shortages are not always institution-wide but concentrated in specialty care areas such as intensive care units (ICUs), understanding causes of turnover in these settings is especially important (Buerhaus et al. 2000). From a policy perspective, it is important to understand whether turnover is related to a tight labor market (i.e., a shortage of personnel and plentiful job alternatives for the nurse), organizational features, or generated by yet unrecognized factors. In a tight labor market, an administrator's only option may be to increase wages. On the other hand, if organizational features are the cause of turnover, organizational changes may be needed.

THEORETICAL UNDERPINNINGS

We developed and tested an instrumental variable model (see Figure 1) that extended past theories and examined a simultaneous relationship between OC and ITL. We identified characteristics that drive both (i.e., employee characteristics and staffing policies), and features that may directly affect one but not the other (i.e., instruments). The instrumental variable for ITL was the nurse labor market. Consistent with previously tested theoretical models postulating that employment alternatives are related to job turnover (Griffeth et al. 2000), we theorized that the tightness of the regional labor market would have a direct effect on nurses' ITL but would not directly influence perceived OC. Our measure of the regional registered nurse (RN) labor market was the ratio RN wages to teachers' wages per metropolitan statistical area (MSA). We assumed that teachers' wages were a good control from which to generate relative nurse wages because both occupations are made up of educated, mainly female, professionals. The rationale for using this instrumental variable was that in regions with more competitive salary structures for RNs, the nurse was more likely to perceive alternative employment opportunities resulting in higher ITL, but the labor market was not likely to directly affect the ICU's OC.

Figure 1.

Figure 1

Conceptual Framework of Organizational Climate and Nurses' Intent to Leave

A variety of structural characteristics were posited to directly affect OC, but not ITL. These instrumental variables included hospital size, hospital profitability, teaching status, Magnet status, and ICU type. The Magnet accreditation program was developed in the 1980s to recognize excellence in nursing management, philosophy, and nursing care (AACN 2005); therefore, we postulated Magnet status was positively correlated with OC, but only affected ITL through OC. A similar effect of profitability was assumed because unless a hospital is in imminent danger of restructuring or closing, it is unlikely that nurses are aware of a hospital's profitability status. Previous research has determined that nurses employed by a hospital going through a restructuring had no increase in ITL compared to nurses in other hospitals, but they did perceive more work stressors and less job satisfaction (Burke 2005), which offers some empirical evidence to support the use of profitability as an instrument for OC. Setting characteristics such as hospital size, teaching status, and ICU type have been found to be related to nurses' perceptions of the work environment (Shaver and Lacey 2003), but we had no reason to believe they would be related to ITL except through their effect on OC.

The groups of variables postulated to affect both OC and ITL were employee characteristics and staffing policies. The staffing policy variables included patient acuity, nurse hours per patient day, agency use, overtime, and wages. Although the use of overtime and agency nurses may satisfy minimum nurse to patient ratios we believed both staffing strategies may negatively affect the OC as well as promote nurses' ITL. Because patient acuity is a measure of nurse workload we included this as a staffing variable. We postulated that employee characteristics would affect both OC and ITL based on the assumptions that these characteristics are known to influence organizational commitment and mobility of the employee and therefore would affect the outcomes we measured.

METHODS

Data were collected from a variety of sources. Table 1 lists variables, operational definitions, and summary statistics. Sampling and data sources are explained below.

Table 1.

A List of Variables

Variable Operational Definition Summary Statistics
Instruments for organizational climate
Profit margin (Revenue−expenses)/revenue Mean=0.05 (SD=0.06)
Hospital size Below median bed size Mean=278 (SD=91.4)
Above median bed size Mean=636 (SD=29.7)
Teaching Yes teaching hospital N=17 (74%)
Magnet Yes Magnet accreditation N=4 (17%)
ICU type Surgical N=10 (25%)
Medical/surgical N=20 (51%)
Medical N=7 (18%)
Coronary N=2 (5%)
Instrument for intent to leave
Labor market Ratio of teachers' salaries to RN salaries per MSA Mean=0.89 (SD= 0.09)
Employee characteristics
Gender Male N=91 (11%)
Education RN with no bachelors degree N=349 (42%)
ICU experience (in years) Response to the question, “How many years have you worked in an ICU?” Mean=9.2 (SD=8.0)
Employment status Full-time N=655 (78%)
Part-time N=117 (14%)
Float N=64 (8%)
ICU staffing policies
Patient acuity Mean NIW for Medicare patients Mean=3.08 (SD=0.15)
NHPPD RN hours per patient day Mean=16.4 (SD=3.9)
Agency use Yes use of agency nurses N=30 (77%)
Overtime Overtime hours/RN hours Mean=0.05 (SD=0.03)
Wage Mean RN wage adjusted per MSA Mean=1.15 (SD=.17)
Dependent variables
Organizational climate PNWE Mean=2.91 (SD=0.46)
Intent to leave Positive response to the question, “Do you plan to leave your current position in the coming year?” N=130 (15%)

ICU, intensive care unit; RN, registered nurse; BS, bachelors in science; NIW, nursing intensity weight; MSA, metropolitan statistical area; PNWE, perception of nurse work environment; NHPPD, nurse hours per patient day.

Hospital Sample

This study was part of a patient safety project in which ICU-related health care associated infections were an important patient safety endpoint. Therefore, recruitment of hospitals occurred through the Association for Professionals in Infection Control and Healthcare Epidemiology, Inc. (APIC) listserve and by invitations sent to hospitals participating in the Centers for Disease Control and Prevention (CDC) National Nosocomial Infections Surveillance (NNIS) system (Horan and Gaynes 2004). Hospitals were eligible to enroll adult medical surgical, medical, surgical, or coronary ICUs that (1) had a minimum of 500 patient days for the year 2002; and (2) conducted infection surveillance using the CDC's definitions. Human subject approvals were obtained from each participating hospital as well as the primary investigators' institutions.

Nurse Sampling

All RNs employed in an enrolled ICU were eligible to be surveyed using an anonymous self-report questionnaire format. Survey distribution was based on processes developed in previous multisite research surveying health care personnel (Dillman 1978; Smith et al. 1998) and has been described in detail elsewhere (Choi et al. 2004). The overall response rate of 41 percent is comparable to the 38–53 percent response rates recently found in other anonymous multisite surveys of hospital-based nursing personnel (Asch et al. 1997).

Nurse Survey

Survey data included employee demographics, our measure of OC, and a dichotomous question about the employees' ITL in the coming year. OC was measured using the 42-item Perceived Nurse Work Environment (PNWE) scale (Choi et al. 2004). The PNWE has seven dimensions (e.g., Nurse/Physician Collaboration and Support for Professional Practice), in which respondents are asked to indicate the extent the factor is present in their work environment using a 4-point Likert scale. Internal consistency of the composite scale, which was used in the analysis, was excellent (α=0.95). Higher scores indicated positive perceptions of the OC. Behavioral ITL due to working conditions was measured by a single self-report item, “Do you plan to leave your current position in the coming year?” In previous research of physicians, self-report ITL clinical practice was found to be an adequate marker of actually leaving (73.3 percent sensitivity, 84.4 percent specificity) (Rittenhouse et al. 2004) and is a frequently used in research assessing the nursing workforce (Hayes et al. 2006). Those who expressed their ITL were asked why. The majority of respondents indicated reason for ITL to be poor working conditions (53 percent), relocating (15 percent), retirement (5 percent), no reason given (12 percent), and positive career move such as promotion (15 percent). We tested the sensitivity of the results excluding various groups. There were no substantive differences in the results.

Other Data Sources

Hospitals provided a variety of administrative data for the year 2002 including ICU-specific monthly (1) lists of Medicare patients admitted; (2) total patient census; (3) payroll; (4) use of agency nurses; and (5) self-reported Magnet status as of December 31, 2002. Hospital characteristics such as bed size and teaching status were obtained from the American Hospital Association survey for the year 2002. Profitability was estimated from Medicare cost reports. Labor market tightness was estimated using RNs' and teachers' wages per MSA from the Bureau of Labor Statistics for the same year.

Empirical Framework

We first estimated naive ordinary least squares equations without considering the simultaneous relationship of ITL and OC. Then using the conceptual framework in Figure 1 we specified a two-equation structural model that identifies causal estimates of the relationships between ITL and OC.

Let

graphic file with name hesr0042-1085-m1.jpg (1)
graphic file with name hesr0042-1085-m2.jpg (2)

where Z represents instruments and X refers to the vector of nursing demographic characteristics and ICU staffing policies postulated to effect both ITL and OC. ZOC refers to a vector of instruments for OC that includes ICU and hospital level characteristics. ZITL refers to the instrument for ITL that is the market level variable. In equation (1), the OC effect (β3) on ITL is identified with the exclusion of the ZOC variables. Similarly, in equation (2), the ITL effect (β3) on OC is identified with the exclusion of the ZITL variable.

We estimated each of the equations in the system separately, with the nurse as the unit of analysis. Because responses of nurses working in the same unit may be correlated the models were estimated with robust standard errors clustering on ICU (Huber 1964). To assess endogeneity bias induced by the simultaneous structure proposed, we followed Wooldridge's recommendation to examine the instrumental variable residuals to determine whether the differences between the ordinary least squares and instrumental variable coefficients were statistically significant (Wooldridge 2003). Because we had multiple instruments to identify OC effects in the ITL equation, we examined different combinations of OC instruments and calculated the Hansen J over-identification test statistic to determine whether the final set of instruments performed consistently (Wooldridge 2003). For both OC and ITL we generated F statistics to show the strength of instruments. A Shea partial R2 was also computed for both instrumental variable equations (Shea 1997). Finally, to characterize the reduced form, the endogenous variables (ITL and OC) were each expressed as a function of all exogenous variables.

To quantify the magnitude of effects of key significant variables on OC and ITL, we used coefficients from the instrumental variable results to calculate direct, indirect, and total effects of each. For example, direct effects of policy levers were determined by their estimated coefficients (e.g., the direct effect of X on ITL is given by β2). Indirect effects on ITL were the estimated effects of X on OC, and the effect of that change in OC on ITL (analogously for OC). For continuous measures (such as wages), we considered the effects of one standard deviation change. For dichotomous variables (such as teaching status), we considered a change of one unit. The total effect was estimated by summing the direct and indirect effects. To facilitate comparisons between ITL (a dichotomous measure) and OC (a continuous measure), the latter was standardized to a scale from zero to one.

Generalizability of the Sample

To examine representativeness of the sample we compared age, gender, education level, and employment status (full-time or part-time) of respondents in our sample to the unweighted sample of critical care nurse respondents in the National Sample Survey of Registered Nurses 2000 (HRSA 2000). We regressed the survey response rate on OC, ITL, and setting characteristics. Last, we compared participating hospitals with the national sample of hospitals using American Hospital Association data.

RESULTS

Sample

Survey results from 837 RNs employed in 39 ICUs were analyzed. The sample of RNs were of similar age and gender as the national sample of ICU nurses (Table 2) with the majority of the nurses being female (89 percent) and between 30 and 44 years old (52 percent). In the national sample, the RNs were less educated and a higher proportion worked part-time (p-values <.05). The 39 ICUs were located in 23 hospitals (number of ICUs per hospital ranged from 1 to 5). Similar to the hospitals participating in the CDC's NNIS system (Table 2), the hospitals participating in our study were geographically representative of the nation, but they were larger and were more likely to be affiliated with an academic institution than other hospitals in the nation (Richards et al. 2001). The ICU specific survey response rates were not significantly related to the dependent variables or setting characteristics.

Table 2.

Comparison to National Data

Sample N=837 National Statistics N=2,645


Registered Nurses n % n % p-value
Age
 29 years 135 (18.3) 481 (18.2)
 30–44 years 384 (52.2) 1,416 (53.5)
 45–59 years 212 (28.8) 710 (26.8)
 ≥60 years 5 (0.7) 38 (1.4) .31
Gender
 Male 91 (10.9) 258 (9.8)
 Female 746 (89.1) 2,387 (90.2) .35
Education
 Associate 277 (33.1) 948 (35.9)
 Diploma 72 (8.6) 386 (14.6)
 Bachelors 436 (52.1) 1,205 (45.5)
 Graduate 52 (6.2) 102 (3.9) <.0001
Employment status
 Full-time 656 (78.4) 1,915 (72.4)
 Part-time 181 (21.6) 730 (27.6) .001
N=23 N=4,859


Hospitals n % n %
Region
 Atlantic 6 (26.09) 1,403 (28.74)
 Central 11 (47.83) 2,516 (51.78)
 Pacific 6 (26.09) 940 (19.35) .72
Size
 Under 300 beds 8 (34.78) 4,118 (83.82)
 300–399 beds 3 (13.04) 346 (7.04)
 400 or more beds 12 (52.17) 449 (9.14) <.0001
Teaching status
 Yes 6 (26.09) 328 (6.68)
 No 17 (73.91) 4,585 (93.32) .0002

Note: National sample of RN data comes from National Sample Survey of Registered Nurses (NSSRN) 2000. National sample of hospital data comes from the American Hospital Association. Data displayed are means and standard deviations for continuous variables and sample size and percentages for nominal variables. Differences were tested using χ2 analysis.

RN, registered nurse.

Tables 3 and 4 display the regression results for ITL and OC, respectively. From left to right, the columns list the results of the naive ordinary least squares, instrumental variables, and reduced form models. The Wooldridge tests were not significant, implying that we should not reject the hypothesis that there is no endogeneity in either equation. Although our statistical tests for endogeneity failed to reject the ordinary least square estimates as significantly different, some of estimates in the instrumental variable specification were quite different.

Table 3.

Results for Intent to Leave (ITL)

Naive Ordinary Least Squares Instrumental Variable Reduced Form Ordinary Least Squares



Variable Coefficient SE Coefficient SE Coefficient SE
Organizational climate (OC) −0.136 0.032*** −0.274 0.071***
X: Employee characteristics
Gender (male) 0.013 0.045 0.008 0.044 0.023 0.048
Education (no BSN) −0.037 0.025 −0.038 0.027 −0.034 0.026
Experience (in years)
 Less than 1 −0.133 0.048** −0.118 0.045** −0.118 0.051**
 2–2.75 0.022 0.046 0.021 0.041 0.021 0.048
 3–4.75 0.056 0.074 0.015 0.073 0.040 0.075
 5–6.5 −0.011 0.052 −0.021 0.047 −0.005 0.056
 7–9.5 0.029 0.065 0.015 0.064 0.036 0.067
 10–11.5 −0.115 0.047* −0.125 0.047** −0.102 0.048*
 12–14.5 −0.065 0.058 −0.069 0.052 −0.064 0.062
 15–19.5 −0.079 0.052 −0.104 0.051 −0.057 0.054
 20–29.5 −0.070 0.048 −0.084 0.045 −0.056 0.050
 30–45 0.032 0.102 0.048 0.101 0.022 0.104
Employment status
 Full-time 0.040 0.047 0.043 0.047 0.046 0.049
 Part-time 0.069 0.066 0.061 0.067 0.088 0.071
X: Staffing policies
Patient acuity 0.005 0.124 0.098 0.148 −0.026 0.178
NHPPD −0.003 0.002 −0.003 0.001 0.003 0.004
Agency 0.034 0.032 0.029 0.027 0.078 0.042
Overtime 0.005 0.004 0.006 0.003 0.009 0.005
Nurses' wages 0.077 0.068 0.188 0.083* −0.057 0.990
ZOC: OC instruments
Hospital characteristics
 Size
  Below median 0.033 0.018
  Above median 0.009 0.007
 Profitability −0.126 0.273
 Teaching status 0.038 0.052
 Magnet −0.076 0.045
ICU characteristics
 ICU type
  Surgical −0.023 0.045
  Medical 0.022 0.051
  Coronary −0.030 0.057
ZITL: ITL instrument
Labor market −0.266 0.106* −0.300 0.099** −0.341 0.121*
Wooldridge test for endogeneity 0.09 (p=.30)
Strength of instruments
Shea partial R2 0.0081
F test 7.94 (p=.02)

Notes: The naive ordinary least squares regression does not consider a simultaneous relationship between ITL and OC. In the instrumental variable regression this relationship was considered and the value for OC was predicted based on the OC instruments' coefficients from the reduced form results (see Table 4). All models are estimated with robust standard errors clustering for intensive care unit with the nurse as the unit of analysis. BSN, bachelor of science; NHPPD, nurse hours per patient day; ICU, intensive care unit.

*

p-value≤.05

**

p-value <.01

***

p-value <.001.

Referent group nurses with 1–1.5 years experience.

Referent group float nurses.

Table 4.

Results for Organizational Climate (OC)

Naive Ordinary Least Squares Instrumental Variable Reduced Form Ordinary Least Squares



Variable Coefficient (SE) Coefficient SE Coefficient SE
Intent to leave (ITL) −0.170 0.037** −0.135 0.659
X: Employee characteristics
Gender (male) −0.063 0.060 −0.064 0.058 −0.067 0.061
Education (no BSN) −0.004 0.032 0.005 0.043 0.010 0.033
Experience (in years)
 Less than 1 0.128 0.071 0.134 0.134 0.155 0.074
 2–2.75 0.020 0.070 0.019 0.060 0.017 0.073
 3–4.75 −0.078 0.063 −0.080 0.060 −0.088 0.067
 5–6.5 −0.060 0.074 −0.053 0.088 −0.059 0.080
 7–9.5 −0.068 0.086 −0.069 0.076 −0.073 0.091
 10–11.5 −0.099 0.091 −0.096 0.079 −0.082 0.093
 12–14.5 −0.032 0.071 −0.030 0.090 −0.021 0.076
 15–19.5 −0.166 0.071* −0.163 0.087 −0.156 0.076*
 20–29.5 −0.010 0.063 −0.098 0.084 −0.090 0.068
 30–45 .0917 0.108 0.091 0.105 0.195 0.111
Employment status
 Full-time 0.012 0.052 −0.010 0.061 0.004 0.051
 Part-time −0.088 0.060 −0.090 0.074 −0.102 0.061
X: Staffing policies
Patient acuity 0.666 0.374 0.668 0.361 0.672 0.370
NHPPD −0.054 0.008 −0.015 0.008 −0.016 0.009
Agency −0.200 0.100 −0.203 0.118 −0.213 0.105
Overtime −0.002 0.010 −0.002 0.104 −0.004 0.009
Nurses' wages 1.027 0.248*** 1.028 0.250*** 1.035 0.253***
ZOC: OC instruments
Hospital characteristics
 Size
  Below median −0.094 0.055 −0.094 0.058 −0.099 0.057
  Above median −0.033 0.017 −0.033 0.017* −0.034 0.018
 Profitability 1.246 0.480* 1.250 0.467** 1.267 0.500*
 Teaching status −0.275 0.124* −0.277 0.128* −0.281 0.134*
 Magnet 0.257 0.083** 0.253 0.083** 0.253 0.092**
ICU characteristics
 ICU type
  Surgical −0.021 0.065 −0.020 0.064 −0.017 0.067
  Medical −0.084 0.117 −0.083 0.114 −0.086 0.120
  Coronary 0.075 0.153 0.076 0.076 0.080 0.159
ZITL: ITL instrument
Labor market 0.046 0.240
Wooldridge test for endogeneity −0.22 (p=.80)
Hansen J statistic for over identification 2.91 (p=.89)
Strength of instruments
Shea partial R2 0.09
F test 2.54 (p=.084)

Notes: The naive ordinary least squares regression does not consider a simultaneous relationship between ITL and OC. In the instrumental variable regression this relationship was considered and the value for ITL was predicted based on the ITL instrument coefficient from the reduced form results (see Table 3). All models are estimated with robust standard errors clustering for intensive care unit with the nurse as the unit of analysis. BSN, bachelor of science; NHPPD, nurse hours per patient day; ICU, intensive care unit.

*

p-value≤.05

**

p-value <.01

***

p-value <.001.

Referent group nurses with 1–1.5 years experience.

Referent group float nurses.

Intent to Leave (ITL)

Overall, the ITL equations were similar (Table 3). In the ordinary least squares equation, OC was significantly inversely related to ITL (p<.001). The instrumental variable estimate of the OC effect was also significantly negative (p≤.05); and, although not statistically significantly different from the ordinary least square estimate, more than 50 percent larger in magnitude. The F test of the OC instruments was significant (F(13,26)=2.54, p=.03), the Shea partial R2 was large (0.09), and the over-identification test failed to reject the null that the instruments are appropriate (p=.89).

In the OC reduced form model (Table 4), three OC instruments (profitability, teaching status, and Magnet accreditation) were statistically significant. Our results did not change substantively when we eliminated different combinations of the statistically insignificant instruments (data not displayed). The labor market was a negative, large, and statistically significant (p≤.05) predictor of ITL in the reduced form equation. It was also negative, statistically significant (p≤.05), and nearly as large in the instrumental variable equation.

Overall, nursing experience was significantly related to ITL (F(9,38)=2.64, p=.02). Nurses with less than 1 year experience and between 10 and 11.5 years experience were significantly less likely to indicate ITL than those with 1–1.5 years experience (p-values <.05). The reduced form specification was similar to the instrumental variable model results.

Organizational Climate (OC)

Table 4 contains the estimation results from the three OC models. In the ordinary least squares model, the ITL coefficient was negative and statistically significant (p<.001), suggesting a strong and important inverse relationship. We could not, however, confirm this relationship with the instrumental variable model where the estimate of the ITL effect was small, positive, and very imprecisely estimated (SE=0.695). Although the instrument (labor market) is statistically significant and substantively important in the ITL equation (Table 3), this could be evidence that it is a weak instrument. In fact, the partial R2 statistic was very small, supporting this concern.

In each of the OC models, we found average nurses' wages in the ICU, hospital profitability, and Magnet status had strong positive and statistically significant effects on OC, and hospital teaching status had a significant negative effect (all p-values ≤.05) on OC. Overall, nursing experience was significantly related to OC (F(9,38)=2.22, p=.05). The point estimates in the ordinary least squares and the reduced form models are negative for nurses with 15–19.5 years of experience compared to those with 1–1.5.

Impact of Key Variables

The variable with the largest substantive impact on ITL is the OC (see online Appendix); improving the OC by one standard deviation was predicted to reduce nurse's probability of ITL their position by 13 percentage points. The variable with the largest total impact on OC was Magnet status. Being employed in a Magnet hospital was predicted to improve the OC by approximately 8.4 percentage points. Because of the positive effect of wages on OC and the large effect of OC on ITL, a wage increase should have small total effect on decreasing ITL.

DISCUSSION

Fifteen percent of the nurses in our sample indicated ITL in the coming year, imposing potentially high hiring and training costs on hospitals. Using instrumental variable techniques, causal relationships were postulated to explain ITL and OC, and we estimated these relationships empirically to quantify the role that OC, labor market conditions, and staffing policies play on ITL. Based on the structural model estimates, we found strong evidence that OC and the tightness of the labor market have significant roles in determining ITL. Furthermore, OC was strongly affected by the average regionally adjusted ICU wages, hospital profitability, teaching, and Magnet status. This implies that nurses' working environments may be affected by investments in human resources, which may ultimately affect nurses' ITL.

A growing body of evidence suggests relationships between increasing nurse staffing and positive patient outcomes (Aiken et al. 2002; Needleman et al. 2002; Institute of Medicine 2004; Mark et al. 2004). We did not find nurse hours per patient day to be significantly associated with either OC or ITL. This may be due to contradictory effects or interactions between cognitive stimulation, workload, and job enjoyment (Oldham and Gordon 1999), the focus on ICUs (not hospital-wide staffing), and/or imprecision due to lack of power. Future analyses investigating the relationships between staffing load, OC, ITL, and patient outcomes are warranted.

Hospital profitability was significantly positively related to OC. More profitable hospitals may have better senior management, which may affect myriad processes in the hospital including those captured by our measure of OC. Furthermore, more profitable hospitals may have more capital for infrastructure, support staff for building maintenance and housekeeping, or more opportunities for continuing education, all of which may improve OC. The exact mechanism of this effect was beyond the scope of this study.

Limitations

The structural model posited critically depends on the assumptions about the instrumental variables: that they are strongly correlated with the endogenous right-hand-side variables, and that they do not directly cause the dependent variable. As required for estimating precise structural effects of OC on ITL, our OC instruments were strong predictors. Our main results about the role of OC in ITL were quite robust to variations in the specification of instruments. Our ITL instrument, however, was not as strong a predictor, which could explain the large standard errors in the structural estimates of ITL on OC and the results about the role of ITL on OC. The instrumental variable estimates were based on a single instrument that was a substantively strong predictor of ITL, but was relatively imprecisely estimated (SE=0.14, p=.05). However, the instrumental variable estimates were too dissimilar from the naive ordinary least squares estimates to simply ignore. Further analyses using a larger sample size with improved instruments would be helpful in understanding if this result is due to lack of power, poor model specification, and/or true lack of effect of ITL on OC.

Although this study used a unique, comprehensive, dataset that included multiple levels of data including characteristics related to the nurse, the ICU, the hospital, and the labor market, inherent limitations of the study were the size of the dataset and the survey response rate. The results may be biased with those intending to leave less likely to respond, especially since some researchers have found nurse turnover rates to be higher than we found in this sample (Hayes et al. 2006). However, the response rate was not related to either dependent variables or setting characteristics; therefore we believe this potential bias is most likely minimal. Because of the self-selected nature of the hospitals and the focus on the ICU environment, the results may not be generalizable in other settings. The sample of nurses in our study was of a similar age and gender as a national sample of critical care nurses. Additionally, the geographical representativeness of the hospitals leads us to believe that the sample was representative of full-time nurses working in ICUs in large academic health centers. However, the results may not be generalizable to smaller, nonacademic hospitals and other settings outside of the ICU. It was not surprising that the hospitals that participated were mainly larger teaching hospitals, as they reflect the NNIS hospitals, which was a primary enrollment strategy used. Although a random sampling of hospitals may have provided more community-based hospitals, these hospitals may not have had the infrastructure required to provide the needed data elements. Furthermore, large teaching hospitals are important to study as OC was perceived more negatively in these settings.

The cross-sectional nature of the data and use of ITL (a proxy for turnover) were limitations. Although ITL is thought to be one of the best predictors of actual turnover (Griffeth et al. 2000; Heyes 2003), it is not a perfect correlate. Studying the relationships of interest using longitudinal data with actual turnover would be a great improvement. However, this was not feasible. Some systems are routinely collecting data on OC, but such data are not collected by most hospitals (Kam and Sincere 1999). Many hospitals are contributing data to the National Database of Nursing Quality Indicators (NDNQIs), which has adapted measures of nurses' perceptions of work environment (Gallagher and Rowell 2003). A similar measure has also been endorsed by the National Quality Forum (2004). In future research, it may be possible to link existing databases with human resource data to provide longitudinal analyses.

Last, our measure of nurse labor market was the ratio of RN wages per MSA to teacher wages per MSA. Because we were not interested in measuring whether a nursing market is more or less tight than any other market in a given area, but rather whether a nursing market in an MSA is more or less tight than a nursing market in another MSA, we believed the measure was adequate. No single empirical measure of occupational labor shortages exists and the existing national datasets are not thought to be sensitive to local labor markets, especially for nursing (Veneri 1999). We followed previous researchers method of comparing average wages of nurses in a local area compared with a profession of similar gender and educational level, that is teaching (Nowak and Preston 2001), but this measure may be a limitation to the study.

Policy Implications

Despite these limitations, the results have a number of policy implications. We believe that health administrators and policy makers should implement interventions aimed at improving OC. As reported by the International Council of Nurses (2006), positive nurse work environments are a result of multiple organizational and structural factors such as the leadership vision and organization characteristics (e.g., communication processes in place) as well as immediate supervisor processes, work design, and group behavior such as team collaboration. Although the analyses reported here do not tease out differences and relative importance of one factor (or subclimate) over another, the analyses do point to the overall importance of a positive OC. Previously, we have found that the nurses' perceptions of professional practice and clinical competence of other nurses were important factors relating to ITL (Stone et al. 2006) and that nurses employed in hospitals with Magnet accreditation perceive the OC more positively (Cimiotti et al. 2005). However, longitudinal research is needed to examine exactly how obtaining Magnet accreditation changes work environments, and continued development and testing of interventions aimed at improving OC are needed.

Increasing wages without attention to the underlying OC may not be the most cost effective way to reduce nurse turnover rates. Others have come to a similar conclusion; in England, researchers found that nurses' dissatisfaction with promotion had a stronger impact than pay on intent to quit (Shields and Ward 2001). Therefore, the researchers concluded that efficient policy design must not only focus on improved pay, but also concentrate on improving career opportunities.

Lastly, nurses employed in teaching hospitals had a higher probability of having a negative perception of the OC in their work environment. In teaching hospitals with rotations of interns and residents, collaboration may be more difficult due to the lack of stability in the interdisciplinary team. Administrators and health policy makers in these institutions need to pay close attention to the OC within their setting.

CONCLUSION

Nursing turnover is an important problem in acute care hospitals. With the backdrop of the nursing shortage and the costs associated with turnover, hospital administrators must find ways to become employers of choice if they are going to recruit and retain nurses. While improving nurse wages may help, it is insufficient. Our findings suggest that implementing interventions aimed at ensuring a positive OC may be a more effective strategy.

Acknowledgments

This study was funded by AHRQ R01 HS013114. We thank all the hospitals that participated in this research. We also thank T. Horan who assisted with recruitment and data collection; H. Shih who assisted with data analysis; and T. Horan and D. Scott who reviewed prior drafts of the manuscript as well as the anonymous reviewers and editors who gave thoughtful suggestions.

Disclosures: The authors have no conflicts of interest.

Disclaimers: The authors have no disclaimers.

SUPPLEMENTARY MATERIAL

The following supplementary material for this article is available online:

Appendix

Impact of Key Variables on Outcomes.

hesr0042-1085-as1.pdf (42.9KB, pdf)

This material is available as part of the online article from:

http://www.blackwell-synergy.com/doi/abs/10.1111/j.1475-6773.2006.00651.x (This link will take you to the article abstract).

Please note: Blackwell Publishing is not responsible for the content or functionality of any supplementary materials supplied by the authors. Any queries (other than missing material) should be directed to the corresponding author for the article.

REFERENCES

  1. AACN. AACN Standards for Establishing and Sustaining Healthy Work Environments. Aliso Viejo, CA: AACN; 2005. [PubMed] [Google Scholar]
  2. Aiken LH, Clarke SP, Sloane DM, Sochalski J, Silber JH. Hospital Nurse Staffing and Patient Mortality, Nurse Burnout, and Job Satisfaction. Journal of the American Medical Association. 2002;288:1987–93. doi: 10.1001/jama.288.16.1987. [DOI] [PubMed] [Google Scholar]
  3. Asch DA, Jedrziewski MK, Christakis NA. Response Rates to Mail Surveys Published in Medical Journals. Journal of Clinical Epidemiology. 1997;50:1129–36. doi: 10.1016/s0895-4356(97)00126-1. [DOI] [PubMed] [Google Scholar]
  4. Buerhaus PI, Staiger DO, Auerbach DI. Why Are Shortages of Hospital RNs Concentrated in Specialty Care Units? Nursing Economics. 2000;18:111–6. [PubMed] [Google Scholar]
  5. Burke RJ. Correlates of Nursing Staff Survivor Responses to Hospital Restructuring and Downsizing. Health Care Management (Frederick) 2005;24:141–9. doi: 10.1097/00126450-200504000-00007. [DOI] [PubMed] [Google Scholar]
  6. Choi J, Bakken S, Larson E, Du Y, Stone PW. Perceived Nursing Work Environment. Nursing Research. 2004;53:370–8. doi: 10.1097/00006199-200411000-00005. [DOI] [PubMed] [Google Scholar]
  7. Cimiotti J, Quinlan P, Larson E, Pastor D, Lin S, Stone PW. The Magnet Processes and the Perceived Work Environment of Nurses. Nursing Research. 2005;54:384–90. doi: 10.1097/00006199-200511000-00004. [DOI] [PubMed] [Google Scholar]
  8. Dillman D. Mail and Telephone Surveys: The Total Design Method. New York: Wiley; 1978. [Google Scholar]
  9. Gallagher RM, Rowell PA. Claiming the Future of Nursing through Nursing-Sensitive Quality Indicators. Nursing Administraction Quarterly. 2003;27:273–84. doi: 10.1097/00006216-200310000-00004. [DOI] [PubMed] [Google Scholar]
  10. General Accounting Office. Nursing Workforce: Recruitment and Retention of Nurses and Nurse Aides Is a Growing Concern. GAO-01-750T. Washington, DC: United States General Accounting Office; 2001. [Google Scholar]
  11. Gifford BD, Zammuto RF, Goodman E Al. The Relationship between Hospital Unit Culture and Nurses Quality of Work Life. Journal of Healthcare Management. 2002;47:13–25. [PubMed] [Google Scholar]
  12. Griffeth RW, Hom PW, Gaertner S. A Meta-Analysis of Antecedents and Correlates of Employee Turnover: Update, Moderator Tests, and Research Implications for the Next Millennium. Journal of Management. 2000;26:463–88. [Google Scholar]
  13. Griffeth RW, Steel RP, Allen DG, Bryan N. The Development of a Multidimensional Measure of Job Market Cognitions: The Employment Opportunity Index (EOI) Journal of Applied Psychology. 2005;90:335–49. doi: 10.1037/0021-9010.90.2.335. [DOI] [PubMed] [Google Scholar]
  14. Hayes LJ, O'Brien-Pallas L, Duffield C, Shamian J, Buchan J, Hughes F, Spence Laschinger HK, North N, Stone PW. Nurse Turnover: A Literature Review. International Journal of Nursing Studies. 2006;43:237–63. doi: 10.1016/j.ijnurstu.2005.02.007. [DOI] [PubMed] [Google Scholar]
  15. Heyes A. The Economics of Vocation or Why Is a Badly Paid Nurse a Good Nurse? Royal Holloway: University of London; 2003. [DOI] [PubMed] [Google Scholar]
  16. Horan TC, Gaynes RP. Surveillance of Nosocomial Infections. In: Mayhall C Glen., editor. Hospital Epidemiology and Infection Control. Philadelphia: Lippincott Williams & Wilkins; 2004. pp. 1659–702. [Google Scholar]
  17. HRSA. The National Sample Survey of Registered Nurses 2000. Rockville, MD: Bureau of Health Professions, Health Resources and Services Administration; 2000. [Google Scholar]
  18. Huber P. Robust Estimation of a Location Parameter. Annals of Mathematical Statistics. 1964;35:73–101. [Google Scholar]
  19. Institute of Medicine. Keeping Patients Safe: Transforming the Work Environment of Nurses. Washington, DC: National Academy Press; 2004. [Google Scholar]
  20. International Council of Nurses and the Florence Nightingale International Foundation. The Global Nursing Shortage: Priority Areas for Intervention. Geneva: The Global Nursing Review Initiative; 2006. [Google Scholar]
  21. Kam S, Sincere F. Using Information from Linkage Research Studies to Improve Organizational Performance. Permanente Journal. 1999;3:54–7. [Google Scholar]
  22. Marchiori DM, Henkin AB. Organizational Commitment of a Health Profession Faculty: Dimensions, Correlates and Conditions. Medical Teacher. 2004;26:353–8. doi: 10.1080/01421590410001683221. [DOI] [PubMed] [Google Scholar]
  23. Mark BA, Harless DW, McCue M, Xu Y. A Longitudinal Examination of Hospital Registered Nurse Staffing and Quality of Care. Health Services Research. 2004;39:279–300. doi: 10.1111/j.1475-6773.2004.00228.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Mor Barak ME, Nissly JA, Levin A. Antecedents to Retention and Turnover among Child Welfare, Social Work and Other Human Service Employees: What Can We Learn from Past Research? A Review and Meta-Analysis. Social Service Review. 2001;75:625–61. [Google Scholar]
  25. National Quality Forum. National Voluntary Consensus Standards for Nursing-Sensitive Care: An Initial Performance Measure Set. Washington, DC: National Quality Forum; 2004. [Google Scholar]
  26. Needleman J, Buerhaus P, Mattke S, Stewart M, Zelevinsky K. Nurse-Staffing Levels and the Quality of Care in Hospitals. New England Journal of Medicine. 2002;346:1715–22. doi: 10.1056/NEJMsa012247. [DOI] [PubMed] [Google Scholar]
  27. Nowak MJ, Preston AC. Can Human Capital Theory Explain Why Nurses Are So Poorly Paid? Australian Economic Paper March. 2001;40(2):232–45. [Google Scholar]
  28. Oldham GR, Gordon BI. Job Complexity and Employee Substance Use: The Moderating Effects of Cognitive Ability. Journal of Health Society Behavior. 1999;40:290–306. [PubMed] [Google Scholar]
  29. Richards C, Emori TG, Edwards J, Fridkin S, Tolson J, Gaynes R. Characteristics of Hospitals and Infection Control Professionals Participating in the National Nosocomial Infections Surveillance System 1999. American Journal of Infection Control. 2001;29:400–3. doi: 10.1067/mic.2001.118408. [DOI] [PubMed] [Google Scholar]
  30. Rittenhouse DR, Mertz E, Keane D, Grumbach K. No Exit: An Evaluation of Measures of Physician Attrition. Health Services Research. 2004;39:1571–88. doi: 10.1111/j.1475-6773.2004.00304.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Shaver KH, Lacey LM. Job and Career Satisfaction among Staff Nurses: Effects of Job Setting and Environment. Journal of Nursing Administration. 2003;33:166–72. doi: 10.1097/00005110-200303000-00008. [DOI] [PubMed] [Google Scholar]
  32. Shea J. Instrument Relevance in Multivariate Linear Models: A Simple Measure. Review of Economics and Statistics. 1997;49:348–52. [Google Scholar]
  33. Shields MA, Ward M. Improving Nurse Retention in the National Health Service in England: The Impact of Job Satisfaction on Intentions to Quit. Journal of Health Economics. 2001;20:677–701. doi: 10.1016/s0167-6296(01)00092-3. [DOI] [PubMed] [Google Scholar]
  34. Smith CS, Salyer J, Geddes N, Mark BA. Strategies to Enhance Internal Validity in Multi-Center Longitudinal Research. Outcomes Management and Nurse Practitioner. 1998;2:174–9. [PubMed] [Google Scholar]
  35. Stone PW, Harrison MI, Feldman P, Linzer M, Peng T, Roblin D, Scott-Cawiezell J, Warren N, Williams E. Organizational Climate of Staff Working Conditions and Safety—An Integrative Model. Advances in Patient Safety: From Research to Implementation. 2005;2:467–81. [Google Scholar]
  36. Stone PW, Larson E, Mooney-Kane C, Lin S, Dick A. Organizational Climate and ICU Nurses' Intention to Leave. Critical Care Medicine. 2006;34:1907–12. doi: 10.1097/01.CCM.0000218411.53557.29. [DOI] [PubMed] [Google Scholar]
  37. Veneri CM. Can Occupational Labor Shortages Be Identified Using Available Data? Monthly Labor Review. 1999;122(3):15–21. [Google Scholar]
  38. Wooldridge JM. Introductory Econometrics: A Modern Approach. Mason, OH: South-Western; 2003. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Appendix

Impact of Key Variables on Outcomes.

hesr0042-1085-as1.pdf (42.9KB, pdf)

Articles from Health Services Research are provided here courtesy of Health Research & Educational Trust

RESOURCES