Abstract
Background
Long-term care (LTC) staffing practices are poorly understood as is their influence on quality of care. We examined the relationship between staffing characteristics and residents’ quality of care indicators at the unit level in LTC homes.
Methods
This cross-sectional study collected data from administrative records and resident assessments from July 2014 to June 2015 at 11 LTC homes in Ontario, Canada comprising of 55 units and 32 residents in each unit. The sample included 69 registered nurses, 183 licensed/registered practical nurses, 858 nursing assistants, and 2173 residents. Practice sensitive, risk-adjusted quality indicators were described individually, then combined to create a quality of care composite ranking per unit. A multilevel regression model was used to estimate the association between staffing characteristics and quality of care composite ranking scores.
Results
Nursing assistants provided the majority of direct care hours in LTC homes (76.5%). The delivery of nursing assistant care hours per resident per day was significantly associated with higher quality of resident care (p = < 0.01). There were small but significant associations with quality of care for nursing assistants with seven or more years of experience (p = 0.02), nursing assistants late to shift (p = < 0.01) and licensed/registered practical nurses late to shift (p = 0.02).
Conclusions
The number of care hours per resident per day delivered by NAs is an important contributor to residents’ quality of care in LTC homes. These findings can inform hiring and retention strategies for NAs in LTC, as well as examine opportunities to optimize the NA role in these settings.
Electronic supplementary material
The online version of this article (10.1186/s12913-018-3552-5) contains supplementary material, which is available to authorized users.
Keywords: Long-term care, Nursing homes, Nursing assistants, Quality of care, Health care aides
Background
According to the most recent national health statistics available (2014 in the United States, 2011 in Canada), long-term care (LTC) homes across North America provided medical care and activities of daily living (ADL) support to over 1.6 million people [1, 2]. Many of these residents have complex medical conditions as well as frailty and depend on staff assistance for their daily activities [3–5]. When a resident is more dependent for assistance with activities of daily living, sufficient care time and staff competency are required to achieve quality care standards [6–8].
There are different approaches to assess care quality; Donabedian’s framework is one of the most widely accepted [9, 10]. This framework categorizes quality of care indicators into structure (i.e. organizational factors), process (i.e. care delivery actions), and outcome (i.e. patient) components [9, 10]. In LTC settings, the most frequently cited resident quality care indicators are patient outcomes. Examples include pressure ulcers, functional status, mortality, hospitalization, nutrition status and incontinence [10–13].
Sufficient and competent staffing is critical although the amount of care time delivered varies regionally. In the United States, federal legislation (i.e. Nursing Home Reform Act (1987)) has considerably low minimal standards for staffing: it requires sufficient staff to meet resident needs and one registered nurse Director of Nursing for eight hours a day for seven days a week and a licensed nurse in evening and night shifts [14]. State legislation varies but tends to have higher staffing standards; although, this has also been criticized by experts as inadequate [14]. According to the 2016 national report for LTC homes in the United States, staff time varies by facility type and resident case mix: the average of registered nurse (RN) hours per resident per day (hprd) ranged from 0.27 to 0.32, the average of licensed practical or vocational nurse (LPN) hprd ranged from 0.16 to 0.34, and the average of nursing assistant (NA) hprd ranged from 1.71 to 2.76 for a total number of 2.14 to 3.42 hprd [15]. In Canada, long-term care is offered through a mix of public, private for-profit, private not-for-profit, and religious-based providers. All LTC homes are legislated and funded by the province (although accommodation costs are shared as co-payments with residents). Provinces operate under the Canada Health Act (1984) which lists conditions required for federal funding of public health care services [16]. Across Canada, an RN on duty who is present at all times is generally required and provinces may additionally require a minimum number of paid staff hours per resident per day (e.x. Alberta requires 1.90 paid hprd from nursing and personal services staff whereas Ontario makes no such stipulations) [17, 18].
Several studies have investigated the associations of staff time with residents’ quality of care in LTC, however, because of limitations in study design and power, there remains uncertainty. Increases in RN staff time are associated with improvements in several quality of care domains (i.e., decreased physical restraints, pressure ulcers, catheterization, urinary tract infections, ADL decline, nutritional supplements, hospitalizations, and improved resident satisfaction) [10, 13, 19]. Increases in L/RPN care hours is associated with decreased pressure ulcers, ADL decline and physical restraint use [20]. Increases in NA care time is associated with decreased infections, pressure ulcers, ADL decline, incontinence, and physical restraint use [20].
Despite promising findings, the true benefits of high staffing levels in LTC are uncertain due to low data quality, insufficient study power, unknown mechanisms of action, and disparate measurement of quality and LTC home characteristics [10–13]. Additionally, existing LTC staffing practices are poorly understood: while LTC homes are required by law to provide minimum RN hours (which may vary by state or province), other nursing and support services are provided at the discretion of the LTC home on an as-needed basis, making these services highly variable [21, 22].
The purpose of this study was to explore the association between the number of staff care hours per resident per day and residents’ outcomes. The hypothesis investigated was that higher hours of direct care for residents is associated with better quality of care outcomes.
Methods
We performed a cross-sectional study across a chain of 19 for-profit LTC homes in Ontario, Canada from July 1, 2014 to June 30, 2015. Data were available from 11 LTC homes, representing 55 total units and 32 residents in each unit, serving approximately 5000 residents and employing 5738 staff members. The study sample included all existing and newly admitted LTC residents, as well as all RN, L/RPN and NA staff (both full-time and part-time, as well as agency-provided) employed at these facilities. The unit of analysis was the 55 units clustered within 11 LTC homes. This study was approved by the relevant Research Ethics Boards.
Sources of data
We collected data from the organization’s staffing records as well as provincially-mandated resident assessment data for the eleven LTC homes. The staffing data included staff hours worked per day, agency staff hours per day, minutes late to shift, minutes worked past shift end, number of years worked at the current LTC home and staff employment status (full-time, part-time, casual). The number of hours staff worked per day is calculated from the data collected by a scanner system where all staff are required to “punch-in” and “punch-out” at the beginning and end of their shift. This information was collected daily by the human resources department and de-identified records where shared.
Data on residents’ clinical characteristics, case mix, and outcomes were collected from the provincially-mandated Resident Assessment Instrument –Minimum Data Set (RAI-MDS) 2.0. RAI-MDS is a comprehensive assessment completed at admission, quarterly, and annually, and when a significant change in health status occurs for each resident in all LTC homes in Ontario [23]. This assessment was implemented in all US nursing homes in 1996 and is currently used in most provinces of Canada, as well as Europe, Asia, and Pacific Rim [23, 24]. We chose the risk adjusted quality indicators from RAI-MDS because these indicators are mandatory to report in Canadian and US nursing homes [25, 26]. We collected all resident assessments during the study period. We reported on the following RAI-MDS scales: depression rating scale (DRS) (i.e., a clinical screen for depression); changes in health, end-stage disease and signs and symptoms (CHESS) (i.e., a measure of health instability); pain (i.e., presence and intensity of pain); ADLs; cognitive performance scale (CPS) (i.e., a measure of consciousness, executive function and memory); and aggressive behavior scale (ABS) [23]. In addition, we reported on 13 practice sensitive RAI-MDS 2.0 quality indicators, which are considered to be responsive to clinical practice changes, including: pressure ulcer, worsening pain, physical restraint use, antipsychotic use without psychosis, indwelling catheter, delirium, declining behavioral symptoms, urinary tract infections, late loss ADL decline, fallen in the last 30 days, feeding tube, decline in mood, and unexplained weight loss [27]. Less than 1% of the population had a feeding tube; this item was dropped from the quality of care composite ranking score.
Statistical analyses
Descriptive analyses included means and standard deviations (SD) for data with a normal distribution (i.e., resident characteristics and staffing characteristics) and medians and interquartile ranges (IQR) for skewed data (i.e., quality indicators). We defined care hours per resident per day by total hours worked, divided by the sum of each day’s number of residents on each unit. Staff hours per resident per day was accrued to each unit and averaged over the 1-year timeframe. Staff time for staff working across multiple units (i.e., RNs, L/RPNs) was attributed across units.
We chose to investigate associations of staff time with a quality of care composite ranking. According to configurational theory, no single outcome can be expected to account for the complexity of managing organizations (such as a LTC home) [28]. Indeed, when a unit performs well in some areas and more poorly in others, it is challenging to conclude the overall effects of staff time in that unit. A more intuitive approach is to rank units on their performance on individual quality indicators and then create an overall summary ranking score. To define an overall measure of quality of care, we created a quality of care composite ranking for each unit similar to that of the US Centers for Medicare and Medicaid’s Five-Star system [29]. First, we adjusted the quality indicators using Canadian standard algorithms, equivalent to those used by the Canadian Institute for Health Information [30]. Across the 55 units, we assigned quintile values of 1 (poorest quality) to 5 (highest quality) to each practice sensitive RAI-MDS QI, and averaged these quintile rankings.
We applied a multi-level regression model, adjusting for clustering of units within LTC homes, to examine possible associations between staffing characteristics and overall quality of care for units. Using the PROC MIXED procedure, data at the unit were represented as clusters within LTC homes to account for the potential correlation between quality of care composite rankings within LTC homes. Such clustering would violate the assumption of independence of observations. We included the RUG-III case mix index (a widely used measure of expected relative staff time in LTC) to adjust for unit-level variation in staffing demands based on resident care needs [31]. Care hours per resident per day, proportion of shifts late by ten+ minutes, proportion of shifts worked past shift end, NA years of experience in the current home and NA employment status were defined a-priori and entered into the model. All analyses were performed using Statistical Analysis Software (SAS® 9.4, SAS Institute Inc., Cary, North Carolina).
Results
Sample size
The sample included 11 homes, 55 units, 858 NAs, 183 L/RPNs, 69 RNs, and 2173 unique residents for the period July 1, 2014 to June 30, 2015.
Resident characteristics
Resident characteristics are described in Table 1. Most residents were female (68.9%) and over 65 years of age (90.7%). Dementia (66.9%), impaired ADL functioning (52.3%), impaired cognition (63.1%), aggression (58.5%), bladder incontinence (68.7%), and dependent on wheelchair for mobility (58.3%) were common. Fewer residents had mood symptoms (29.7%), severely aggressive behaviors (18.6%), unstable health (21.8%) and wandering behaviors (24.7%).
Table 1.
Mean (SD) | |
---|---|
Female (%) | 68.9 (9.8) |
Age (years) | 82.7 (2.9) |
Age < 65 years (%) | 9.3 (8.5) |
Alzheimer’s disease and related dementias (%) | 66.9 (24.9) |
Activities of daily living impairmenta (%) | 52.3 (12.0) |
Cognitive impairmentb (%) | 63.1 (23.9) |
Depressive symptomsc (%) | 29.7 (20.1) |
Mildly aggressive behaviorsd (%) | 58.5 (21.4) |
Severely aggressive behaviorse (%) | 18.6 (13.3) |
Unstable healthf (%) | 21.8 (9.0) |
Bladder incontinence daily (%) | 68.7 (13.0) |
Wandering behaviors (%) | 24.7 (16.8) |
Wheelchair primarily used for mobility (%) | 58.3 (14.9) |
RUG-III case mix index | 1.098 (0.068) |
aDefined as a score of 4 or more in Activities of Daily Living Scale (ADL); score range is 0–16
bDefined as a score of 3 or more in Cognitive Performance Scale (CPS); score range is 0–6
cDefined as a score of 3 or more in Depression Rating Score (DRS); score range is 0–14
dDefined as a score of 1 or more in Aggressive Behavior Scale (ABS); score range is 0–12
eDefined as a score of 5 or more in Aggressive Behavior Scale (ABS); score range is 0–12
fDefined as a score of 2 or more in Changes in Health, End-Stage Disease, and Signs and Symptoms Score (CHESS); score range is 0–5
Quality of care
The practice sensitive quality indicators are described in Table 2. The most prevalent conditions included mood decline (28.7%), delirium (27.9%), antipsychotic use without psychosis (20.4%), late loss ADL decline (bed mobility, transfers, eating and toilet use) (18.0%), and fall in the last 30 days (18.1%). Indicators which were present in less than 10% of residents included indwelling catheter, urinary tract infection, worsening pain, pressure ulcer, physical restraint use, and unexplained weight loss. The quality of care composite ranking for each unit are displayed graphically as a boxplot in [see Additional file 1: Figure S1].
Table 2.
Median (IQR) | |
---|---|
Late loss ADL declinea (%) | 18.0 (11.4–23.8) |
Declining behavioral symptoms (%) | 13.1 (7.9–17.5) |
Indwelling catheter (%) | 1.4 (0.0–4.1) |
Urinary tract infection (%) | 4.6 (3.0–6.4) |
Delirium (%) | 27.9 (18.9–31.4) |
Antipsychotic use without psychosis (%) | 20.4 (13.8–27.6) |
Fallen in the last 30 days (%) | 18.1 (13.5–21.8) |
Mood declineb (%) | 28.7 (17.5–37.6) |
Worsening pain (%) | 5.5 (2.5–7.4) |
Pressure ulcer (%) | 4.7 (3.1–7.9) |
Physical restraint use (%) | 8.2 (2.5–10.8) |
Unexplained weight loss (%) | 9.7 (5.3–13.3) |
aDefined as a score of 4 or more in Activities of Daily Living Scale (ADL); score range is 0–16
bDefined as a score of 3 or more in Depression Rating Score (DRS); score range is 0–14
Staffing characteristics
Staffing characteristics are described in Table 3. On average, residents received 2.55 h of care per day: 0.15 h were provided by RNs, 0.44 h were provided by L/RPNs, and 1.95 h were provided by NAs. Agency staff contributed approximately 0.01 h of care per resident per day, although this varied widely among units, with many using no agency staffing during the study period. Many NAs had full-time employment status (36.7%) and many worked for at least seven years in LTC (46.3%).
Table 3.
Mean (SD) | |
---|---|
Care hours per resident per day | |
Registered nurse (RN) | 0.15 (0.04) |
RN agency staff | 0.0032 (0.0055) |
Licensed/Registered practical nurse (L/RPN) | 0.44 (0.09) |
L/RPN agency staff | 0.0051 (0.0080) |
Nursing assistant (NA) | 1.95 (0.24) |
NA agency staff | 0.0046 (0.0076) |
Total | 2.55 (0.26) |
Late 10+ minutes to shift | |
RN (%) | 1.7 (1.2) |
L/RPN (%) | 1.7 (1.3) |
NA (%) | 1.6 (0.9) |
Stayed 30+ minutes past shift end | |
RN (%) | 27.9 (16.7) |
L/RPN (%) | 16.2 (8.7) |
NA (%) | 2.2 (1.3) |
Nursing assistant | |
Proportion serving 7+ years in the current LTC (%) | 46.3 (16.4) |
Full-time (%) | 36.7 (7.7) |
Model
The association of quality of care ranking with staffing factors within units is described in Table 4, where estimates reflect absolute changes in the average quality of care ranking, after adjusting for all other factors. A unit with one additional NA care hour per resident per day was associated with an improvement (increase) in the quality of care composite ranking score (on a 1 to 5 scale) by 0.89 (p = < 0.01). Controlling for all other factors, a 1 % increase in L/RPNs ‘late to shift’ was associated with an increase in the unit’s quality of care composite ranking by 0.10 (p = 0.02), yet a 1 % increase in the percent of NAs late to shift was associated with a decrease of 0.14 in the unit’s quality of care composite ranking (p = 0.02). Additionally, a 1 % increase in NAs with seven or more years of experience in the current LTC home was associated with an increase of 0.01 in the unit’s quality of care composite ranking (p = 0.02). There was no statistically significant association with quality of care for RN care hours, L/RPN care hours, agency staff care hours, the percent of RNs late to shift, any staff staying past shift, or proportion of NAs with full-time employment status. A correlation matrix (See Additional file 2: Table S1) indicates that no correlations exceed .8 and no variable resulted in a variance inflation (VIF) above 10 (multi-variable linear regression with the collinearity diagnostics). There is no evidence multicollinearity was an issue in the model.
Table 4.
Estimate | P-value | |
---|---|---|
Case mix index | −0.10 | 0.92 |
RN hours per resident per day | 0.63 | 0.84 |
L/RPN hours per resident per day | 0.16 | 0.84 |
NA hours per resident per day | 0.90 | < 0.01 |
Agency staff hours per resident per day | 3.50 | 0.36 |
RN proportion shifts late 10+ minutes | <−0.01 | 0.95 |
L/RPN proportion shifts late 10+ minutes | 0.10 | 0.02 |
NA proportion shifts late 10+ minutes | −0.14 | < 0.01 |
RN stayed 30+ minutes past shift end | −0.01 | 0.45 |
L/RPN stayed 30+ minutes past shift end | 0.01 | 0.68 |
NA stayed 30+ minutes past shift end | 0.03 | 0.54 |
NA proportion serving 7+ years in the current LTC | 0.01 | 0.02 |
NA proportion that are full time | 0.01 | 0.09 |
1Each of 12 quality indicators ranked within 55 units, given a quintile score of 1 (worst) to 5 (best); adjusted for unit nested within the LTC home
2Example Interpretation: All things staying the same, a unit with one additional NA hour per patient per day was associated with a quality of care composite ranking score improvement of 0.9 (on the 1 to 5 scale). For variables stated as percentages: All things staying the same, a 1% increase in NA shifts that were started late (by 10 or more minutes) starting their shift 10 min was associated with a quality of care composite ranking decline of 0.14 (on the 1 to 5 scale)
Discussion
A significant number of older people depend on LTC services [1, 2]. Many studies have attempted to determine the optimal care hours required to meet resident needs but, because of design limitations, there remains uncertainty [10–13].
The characteristics of LTC residents who participated in this study mirrored the provincial data on residents’ age (83 years vs. 82 years provincially), gender (69% female vs. 69% female provincially), diagnosed with dementia (67% vs. 60% provincially) and depressive symptoms (30% vs. 34% provincially) [32]. When compared to data from US nursing homes, residents were similar in terms of gender (69% female vs. 66% female US), ADL impairment (52% vs. 63% US) and cognitive impairment (63% vs. 61% US) [33].
Some quality of care indicators included in this study compared favorably with national and provincial Canadian averages: antipsychotic use without psychosis (20% vs. 23–27% CAN) and worsening pain (5.5% vs. 10.3–10.5% CAN) [27, 29]. The quality of care indicators which did not compare well to the Canadian and provincial (Ontario) averages included falls (18% vs. 15–16% ON and CAN), physical restraint use (8% vs. 6.0–7% CAN), mood decline (29% vs. 22–26% ON and CAN), and pressure ulcers (5% vs. 3% ON and CAN) [32, 33]. The quality indicator rates found in this study were similar with US national reports as well: antipsychotic use (20% vs. 23% US), falls (18% vs. 16% US) and pressure ulcers (5% vs. 5% US) [34]. Based on these estimates, it appears that our sample is broadly representative of North-American LTC resident populations.
According to the most recent report for LTC homes in the United States, the average paid care time in for-profit LTC homes is 0.26 RN hprd, 0.16 LPN hprd and 2.45 NA hprd for a total of 2.87 hprd [15]. However, the report does not distinguish between “worked” hours and “paid hours” (i.e., paid hours could appear inflated because of vacation or sick time). We found that, on average, residents received 88.9% of the reported average number of total care hours, 57.7% of RN care hours, 275.0% of L/RPN care hours, and 79.6% of NA care hours. Decreased care time has been found to be associated with rationing of care which may impact clinical outcomes [35]. While the residents in this study appeared to receive fewer care hours than US national averages, the authors deemed it to be beyond the scope of this study to evaluate if the average care hours are appropriate standards for care. Instead, this study examined the associations of care hours as they relate to residents’ quality of care.
In terms of associations between staffing factors and quality of care, NA care hours were significantly associated with higher overall quality of care; however, there was no such observation with RN or L/RPN hours. A potential reason for this could be that by averaging RN and L/RPN hours per resident per day across the different units per home, we effectively removed any variation at the unit level. However, this was necessary given that RN and L/RPN hours were not assigned to indicusal units. In LTC homes, RN and L/RPN time is mostly dedicated to provide assessment and care only to residents experiencing instability, high complexity and/or are near the end of life. A study focusing specifically on the association between RN and L/RPN time and quality of care for complex residents could observe such an association. Additionally, the numbers of RN or L/RPN staff in this study were low, and may have been dominated by the total staff relationship (RN, L/RPN, NA) with quality of care.
Some of the associations between staffing variables and quality of care were statistically significant, but of a very small size, limiting their clinical relevance. For example, the proportion of L/RPN and NA shifts that were started late (10 or more minutes) were weakly associated with the quality of care composite ranking. Late to shift may represent a complicated combination of staff morale, organization, personal stress, and tangible care available to resident during shift change. The meaning and influence of late to shift might be dependent on a unit’s culture and normal practice patterns. However, none of these inferences could be supported in this study, nor are they supported in the literature. We also found that NAs’ years of experience in the current LTC home was significantly associated with improved overall quality of care. This is likely the result of increased familiarity with residents, families, colleagues, and the organization; as well as being an indicator of low staff turnover, which has been shown to be an important determinant of quality of care [36].
This study used one of the largest samples of LTC residents to date. Additionally, our study described staff hours in detail and related them to a robust quality of care composite ranking, which provides a consolidated view on quality compared to individual quality indicators per unit. However, our study only described one LTC organization and it used a cross-sectional design, which does not establish causality. Despite these limitations, our findings demonstrate the importance of NAs as they provide a meaningful contribution to the quality of care residents receive.
Conclusions
In conclusion, associations between LTC staffing characteristics and overall quality of care were found for NA care hours and NA years of experience in the current LTC home. This study highlighted the importance of employing and retaining NAs as they contribute to quality of care in LTC homes. There have been smaller studies with similar objectives which showed mixed associations with certain quality of care indicators. To our knowledge, this was the largest multi-site study among nursing home residents and staff which evaluated multiple dimensions of quality of care.
Additional files
Acknowledgments
Funding
This work was supported by The Natural Sciences and Engineering Research Council of Canada: College and Community Innovation Program-Industrial Research Chairs for Colleges Grant [grant number 137020]. The funder had no influence on the study design, data collection, analysis, interpretation of data, or the writing of the manuscript.
Availability of data and materials
Under the provisions set out in the legislation (Province of Ontario Personal Health Information Protection Act, 2004, S.O. 2004, c. 3, Sched. A) as well as research ethics, our study does not have clearance to make the data publicly available. Data are however available from the authors upon request and with permission of data owner (LTC organization) and with research ethics board approval.
Abbreviations
- ADL
Activities of daily living
- L/RPN
Licensed/Registered Practical Nurse
- LTC
Long-term care
- NA
Nursing assistant
- RAI-MDS
Resident assessment instrument-minimum Data Set
- RN
Registered nurse
Authors’ contributions
VB and AC were responsible for the study conception, design, acquisition of data collection, and data interpretation. AC, JPo, and MD were responsible for data interpretation and drafting the manuscript. VB, SS, Jd, PB, GH, JPl, JPo and AC contributed to critical revisions of the manuscript for important intellectual content. All authors have read and approved the final version of the manuscript and agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriate investigated and resolved.
Ethics approval and consent to participate
This study was approved by the Conestoga College Research Ethics Board (REB-118) Hamilton Integrated Research Ethics Board (0739D – McMaster University). Participant consent was not required given that the data used in this study were from existing anonymized records in compliance with the requirements for the secondary use of health information outlined in our provincial legislation (Province of Ontario Personal Health Information Protection Act, 2004, S.O. 2004, c. 3, Sched. A).
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Veronique M Boscart, Phone: 519-748-5220, Email: vboscart@conestogac.on.ca.
Souraya Sidani, Email: ssidani@ryerson.ca.
Jeffrey Poss, Email: jwposs@uwaterloo.ca.
Meaghan Davey, Email: zehrm1@mcmaster.ca.
Josie d’Avernas, Email: davernas@uwaterloo.ca.
Paul Brown, Email: paul.brown@schlegelvillages.com.
George Heckman, Email: ggheckma@uwaterloo.ca.
Jenny Ploeg, Email: ploegj@mcmaster.ca.
Andrew P Costa, Email: acosta@mcmaster.ca.
References
- 1.Nursing Home Care FastStats. Centers for disease control and prevention (online). https://www.cdc.gov/nchs/data/series/sr_03/sr03_038.pdf. Accessed 6 Mar 2017.
- 2.Living arrangements of seniors. Statistics Canada (online). https://www12.statcan.gc.ca/census-recensement/2011/as-sa/98-312-x/98-312-x2011003_4-eng.cfm. Accessed 6 Mar 2017.
- 3.Moore KL, Boscardin WJ, Steinman MA, Schwartz JB. Age and sex variation in prevalence of chronic medical conditions in older residents of U.S. nursing homes. J Am Geriatr Soc. 2012;60:756–764. doi: 10.1111/j.1532-5415.2012.03909.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.National Nursing Homes Survey. Centers for disease control and prevention (online). https://www.cdc.gov/nchs/nnhs/resident_tables_estimates.htm. Accessed March 6, 2017.
- 5.When a nursing home is home: how do Canadian nursing homes measure up on quality? Canadian Institute for Health Information (online). https://secure.cihi.ca/free_products/CCRS_QualityinLongTermCare_EN.pdf. Accessed March 6, 2017.
- 6.Estabrooks CA, Squires JE, Carleton HL, et al. Who is looking after mom and dad? Unregulated workers in Canadian long-term care homes. Can J Aging. 2015;34(1):47–59. doi: 10.1017/S0714980814000506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Hirdes JP, Mitchell L, Maxwell CJ, White N. Beyond the 'iron lungs of gerontology': using evidence to shape the future of nursing homes in Canada. Can J Aging. 2011;30(3):371–390. doi: 10.1017/S0714980811000304. [DOI] [PubMed] [Google Scholar]
- 8.Tyler DA, Feng Z, Leland NE, et al. Trends in postacute care and staffing in US nursing homes, 2001-2010. J Am Med Dir Assoc. 2013;14:817–820. doi: 10.1016/j.jamda.2013.05.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Donabedian A. An introduction to quality assurance in health care. 3. Oxford: Oxford University Press; 2003. [Google Scholar]
- 10.Castle NG, Gerguson JG. What is nursing home quality and how is it measured? Gerontologist. 2010;50(4):426–442. doi: 10.1093/geront/gnq052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Spilsbury K, Hewitt C, Stirk L, Bowman C. The relationship between nurse staffing and quality of care in nursing homes: a systematic review. Int J Nurs Stud. 2011;48(6):732–750. doi: 10.1016/j.ijnurstu.2011.02.014. [DOI] [PubMed] [Google Scholar]
- 12.Bostick JE, Rantz MJ, Flesner MK, Riggs CJ. Systematic review of studies of staffing and quality in nursing homes. J Am Med Dir Assoc. 2006;7(6):366–376. doi: 10.1016/j.jamda.2006.01.024. [DOI] [PubMed] [Google Scholar]
- 13.Backhaus R, Verbeek H, van Rossum E, et al. Nurse staffing impact on quality of care in nursing homes: a systematic review of longitudinal studies. J Am Med Dir Assoc. 2014;15(6):383–393. doi: 10.1016/j.jamda.2013.12.080. [DOI] [PubMed] [Google Scholar]
- 14.Harrington C, Schnelle JF, McGregor M, et al. The need for higher minimum staffing standards in U.S. nursing homes. Health Serv Insights. 2016;12(9):13–19. doi: 10.4137/HSI.S38994. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Rome V, and Harris-Kojetin, LD. Variation in residential care community nurse and aide staffing levels: United States, 2014. National Health Statistics Report 2016. https://www.cdc.gov/nchs/data/nhsr/nhsr091.pdf. Accessed January 4, 2018. [PubMed]
- 16.Fact sheet: Canada health act. Canadian nurses association. https://www.cna-aiic.ca/~/media/cna/page-content/pdf-en/fs01_canada_health_act_june_2000_e.pdf?la=en Accessed January 4, 2018.
- 17.A guide to the long-term care homes act, 2007 and regulation 79/10. http://www.health.gov.on.ca/en/public/programs/ltc/docs/ltcha_guide_phase1.pdf. Accessed January 4, 2018.
- 18.Nursing homes act: nursing homes operation and regulation. Province of Alberta. http://www.qp.alberta.ca/documents/Regs/1985_258.pdf. Accessed January 4, 2018.
- 19.Lee HY, Blegen MA, Harrington C. The effects of RN staffing hours on nursing home quality: a two-stage model. Int J Nurs Stud. 2014;51(3):409–417. doi: 10.1016/j.ijnurstu.2013.10.007. [DOI] [PubMed] [Google Scholar]
- 20.Harrington C, Choiniere J, Goldmann M, Jacobsen FF, Lloyd L, McGregor M, Stamatopoulos V, Szebehely M. Nursing home staffing standards and staffing levels in six countries. Journal Nurs Scholarsh. 2012;44(1):88–98. doi: 10.1111/j.1547-5069.2011.01430.x. [DOI] [PubMed] [Google Scholar]
- 21.Nursing Home Regulations Plus. University of Minnesota (online). http://www.hpm.umn.edu/nhregsplus/NHRegs_by_State/By%20State%20Main.html. Accessed March 6, 2017.
- 22.A guide to the long term care homes act, 2007 and regulation 79/10. Government of Ontario (online). http://www.health.gov.on.ca/en/public/programs/ltc/docs/ltcha_guide_phase1.pdf. Accessed March 6, 2017.
- 23.Long-Term Care Facilities. InterRAI (online). https://www.cihi.ca/en/outcome_rai-mds_2.0_en.pdf. Accessed March 6, 2017.
- 24.Heckman GA, Gray LC, Hirdes J. Addressing health care needs for frail seniors in Canada: the role of InterRAI instruments. CGS CME. 2013;30:8–16. [Google Scholar]
- 25.Measuring long-term care performance in Ontario. Health Quality Ontario (online). http://www.hqontario.ca/System-Performance/Measuring-System-Performance/Measuring-Long-Term-Care-Homes. Accessed January 8, 2017.
- 26.Quality Measures. Centers for Medicare and Medicaid Services (online). https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-instruments/NursingHomeQualityInits/NHQIQualityMeasures.html
- 27.Estabrooks CA, Knopp-Sihota JA, Norton PG. Practice sensitive quality indicators in RAI-MDS 2.0 nursing home data. BMC Res Notes. 2013;13(6):460. doi: 10.1186/1756-0500-6-460. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Anderson RA, Hsieh PC, Su HF. Resource allocation and resident outcomes in nursing homes: comparisons between the best and worst. Res Nurs Health. 1998;21(4):297–313. doi: 10.1002/(SICI)1098-240X(199808)21:4<297::AID-NUR3>3.0.CO;2-A. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Design for Nursing Home Compare Five-Star Quality Rating System: technical user’s guide. Centers for Medicare and Medicaid Services (online). https://www.cms.gov/Medicare/Provider-Enrollment-and-Certification/CertificationandComplianc/Downloads/usersguide.pdf. Accessed March 6, 2017.
- 30.CCRS quality indicators risk adjustment methodology. Canadian Institute for Health Information (online). https://www.cihi.ca/en/ccrs_qi_risk_adj_meth_2013_en.pdf. Accessed on 13th April 2017.
- 31.Fries BE, Schneider DP, Foley JW, Gavazzi M, Burke R, Cornelius E. Refining a case-mix measure for nursing homes: resource utilization groups (RUG-III) Med Care. 1994;32(7):668–685. doi: 10.1097/00005650-199407000-00002. [DOI] [PubMed] [Google Scholar]
- 32.Long-term care performance in Ontario. Health Quality Ontario (online). http://www.hqontario.ca/System-Performance/Long-Term-Care-Home-Performance. Accessed 6 Mar 2017.
- 33.Your health system (ON). Canadian Institute for Health Information (online). https://yourhealthsystem.cihi.ca/hsp/indepth?lang=en#/theme/C5001/2/. Accessed 6 Mar 2017.
- 34.Nursing home data compendium 2015 edition. Centers for Medicare and Medicaid Services (online). https://www.cms.gov/Medicare/Provider-Enrollment-and-Certification/CertificationandComplianc/Downloads/nursinghomedatacompendium_508-2015.pdf Accessed March 6, 2017.
- 35.Zúñiga F, Ausserhofer D, Hamers JP, et al. The relationship of staffing and work environment with implicit rationing of nursing care in Swiss nursing homes--a cross-sectional study. Int J Nurs Stud. 2015;52(9):1463–1474. doi: 10.1016/j.ijnurstu.2015.05.005. [DOI] [PubMed] [Google Scholar]
- 36.Castle NG, Engberg J, Men A. Nursing home staff turnover: impact on nursing home compare quality measures. Gerontologist. 2007;47(5):650–661. doi: 10.1093/geront/47.5.650. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Under the provisions set out in the legislation (Province of Ontario Personal Health Information Protection Act, 2004, S.O. 2004, c. 3, Sched. A) as well as research ethics, our study does not have clearance to make the data publicly available. Data are however available from the authors upon request and with permission of data owner (LTC organization) and with research ethics board approval.