Abstract
Patients following cardiac surgery commonly experience post-operative delirium (POD) during their postoperative hospital stay. A multifaceted, specialty wide, quality improvement (QI) project was undertaken for patients experiencing POD. The goal was to develop a reduction in POD care bundle (rPOD-a structured patient care program) that encompasses efficient preoperative risk factor identification and a postoperative patient-care process to ensure early POD identification and treatment. The following steps were taken to implement the rPOD care bundle including: (a) Developing a quality driven, evidence-based guideline for the perioperative cardiac surgery health care team, (b) identifying and addressing local barriers to implementation, (c) selecting performance measures to assess intervention adherence and patient outcomes, and (d) ensuring that all patients receive the interventions through staff engagement and education, and regular project evaluation. Trends of process measures and quality improvement measures were examined. An increasing trend in the rate of postoperative delirium screening during implementation of rPOD intervention was demonstrated. This quality improvement study provides a bases for future postoperative delirium reduction interventions.
Keywords: postoperative delirium, postoperative care, quality improvement, cardiac surgery, care strategies
1. Introduction
Delirium is an acute brain dysfunction characterized by a fluctuating disturbance of consciousness with inattention and cognition and perception deficits [1,2]. It is the most common neuropsychological complication following cardiac surgery, with the most recent estimates of prevalence ranging from 25% to 50% [3,4]. While postoperative delirium (POD) may resolve in hospital, the patients experiencing delirium are at a higher risk of worse in-hospital and post-discharge outcomes. Numerous studies among cardiac surgery patients have demonstrated that POD increases the risk of postoperative mortality and of prolonged length of hospital stay [5,6,7,8]. In addition, such patients are at a higher risk of functional decline both physically and mentally, resulting in post-discharge poor quality of life, as well as a higher rate of nursing home placement [5,6,7,8]. There has been extensive research documenting the short- and long-term hazards associated with POD. In the same vein, many critical care societies have published care bundles to support institutional patient-care processes facilitating early identification and treatment of POD. One such example would be of the society of critical care medicine published ABCDEF- ICU liberation 2010 and PAD (Pain, agitation and delirium) guidelines in 2013. However, the condition remains frequently unrecognized (in three out of four ICU patients), and under-appreciated during hospitalization [9,10].
Hospital-wide strategies focused on reducing POD are essential to improving clinical outcomes of surgery, as well as to improving patient-related outcomes including postoperative cognitive functioning. Through this knowledge translation-quality improvement initiative, the goal was to develop steps essential to implement an rPOD care bundle, centered around assessing baseline vulnerability (preoperative risk factor assessment), implementing preventative strategies, as well as early identification and management of delirium based on the available best practice evidence.
This project was implemented through a validated QI model (Figure 1) [11]. Here, we describe our collaborative healthcare improvement initiative carried through the following four steps: (1) summarizing evidence to identify potentially beneficial interventions, (2) identifying local barriers to implementation, (3) selection and development of performance measures and, (4) ensuring that all patients receive the interventions. The last step follows an iterative “4E” algorithm to engage and educate front line staff, execute the intervention and evaluate performance using objective measurement tools (Figure 1) [11].
The purpose of this quality improvement project was to develop and implement a structured program to assess risk factors and to reduce incidence, early identification and prompt treatment of POD among the post-cardiac surgery ICU patients. This project targeted health care providers in the cardiac pre-assessment clinic (CPAC), cardiac surgery in-patient unit (CSIU), intensive care cardiac surgery (ICCS), cardiology inpatient unit, inclusive of nursing staff, physician assistants, physicians, as well as cardiac surgery patients and their caregivers.
The global aim of this quality improvement project was to decrease the prevalence of postoperative delirium among cardiac surgery patients at our center. The objective of this paper is to describe a multifaceted, quality improvement undertaking for the reduction of postoperative delirium, via prevention and management, in a cardiac surgery unit within a tertiary care hospital. In doing so, the study team discusses barriers encountered during the QI process and solutions to those barriers, along with the issues concerning staff adherence and long-term sustainability in order to provide relevant information for other cardiac surgery units that may wish to undertake a similar project.
2. Methods
2.1. Context for the QI Project
The rPOD quality improvement initiative was carried out at the St. Boniface Hospital (tertiary care center for the province of Manitoba, Cardiac Science Program including CPAC, ICCS, and CSIU). The multidisciplinary delirium working group, the perioperative health care providers, Winnipeg Regional Health Authority (WRHA), and cardiovascular surgery patients were the key stakeholders.
2.2. Use of an Established QI Model
The rPOD care bundle was implemented starting in 2012 with its completion in 2016. Here, we have employed an established QI model (Figure 1, Table 1) for improving the quality of care for cardiac surgery patients and to reduce the postoperative delirium prevalence among the cardiac surgery patients. The strategies were employed across the time frame, which was consecutive, but at times simultaneous.
Table 1.
Step 1: Summarizing Evidence to Identify Potentially Beneficial Interventions | Step 2: Identifying Local Barriers to Implementation | Step 3: Selecting and Developing Performance Measures | Step 4: Ensuring All Patients Receive the Interventions |
---|---|---|---|
|
|
|
E-Engage E-Educate E-Execute E-Evaluate |
The table describes the adaption of a previously validated quality improvement model and provides a stepwise implementation of the rPOD care bundle.
2.3. Applying the QI Model to Reduce Postoperative Delirium among the Cardiac Surgery Patients
Overall Considerations
The improvement process involved a large patient care system involving an extensive multidisciplinary collaboration. A key first step was establishing a multidisciplinary team (i.e., delirium working group) to design and implement the project. This process was initiated by a cardiac surgeon (RA) with extensive QI experience and who is the director of ICCS, as well as the section head for the section of cardiac surgery. The other members of the delirium working group included an anesthetist (HG), a nurse champion (SW), as well as the perioperative cardiac surgery nursing staff.
Step 1: Summarize the Evidence
Our QI team developed guidelines targeted towards reducing postoperative delirium. The rPOD care bundle was developed based on our previous experience, the best evidence from the literature and through expert consensus. The rPOD care bundle consists of 3 domains as follows (Table 2):
Table 2.
Preoperative Intervention (CPAC, CSIU, 5A)—Preoperative Assessment Package | Operative Intervention | Postoperative Intervention—ICCS |
---|---|---|
|
|
|
Nurse education package and Yearly self-learning module |
The above table delineates the components of rPOD care bundle that were implemented across the perioperative period.
Domain 1: Establishing Assessment Practices
(A) The baseline vulnerability assessment, including frailty assessment (i.e., Clinical Frailty Scale (CFS)), and cognitive assessment (i.e., Montreal Cognitive Assessment (MoCA)), were implemented. These screening tools were a part of the preoperative assessment package (initially introduce by the Winnipeg Regional Health Authority as a part of a delirium program for all surgical specialties). In addition, a delirium score card (Figure S1) was implemented to assess the risk of postoperative delirium.
(B) During the postoperative period, the Confusion Assessment Method for the ICU (CAM-ICU) screening, [12] and the Critical-Care Pain Observation Tool (CPOT) [13], were introduced in the ICCS unit.
Domain 2: Introducing and Implementing Preventative Strategies
(A) Preoperative: The patient and caregiver delirium education brochure was given during their preoperative visit. The goal was to increase patients’ and caregivers’ awareness regarding postoperative delirium (i.e., risk factors, signs and symptoms and outcomes). In addition, the brochure provided specific guidelines regarding the patients’ and caregivers’ roles in aiding early identification and management of delirium.
A ‘Getting to know you’ form was introduced to gather personal patient information, including family members’ names, use of assistive devices (hearing aid, glasses, dentures, mobility aid), profession, interests/hobbies and preferred terms for common activities. Such information could be valuable to the frontline staff to facilitate the cognitive functions during the postoperative recovery period.
(B) Intra operative: A delirium score card was included in the operating room time-out. The patients identified as high risk of delirium, using the delirium score card, received an EEG and cerebral capnography-guided anesthesia, to minimize sedation-related neurocognitive dysfunction.
(C) Postoperative: Early mobilization protocol was introduced in the postoperative intensive care unit.
Domain 3: Delirium Care Strategies
The delirium care strategies included investigating modifiable factors, non-pharmacological and pharmacological interventions (Table 3). In addition, the primary care practitioners were informed of their patients’ experiencing delirium and were sent an information pamphlet describing the long-term impact of postoperative delirium which may affect their patient’s post-discharge health-related quality of life.
Table 3.
A Positive CAM Indicates Delirium, a Medical Emergency and Should Be Translated to Following Action | |
---|---|
Investigations | Interventions |
|
|
Step 2: Identify Local Barriers to Implementation
We carefully considered the steps involved in preparing the frontline staff through engaging all relevant stakeholders (ICCS, CSIU, CPAC RN, Physician Assistant) in monthly, multidisciplinary, delirium working group meetings. The goal was to identify barriers to achieve staff buy-ins and implementation. As described in step 4: multiple strategies of the 4 E’s model were applied to promote efficient implementation.
The barriers to the rPOD QI project and their management strategies are described in Table 4. An important barrier was the lack of cardiac surgery-specific delirium management guidelines. Through the Plan-Do-Check-Adjust iterative cycle the delirium working group drafted the cardiac science delirium guidelines.
Table 4.
Barriers | Strategy to Overcome Barriers | |
---|---|---|
1 | Lack of leadership |
|
2 | Lack of delirium-related knowledge and training among nursing staff |
|
3 | Lack of preoperative baseline risk assessment |
|
4 | Over sedation |
|
5 | Delirium screening |
|
6 | Perceived pain and discomfort screening |
|
7 | Early mobilization |
|
8 | Interventions aimed at preventing delirium |
|
9 | Lack of patient and caregiver engagement |
|
10 | Lack of communication with the community physician (family physician) |
|
The majority of local barriers were regarding intervention implementation. The rPOD intervention was implemented in sequential and additive stages to limit overwhelming the staff with multiple interventions. Lack of delirium-related education and training among the cardiac surgery frontline health care providers was another important barrier. Multiple information and education sessions were conducted to facilitate staff buy-in. The training was further augmented through the regional health authority’s initiative to educate and train all surgical units and patient care staff regarding postoperative delirium and to provide necessary training including assessment tools (CAM ICU, CPOT) and recoding in the electronic patient record.
Step 3: Performance Measure
The process and outcome measures were collected retrospectively (Table 5). Adherence data includes completion rates of baseline risk and POD assessment.
Table 5.
Measure (S) | Mode of Assessment |
---|---|
Process Measures (Intervention adherence) | |
Intervention adherence | Rate of completion of baseline risk assessment |
Rate of completion of delirium assessment | |
Outcome Measures | |
Primary outcome | Rates of delirium screening |
Quality indicators | Number of positive CAM screens in clinical database for patients screened with CAM |
Number of patients restrained in ICU, Wards | |
Hospital LOS, ICU LOS | |
All-cause in hospital mortality | |
Major adverse cardiac events | |
Rate of sternal wound infection |
The primary outcome measure was the change in the rates of POD screening before, during and after the rPOD care bundle implementation. The quality indicator measures are detailed in Table 5. The performance measures were collected for the ICCS unit, Preoperative assessment clinic and CSIU. In addition, fiscal trends, in terms of departmental expenditure, constant care resource utilization for the duration of rPOD implementation and post implementation were also collected.
For the primary analysis, a pre-post design was used to compare outcomes during the baseline pre-intervention period versus when all the rPOD care bundle had been implemented.
Research ethics board approval was provided to collect compliance and quality improvement metrics data for this study
Step 4: Ensuring Complete Intervention Implementation: 4 Es’ Model
Engage: Engagement of all stakeholders, from the study leadership to frontline clinical staff, was necessary to ensure buy-in and sustained project adherence. The engagement process included: (1) Conducting educational sessions with a focus on evidence regarding risk factors of delirium, significance of incident delirium and care strategies, as well as presenting results from the previous research delirium study demonstrating delirium rates among cardiac surgery patients at our center, (2) Recruitment of a nurse champion to collaborate on the project, and (3) Monthly review meetings of the delirium working group committee.
Educate: Staff education took place throughout the project. To engage the frontline staff, we administered multiple education and presentation sessions. In these sessions we presented the results of our delirium screening research study and also trained staff to implement the delirium intervention. The nurse champion attended multidisciplinary team meetings and was instrumental in the project design. In preparation for the pilot study, ICCS nurses were briefed on details of the QI project, the daily checklist and delirium screening. During the pilot delirium research study, a member of the ICCS delirium team met frequently with the night shift staff to provide feedback, answer questions and address barriers to future interventions and assessment (baseline risk and delirium screening) completion. In addition, the nursing staff attended educational programs developed by the regional health authority.
Execute: As described in the QI model, there are four general approaches to overcoming implementation barriers. First, the QI team standardized care by orienting all intensive care staff to rPOD care bundles. Second, the QI team used independent reminders, in the form of a checklist and daily verbal reminders from charge nurses and nurse champions to complete the rPOD intervention. Additionally, the QI team introduced a smaller number of interventions at one time using a staged approach. Finally, to learn from problems, throughout the project barriers were reviewed and addressed at monthly delirium working group meetings (Step 2: Identify Local Barriers to implementation).
Evaluate: An “audit and feedback” approach was employed to access group adherence as well as to encourage following of the set standards. The adherence data was presented and discussed with the nurse champion during the monthly delirium working group. Those with high adherence were commended while those with lower adherence were further engaged and educated to facilitate compliance.
3. Results
The delirium quality improvement intervention was implemented from 2012 to 2016. Different domains of the intervention may have been implemented simultaneously (Table S1). The adult patients (age ≥ 18 years) undergoing cardiac surgery were eligible for the intervention and outcome analysis. The corresponding health care providers’ compliance data was collected during the cardiac surgery patients’ perioperative care transition, including the preoperative, intraoperative and postoperative period. The data about each reporting period has been collected and analyzed.
The median patient age was 67 years (58–74) Table 6. The preoperative risk, as assessed using MoCA, CFS and PHQ9 (Table 6), were similar between patients across all intervention stages. Additional baseline and ICU data are summarized in the Table 7 and Table 8.
Table 6.
Patient Characteristic | Pre-rPOD Intervention (2009–2011) | During-rPOD Intervention (2012–2015) | Post-rPOD Intervention (2016–2018) | p-Value |
---|---|---|---|---|
Age | 66 (58–74) | 67 (58–74) | 68 (59–75) | <0.001 |
Sex (Female) | 28.2% | 27.9% | 27.8% | 0.942 |
Type of Cardiac Surgery | ||||
CABG | 60.9% | 46.9% | 45.6% | <0.001 |
Valve | 14.8% | 20.2% | 23.0% | <0.001 |
CABG + Valve | 11.2% | 11.3% | 11.1% | 0.969 |
Other | 13.1% | 21.6% | 20.3% | <0.001 |
MoCA Score | - | 26 (23–28) | 26 (23–28) | 0.479 |
CFS (Nursing Assessment) | - | 3 (2–4) | 4 (3–4) | <0.001 |
Patient Health Questionnaire (Version 9) | - | 1 (0–3) | 2 (0–6) | <0.001 |
Continuous variables expressed as median (quartile 1–3) and compared using Kruskal-Wallis Test. Categorical variables expressed as percentage and compared using Chi-Square Test. Summary statistics calculated on non-missing data. MoCA—Montreal Cognitive Assessment, CFS—Clinical Frailty Scale
Table 7.
7.1. Process Measures | During-rPOD Implementation (2012–2016) | Post-rPOD Implementation (2016–2018) | p-Value |
---|---|---|---|
7.1.1 Baseline risk assessment | |||
MoCA completion rate | 30.0% | 46.6% | <0.001 |
CFS completion rate | 30.7% | 49.2% | <0.001 |
7.1.2 Delirium assessment | |||
Any CAM Assessment Recorded | 97.3% | 98.5% | 0.002 |
Any RASS Assessment Recorded | 98.4% | 99.2% | 0.006 |
Continuous variables expressed as median (quartile 1–3) and compared using Kruskal-Wallis Test. Categorical variables expressed as percentage and compared using Chi-Square Test. Summary statistics calculated on non-missing data. MoCA—Montreal Cognitive Assessment, CFS—Clinical Frailty Scale.
Table 8.
7.2. Quality Improvement Measures | Pre-rPOD Intervention (2009–2011) | During-rPOD Intervention (201–2016) | Post-rPOD Intervention (2016–2018) | p-Value |
---|---|---|---|---|
7.2.1 Primary outcome | ||||
Postoperative delirium screening rates | 9.0% | 23.3% | 19.1% | <0.001 |
7.2.2 Quality indicators | ||||
Number of Positive CAM screens in clinical database for patients screened with CAM | 2 (1–4) | 2 (1–5) | 3 (1–6) | <0.001 |
Number of patients restrained—ICU | - | 3.0% | 1.2% | <0.001 |
Number of patients restrained—Ward | - | 0.4% | 0.4% | 0.955 |
Length of ICU stay for patients screened with delirium (Hours) | 79 (43–161) | 90 (42–165) | 74 (41–147) | 0.329 |
Length of Hospital Stay (Surgery to Discharge) for patients screened with delirium (Days) | 12 (7–22) | 13 (8–23) | 12 (8–23) | 0.282 |
Major Adverse Cardiac Events (MI, Stroke, Dialysis, In-Hospital Mortality) |
5.4% | 8.1% | 6.3% | <0.001 |
Sternal Infection (Superficial or Deep) | 0.2% | 1.3% | 1.3% | <0.001 |
In-Hospital Mortality | 2.5% | 3.2% | 2.1% | 0.012 |
Continuous variables expressed as median (quartile 1–3) and compared using Kruskal-Wallis Test. Categorical variables expressed as percentage and compared using Chi-Square Test. Summary statistics calculated on non-missing data.
A total of 3340 patients were evaluated over the study period. We compared the unadjusted assessment completion rates across the intervention period (Table 7). The mean daily preoperative MoCA delivery and completion rates improved from 30% (30.7% for CFS) during the r-POD implementation phase to 46.6% (49.2% for CFS) in the post implementation phase. However, postoperative delirium assessment rates (considering data of the fully- or partially-completed delirium assessment tool) were similar to rates during and after the post implementation phase.
The quality improvement metrics (outcome-data) before, during and after the implementation of the rPOD intervention are reported in Table 8. The primary outcome measure for the rates of postoperative delirium screening (data only from completed CAM assessments were included) increased during the implementation of the rPOD care bundle and following its implementation. Figure 2 demonstrates the trends of gross expenditure (GL dollars) (Panel A), average patient day constant care or close observation hours and expenditure (Panel B and Panel C), and average in-patient-days (Panel D).
4. Discussion
In this study, the QI team used an established QI model to implement the rPOD intervention across the various departments. This model employed a previously successful 4E’s algorithm (engage, educate, execute, and evaluate). Essential to this effort was the implementation of the rPOD care bundle, which included the preoperative baseline assessment, perioperative preventative strategies and postoperative rapid delirium assessment and care strategies, in successive stages to allow for incremental adoption of the intervention. Using this approach, the QI team demonstrated that multidisciplinary, perioperative and patient-focused interventions for the reduction of postoperative delirium were feasible to be performed on a daily basis, assisting the perioperative care process.
The sustainability of QI projects are challenging. Sustainability is supported by immediate, visible results, which can be difficult in delirium-related projects. Furthermore, identifying and measuring the implementation of new initiatives within health care is difficult without sustainability of these programs over time. Continued staff education delineating the consequences of delirium, frequent feedback to support intervention adoption and identifying patient perspectives could help with the adherence for such an intervention.
A limitation to this project was that more patients underwent CABG during the initial period of this study. Over time more complex surgeries including single and double valve replacement surgery were conducted. This change could have resulted in different levels of cardiac surgical stress and in turn, could have affected the rates of delirium as well as the level of care provided to the patients. Another limitation of this project was, as with other QI projects, uncertainty regarding the generalizability of these results. This project was implemented in a setting led by academic and clinical experts and team members with training and experience in QI projects. However, many of the implementation challenges surmounted in this project, such as continued use of the intervention as part of routine care, are universal to all cardiac surgery units. Furthermore, the established QI model used and the commonsense appeal of these evidence-based rPOD interventions may facilitate its utilization and buy-in for other settings.
5. Conclusions
Using an established QI model to implement a multifaceted rPOD intervention to improve delirium care strategies is feasible. The future direction includes the development of strategies to address sustainability and the extension of similar efforts to other cardiac and non-cardiac surgical programs.
Acknowledgments
Healthcare providers from the Cardiac Science Program at the St Boniface Hospital.
Abbreviations
POD | Postoperative Delirium |
rPOD | Reduction of Postoperative Delirium |
CPAC | Cardiac Pre-Admission Clinic |
CSIU | Cardiac Surgery Inpatient Unit |
ICCS | Intensive Care Cardiac Surgery |
Supplementary Materials
The following are available online at https://www.mdpi.com/article/10.3390/geriatrics6040111/s1, Figure S1: Delirium score card; Table S1: Delirium Quality improvement.
Author Contributions
Conceptualization: R.C.A. and H.G.; Methodology: R.M.S., R.C.A. and S.W.; Data Management: R.M.S. and B.H.; Statistical Analysis: B.H. and R.M.S.; Writing—Original Draft Preparation: R.M.S.; Writing—Review & Editing: R.M.S., B.H., D.K., S.W., H.G. and R.C.A.; Supervision and Project Administration: D.K. and S.W.; Funding Acquisition: R.C.A. and H.G. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Ethics Approval was received from the University of Manitoba Human Research Ethics Board. HS22352 (H2018:449).
Informed Consent Statement
This study was retrospective in nature and used de-identified data. Therefore, research participant consent was not applicable.
Data Availability Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Salluh J.I., Soares M., Teles J.M., Ceraso D., Raimondi N., Nava V.S., Blasquez P., Ugarte S., Ibanez-Guzman C., Centeno J.V., et al. Delirium epidemiology in critical care (DECCA): An international study. Crit. Care. 2010;14:R210. doi: 10.1186/cc9333. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Whitlock E.L., Vannucci A., Avidan M.S. Postoperative delirium. Minerva Anestesiol. 2011;77:448–456. [PMC free article] [PubMed] [Google Scholar]
- 3.Rudolph J.L., Inouye S.K., Jones R., Yang F.M., Fong T.G., Levkoff S.E., Marcantonio E.R. Marcantonio ER. Delirium: An Independent Predictor of Functional Decline After Cardiac Surgery. J. Am. Geriatr. Soc. 2010;58:643–649. doi: 10.1111/j.1532-5415.2010.02762.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Brown C.H. Delirium in the Cardiac Surgical Intensive Care Unit. Curr. Opin. Anaesthesiol. 2014;27:117–122. doi: 10.1097/ACO.0000000000000061. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Marcantonio E.R., Goldman L., Mangione C.M., Ludwig L.E., Muraca B., Haslauer C.M., Donaldson M.C., Whittemore A.D., Sugarbaker D.J., Poss R., et al. A clinical prediction rule for delirium after elective noncardiac surgery. JAMA. 1994;271:134–139. doi: 10.1001/jama.1994.03510260066030. [DOI] [PubMed] [Google Scholar]
- 6.Rudolph J.L., Jones R., Rasmussen L.S., Silverstein J.H., Inouye S.K., Marcantonio E.R. Independent vascular and cognitive risk factors for postoperative delirium. Am. J. Med. 2007;120:807–813. doi: 10.1016/j.amjmed.2007.02.026. [DOI] [PubMed] [Google Scholar]
- 7.Marcantonio E.R., Flacker J.M., Michaels M., Resnick N.M. Delirium is independently associated with poor functional recovery after hip fracture. J. Am. Geriatr. Soc. 2000;48:618–624. doi: 10.1111/j.1532-5415.2000.tb04718.x. [DOI] [PubMed] [Google Scholar]
- 8.Franco K., Litaker D., Locala J., Bronson D. The cost of delirium in the surgical patient. Psychosomatics. 2001;42:68–73. doi: 10.1176/appi.psy.42.1.68. [DOI] [PubMed] [Google Scholar]
- 9.Arora R.C., Djaiani G., Rudolph J.L. Detection, Prevention, and Management of Delirium in the Critically Ill Cardiac Patient and Patients Who Undergo Cardiac Procedures. Can. J. Cardiol. 2017;33:80–87. doi: 10.1016/j.cjca.2016.08.020. [DOI] [PubMed] [Google Scholar]
- 10.Boustani M., Baker M.S., Campbell N., Munger S., Hui S.L., Castelluccio P., Farber M., Guzman O., Ademuyiwa A., Miller D., et al. Impact and recognition of cognitive impairment among hospitalized elders. J. Hosp. Med. Off. Publ. Soc. Hosp. Med. 2010;5:69–75. doi: 10.1002/jhm.589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Pronovost P.J., Berenholtz S.M., Needham D.M. Translating Evidence into Practice: A Model for Large Scale Knowledge Translation. BMJ. 2012;337:963–965. doi: 10.1136/bmj.a1714. [DOI] [PubMed] [Google Scholar]
- 12.Ely E.W., Margolin R., Francis J., May L., Truman B., Dittus R., Speroff T., Gautam S., Bernard G.R., Inouye S.K. Evaluation of delirium in critically ill patients: Validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) Crit. Care Med. 2001;29:1370–1379. doi: 10.1097/00003246-200107000-00012. [DOI] [PubMed] [Google Scholar]
- 13.Gélinas C., Fillion L., Puntillo K.A., Viens C., Fortier M. Validation of the critical-care pain observation tool in adult patients. Am. J. Crit. Care. 2006;15:420–427. doi: 10.4037/ajcc2006.15.4.420. [DOI] [PubMed] [Google Scholar]
- 14.Ely E.W., Truman B., Shintani A., Thomason J.W.W., Wheeler A.P., Gordon S., Francis J., Speroff T., Gautam S., Margolin R., et al. Monitoring sedation status over time in ICU patients: Reliability and validity of the Richmond Agitation-Sedation Scale (RASS) JAMA. 2003;289:2983–2991. doi: 10.1001/jama.289.22.2983. [DOI] [PubMed] [Google Scholar]
- 15.Ely E.W., Inouye S.K., Bernard G.R., Gordon S., Francis J., May L., Truman B., Speroff T., Gautam S., Margolin R., et al. Delirium in mechanically ventilated patients: Validity and reliability of the confusion assessment method for the intensive care unit (CAM-ICU) JAMA. 2001;286:2703–2710. doi: 10.1001/jama.286.21.2703. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Not applicable.