Abstract
Importance
Critically ill patients often receive high-intensity life sustaining treatments (LST) in the intensive care unit (ICU), although they can be ineffective and eventually undesired. Determining the risk factors associated with reversals in LST goals can improve patient and provider appreciation for the natural history and epidemiology of critical care and inform decision making around the (continued) use of LSTs.
Methods
This is a single institution retrospective cohort study of patients receiving life sustaining treatment in an academic tertiary hospital from 2009 to 2013. Deidentified patient electronic medical record data was collected via the clinical data warehouse to study the outcomes of treatment limiting Comfort Care and do-not-resuscitate (DNR) orders. Extended multivariable Cox regression models were used to estimate the association of patient and clinical factors with subsequent treatment limiting orders.
Results
10,157 patients received life-sustaining treatment while initially Full Code (allowing all resuscitative measures). Of these, 770 (8.0%) transitioned to Comfort Care (with discontinuation of any life-sustaining treatments) while 1,669 (16%) patients received new DNR orders that reflect preferences to limit further life-sustaining treatment options. Patients who were older (Hazard Ratio(HR) 1.37 [95% CI 1.28–1.47] per decade), with cerebrovascular disease (HR 2.18 [95% CI 1.69–2.81]), treated by the Medical ICU (HR 1.92 [95% CI 1.49–2.49]) and Hematology-Oncology (HR 1.87 [95% CI 1.27–2.74]) services, receiving vasoactive infusions (HR 1.76 [95% CI 1.28, 2.43]) or continuous renal replacement (HR 1.83 [95% CI 1.34, 2.48]) were more likely to transition to Comfort Care. Any new DNR orders were more likely for patients who were older (HR 1.43 [95% CI 1.38–1.48] per decade), female (HR 1.30 [95% CI 1.17–1.44]), with cerebrovascular disease (HR 1.45 [95% CI 1.25–1.67]) or metastatic solid cancers (HR 1.92 [95% CI 1.48–2.49]), or treated by Medical ICU (HR 1.63 [95% CI 1.42–1.86]), Hematology-Oncology (HR 1.63 [95% CI 1.33–1.98]) and Cardiac Care Unit-Heart Failure (HR 1.41 [95% CI 1.15–1.72]).
Conclusion
Decisions to reverse or limit treatment goals occurs after more than 1 in 13 trials of LST, and is associated with older female patients, receiving non-ventilator forms of LST, cerebrovascular disease, and treatment by certain medical specialty services.
Introduction
Advances in medical technology have generated multiple sophisticated life sustaining treatment (LST) options. These capabilities have undoubtedly saved or at least prolonged many patient lives, but their development may not always be matched by the prudence to apply them.
Effective decisions for LSTs and cardiopulmonary resuscitation are challenging when underuse can represent a life-threatening patient safety hazard[1] while overuse can have its own severe adverse consequences. Inappropriate decisions to withhold life-sustaining treatments have severe consequences,[2,3] and there is risk of patients labeled with “do not resuscitate” orders being misinterpreted to receive generally less aggressive care that they may benefit from. For this study, we focus on the complementary scenario. When both health professionals and the public systematically overestimate the efficacy of LSTs,[4] critically ill patients may receive burdensome high intensity treatments that do not effectively improve their quality or quantity of life.[5–7] Patients receiving LSTs who subsequently reverse or limit their goals of care with physician orders for Comfort Care or DNR can improve our understanding of the challenging LST decision making process and the effects of their application.[8–13]
Prior studies demonstrate differences in DNR orders based on patient characteristics, family, providers, and institutions.[10,12–24] Specifically, advanced age, female gender, and White race are associated with greater limitations, like DNR orders,[10,13,19,23] while physician projection of future mortality and recovery, age, patient wishes, severity of illness, and number of comorbidities are associated with withdrawal of life support.[25] Such differences can occur despite established guidelines, in part due to medical providers’ poor understanding of advance care planning documents such as living wills or physician orders for life sustaining treatments (POLST).[26,27]
Prior surveys suggest that physicians of different specialties have varying recommendations for end-of-life decision making.[14,15,28] Determining the factors associated with reversals in LST goals can improve patient and provider appreciation for the natural history and epidemiology of critical care to inform decision making on (continued) use of LSTs. In this study, we focused specifically on patients where life-sustaining critical care interventions were initiated, then had a subsequent reversal or limitation during the same hospitalization. We also evaluated the relevance of various modalities of life support and the potential variation in different specialty treatment teams in the decision-making process. The study was exempted as non-human subjects research by the Stanford IRB.
Methodology
Study population
Deidentified patient data from Stanford University Hospital from 2009 to 2013 were collected via the STRIDE clinical data warehouse.[29] Patients were included if they received any life-sustaining critical care interventions as recorded in electronic medical records; mechanical ventilation, vasoactive infusions (dopamine, norepinephrine, epinephrine, dobutamine, vasopressin, phenylephrine), or continuous renal replacement therapy (CRRT). The structured data includes patient encounters from their initial life support order until hospital discharge. Patient demographics, comorbidities, laboratory results, vital signs, and primary medical team assignments were also included.
Study outcomes
In the Stanford Health Care system, a patient’s preferences regarding LST are interpreted and summarized in a code status order electronically signed by an attending physician. Code status options include: Full Code, Partial Code, DNR, and Comfort Care. The default Full Code status indicates no limits on resuscitative measures. Partial Code includes specific limitations that are generally less restrictive than a complete DNR order, such as no intubation, chest compressions, or defibrillation. DNR indicates to allow natural death without resuscitative measures in the event of cardiopulmonary arrest (pulseless and apneic). Comfort Care is essentially the extreme end of DNR orders, indicating symptom-oriented treatments only, removing interventions only intended to prolong life. This typically occurs when death is imminently expected as any current life-sustaining therapies that are inconsistent with an active Comfort Care order are discontinued.
To study reversals in LST, we identified patients who were Full Code as of life support initiation and followed them from this point until hospital discharge, death, or change to Partial Code, DNR or Comfort Care. The primary study outcome was change to Comfort Care status. As a secondary (but more prevalent) outcome, we assessed for change to “Any DNR” code status (Partial Code, DNR, or Comfort Care) that may not reflect a complete reversal, but a limitation on subsequent LST.
Covariates
We assessed patient and clinical factors for association with limiting LST. Patient factors included race/ethnicity, age, gender, insurance status (Self-pay or not), and socioeconomic status. Socioeconomic status was approximated by median household income of their home ZIP code from 2013 census data.[30] Patients’ Charlson comorbidities were determined based on International Classification of Diseases 9th edition (ICD-9) diagnosis codes in patient problem lists and admission diagnosis.[31] We used binary indicators for each of the 16 comorbidities. To adjust for acute severity of illness that could dynamically effect decision making, we included daily laboratory results and vital signs based on components of the APACHE[32] and SAPS[33] scores. These included temperature, systolic blood pressure, pulse, respiratory rate, partial pressure of oxygen (pO2(a)), arterial pH (pHa), sodium, potassium, creatinine, blood urea nitrogen (BUN), total bilirubin, bicarbonate, hematocrit, white blood cells and Glasgow coma scale score (GCS). The life sustaining treatment modalities used (i.e., mechanical ventilation, vasoactive infusion, or CRRT) were also noted. Lastly, we included binary indicators for having been treated by different primary medical teams (e.g., cardiology, medicine, neurology, hematology-oncology, critical care, surgery, transplant, or trauma). Each patient can have accumulated multiple treatment teams over the course of their stay.
Statistical analysis
We described the study population with contingency tables. We evaluated the association of baseline (patient demographics and comorbidities) and time-varying (primary medical team, life sustaining treatment, vital signs and lab test results) characteristics on change to Any DNR and change to Comfort Care status using extended multivariable Cox proportional hazards regression models. Vital sign and lab results had missing values due to being intermittently assessed (i.e. are not necessarily required every day) or not being required if a patient is healthy or on life sustaining treatment (e.g. CRRT induces normative potassium levels). As such, the data is likely to be missing not at random. To deal with this we used a combined single imputation approach as follows: for each vital sign or lab test from the first available value, last observation carried forward (LOCF) was used to fill in missing values. For observations missing prior to the first available value were filled in using the normative healthy range for each vital sign or test based on ranges used in the APACHE and SAPS scores as follows: Temperature 98.6F, Systolic Blood Pressure 110mm Hg, Pulse 80bpm, Respiratory rate 16breaths/min, pO2(a) 95mmHg, pHa 7.4, Sodium 145mEq/L, Potassium 4.5mEq/L, Creatinine 0.8mg/dl, Hematocrit 42%, White blood cells 8 × 109/L, Glasgow Coma Scale score 15, Blood urea nitrogen 15mg/dl, Total bilirubin 1mg/dl, Bicarbonate 24mEq/L. To assess the sensitivity of results to different healthy normative values for initial vital sign and lab test measures, we estimated three additional Cox models for each study outcome as follows: without adjustment for vital sign and lab test measures at all (essentially ignoring acute severity of illness); using minimum healthy range values, and using maximum healthy range values. Notably, vital sign and lab test values may be highly correlated with receiving life support (e.g., blood pressure with vasoactive infusions or respiratory rate with ventilation). Thus, three further Cox models were fit to assess the sensitivity of the associations for life support covariates (CRRT, vasoactive infusion, ventilation) to vital sign and lab test imputation. For each study outcome, three models (using LOCF and normative healthy values) assessed each life support covariate in turn while excluding those vital signs or lab test results that are expected to be normative due to the life support mechanism itself. These models were as follows: for CRRT sodium, potassium, creatinine, blood urea nitrogen, and bicarbonate were excluded; for vasoactive infusion pulse and systolic blood pressure were excluded; and for ventilation respiratory rate, pO2(a), and PHA were excluded.
For each model we applied a Bonferroni correction when assessing that significance of covariates. As each model contained 50 covariates and assuming a desired family-wise alpha of 0.05, the threshold for significance is 0.05/51 = 0.001. Data management was done with Python 2.7 and SAS 9.3, while analyses were conducted with R version 3.3.2
Results
Baseline characteristics
During the study period, 10,590 subjects received LSTs. Of these, 433 already had Any DNR order at the initiation of LST, likely receiving them for critical care support before overt cardiopulmonary arrest (e.g., vasopressors for hypotension or mechanical ventilation for hypoxia). This leaves 10,157 patients in the study cohort who were Full Code at the entry point of initiating LST, with baseline characteristics summarized in Table 1. After initiation of LST, 1,669 (16%) subsequently had Any DNR order, 770 (8%) had Comfort Care orders, and 1,423 (14%) died, as summarized in Table a in S1 File and Fig 1.
Table 1. Summary of patient and clinical characteristics (N = 10,157).
Baseline Characteristic | Median [IQR] or Number (Percent) |
---|---|
Age (years) | 62.2 [49.9–73.6] |
Length of Stay (days) | 8.0 [5.0–15.0] |
Household Income Estimate | $70001 [52001–95001] |
Insured | 10035 (99%) |
Female | 4,257 (42%) |
Race/Ethnicity | |
Non-Hispanic White | 5,664 (56%) |
Hispanic/Latino | 1,512 (15%) |
Native American | 35 (0.34%) |
African-American | 492 (5%) |
Pacific Islander | 149 (1%) |
Asian | 1269 (12%) |
Other | 592 (6%) |
Unknown | 444 (4%) |
Charlson Comorbidities | |
Cerebrovascular Disease | 725 (7%) |
Congestive Heart Failure | 768 (8%) |
COPD | 472 (5%) |
Dementia | 8 (0.1%) |
Diabetes without Chronic Complications | 590 (6%) |
Diabetes with Chronic Complications | 97 (1%) |
Hemiplegia or Paraplegia | 45 (0.4%) |
Malignancy | 1518 (15%) |
Metastatic Solid Tumor | 205 (2%) |
Myocardial Infarction | 27 (0.3%) |
Mild Liver Disease | 414 (4%) |
Moderate or Severe Liver Disease | 230 (2%) |
Peptic Ulcer | 37 (0.4%) |
Peripheral Vascular Disease | 682 (7%) |
Renal Disease | 520 (5%) |
Rheumatologic Disease | 98 (1%) |
Medical Teams | |
Cardiology | 913 (9%) |
Cardiac Care Unit (CCU) | 751 (7%) |
Cardiac Care Unit-Heart Failure (CCU(HF)) | 370 (4%) |
Cardiovascular ICU (CVICU) | 280 (3%) |
Hematology-Oncology | 410 (4%) |
Medicine | 1179 (12%) |
Medical ICU | 718 (7%) |
Neurology | 117 (1%) |
Surgical ICU | 506 (5%) |
Surgery Specialty | 1078 (11%) |
Transplant | 530 (5%) |
Trauma | 234 (2%) |
Life-Sustaining Treatment Usage at initial baseline* | |
CRRT | 288 (3%) |
Vasoactive | 6,727 (66%) |
Ventilator | 7,414 (73%) |
Life–Sustaining Treatment usage at any time of stay* | |
CRRT | 691 (7%) |
Vasoactive | 7,442 (73%) |
Ventilator | 7,932 (78%) |
Comfort Care | 770 (8%) |
Any DNR | 1,669 (16%) |
Died during study period | 1,423 (14%) |
Died with Comfort Care orders | 714 (50%) |
Died with Any DNR | 1,161 (82%) |
*Not Mutually exclusive categories
Patient demographics
Comfort Care orders were more likely in older patients (HR 1.37 [95% CI 1.28–1.47] per decade). Any DNR orders were more likely with older patients (HR 1.43 [95% CI 1.38–1.48] per decade) and female patients (HR 1.3 [95% CI 1.17–1.44]).
No significant racial disparities were detected for Any DNR orders in multivariable analysis relative to the most prevalent reference group (Non-Hispanic White).
Comorbidity categories
Comfort Care orders were more likely in patients suffering from Cerebrovascular Disease (HR 2.18 [95% CI 1.69–2.81]) or those who have had a Myocardial Infarction (MI), (HR 4.43 [95% CI 1.85–10.62]) while Any DNR orders were more likely for those with Cerebrovascular Disease (HR 1.45 [95% CI 1.25–1.67]), Metastatic Malignancy (HR 1.92 [95% CI 1.48–2.49]), or other Malignancy (HR 1.33 [95% CI 1.15–1.54]).
Life-sustaining treatment modality
Comfort Care orders were more likely for patients receiving vasoactive infusions (HR 1.76 [95% CI 1.28–2.43]) and continuous renal replacement therapy (HR 1.83 [95% CI 1.34–2.48]). Any DNR was similarly more likely for patients receiving vasoactive infusions (HR 1.55 [95% CI 1.31–1.84]) and continuous renal replacement therapy (HR 1.43 [95% CI 1.2–1.7]). Mechanical ventilation was not significantly associated with either Any DNR or Comfort Care orders.
Treatment team specialty
Patients treated by the Medical ICU (HR 1.92 [95% CI 1.49–2.49]) and Hematology-Oncology (HR 1.87 [95% CI 1.27–2.74]) appeared were more likely to transition to Comfort Care, though the Hematology-Oncology association did not meet our stricter threshold for significance.
Patients treated by the Medical (HR 1.63 [95% CI 1.42–1.86]), Hematology-Oncology service (HR 1.63 [95% CI 1.33–1.98]), and Cardiac Care Unit-Heart Failure service (HR 1.41 [95% CI 1.15–1.72]) were more likely to change to Any DNR, while those treated by the Cardiovascular ICU (HR 0.32 [95% CI 0.25–0.41]), and Surgical services (HR 0.74 [95% CI 0.63–0.87]) were less likely.
Primary results are summarized in Figs 2 and 3. Supplementary Materials includes results for multiple additional variations of the Cox model for sensitivity analysis with respect to different data imputation strategies and inclusion vs. exclusion of different vital signs and lab result indicators of severity of illness.
Discussion
Most inpatients entering life-sustaining critical care interventions were Full Code, which may reflect purposeful choices or limited prior advance care planning discussions (e.g., “default” selection that was not pointedly discussed with patients). Only 4.1% of patients had Any DNR order at initiation of LST. Among the Full Code patients, 8.0% subsequently had Comfort Care orders and 16% subsequently had Any DNR order. Of the 1,423 patients who died in the hospital, 714 (50%) died with Comfort Care orders and 1,161 (82%) died with DNR orders.
Prior literature suggests racial and cultural disparities in decision making,[10,19,21,23] though we found no significant differences for Hispanic, African American, Pacific Islander, or Native American patients changing to Comfort Care or Any DNR after controlling for other patient and clinical factors. The lack of significant disparities among racial minority groups suggests that differences are due to alternative characteristics, such as comorbidity, severity of illness, treatment modality, and team specialty. Similar to prior studies,[10,13,19,23] we found that advancing age and female gender are associated with decisions to limit life sustaining treatments, even after adjusting for other factors. Ongoing research and discussion are warranted to properly interpret and apply decision making in these cases to ensure both patient safety and informed consent.
We found that the modality of life-sustaining critical care interventions had varying associations with Comfort Care or Any DNR orders. Patients on either continuous renal replacement therapy or vasoactive infusions were more likely to receive Any DNR order to limit further escalation of aggressive life support interventions. Mechanical ventilation was not significantly associated with changing code status. This may be because patients are less willing to transition, or they have a physical barrier (intubation and sedation) to expressing revised goals of care. In the latter case, decision making responsibility then goes to the patient’s surrogate (typically family), who may be more hesitant to advocate reversals and limitations than the patient themselves if not previously addressed in documents like living wills. Alternative processes to best represent patient preferences rather than family member’s best guesses are thus an additional important area of development.[1]
Notably, we found that the treatment teams involved in patient care were associated with Comfort Care and Any DNR. Patients transferred to the Intensive Care Unit from Hematology and Oncology services were more likely to have Any DNR orders, while patients from Surgical, Cardiovascular and Cardiac Intensive Care Unit services were less likely. Decision variation is expected when different primary specialty teams reflect patients with different disease states (e.g. cancer), corresponding prognosis, and acceptable treatment goals (e.g. elective surgery). Yet, these variations are observed even after adjusting for patient comorbidities, admission diagnosis, and severity of illness indicators, which raises questions about differing practice patterns within various medical subspecialists. Clinicians and patients have different perspectives or abilities to recognize conditions amenable to intervention. For example, we may recognize metastatic cancer as an intractable terminable disease while believing there are always more interventions to salvage patients with cardiac and surgical problems. At the same time, evidence suggests that in some (surgical) settings, prematurely labeling patients “DNR” may result in worse outcomes perhaps from unintended “failure to rescue.”[34,35] This study alone cannot judge whether any of the observed practices are “appropriate” or not, but does illustrate that differences exist.
Supplementary Materials review the results of multiple sensitivity analyses with respect to different data imputation strategies and inclusion vs. exclusion of different vital signs and lab result indicators of severity of illness. The overall pattern of significant findings remained stable across different model variations, except for use of mechanical ventilation. In models excluding vital signs and laboratory results, mechanical ventilation is positively associated with subsequent DNR orders. This likely just reflects mechanical ventilation as a proxy for severity of illness as our primary model that included markers for acute illness did not show a significant association.
Limitations of this study include that data was collected from a single institution, which can restrict generalizability. Prior studies demonstrated that do not resuscitate physician orders vary according by region and are less prevalent in teaching hospitals than community hospitals.[23] The patient community surrounding the study institution generally represents a wealthier, more educated, and ethnically diverse population.[36,37] Our results identify patient and clinical factors associated with Comfort Care and Any DNR orders, but do not necessarily represent causal relationships. Similarly, given this retrospective study of structured electronic medical record data, additional contextual information such as living wills,[38] physician orders for life sustaining treatment,[39] and documentation of physician-family meetings were unavailable to provide qualitative rationale for the decisions in individual cases. Our study assumes that DNR orders electronically signed by attending physicians are “correct,” but does not account for the possibility of physicians misinterpreting patient preferences for life-sustaining interventions.[1]
While Comfort Care orders are a relatively explicit proxy for reversing LST decisions, Any DNR order after LST initiation may still be consistent with initial LST treatment goals (e.g., starting on vasopressors for low blood pressure, but later activating a DNR order to decline mechanical ventilation while still accepting ongoing vasopressors). Even in the case of subsequent Comfort Care orders, it is worth reflecting that while this may ultimately be a “reversal” of goals of care for ineffective LST, this does NOT entail that the decision to initiate LST was a “mistake.” As with all medical treatments, many trials of therapy do not ultimately produce a benefit. The initial decision to offer the therapy should be judged based only on information available at that moment, which is perfectly valid when we credibly expect a potential benefit that outweighs risks and harms.
What the results of this study can do is inform discussions around critical care decisions, similar to other prognostic risk scoring systems. Estimating patient risks for changing preferences can shift the balance of risks, benefits, and harms that are acceptable to patients when proceeding with trials of potentially burdensome, but life sustaining, treatments. Clinicians and health systems should take interest in identifying areas of care variation and in the characteristics, that may reflect critically ill patients who are more receptive to goals of care discussions, to help us deploy supportive and palliative interventions as early as possible in appropriate cases.
In summary, we found that Comfort Care and Any DNR orders subsequently occur for more than 1 in 13 patients who received life sustaining therapy, and are more common among older women. Patients on different forms of LST (e.g., continuous renal replacement and vasopressors) were more likely to reverse treatment compared to those on ventilator support. Different medical treatment team subspecialties are associated with varying resuscitation status. Awareness of these predictive factors can help inform complex decision-making processes to mitigate the risks of both underuse and overuse of critical care interventions.
Supporting information
Acknowledgments
Gustavo A. Chavez was supported by Stanford University School of Medicine Center of Excellence and Stanford University School of Medicine Medical Scholars Research Program. Jonathan H. Chen was supported by NIH Big Data 2 Knowledge Award Number K01ES026837 through the National Institutes of Health and National Institute of Environmental Health Sciences. Ilana Richman was supported by the US Department of Veterans Affairs Office of Academic Affiliations and Health Services Research and Development Service Research Funds. Dr. Periyakoil's time is supported in part by grants R25 MD006857, 5U54MD010724 and the Department of Veterans Affairs. The sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript, and decision to submit the manuscript for publication.
Data Availability
Deidentified data underlying analyses available for download from link below: https://simtk.org/frs/download_confirm.php/latestzip/1969/ICUDNR-latest.zip?group_id=892.
Funding Statement
Gustavo A. Chavez was supported by Stanford University School of Medicine Center of Excellence and Stanford University School of Medicine Medical Scholars Research Program. Jonathan H. Chen was supported by NIH Big Data 2 Knowledge Award Number K01ES026837 through the National Institutes of Health and National Institute of Environmental Health Sciences. Ilana Richman was supported by the US Department of Veterans Affairs Office of Academic Affiliations and Health Services Research and Development Service Research Funds. Vyjeyanthi S. Periyakoil’s time is supported in part by grants R25 MD006857, 5U54MD010724 and the Department of Veterans Affairs. Patient data extracted and de-identified by Gomathi Krishnan and Lee Ann Yasukawa of the STRIDE (Stanford Translational Research Integrated Database Environment) project, a research and development project at Stanford University to create a standards-based informatics platform supporting clinical and translational research. The STRIDE project described was supported by the National Center for Research Resources and the National Center for Advancing Translational Sciences, National Institutes of Health, through grant UL1 RR025744. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Mirarchi FL, Cooney TE, Venkat A, Wang D, Pope TM, Fant AL, et al. TRIAD VIII: Nationwide Multicenter Evaluation to Determine Whether Patient Video Testimonials Can Safely Help Ensure Appropriate Critical Versus End-of-Life Care. J Patient Saf. 2017;0: 1–11. doi: 10.1097/PTS.0000000000000357 [DOI] [PubMed] [Google Scholar]
- 2.Rajan S, Folke F, Kragholm K, Hansen CM, Granger CB, Hansen SM, et al. Prolonged cardiopulmonary resuscitation and outcomes after out-of-hospital cardiac arrest. Resuscitation. 2016;105: 45–51. doi: 10.1016/j.resuscitation.2016.05.004 [DOI] [PubMed] [Google Scholar]
- 3.Elmer J, Torres C, Aufderheide TP, Austin MA, Callaway CW, Golan E, et al. Association of early withdrawal of life-sustaining therapy for perceived neurological prognosis with mortality after cardiac arrest. Resuscitation. European Resuscitation Council, American Heart Association, Inc., and International Liaison Committee on Resuscitation.~Published by Elsevier Ireland Ltd; 2016;102: 127–135. doi: 10.1016/j.resuscitation.2016.01.016 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Roberts D, Hirschman D, Scheltema K. Adult and pediatric CPR: attitudes and expectations of health professionals and laypersons. Am J Emerg Med. 2000;18: 465–8. doi: 10.1053/ajem.2000.7338 [DOI] [PubMed] [Google Scholar]
- 5.Diem SJ, Lantos JD, Tulsky JA. Cardiopulmonary Resuscitation on Television? Miracles and Misinformation. N Engl J Med. 1996;334: 1578–1582. doi: 10.1056/NEJM199606133342406 [DOI] [PubMed] [Google Scholar]
- 6.Van den Bulck JJM. The impact of television fiction on public expectations of survival following inhospital cardiopulmonary resuscitation by medical professionals. Eur J Emerg Med. 2002;9: 325–9. doi: 10.1097/01.emj.0000043720.82722.66 [DOI] [PubMed] [Google Scholar]
- 7.Kostoulakos NM, Bradley DR. Overestimation of the effectiveness of cardiopulmonary resuscitation. Percept Mot Skills. 1997;84: 1409–10. doi: 10.2466/pms.1997.84.3c.1409 [DOI] [PubMed] [Google Scholar]
- 8.Dying in America: Improving Quality and Honoring Individual Preferences Near the End of Life [Internet]. Dying in America: Improving Quality and Honoring Individual Preferences Near the End of Life. 2015. Available: http://www.ncbi.nlm.nih.gov/pubmed/25927121
- 9.Approaching Death: Improving Care at the End of Life [Internet]. Approaching Death: Improving Care at the End of Life. 1997. Available: http://www.ncbi.nlm.nih.gov/pubmed/25121204
- 10.Goodlin SJ, Zhong Z, Lynn J, Teno JM, Fago JP, Desbiens N, et al. Factors associated with use of cardiopulmonary resuscitation in seriously ill hospitalized adults. JAMA. 282: 2333–9. Available: http://www.ncbi.nlm.nih.gov/pubmed/10612321 [DOI] [PubMed] [Google Scholar]
- 11.Downar J, Luk T, Sibbald RW, Santini T, Mikhael J, Berman H, et al. Why do patients agree to a “Do not resuscitate” or “Full code” order? Perspectives of medical inpatients. J Gen Intern Med. 2011;26: 582–7. doi: 10.1007/s11606-010-1616-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Boyd K, Teres D, Rapoport J, Lemeshow S. The relationship between age and the use of DNR orders in critical care patients. Evidence for age discrimination. Arch Intern Med. 1996;156: 1821–6. Available: http://www.ncbi.nlm.nih.gov/pubmed/8790076 [PubMed] [Google Scholar]
- 13.Bailey FA, Allen RS, Williams BR, Goode PS, Granstaff S, Redden DT, et al. Do-not-resuscitate orders in the last days of life. J Palliat Med. 2012;15: 751–9. doi: 10.1089/jpm.2011.0321 [DOI] [PubMed] [Google Scholar]
- 14.Kelly WF, Eliasson AH, Stocker DJ, Hnatiuk OW. Do specialists differ on do-not-resuscitate decisions? Chest. The American College of Chest Physicians; 2002;121: 957–963. doi: 10.1378/chest.121.3.957 [DOI] [PubMed] [Google Scholar]
- 15.Einav S, Alon G, Kaufman N, Braunstein R, Carmel S, Varon J, et al. To resuscitate or not to resuscitate: a logistic regression analysis of physician-related variables influencing the decision. Emerg Med J. 2012;29: 709–714. doi: 10.1136/emermed-2011-200206 [DOI] [PubMed] [Google Scholar]
- 16.Frank C, Heyland DK, Chen B, Farquhar D, Myers K, Iwaasa K. Determining resuscitation preferences of elderly inpatients: a review of the literature. CMAJ. 2003;169: 795–9. Available: http://www.ncbi.nlm.nih.gov/pubmed/14557319 [PMC free article] [PubMed] [Google Scholar]
- 17.Garland A, Connors AF. Physicians’ influence over decisions to forego life support. J Palliat Med. 2007;10: 1298–305. doi: 10.1089/jpm.2007.0061 [DOI] [PubMed] [Google Scholar]
- 18.Boerner K, Carr D, Moorman S. Family relationships and advance care planning: do supportive and critical relations encourage or hinder planning? J Gerontol B Psychol Sci Soc Sci. 2013;68: 246–56. doi: 10.1093/geronb/gbs161 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Lovell A, Yates P. Advance Care Planning in palliative care: a systematic literature review of the contextual factors influencing its uptake 2008–2012. Palliat Med. 2014;28: 1026–35. doi: 10.1177/0269216314531313 [DOI] [PubMed] [Google Scholar]
- 20.Auriemma CL, Nguyen CA, Bronheim R, Kent S, Nadiger S, Pardo D, et al. Stability of end-of-life preferences: a systematic review of the evidence. JAMA Intern Med. 2014;174: 1085–92. doi: 10.1001/jamainternmed.2014.1183 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Barnato AE, Anthony DL, Skinner J, Gallagher PM, Fisher ES. Racial and ethnic differences in preferences for end-of-life treatment. J Gen Intern Med. 2009;24: 695–701. doi: 10.1007/s11606-009-0952-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Anderson WG, Chase R, Pantilat SZ, Tulsky JA, Auerbach AD. Code status discussions between attending hospitalist physicians and medical patients at hospital admission. J Gen Intern Med. 2011;26: 359–66. doi: 10.1007/s11606-010-1568-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Jayes RL, Zimmerman JE, Wagner DP, Knaus WA. Variations in the use of do-not-resuscitate orders in ICUs: Findings from a national study. Chest. The American College of Chest Physicians; 1996;110: 1332–1339. doi: 10.1378/chest.110.5.1332 [DOI] [PubMed] [Google Scholar]
- 24.Zingmond DS, Wenger NS. Regional and institutional variation in the initiation of early do-not-resuscitate orders. Arch Intern Med. 165: 1705–12. doi: 10.1001/archinte.165.15.1705 [DOI] [PubMed] [Google Scholar]
- 25.Cook D, Rocker G, Marshall J, Sjokvist P, Dodek P, Griffith L, et al. Withdrawal of mechanical ventilation in anticipation of death in the intensive care unit. N Engl J Med. 2003;349: 1123–1132. doi: 10.1056/NEJMoa030083 [DOI] [PubMed] [Google Scholar]
- 26.Mirarchi FL. Does a living will equal a DNR? Are living wills compromising patient safety? J Emerg Med. 2007;33: 299–305. doi: 10.1016/j.jemermed.2007.02.026 [DOI] [PubMed] [Google Scholar]
- 27.Moore KA, Rubin EB, Halpern SD. The Problems With Physician Orders for Life-Sustaining Treatment. JAMA. 2016;315: 259–60. doi: 10.1001/jama.2015.17362 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Periyakoil VS, Neri E, Fong A, Kraemer H. Do unto others: Doctors’ personal end-of-life resuscitation preferences and their attitudes toward advance directives. PLoS One. 2014;9 doi: 10.1371/journal.pone.0098246 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Lowe HJ, Ferris T a, Hernandez PM, Weber SC. STRIDE—An integrated standards-based translational research informatics platform. AMIA Annu Symp Proc. 2009;2009: 391–5. [PMC free article] [PubMed] [Google Scholar]
- 30.Bureau UC. 2009–2013 5-Year American Community Suruvey [Internet]. 2014 [cited 20 Jul 2009]. Available: http://factfinder.census.gov/faces/nav/jsf/pages/download_center.xhtml
- 31.Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi J-C, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43: 1130–1139. doi: 10.1097/01.mlr.0000182534.19832.83 [DOI] [PubMed] [Google Scholar]
- 32.Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13: 818–29. Available: http://www.ncbi.nlm.nih.gov/pubmed/3928249 [PubMed] [Google Scholar]
- 33.Le Gall J-R, Lemeshow S, Saulnier F. Simplified Acute Physiology Score (SAPS II) Based on a European / North American multicenter study. Jama. 1993;270: 2957–2963. doi: 10.1001/jama.270.24.2957 [DOI] [PubMed] [Google Scholar]
- 34.Siracuse JJ, Jones DW, Meltzer EC, Graham AR, Salzler GG, Connolly PH, et al. Impact of “Do Not Resuscitate” Status on the Outcome of Major Vascular Surgical Procedures. Ann Vasc Surg. 2015;29: 1339–45. doi: 10.1016/j.avsg.2015.05.014 [DOI] [PubMed] [Google Scholar]
- 35.Jawa RS, Shapiro MJ, McCormack JE, Huang EC, Rutigliano DN, Vosswinkel JA. Preadmission Do Not Resuscitate advanced directive is associated with adverse outcomes following acute traumatic injury. Am J Surg. 2015;210: 814–21. doi: 10.1016/j.amjsurg.2015.04.007 [DOI] [PubMed] [Google Scholar]
- 36.Metropolitan Transportation Commission GA of BA. Bay Area Census [Internet]. 2011. Available: http://www.bayareacensus.ca.gov/bayarea.htm
- 37.L. RC KB. Educational Attainment in the United States: 2015. In: US Census [Internet]. 2015 [cited 1 Sep 2017]. Available: http://www.census.gov/prod/2012pubs/p20-566.pdf.
- 38.Mirarchi FL, Costello E, Puller J, Cooney T, Kottkamp N. TRIAD III: nationwide assessment of living wills and do not resuscitate orders. J Emerg Med. Elsevier Ltd; 2012;42: 511–20. doi: 10.1016/j.jemermed.2011.07.015 [DOI] [PubMed] [Google Scholar]
- 39.Mirarchi FL, Doshi AA, Zerkle SW, Cooney TE. TRIAD VI: how well do emergency physicians understand Physicians Orders for Life Sustaining Treatment (POLST) forms? J Patient Saf. 2015;11: 1–8. doi: 10.1097/PTS.0000000000000165 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Deidentified data underlying analyses available for download from link below: https://simtk.org/frs/download_confirm.php/latestzip/1969/ICUDNR-latest.zip?group_id=892.