Abstract
Purpose
To assess the performance of neuroprognostic guidelines proposed by the American Academy of Neurology (AAN), European Resuscitation Council/European Society of Intensive Care Medicine (ERC/ESICM), and American Heart Association (AHA) in predicting outcomes of patients who remain unconscious after cardiac arrest.
Methods
We retrospectively identified a cohort of unconscious post-cardiac arrest patients at a single tertiary care centre from 2011 to 2017 and reviewed hospital records for clinical, radiographic, electrophysiologic, and biochemical findings. Outcomes at discharge and 6 months post-arrest were abstracted and dichotomized as good (Cerebral Performance Category (CPC) scores of 1–2) versus poor (CPC 3–5). Outcomes predicted by current guidelines were compared to actual outcomes, with false positive rate (FPR) used as a measure of predictive value.
Results
Of 226 patients, 36% survived to discharge, including 24 with good outcomes; 52% had withdrawal of life-sustaining therapies (WLST) during hospitalization. The AAN guideline yielded discharge and 6-month FPR of 8% and 15%, respectively. In contrast, the ERC/ESICM had a FPR of 0% at both discharge and 6 months. The AHA predictors had variable specificities, with diffuse hypoxic-ischaemic injury on MRI performing especially poorly (FPR 12%) at both discharge and 6 months.
Conclusions
Though each guideline had components that performed well, only the ERC/ESICM guideline yielded a 0% FPR. Amongst the AAN and AHA guidelines, false positives emerged more readily at 6 months, reflective of continuing recovery after discharge, even in a cohort inevitably biased by WLST. Further assessment of predictive modalities is needed to improve neuroprognostic accuracy
Keywords: cardiac arrest, neuroprognostication, self-fulfilling prophecy, hypoxic-ischaemic encephalopathy, post-cardiac arrest syndrome, outcomes assessment, heart arres
INTRODUCTION
Neurologic prognosis is frequently uncertain in individuals who are unconscious following cardiac arrest, as the degree of hypoxic-ischaemic brain injury may be difficult to assess early on. For those with return of spontaneous circulation (ROSC) after out-of-hospital cardiac arrest, between 50% and 90% fail to survive to hospital discharge1, 2. Regardless of the aetiology of arrest, the majority of comatose post-arrest patients die after withdrawal of life-sustaining therapies (WLST) due to a perceived poor neurologic prognosis3–5. During neuroprognostication, clinicians must balance two competing goals: 1) avoiding premature WLST in patients who may achieve a good neurologic outcome, and 2) avoiding prolonging care in patients destined for a poor outcome. Adopting a multimodal approach to neuroprognostication is recommended6–11, as no individual modality is infallible.
In the 2006 American Academy of Neurology (AAN) practice parameters for cardiac arrest survivors12, myoclonic status epilepticus (MSE) on post-arrest day 1, bilaterally absent N20 somatosensory evoked potentials (SSEP), elevated serum neuron specific enolase (NSE) levels, and absent pupillary or corneal reflexes with extensor or absent motor response on day 3 are regarded as poor outcome predictors. This algorithm, however, is derived from studies pre-dating the widespread use of targeted temperature management (TTM), which alters cellular metabolism13 and delays clearance of sedatives and paralytics14–16, thus also delaying clinical signs of recovery17–20.
In contrast, the 2014 European Resuscitation Council/European Society of Intensive Care Medicine (ERC/ESICM) guideline21 comprises recent data on TTM-treated patients, with acknowledgement of varying levels of prediction confidence, and reaffirm the complete abolishment of pupillary and corneal reflexes and N20 potentials as robust poor outcome predictors. The 2015 American Heart Association (AHA) guideline22 assesses current prognostic modalities separately, including their timing in relationship to TTM, and establishes the absence of pupillary reflexes at 72 hours in TTM-treated patients as the only poor prognostic parameter with Class I evidence.
In an era of variable management strategies and evolving neuroprognostic tools, it is imperative that prognostic strategies are accurate. Measurements of accuracy, however, are inherently confounded by the self-fulfilling prophecy from WLST, in which treating physicians are not blinded to the results of a prognostic assessment and consequently use them to inform care decisions. The purpose of this study is to ascertain the neuroprognostic performance of the AAN, ERC/ESICM, and AHA guidelines when applied to a real-world cohort of patients. We hypothesized that the guidelines overestimate their predictive value, such that actual false positive rates (FPR) at both hospital discharge and 6 months are higher than reported.
METHODS
Sample selection
The study was approved by the Yale University Human Investigation Committee (HIC# 2000021220), and the need for informed consent was waived. The cohort was retrospectively identified by querying the electronic medical record (EMR) for patients age 18 years or older with a cardiac arrest diagnosis code (ICD-9–427.5/ICD-10-I46.9) between January 2011 and June 2017. Additional inclusion criteria included successful resuscitation and unconsciousness for at least 24 hours after ROSC. Patients who died or had WLST within the first 24 hours were excluded (Figure 1).
Data collection
Data abstracted from the EMR included demographics, arrest location, non-perfusing rhythms, and details of TTM when applicable. Neuroprognostic variables included the clinical examination (pupillary light reflex, corneal reflex, motor response to pain, and post-anoxic myoclonus), EEG, SSEP, head CT, brain MRI, and serum NSE levels. Electrophysiologic and radiologic data were abstracted from final reports for these studies. MSE was discerned by either EEG report or EMR documentation by a neurologist. All results were retrospectively collected at the time points specified by each guideline, including with respect to time of rewarming after TTM when indicated, with the exception of the AHA recommendation of head CT within the first two hours after ROSC, which was extended to the first 24 hours to account for imprecise time of ROSC in a large subset of patients. As the AAN guideline does not distinguish between TTM-treated and non-TTM-treated patients, all AAN time points were based on time of ROSC.
Outcomes were assessed using the Cerebral Performance Category (CPC) scale. Scores were assigned retrospectively based on EMR documentation of cognitive and functional status, including documentation by rehabilitation specialists, at both discharge and 6 months. For 17 patients for whom no 6-month follow-up was documented, the discharge outcome score was carried forward. CPC scores were dichotomized as “good” outcome (CPC 1–2) versus “poor” outcome (CPC 3–5). All CPC scores in survivors were adjudicated by a board-certified neurointensivist (CBM) blinded to details of the case.
Statistical analysis
Statistical analyses were performed using GraphPad Prism version 7.0a for Mac OS X (GraphPad Software, La Jolla California USA, www.graphpad.com). Categorical variables are presented as counts and percentages, and continuous variables as mean and standard deviation (SD) or, for non-normally distributed data, median and interquartile range (IQR). Fisher’s exact test was used to determine statistical significance of contingency tables, with an alpha level of 0.05. For FPR, the 95% confidence interval (CI) was approximated via the Wilson-Brown method.
Data availability
Anonymized data will be shared with any qualified investigator upon request.
RESULTS
Demographic data
A total of 226 patients met the study criteria. The population was predominantly male (55%) and non-Hispanic white (58%), with an average age of 58 years (Table 1). Sixty-two percent suffered an out-of-hospital arrest. Non-perfusing rhythms included pulseless electrical activity (50%), asystole (23%), ventricular fibrillation or ventricular tachycardia (20%), and unknown rhythm (7%). Fifty-seven percent of patients underwent TTM, and 45 (30%) had a targeted temperature of 36°C.
Table 1.
Total N = 226 |
|
---|---|
Female, N (%) | 102 (45) |
Age, years, mean (SD) | 58 (17) |
Race/ethnicity, N (%) | |
Non-Hispanic white | 133 (59) |
Non-Hispanic black | 56 (25) |
Hispanic | 28 (12) |
Other/unknown | 9 (4) |
Arrest location, N (%) | |
Out of hospital | 139 (62) |
Emergency department | 19 (8) |
In hospital | 68 (30) |
Arrest rhythm, N (%) | |
VF/VT | 45 (20) |
Pulseless electrical activity | 112 (50) |
Asystole | 53 (23) |
Unknown | 16 (7) |
TTM, N (%) | 136 (60) |
Target temperature 32–34°C | 95 (70) |
Target temperature 36°C | 41 (30) |
Neuroprognostic study, N (%) | |
EEG | 197 (87) |
SSEP, days 1–5 | 43 (19) |
NSE, days 1–3 | 45 (20) |
Head CT, ≤24h | 180 (80) |
Brain MRI, days 2–6 | 96 (42) |
Survival to discharge, N (%) | 81 (36) |
CPC score 1 | 15 (7) |
CPC score 2 | 9 (4) |
CPC score 3 | 42 (19) |
CPC score 4 | 15 (7) |
Hospital progression to brain death, N (%) | 26 (12) |
Days to brain death, median (IQR) | 4 (2–6) |
Hospital progression to cardiac death, N (%) | 7 (3) |
Days to cardiac death, median (IQR) | 4 (2–29) |
WLST, N (%) | 118 (52) |
WLST day, median (IQR) | 6 (4–12) |
6-month outcome, N (%) | |
CPC score 1 | 21 (10) |
CPC score 2 | 12 (5) |
CPC score 3 | 29 (13) |
CPC score 4 | 7 (3) |
CPC score 5 | 157 (69) |
Abbreviations: VF/VT = ventricular fibrillation/ventricular tachycardia; TTM = targeted temperature management; SSEP = somatosensory evoked potential; NSE = neuron specific enolase; CPC = Cerebral Performance Category; IQR = interquartile range; WLST = withdrawal of life-sustaining therapies
Outcomes at discharge and 6 months
WLST prior to hospital discharge occurred in 118 patients (52%) (Table 1). The median WLST time was post-arrest day 6 (IQR 4–12), although 25 (11%) had WLST on days 2–3. Twenty-six patients (12%) progressed to brain death during hospitalization (median day 4; IQR 2–6), and seven (3%) progressed to cardiac death (median day 4; IQR 2–29) due to recurrent cardiac arrest and/or progressive cardiovascular collapse. Eighty-one patients (36%) survived to discharge, including 24 (11%) with a good outcome.
Twelve patients died between discharge and 6 months, for a total of 157 patients (69%) with CPC 5 at 6 months. Twelve additional patients improved to a good outcome, for a total of 33 patients (41% of discharge survivors) with a good 6-month outcome. Four patients worsened after discharge from a CPC score of 1 to 3 (3 patients) or 2 to 3.
Rates of neuroprognostic assessments
Continuous EEG was obtained in 87% of patients (Table 1). Eighty percent of patients had a head CT within 24 hours of arrest, and 53% had a brain MRI during hospitalization. Seven percent underwent SSEP between days 1–3, and another 13% on days 4–5. Twenty percent had serum NSE measured between days 1–3 (Figure 2).
Predictive value of the AAN guideline
Based on the AAN guideline, 113 patients (50%) were predicted to have a poor neurologic outcome (Table 2). Of these, 94 (83%) did not survive to discharge, including 75 (66%) with WLST. Of the 19 survivors, two had a good discharge outcome, for an overall FPR of 8% (95% CI, 1–26%). One had been predicted to do poorly due to absent motor response and corneal reflexes on post-arrest day 3, while the other had an NSE level greater than 150.0 mcg/L on day 2; both were treated with TTM.
Table 2.
TP, N | FP, N | TN, N | FN, N | p | FPR, % (95% CI) | Sensitivity, % (95% CI) | |
---|---|---|---|---|---|---|---|
Discharge | 111 | 2 | 22 | 91 | <0.001 | 8 (1–26) | 55 (48–62) |
6 months | 108 | 5 | 28 | 85 | <0.001 | 15 (7–31) | 56 (49–63) |
Abbreviations: TP = true positive; FP = false positive; TN = true negative; FN = false negative; FPR = false positive rate
P values are calculated for contingency tables.
At 6 months, the FPR increased to 15% (95% CI, 7–31%), reflecting three patients who improved following discharge. Two had absent pupillary reflexes with absent motor response on day 3, while the other had elevated NSE levels on days 1 and 2 (37.3 and 45.2 mcg/L, respectively). All three patients were treated with TTM.
Predictive value of the ERC/ESICM guideline
On post-arrest days 3–5, for patients with an absent or extensor motor response to pain, the ERC/ESICM guideline recommends two robust predictors of “very likely” poor outcome: absent N20 SSEP and/or absence of both pupillary and corneal reflexes. Based on these criteria, the FPR was 0% at both discharge (95% CI, 0–14%) and 6 months (95% CI, 0–10%) (Table 3).
Table 3.
Discharge outcome | |||||||
---|---|---|---|---|---|---|---|
TP, N | FP, N | TN, N | FN, N | p | FPR, % (95% CI) | Sensitivity, % (95% CI) | |
“Very likely” poor outcome, day 3 | 33 | 0 | 24 | 150 | 0.02 | 0 (0–14) | 18 (13–24) |
“Very likely” poor outcome, day 4 | 32 | 0 | 24 | 133 | 0.02 | 0 (0–14) | 19 (14–26) |
“Very likely” poor outcome, day 5 | 26 | 0 | 24 | 119 | 0.03 | 0 (0–14) | 18 (13–25) |
“Likely” poor outcome | 48 | 0 | 24 | 135 | 0.0016 | 0 (0–14) | 26 (20–33) |
6 month outcome | |||||||
TP, N | FP, N | TN, N | FN, N | p | FPR, % (95% CI) | Sensitivity, % (95% CI) | |
“Very likely” poor outcome, day 3 | 33 | 0 | 33 | 141 | 0.003 | 0 (0–10) | 19 (14–25) |
“Very likely” poor outcome, day 4 | 32 | 0 | 33 | 124 | 0.002 | 0 (0–10) | 21(15–28) |
“Very likely” poor outcome, day 5 | 26 | 0 | 33 | 110 | 0.003 | 0 (0–10) | 19 (13–27) |
“Likely” poor outcome | 48 | 0 | 33 | 126 | <0.001 | 0 (0–10) | 28 (21–35) |
Abbreviations: TP = true positive; FP = false positive; TN = true negative; FN = false negative; FPR = false positive rate
P values are calculated for contingency tables.
Based on one or both of the following: 1) no pupillary and corneal reflexes, and/or 2) bilaterally absent N20 potentials on somatosensory evoked potentials (SSEP)
Defined as two or more of the following, with earliest prognostication beginning at 72 hours: 1) myoclonic status epilepticus ≤ 48 hours after return of spontaneous circulation (ROSC), 2) high neuron specific enolase levels at 48–72 hours after ROSC, 3) unreactive burst-suppression or status epilepticus on EEG, 4) diffuse hypoxic-ischaemic brain injury on brain CT (≤ 24 hours after ROSC) or MRI (days 2–5)
Of 207 survivors to day three, 33 (16%) were predicted to have a poor outcome based on the aforementioned criteria. All either died prior to discharge (94%), including 22 (69%) due to WLST, or were discharged with a CPC score of 4 (6%). Of 189 survivors to day four, 32 (17%) fulfilled above criteria for poor outcome; all had an in-hospital death, 23 (72%) due to WLST. On day five, 26 of 169 patients (15%) fulfilled criteria for poor outcome. Twenty-four (92%) died before discharge, either secondary to WLST (17 patients) or by progression to brain death (7 patients). Of the survivors, one was discharged with CPC 4 and the other with CPC 3; none improved at 6 months.
The ERC/ESICM guideline also predicts “likely” poor outcome with ≥2 of the following: 1) MSE within 48 hours of ROSC, 2) high NSE at 48–72 hours, 3) unreactive burst-suppression or status epilepticus, and 4) diffuse hypoxic-ischaemic injury on CT (within 24 hours) or MRI (days 2–5). As “high NSE” is not defined, the AAN threshold of 33 mcg/L was used, although the guideline acknowledges the varying sensitivity and specificity of different cut-offs according to the type of assay used and the sample timing. All 48 patients meeting multimodal criteria had a poor discharge outcome. Forty-three (90%) did not survive to discharge, with 36 having WLST, and no survivors showed improvement at 6 months, for a FPR of 0% (Table 3).
Predictive value of the AHA guideline
Absent pupillary reflexes on days 3–4 after ROSC yielded no false positives at discharge (Table 4). However, two patients with absent pupillary reflexes on day 3 achieved a good 6-month outcome, for a FPR of 6% (95% CI, 1–20%). These patients regained pupillary reflexes on days 4 and 5, respectively; neither underwent TTM nor had other AHA-specified poor prognostic parameters.
Table 4.
Discharge outcome | |||||||
---|---|---|---|---|---|---|---|
TP, N | FP, N | TN, N | FN, N | p | FPR, % (95% CI) | Sensitivity, % (95% CI) | |
Bilaterally absent pupillary light reflex, day 3 | 51 | 0 | 24 | 130 | <0.001 | 0 (0–14) | 28 (22–35) |
Bilaterally absent pupillary light reflex, day 4 | 43 | 0 | 24 | 121 | 0.002 | 0 (0–14) | 26 (20–33) |
Myoclonic status epilepticus at ≤72h | 60 | 0 | 24 | 142 | <0.001 | 0 (0–14) | 30 (24–36) |
Burst suppression | 24 | 0 | 16 | 157 | 0.23 | 0(0–19) | 13 (9–19) |
Unreactive EEG to stimuli | 92 | 0 | 9 | 48 | <0.001 | 0 (0–30) | 66 (58–73) |
Status epilepticus | 12 | 0 | 24 | 190 | 0.62 | 0 (0–14) | 6 (3–10) |
Absent N20s on days 1–3 | 10 | 0 | 0 | 5 | >0.99 | 0 (0–100) | 67 (42–85) |
NSE >33.0 mcg/L | 22 | 0 | 3 | 9 | 0.04 | 0 (0–56) | 71(53–84) |
NSE >78.9 mcg/L | 15 | 0 | 3 | 16 | 0.24 | 0 (0–56) | 48 (32–65) |
Reduced GWR on head CT at ≤24h | 22 | 0 | 19 | 139 | 0.13 | 0(0–17) | 14 (9–20) |
Diffuse hypoxic-ischemic injury on brain MRI, days 2–6 | 60 | 1 | 7 | 28 | 0.003 | 12 (1–47) | 68 (58–77) |
6 month outcome | |||||||
TP, N | FP, N | TN, N | FN, N | p | FPR, % (95% CI) | Sensitivity, % (95% CI) | |
Bilaterally absent pupillary light reflex, day 3 | 49 | 2 | 31 | 124 | 0.007 | 6 (1–20) | 28 (22–35) |
Bilaterally absent pupillary light reflex, day 4 | 42 | 1 | 32 | 114 | 0.002 | 3 (0–15) | 27 (21–34) |
Myoclonic status epilepticus at ≤72h | 59 | 1 | 32 | 134 | <0.001 | 3 (0–15) | 31(25–37) |
Burst suppression | 24 | 0 | 24 | 149 | 0.05 | 0 (0–14) | 14 (10–20) |
Unreactive EEG to stimuli | 92 | 0 | 17 | 40 | <0.001 | 0 (0–18) | 70 (61–77) |
Status epilepticus | 12 | 0 | 33 | 181 | 0.22 | 0 (0–10) | 6 (4–11) |
Absent N20s on days 1–3 | 10 | 0 | 0 | 5 | >0.99 | 0 (0–100) | 67 (42–85) |
NSE >33.0 mcg/L | 21 | 1 | 3 | 9 | 0.12 | 25 (1–70) | 70 (52–83) |
NSE >78.9 mcg/L | 15 | 0 | 4 | 15 | 0.11 | 0 (0–49) | 50 (33–67) |
Reduced GWR on head CT at ≤24h | 22 | 0 | 26 | 132 | 0.05 | 0 (0–13) | 14 (10–21) |
Diffuse hypoxic-ischemic injury on brain MRI, days 2–6 | 59 | 2 | 15 | 20 | <0.001 | 12 (2–34) | 75 (64–83) |
Abbreviations: TP = true positive; FP = false positive; TN = true negative; FN = false negative; FPR = false positive rate; NSE = neuron specific enolase; GWR = grey-white matter ratio
P values are calculated for contingency tables.
MSE within 72 hours, unreactive EEG, status epilepticus, and persistent burst-suppression all demonstrated 0% FPR at discharge. At 6 months, only MSE yielded a false positive, for a FPR of 3% (95% CI, 0–15%).
Neither absent N20 potentials on days 1–3 nor NSE above 33 mcg/L on days 2–3 yielded false positives at discharge, but the incidences of these findings were low and not statistically significant. At 6 months, elevated NSE generated one false positive for a FPR of 25% (95% CI, 1–70%). This patient, who had up-trending NSE levels on days 1 and 2 from 37.3 mcg/L to 45.2 mcg/L, improved from CPC 3 to 2. One study17 suggests an NSE threshold of 78.9 mcg/L after TTM, and when applied to this cohort, the results yielded no false positives.
Reduction in grey-white matter ratio and/or sulcal effacement on head CT performed well as a predictor of poor discharge outcome with a 0% FPR (95% CI, 0–17%; p=0.1349). Diffuse hypoxic-ischaemic injury on MRI between days 2–6 had a FPR of 12% both at discharge (95% CI, 1–47%; p=0.0033) and at 6 months (95% CI, 2–34%; p<0.0001).
DISCUSSION
Current neuroprognostication strategies after cardiac arrest are imprecise, stemming from studies marred by the bias of the self-fulfilling prophecy―unavoidable in this setting to date. While the AAN, ERC/ESICM, and AHA all propose discrete and nuancedly different guidelines for neuroprognostication, they place value in common tools used in a multimodal manner—namely, the clinical examination, neuroimaging, and electrophysiologic and biochemical findings. However, predictions of poor outcome may be inaccurate, with several false positives emerging from this study cohort. Given that WLST certainly occurred, the performance of the guidelines here may only represent the best-case scenario—if patients had been followed without WLST, the FPR may well have been higher. As recovery is ongoing during the initial days post-arrest, early neuroprognostication may precede clinical improvement and thus underestimate the likelihood of recovery.
The ERC/ESICM guideline provided the best specificity, which hinged upon applying its multimodal algorithm only to those with absent or extensor motor responses. Further, perhaps the application of this guideline in practice could have prevented survival with poor outcome in two individuals (CPC 3 and 4). In contrast, the AAN guideline performed poorly within this cohort, with FPR higher than those reported, particularly for elevated NSE levels and for unfavourable motor responses combined with absent pupillary or corneal reflexes. All false positives occurred in TTM-treated patients, supporting the assertion that TTM may delay recovery. When prognosticating based on post-rewarming findings rather than post-ROSC, no patients were predicted to have a poor outcome.
The high specificity of the ERC/ESICM guideline is accompanied by relatively low sensitivity. The sensitivity for a “very likely” poor outcome ranged from 18% to 21%, while the criteria for a “likely” poor outcome demonstrated 26% to 28% sensitivity (Table 3). This, as well as its applicability only to patients with an absent or extensor motor response, represents a limitation of the guideline. Remarkably, the guideline predicted an indeterminate outcome for over 40% of the cohort based solely on a motor score greater than 2, though 67 of these patients ultimately had a poor outcome. In comparison, the AAN guideline demonstrated 55–56% sensitivity (Table 1), but with unacceptably low specificity. While both guidelines aim primarily to maximize specificity, the overall low sensitivities signify a critical gap in the field.
According to the AHA recommendations, absent pupillary reflexes on days 3 and 4 strongly predict poor outcome, with reported FPR of 0% (95% CI, 0–8%) in non-TTM-treated patients and 1% (95% CI, 0–3%) in TTM-treated patients22. In this cohort, reported specificities were upheld at hospital discharge. However, at 6 months, FPR for days 3 and 4 increased to 6% and 3%, respectively, with non-negligible CI. MSE performed similarly at 6 months, and diffuse hypoxic-ischaemic injury on MRI provided even lower specificity. Sensitivities were markedly variable, with absent pupillary reflexes demonstrating less than 30% sensitivity for a poor outcome (Table 4). Though these parameters are evaluated independently in this study, the AHA cautions that many of its recommendations should be considered in combination; however, no methodology is provided22.
Absent pupillary reflexes are well-studied as a reliable predictor of poor outcome23–27, yet our cohort demonstrated several cases of absent reflexes in patients who achieved a good outcome. These must be interpreted cautiously, as no standardized technique such as pupillometry was used. Without objective pupillary scoring, interrater reliability is low, and reactivity may be undetected28–30.
Notably, within this cohort, poor outcome was driven primarily by CPC 5, which comprised 69% of the cohort at 6 months; however, our cohort did include a relatively high proportion of CPC 3–4. Amongst those with discharge CPC 5, 77% died in the setting of WLST (Table 1). It is still possible that the incidence of poor outcome is inflated by self-fulfilling prophecy, and consequently so too are the specificities of each prognosticator. FPR may be underestimated given the rate of WLST, particularly within the first 5 days (55 patients). Patients with WLST on day 1 were excluded from the study (47 patients; Figure 1), further biasing results toward underestimation of early WLST.
Thirteen patients (16% of survivors to discharge) improved from a poor discharge outcome to a good 6-month outcome. Other studies suggest that functional recovery after cardiac arrest occurs throughout the first year31, 32. In this cohort, false positives emerged more frequently at 6 months, reflecting significant post-discharge improvement. Further research on long-term outcomes at serial time points may better characterize the scope of neurologic recovery and would lend itself well to improving neuroprognostic accuracy.
Study limitations
Due to the nature of a single-centre retrospective study, the generalizability of these findings is limited. SSEP, EEG, MRI and NSE data were not available in all subjects. Further, burst-suppression, status epilepticus, and absent N20 potentials were rare within this cohort, rendering their utility difficult to evaluate. Data were collected retrospectively and thus were limited by the accuracy and comprehensiveness of documentation. Clinical examination technique was neither standardized nor assessed, which may have led to false positives. Neuroimaging and electrophysiologic findings were abstracted from the final reports for these tests. CPC scores, abstracted from EMR documentation, were inherently limited by availability.
Neuroprognostication practices and implementation of WLST may represent the bias of our centre. Certain tests, including NSE and SSEP, were not routinely collected prior to 2015 due to practice patterns or unavailability at this institution. Further, the study period captured evolving post-cardiac arrest care practices following the publication of the TTM trial in 201333, thus capturing target temperatures ranging from 32–36°C and evolving neuroprognostication practices with the introduction of protocols of care. Our institutional guidelines, introduced in 2013 and revised in 2015 (Figure S1), favoured a multimodal approach at no earlier than 72 hours. However, WLST decisions were at the discretion of the treating team, and this time window was not strictly followed in practice as demonstrated by our data.
CPC scoring, though utilized in each guideline, is not without limitations34–36. Mild to moderate cognitive deficits may not manifest as functional disability and can therefore be underestimated. Conversely, functional impairment is not necessarily secondary to arrest. Furthermore, cardiac arrest patients often have numerous comorbidities and may have diminished pre-arrest functional status, the extent of which is not quantified in the guidelines nor this study. Measuring CPC change from the pre-arrest state may be more useful for assessing neuroprognostic utility.
Each guideline cautions against the confounding effect of residual sedation. To the best extent possible, data were abstracted from the earliest time point consistent with guideline recommendations, at which time the effect of sedation was presumed to be negligible.
CONCLUSIONS
No gold standard currently exists for neuroprognostication of post-cardiac arrest survivors. Comparing the AAN, ERC/ESICM, and AHA guidelines, the ERC/ESICM guideline provides the best specificity for predicting poor outcome, though at the expense of significantly lower sensitivity. Future prospective initiatives should seek to better characterize the value of available neuroprognostic modalities, both independently and in a multimodal fashion, with respect to both discharge and long-term outcomes.
Supplementary Material
ACKNOWLEDGMENTS
Research in this publication was supported by the National Heart, Lung and Blood Institute of the National Institutes of Health under Award Number T35HL007649. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Heart, Lung, and Blood Institute or the National Institutes of Health.
Funding: Research reported in this publication was supported by the National Heart, Lung and Blood Institute of the National Institutes of Health (Award Number T35HL007649).
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Potential Conflicts of Interest:
Ms. Sonya E. Zhou reports no disclosures.
Dr. Carolina B. Maciel reports no disclosures.
Ms. Cora H. Ormseth reports no disclosures.
Dr. Rachel Beekman reports no disclosures.
Dr. Emily J. Gilmore reports no disclosures.
Dr. David M. Greer serves as Editor-in-Chief of Seminars in Neurology and has received compensation for medico-legal consultation.
CONFLICTS OF INTEREST
None
Authors’ Declarations
We wish to confirm that there are no known conflicts of interest associated with this publication, and there has been no significant financial support for this work that could have influenced its outcome.
REFERENCES
- 1.Fugate JE, Brinjikji W, Mandrekar JN, et al. Post-cardiac arrest mortality is declining: a study of the US National Inpatient Sample 2001 to 2009. Circulation. 2012;126:546–50. [DOI] [PubMed] [Google Scholar]
- 2.Benjamin EJ, Virani SS, Callaway CW, et al. Heart Disease and Stroke Statistics-2018 Update: A Report From the American Heart Association. Circulation. 2018. [DOI] [PubMed] [Google Scholar]
- 3.Laver S, Farrow C, Turner D, and Nolan J. Mode of death after admission to an intensive care unit following cardiac arrest. Intensive Care Med. 2004;30:2126–8. [DOI] [PubMed] [Google Scholar]
- 4.Geocadin RG, Buitrago MM, Torbey MT, Chandra-Strobos N, Williams MA, and Kaplan PW. Neurologic prognosis and withdrawal of life support after resuscitation from cardiac arrest. Neurology. 2006;67:105–8. [DOI] [PubMed] [Google Scholar]
- 5.Mulder M, Gibbs HG, Smith SW, et al. Awakening and withdrawal of life-sustaining treatment in cardiac arrest survivors treated with therapeutic hypothermia*. Crit Care Med. 2014;42:2493–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Greer DM, Rosenthal ES, and Wu O. Neuroprognostication of hypoxic-ischaemic coma in the therapeutic hypothermia era. Nat Rev Neurol. 2014;10:190–203. [DOI] [PubMed] [Google Scholar]
- 7.Oddo M and Rossetti AO. Early multimodal outcome prediction after cardiac arrest in patients treated with hypothermia. Crit Care Med. 2014;42:1340–7. [DOI] [PubMed] [Google Scholar]
- 8.Taccone F, Cronberg T, Friberg H, et al. How to assess prognosis after cardiac arrest and therapeutic hypothermia. Crit Care. 2014;18:202. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Karapetkova M, Koenig MA, and Jia X. Early prognostication markers in cardiac arrest patients treated with hypothermia. Eur J Neurol. 2015. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Sandroni C and Geocadin RG. Neurological prognostication after cardiac arrest. Curr Opin Crit Care. 2015;21:209–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Friberg H, Cronberg T, Dunser MW, Duranteau J, Horn J, and Oddo M. Survey on current practices for neurological prognostication after cardiac arrest. Resuscitation. 2015;90:158–62. [DOI] [PubMed] [Google Scholar]
- 12.Wijdicks EF, Hijdra A, Young GB, Bassetti CL, Wiebe S, and Quality Standards Subcommittee of the American Academy of N. Practice parameter: prediction of outcome in comatose survivors after cardiopulmonary resuscitation (an evidence-based review): report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2006;67:203–10. [DOI] [PubMed] [Google Scholar]
- 13.Polderman KH. Mechanisms of action, physiological effects, and complications of hypothermia. Crit Care Med. 2009;37:S186–202. [DOI] [PubMed] [Google Scholar]
- 14.Tortorici MA, Kochanek PM, and Poloyac SM. Effects of hypothermia on drug disposition, metabolism, and response: A focus of hypothermia-mediated alterations on the cytochrome P450 enzyme system. Crit Care Med. 2007;35:2196–204. [DOI] [PubMed] [Google Scholar]
- 15.Legriel S, Bruneel F, Sediri H, et al. Early EEG monitoring for detecting postanoxic status epilepticus during therapeutic hypothermia: a pilot study. Neurocrit Care. 2009;11:338–44. [DOI] [PubMed] [Google Scholar]
- 16.Samaniego EA, Mlynash M, Caulfield AF, Eyngorn I, and Wijman CA. Sedation confounds outcome prediction in cardiac arrest survivors treated with hypothermia. Neurocrit Care. 2011;15:113–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Steffen IG, Hasper D, Ploner CJ, et al. Mild therapeutic hypothermia alters neuron specific enolase as an outcome predictor after resuscitation: 97 prospective hypothermia patients compared to 133 historical non-hypothermia patients. Crit Care. 2010;14:R69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Bisschops LL, van Alfen N, Bons S, van der Hoeven JG, and Hoedemaekers CW. Predictors of poor neurologic outcome in patients after cardiac arrest treated with hypothermia: a retrospective study. Resuscitation. 2011;82:696–701. [DOI] [PubMed] [Google Scholar]
- 19.Grossestreuer AV, Abella BS, Leary M, et al. Time to awakening and neurologic outcome in therapeutic hypothermia-treated cardiac arrest patients. Resuscitation. 2013;84:1741–1746. [DOI] [PubMed] [Google Scholar]
- 20.Zanyk-McLean K, Sawyer KN, Paternoster R, Shievitz R, Devlin W, and Swor R. Time to Awakening Is Often Delayed in Patients Who Receive Targeted Temperature Management After Cardiac Arrest. Ther Hypothermia Temp Manag. 2016. [DOI] [PubMed] [Google Scholar]
- 21.Sandroni C, Cariou A, Cavallaro F, et al. Prognostication in comatose survivors of cardiac arrest: an advisory statement from the European Resuscitation Council and the European Society of Intensive Care Medicine. Intensive Care Med. 2014;40:1816–31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Callaway CW, Donnino MW, Fink EL, et al. Part 8: Post-Cardiac Arrest Care: 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2015;132:S465–82. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Behrends M, Niemann CU, and Larson MD. Infrared pupillometry to detect the light reflex during cardiopulmonary resuscitation: a case series. Resuscitation. 2012;83:1223–8. [DOI] [PubMed] [Google Scholar]
- 24.Sandroni C, Cavallaro F, Callaway CW, et al. Predictors of poor neurological outcome in adult comatose survivors of cardiac arrest: a systematic review and meta-analysis. Part 1: patients not treated with therapeutic hypothermia. Resuscitation. 2013;84:1310–23. [DOI] [PubMed] [Google Scholar]
- 25.Sandroni C, Cavallaro F, Callaway CW, et al. Predictors of poor neurological outcome in adult comatose survivors of cardiac arrest: a systematic review and meta-analysis. Part 2: Patients treated with therapeutic hypothermia. Resuscitation. 2013;84:1324–38. [DOI] [PubMed] [Google Scholar]
- 26.Rittenberger JC, Sangl J, Wheeler M, Guyette FX, and Callaway CW. Association between clinical examination and outcome after cardiac arrest. Resuscitation. 2010;81:1128–32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Al Thenayan E, Savard M, Sharpe M, Norton L, and Young B. Predictors of poor neurologic outcome after induced mild hypothermia following cardiac arrest. Neurology. 2008;71:1535–7. [DOI] [PubMed] [Google Scholar]
- 28.Olson DM, Stutzman S, Saju C, Wilson M, Zhao W, and Aiyagari V. Interrater Reliability of Pupillary Assessments. Neurocrit Care. 2015. [DOI] [PubMed] [Google Scholar]
- 29.Suys T, Bouzat P, Marques-Vidal P, et al. Automated quantitative pupillometry for the prognostication of coma after cardiac arrest. Neurocrit Care. 2014;21:300–8. [DOI] [PubMed] [Google Scholar]
- 30.Oddo M, Sandroni C, Citerio G, et al. Quantitative versus standard pupillary light reflex for early prognostication in comatose cardiac arrest patients: an international prospective multicenter double-blinded study. Intensive Care Med. 2018;44:2102–2111. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Tong JT, Eyngorn I, Mlynash M, Albers GW, and Hirsch KG. Functional Neurologic Outcomes Change Over the First 6 Months After Cardiac Arrest. Crit Care Med. 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Raina KD, Rittenberger JC, Holm MB, and Callaway CW. Functional Outcomes: One Year after a Cardiac Arrest. Biomed Res Int. 2015;2015:283608. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Nielsen N, Wetterslev J, Cronberg T, et al. Targeted temperature management at 33 degrees C versus 36 degrees C after cardiac arrest. N Engl J Med. 2013;369:2197–206. [DOI] [PubMed] [Google Scholar]
- 34.Sawyer KN and Kurz MC. Assessing cardiac arrest beyond hospital discharge--We are only as “Good” as the outcomes we measure. Resuscitation. 2015;94:A1–2. [DOI] [PubMed] [Google Scholar]
- 35.Grossestreuer AV, Abella BS, Sheak KR, et al. Inter-rater reliability of post-arrest cerebral performance category (CPC) scores. Resuscitation. 2016;109:21–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Raina KD, Callaway C, Rittenberger JC, and Holm MB. Neurological and functional status following cardiac arrest: method and tool utility. Resuscitation. 2008;79:249–56A [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Anonymized data will be shared with any qualified investigator upon request.