Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2020 Mar 1.
Published in final edited form as: Am J Emerg Med. 2018 Jun 8;37(3):461–467. doi: 10.1016/j.ajem.2018.06.020

Comparison of Clinical Risk Scores for Triaging High-Risk Chest Pain Patients at the Emergency Department

Al-Zaiti Salah S 1,2, Faramand Ziad 5, Alrawashdeh Mohammad 1, Sereika Susan M 3,4, Martin-Gill Christian 2,5, Callaway Clifton 2,5
PMCID: PMC6286698  NIHMSID: NIHMS976070  PMID: 29907395

Abstract

Background:

Many of the clinical risk scores routinely used for chest pain assessment have not been validated in patients at high risk for acute coronary syndrome (ACS). We performed an independent comparison of HEART, TIMI, GRACE, FRISC, and PURSUIT scores for identifying chest pain due to ACS and for predicting 30-day death or re-infarction in patients arriving through Emergency Medical Services (EMS).

Methods and Results:

We enrolled consecutive EMS patients evaluated for chest pain at three emergency departments. A reviewer blinded to outcome data retrospectively reviewed patient charts to compute each risk score. The primary outcome was ACS diagnosed during the primary admission, and the secondary outcome was death or re-infarction within 30-days of initial presentation. Our sample included 750 patients (aged 59±17 years, 42% female), of whom 115 (15.3%) had ACS and 33 (4.4%) had 30-day death or re-infarction. The c-statistics of HEART, TIMI, GRACE, FRISC, and PURSUIT for identifying ACS were 0.87, 0.86, 0.73, 0.84, and 0.79, respectively, and for predicting 30-day death or re-infarction were 0.70, 0.73, 0.72, 0.72, and 0.62, respectively. Sensitivity / negative predictive value of HEART≥4 and TIMI≥3 for ACS detection were 0.94 / 0.98 and 0.87 / 0.97, respectively.

Conclusions:

In chest pain patients admitted through EMS, HEART and TIMI outperform other scores for identifying chest pain due to ACS. Although both have similar negative predictive value, HEART has better sensitivity and lower rate of false negative results, thus it can be used preferentially over TIMI in the initial triage of this population.

Keywords: HEART, TIMI, chest pain, acute coronary syndrome

INTRODUCTION

Nearly 7 million Americans visit emergency departments (ED) annually with a chief complaint of chest pain. The focus of initial chest pain assessment is to identify those with acute coronary syndrome (ACS) to accelerate necessary treatment. Given that the initial clinical examination, ECG results, and initial cardiac enzyme levels are often insufficient to eliminate the possibility of ACS, a large proportion of chest pain patients are admitted to the hospital for further evaluation.[1-3] Many well-established clinical risk scores (e.g., HEART, TIMI, etc.) have been used to stratify risk in such undifferentiated chest pain populations,[4] and the HEART score has been shown to possess the highest negative predictive value for adverse cardiac events compared to other risk scores.[5] However, nearly one quarter of chest pain patients are admitted through Emergency Medical Services (EMS). This latter group tend to have higher prevalence of ACS events and subsequent hospital readmission, as well as three-fold increased risk of death compared to those who self-transport.[6-8] As such, clinicians have very low threshold to admitting these patients for further evaluation. Despite the established value of clinical risk scores in stratifying risk in unselected ED populations, these risk scores were not specifically validated in high risk chest pain patients admitted through EMS. Still, these risk scores are frequently associated with prognosis at 30 days rather than with diagnostic performance during hospitalization. Accordingly, we sought to perform a comparison of PURSUIT, TIMI, GRACE, FRISC, and HEART risk scores for (1) identifying chest pain due to ACS, (2) predicting the occurrence of subsequent cardiac events, and (3) predicting all-cause readmissions.

METHODS

Sample and Settings

Subjects for this sub-analysis were recruited from the EMPIRE study (ECG Methods for the Prompt Identification of Coronary Events). The methods of EMPIRE were described in detail elsewhere.[9] In short, EMPIRE is a prospective observational cohort study that enrolled consecutive, non-traumatic chest pain patients transported by EMS to one of three University of Pittsburgh Medical Center-affiliated tertiary care hospitals (UPMC Presbyterian, Mercy, and Shadyside hospitals) in Pittsburgh, PA between May 2013 and August 2014 (N=2,065). The current secondary analysis is based on patients on whom a 12-lead ECG was obtained upon first medical contact by EMS and transmitted to the UPMC medical command center as part of the acute evaluation of chest pain (n=750). Independent reviewers abstracted the key in-hospital data elements recommended by the American College of Cardiology for measuring the management and outcomes of patients with ACS:[10] demographics, anthropometrics, past medical history, home medications, clinical presentation and course of hospitalization, laboratory tests, imaging studies, cardiac catheterization, treatments, and in-hospital complications. There were no modifications to routine medical care. Patients were enrolled through a waiver of informed consent and the study was approved by the University of Pittsburgh Institutional Review Board.

Clinical Outcomes

The first primary outcome was the presence of ACS (myocardial infarction or unstable angina) during the primary indexed admission, defined as the presence of symptoms of ischemia (i.e., diffuse discomfort in the chest, upper extremity, jaw, or epigastric area for >20 min) and at least one of the following criteria: (1) elevation of cardiac troponin (i.e., > 99th percentile), (2) subsequent development of labile, ischemic ECG changes (e.g., ST-T changes, new bundle branch block, new Q wave) during hospitalization, (3) imaging evidence of new loss of viable myocardium or new regional wall motion abnormalities, or (4) coronary angiography or nuclear imaging demonstrating greater than 70% stenosis of a major coronary artery with or without treatment.[11, 12] The second primary outcome was the occurrence of major adverse cardiac events (MACE) within 30 days of presentation, defined as (1) resuscitated or un-resuscitated sudden cardiac arrest, (2) all-cause death, or (3) post-discharge re-infarction requiring cardiac revascularization. The secondary outcome was all-cause readmission or observation stays within 30-days of initial presentation.

To adjudicate study outcomes, two independent reviewers were provided full access to patient index and discharge records, serial ECGs, results of cardiac diagnostic tests (e.g., imaging scans and catheterization laboratory reports), and other information pertinent to the course of hospitalization (e.g., interventions, procedures, and prescribed medications). Patients who did not have complete evaluation within 30 days (e.g., discharged from ED) were classified as negative for MACE and ACS if they had no 30-day adverse events. Patients who died without explanation within 30 days were classified as positive for both outcomes. All disagreements were resolved by a third reviewer.

Calculating Risk Scores

Risk scores were calculated retrospectively through chart review by an independent reviewer who was blinded to outcome data. We followed the methods described in the derivation studies for calculating each risk score.[4, 5, 13-17] Each of the five risk scores used some criteria based on (1) cardiac enzymes and (2) the presenting 12-lead ECG. We used the first cardiac troponin I result at the ED, with the 99th percentile cutoff point specified at each participating UPMC hospital. As recommended by current guidelines for the management of patients with suspected ACS, we used the initial prehospital 12-lead ECG upon first medical contact. The ECG item in each risk score was given a full score if it met the diagnostic cutoff values specified in the universal definition of myocardial infarction:[12] two contiguous leads with (1) ST elevation ≥0.2 mV (in V2–V3) or ≥0.1 mV (in other leads), (2) horizontal/down-sloping ST depression ≥0.5 mV, or (3) T-wave inversion ≥0.1 mV. If the ECG revealed a bundle branch block, a paced rhythm, a ventricular rhythm or left ventricular hypertrophy (based on Sokolow-Lyon voltage criterion), then the ECG item was not given a score unless it was specified in that risk score (i.e., HEART gives partial ECG score). All other scoring variable (i.e., age, sex, past medical history, clinical presentation, and diagnostic lab results) were obtained from the in-hospital records. A brief description of each risk score and with any adjustments we made are summarized in Table 1.

Table 1:

Scoring criteria for computing each clinical risk score

Criteria PURSUIT
 [17]
TIMI
 [15]
GRACE
 [14]
FRISC
 [13]
HEART
 [16]
Age x x x x x
Sex x x
Past Medical History x x x
Risk Factors x x
Medication Use x
CSS / Killip Class x x
Signs & Symptoms x x
Patient History x
Cardiac arrest upon admission x
Vital Signs x
ECG Findings x x x x x
Cardiac Enzymes x x x x
Creatinine level x
Possible Range of Scores 0–18 0–7 0–372 0–5 1 0–10
Cutoff for High-Risk ≥ 10 ≥ 3 ≥ 109 ≥ 2 ≥ 4

(1) FRISC score uses interleukin-6 or CRP in the scoring criteria, which were missing from our data, yielding a possible score of 0–5 rather than 0–6 as described in the original method.

Statistical Analysis

For continuous type variables, measures of central tendency and dispersion were reported as mean ± SD for normally distributed variables and median [25th – 75th IQR] for non-normally distributed variables. Categorical variables were described using frequencies and percentages and reported as n (%). Each outcome was treated as a dichotomous variable (yes/no) and each risk score was treated as a continuous variable in analyses. ACS groups were compared using the chi-square test of independence for categorical variables, the independent samples t-test for normally distributed continuous variables, and the Mann-Whitney test for non-normally distributed continuous variables. The discriminatory power to identify each primary outcome using each risk score was evaluated using the area under the receiver-operator characteristic curve. Areas under the ROC curve (AUC) for the different risk scores were compared using the nonparametric method developed by DeLong, DeLong, and Clarke-Pearson with post-hoc multiple pairwise comparisons at Bonferroni adjustment at p<0.005 (=0.05/10).[18] Previously published cutoff limits for each risk score were used to compute and report diagnostic accuracy values as per STARD guidelines,[19] including sensitivity, specificity, as well as positive (PPV) and negative (NPV) predictive values. We used 1,000 samples bootstrap technique for generating the 95% CI limits for each diagnostic accuracy value. The pairwise agreement between different scores was evaluated using the McNemar’s test. The significance level was set at 0.05 for two-tailed hypothesis testing. All analyses were conducted using IBM SPSS Statistics version 24 (IBM, Corp., Armonk, NY) and SAS version 9.4 (SAS Institute, Inc., Cary, NC).

RESULTS

The final sample included 750 patients (age 59±17 years; 42% female, and 40% Black). Hypertension (68%) and smoking (58%) were the most prevalent risk factors for ACS, followed by dyslipidemia (35%), known CAD (33%), prior MI (27%), prior revascularization procedure (28%), diabetes (26%), and heart failure (18%).Table 2 summarizes the demographic and clinical characteristics of the study sample.

Table 2:

Demographic and clinical characteristics of study sample

Clinical Characteristics All Patients
(N=750)
Final Diagnosis
p value
ACS
(n=115)
No ACS
(n=635)

Age (years) 59 ± 17 64± 15 58 ± 17 <0.001

Male Sex 433 (58%) 71(62%) 362(57%) NS

White Race 431 (57%) 89(77%) 342 (54%) <0.001

Past Medical History
 HTN 519 (69%) 76 (67%) 443(70%) NS
 DM 196 (26%) 39 (34%) 157 (25%) <0.05
 Smoker 436 (58%) 66 (57%) 370 (58%) NS
 Dyslipidemia 259 (35%) 42 (37%) 217 (35%) NS
 Heart Failure 130 (18%) 18 (16%) 112 (18%) NS
 Known CAD 248 (33%) 41 (36%) 207 (33%) NS
 Prior MI 205 (27%) 40 (35%) 165 (26%) <0.05
 Prior PCI / CABG 207 (28%) 44 (39%) 163 (26%) <0.001

Clinical Presentation
 Typical Chest Pain 645 (86%) 102 (90%) 543 (86%) NS
 Dyspnea 215 (29%) 32 (28%) 183 (29%) NS
 Heart Rate 85 ± 24 80 ± 21 85 ± 25 <0.05
 Breathing Rate 19 ± 5 20 ± 4 18 ± 5 <0.05

Laboratory Findings
 Sodium 137 ± 6 137 ± 3 137 ± 6 NS
 Potassium 3.9 ± 0.6 4.0 ± 0.6 3.9 ± 0.5 NS
 Creatinine 1.0 [0.8 – 1.2] 1.1 [0.8 – 1.3] 0.9 [0.7 – 1.2] NS
 Glucose 142 ± 81 147 [113 –
205]
110 [95 –
140]
<0.001
 Initial cTnI Positive 95 (13%) <0.001
 Peak cTnI Positive 170 (23%) 56 (49%) 39 (6%) <0.001
99 (87%) 71 (11%)

Course of Hospitalization
 LOS 1 [0.5 – 3] 3 [0.5 – 4.5] 1 [0.1 – 2] <0.001
 PCI Performed 65 (9%) 60 (53%) 5 (0.8%) <0.001
 CABG Performed 9 (1.2%) 7 (6%) 2 (0.3%) <0.001

30-Day Outcomes
 MACE 33 (4.4%) 19 (16.5%) 14 (2.2%) <0.001
 Readmission 146(20%) 23 (20%) 123 (20%) NS

values are mean ± SD, median [25th – 75th interquartile range], or n (%).

ACS: coronary artery syndrome; HTN: hypertension; DM: diabetes mellitus; CAD: coronary artery disease; MI: myocardial infarction; PCI: percutaneous coronary intervention; CABG: coronary bypass graft; cTnI: cardiac troponin I; LOS: length of stay; CV: cardiovascular.

Overall, 115 patients (15.3%) were diagnosed with ACS during the primary admission (31 had STE on presenting ECG and 84 had NSTE). Compared to those with no ACS, patients with ACS were older and were more likely to have a prior history of diabetes mellitus, prior MI, or prior revascularization procedure (Table 2). The initial cardiac troponin was positive in only 50% of patients with ACS; repeated troponin essays were positive in 87% of this group (i.e., 13% had unstable angina). More than half (53%) of ACS cases were treated by primary percutaneous coronary intervention, and only 6% were treated by coronary bypass surgery.

A total of 42 MACE events occurred in 33 patients (4.4%) within 30-days: 12 developed fatal ventricular arrhythmia upon admission; 4 experienced arrhythmic death; 5 died during primary admission; and 21 experienced post-discharge new infarctions with unplanned repeat revascularization. There were no differences between patients with or without MACE regarding age, sex, race, or past medical history. The rate of 30-day MACE was 16.5% in ACS patients, compared to 2.2% in others (p<0.001) (Table 2).

A total of 146 patients (20%) were readmitted to the hospital within 30-days of initial presentation. Approximately, one third (n=47, 32%) of these readmissions were chest-pain related. Overall, patients who were readmitted were more likely to be males and to have a past medical history of hypertension. There was no difference in 30-day readmission rates between those diagnosed with or without ACS in the primary admission (Table 2).

Figure 1 shows the differences in risk scores between patients with or without the primary clinical outcomes. TIMI, GRACE, FRISC, and HEART scores were higher in patients with ACS (all p < 0.001), in patients with 30-day MACE (all p < 0.001), and in patients with 30-day readmissions (all p < 0.05). PURSUIT score was higher only in patients with chest pain due to ACS (p < 0.001), but not in patients with 30-day MACE or 30-day readmissions.

Figure 1:

Figure 1:

Comparing mean risk scores between those with or without major clinical outcomes

This figure compares the mean and its 95% confidence interval for each risk score between patients with or without acute coronary syndrome (ACS), with or without 30-day major adverse cardiac events (MACE), and with or without 30-day readmission.

Figure 2 compares the area under the ROC curve between the five risk score. HEART (0.87), TIMI (0.86), and FRISC (0.84) had good discrimination power to classify ACS events; PURSUIT (0.79) and GRACE (0.73) had a fair discrimination power. Overall these areas under the ROC curves differed across the five risk scores (χ2= 38.24, df=4, p<0.0001). For classifying 30-day MACE events, however, none of the scores had a good discrimination power. TIMI (0.73), FRISC (0.72), HEART (0.72), and GRACE (0.70) had fair discrimination power; whereas PURSUIT (0.62) had poor discrimination power. These areas under the ROC curves did not significantly differ across the five risk scores (χ2=5.46, df=4, p=0.2435). Using previously published cutoff values, we computed the diagnostic accuracy values for each risk score to classify ACS and 30-day MACE (Table 3). For ACS detection, HEART had the highest sensitivity (0.94) and NPV (0.98); whereas TIMI had lower sensitivity (0.87) but comparable NPV (0.97). Similar results were observed for MACE prediction: HEART had better sensitivity than TIMI (0.79 vs. 0.67), but both had comparable NPV (0.98 vs. 0.98).

Figure 2:

Figure 2:

Diagnostic and prognostic value of each risk score to predict major clinical outcomes

This figure compares the area under the receiver operator characteristics curve (AUC) for each risk score for detecting acute coronary syndrome (ACS, left panel), or 30-day major adverse cardiac events (MACE, right panel).

Table 3:

Diagnostic Accuracy of Each Risk Score in Predicting Study Outcomes

AUC Sensitivity Specificity PPV NPV

Predicting ACS
GRACE 0.73 (0.68-0.77) * 0.71 (0.63-0.79) 0.59 (0.55-0.63) 0.24 (0.20-0.29) 0.92 (0.89-0.94)
PURSUIT 0.79 (0.73-0.84) * 0.78 (0.70-0.85) 0.61 (0.57-0.65) 0.27 (0.22-0.32) 0.94 (0.91-0.96)
FRISC 0.84 (0.80-0.87) 0.80 (0.72-0.87) 0.77 (0.73-0.80) 0.38 (0.32-0.44) 0.96 (0.93-0.97)
TIMI 0.86 (0.82-0.89) 0.87 (0.80-0.92) 0.73 (0.70-0.77) 0.37 (0.32-0.43) 0.97 (0.95-0.98)
HEART 0.87 (0.83-0.90) 0.94 (0.89-0.97) 0.49 (0.46-0.53) 0.25 (0.21-0.29) 0.98 (0.96-0.99)

Predicting MACE
GRACE 0.72 (0.60-0.84) 0.70 (0.53-0.84) 0.55 (0.52-0.59) 0.07 (0.04-0.10) 0.98 (0.96-0.99)
PURSUIT 0.62 (0.51-0.74) 0.64 (0.47-0.79) 0.56 (0.52-0.59) 0.06 (0.04-0.09) 0.97 (0.95-0.98)
FRISC 0.72 (0.64-0.80) 0.61 (0.44-0.76) 0.69 (0.66-0.73) 0.08 (0.05-0.12) 0.97 (0.96-0.99)
TIMI 0.73 (0.66-0.80) 0.67 (0.50-0.81) 0.66 (0.62-0.69) 0.08 (0.05-0.12) 0.98 (0.96-0.99)
HEART 0.70 (0.61-0.73) 0.79 (0.63-0.90) 0.44 (0.40-0.47) 0.06 (0.04-0.09) 0.98 (0.96-0.99)

Values are mean ± 95% CI using 1000 samples bootstrap technique; PPV: positive predictive value; NPV: negative predictive value

(*)

p <0.005 against HEART

(†)

p<0.005 against TIMI

Figure 3 compares the numbers of misclassified events by each risk score. HEART misclassified 7 out of the 115 ACS events (6%) and 7 out of the 33 MACE events (21%); whereas TIMI misclassified 15 (13%) and 11 (33%) of these events, respectively. Also, there was a significant disagreement between how HEART and TIMI scores assigned risk categories (McNemar’s χ2=237.4, df=1, p<0.001). Specifically, HEART classified 429 (57%) patients as higher risk, compared to only 269 (36%) patients by TIMI. More than 40% of those classified as higher risk by HEART (i.e., 175 of 429) were classified as lower risk by TIMI.

Figure 3:

Figure 3:

Comparing high and low risk categories in patients with major clinical outcomes

This figure compares the number of patients correctly classified as high risk or misclassified as low risk by each risk score for detecting: (A) acute coronary syndrome (ACS), or (B) 30-day major adverse cardiac events (MACE). Error bars indicate the 95% CI of the count.

Finally, to evaluate the discrimination index of each risk score to classify NSTE-ACS events, we repeated all analyses after excluding patients with diagnostic ST elevation on the presenting ECG who were directly referred for emergent catheterization (n=31). We observed similar results; only HEART, TIMI, and FRISC had good discrimination power (Figure 4). HEART had the highest sensitivity (93%), but the lowest specificity (49%), whereas TIMI had a better balance between sensitivity (85%) and specificity (73%).

Figure 4:

Figure 4:

Predicting ACS in the absence of diagnostic ST elevation on the presenting ECG

(A)This figure compares the area under the receiver operator characteristics curve (AUC) for each risk score for detecting non-ST elevation acute coronary syndrome (NSTE-ACS). (B) This figure compares the number of patients correctly classified as high risk or misclassified as low risk by HEART and TIMI for detecting NSTE-ACS.

DISCUSSION

In this study, we compared the performance of five clinical risk scores in high-risk chest pain patients transported by ambulance with an ECG transmitted by EMS to the receiving hospital. We found that, in this EMS population, clinical risk scores perform better in identifying chest pain due to ACS, rather than predicting 30-day MACE. HEART (AUC=0.87) and TIMI (AUC=0.86) scores had comparable power and NPV to identify ACS events, but HEART had better sensitivity and lower rate of false negative results. To our knowledge, this is the first study to validate the use of clinical risk scores in a large EMS cohort of patients with chest pain. The originality of our work lies in the comparison of the diagnostic performances of five risk scores for optimal early triage of patients with suspected ACS.

Few studies previously compared the prognostic value of different risk scores for predicting MACE in unselected chest pain populations. These studies consistently favored HEART score over other clinical risk scores. For instance, Poldervaart and colleagues recently compared three risk scores for predicting 6-week MACE (19%) in nine Dutch hospitals (n=1,748).[20]. They found that HEART had the highest discrimination index (AUC=0.86), followed by TIMI (AUC=0.80) and GRACE (AUC=0.73). Sakamoto and colleagues also recently compared the same three risk scores for predicting 30-day MACE (36%) in a single hospital in Singapore (n=604).[21] They also found that HEART had the highest discrimination index (AUC=0.78), followed by TIMI (AUC=0.65) and GRACE (AUC=0.62). In a third prospective validation study by the authors of the HEART score,[5] the HEART score (AUC=0.83) outperformed TIMI (AUC=0.75) and GRACE (AUC=0.70) in predicting 6-week MACE (17%) in a large cohort of patients (n=2440). In a fourth study, Sun and colleagues compared TIMI and HEART risk scores for predicting MACE (6.2%) in nine U.S. hospitals (n=8,255).[22] They similarly found that HEART score had a higher discrimination index (AUC=0.75) compared to TIMI (AUC=0.67). Our current findings are congruent with these previous studies and demonstrate that HEART and TIMI maintain superior discrimination power for identifying ACS events in high-risk EMS cohorts of patients with chest pain.

One important comparison can be made between our data and previous studies. That is we observed relatively better performance for both HEART (0.87) and TIMI (0.86) scores for predicting ACS compared to previous studies (0.75–0.86 for HEART and 0.65–0.80 for TIMI). We speculate that this might be due to the fact that our primary outcome included only patients with ACS diagnosed at the index-visit, whereas previous studies used a composite endpoint of 6-week ACS, invasive coronary revascularization, post-discharge re-infarction, and all-cause death. In fact, when we considered 30-day death or re-infarction the c-statistic dropped significantly from 0.87 to 0.70 for HEART and from 0.86 to 0.73 for TIMI. In other words, the lower c-statistic observed in the previous studies might be attributed to dilution effect introduced by using a soft composite endpoints.[23] Interestingly, one of these previous studies[5] considered the occurrence of ACS within three months (i.e., 93% of events were already diagnosed during the primary admission) as a secondary outcome and found that the c-statistics for HEART score increased from 0.83 for MACE prediction to 0.86 for ACS prediction. Another interesting comparison can be seen in one of these previous studies that excluded patients with ACS diagnosed at the ED from their MACE endpoint.[22] As expected, the c-statistic they observed for HEART (0.75) was relatively lower than what we observed (0.87) and what most other studies previously reported (0.75–0.86).

There are several important clinical implications of our findings. The focus of chest pain assessment in the ED is to identify both low-risk and high-risk patients. HEART and TIMI scores can be computed as soon as the first lab results and initial ECG are obtained (<1 hour), and hence can play a significant role in diagnosing or excluding the possibility of ACS. In high-risk patients transported by EMS providers, HEART score is very useful in identifying which patients are more likely to have ACS (warranting admission or further evaluation). Within this context, HEART score also has a very high NPV (i.e., >97%) which suggests it can be used to identify low risk patients who are less likely to experience adverse events. It is worth noting that HEART score tends to classify more patients as high-risk (57%) compared to other scores (36% using TIMI), yielding low specificity (i.e., <50%) and raising concerns regarding increased resource utilization. Nevertheless, the gains associated with lower rates of false negatives would keep this score more appealing for the development of clinical management algorithms compared to other scores. Still, supplementing HEART score with recent novel tools designed for non-invasive ischemia detection[24-26] would potentially improve the specificity of this score for optimal clinical utility. Finally, given that HEART computation relies more on subjective data, TIMI would provide more objective assessment when clinicians cannot reliably obtain a detailed description of the chief complaint (e.g., patient is poor historian).

Limitations

One limitation of this analysis is that all risk scores were computed retrospectively, which is especially important for scoring the history component of the HEART score. To address this issue, we used a systematic coding scheme by a reviewer blinded to clinical outcomes, and reviewed all available ED records for complete assessment (i.e., EMS charts, triage reports, ED progress notes, ED nursing notes, admission notes, and ED discharge summary). Another limitation is the possibility of loss to follow up due to the observational nature of our study. We used inpatient and outpatient electronic medical records of UPMC network to assure complete ascertainment, and our 30-day death or re-infarction rate was 4.4%, which is comparable to the rate reported in chest pain populations in the United States using Medicare billing data (i.e., 3.2–4.3%).[27]

CONCLUSION

In high-risk chest pain patients admitted through EMS, clinical risk scores have superior discrimination index for identifying ACS as the cause of chest pain during the primary admission, but poor discrimination index for predicting future death or re-infarction. Although HEART and TIMI have comparable excellent discrimination power, HEART score has better sensitivity and lower rate of false negative results, thus it can be used preferentially over TIMI in the initial ED evaluation of this population.

Acknowledgments

Funding: NIH – NHLBI (R01-HL-137761)

ABBREVIATIONS

ACS

Acute Coronary Syndrome

ECG

Electrocardiogram

EMS

Emergency Medical Services

ED

Emergency Department

FRISC

Fast Revascularisation in Instability in Coronary disease

GRACE

Global Registry of Acute Coronary Events

HEART

History-ECG-Age-Risk Factors-Troponin

MACE

major adverse cardiac events

PURSUIT

Platelet Glycoprotein IIb/IIIa in Unstable angina: Receptor Suppression Using Integrilin Therapy

TIMI

Thrombolysis in Myocardial Infarction

Footnotes

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

Conflicts of Interest: None

Presentation: this work was presented at the 2017 AHA Scientific Sessions in Anaheim CA

REFERENCES

  • 1.Rui P and K. K, National Hospital Ambulatory Medical Care Survey: Emergency Department Summary Tables. US Department of Health and Human Services, National Center for Health Statistics, 2014. Available from: http://www.cdc.gov/nchs/data/ahcd/nhamcs_emergency/2014_ed_web_tables.pdf.
  • 2.Thang ND, et al. , ECG signs of acute myocardial ischemia in the prehospital setting of a suspected acute coronary syndrome and its association with outcomes. Am J Emerg Med, 2014. 32(6): p. 601–5. [DOI] [PubMed] [Google Scholar]
  • 3.Lindsell CJ, et al. , The Internet Tracking Registry of Acute Coronary Syndromes (i* trACS): a multicenter registry of patients with suspicion of acute coronary syndromes reported using the standardized reporting guidelines for emergency department chest pain studies. Annals of emergency medicine, 2006. 48(6): p. 666–677. e9. [DOI] [PubMed] [Google Scholar]
  • 4.E Backus B, et al. , Risk scores for patients with chest pain: evaluation in the emergency department. Current cardiology reviews, 2011. 7(1): p. 2–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Backus BE, et al. , A prospective validation of the HEART score for chest pain patients at the emergency department. Int J Cardiol, 2013. 168(3): p. 2153–8. [DOI] [PubMed] [Google Scholar]
  • 6.Canto JG, et al. , Use of Emergency Medical Services in Acute Myocardial Infarction and Subsequent Quality of Care. Observations From the National Registry of Myocardial Infarction 2, 2002. 106(24): p. 3018–3023. [DOI] [PubMed] [Google Scholar]
  • 7.Meisel ZF, et al. , Variations in Ambulance Use in the United States: the Role of Health Insurance. Academic emergency medicine : official journal of the Society for Academic Emergency Medicine, 2011. 18(10): p. 1036–1044. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Kocher RP and Adashi EY, Hospital readmissions and the Affordable Care Act: paying for coordinated quality care. Jama, 2011. 306(16): p. 1794–1795. [DOI] [PubMed] [Google Scholar]
  • 9.Al-Zaiti SS, et al. , Rationale, development, and implementation of the Electrocardiographic Methods for the Prehospital Identification of Non-ST Elevation Myocardial Infarction Events (EMPIRE). J Electrocardiol, 2015. 48(6): p. 921–26. [DOI] [PubMed] [Google Scholar]
  • 10.Cannon CP, et al. , American College of Cardiology key data elements and definitions for measuring the clinical management and outcomes of patients with acute coronary syndromes: A report of the American College of Cardiology Task Force on Clinical Data Standards (Acute Coronary Syndromes Writing Committee) Endorsed by the American Association of Cardiovascular and Pulmonary Rehabilitation, American College of Emergency Physicians, American Heart Association, Cardiac Society of Australia & New Zealand, National Heart Foundation of Australia, Society for Cardiac Angiography and Interventions, and the Taiwan Society of Cardiology. Journal of the American College of Cardiology, 2001. 38(7): p. 2114–2130. [DOI] [PubMed] [Google Scholar]
  • 11.Kushner FG, et al. , 2009 Focused Updates: ACC/AHA Guidelines for the Management of Patients With ST-Elevation Myocardial Infarction (Updating the 2004 Guideline and 2007 Focused Update) and ACC/AHA/SCAI Guidelines on Percutaneous Coronary Intervention (Updating the 2005 Guideline and 2007 Focused Update). Catheterization and Cardiovascular Interventions, 2009. 74(7). [DOI] [PubMed] [Google Scholar]
  • 12.Thygesen K, et al. , Universal definition of myocardial infarction: Statement from ESC/ACCF/AHA/WHF Task Force for the Redefinition of Myocardial Infarction. European Heart Journal, 2007. 28(20): p. 2525–2538. [DOI] [PubMed] [Google Scholar]
  • 13.Lagerqvist B, et al. , FRISC score for selection of patients for an early invasive treatment strategy in unstable coronary artery disease. Heart, 2005. 91(8): p. 1047–1052. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Granger Cb GRJDO and et al. , PRedictors of hospital mortality in the global registry of acute coronary events. Archives of Internal Medicine, 2003. 163(19): p. 2345–2353. [DOI] [PubMed] [Google Scholar]
  • 15.Antman Em CMBPM and et al. , The timi risk score for unstable angina/non–st elevation mi: A method for prognostication and therapeutic decision making. JAMA, 2000. 284(7): p. 835–842. [DOI] [PubMed] [Google Scholar]
  • 16.Six A, Backus B, and Kelder J, Chest pain in the emergency room: value of the HEART score. Netherlands Heart Journal, 2008. 16(6): p. 191–196. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Boersma E, et al. , Predictors of Outcome in Patients With Acute Coronary Syndromes Without Persistent ST-Segment Elevation. Circulation, 2000. 101(22): p. 2557–2567. [DOI] [PubMed] [Google Scholar]
  • 18.DeLong ER, DeLong DM, and Clarke-Pearson DL, Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics, 1988: p. 837–845. [PubMed] [Google Scholar]
  • 19.Bossuyt PM, et al. , Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clinical chemistry and laboratory medicine, 2003. 41(1): p. 68–73. [DOI] [PubMed] [Google Scholar]
  • 20.Poldervaart JM, et al. , Comparison of the GRACE, HEART and TIMI score to predict major adverse cardiac events in chest pain patients at the emergency department. International Journal of Cardiology, 2017. 227(Supplement C): p. 656–661. [DOI] [PubMed] [Google Scholar]
  • 21.Sakamoto JT, et al. , Comparing HEART, TIMI, and GRACE scores for prediction of 30-day major adverse cardiac events in high acuity chest pain patients in the emergency department. International Journal of Cardiology, 2016. 221(Supplement C): p. 759–764. [DOI] [PubMed] [Google Scholar]
  • 22.Sun BC, et al. , Comparison of the HEART and TIMI Risk Scores for Suspected Acute Coronary Syndrome in the Emergency Department. Critical Pathways in Cardiology, 2016. 15(1): p. 1–5. [DOI] [PubMed] [Google Scholar]
  • 23.Al-Zaiti SS, et al. , Electrocardiogram-Based Predictors of Clinical Outcomes: A Meta-Analysis of the Prognostic Value of ventricular repolarization. Heart & Lung, 2014. 43(6): p. 516–26. [DOI] [PubMed] [Google Scholar]
  • 24.Al-Zaiti S, et al. , Evaluation of Beat-to-Beat Ventricular Repolarization Lability from Standard 12-Lead ECG During Acute Myocardial Ischemia. Journal of Electrocardiology, 2017. 50(6): p. 717–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Al-Zaiti S, et al. , Spatial Indices of Repolarization Correlate with Non-ST Elevation Myocardial Ischemia in Patients with Chest Pain. Medical & Biological Engineering & Computing 2018. 56(1): p. 1–12. [DOI] [PubMed] [Google Scholar]
  • 26.Al-Zaiti S, et al. , Clinical Utility of Ventricular Repolarization Dispersion for Real-Time Detection of Non-ST Elevation Myocardial Infarction in Emergency Departments. Journal of the American Heart Association, 2015. 4(7): p. e002057. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Cotterill PG, et al. , Variation in chest pain emergency department admission rates and acute myocardial infarction and death within 30 days in the Medicare population. Acad Emerg Med, 2015. 22(8): p. 955–64. [DOI] [PubMed] [Google Scholar]

RESOURCES