Abstract
Study Hypothesis
Older adults are frequently hospitalized from the emergency department (ED) after an episode of unexplained syncope. Current admission patterns are costly with little evidence of benefit. We hypothesized that an Emergency Department Observation Syncope Protocol would reduce resource use without adversely affecting patient-oriented outcomes.
Methods
This randomized trial at five EDs compared an ED observation syncope protocol to inpatient admission for intermediate-risk adults (≥50 years) presenting with syncope or near-syncope. Primary outcomes included inpatient admission rate and length-of-stay. Secondary outcomes included 30-day and 6-month serious outcomes after hospital discharge, index and 30-day hospital costs, 30-day quality-of-life scores, and 30-day patient satisfaction.
Results
Study staff randomized 124 patients. Observation resulted in a lower inpatient admission rate (15% vs. 92%, 95%CI Difference: −88%, −66%) and shorter hospital length-of-stay (29 vs. 47 hours, 95%CI Difference: −28, −8). Serious outcome rates after hospital discharge were similar for observation vs. admission at 30-days (3% vs. 0%, 95%CI Difference: −1%, 8%) and 6-months (8% vs. 10%, 95%CI Difference: −13%, 9%). Index hospital costs in the observation group were $629 (95%CI Difference: −$1376, −$56) lower than in the admission group. There were no differences in 30-day quality-of-life scores or in patient satisfaction.
Conclusions
An ED observation syncope protocol reduced the primary outcomes of admission rate and hospital length-of-stay. Analyses of secondary outcomes suggest reduction in index hospital costs with no difference in safety events, quality-of-life, or patient satisfaction. Our findings suggest that an ED observation syncope protocol can be replicated and safely reduce resource use.
Introduction
Background
Syncope represents a common and vexing chief complaint in emergency departments. In the United States alone, syncope accounts for 740,000 annual emergency department (ED) evaluations1 and yearly hospital costs of over $2.4 billion.2 Because patients have recovered by the time of ED presentation, it is often difficult to distinguish among the many potential causes that include benign as well as life-threatening conditions. Despite international efforts to develop clinical guidelines3-7, diagnostic pathways8-11, and risk prediction tools12-18, there remains considerable uncertainty about how to optimally manage patients at intermediate risk of adverse outcomes.19 As a result, providers often hospitalize older adults without a clear cause for syncope for diagnostic evaluation.1,20-22 However, current admission practices are characterized by low diagnostic yield and significant practice variation 23, do not clearly improve outcomes24, and are costly.2,25 These findings have been reported from multiple countries.26-33 Efforts by the U.S. Center for Medicare and Medicaid Services (CMS) to deny hospital payments for ‘unnecessary’ inpatient admissions have further intensified the need to develop an alternative diagnostic pathway; syncope was recently identified as the top diagnosis associated with payment denials by CMS Recovery Audit Contractors.34
Importance
An Emergency Department Observation Syncope Protocol may safely reduce hospitalizations by expediting and standardizing the evaluation of syncope. A previous single-center randomized evaluation of an ED based, syncope evaluation unit suggested a 55% reduction in hospital admissions without increase in mortality.35 However, these results have not been replicated at other sites, and there is no information about how such an approach may impact costs, non-fatal clinical events, and patient centered outcomes such as quality-of-life and satisfaction. Evaluating the efficiency and safety of this alternative delivery approach has important health delivery implications; 36% of U.S. EDs operate an observation unit and have the potential ability to implement an ED observation protocol.36
Goals of This Investigation
We compared an ED observation syncope protocol vs. routine inpatient admission for intermediate-risk patients after an unrevealing emergency department evaluation for syncope. We tested the primary hypotheses that an ED observation protocol would reduce hospital admissions and hospital length-of-stay.
We originally intended to collect planning data for a definitive non-inferiority trial of safety, costs, and quality-of-life. Because of changes in payer audit and payment policies during the study period34, however, it is unlikely that U.S. hospitals will participate in future randomized studies of ED observation unit care. In exploratory analyses, we assessed the impact of the ED observation protocol on safety, costs, quality-of-life, and patient satisfaction.
Methods
Study Design and Setting
We conducted a randomized clinical trial at five emergency departments (EDs) from March 1, 2010 to October 1, 2011 (ClinicalTrials.gov Identifier: NCT01003262). Study staff completed participant follow-up on April 31, 2012. We include the trial protocol and CONSORT checklist as online supplements.
The study sites represent a diversity of hospital characteristics, geography, and patient populations. (eTable 1) All ED observation units are located in a distinct physical space adjacent to the main ED, supervised by attending emergency physicians, and staffed by mid-level providers.
The IRBs of the coordinating center and all enrolling sites approved this study. An independent safety monitor reviewed all data on clinical events.
Selection of Participants
Patients aged 50 years or greater were prospectively screened in the emergency department for a complaint of syncope or near-syncope. Syncope was defined as a sudden, transient loss of consciousness. Near-syncope was defined as a sensation of imminent loss of consciousness, without actual syncope.
Using specialty society guidelines, the study team developed risk stratification guidelines for short-term, dangerous clinical events after syncope .4,6,37 (Figure 1) We included additional feedback from enrolling physicians to ensure that the guidelines were feasible and acceptable at the study sites. Treating physicians used these criteria to categorize patients as high, intermediate, or low risk. Patients at intermediate risk were eligible for study enrollment. Although we considered objective risk scores, none have been validated for routine clinical use38 and were not felt to be feasible at our enrolling sites.
Figure 1.
Risk Stratification Guidelines
We excluded patients with a serious condition identified during the ED, including symptomatic arrhythmias, myocardial infarction, pulmonary embolism, acute pulmonary edema, stroke, severe anemia or blood loss requiring blood transfusion, sepsis, and major traumatic injury. Additional exclusion criteria included: seizure, head trauma, or intoxication as the reason for loss of consciousness; new or baseline cognitive impairment; do-not-resuscitate or do-not-intubate status; active chemotherapy for cancer; and inability to speak either English or Spanish.
Randomization Assignment
After providing informed consent, patients were block randomized (n=4) by site in a 1:1 ratio to either the observation protocol or routine inpatient admission. A computer generated the study arm assignment at the time of randomization, and no research personnel had advance knowledge of study arm assignment. We could not blind this health service intervention to patients, providers, or research personnel. All study patients received an initial ED evaluation consisting of a directed history, physical examination, standardized laboratory tests, and a 12-lead electrocardiogram.
Intervention
We used professional society guidelines4,6,37 to design the ED observation protocol intervention. All observation protocol patients received continuous cardiac monitoring for at least 12 hours. The ED treating team ordered at least two serial cardiac troponin tests, approximately six hours apart, to exclude acute myocardial infarction. The study sites used different troponin assays; we defined a normal troponin threshold as the 99th percentile value for a reference population for each site’s assay. The ED treating team ordered a rest echocardiogram for patients with a cardiac murmur on chest auscultation, if a prior echocardiogram had not been performed in the prior six months. The ED treating teams could perform additional testing at their discretion.
The maximum stay in the ED observation unit could not exceed 24 hours. Observation protocol patients who were diagnosed with a serious condition, had persistent symptoms of syncope or near-syncope, were felt by the treating physician to be unable to be safely discharged home because of functional reasons (e.g. inability to ambulate), or had pending tests at 24 hours were admitted to the hospital. All other patients were eligible for discharge. The treating ED team made the final decision to admit or discharge observation patients.
An inpatient medicine service managed patients randomized to routine inpatient admission. The study protocol did not guide the care of patients randomized to this arm. Contamination between the study arms was minimized because both groups were managed in distinct physical spaces by different clinical services. Although it is possible that some patients in the routine inpatient admission arm were classified as “observation status” for billing purposes, the physical setting, providers, and processes were indistinguishable from “inpatient” care.
Outcomes
Primary outcomes included inpatient admission rates (%) and hospital length-of-stay (hours) at the index ED visit. Prior studies of health service interventions for syncope have used admission rate as a primary outcome.8-11,35 Because hospital services may be similar in inpatient, observation, and ED settings, we also assessed hospital length-of-stay as a primary outcome.
Secondary outcomes included 30-day and 6-month serious clinical events, index and 30-day hospital costs, 30-day changes in quality-of-life after study enrollment, and 30-day patient satisfaction.
We defined potential safety events as serious clinical events that occurred after discharge from the index hospital visit. Clinical events that occurred during the hospitalization were not considered safety events, as these were felt to represent appropriate recognition of serious illness during the diagnostic evaluation. A multi-specialty panel of emergency physicians, internists, geriatricians, and cardiologists previously defined syncope-related, serious clinical events.20 These include death, ventricular arrhythmias, Mobitz II or complete heart block, sick sinus syndrome, sinus pause greater than 3 seconds, symptomatic supraventricular tachycardia (heart rate>100 beats per minute), symptomatic bradycardia (heart rate <60 beats per minute), major cardiac intervention such as permanent pacemaker placement, myocardial infarction, stroke, pulmonary embolism, aortic dissection, non-traumatic intracranial hemorrhage, internal hemorrhage or anemia requiring blood transfusion, and major traumatic injury (intracranial bleed, bone fracture, or thoraco-abdominal visceral injury) associated with syncope, near-syncope, or a fall occurring after the index visit. We also measured recurrent episodes of syncope or near-syncope resulting in an ED visit.
We modeled hospital costs for all 30-day acute care services in the ED, observation unit, and inpatient settings by imputing 2011 Medicare national mean payments for procedures and observation facility fees. The eMethods and eTable 2 describe the cost model in detail.
We administered the Quality of Well-being Scale39 to measure general health utility and the Syncope Functional Status Questionnaire40,41 to measure symptom specific quality-of-life. The Quality of Well-being Scale ranges from 0-1, with 0 indicating worst possible health and 1 indicating optimum health. The Syncope Functional Status Questionnaire ranges from 0-100, with 0 indicating no syncope- related impairment and 100 indicating maximum impairment.
Finally, we measured patient satisfaction using the Consumer Assessment of Healthcare Providers and Systems – Hospital overall rating of care42, which ranges from 0 (worst) −10 (best).
Baseline and Follow-up Measures
At baseline, all patients received 12-lead electrocardiogram, cardiac troponin, basic metabolic panel, and hematocrit testing during the index ED evaluation. Research staff extracted laboratory and vital sign data from the ED chart. Research assistants obtained demographic data, including race/ethnicity, directly from patients and administered baseline quality-of-life instruments. Treating physicians completed a survey about patient history of presentation, pre-existing co-morbidities, physical exam, and electrocardiogram interpretation. We used clinical data to estimate a Syncope Risk Score, which is a case mix measure derived from a population of older adults with syncope.43 Research staff extracted information on inpatient admission and length-of-stay from administrative data.
Outcomes ascertainment after patient enrollment included direct patient phone interviews by research assistants and medical chart abstraction by physician-reviewers. Research staff called patients at 30-days to determine vital status, identify subsequent hospital visits occurring at non-enrolling site facilities, and administer follow-up quality-of-life instruments. Physician reviewers abstracted records from all ED visits and hospitalizations within 30 days, including those that occurred outside of the enrolling sites, to identify serious clinical events and to quantify hospital-based health service use. Research staff recorded disposition (discharge from ED, observation, inpatient admission) and major diagnostic and therapeutic procedures. We repeated direct patient phone interviews and chart reviews at 6-months to identify additional serious clinical events and episodes of recurrent syncope. Finally, we verified the vital status of all patients at 6-months after enrollment using the Social Security Death Masterfile.44
A second physician-reviewer who was blinded to the original reviews reabstracted charts for the 40 enrolled patients (first 10 enrollments at each of the 4 sites). There was 100% agreement on the occurrence of serious clinical events and good agreement on whether patients received any of 25 diagnostic or therapeutic procedures (K=0.63-1).
Data Analysis
We created intent-to-treat regression models with study sites as fixed-effects to analyze all outcomes. The predictor variable was randomization assignment. We analyzed binary outcomes using logistic regressions. To correct for skewness, we applied a log transformation to cost outcomes. The difference in cost outcomes between observation and routine care was estimated based on a log-scale analysis and then transformed back to the original scale, and the corresponding 95% confidence interval was calculated using bootstrapping with 1000 iterations. Finally, we used the log-rank test to analyze survival without a safety event during the first six months after initial hospital discharge, and Kaplan-Meier curves for safety-events were plotted.
The sample size was designed to achieve a power of 80% to detect a 22% reduction in inpatient admission rate in the observation group (two sided α=0.05), assuming an inpatient admission rate of 85% in the standard care group. A safety monitor performed an interim analysis at 6-months with a pre-defined stopping threshold for an absolute difference of 8% or greater in serous outcomes between the two study arms.
Non-Inferiority of Safety
We performed a post-hoc, non-inferiority analysis of one-month serious outcomes after index hospital discharge. We defined a pre-specified, non-inferiority threshold of 4% absolute difference in 30-day safety event rates using an economic justification. (See Trial Protocol) If the observation protocol resulted in a 4% worse safety event rate than routine care, then prior cost data2 suggest that it would cost $135,000 to potentially avoid one safety event by admitting all patients rather than observing them. This threshold assumes that inpatient admission reduces downstream morbidity and mortality related to syncope safety events, which has never been proven24, and this margin is more expensive than commonly suggested criteria for cost-effective care (e.g., $100,000 / Quality-Adjusted Life Year).45
In contrast to frequentist procedures which seek to disprove the null hypothesis, a Bayesian approach estimates the likelihood that a study hypothesis is true. Bayesian analyses may be particularly helpful for small studies, when there may be insufficient data to exclude the null hypothesis.46 We used Bayesian logistic regression models to estimate the posterior probability that the absolute difference in one-month safety events was within the pre-specified 4% non-inferiority margin. We used non-informative prior distributions for the models. Bayesian parameter estimates were generated with Markov chain Monte Carlo methods, and Bayesian model inferences were summarized as a point estimate and an interval containing the true parameter with some probability (i.e. the 95% Credible Interval). As recommended by CONSORT guidelines for non-inferiority analyses47, we analyzed: (1) all enrolled patients (intent-to-treat approach) and (2) all patients who received the assigned treatment (per-protocol approach). The Bayesian modeling was implemented using the WinBUGS software (publicly available; version 1.4.3).48
Protocol Modifications
This study differs from the original trial registration and protocol in the following aspects: 1. We lowered the age criterion from the original trial proposal (≥60 years) after four months of enrollment to improve patient recruitment; the study sponsor and study site IRBs approved this change; 2. The original trial protocol proposed collection of 6-month quality-of-life data; however, this was dropped because of participant complaints about survey length and burden; 3. We proposed a formal cost effectiveness analysis (i.e., comparison of the ratio of cost to quality-adjusted-life-year). We dropped this analysis due to lack of observed differences in the denominator (see Results below). A formal cost-effectiveness analysis would yield no additional information compared to an assessment of cost-difference only; 4. We added satisfaction as a secondary outcome because of its importance to patient centered care; 5. Finally, the Bayesian non-inferiority assessment of safety events was an exploratory analysis and not proposed in the original protocol.
Results
Characteristics of Study Subjects
Figure 2 describes screening, eligibility, and randomization. Of 2,724 emergency department patients screened for syncope or near syncope, there were 1,235 who were potentially eligible prior to risk stratification. Treating physicians excluded an additional 315 patients for low risk and 633 patients for high risk. Compared to intermediate risk patients, high risk patients were older (70 vs 66; 95%CI difference 2.4, 5.7); there were no differences by gender (67% vs 70% female; chi-square p=0.26). eTable 3 lists specific reasons for high-risk exclusions.
Figure 2.
Screening and Enrollment Flowchart
Of 287 eligible patients after risk stratification, study staff randomized 124 patients. eTable 4 describes reasons why eligible patients were not randomized. In the final study cohort, there was a higher proportion of patient with abnormal electrocardiograms in the control group; there were otherwise no major imbalances in demographic and clinical features between the groups. (Table 1) Protocol violations included four patients who left against medical advice after randomization and two patients discharged by the treating physician despite randomization to the admission arm.
Table 1.
Characteristics of Study Cohort
| Characteristic | Observation (n=62) |
Routine Admission (n=62) |
|---|---|---|
| Age, years (Mean, SD) | 65 (11) | 64 (11) |
| Chief complaint of syncope* (n,%) | 46 (74%) | 38 (61%) |
| Male (n,%) | 29 (47%) | 32 (52%) |
| White/non-Hispanic (n,%) | 27 (44%) | 24 (39%) |
| Past Medical History (n,%) Congestive heart failure |
||
| 1 (2%) | 2 (3%) | |
| Coronary artery disease | 8 (13%) | 5 (8%) |
| Arrhythmia | 5 (8%) | 4 (6%) |
| Syncope in prior year | 10 (16%) | 13 (21%) |
| Index Syncope History (n,%) Occurred while supine |
||
| 8 (13%) | 8 (13%) | |
| Associated with chest pain | 8 (13%) | 7 (11%) |
| Associated with shortness of breath | 11 (18%) | 4 (6%) |
| Associated with palpitations | 6 (10%) | 4 (6%) |
| No warning signs | 18 (29%) | 13 (21%) |
| Baseline quality-of-life scores Quality of Well Being Scale (Mean, SD) Quality of Well Being Scale (median, IQR) |
||
| 0.55 (0.15) | 0.55 (0.14) | |
| 0.55 (0.45, 0.65) | 0.55 (0.47, 0.66) | |
| Syncope Functional Status Questionnaire (Mean, SD) |
29 (25) | 25 (26) |
| Syncope Functional Status Questionnaire (median, IQR) |
26 (7.1, 41) | 17 (4.8, 39) |
| Triage systolic blood pressure (Mean, SD) | 140 (24) | 141 (24) |
| Hematocrit <30 (n,%) | 5 (8%) | 3 (5%) |
| Troponin >99% normal reference (n,%) † | 5 (8%) | 5 (8%) |
| Abnormal initial electrocardiogram (n,%) ‡ | 11 (18%) | 23 (37%) |
| Syncope Risk Score (Mean, SD)|| | 0.76 (0.84) | 0.76 (0.67) |
vs. near-syncope
>99% normal reference range for site-specific troponin assay
Presence of non-sinus rhythm; multiple PVCs (>1 on standard 12-lead tracing); sinus bradycardia<40; left or right ventricular hypertrophy; left or right axis deviation; complete left or right bundle branch block; first degree block (>20mS); short PR interval (<10 mS); prolonged QRS (>1 OmS); prolonged QTc (>450mS);
Q/ST/T changes consistent with acute or chronic ischemia
Risk prediction score developed for older adults with syncope43
Primary and Secondary Outcomes
We describe study outcomes in Table 2 and missing outcome data in eTable 5. In the routine admission arm, protocol violations accounted for the 8% of patients who were not hospitalized. Compared to routine admission, observation was associated with absolute reductions of 77% in inpatient admission rate (relative risk ratio: 0.16; 95%CI: 0.09, 0.29; p<0.0001) and 18 hours in hospital length-of-stay (p=0.0003).
Table 2.
Outcomes by Study Group*
| Observation | Routine Admission | Difference | |
|---|---|---|---|
| OUTCOMES | (n=62) | (n=62) | (95%CI) |
| Primary Outcomes | |||
| Inpatient Admission (n,%) | 9 (15%) | 57 (92%) | −77% (−88%, −66%) |
| Length-of-Stay, hours (Mean, SD) | 29 (15) | 47 (34) | −18 (−28, −8) |
| Secondary Outcomes | |||
| Costs † | |||
| Hospital costs, at index visit, in $US (Mean, SD) | 1400 (1220) | 2420 (3930) | −629 (−1376, −56) |
| Hospital costs, at index visit, in $US (Median, IQR) | 1190 (870, 1550) | 1570 (870, 2370) | |
| Hospital costs, within 30 days, in $US (Mean, SD) | 1800 (2150) | 2520 (3980) | −479 (−1230, 198) |
| Hospital costs, within 30 days, in $US (Median, IQR) | 1210 (948, 1660) | 1580 (870, 2390) | |
| Serious Clinical Outcomes During Hospital Visit (n,%) | 5 (8%) | 3 (5%)‡ | 3% (−6%, 12%) |
| Death | 0 | 0 | |
| Arrhythmia | 2 (3%) | 2 (3%) | |
| Pacemaker Insertion | 1 (2%) | 1 (2%) | |
| Syncope/Fall With Bone Fracture | 2 (3%) | 1 (2%) | |
| 30-Day Recurrent Syncope (n,%) | 1 (2%) 32 | 1 (2%) | 0% (−4%, 4%) |
| 30-Day Serious Outcomes After Hospital Discharge (n,%) | 2 (3%) | 0 | 3% (−1%, 8%) |
| 6-Month Serious Outcomes After Hospital Discharge (n, %) | 4 (8%) | 5 (10%) | −2% (−13%, 9%) |
| Quality-of-life | |||
| Change in Quality of Well Being score (Mean, SD) |
0.00 (0.20) | 0.03 (0.18) | −0.02 (−0.10, 0.06) |
| Change in Syncope Functional Status Questionnaire score (Mean, SD) |
−7.6 (20.1) | −2.4 (26.3) | −5.2 (−15.2, 4.8) |
| Patient Satisfaction (Mean, SD) | 8.9 (1.4) | 9.3 (0.9) | −0.46 (−0.95, 0.026) |
% denominator based on complete outcomes data- see eTable 3 for missing outcomes data; all site fixed effects were non-significant (p>0.05)
95%CI for differences based on back-transformation of log-transformed analysis; see text
1 patient experienced symptomatic arrhythmia, cardiac ablation, and pacemaker placement
eTable 6 describes all patients with potential safety events. There were no significant differences in the proportion of patients who were diagnosed with a serious clinical condition after the initial ED evaluation at 30-days or 6-months. Figure 3 displays the Kaplan-Meier curve for safety events at six months (p=0.8).
Figure 3.
Kaplan-Meier Curves for Safety Events
The ED observation syncope protocol was associated with an absolute cost reduction of $629 for hospital services associated with the index visit, and a non-significant trend towards lower 30-day hospital costs. We found no differences in diagnostic testing rates between the groups (eTable 7); therefore the cost differences were attributable to differences in hospital length-of-stay. There were no significant differences in general health utility, syncope-specific quality-of-life, or patient satisfaction.
Non-Inferiority of 30-day Safety Events
eFigures 1 and 2 illustrate the posterior distributions of rate-differences. For the intent-to-treat analysis, the posterior estimate of difference in safety event rates at one month between observation and admission was 3.1% (95% CI: 0.3%, 9.0%). Using a 4% non-inferiority margin, the posterior probability of the observation protocol being non-inferior to routine care was 0.72, given the observed data.
For the per-protocol analysis, the posterior estimate of difference in safety event rates at one month between the two arms was 3.3% (95% CI: 0.3%, 9.4%). The posterior probability of the observation protocol being non-inferior to routine admission was 0.70.
Limitations
Strengths of our study include patient-level randomization and replication of the protocol at EDs with a diversity of structural and patient characteristics. However, we acknowledge potential limitations. First, this study was not a priori powered to assess non-inferiority of secondary outcomes. Given external payer pressures to reduce inpatient syncope admissions34, additional efforts to randomize patients are unlikely to succeed in U.S. settings. However, our Bayesian analyses suggest that the observation protocol is likely to be non-inferior to routine inpatient admission for safety events.
Second, there is no existing consensus for an acceptable non-inferiority margin for safety events. We used an economic approach using a conventional cost/ quality-life year threshold and highly conservative assumptions about the potential benefit of hospitalization over observation. However, the clinical acceptability of our proposed safety margin is unknown and requires future investigation.
Third, we found that almost half of potentially eligible patients were excluded as ‘high-risk’; half of those were based on the clinical judgment of treating physicians. Because published risk scores have not been validated for routine clinical use38, we developed risk stratification guidelines that were acceptable to enrolling site physicians and consistent with prior research.35 However, conservative risk stratification and physician discomfort with the observation protocol may have limited potential enrollment.49 Validated risk prediction instruments may broaden the safe application of the observation protocol.43 Although there is the potential for selection bias towards less severely ill patients, the overall 30-day event rate (6%) observed in our trial is almost identical to the reported event rate in a community cohort of intermediate-risk, older adults presenting to an ED with syncope.43
Fourth, our cost analysis did not include outpatient facility or patients’ costs. We were unable to collect reliable data on outpatient visits, and it is possible that there were difference in outpatient health service utilization between the treatment arms. In addition, there is increasing concern about large and unanticipated patient co-payments associated with observation care.50 Although we did not have data on patient co-payments, it is likely that Medicare covered patients in our trial would have paid less under observation status than as an inpatient admission. The 2011 Medicare inpatient deductible for hospital services was $1,13251; at the outpatient Medicare co-pay rate of 20%, Medicare covered patients in our observation arm on average would have paid less than $300 for hospital services.
Fifth, the original protocol proposed to study patients aged 60 years and older because of higher incidence of adverse events and health service use.52,53 The age criterion was lowered because of enrollment challenges, and it is possible that observation has a differential impact in patients above and below 60 years of age. In post-hoc analysis, we assessed whether there was any interaction effect between treatment assignment and age (dichotomized as <60 and ≥ 60 years). We found no significant interaction effects (p>0.3) for any of the primary or secondary outcomes.
Sixth, there was an imbalance in patients with abnormal ECGs between the two treatment arms, likely due to the small sample size. Similar Syncope Risk Stratification Scores (which incorporate ECG abnormalities) suggest that overall risk in the groups were comparable prior to randomization. In post-hoc analysis which included abnormal ECG, the difference in index hospital costs became insignificant (p=0.07); there were no qualitative changes in analyses of any other primary or secondary outcome.
Finally, we had incomplete data for quality-of-life and satisfaction ratings (eTable 3) due to participant refusal, which is likely related to length of the survey instruments. There is the potential for response bias, although we did not find evidence of differential response rates by study arm.
Discussion
We found that an ED observation protocol substantially reduced hospital inpatient admissions, length-of-stay, and index hospital costs in older patients with intermediate-risk syncope. We observed similar rates of potential safety events, changes in quality-of-life scores, and ratings of overall care between the study arms. We did note that the cost advantage of an ED observation protocol was attenuated at 30-days, and this finding may potentially be related to subsequent hospital visits that were unrelated to the index visit for syncope. Our findings suggest that a structured observation protocol, based in the emergency department, is a safe and a cost-saving alternative to hospital inpatient admission for the evaluation of intermediate-risk syncope.
Several European studies suggest that structured decision pathways and specialized diagnostic units may safely reduce resource use in the evaluation of syncope.8,9 However, these studies were not randomized and the findings of benefit have not been uniform.10,11 There previously has been a single randomized trial (n=103) of an ED based syncope unit, performed at an academic center serving a predominantly white population.35 This prior trial reported a 55% absolute reduction in hospital admissions and a 54% relative reduction in hospital bed-days. There were no significant differences in death or recurrent syncope at 2-year follow-up. Our study confirms and generalizes these previous findings to sites with diverse hospital and patient characteristics. We also assessed costs, non-fatal safety events, quality-of-life, and patient satisfaction which previously have not been studied. Our trial suggests that an ED observation protocol can be successfully implemented in a variety of practice settings with an existing emergency department observation unit.
Several mechanisms may explain our findings. The immediate availability of testing services and attending providers at all times of the day may have facilitated rapid decision-making in the observation group compared to the patients admitted to the inpatient setting. The study protocol is a structured pathway and may reduce variance in the diagnostic evaluation. Similar post-discharge event rates for both groups suggest that 12-24 hours of cardiac monitoring in an observation unit is safe; there may be diminishing diagnostic value in extending monitoring beyond 24 hours.54
In summary, we found that an ED-based observation protocol substantially reduced resource use at the index visit for intermediate-risk patients with syncope, without evidence of worse clinical, quality-of-life, or satisfaction outcomes. This protocol can easily be adapted for emergency departments with existing observation units and represents a cost-effective and safe alternative to routine inpatient admission. Future research should confirm our preliminary findings of safety in external cohorts and develop objective risk prediction instruments to identify a broader set of patients who may be eligible for observation unit care.
Supplementary Material
Acknowledgments
Grant Support:
This study was supported by National Institutes of Health (NIH) grant RC1 AG035664 (Dr. Sun). At the time of the study, Dr. Sun was supported by NIH/ NIA grants K12 AG001004, the UCLA Older Americans Independence Center P30-AG028748, and an American Geriatrics Society Dennis Jahnigen Career Development Award. Dr. Mangione's effort is supported in part by the UCLA Robert Wood Johnson Clinical Scholars Program and the U.S. Department of Veterans Affairs (Grant #67799). Dr. Mangione also receives support from the University of California, Los Angeles, Resource Centers for Minority Aging Research Center for Health Improvement of Minority Elderly (RCMAR/CHIME) under NIH/NIA Grant P30-AG021684, and from the NIH/NCATS UCLA CTSI Grant Number UL1TR000124.
The funding organizations had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript. The contents do not necessarily represent the official views of the National Institutes of Health.
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Conflicts of Interest: None
Author Contributions Statement
BCS and CMM designed the study. BCS obtained funding for this study. BCS, HM, SB, CB, LR, SOH, CLC, and AB were responsible for data collection, and BCS supervised the overall data collection process. HM were responsible for data management and cleaning. LL performed the data analysis. EK and RA developed and implemented the cost-model methodology. BCS drafted the manuscript. All authors contributed substantially to manuscript revisions. BCS takes responsibility for the paper as a whole. BCS, HM, and LL had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. All authors approved the final report for submission.
Trial Registration
ClinicalTrials.gov Identifier: NCT01003262
References
- 1.Sun BC, Emond JA, Camargo CA., Jr. Characteristics and admission patterns of patients presenting with syncope to u.s. Emergency departments, 1992-2000. Acad Emerg Med. 2004 Oct;11(10):1029–1034. doi: 10.1197/j.aem.2004.05.032. [DOI] [PubMed] [Google Scholar]
- 2.Sun BC, Emond JA, Camargo CA., Jr. Direct medical costs of syncope-related hospitalizations in the United States. Am J Cardiol. 2005 Mar 1;95(5):668–671. doi: 10.1016/j.amjcard.2004.11.013. [DOI] [PubMed] [Google Scholar]
- 3.Linzer M, Yang EH, Estes NA, 3rd, Wang P, Vorperian VR, Kapoor WN. Diagnosing syncope. Part 2: Unexplained syncope. Clinical Efficacy Assessment Project of the American College of Physicians. Ann Intern Med. 1997;127(1):76–86. doi: 10.7326/0003-4819-127-1-199707010-00014. [DOI] [PubMed] [Google Scholar]
- 4.Linzer M, Yang EH, Estes NA, 3rd, Wang P, Vorperian VR, Kapoor WN. Diagnosing syncope. Part 1: Value of history, physical examination, and electrocardiography. Clinical Efficacy Assessment Project of the American College of Physicians. Ann Intern Med. 1997;126(12):989–996. doi: 10.7326/0003-4819-126-12-199706150-00012. [DOI] [PubMed] [Google Scholar]
- 5.Strickberger SA, Benson DW, Biaggioni I, et al. AHA/ACCF Scientific Statement on the evaluation of syncope: from the American Heart Association Councils on Clinical Cardiology, Cardiovascular Nursing, Cardiovascular Disease in the Young, and Stroke, and the Quality of Care and Outcomes Research Interdisciplinary Working Group; and the American College of Cardiology Foundation: in collaboration with the Heart Rhythm Society: endorsed by the American Autonomic Society. Circulation. 2006 Jan 17;113(2):316–327. doi: 10.1161/CIRCULATIONAHA.105.170274. [DOI] [PubMed] [Google Scholar]
- 6.Huff JS, Decker WW, Quinn JV, et al. linical policy: critical issues in the evaluation and management of adult patients presenting to the emergency department with syncope. Ann Emerg Med. 2007 Apr;49(4):431–444. doi: 10.1016/j.annemergmed.2007.02.001. [DOI] [PubMed] [Google Scholar]
- 7.Moya A, Sutton R, Ammirati F, et al. Guidelines for the diagnosis and management of syncope (version 2009): The Task Force for the Diagnosis and Management of Syncope of the European Society of Cardiology (ESC) Eur Heart J. 2009 Aug 27; doi: 10.1093/eurheartj/ehp298. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Brignole M, Disertori M, Menozzi C, et al. Management of syncope referred urgently to general hospitals with and without syncope units. Europace. 2003 Jul;5(3):293–298. doi: 10.1016/s1099-5129(03)00047-3. [DOI] [PubMed] [Google Scholar]
- 9.Brignole M, Ungar A, Bartoletti A, et al. Standardized-care pathway vs. usual management of syncope patients presenting as emergencies at general hospitals. Europace. 2006 Aug;8(8):644–650. doi: 10.1093/europace/eul071. [DOI] [PubMed] [Google Scholar]
- 10.Del Greco M, Cozzio S, Scillieri M, Caprari F, Scivales A, Disertori M. Diagnostic pathway of syncope and analysis of the impact of guidelines in a district general hospital. The ECSIT study (epidemiology and costs of syncope in Trento) Ital Heart J. 2003 Feb;4(2):99–106. [PubMed] [Google Scholar]
- 11.McCarthy F, McMahon CG, Geary U, Plunkett PK, Kenny RA, Cunningham CJ. Management of syncope in the Emergency Department: a single hospital observational case series based on the application of European Society of Cardiology Guidelines. Europace. 2009 Feb;11(2):216–224. doi: 10.1093/europace/eun323. [DOI] [PubMed] [Google Scholar]
- 12.Martin GJ, Adams SL, Martin HG, Mathews J, Zull D, Scanlon PJ. Prospective evaluation of syncope. Ann Emerg Med. 1984;13(7):499–504. doi: 10.1016/s0196-0644(84)80511-9. [DOI] [PubMed] [Google Scholar]
- 13.Sarasin FP, Hanusa BH, Perneger T, Louis-Simonet M, Rajeswaran A, Kapoor WN. A risk score to predict arrhythmias in patients with unexplained syncope. Acad Emerg Med. 2003 Dec;10(12):1312–1317. doi: 10.1111/j.1553-2712.2003.tb00003.x. [DOI] [PubMed] [Google Scholar]
- 14.Colivicchi F, Ammirati F, Melina D, Guido V, Imperoli G, Santini M. Development and prospective validation of a risk stratification system for patients with syncope in the emergency department: the OESIL risk score. Eur Heart J. 2003;24(9):811–819. doi: 10.1016/s0195-668x(02)00827-8. [DOI] [PubMed] [Google Scholar]
- 15.Quinn JV, Stiell IG, McDermott DA, Sellers KL, Kohn MA, Wells GA. Derivation of the San Francisco Syncope Rule to predict patients with short-term serious outcomes. Ann Emerg Med. 2004 Feb;43(2):224–232. doi: 10.1016/s0196-0644(03)00823-0. [DOI] [PubMed] [Google Scholar]
- 16.Del Rosso A, Ungar A, Maggi R, et al. Clinical predictors of cardiac syncope at initial evaluation in patients referred urgently to general hospital: the EGSYS score. Heart. 2008 Jun 2; doi: 10.1136/hrt.2008.143123. [DOI] [PubMed] [Google Scholar]
- 17.Costantino G, Perego F, Dipaola F, et al. Short- and long-term prognosis of syncope, risk factors, and role of hospital admission: results from the STePS (Short-Term Prognosis of Syncope) study. J Am Coll Cardiol. 2008 Jan 22;51(3):276–283. doi: 10.1016/j.jacc.2007.08.059. [DOI] [PubMed] [Google Scholar]
- 18.Reed MJ, Newby DE, Coull AJ, Prescott RJ, Jacques KG, Gray AJ. The ROSE (risk stratification of syncope in the emergency department) study. J Am Coll Cardiol. 2010 Feb 23;55(8):713–721. doi: 10.1016/j.jacc.2009.09.049. [DOI] [PubMed] [Google Scholar]
- 19.Benditt DG. Syncope Management Guidelines at work: first steps towards assessing clinical utility. Eur Heart J. 2006 Jan;27(1):7–9. doi: 10.1093/eurheartj/ehi626. [DOI] [PubMed] [Google Scholar]
- 20.Sun BC, Mangione CM, Merchant G, et al. 2007 Apr;49(4):420–427. doi: 10.1016/j.annemergmed.2006.11.012. 427 e421-424. [DOI] [PubMed] [Google Scholar]
- 21.Quinn J, McDermott D, Stiell I, Kohn M, Wells G. Prospective validation of the San Francisco Syncope Rule to predict patients with serious outcomes. Ann Emerg Med. 2006 May;47(5):448–454. doi: 10.1016/j.annemergmed.2005.11.019. [DOI] [PubMed] [Google Scholar]
- 22.Gallagher EJ. Hospitalization for fainting: high stakes, low yield. Ann Emerg Med. 1997;29(4):540–542. [PubMed] [Google Scholar]
- 23.Mendu ML, McAvay G, Lampert R, Stoehr J, Tinetti ME. Yield of diagnostic tests in evaluating syncopal episodes in older patients. Arch Intern Med. 2009 Jul 27;169(14):1299–1305. doi: 10.1001/archinternmed.2009.204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Crane SD. Risk stratification of patients with syncope in an accident and emergency department. Emerg Med J. 2002;19(1):23–27. doi: 10.1136/emj.19.1.23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Alshekhlee A, Shen WK, Mackall J, Chelimsky TC. Incidence and mortality rates of syncope in the United States. Am J Med. 2009 Feb;122(2):181–188. doi: 10.1016/j.amjmed.2008.08.024. [DOI] [PubMed] [Google Scholar]
- 26.Baron-Esquivias G, Martinez-Alday J, Martin A, et al. Epidemiological characteristics and diagnostic approach in patients admitted to the emergency room for transient loss of consciousness: Group for Syncope Study in the Emergency Room (GESINUR) study. Europace. 2010 Jun;12(6):869–876. doi: 10.1093/europace/euq018. [DOI] [PubMed] [Google Scholar]
- 27.Blanc JJ, L'Her C, Touiza A, Garo B, L'Her E, Mansourati J. Prospective evaluation and outcome of patients admitted for syncope over a 1 year period. Eur Heart J. 2002;23(10):815–820. doi: 10.1053/euhj.2001.2975. [DOI] [PubMed] [Google Scholar]
- 28.Casini-Raggi V, Bandinelli G, Lagi A. Vasovagal syncope in emergency room patients: analysis of a metropolitan area registry. Neuroepidemiology. 2002 Nov-Dec;21(6):287–291. doi: 10.1159/000065525. [DOI] [PubMed] [Google Scholar]
- 29.Kulakowski P, Lelonek M, Krynski T, et al. Prospective evaluation of diagnostic work-up in syncope patients: results of the PL-US registry. Europace. 2010 Feb;12(2):230–239. doi: 10.1093/europace/eup367. [DOI] [PubMed] [Google Scholar]
- 30.Pires LA, Ganji JR, Jarandila R, Steele R. Diagnostic patterns and temporal trends in the evaluation of adult patients hospitalized with syncope. Arch Intern Med. 2001 Aug 13-27;161(15):1889–1895. doi: 10.1001/archinte.161.15.1889. [DOI] [PubMed] [Google Scholar]
- 31.Schillinger M, Domanovits H, Mullner M, Herkner H, Laggner AN. Admission for syncope: evaluation, cost and prognosis. Wien Klin Wochenschr. 2000 Oct 13;112(19):835–841. [PubMed] [Google Scholar]
- 32.Shiyovich A, Munchak I, Zelingher J, Grosbard A, Katz A. Admission for syncope: evaluation, cost and prognosis according to etiology. Isr Med Assoc J. 2008 Feb;10(2):104–108. [PubMed] [Google Scholar]
- 33.Suzuki T, Matsunaga N, Kohsaka S. Diagnostic patterns in the evaluation of patients hospitalized with syncope. Pacing Clin Electrophysiol. 2006 Nov;29(11):1240–1244. doi: 10.1111/j.1540-8159.2006.00530.x. [DOI] [PubMed] [Google Scholar]
- 34.Association AH Exploring the impact of the RAC program on hospitals nationwide. 2012 http://www.aha.org/content/12/12Q1ractracresults.pdf. Accessed July 17, 2012.
- 35.Shen WK, Decker WW, Smars PA, et al. Syncope Evaluation in the Emergency Department Study (SEEDS): a multidisciplinary approach to syncope management. Circulation. 2004 Dec 14;110(24):3636–3645. doi: 10.1161/01.CIR.0000149236.92822.07. [DOI] [PubMed] [Google Scholar]
- 36.Wiler JL, Ross MA, Ginde AA. National study of emergency department observation services. Acad Emerg Med. 2011 Sep;18(9):959–965. doi: 10.1111/j.1553-2712.2011.01151.x. [DOI] [PubMed] [Google Scholar]
- 37.Brignole M, Alboni P, Benditt DG, et al. Guidelines on Management (Diagnosis and Treatment) of Syncope. Update 2004. Executive Summary. Rev Esp Cardiol. 2005 Feb;58(2):175–193. doi: 10.1157/13071892. [DOI] [PubMed] [Google Scholar]
- 38.Benditt DG, Can I. Initial evaluation of "syncope and collapse" the need for a risk stratification consensus. J Am Coll Cardiol. 2010 Feb 23;55(8):722–724. doi: 10.1016/j.jacc.2009.09.050. [DOI] [PubMed] [Google Scholar]
- 39.Kaplan RM, Ries AL, Reilly J, Mohsenifar Z. Measurement of health-related quality of life in the national emphysema treatment trial. Chest. 2004 Sep;126(3):781–789. doi: 10.1378/chest.126.3.781. [DOI] [PubMed] [Google Scholar]
- 40.Linzer M, Gold DT, Pontinen M, Divine GW, Felder A, Brooks WB. Recurrent syncope as a chronic disease: preliminary validation of a disease-specific measure of functional impairment. J Gen Intern Med. 1994 Apr;9(4):181–186. doi: 10.1007/BF02600121. [DOI] [PubMed] [Google Scholar]
- 41.van Dijk N, Boer KR, Wieling W, Linzer M, Sprangers MA. Reliability, validity and responsiveness of the syncope functional status questionnaire. J Gen Intern Med. 2007 Sep;22(9):1280–1285. doi: 10.1007/s11606-007-0266-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.CAHPS Hospital Survey 2013 http://www.hcahpsonline.org/home.aspx. Accessed February 21, 2013.
- 43.Sun BC, Derose SF, Liang LJ, et al. Predictors of 30-day serious events in older patients with syncope. Ann Emerg Med. 2009 Dec;54(6):769–778. doi: 10.1016/j.annemergmed.2009.07.027. e761-765. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Quinn J, McDermott D, Kramer N, et al. Death after emergency department visits for syncope: how common and can it be predicted? Ann Emerg Med. 2008 May;51(5):585–590. doi: 10.1016/j.annemergmed.2007.08.005. [DOI] [PubMed] [Google Scholar]
- 45.Chambers JD, Neumann PJ, Buxton MJ. Does Medicare have an implicit cost-effectiveness threshold? Med Decis Making. 2010 Jul-Aug;30(4):E14–27. doi: 10.1177/0272989X10371134. [DOI] [PubMed] [Google Scholar]
- 46.Lewis RJ. Are clinician-investigators Bayesian? Acad Emerg Med. 2001 Dec;8(12):1179–1181. doi: 10.1111/j.1553-2712.2001.tb01137.x. [DOI] [PubMed] [Google Scholar]
- 47.Piaggio G, Elbourne DR, Pocock SJ, Evans SJ, Altman DG. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA. 2012 Dec 26;308(24):2594–2604. doi: 10.1001/jama.2012.87802. [DOI] [PubMed] [Google Scholar]
- 48.Lunn DJ, Thomas A, Best N, Spiegelhalter D. WinBUGS - A Bayesian modelling famework: Concepts, structure, and extensibility. Statistics and Computing. 2000;10:325–327. [Google Scholar]
- 49.Quinn JV, Stiell IG, McDermott DA, Kohn MA, Wells GA. The San Francisco Syncope Rule vs physician judgment and decision making. Am J Emerg Med. 2005 Oct;23(6):782–786. doi: 10.1016/j.ajem.2004.11.009. [DOI] [PubMed] [Google Scholar]
- 50.Ross EA, Bellamy FB. Reducing patient financial liability for hospitalizations: the physician role. Journal of hospital medicine : an official publication of the Society of Hospital Medicine. 2010 Mar;5(3):160–162. doi: 10.1002/jhm.617. [DOI] [PubMed] [Google Scholar]
- 51.CMS Update to Medicare Deductible, Coinsurance, and Premium Rates for 2011. 2011 http://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/MLNMattersArticles/downloads/MM7224.pdf. Accessed July 19, 2013.
- 52.Sun BC, Emond JA, Camargo CA., Jr. Inconsistent electrocardiographic testing for syncope in United States emergency departments. Am J Cardiol. 2004 May 15;93(10):1306–1308. doi: 10.1016/j.amjcard.2004.02.021. [DOI] [PubMed] [Google Scholar]
- 53.Sun BC, Hoffman JR, Mangione CM, Mower WR. Older age predicts short-term, serious events after syncope. J Am Geriatr Soc. 2007 Jun;55(6):907–912. doi: 10.1111/j.1532-5415.2007.01188.x. [DOI] [PubMed] [Google Scholar]
- 54.Bass EB, Curtiss EI, Arena VC, et al. The duration of Holter monitoring in patients with syncope. Is 24 hours enough? Arch Intern Med. 1990 May;150(5):1073–1078. [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.



