Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2018 Apr 18.
Published in final edited form as: Acad Emerg Med. 2017 Mar 17;24(4):422–431. doi: 10.1111/acem.13140

Identification of Emergency Department Visits in Medicare Administrative Claims: Approaches and Implications

Arjun K Venkatesh 1, Hao Mei 1, Keith E Kocher 1, Michael Granovsky 1, Ziad Obermeyer 1, Erica S Spatz 1, Craig Rothenberg 1, Harlan M Krumholz 1, Zhenqui Lin 1
PMCID: PMC5905698  NIHMSID: NIHMS951193  PMID: 27864915

Abstract

Objectives

Administrative claims data sets are often used for emergency care research and policy investigations of healthcare resource utilization, acute care practices, and evaluation of quality improvement interventions. Despite the high profile of emergency department (ED) visits in analyses using administrative claims, little work has evaluated the degree to which existing definitions based on claims data accurately captures conventionally defined hospital-based ED services. We sought to construct an operational definition for ED visitation using a comprehensive Medicare data set and to compare this definition to existing operational definitions used by researchers and policymakers.

Methods

We examined four operational definitions of an ED visit commonly used by researchers and policymakers using a 20% sample of the 2012 Medicare Chronic Condition Warehouse (CCW) data set. The CCW data set included all Part A (hospital) and Part B (hospital outpatient, physician) claims for a nationally representative sample of continuously enrolled Medicare fee-for-services beneficiaries. Three definitions were based on published research or existing quality metrics including: 1) provider claims–based definition, 2) facility claims–based definition, and 3) CMS Research Data Assistance Center (ResDAC) definition. In addition, we developed a fourth operational definition (Yale definition) that sought to incorporate additional coding rules for identifying ED visits. We report levels of agreement and disagreement among the four definitions.

Results

Of 10,717,786 beneficiaries included in the sample data set, 22% had evidence of ED use during the study year under any of the ED visit definitions. The definition using provider claims identified a total of 4,199,148 ED visits, the facility definition 4,795,057 visits, the ResDAC definition 5,278,980 ED visits, and the Yale definition 5,192,235 ED visits. The Yale definition identified a statistically different (p < 0.05) collection of ED visits than all other definitions including 17% more ED visits than the provider definition and 2% fewer visits than the ResDAC definition. Differences in ED visitation counts between each definition occurred for several reasons including the inclusion of critical care or observation services in the ED, discrepancies between facility and provider billing regulations, and operational decisions of each definition.

Conclusion

Current operational definitions of ED visitation using administrative claims produce different estimates of ED visitation based on the underlying assumptions applied to billing data and data set availability. Future analyses using administrative claims data should seek to validate specific definitions and inform the development of a consistent, consensus ED visitation definitions to standardize research reporting and the interpretation of policy interventions.


Administrative claims data sets are often used by emergency care researchers and policymakers to define cohorts of patients for acute care research, and more commonly, such data sets are used outside of emergency medicine to define emergency department (ED) visits as an outcome for studies of healthcare resource utilization or evaluation of quality improvement interventions such as care coordination.15 Despite the high profile of ED visits in analyses using administrative claims, little work has sought to rigorously compare the degree to which estimates based on data created for billing purposes differ in describing the clinical construct of an ED visit in which a patient seeks acute, unscheduled care for undifferentiated clinical scenarios at a hospital-based ED.6 Previous publications and technical reports have often suggested definitions for an ED visit specific to the limitations of certain data sets with little supporting analyses to provide reassurance to clinicians or policymakers charged with interpreting research findings.7,8 As a result, variations in the definition of ED visitation may overcount ED visits by capturing nonhospital services or under-count ED visits by failing to capture ED visits cooccurring with critical care or observation.

Administrative claims of Medicare beneficiaries are the most frequently used data set for researchers as well as policymakers. An unstructured search of publications in the past 10 years revealed over 135 publications using Medicare data and over 1,500 publications using administrative claims data with mention of the “emergency department.” Similarly, ED visits are defined in the cohort or outcomes of 29 quality measures endorsed by the National Quality Forum that use administrative claims data. Given federal efforts at data transparency,9 statistics derived from Medicare administrative claims data are also used by public and private organizations seeking to advance policy agendas. Furthermore, recent consensus statements have also supported the increased use of administrative claims data for research in emergency care.10 However, complicating these efforts has been the consistency in how ED visits are operationally defined.

Therefore, we sought to compare four operational definitions for ED visitation using a comprehensive Medicare data set. We contrasted three established operational definitions used by policymakers and researchers with one we constructed based on emergency care expert opinion and clinician review that utilized all relevant data sources.

METHODS

Design and Data Set

We used a 20% random sample of the Medicare Chronic Condition Warehouse (CCW) data set.11 CMS draws the sample for the data set from all Medicare fee-for-service beneficiaries. This data set includes all Medicare claims for each included beneficiary between January 2012 and December 2012. The data set has undergone substantial “cleaning” to ensure that only final, adjudicated claims are included to increase reliability. The Medicare CCW data set is an ideal data source for this study because all Medicare Part A (inpatient hospital and skilled nursing) and Part B (hospital outpatient and physician) services are captured in the data set for each included beneficiary.

Definitions

For this analysis we compared four operational definitions of an ED visit. Three established definitions were identified based on a review of the peer-reviewed literature, federal government–authored research reports, and technical guidance available for national quality measures. One definition, the Yale definition, was developed to utilize these established definitions and additional expert review. All definitions are intended to identify hospital-based ED visits, consistent with the Institute of Medicine’s conceptual focus on hospital-based emergency care6 that is the current focus of most existing health services research and quality measures:

  1. Provider definition: Several researchers have used physician service, or “carrier,” claims to identify ED visits. Provider-defined ED visits are those with Part B claims for Healthcare Common Procedure Coding System (HCPCS) codes 99281, 99282, 99283, 99284, and 99285.1215

  2. Facility definition: hospital inpatient and outpatient facility claims are commonly used by researchers and by CMS to define ED visits.16,17 For this definition, we considered an ED visit presence of ED revenue center codes 0450–0459, 0981 in the hospital outpatient department or hospital inpatient department claims.

  3. ResDAC definition: The CMS Research Data Assistance Center (ResDAC) publishes guidance for researchers using Medicare administrative claims data. The most recent definition, published in July 2015, defines an ED visits as a hospital outpatient or inpatient claims with revenue center codes 0450–0459, 0981 or a hospital inpatient claim with an emergency room charge > $0.8,18

  4. Yale definition: Based on expert consensus and clinician review, we applied several modifications to existing definitions to construct a new operational definition for ED visits using administrative claims that reflects the current organization and delivery of acute care; we describe this approach below and in Figure 1.

Figure 1.

Figure 1

Yale emergency department visit definition derivation. 1Carrier claim lines with the same BENE_ID, LINE_1ST_EXPNS_DT, PRF_PHYSN_NPI, and TAX_NUM are considered duplicates from coding. 2Outpatient claim lines with the same BENE_ID, REV_CNTR, and PRVDR_NUM, and both HCPCS_1ST_MDFR_CD and HCPCS_2ND_MDFR_CD not equal to 25 or 27 are considered duplicates from coding. 3Only the first line in each inpatient claim is considered a real ED visit. The rest in the same claim are considered duplicates within hospitalization. HCPCS = Healthcare Common Procedure Coding System.

Approach to Development of the Yale Operational Definition for ED Visitation

To develop our Yale operational definition of an ED visit we first sought to capture all possible healthcare service use that could represent an ED visit. To do this we first included all physician service claims used for ED services (HCPCS 99281, 99282, 99283, 99284, 99285, 99291)19 and all hospital outpatient and inpatient claims that indicated use of ED services based on revenue center codes (0450–0459, 0981). As many claims included numerous “claim lines” for distinct healthcare services over broad ranges of time, we consider each individual claim line as a possible visit for this analysis.

For analyses of all definitions we first excluded all duplicate claims likely to reflect billing errors. To exclude duplicate facility claims, we considered hospital outpatient or inpatient facility claims conducted at the same hospital (defined by Medicare provider number) and by the same physician (defined by NPI number) on the same date without use of coding modifier 25 or 27, which indicate unique same-day ED visits, to be duplicate claims. To exclude duplicate provider claims, we considered all provider claims with identical ED location (based on hospital Medicare provider number), identical ED clinician (based on NPI number), and identical date of service to be duplicate claims.

Given that most ED visits include the creation of both a facility claim (hospital outpatient or hospital inpatient) as well as a provider claim we also sought to identify any overlapping claims reflecting the same ED visit. Currently, Medicare regulations for hospital facility care pay for ED services as “bundled” within the single Diagnosis-Related Group (DRG) payment set by the Inpatient Prospective Payment System for admitted patients or as an Ambulatory Payment Classification (APC) set by the Outpatient Prospective Payment System for patients not admitted to inpatient status. At the same time, Medicare pays for provider services in the ED based on HCPCS codes billed to Medicare separately by the provider. To avoid duplicate counting of overlapping claims, we first assumed that each provider claim was likely to represent a unique ED visit because billing guidelines for hospital outpatient visits carry greater ambiguity than provider claims with regards to the definition of emergency services.20 While one previous study similarly sought to combine facility and provider claims to define ED visitation, our approach allows for repeat ED visitation within 72 hours, which have been shown to be common and were excluded by prior work.2123 We therefore considered any hospital inpatient or outpatient claim for an ED visit on the same day, previous day, or following calendar day as an overlapping visit that should not be counted as a unique ED encounter (Table 1). Additionally, because providers or facilities claims may often include multiple ED visits on the same claim as a result of the claim adjudication and reporting processes, the number of ED visits captured by each definition can exceed the total number of claims.

Table 1.

Analysis of Related Facility and Provider ED Visit Claims

Provider Claims

−4 Days −3 Days −2 Days −1 Day Same Day +1 day +2 days +3 days +4 days Total*
Facility claims
 Hospital outpatient claims 86,357 (2.02%) 85,037 (1.99%) 101,619 (2.37%) 129,158 (3.02%) 3,661,726 (85.52%) 141,716 (3.31%) 89,980 (2.10%) 76,601 (1.79%) 72,340 (1.69%) 4,281,511
 Hospital inpatient claims 11,697 (0.81%) 13,512 (0.94%) 12,008 (0.84%) 17,759 (1.24%) 1,106,846 (77.12%) 176,158 (12.27%) 40,916 (2.85%) 24,429 (1.70%) 19,457 (1.36%) 1,435,253
 Facility (hospital outpatient or inpatient) claims 98,054 (1.72%) 98,549 (1.72%) 113,627 (1.99%) 146,917 (2.57%) 4,768,572 (83.41%) 317,874 (5.56%) 130,896 (2.29%) 101,030 (1.77%) 91,797 (1.61%) 5,716,764
Yale Definition Included as distinct ED visits Excluded for overlap with provider claims Included as distinct ED visits
*

Total numbers are numbers of ED visits after excluding duplicates from coding (for outpatient claims) and duplicates within hospitalization (for inpatient claims).

A total of 87.63% facility claims are excluded as overlap with provider claims.

To select only those claims likely to represent traditional ED care involving care by a physician or mid-level provider in a hospital-based ED open 24 hours a day 7 days a week, we identified several clinical scenarios for further exclusion or inclusion:

  1. Use of critical care services outside the ED: As the acuity of patients evaluated in the ED has increased over the past decade, the billing of critical care services (HCPCS 99291) in the ED has also risen.20,24 Because current Medicare Part B guidelines do not allow for the duplicative billing of Critical Care Services and Evaluation and Management Services (HCPCS 99281–99285) in the ED, we excluded all provider claims for HCPCS 99291 in which the place of service was not the ED.

  2. Non-ED setting claims: We identified several types of professional provider claims and facility claims that may occur outside the ED setting but billed with similar codes such as services provided in physician offices, urgent care, and nursing facilities and at home. Current provider and facility claims include “place of service” designations that differentiate between these settings and the ED.25 While these codes are not sensitive, they are quite specific; therefore, we excluded any provider claims with place of service outside the ED (place of service = 23; Data Supplement S1, available as supporting information in the online version of this paper).

  3. Observation admissions: The majority of observation services are provided by ED-managed observation units and current Part B payment regulation do not allow for physicians of the same tax identification number (TIN) or medical specialty to provide evaluation and management services for both an ED visit and admission to observation.2628 Therefore, use of ED provider claims may not capture all ED visits resulting in observation. We defined any visit resulting in hospital observation service use (outpatient revenue center 0762 or outpatient revenue center 0760 and HCPCS G0378) in which a hospital revenue center code for ED services is also present (0450–0459, 0981) as evidence of an ED visit.20,30

While these clinical scenarios are not currently specified within existing operational definitions, ED visits captured or excluded by these scenarios are variably captured by each existing provider, facility, and ResDAC operational definitions based solely on select billing criteria.

Analysis

We present descriptive statistics for each definition and compare our novel definition of an ED visit to existing definitions using 2 × 2 tables of agreement. We report McNemar’s test to assess statistical agreement between our definition and each operational definition. To account for multiple statistical comparisons we utilize the conservative Bonferroni correction with subsequent alpha = 0.0125. As a secondary analysis, we also tested the sensitivity of the Yale definition to provider claim date of service accuracy by re-creating each 2 × 2 table of agreement assuming that a provider claim ±2 days or ±3 days from a facility claim represented a matched ED visits.

RESULTS

A total of 10,717,786 beneficiaries were included in the 2012 Medicare CCW 20% sample data set representing care for over 50 million Medicare fee-for-service beneficiaries across the United States. A description of the sample is seen in Table 2. A total of 2,356,226 beneficiaries (22%) had any evidence of ED use during the study year including 5,028,314 claims.

Table 2.

Study Sample, the 20% Sample of 2012 Medicare CCW*

Characteristic Beneficiaries
Age (y), mean (±SD) 71.17 (±12.33)
 <65 1,791,260 (16.71%)
 65–80 6,670,499 (62.24%)
 >80 2,256,027 (21.05%)
Sex, % female 5,856,410 (54.64%)
Race, % white 8,763,178 (81.76%)
ED visit 2,356,226 (21.98%)
Observation admission 319,671 (2.98%)
Inpatient hospitalization 1,339,091 (12.49%)
SNF service utilization 384,312 (3.58%)
Hospice service utilization 255,982 (2.39%)

CCW = Chronic Condition Warehouse; SNF = skilled nursing facility.

*

The study sample included a total of 10,717,786 beneficiaries

The provider claims–based definition identified a total of 4,199,148 ED visits, the facility claims–based definition 4,795,057 visits, the ResDAC definition 5,278,980 visits, and the Yale definition 5,192,235 ED visits (Figure 1 and Table 3). The Yale definition was statistically different (p < 0.05) from all other definitions (Table 3 and Figure 2). Of note, we did not identify any ED visit claims with revenue center codes 0453, 0454, 0455, 0457, or 0458 in our data set as these revenue center codes are reserved for ED billing use but are not currently used and therefore did not result in the identification of any ED visits under any definition.

Table 3.

Agreement Between Each ED Visit Definition

Yale Definition + Total
Provider claim definition*
+ 4,197,848 (74.93%) 994,387 (17.75%) 5,192,235 (92.68%)
1,300 (0.02%) 408,921 (7.30%) 410,221 (7.32%)
Total 4,199,148 (74.95%) 1,403,308 (25.05%) 5,602,456
Facility claim definition
+ 4,795,057 (85.59%) 397,178 (7.09%) 5,192,235 (92.68%)
0 (0.00%) 410,221 (7.32%) 410,221 (7.32%)
Total 4,795,057 (85.59%) 807,399 (14.41%) 5,602,456
ResDAC definition
+ 4,870,034 (86.93%) 322,201 (5.75%) 5,192,235 (92.68%)
408,946 (7.30%) 1,275 (0.02%) 410,221 (7.32%)
Total 5,278,980 (94.23%) 323,476 (5.77%) 5,602,456
*

Provider claim definition = HCPCS Codes 99281–99285.

Facility definition = Revenue Center Codes 0450–0549, 0981.

ResDAC Definition = outpatient files, Revenue Center Codes 0450–0549, 0981; inpatient files, Revenue Center Codes 0450–0459, 0981; inpatient MedPAR: emergency room charge amount > $0.

Figure 2.

Figure 2

Emergency department visit frequency based on administrative claims definition. ResDAC = CMS Research Data Assistance Center. [Color figure can be viewed at wileyonlinelibrary.com]

While no single difference between each administrative claims definition can explain observed differences in ED visit estimates, several of the clinical scenarios resulted in notable differences in the capture of ED visits. For example, inclusion of HCPCS 99291 in the operational definition to capture critical care services performed in the ED resulted in 293,083 ED visits not captured by traditional provider claims HCPCS definitions. Also, the use of facility claims for outpatient observation services captured 40,744 claims, not otherwise captured by previously used provider- and facility-based definitions. A qualitative description of various clinical and billing scenarios that may explain differences between each definition is presented in Table 4.

Table 4.

Clinical and Billing Scenario Differences Between ED Visit Operational Definitions

Scenario ED Visit Definition*

Provider Facility ResDAC Yale
ED visits in which critical care codes are used to bill for ED professional services X X X
Visits for which an accompanying professional fee E&M claim is not permitted under billing regulations X X X
 ED visit isolated to a single surgical procedure (i.e., uncomplicated laceration repair) V X X X
 ED visits for minor procedural follow-up considered part of global surgical package (i.e., epistaxis packing removal, suture removal) X X X
Emergency triage services delivered as part of an advanced treatment protocol such as an EKG X
ED visits preceding observation stays in which E&M services are provided by the same emergency medicine group X X X
Outpatient hospital visits labeled as “emergency services” that occur outside the ED on an unscheduled basis such as hemodialysis or infusion services O O
ED visit in which a primary care clinician evaluates a patient in the ED without emergency clinician evaluation V X X X
Brief ED triage evaluation, such as a patient in active labor, without emergency clinician professional services X V X

E&M = Evaluation and Management.

*

X = likely ED visit identified by definition; O = likely not an ED visit identified by definition; V = variably identified by definition; empty cell = no ED visit identified by definition.

Sensitivity analyses allowing for broader date of service matching between provider and facility claims demonstrated minimal changes to Yale definition ED visit estimates. Allowing for a 2-day window for matching reduced the total number of ED visits identified by 38,123 (0.73%) while allowing for a 3-day matching window reduced the total number of ED visits identified by 56,833 (1.1%), and all comparisons remained statistically difference (Data Supplements S2a and S2b, available as supporting information in the online version of this paper).

DISCUSSION

Using all relevant sources of administrative claims for Medicare beneficiaries, we found marked differences in estimates of ED visitation between four operational definitions. Operational definitions utilizing all relevant provider- and facility-based data sources capture more ED visits than definitions limited to narrower provider- or facility-specific data sets. Furthermore, our application of clinical review to generate a new operational definition of ED visitation further identified ED visits not captured by previous definitions. These definitional differences underscore the importance of developing and validating consistent, consensus-based definitions of ED visitation for researchers and policymakers.

This work provides several points of guidance to researchers seeking to use administrative claims data for emergency care research. First, use of provider claims without facility claims may identify substantially fewer ED visits. Primarily, traditionally applied provider definitions include the five primary Evaluation and Management (E&M) billing codes (9928x) used by emergency physicians and in turn fail to capture the increasing use of critical care billing codes for ED professional services. Less commonly, there may be scenarios in which ED services are used for suture or packing removal (following either epistaxis or abscess drainage) that would not be billable by a physician but likely by a facility. Also, some triage only services may have been billable by facilities but not in physicians in 2012, although this practice is no longer permitted. For example, if emergency triage services are delivered as part of an advanced treatment protocol such as an EKG then a facility may produce a chargeable event without an associated emergency physician charge.31

Second, we found that definitions of ED visits that rely on facility claims, including the ResDAC definition, do not capture a potentially meaningful proportion of ED visits in comparison to the operational definition that includes provider claims. This may be the result of a number of potential clinical scenarios involving the ED. For example, there are situations in which an accompanying professional fee E&M claim is not permitted under billing regulations. Such scenarios include ED-operated observation units in which E&M provider claims are not permitted for the initial emergency services will not be identified by the facility definition. In addition, the use of non–ED-specific critical care HCPCS codes by emergency clinicians may not be captured by either the facility or the ResDAC definitions. Also, these facility-based definitions may overcount the number of ED visits by capturing outpatient hospital services labeled as “emergency services” but actually occurring outside the ED on an unscheduled basis such as hemodialysis or infusion services.32 In addition, facility-based definitions may capture ED visits not captured by the traditional provider definition under exceptional circumstances when a primary care doctor or specialty physician evaluates a patient in the ED without emergency clinician evaluation or when a patient is briefly evaluated in ED triage, such as a patient in active labor, but rapidly moved to another part of the facility for which services are billed instead of emergency services. Conversely, the Yale definition’s use of provider claims in addition to facility claims could estimate a higher number of ED visits than the facility and ResDAC definitions if the matching based on the date of service between the provider and facility files creates inaccuracies. Our approach sought to limit this by setting a ±1-day data range resulting in 92% of facility claims overlapping a provider claim and being considered one ED visit. Our sensitivity analyses confirmed that this assumption did not materially impact results as using a less restrictive overlap of ±2 or ±3 days.

Interestingly, the ResDAC definition’s higher estimate of ED visitation as a result of including some potentially non-ED facility claims was offset by the lower estimation of other ED visits captured in provider claims. The comparable total ED visit count between the ResDAC and Yale definition should not be interpreted as evidence of agreement, or even similarity, but rather as coincidental to various assumptions applied to the data. Furthermore, given variation in coding practices both between and within facilities, it is unlikely that analyses of ED visits for a given clinical condition, geography, or hospital would be similar between the ResDAC and Yale definition as a result of this balancing effect.

Given these differences between facility and provider claims, researchers interesting in studying ED utilization should utilize more comprehensive data sets to improve epidemiologic accuracy and build the foundation for a future consensus definition. As more comprehensive data sets, including all-payer claims databases that include both facility and provider claims from numerous payers, become increasingly available researchers should develop algorithms that better match actual emergency care billing patterns to ensure the validity of findings.

In addition to improving the reporting, specification, and rationale of operational definitions using administrative claims, future work should seek to develop a consistent, common definition for emergency care. The inherent variability in not only the organization of emergency care services, but more importantly the billing and coding of these services, is likely inevitable and necessitates a consensus definition. Previous work in other specialties such as cardiology and infectious diseases have dedicated substantial attention and resources to developing administrative claims–based definitions for clinical entities such as acute myocardial infarction and pneumonia, yet little work has dedicated such attention to health service concept such as ED visitation or intensive care unit services to support national epidemiologic studies and the development of quality measures.3,34 Consistent definitions specific to each data set are also important for the measurement of healthcare services that are not clinically defined as prior work has shown marked differences in hospital readmission measurement based on the data source or administrative claims definition used.3537 The development of consistent definitions would also permit researchers to conduct meta-analyses and permit policymakers to compare results of studies conducted in disparate states or geographies. Future efforts such as the Society of Academic Emergency Medicine Consensus Conference could be used to establish consensus definitions for acute care researchers.10

For policymakers seeking to develop metrics of ED utilization the use of a consistent and valid ED visit definition is critical to understanding the scope of quality measures, the actual effects of interventions, and the degree to which subsequent policy changes are necessary. Recent work assessing the validity of hospital-level measures of acute myocardial infarction mortality has shown that attribution based on ED visitation can substantially impact reported hospital mortality scores based on Medicare administrative claims;38 as such, ensuring that the underlying ED visit is accurately identified is paramount to the credibility of national quality programs.

The development of a single consensus definition of an ED visit within administrative claims would be ideal; however, the sustainability of such a definition will be challenging as billing and coding practices change. Therefore, due to current limitations in data availability, several consistent, consensus definitions may be desirable to support research objectives or policy purposes that require narrower or broader interpretations of emergency care. As CMS payment policy in conjunction with healthcare delivery system changes result in evolving hospital and provider billing practices, users of administrative claims data will need to continually apply clinical reasoning to capture elements of acute care that may not always be considered a traditional ED visit such as hospital-based urgent care, freestanding ED care, or select urgent procedures. Regardless of the clinical nuances of individual studies, however, the use of a consistent base definition is essential to ensuring the validity of emergency care research.

LIMITATIONS

Several limitations of this work warrant mention. First, there is no criterion standard definition for an ED visit in administrative claims; therefore, we cannot conclude that the operational definition developed is more or less accurate than alternative definitions. More detailed review would require comparison with chart abstracted data; however, that is likely to be too resource-intensive to be conducted and further amplifies the need for investigations such as this. Second, our study was conducted on a Medicare data set, which may limit the translation of the Yale definition to other commonly used administrate claims data sets with more constrained data, such as the State Emergency Department Databases (SEDD) and State Inpatient Department Databases (SIDD) assembled by the Agency for Healthcare Research and Quality Healthcare Cost and Utilization Project (HCUP), in which only hospital facility claims are available. Regardless, the derivation principles outlined in this work are likely generalizable and provide guidance to both future analyses as well as users of the data. Third, because our study utilized Medicare administrative claims in which facilities and provider groups, identified by CMS certification number (CCN) or TIN may only bill CMS for services once per day, interfacility transfers within the same CCN or TIN may not capture both ED visits in any of the four definitions. Finally, our definition of an ED visit is based in a conceptual model seeking to identify hospital-based emergency care, which may not capture newer forms of emergency care such as some of the care delivered in freestanding EDs or urgent care centers for which services are billed as physician office visits and not as emergency services.

CONCLUSIONS

Operational definitions of ED visitation used for administrative claims–based research and policy widely differ based on underlying assumptions of billing data and data set availability. The use of a comprehensive operational definition that incorporates all relevant data sources as well as expert clinical review generates different estimates of ED visitation than operational definitions traditionally used by researchers and policymakers. Future analyses using administrative claims data should seek to validate specific definitions and inform the development of a consensus ED visitation definition to standardize research reporting and support health policy evaluation.

Supplementary Material

(a) Agreement between each ED visit definition (±2 day); (b) agreement between each ED visit definition (±3 day). Data Supplement S1.

Frequency of place of service codes by ED HCPCS coding.

Frequency of place of service codes by ED HCPCS coding. Data Supplement S2.

(a) Agreement between each ED visit definition (±2 day); (b) agreement between each ED visit definition (±3 day).

Acknowledgments

We thank Julia Eichenfeld for her dedicated support as research assistants to this work.

Footnotes

The authors have no relevant financial information or potential conflicts to disclose.

Supporting Information

The following supporting information is available in the online version of this paper

References

  • 1.Iezzoni LI. Assessing quality using administrative data. Ann Intern Med. 1997;127:666–74. doi: 10.7326/0003-4819-127-8_part_2-199710151-00048. [DOI] [PubMed] [Google Scholar]
  • 2.Hirshon JM, Warner M, Irvin CB, et al. Research using emergency department-related data sets: current status and future directions. Acad Emerg Med. 2009;16:1103–9. doi: 10.1111/j.1553-2712.2009.00554.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Taubman SL, Allen HL, Wright BJ, Baicker K, Finkelstein AN. Medicaid increases emergency-department use: evidence from Oregon’s Health Insurance Experiment. Science. 2014;343:263–8. doi: 10.1126/science.1246183. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Joynt KE, Gawande AA, Orav E, Jha AK. Contribution of preventable acute care spending to total spending for high-cost Medicare patients. JAMA. 2013;309:2572–8. doi: 10.1001/jama.2013.7103. [DOI] [PubMed] [Google Scholar]
  • 5.Friedberg MW, Schneider EC, Rosenthal MB, Volpp KG, Werner RM. Association between participation in a multi-payer medical home intervention and changes in quality, utilization, and costs of care. JAMA. 2014;311:815–25. doi: 10.1001/jama.2014.353. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Hospital-Based Emergency Care. At the Breaking Point. Washington, DC: Institute of Medicine; 2007. [Google Scholar]
  • 7.Introduction to the HCUP State Emergency Department Databases (SEDD) Healthcare Cost and Utilization Project (HCUP) Agency for Healthcare Research and Quality; 2016. [Accessed February 23, 2017]. Available at: www.hcup-us.ahrq.gov/db/state/sedddist/SEDD_Introduction.jsp. [Google Scholar]
  • 8.How to Identify Hospital Claims for Emergency Room Visits in the Medicare Claims Data. Research Data Assistance Center; 2015. [Accessed February 23, 2017]. Available at: http://www.resdac.org/resconnect/articles/144. [Google Scholar]
  • 9.Tavenner M, Niall B. CMS Progress Towards Greater Data Transparency. Health Affairs Blog. 2013 Jul 31; [Google Scholar]
  • 10.Kuehl DR, Berdahl CT, Jackson TD, et al. Advancing the use of administrative data for emergency department diagnostic imaging research. Acad Emerg Med. 2015;22:1417–26. doi: 10.1111/acem.12827. [DOI] [PubMed] [Google Scholar]
  • 11.Chronic Conditions Data Warehouse. Center for Medicare and Medicaid Services; 2016. [Accessed January 23, 2017]. Available at: https://www.ccwdata.org/web/guest/home. [Google Scholar]
  • 12.Duszak R, Jr, Allen B, Jr, Hughes DR, et al. Emergency department CT of the abdomen and pelvis: preferential utilization in higher complexity patient encounters. J Am Coll Radiol. 2012;9:409–13. doi: 10.1016/j.jacr.2012.01.011. [DOI] [PubMed] [Google Scholar]
  • 13.Studnicki J, Platonova EA, Fisher JW. Hospital-level variation in the percentage of admissions originating in the emergency department. Am J Emerg Med. 2012;30:1441–6. doi: 10.1016/j.ajem.2011.11.008. [DOI] [PubMed] [Google Scholar]
  • 14.Dudas RA, Monroe D, McColligan Borger M. Community pediatric hospitalists providing care in the emergency department: an analysis of physician productivity and financial performance. Pediatr Emerg Care. 2011;27:1099–103. doi: 10.1097/PEC.0b013e31823606f5. [DOI] [PubMed] [Google Scholar]
  • 15.Kaskie B, Obrizan M, Jones MP, et al. Older adults who persistently present to the emergency department with severe, non-severe, and indeterminate episode patterns. BMC Geriatr. 2011;11:65. doi: 10.1186/1471-2318-11-65. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Measure Methodology. Center for Medicare and Medicaid Services; 2016. [Accessed February 23, 2017]. Available at: https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/HospitalQualityInits/Measure-Methodology.html. [Google Scholar]
  • 17.Stuart M, Steinwachs D, Harlow J, Fox M. Ambulatory practice variation in Maryland: implications for Medicaid cost management. Health Care Financ Rev. 1990;(Spec. No):57–67. [PMC free article] [PubMed] [Google Scholar]
  • 18.Kocher KE, Nallamothu BK, Birkmeyer JD, Dimick JB. Emergency department visits after surgery are common for Medicare patients, suggesting opportunities to improve care. Health Aff (Millwood) 2013;32:1600–7. doi: 10.1377/hlthaff.2013.0067. [DOI] [PubMed] [Google Scholar]
  • 19.Wiler JL, Poirier RF, Farley H, Zirkin W, Griffey RT. Emergency severity index triage system correlation with emergency department evaluation and management billing codes and total professional charges. Acad Emerg Med. 2011;18:1161–6. doi: 10.1111/j.1553-2712.2011.01203.x. [DOI] [PubMed] [Google Scholar]
  • 20.ED Facility Level Coding Guidelines. American College of Emergency Physicians; 2011. [Accessed February 23, 2017]. Available at: https://www.acep.org/content.aspx?id=30428. [Google Scholar]
  • 21.Kaskie B, Obrizan M, Cook EA, et al. Defining emergency department episodes by severity and intensity: a 15-year study of Medicare beneficiaries. BMC Health Serv Res. 2010;10:1–13. doi: 10.1186/1472-6963-10-173. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Rising KL, Victor TW, Hollander JE, Carr BG. Patient returns to the emergency department: the time-to-return curve. Acad Emerg Med. 2014;21:864–71. doi: 10.1111/acem.12442. [DOI] [PubMed] [Google Scholar]
  • 23.Liu SW, Obermeyer Z, Chang Y, Shankar KN. Frequency of ED revisits and death among older adults after a fall. Am J Emerg Med. 2015;33:1012–8. doi: 10.1016/j.ajem.2015.04.023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Blakeman JR. The Business of Emergency Medicine: 2012 Emergency Medicine CPT Statistics: Medicare. Milwaukee, WI: American Academy of Emergency Medicine; 2012. [Google Scholar]
  • 25.Place of Service Codes for Professional Claims Database. Place of Service Code Set. 2015 [Google Scholar]
  • 26.Venkatesh AK, Geisler BP, Gibson Chambers JJ, Baugh CW, Bohan JS, Schuur JD. Use of observation care in US emergency departments, 2001 to 2008. PLoS One. 2011;6:e24326. doi: 10.1371/journal.pone.0024326. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Wiler JL, Ross MA, Ginde AA. National study of emergency department observation services. Acad Emerg Med. 2011;18:959–65. doi: 10.1111/j.1553-2712.2011.01151.x. [DOI] [PubMed] [Google Scholar]
  • 28.Observation - Physician Coding FAQ. American College of Emergency Physicians; 2016. [Accessed February 23, 2017]. Available at: http://www.acep.org/Clinical-Practice-Management/Observation-Physician-Coding-FAQ/ [Google Scholar]
  • 29.ICAHN IL Medicaid Hospital Rate Reform. Illinois Critical Access Hospital Network; [Accessed February 23, 2017]. 2014. Available at: http://www.icahn.org/files/Documents_and_Presentations/Jodie_Edmonds/ICAHN_webinar_051514.pdf. [Google Scholar]
  • 30.Medicare Claims Processing Manual. Baltimore, MD: Centers for Medicare & Medicaid Services; 2016. [Google Scholar]
  • 31.Can Hospitals Bill Medicare for the Lowest Level ER Visit for Patients Who Check into the ER and Are “triaged” through a Limited Evaluation by a Nurse but Leave the ER before Seeing a Physician? Centers for Medicare & Medicaid Services; [Accessed February 23, 2017]. Accessed at: https://questions.cms.gov/faq.php?id=5005&faqId=2297. [Google Scholar]
  • 32.Niedzwiecki M, Baicker K, Wilson M, Cutler DM, Obermeyer Z. Short-term outcomes for Medicare beneficiaries after low-acuity visits to emergency departments and clinics. Med Care. 2016;54:498–503. doi: 10.1097/MLR.0000000000000513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Krumholz HM, Wang Y, Mattera JA, et al. An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with an acute myocardial infarction. Circulation. 2006;113:1683–92. doi: 10.1161/CIRCULATIONAHA.105.611186. [DOI] [PubMed] [Google Scholar]
  • 34.Lindenauer PK, Normand SL, Drye EE, et al. Development, validation, and results of a measure of 30-day readmission following hospitalization for pneumonia. J Hosp Med. 2011;6:142–50. doi: 10.1002/jhm.890. [DOI] [PubMed] [Google Scholar]
  • 35.Hechenbleikner EM, Makary MA, Samarov DV, et al. Hospital readmission by method of data collection. J Am Coll Surg. 2013;216:1150–8. doi: 10.1016/j.jamcollsurg.2013.01.057. [DOI] [PubMed] [Google Scholar]
  • 36.Horwitz LI, Partovian C, Lin Z, et al. Development and use of an administrative claims measure for profiling hospital-wide performance on 30-day unplanned readmission. Ann Intern Med. 2014;161:S66–75. doi: 10.7326/M13-3000. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Garland A, Gershengorn HB, Marrie RA, Reider N, Wilcox ME. A practical, global perspective on using administrative data to conduct intensive care unit research. Ann Am Thorac Soc. 2015;12:1373–86. doi: 10.1513/AnnalsATS.201503-136FR. [DOI] [PubMed] [Google Scholar]
  • 38.Voss EA, Ma Q, Ryan PB. The impact of standardizing the definition of visits on the consistency of multi-database observational health research. BMC Med Res Methodol. 2015;15:13. doi: 10.1186/s12874-015-0001-6. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

(a) Agreement between each ED visit definition (±2 day); (b) agreement between each ED visit definition (±3 day). Data Supplement S1.

Frequency of place of service codes by ED HCPCS coding.

Frequency of place of service codes by ED HCPCS coding. Data Supplement S2.

(a) Agreement between each ED visit definition (±2 day); (b) agreement between each ED visit definition (±3 day).

RESOURCES