Key Points
Question
How much progress did US hospitals make toward building a nationally interoperable health system from 2014 to 2018, and was aligning financial incentives via alternative payment models associated with interoperability?
Findings
In this cohort study of 3928 US hospitals, progress in interoperability was slow, with fewer than half of hospitals reporting that they engaged in all 4 domains of interoperability by 2018. No evidence of an association between alternative payment model participation and interoperable data sharing was found.
Meaning
The results of this study suggest that building a nationally interoperable health care system remains a complex and challenging task that requires more than just alignment of financial incentives via voluntary payment reform programs.
Abstract
Importance
Interoperable patient data exchange across hospitals remains an important policy goal for reducing costs and improving the quality of care. Congress designated 2018 as the goal for nationwide interoperability, and policy makers hoped that aligning financial incentives via alternative payment models (APMs) would help achieve that goal.
Objective
To measure interoperability progress since 2014, assess the association between alternative payment model participation and hospital engagement in interoperable data sharing from 2014 to 2018, and evaluate hospital-reported barriers to interoperability in 2018.
Design, Setting, and Participants
This cohort study included nonfederal acute care hospitals in the US from January 2014 to December 2018 that responded to the American Hospital Association Annual Survey. Data were analyzed from October 2019 through March 2021.
Exposures
Participation in an APM, including accountable care organizations, bundled payments, or patient-centered medical homes.
Main Outcomes and Measures
Hospital engagement in all 4 domains of interoperability: finding/querying for data, sending data electronically, receiving data electronically, and integrating electronic patient data from external care delivery organizations.
Results
The sample included 3928 hospitals in the US from January 2014 to December 2018. Progress across interoperability domains was uneven, 2430 (88.3%) hospitals sending and 2115 (76.9%) receiving patient data electronically in 2018. However, only 1249 (45.4%) hospitals engaged in all 4 domains of interoperability in 2018, and growth between 2014 and 2018 was slow. There was no evidence that participation in APMs was associated with interoperability, with multivariate models suggesting that participation in an APM was associated with only a non–statistically significant 1–percentage point increase in interoperability engagement (β = 0.01; 95% CI, −0.01 to 0.03). The most commonly cited barrier to interoperability was challenges associated with sharing data across different electronic health record vendors.
Conclusions and Relevance
In this cohort study of hospital interoperability, fewer than half of US hospitals were engaged in interoperable data exchange in 2018. There was no observable evidence that hospital APM participation was associated with interoperability engagement. Many hospitals report technical and governance challenges to data sharing that are unlikely to be addressed by the alignment of financial incentives alone.
This cohort study examines interoperability progress, the association between alternative payment model participation and hospital engagement in interoperable data sharing, and hospital-reported barriers to interoperability.
Introduction
Following the passage of the US Health Information Technology for Economic and Clinical Health (HITECH) Act of 2009, substantial public and private effort has focused on increasing interoperable data exchange to provide clinicians access to relevant patient records at the point of care, regardless of where the records were originally created.1,2,3 The potential benefits of nationwide interoperability are substantial, including improved patient outcomes and reductions in unnecessary and duplicative care.4,5,6 However, early progress after HITECH was slow, and as of 2014, fewer than one-quarter of US hospitals were engaged in all 4 of the interoperability domains identified by the Office of the National Coordinator for Health Information Technology (ONC): electronically finding (querying), sending, receiving, and integrating information into electronic health records (EHRs).7,8,9 To spur greater interoperability progress, Congress in 2015 declared a “national objective to achieve widespread exchange of health information through interoperable certified EHR technology nationwide by December 31, 2018.”10
One policy mechanism by which Congress intended to achieve the goal of national interoperability by 2018 was via programs designed to better align financial incentives to encourage data sharing known as alternative payment models (APMs), as described in the US Medicare Access and Children's Health Insurance Program Reauthorization Act (MACRA) of 2015. While other efforts to encourage interoperability were also underway during this period, policy makers and researchers focused on these payment reform initiatives as some of the most promising potential drivers of interoperability.11 In contrast, health information technology (IT) provisions of the 21st Century Cures Act took a targeted approach by directly advancing technology, standards, and governance models with the aim of reducing the technical and administrative complexity of interoperability and addressing specific barriers, such as information blocking.
Assessing progress against the 2018 congressional objective could reveal the trajectory of interoperability and appropriateness of targeting lagging areas. Stronger incentives for data sharing were expected to arise from the spread of risk-bearing population-based and episode-based APMs,12,13 such as accountable care organizations (ACOs), patient-centered medical homes (PCMH), and bundled payments.14 While these models were designed to improve quality and reduce costs, they were expected to promote interoperability to achieve those goals.7,15
We sought to bring new evidence to assess progress in interoperability using the HITECH/MACRA policy framework. We used national hospital data to track interoperability progress from 2014 to 2018 and compare this progress between hospitals that participated in APMs and those that did not. We also assessed hospital-reported barriers to interoperability and compared differences in barriers between hospitals that did and did not participate in APMs. These analyses provide insights regarding the challenges to interoperability that need to be addressed in ongoing 21st Century Cures policy making.16
Methods
Data and Sample
We used data from 2014 to 2018 from the American Hospital Association (AHA) Annual Survey and IT Supplement to capture hospitals’ engagement in interoperability, participation in APMs, and other hospital characteristics.17 The surveys are sent annually to every hospital in the US with a request that the chief executive officer (or chief information officer for the IT supplement) complete the survey or delegate it to the most knowledgeable person. The 2018 IT Supplement survey collected data from January to May 2019 regarding hospital IT status at the end of 2018. The study used secondary data on organizations and was thus exempt from human participants research approvals. This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guidelines for all estimates reported.
To measure trends over time, we created a panel of hospitals that responded to the AHA IT Supplement at least once from 2014 to 2018. We limited the sample to nonfederal acute care hospitals, as those were subject to HITECH Act and considered eligible hospitals for the Meaningful Use and Promoting Interoperability programs. We matched these data to AHA Annual Survey data from 2014 to 2018 to capture characteristics, including the number of beds, ownership, teaching status, location, system membership, and participation in 3 payment reform programs. The sample comprised 3928 unique hospitals during a period of 5 years and a total of 13 883 hospital-year observations.
Measures
Interoperability Domains
We created 4 dichotomous measures to capture hospital engagement in each of the 4 domains of interoperability as defined by ONC. These functionality-based, technology-agnostic domains capture the core elements of interoperable data exchange required for clinical use in which care delivery organizations need to share information electronically,9 and the AHA IT Supplement began measuring these in 2014.
Sending and receiving information facilitates electronic data exchange for planned transitions of care, including discharges to an outpatient setting or referrals to another organization. Finding (querying) data, the ability to search or query for patient data from outside organizations, is a necessary capability for unplanned care transitions, such as emergency care.18,19 Integrating patient information is a critical capability that distinguishes interoperability from health information exchange; data from outside organizations can be integrated or incorporated into the EHR without manual effort.2,20 We defined these variables as consistent with previous studies and ONC standards.7,21 Full variable descriptions are available in eMethods 1 in the Supplement.
APM Participation
We created dichotomous measures of our treatment variable, participation in each of the 3 APMs, using questions from the AHA Annual Survey. The 3 alternative payment models we included were ACOs, PCMH, and bundled payments involving inpatient, physician, or post–acute care bundles. The ACO and PCMH data were available during each year from 2014 to 2018, while bundled payment data were available for 2015 to 2018. Hospitals that participated in 1 or more APMs in a year were considered an APM participant. Full variable descriptions are available in eMethods 2 in the Supplement.
Barriers to Interoperability
We measured barriers to interoperability in 2018 using the question “Which of the following issues has your hospital experienced when trying to electronically (not eFax) send, receive, or find (query) patient health information to/from other care settings or organizations?” with 12 possible barriers to select yes or no options. Hospitals that responded yes to any of the subquestions were considered as experiencing that barrier. We limited the sample to hospitals that reported engaging in all 4 domains of interoperability to minimize availability bias and conducted robustness tests with all hospitals, as well as hospitals that reported at least sending and receiving data.
Hospital Characteristics
We included several hospital characteristics based on previous studies of interoperability.7,22 These included level of EHR adoption (less than basic, basic EHR, or comprehensive EHR),23 membership in a regional health information exchange organization,24 size (by number of beds), teaching status, membership in a health care system, urban or rural location, and geographic region. We report descriptive statistics of these, as well as hospital EHR vendors, in eTable 1 in the Supplement.
Statistical Analysis
We calculated the proportion of hospitals that engaged in each of the 4 domains of interoperability, as well as all 4 domains, in each year from 2014 to 2018. We assessed progress in all 4 domains by hospital characteristics, comparing the first and last years (2014 and 2018). All measures used weights generated by an inverse probability model to account for nonresponse bias and create nationally representative estimates.25
To compare APM and non-APM hospitals, we calculated engagement in interoperability during each year by APM participation status, with χ2 tests for statistical significance. We created 2 ordinary least squares linear probability models, with the dependent variable as the dichotomous measure of whether a hospital engaged in all 4 domains of interoperability and the independent variable of interest as participation in any APM in the first model and each of the 3 APMs individually in the second model. Both models included hospital fixed effects to control for time-invariant omitted variables and year fixed effects to control for secular trends. Both models included controls for time-varying hospital characteristics, including EHR adoption level, health information organization participation, and system membership, as well as robust standard errors clustered at the hospital level. We conducted robustness tests and alternative specifications, including difference-in-differences models that used the Callaway and Sant’Anna estimator designed for varying treatment timing26 (eMethods 3 in the Supplement).
Finally, we compared the proportion of hospitals reporting each barrier to interoperability in 2018 for APM and non-APM hospitals using χ2 tests. All statistical tests used a 2-sided α of .05 for statistical significance. Analysis was performed from October 2019 through March 2021 using Stata, version 17 (StataCorp).
Results
Interoperability Progress
The AHA Annual Survey IT Supplement response rate for nonfederal acute care hospitals was 64% (n = 3540) for 2018. As of 2018, 1249 US hospitals (45.4%) engaged in all 4 domains of interoperability. The most widely adopted domain in 2018 was sending data (2430 hospitals [88.3%]), followed by receiving data (2115 [76.9%]), and finding data (1785 [64.9%]). Integrating data without manual intervention was the least commonly adopted domain, with 1702 hospitals (61.8%) reporting they had the capability to do so in 2018 (Figure 1).
The number of hospitals that reported that they engaged in all 4 domains of interoperability increased by 22.8 percentage points from 2014 when only 635 hospitals (22.6%) reported they were had all 4 capabilities. The most progress from 2014 to 2018 was in the integrate domain, with a 22.3 percentage point increase from 39.5% (n = 1110) in 2014. Receiving data had the next most progress with 21.9 percentage points, from 54.9% (n = 1544) in 2014, followed by finding data, with an 18.6 percentage point increase from 46.2% (n = 1299) in 2014. Sending data increased 11.2 percentage points, from 77.1% (n = 2166) of hospitals in 2014.
Comparing engagement in all 4 domains of interoperability from 2014 to 2018 by hospital characteristics, large hospitals made the most progress, with a 30.6 percentage point increase from 2014 to 2018 (P < .001). Teaching hospitals (28.7 percentage point increase), system hospitals (27.8 percentage points), and hospitals located in urban areas (27.5 percentage point increase) also made substantial progress. Hospitals with a basic EHR in the measure of EHR sophistication saw a 2.2 percentage point decrease in interoperability engagement (Figure 2).
Interoperability by APM Participation
In 2014, APM hospitals engaged in interoperability at a significantly higher level than non-APM hospitals (33.5% [n = 281] for APM hospitals and 17.6% [n = 320] for non-APM hospitals; P < .001). The APM hospitals saw a 21.9 percentage point increase up to 55.4% (n = 691) in 2018 (an average increase of 5.5 percentage points per year), while non-APM hospitals increased by 19.7 percentage points over time (an average increase of 4.9 percentage points per year) to reach 37.2% (n = 573) in 2018 (Figure 3).
In multivariate models with hospital and year fixed effects, we found no evidence that participation in an APM was associated with interoperability engagement, regardless of the independent variable as participation in any APM (β = 0.01; 95% CI, −0.01 to 0.03) or separately for PCMH (β = 0.01; 95% CI, −0.02 to 0.03), bundled payments (β = −0.01; 95% C, −0.04 to 0.02), and ACOs (β = 0.01; 95% CI, −0.01 to 0.04) (Table 1). Full model results, robustness checks with alternative estimators, and model designs and diagnostic tests are available in the eMethods 3 in the Supplement which found similar results.
Table 1. Association Between APM Participation and Hospital Engagement in Interoperability.
Dependent variable: hospital engagement in all 4 domains of interoperability | Coefficient (95% CI)a | P value |
---|---|---|
Model 1: any APM | ||
APM participation | 0.01 (−0.01 to 0.03) | .30 |
Basic EHR | 0.01 (−0.01 to 0.03) | .30 |
Comprehensive EHR | 0.08 (0.06 to 0.11) | <.001 |
RHIO participation | 0.12 (0.10 to 0.15) | <.001 |
Member of a health system | <0.01 (−0.05 to 0.05) | .92 |
Model 2: specific APMs | ||
Patient-centered medical home | 0.01 (−0.02 to 0.03) | .69 |
Bundled payment program | −0.01 (−0.04 to 0.02) | .45 |
Accountable care organization | 0.01 (−0.01 to 0.04) | .30 |
Basic EHR | 0.01 (−0.01 to 0.03) | .30 |
Comprehensive EHR | 0.08 (0.06 to 0.11) | <.001 |
RHIO participation | 0.12 (0.10 to 0.15) | <.001 |
Member of a health system | <0.01 (−0.05 to 0.05) | .94 |
Abbreviations: AHA, American Hospital Association; APM, alternative payment models; EHR, electronic health record; RHIO, regional health information exchange organization.
Analysis of AHA Annual Survey and IT Supplement data, 2014 to 2018. Models 1 and 2 are ordinary least squares linear probability models and include hospital and year fixed effects and robust standard errors clustered at the hospital level. Coefficients can be interpreted as percentage point changes in likelihood of interoperability.
Barriers to Interoperability
Several barriers were reported by at least half of hospitals, including experiencing greater challenges exchanging data across different vendor platforms (735 [80.8%]); providers (the survey instrument uses the term provider, which can be ambiguous as to whether the respondents were indicating an individual clinician or practice; a care delivery organization, such as a hospital or clinic; or both) with which the hospital shares patients not typically exchanging patient data with them (771 [72.5%]); providers with which the hospital would like to send patient information electronically having an EHR, but it lacks the technical capability to receive information (834 [66.4%]); and difficulty locating the address of the provider to send information (697 [55.4%]) (Table 2). We found several differences in the prevalence of reported barriers between APM and non-APM hospitals (Table 2). Hospitals participating in APMs were more likely to report difficulty locating a provider’s address to send the information (65.1% [n = 442] compared with 44.1% [n = 255] for non-APM; P < .001), that providers that they wanted to send data to did not have an EHR (55.5% [n = 376] vs 39.6% [n = 229] non-APM; P < .001), difficulty matching or identifying the correct patient between systems (54.0% [n = 308] vs 37.0% [n = 183] non-APM, P < .001); and many recipients of their electronic care summaries reporting that the information was not useful (43.8% [n = 297] vs 32.9% [n = 190] non-APM; P < .001). The APM hospitals were less likely to report that providers with which they share patients did not exchange data with them (66.3% [n = 378] compared with 79.6% [n = 393] for non-APM; P < .001) and that they had to develop customized interfaces to electronically exchange health information (34.4% [n = 201] vs 43.5% [n = 141] non-APM; P = .01). We also found that, controlling for observable hospital characteristics, APM hospitals reported more barriers than non-APM hospitals (eTable 2 in the Supplement). We found similar results when expanding to include all hospitals (eTable 3 in the Supplement) and hospitals that engaged in at least sending and receiving data (eTable 4 in the Supplement).
Table 2. Barriers to Interoperability Among APM and Non-APM Hospitals Among Hospitals Engaged in All 4 Domains of Interoperability in 2018.
Characteristic | No. (%)a | P value | ||
---|---|---|---|---|
All hospitals | Non-APM hospitals | APM hospitals | ||
APM hospitals more likely to report barrier | ||||
Difficult to locate the address of the providerb to send the information (eg, lack of provider directory) | 697 (55.4) | 255 (44.1) | 442 (65.1) | <.001 |
Providers we would like to electronically send patient health information to do not have an EHR or other electronic system with capability to receive the information | 605 (48.2) | 229 (39.6) | 376 (55.5) | <.001 |
Difficult to match or identify the correct patient between systems | 491 (46.1) | 183 (37.0) | 308 (54.0) | <.001 |
Many recipients of our electronic care summaries (eg, CCDA) report that the information is not useful | 487 (41.5) | 190 (32.9) | 297 (43.8) | <.001 |
APM hospitals less likely to report barrier | ||||
There are providers with which we share patients with that do not typically exchange patient data with us | 771 (72.5) | 393 (79.6) | 378 (66.3) | <.001 |
We had to develop customized interfaces to electronically exchange health information | 342 (37.6) | 141 (43.5) | 201 (34.4) | .01 |
APM and non-APM hospitals equally likely to report barrier | ||||
Experience greater challenges exchanging (eg, sending/receiving data) across different vendor platforms | 735 (80.8) | 261 (80.7) | 474 (80.9) | .58 |
Providers we would like to electronically send patient health information to have an EHR; however, they lack the technical capability to receive the information | 834 (66.4) | 390 (67.5) | 444 (65.5) | .99 |
We have to pay additional costs to send/receive data with care settings/organizations outside our system | 376 (38.7) | 132 (40.8) | 244 (41.8) | .82 |
Cumbersome workflow to send (not eFax) the information from our EHR system | 210 (16.7) | 95 (16.4) | 115 (17.0) | .62 |
No technical capability to electronically receive from outside providers | 66 (6.2) | 31 (6.2) | 35 (6.1) | .94 |
No technical capability to electronically send to outside providers | 32 (2.6) | 18 (3.2) | 14 (2.1) | .28 |
Abbreviations: AHA, American Hospital Association; APM, alternative payment model; CCDA, consolidated clinical document architecture; EHR, electronic health record.
Analysis of AHA Annual Survey and IT Supplement data, 2014 to 2018. Denominators can vary across questions, as nonrespondents were excluded and not all hospitals responded to every question.
The survey instrument uses the term provider, which can be ambiguous as to whether the respondents were indicating an individual clinician or practice; a care delivery organization, such as a hospital or clinic; or both. Future data collection efforts should make an effort to clarify this distinction.
Discussion
We measured interoperability progress from 2014 to 2018 and found that engagement was limited, with fewer than half of hospitals engaging in all 4 domains by 2018. Progress was slow, with engagement increasing at an average rate of 5.7 percentage points per year. Compared with EHR adoption, which rose quickly during the decade following the passage of the HITECH Act in 2009, at the current rate, it will take until 2027 to achieve nationwide engagement in all 4 domains of interoperability, which is 18 years after the passage of HITECH. The policy efforts in the HITECH/MACRA era, from technical requirements in EHR certification to payment incentives in APMs, did not deliver on the goal of national interoperability by 2018. Achieving widespread interoperability has proven to be a much more complex challenge compared with EHR adoption and requires a more comprehensive approach.
The results of this analysis of APMS suggest that they were not associated with more substantial increases in interoperability among participating hospitals. While APM hospitals had a higher level of interoperability compared with non-APM hospitals in 2014, engagement in all 4 domains of interoperability grew at a similar rate in APM and non-APM hospitals during the 5-year study period. Similarly, the 2-way fixed-effects regression model that controlled for time-invariant unobserved hospital characteristics found no association between participating in an APM and engagement in all 4 domains of interoperability.
There are several reasons why APM participation may not have been associated with interoperability engagement. It may be that the incentives are too weak, with an insufficient proportion of hospital revenue connected to these programs to justify new investment in interoperability. Given that most APM payment is based on fee-for-service programs, with only upside rewards rather than more aggressive downside risk arrangements, APM incentives may not be strong enough to change hospital behavior substantially.27 It may also be that the incentives are too diffuse; even if APM participation affects hospital decision-making, hospital leaders may choose to focus on reducing costs in other ways, such as reducing utilization or shifting referrals to lower-cost care facilities.28 Evidence on ACOs suggests that care coordination is unlikely to be significantly associated with savings, and ACO participants target areas of unnecessary care that are more within their control.29,30
Such challenges are underscored by our results associated with barriers to interoperability. The most common barriers were technical and governance issues, such as cross-vendor data sharing, exchange partners lacking the technical capacity to receive data, and clinician and patient matching. The differences between APM and non-APM hospitals highlight the specific limitations of the value-based payment approach: while APM hospitals were less likely to report exchange partners being unwilling to share data or charging for custom interfaces to do so, they were equally or more likely to report several of the technical and governance barriers, such as difficulties exchanging across different EHR vendors, and APM hospitals may encounter these barriers more often, as they have incentives to fill in information gaps for care coordination. This suggests that value-based payment models aligned financial incentives for sharing data, but technical barriers hampered interoperability progress.
Rulemaking following the 21st Century Cures Act31 provides a framework for the next generation of interoperability that may address some of these barriers. This includes setting standards for application programming interface (API) implementation by EHR vendors, which can reduce the technical complexity of exchange between clinicians as API-based queries can be standardized across exchange partners. Advancing certified EHRs to include standard-based APIs may address other commonly cited barriers, such as difficulties with cross-vendor exchange.32 Another effort to simplify the exchange outlined in the Cures Act is the Trusted Exchange Framework and Common Agreement. It seeks to enable exchange of patient health information across health information networks, reducing the need to participate in multiple networks to exchange with trading partners that may participate in different networks. The regulations also prohibit information blocking by EHR vendors and care delivery organizations, which is the practice of preventing interoperability for reasons such as not sharing data with market competitors, which may address the issue of care delivery organizations choosing to not share patient data, a barrier cited by more than 70% of hospitals in this study. This prescriptive approach also contrasts with the HITECH Act, which focused on primarily on EHR adoption rather than requiring data exchange across those EHRs, and it is critical to measure interoperability progress and evaluate the effectiveness of these new policies that more directly target the technological barriers and mandate sharing of structured data elements.33
Limitations
Our work should be interpreted with several limitations in mind. First, we used self-reported survey data and were unable to verify the accuracy of responses, although the AHA Annual Survey and IT Supplement are widely used and have been previously validated against external sources.34 Second, there are multiple ways to measure interoperability, such as participation, breadth, and volume. We focused on 4 federally prioritized domains of interoperability, but were unable to observe variability in implementation and use. Future research should examine differences across exchange methods. For example, the process of integrating data into the EHR without manual intervention may be different between hospitals using different methods of data sharing. Similarly, there are dimensions of APM participation that our data were unable to capture, such as whether a hospital participated in a Medicare or commercial ACO and the specific bundled payment services. Third, while we use a 2-way fixed-effects model to control for time-invariant omitted variable bias, time-varying confounders may have biased our results. We tested for these to the extent possible using measures described in eMethods 3 in the Supplement. Therefore, we were unable to fully establish either the size or directionality of a causal effect. Fourth, it is possible that our 2-way fixed-effects model is not appropriately powered to detect an association of APM participation with interoperability, resulting in a bias toward the null result. However, given that we found significant associations between other time-varying hospital characteristics, if APMs had an effect not detected in our model, it would be so small that it would not serve as an effective policy mechanism to incentivize interoperability. Finally, our specific analysis focuses on evaluating the association of APM participation with interoperability, and while the results inform speculation regarding other factors that may be associated with interoperability, the study design did not allow an in-depth analysis. Previous work has explored how these characteristics are associated with interoperability,7,21,35,36,37 and future research should continue to study how EHR vendor, size, teaching status, or location affect hospital engagement in interoperability.
Conclusions
In this cohort study of hospital interoperability, we found fewer than half of hospitals were engaged in all 4 domains of interoperability in 2018. Interoperability progress was slow; if progress continued at the same rate, it would take until 2027 to achieve nationwide interoperability. We found no evidence that APM participation was associated with interoperable data sharing. The new framework to encourage data sharing through the 21st Century Cures Act may address remaining barriers to interoperability, such as technical challenges and issues with data governance.
References
- 1.Blumenthal D. Launching HITECH. N Engl J Med. 2010;362(5):382-385. doi: 10.1056/NEJMp0912825 [DOI] [PubMed] [Google Scholar]
- 2.Holmgren AJ, Adler-Milstein J. Health information exchange in US hospitals: the current landscape and a path to improved information sharing. J Hosp Med. 2017;12(3):193-198. doi: 10.12788/jhm.2704 [DOI] [PubMed] [Google Scholar]
- 3.DeSalvo KB, Dinkler AN, Stevens L. The US Office of the National Coordinator for Health Information Technology: progress and promise for the future at the 10-year mark. Ann Emerg Med. 2015;66(5):507-510. doi: 10.1016/j.annemergmed.2015.03.032 [DOI] [PubMed] [Google Scholar]
- 4.Walker J, Pan E, Johnston D, Adler-Milstein J, Bates DW, Middleton B. The value of health care information exchange and interoperability. Accessed May 2, 2021. [DOI] [PubMed]
- 5.Zhou Y, Ancker JS, Upadhye M, et al. The impact of interoperability of electronic health records on ambulatory physician practices: a discrete-event simulation study. Inform Prim Care. 2013;21(1):21-29. doi: 10.14236/jhi.v21i1.36 [DOI] [PubMed] [Google Scholar]
- 6.Chen M, Guo S, Tan X. Does health information exchange improve patient outcomes? empirical evidence from Florida hospitals. Health Aff (Millwood). 2019;38(2):197-204. doi: 10.1377/hlthaff.2018.05447 [DOI] [PubMed] [Google Scholar]
- 7.Holmgren AJ, Patel V, Adler-Milstein J. Progress in interoperability: measuring US hospitals’ engagement in sharing patient data. Health Aff (Millwood). 2017;36(10):1820-1827. doi: 10.1377/hlthaff.2017.0546 [DOI] [PubMed] [Google Scholar]
- 8.Holmgren AJ, Patel V, Charles D, Adler-Milstein J. US hospital engagement in core domains of interoperability. Am J Manag Care. 2016;22(12):e395-e402. [PubMed] [Google Scholar]
- 9.Office of the National Coordinator for Health Information Technology . Connecting health and care for the nation: a shared nationwide interoperability roadmap. Accessed June 5, 2021. https://www.healthit.gov/sites/default/files/hie-interoperability/nationwide-interoperability-roadmap-final-version-1.0.pdf
- 10.US Government . Medicare Access and CHIP Reauthorization Act of 2015. (MACRA). Accessed January 12, 2021. https://www.congress.gov/114/plaws/publ10/PLAW-114publ10.pdf
- 11.Adler-Milstein J. Moving past the EHR interoperability blame game. Accessed July 5, 2021. https://catalyst.nejm.org/ehr-interoperability-blame-game/
- 12.Delbanco SF, Anderson KM, Major CE, Kiser MB, Toner BW. Promising payment reform: risk-sharing with accountable care organizations. Accessed April 4, 2021. https://www.commonwealthfund.org/publications/fund-reports/2011/jul/promising-payment-reform-risk-sharing-accountable-care
- 13.Weiner JP, Fowles JB, Chan KS. New paradigms for measuring clinical performance using electronic health records. Int J Qual Health Care. 2012;24(3):200-205. doi: 10.1093/intqhc/mzs011 [DOI] [PubMed] [Google Scholar]
- 14.Liao JM, Navathe AS, Werner RM. The impact of Medicare’s alternative payment models on the value of care. Annu Rev Public Health. 2020;41(1):551-565. doi: 10.1146/annurev-publhealth-040119-094327 [DOI] [PubMed] [Google Scholar]
- 15.Lin SC, Hollingsworth JM, Adler-Milstein J. Alternative payment models and hospital engagement in health information exchange. Am J Manag Care. 2019;25(1):e1-e6. [PMC free article] [PubMed] [Google Scholar]
- 16.US Centers for Medicare & Medicaid Services . CMS interoperability and patient access final rule. Accessed October 20, 2020. https://www.cms.gov/Regulations-and-Guidance/Guidance/Interoperability/index
- 17.American Hospital Association . AHA annual survey database. Accessed April 24, 2021. https://www.ahadata.com/aha-annual-survey-database
- 18.Thorn SA, Carter MA, Bailey JE. Emergency physicians’ perspectives on their use of health information exchange. Ann Emerg Med. 2014;63(3):329-337. doi: 10.1016/j.annemergmed.2013.09.024 [DOI] [PubMed] [Google Scholar]
- 19.Johnson KB, Unertl KM, Chen Q, et al. Health information exchange usage in emergency departments and clinics: the who, what, and why. J Am Med Inform Assoc. 2011;18(5):690-697. doi: 10.1136/amiajnl-2011-000308 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Rudin RS, Motala A, Goldzweig CL, Shekelle PG. Usage and effect of health information exchange: a systematic review. Ann Intern Med. 2014;161(11):803-811. doi: 10.7326/M14-0877 [DOI] [PubMed] [Google Scholar]
- 21.Pylypchuk Y, Johnson C, Patel V. State of interoperability among U.S. non-federal acute care hospitals in 2018. Accessed October 20, 2021. https://www.healthit.gov/data/data-briefs/state-interoperability-among-us-non-federal-acute-care-hospitals-2018
- 22.Jha AK, DesRoches CM, Kralovec PD, Joshi MS. A progress report on electronic health records in U.S. hospitals. Health Aff (Millwood). 2010;29(10):1951-1957. doi: 10.1377/hlthaff.2010.0502 [DOI] [PubMed] [Google Scholar]
- 23.Jha AK, DesRoches CM, Campbell EG, et al. Use of electronic health records in U.S. hospitals. N Engl J Med. 2009;360(16):1628-1638. doi: 10.1056/NEJMsa0900592 [DOI] [PubMed] [Google Scholar]
- 24.Grossman JM, Kushner KL, November EA. Creating sustainable local health information exchanges: can barriers to stakeholder participation be overcome? Res Brief. 2008;2(2):1-12. [PubMed] [Google Scholar]
- 25.Charles D, Swain M, Patel V. Interoperability among U.S. non-federal acute care hospitals, 2014. Accessed October 20, 2021. https://www.healthit.gov/sites/default/files/briefs/onc_databrief25_interoperabilityv16final_081115.pdf
- 26.Callaway B, Sant’Anna PHC. Difference-in-differences with multiple time periods. J Econometrics. 2020;225(2):200-230. doi: 10.1016/j.jeconom.2020.12.001 [DOI] [Google Scholar]
- 27.Catalyst for Payment Reform . Press release: payment reform has grown significantly, though not across methods likely to transform health care; key indicators raise questions about impact to date. Accessed August 31, 2020. https://www.catalyze.org/about-us/cpr-in-the-news/new-national-scorecards/
- 28.Kaufman BG, Spivack BS, Stearns SC, Song PH, O’Brien EC. Impact of accountable care organizations on utilization, care, and outcomes: a systematic review. Med Care Res Rev. 2019;76(3):255-290. doi: 10.1177/1077558717745916 [DOI] [PubMed] [Google Scholar]
- 29.McWilliams JM. Cost containment and the tale of care coordination. N Engl J Med. 2016;375(23):2218-2220. doi: 10.1056/NEJMp1610821 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.McWilliams JM, Hatfield LA, Landon BE, Hamed P, Chernew ME. Medicare spending after 3 years of the Medicare Shared Savings Program. N Engl J Med. 2018;379(12):1139-1149. doi: 10.1056/NEJMsa1803388 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.US Government . 6—21st Century Cures Act. Accessed February 11, 2017. https://www.congress.gov/bill/114th-congress/house-bill/6/text
- 32.Moscovitch B. Six ways new federal health IT rules improve both care and public health. Accessed July 13, 2020. https://pew.org/2VeLmsD
- 33.Savage M, Neinstein A, Adler-Milstein J. Measure the impact of the ONC’s new interoperability rules now. Accessed August 31, 2020. https://www.healthaffairs.org/do/10.1377/hblog20200701.58142/full/
- 34.Everson J, Lee SYD, Friedman CP. Reliability and validity of the American Hospital Association’s national longitudinal survey of health information technology adoption. J Am Med Inform Assoc. 2014;21(e2):e257-e263. doi: 10.1136/amiajnl-2013-002449 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Everson J, Cross DA. Mind the gap: the potential of alternative health information exchange. Am J Manag Care. 2019;25(1):32-38. [PMC free article] [PubMed] [Google Scholar]
- 36.Everson J, Adler-Milstein J. Engagement in hospital health information exchange is associated with vendor marketplace dominance. Health Aff (Millwood). 2016;35(7):1286-1293. doi: 10.1377/hlthaff.2015.1215 [DOI] [PubMed] [Google Scholar]
- 37.Everson J, Butler E. Hospital adoption of multiple health information exchange approaches and information accessibility. J Am Med Inform Assoc. 2020;27(4):577-583. doi: 10.1093/jamia/ocaa003 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.