Abstract
Background and Objective
Healthcare professionals, industry and policy makers have identified Health Information Exchange (HIE) as a solution to improve patient safety and overall quality of care. The potential benefits of HIE on healthcare have fostered its implementation and adoption in the United States. However,there is a dearth of publications that demonstrate HIE effectiveness. The purpose of this review was to identify and describe evidence of HIE impact on healthcare outcomes.
Methods
A database search was conducted. The inclusion criteria included original investigations in English that focused on a HIE outcome evaluation. Two independent investigators reviewed the articles. A qualitative coding approach was used to analyze the data.
Results
Out of 207 abstracts retrieved, five articles met the inclusion criteria. Of these, 3 were randomized controlled trials, 1 involved retrospective review of data, and 1 was a prospective study. We found that HIE benefits on healthcare outcomes are still sparsely evaluated, and that among the measurements used to evaluate HIE healthcare utilization is the most widely used.
Conclusions
Outcomes evaluation is required to give healthcare providers and policy-makers evidence to incorporate in decision-making processes. This review showed a dearth of HIE outcomes data in the published peer reviewed literature so more research in this area is needed. Future HIE evaluations with different levels of interoperability should incorporate a framework that allows a detailed examination of HIE outcomes that are likely to positively affect care.
Keywords: Medical record linkage, health services, health utilization, review literature, health information exchanges
1. Introduction
Health Information Exchange (HIE) refers to the sharing of clinical and administrative data across the boundaries of health care institutions, data repositories, and groups (payers, patients, providers, and others) according to nationally recognized standards [1, 2]. The importance of HIE has been the focus of several national agencies interest including the Department of Health and Human Services (DHHS) due to the potential for HIE to positively impact health care quality; in March 2010, DHHS awarded $162 million to stimulate HIE use in 16 states [3].
The potential benefits attributable to HIE include improved quality of care, efficiency, and patient safety, facilitated communications among providers, improved public health surveillance, facilitated quality of care measurement such as the ability of an organization to identify infectious disease outbreaks and decreased health care costs [4]. However, research on HIE clinical outcomes remains sparse; a systematic review of the effects of health information technology on quality, efficiency, and costs of health care included 257 articles but none of them involved HIE as it is now defined [4].
Much has been written on HIE implementation and adoption showing that there is still a need of extensive HIE effectiveness demonstration to leverage its use [2, 5–13]. Current or future HIE initiatives should use evidence-based information to make decisions about planning, implementation and operation of HIE’s as well as prioritize research and funding. The purpose of this review is to identify and describe evidence of HIE impact on health outcomes and health care costs.
2. Methods
We conducted a literature review to identify English-language investigations describing HIE outcome evaluations by searching articles listed in the MEDLINE and, Academic Search Premier databases between January 1995 and December 2010. We defined outcomes as any change in patients’ health status or health services utilization. The two authors reviewed articles for inclusion independently. Open discussions were held to solve disagreements, until consensus was reached. We adopted a broad definition of HIE to include any study where electronic data sharing occurred between different healthcare settings. The search combined the terms health information exchange, information exchange, electronic health information exchange, electronic data interchange, sharing medical information, and outcomes assessment (MESH). Articles were included if they were original investigations in English that focused on HIE outcomes. Articles were excluded if they related to HIE in health care consultation (i.e., patient-provider communication) or addressed evaluation of health information technologies other than information exchange (e.g., electronic health records, personal health records, electronic prescribing, computerized physician order entry). HIE policy discussions, implementation concerns, technical architecture reports, economic models, and theory building case studies were also excluded. A qualitative coding approach was used to analyze the data. Qualitative coding consists in the creation of thematic categories, and the establishment of the relationships between categories [14].
3. Results
A total of 207 abstracts were retrieved and reviewed by the two authors. Initially, 20 articles met the inclusion criteria. After the evaluation of the 20 initial articles reference lists,’ we identified three additional articles. Eighteen articles were excluded during a second review cycle because the articles were inaccessible (n = 4) or did not perform outcome assessment but instead investigated participants’ perceptions of HIE potential outcomes (n = 14). A total of 5 articles met the inclusion criteria. Of these, 3 were randomized controlled trials, 1 involved retrospective review of data, and 1 was a prospective study (Table 1).
Table 1.
Author/ Year of publication | Setting | Research design | Sample size (N) | Comparison | Participants in the exchange | Data Exchanged | Primary Outcome | Main Findings | HIE Finding Summary |
---|---|---|---|---|---|---|---|---|---|
Overhage et al. 2002 [15] |
Multicentre | Randomized controlled trial (at patient level) | 32,468 patients | Electronically delivered patient information Vs. No patient information delivered electronically |
ED physicians | Diagnosis, laboratory tests and electrocardiogram results, imaging reports, medication therapy, ED visit reports, and clinic visit reports | Mean ED charges for a single encounter | Cost savings $26.52 p = 0.03 per ED encounter at 1 of the 2 participant hospitals in the intervention group | + |
Lang et al. 2006 [16] |
Single site | Crossover cluster randomized controlled trial (at provider level) | 2,022 patient visits 23 providers |
Web-based standardized communication system Vs. One-page print-based reports sent by mail |
Family and ED physicians | ED visit reports, diagnosis, laboratory tests and electrocardiograms results, imaging reports, and medication therapy | Repeated visits to the ED within 14 days of the initial visit | No significant difference between intervention and control group | - |
Hansagi et al. 2008 [20] |
Multicentre | Randomized controlled trial (at patient level) | 1,799 patients | Patients’ ED information for frequent users forwarded by the study staff to PC and ED physicians Vs. No patient information exchanged |
PC and ED physicians | Data exchanged not described by authors | Mean # of ED visits, mean # of PC physician visits, mean # of visits to specialist outpatient clinic physician and mean # of days in hospital | No significant difference between intervention and control group | - |
Vest J. 2009 [18] |
Multicentre | Retrospective database analysis | 6,114 patients | Index of HIE use: zero (none), low (1 view), medium (2–3 views) or high (4 or more views during three years. | Members of the Integrated Care Collaboration (ICC) of Central Texas | Demographic and clinical data except encounters covered by Medicare | Inpatient hospitalizations Emergency room utilization |
Any level of HIE access was associated with a higher frequency of ED visits (OR = 1.96; 95%CI 1.70 to 2.26), clinic visits (OR = 1.63; 95%CI 1.46 to 1.82), and hospital admissions (OR = 2.02; 95%CI 1.38 to 2.98) | - |
Branger et al. 1999 [19] |
Multicentre | Prospective quasi-experimental | 275 patients | Paper-based communication Vs. Electronic communication |
General Practitioners Internal medicine providers |
Administrative data Medical data |
HBA1c levels and the frequency of communication between general practitioners and internal medicine providers | Mean differences in HBA1c level reduction in the intervention group vs. the controls were not significant (0.21 vs. 0.12 p = 0.68). | - |
ED= Emergency Department, PC= Primary Care AUD= Australian Dollars
3.1 Health Care Utilization
One study evaluated the effect of increased access to patient clinical information in the hospital setting [15]. In this study, computer-based patient data from one urban hospital were shared electronically with the emergency physicians at two other urban hospitals. The researches randomized 32,468 patients to either the control or intervention group. In the intervention group, ED physicians could access an online system containing clinical information for a patient who was seen at one of the study hospitals. The clinical information included: inpatient laboratory results; discharge summaries; operative reports; ED visit notes; diagnostic tests; dictated clinical notes; and medication history. ED physicians in the control group did not have access to these patient-specific data. For the primary outcome, the investigators collected data from each hospital’s billing records measuring the mean ED charge for a single encounter and the first day’s charges for each patient if admitted to the hospital. The first day’s charges were included because Medicare requires that hospitals combine ED and inpatient charges in one bill for patients admitted to the hospital; the investigators were unable to split these charges. The intervention group in only one hospital showed a statistically significant decrease in ED charges ($26.52 cost savings p = 0.037 vs. $25.36 p = 0.073). However, researchers could not identify where the savings originated (e.g., radiology, laboratory, facility, or pharmacy charges). This study established the feasibility of exchanging clinical information data between institutions for emergency care, but did not demonstrate conclusive cost reductions.
In another study, Lang et al. evaluated a web-based standardized communication system that enabled family physicians in Canada to receive patient reports from ED visits [16]. This study, which was an unblinded 4-period crossover cluster randomized controlled trial, assessed the number of repeated visits to the ED and health services utilization at family physician office. During the intervention period, family physicians received patients’ detailed information such as laboratory tests results, and medication history, for each participant’s visit to ED through an electronic system 24 hours after the visit occurred; while in the control phase family physicians received by mail a paper copy of the first page of the ED’s discharge notes. To measure resource utilization, the investigators used the hospital’s database and asked family physicians to self-report the number of health services required at each visit.
The results of this study are mixed. Although researchers found that system decreased the ED return visits after 28 days for all patients older than 65 years old (OR = 0.70; 95% CI, 0.49 to 1.0), there was a significant increase in specialty consultation requests for the intervention (20 vs. 8 p = 0.049). The study did not find a statistically significant reduction in the number of repeated ED visits after 14 day of the initial visit (OR = 1.1; 95% CI, 0.8 to 1.51) or in any other measure of health services utilization.
Hansagi et al. conducted a randomized controlled trial to evaluate the usefulness of sharing clinical information between ED’s and primary care clinics in one Swedish hospital over a 24-month period [20]. The hospital’s electronic database identified those who were frequent users of the ED (>3 visits per year) in the previous 12 months. These patients were then randomized into an intervention group (n = 834) or a control group (n = 965). Hard copy information about the patient’s last three ED visits was forwarded by the study staff to ED physicians (n = 57) and primary care physicians (n = 37) for the intervention group via an unspecified method during the following 12 months. The investigators assessed health care utilization by examining the mean number of ED visits, mean number of primary care physician visits, mean number of specialist outpatient clinic physician visits and mean number of days in the hospital by collecting data from the hospital database system. Investigators analyzed differences in means before and after the intervention for both groups and administered a survey to evaluate ED and primary care physicians’ perceptions of the value of easy access to patient medical information. This study failed to show significant differences between the control and the intervention group during the 12 month of prospective data collection for any of the health care utilization outcomes analyzed. However, the researchers reported that 82% of ED physicians and 76% of primary care providers perceived the information obtained through the exchange as useful.
Vest J, tested the hypotheses that access to an HIE would be associated with lower rates of inpatient hospitalizations or emergency room utilization for sensitive ambulatory care conditions such as asthma, diabetes, ear infections, or pelvic inflammatory disease [18]. The investigator retrospectively analyzed data from the Integrated Care Collaboration (ICC) of Central Texas data repository. The ICC is a centralized database containing clinical information added by eighteen organizations including hospitals systems, clinics, and governmental agencies. These organizations can access data in the repository through a secure website. This study analyzed data for 6,114 patients between 2005 and 2007. The researcher created information access index using the information logs to measure the HIE utilization. The results of this analysis indicated that HIE was associated with increased health care utilization. HIE information access was significantly associated with higher emergency room visits (OR = 1.96; 95%CI 1.70 to 2.26), clinic visits (OR = 1.63; 95%CI 1.46 to 1.82), and hospital admissions (OR = 2.02; 95%CI 1.38 to 2.98). In addition, the higher the level of HIE information access the higher the probability of emergency room visits and ambulatory care sensitive hospitalizations. The author proposes as possible explanations for the study results: the inadequate or inefficient use of the HIE, unavailable data or missed data by the users, or that the information was not accessed by whom it would be most beneficial. Finally, the higher use of health services utilization associated with sicker patients could have driven HIE use.
3.2 Health Outcomes
Using a quasi-experimental study design, Branger et al. assessed the outcomes of an information exchange between 32 general practitioners and an internal medicine consultant who provided care to 275 diabetic patients in The Netherlands [19]. Researchers compared traditional paper-based reporting process to an electronic system for data exchange. The system allowed hospitals from the Apeldoorn area to exchange admission summaries, discharge reports and laboratory test results. When a general practitioner referred a patient, an electronic message containing the patient demographic information, reporting dates, and information from the electronic medical record was generated. Before the message was transmitted to the other provider, the referring physician was able to edit the message, add free text or discard data. The researches selected the 20 practitioners with the highest number of patient referrals to form the intervention group; this group received the exchange communication module. The remaining 12 general practitioners were designated as the control group and continued working without the inter-physician communication module. This investigation showed that the mean difference of HbA1c levels of patients of intervention group decreased compared to the levels measured before the intervention (from 7.0 to 6.8 p = 0.03). The control group’s patients did not demonstrate a significant decrease in the HbA1c levels (from 6.6 to 6.5 p = 0.52). The mean differences of HbA1c levels in the intervention group’s patients were not significantly different than the control group’s patients (0.21 vs 0.12 p = 0.68) (►Table 1)
4. Discussion
The main objective of this study was to present a review of relevant published literature about the effect of HIEs on health outcomes. Although the HIE definition used in this review was broad and may not meet the requirements of current HIE definitions, we found little research that aimed at evaluating the impact of HIE on patients’ health and health care utilization outcomes. Moreover, the few articles that met our inclusion criteria varied significantly in methodology and different measures were used for outcome assessments. The majority of the outcomes measures focused on health care utilization such as number of visits to ED and duplication of services and costs. Only one of the three randomized controlled studies included in this review identified positive HIE outcomes. Overahage et al. found significant cost savings ($26.52) in ED charges per visit at one of the two hospitals involved. In comparison, Lang et al. did not find differences in the number of repeated visits to ED two weeks after the initial visit; Hansagi did not find findings favoring HIE in any of the outcomes measured. Moreover, in Vest et al.’s retrospective analysis, HIE use was associated with greater healthcare services utilization.
There may be several reasons for the lack of results supporting HIE services. The study intervention periods were relatively short, varying from 6 to 30 months, which could prevent long-term benefits to become evident. Also, all studies aggregated costs and other utilization measures for analyzing data. Therefore results may be confounded by factors such as illness severity. In addition, aggregation of data per patients’ visit may impede evaluating the impact of HIE on repeated number of laboratory tests and x-rays. These outcomes should be further explored separately. There is a need for the development and validation of measures to evaluate HIE effectiveness. These measures should account for the different levels of interoperability that can be achieved with HIE [21]. The majority of studies reviewed focused on number of repeated emergency or primary care visits as outcome measure, which do not necessarily reflect the potential for HIE effectiveness in its entirety. For example, the impact of HIE on medication reconciliation and thus medication safety could be additionally examined.
None of the investigations directly addressed training of HIE users, which could have resulted in systems’ under-utilization and reduced power. In addition, the behavior of consulting HIE only when others sources have been exhausted can negatively impact HIE potential benefits [22, 23].
Several literature reviews have been conducted on health information technology (HIT) [24–28]. However, these reviews do not focus on HIE and include a wide range of technologies such as computerized physician order entry, electronic health records, or computerized decision support. Chaudry et al. included data exchange networks in their systematic review; however they did not find an improvement in health outcomes for HIEs [24]. Additionally, other published HIE reviews concentrate on systems capabilities, implementation approaches, or costs and have found that HIE initiatives are diverse impeding the selection of a preferred strategy for evaluation [29]. HIE effects on health care are the consequences of the connectivity between hardware, software, and different stakeholders such as providers, patients and payers. This complex interrelationship between system components may prove to be a challenge for HIE outcomes evaluation [30]. In addition, the gradual implementation and adoption of technologies such as HIE may prove to be an impediment to the identification of a point to make to pre-post comparisons [31]. While it may at first seem that this review produces evidence against HIEs, this is not the case. The intent of this article is to point out that additional well-designed studies of the outcomes of HIEs are desperately needed. It is our hope that researchers will find this an interesting area for study and develop effective measurement tools, study patient outcomes and publish these results.
This review has several limitations. We identified a very limited number of articles that met our study criteria and therefore general conclusions cannot be drawn from this review. In addition, HIE initiatives in the early stages of operation and their outcomes evaluations may not appear in publication yet or may not be available via peer-reviewed journals. The limited sample size and low power of the studies reviewed prevent us to draw definite conclusions of HIE effectiveness.
5. Conclusion
Outcomes evaluation is required to give healthcare providers and policy-makers evidence to incorporate in decision-making processes. This review showed a dearth of HIE outcomes data in the published peer reviewed literature so more research in this area is needed. Future HIE evaluations with different levels of interoperability should incorporate a framework that allows a detailed examination of HIE outcomes that are likely to positively affect care.
Conflict of interest
The authors declare that they have no conflicts of interest in the research. This study was funded by the Centers for Medicare and Medicaid (CMS) Grant Number 0705AZTRA1 provided to Arizona for the Medicaid Health Information Exchange and Utility Project.
Protection of Human and Animal Subject
The article did not involve research on human subjects.
References
- 1.Balfour D, 3rd, Evans S, Januska J, Lee H, Lewis S, Nolan S, et al. Health information technology – results from a roundtable discussion. Journal of managed care pharmacy 2009; 15(1 Suppl A): 10 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Kern LM, Barron Y, Abramson EL, Patel V, Kaushal R. HEAL NY: Promoting interoperable health information technology in New York State. Health Affairs 2009; 28(2): 493 [DOI] [PubMed] [Google Scholar]
- 3.Services USDoHaH HHS announces additional $162 million in recovery act investment to advance widespread meaningful use of health IT. [cited 2010]; Available from: http://www.hhs.gov/news/press/2010pres/03/20100315a.html
- 4.Wilt D, Muthig B. Crossing barriers: EMR implementation across a nationwide continuum of care. Journal of healthcare information management 2008; 22(2): 23 [PubMed] [Google Scholar]
- 5.Marchibroda JM. The impact of health information technology on collaborative chronic care management. Journal of managed care pharmacy 2008; 14(2 Suppl): S3-S11 [PubMed] [Google Scholar]
- 6.Shapiro JS, Kannry J, Lipton M, Goldberg E, Conocenti P, Stuard S, et al. Approaches to patient health information exchange and their impact on emergency medicine. Annals of Emergency Medicine 2006; 48 (4): 426–342 [DOI] [PubMed] [Google Scholar]
- 7.Hripcsak G, Kaushal R, Johnson KB, Ash JS, Bates DW, Block R, et al. The United Hospital Fund meeting on evaluating health information exchange. Journal of biomedical informatics 2007; 40(6): S3-S10 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Goroll AH, Simon SR, Tripathi M, Ascenzo C, Bates DW. Community-wide implementation of health information technology: the Massachusetts eHealth Collaborative experience. Journal of the American Medical Informatics Association 2009; 16(1): 132 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Solomon MR. Regional health information organizations: a vehicle for transforming health care delivery? Journal of medical systems 2007; 31 (1): 35–47 [DOI] [PubMed] [Google Scholar]
- 10.Adler-Milstein J, Landefeld J, Jha AK. Characteristics associated with regional health information organization viability. Journal of the American Medical Informatics Association 2010; 17(1): 61 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Adler-Milstein J, Bates DW, Jha AK. US Regional health information organizations: progress and challenges. Health Affairs 2009; 28(2): 483 [DOI] [PubMed] [Google Scholar]
- 12.Shapiro J, Kannry J, Kushniruk A. New York Clinical Information Exchange (NYCLIX) Clinical Advisory Subcommittee. Emergency physicians' perceptions of health information exchange. J Am Med Inform Assoc 2007; 14: 700–705 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Shapiro JS. Evaluating public health uses of health information exchange. Journal of biomedical informatics 2007; 40(6): S46-S49 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Richards L. Handling qualitative data: A practical guide: Sage Publications Ltd; 2009. [Google Scholar]
- 15.Overhage JM, Dexter PR, Perkins SM, Cordell WH, McGoff J, McGrath R, et al. A randomized, controlled trial of clinical information shared from another institution. Annals of emergency medicine 2002; 39 (1): 14–23 [DOI] [PubMed] [Google Scholar]
- 16.Lang E, Afilalo M, Vandal AC, Boivin JF, Xue X, Colacone A, et al. Impact of an electronic link between the emergency department and family physicians: a randomized controlled trial. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne 2006; 174 (3): 313-318 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Brebner JA, Brebner EM, Ruddick-Bracken H. Accident and emergency teleconsultation for primary care – a systematic review of technical feasibility, clinical effectiveness, cost effectiveness and level of local management. J Telemed Telecare 2006; 12 (Suppl 1): 5–8 [DOI] [PubMed] [Google Scholar]
- 18.Vest JR. Health information exchange and healthcare utilization. Journal of medical systems 2009; 33 (3): 223–231 [DOI] [PubMed] [Google Scholar]
- 19.Branger PJ, van't Hooft A, van der Wouden JC, Moorman PW, van Bemmel JH. Shared care for diabetes: supporting communication between primary and secondary care. International journal of medical informatics 1999; 53(2–3): 133–142 [DOI] [PubMed] [Google Scholar]
- 20.Hansagi H, Olsson M, Hussain A, Öhlén G. Is information sharing between the emergency department and primary care useful to the care of frequent emergency department users? European Journal of Emergency Medicine 2008; 15(1): 34 [DOI] [PubMed] [Google Scholar]
- 21.Kuperman GJ. Health-information exchange: why are we doing it, and what are we doing? J Am Med Inform Assoc 2011; 18 (5): 678–682 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Rudin RS. Why clinicians use or don't use health information exchange. J Am Med Inform Assoc 2011; 18(4): 529 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Vest JR, Gamm LD, Ohsfeldt RL, Zhao H, Jasperson J. Factors Associated with Health Information Exchange System Usage in a Safety-Net Ambulatory Care Clinic Setting. Journal of Medical Systems Published online (Epub ahead of print). Available at: http://dx.doi.org/10.1007/s10916–011–9712–3 [DOI] [PMC free article] [PubMed]
- 24.Chaudhry B, Wang J, Wu S, Maglione M, Mojica W, Roth E, et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Annals of internal medicine 2006; 144(10): 742 [DOI] [PubMed] [Google Scholar]
- 25.Waneka R, Spetz J. Hospital Information Technology Systems' Impact on Nurses and Nursing Care. Journal of Nursing Administration 2010; 40(12): 509 [DOI] [PubMed] [Google Scholar]
- 26.Govindan M, Van Citters AD, Nelson EC, Kelly-Cummings J, Suresh G. Automated detection of harm in healthcare with information technology: a systematic review. Quality and Safety in Health Care 2010; 19(5): 1 [DOI] [PubMed] [Google Scholar]
- 27.Gallego AI, Gagnon MP, Desmartis M. Assessing the Cost of Electronic Health Records: A Review of Cost Indicators. Telemedicine and e-Health 2010; 16 (9): 963–972 [DOI] [PubMed] [Google Scholar]
- 28.Menachemi N, Chukmaitov A, Saunders C, Brooks RG. Hospital quality of care: Does information technology matter? The relationship between information technology adoption and quality of care. Health Care Management Review 2008; 33(1): 51 [DOI] [PubMed] [Google Scholar]
- 29.Fontaine P, Ross SE, Zink T, Schilling LM. Systematic review of health information exchange in primary care practices. The Journal of the American Board of Family Medicine 2010; 23(5): 655 [DOI] [PubMed] [Google Scholar]
- 30.Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, et al. Framework for design and evaluation of complex interventions to improve health. Bmj 2000; 321(7262): 694 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Ammenwerth E, Gräber S, Herrmann G, Bürkle T, König J. Evaluation of health information systems–problems and challenges. International Journal of Medical Informatics 2003; 71(2–3): 125–135 [DOI] [PubMed] [Google Scholar]