Abstract
Background: The CDC established a national objective to create population-based tracking of immunizations through regional and statewide registries nearly 2 decades ago, and these registries have increased coverage rates and reduced duplicate immunizations. With increased adoption of commercial electronic medical records (EMR), some institutions have used unidirectional links to send immunization data to designated registries. However, access to these registries within a vendor EMR has not been previously reported.
Purpose: To develop a visually integrated interface between an EMR and a statewide immunization registry at a previously non-reporting hospital, and to assess subsequent changes in provider use and satisfaction.
Methods: A group of healthcare providers were surveyed before and after implementation of the new interface. The surveys addressed access of the California Immunization Registry (CAIR), and satisfaction with the availability of immunization information. Information Technology (IT) teams developed a “smart-link” within the electronic patient chart that provides a single-click interface for visual integration of data within the CAIR database.
Results: Use of the tool has increased in the months since its initiation, and over 20,000 new immunizations have been exported successfully to CAIR since the hospital began sharing data with the registry. Survey data suggest that providers find this tool improves workflow and overall satisfaction with availability of immunization data. (p=0.009).
Conclusions: Visual integration of external registries into a vendor EMR system is feasible and improves provider satisfaction and registry reporting.
Key Words: Electronic Medical Records, Immunization Registries, EMR integration, HITECH, Meaningful Use
Introduction
Since their inception nearly 20 years ago, immunization registries have been shown to increase vaccine coverage rates and decrease duplicate immunizations [1-3]. The CDC provides funding for immunization information system (IIS) programs in all 50 states [4]. As part of the Health Information Technology for Economic and Clinical Health Act (HITECH) of 2009, providers with electronic medical records (EMRs) are encouraged to submit electronic immunization data to IISs to achieve meaningful use [4-6]. Many institutions have established unidirectional interoperability by which their EMR immunization records are uploaded to a designated registry—thereby preventing the need for staff to manually update each patient chart in the registry [1,5]. Bidirectional interoperability is preferable as it would allow accurate immunization data from the IIS to be sent directly to the hospital’s or practice’s EMR, however integration is expensive and difficult to implement [7]. Visual integration into the EMR with context-sensitive access can meet clinician needs without the expense of bidirectional data integration.
Lucile Packard Children's Hospital (LPCH) has a strong history of developing informatics-enabled innovations [8-12]. LPCH had not, however, previously participated in the statewide immunization registry, the California Immunization Registry (CAIR), largely due to concerns for duplication of efforts by clinical staff who would need to manually enter the same data in both the vendor EMR and the IIS. The previous system was paper-based and involved scanning copies of the patient records in to the EMR. No immunization information was tracked directly in our EMR. This information was not complete and only contained data for those immunizations recorded at LPCH.
The few published reports on bidirectional registries involved Health Level 7 (HL7) web service, which have not been widely replicated given that the technical work involved is far greater and difficult to sustain [13,14]. Decision support services in the EMR are much more limited as the compared to those native in the registries. Our team’s goal was to develop a visually integrated interface by which clinical staff could quickly and easily access the registry to evaluate a patient’s immunization history from within our EMR. It was hypothesized that initiating the association between LPCH and CAIR would add to the number of patients included in the IIS, increase provider utilization of this tool, and improve provider satisfaction and perceived efficiency.
Methods
Integration
Creation of the visually integrated registry interface within the vendor EMR required two different efforts. The first was to upload hospital immunization data to the IIS, transferring nightly any new immunizations recorded at LPCH using HL7 code. Historical data, including all immunizations previously ordered using Computerized Physician Order Entry (CPOE) from, were also uploaded. The second aspect was to create a “smart link” – a web-based icon in the “Patient Summary” area of the chart that directs providers to the CAIR registry site. (Figure 1). Clicking this link sends patient identifiers to the CAIR database, using an institutional login to access the patient’s CAIR chart. The CAIR interface includes both immunizations from LPCH data uploads and any others added to the database by outside institutions, as well as its native decision support tool. (Figure 2). The new interface was implemented at the end of the 2011 calendar year.
Survey
Healthcare providers at LPCH were electronically surveyed several months prior to the rollout of the tool with regards to their satisfaction with the prior paper system and their use of the statewide registry (n=41). All LPCH residents, General Pediatrics attending physicians, primary care clinic nurses and nursing assistants were invited to participate. The providers were again asked to participate in a follow-up survey 4 months after the rollout (n=41). A brief, 7-item survey, including multiple-choice and free-response questions, was developed to assess the provider’s use of CAIR, perceived impact on their workflow, and satisfaction with the hospital’s immunization recording systems (Appendix). R for Mac (The R Foundation for Statistical Computing, Vienna, Austria) was used to perform Fisher’s exact test for categorical variables, and the Wilcoxon Rank Sum test to compare the distribution of satisfaction ratings.
This project and study were done as part of quality improvement measures and thus IRB approval was not required.
Results
Figure 3 exemplifies that use of this tool has increased incrementally during the first 4 months following implementation. Data from LPCH was uploaded to the CAIR database starting in December 2011—sharing all previously ordered immunizations and any immunizations ordered using CPOE after that date. Over 20,000 new immunization records—both historic and recent—were successfully inserted into the CAIR database since initiation.
Forty-one independent providers responded to each of the pre- and post-surveys as seen in Table 1. There was a slight statistical difference of the demographic distribution, as more attending physicians participated in the post-survey. Responders indicated increased usage of the registry following interface implementation (p = < 0.001).
Of the providers surveyed, the majority had never accessed CAIR prior to the availability of the link. Afterwards, the number of providers who had accessed CAIR significantly increased (p = < 0.001). Although, the majority of our respondents were physicians, the primary care clinic nursing staff reported the most frequent use of the tool.
Overall provider satisfaction increased slightly (p = 0.009), however, the majority of providers (56%) perceived that the smart link improved their efficiency (Figure 4). 68% of the surveyed providers felt that the smart link increased the likelihood that their patients’ immunization record was up to date (Figure 5).
Discussion
Few published examples of bidirectional interfaces between EMRs and immunization registries exist, and to the authors’ knowledge, none about visual integration within a vendor EMR [13,14]. The HITECH act lays out objectives in order to promote EMRs and their meaningful use in 3 successive stages. In order to receive economic incentives, each stage of criteria must be met, including those related to electronic data sharing with IIS [5-7,15]. While unidirectional interoperability is all that is required under HITECH, visual integration of the registry is a significant enhancement because institutional immunization data is not only shared with the registry, individual patient data is easily accessible by providers within their workflow [7].
These data suggest that use of CAIR among providers at LPCH has increased since the introduction of the interface to the EMR and a significant increase in the link utilization in the months since implementation is shown. An IIS is only as robust as the information it receives and the amount it is utilized [16]. The CDC hopes to have >95% of children under 6 included in an IIS by the year 2020 [17], a goal that will require participation of many additional institutions. Given the parallel federal incentives to implement EMR systems, many institutions are similarly hesitant to participate in an IIS due to concerns about extra work for staff [18,19].
The interface implemented at LPCH is a web-based link, which preserves the sanctity of the registry database while improving provider workflow. System maintenance is relatively minimal once the algorithms are established. This link was established in a vendor-based system, which could be utilized by many other institutions. The only previously reported of bidirectional interface in NYC was with two smaller EMRs, both internally developed [13,14]. Providers at LPCH indicated that having the link increased the likelihood that their patients’ immunization information was up to date, as well as their overall efficiency.
Although this study has a relatively small sample size, the authors feel that the responses reflect the general consensus of primary care providers at LPCH. Despite the slight difference in the demographics of the pre- and post- survey groups, it is unlikely that these differences bias the main outcome measures of this study. Another limitation is that the outpatient clinics at LPCH have not yet started utilizing CPOE to order immunizations, so the data shared with the IIS is currently limited to hospitalized inpatients, including newborns in the well baby nursery and obstetric patients. However, given that the link allows access to the entire registry’s data set and not just patients who have had immunizations documented at LPCH, its integrated nature makes it useful for providers (both inpatient and outpatient), who are able to examine records from patients’ seen at other area clinics.
Conclusions
The successful implementation of a unidirectional interface between a commercial EMR and the California state immunization registry with visually integrated universal access has resulted in significant enhancement in the comprehensive nature of patient immunization records at this hospital.
It is the authors’ hope that this example will serve to inspire other institutions with vendor-based EMR systems to implement similar interfaces for the good of all communities and patients.
Acknowledgements
The authors would like to acknowledge Joshua Faulkenberry, Pragati Kamath, and Nestor Llerena at LPCH, as well as Eric Dansby, Sarah Kang, and Jagadesh Talluri at CAIR, for their technical expertise and assistance with this project. Christopher Stave’s assistance with the literature search is also greatly appreciated, as is Lisa Chamberlain’s inspiration and advocacy leadership.
Funding: None
Author Contribution Statements:
Dr. Stevens helped conceptualize the project, administered the surveys, analyzed the data, drafted the manuscript, and approved the final version for submission.
Dr. Palma contributed to the statistical analysis, reviewed the manuscript, and approved the submission version.
Ms. Pandher helped design and worked with the technical development of the system, as well as aided in data acquisition and final approval of the manuscript.
Dr. Longhurst contributed substantially to the conception, design, acquisition of data, analysis, and interpretation of data; revising the article for important intellectual content; and final approval of the published version.
Appendix – Survey questions
Pre-Survey
What is your current position?
How often do you need to access immunization information about a patient?
-
Have you ever accessed the California Immunization Registry?
The questions below used the Likert scale Strongly Disagree to Strongly Agree (1-5):
I am satisfied with the current system of recording immunizations.
I feel that integrating the centralized immunization record into our electronic medical record will improve my workflow.
Using a centralized resource for immunization records will improve patient care.
Do you have any additional comments?
Post-Survey
What is your current position?
How often do you need to access immunization information about a patient?
Did you ever access the California Immunization Registry before the link in Cerner was available?
Have you ever accessed the California Immunization Registry using the link in Cerner?
If so, how many times have you accessed it in the last 2 weeks?
-
How strongly do you agree or disagree with the following statements?
I am satisfied with the current system of recording immunizations.
Having my patients' immunization information accessible through the smart link has improved my efficiency.
The new EMR interface makes it more likely that my patients' immunization information is up to date.
Do you have any additional comments?
Abbreviations:
- California Immunization Registry (CAIR)
Computerized Physician Order Entry (CPOE), Electronic Medical Record (EMR), Health Information Technology for Economic and Clinical Health Act (HITECH), Health Level 7 (HL7), Immunization Information System (IIS), Information Technology (IT), Lucile Packard Children's Hospital (LPCH)
Footnotes
Financial Disclosure: The authors have no financial relationships relevant to this article to disclose.
Conflict of Interest: The authors have no conflicts of interest relevant to this article to disclose.
References
- 1.Abramson JS, O'Shea TM, Ratledge DL, Lawless MR, Givner LB. 1995. Development of a vaccine tracking system to improve the rate of age-appropriate primary immunization in children of lower socioeconomic status. J Pediatr. 126(4), 583-86 10.1016/S0022-3476(95)70354-3 [DOI] [PubMed] [Google Scholar]
- 2.Linkins RW. 2001. Immunization registries: progress and challenges in reaching the 2010 national objective. J Public Health Manag Pract. 7(6), 67-74 [DOI] [PubMed] [Google Scholar]
- 3.Placzek H, Madoff LC. 2011. The use of immunization registry-based data in vaccine effectiveness studies. Vaccine. 29(3), 399-411 10.1016/j.vaccine.2010.11.007 [DOI] [PubMed] [Google Scholar]
- 4.Weinberg ST. 2010. Immunization Registries: Where we’ve been and where we’re headed. AAP News. 31(12), 28 [Google Scholar]
- 5.Meaningful Use and Immunization Information Systems In.
- 6.Meaningful use of electronic health records EHRs. In: American Academy of Pediatrics. [Google Scholar]
- 7.Dombkowski KJ, Clark SJ. 2012. Redefining meaningful use: achieving interoperability with immunization registries. Am J Prev Med. 42(4), e33-35 10.1016/j.amepre.2012.01.009 [DOI] [PubMed] [Google Scholar]
- 8.Palma JP, VanEaton EG, Longhurst CA. 2011. Neonatal Informatics: Information Technology to Support Handoffs in Neonatal Care. NeoReviews. 2011(12), e560-63 10.1542/neo.12-10-e560 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bernstein J, Imler D, Sharek P, Longhurst C. 2010. Improved Physician Workflow and Satisfaction after Integration of Sign-out Notes into the EMR. Jt Comm J Qual Patient Saf. [DOI] [PubMed] [Google Scholar]
- 10.Frankovich J, Longhurst CA, Sutherland SM. 2011. Evidence-based Medicine in the EMR Era. N Engl J Med. 365(19), 1758-59 10.1056/NEJMp1108726 [DOI] [PubMed] [Google Scholar]
- 11.Longhurst CA, Parast L, Sandborg CI, Widen E, Sullivan J, et al. 2010. Decrease in Hospital-wide Mortality Associated with Implementation of a Comprehensive Electronic Medical Record. Pediatrics. 126(1), 14-21 10.1542/peds.2009-3271 [DOI] [PubMed] [Google Scholar]
- 12.Adams ES, Longhurst CA, Pageler N, Widen E, Franzon D, et al. 2011. Computerized physician order entry with decision support decreases blood transfusions in hospitalized children. Pediatrics. 127(5), e1112-19 10.1542/peds.2010-3252 [DOI] [PubMed] [Google Scholar]
- 13.Arzt NH. 2010. Service-Oriented Architecture in Public Health: Interoperability Case Studies. J Healthc Inf Manag. 24(2), 45-52 [PubMed] [Google Scholar]
- 14.Arzt NH, Forney K, Chi A, Suralik M, Schaeffer P, et al. 2011. Meaningful Use and Public Health: An Immunization Information System Case Study. J Healthc Inf Manag. 25(4), 37-44 [Google Scholar]
- 15.Blumenthal D. 2010. Launching HITECH. N Engl J Med. 362(5), 382-85 10.1056/NEJMp0912825 [DOI] [PubMed] [Google Scholar]
- 16.Davidson AJ, Melinkovich P, Beaty BL, Chandramouli V, Hambidge SJ, et al. 2003. Immunization registry accuracy: improvement with progressive clinical application. Am J Prev Med. 24(3), 276-80 10.1016/S0749-3797(02)00638-4 [DOI] [PubMed] [Google Scholar]
- 17.2012. Progress in immunization information systems - United States, 2010. MMWR Morb Mortal Wkly Rep. 61(25), 464-67 [PubMed] [Google Scholar]
- 18.Kairys SW, Gubernick RS, Millican A, Adams WG. 2006. Using a registry to improve immunization delivery. Pediatr Ann. 35(7), 500-06 [DOI] [PubMed] [Google Scholar]
- 19.Saville AW, Albright K, Nowels C, Barnard J, Daley MF, et al. 2011. Getting under the hood: exploring issues that affect provider-based recall using an immunization information system. Acad Pediatr. 11(1), 44-49 10.1016/j.acap.2010.12.009 [DOI] [PubMed] [Google Scholar]
- 20.Mahon BE, Shea KM, Dougherty NN, Loughlin AM. 2008. Implications for registry-based vaccine effectiveness studies from an evaluation of an immunization registry: a cross-sectional study. BMC Public Health. 8(160), 160 10.1186/1471-2458-8-160 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Hinman AR, Ross DA. 2010. Immunization registries can be building blocks for national health information systems. Health Aff (Millwood). 29(4), 676-82 10.1377/hlthaff.2007.0594 [DOI] [PubMed] [Google Scholar]
- 22.Centers for Disease Control and Prevention Immunization Registry Support Branch, National Immunization Program, Centers for Disease Control and Prevention. National Immunization Program. Implementation guide for immunization data transactions using version 2.3.1 of the Health Level Seven (HL7) Standard Protocol, version 2.2. In; 2006.
- 23.Spooner SA. 2007. Special requirements of electronic health record systems in pediatrics. Pediatrics. 119(3), 631-37 10.1542/peds.2006-3527 [DOI] [PubMed] [Google Scholar]