Skip to main content
NIHPA Author Manuscripts logoLink to NIHPA Author Manuscripts
. Author manuscript; available in PMC: 2014 Jul 15.
Published in final edited form as: Genet Med. 2013 Jul 11;15(10):786–791. doi: 10.1038/gim.2013.88

Clinical Genomics in the World of the Electronic Health Record

Keith Marsolo [1], S Andrew Spooner [1],[2]
PMCID: PMC4096770  NIHMSID: NIHMS595117  PMID: 23846403

Abstract

The widespread of adoption of EHRs presents a number of benefits to the field of clinical genomics. They include the ability to return results to the practitioner, the ability to use genetic findings in clinical decision support, and to have data collected in the EHR serve as a source of phenotypic information for analysis purposes. Not all EHRs are created equal, however. They differ in their features, capabilities and ease-of-use. Therefore, in order to understand the potential of the EHR, it is first necessary to understand its capabilities and the impact that implementation strategy has on usability. Specifically, we focus on the following areas: 1) how the EHR is used to capture data in clinical practice settings; 2) how the implementation and configuration of the EHR affects the quality and availability of data; 3) the management of clinical genetic test results and the feasibility of EHR integration; and 4) the challenges of implementing an EHR in a research-intensive environment. This is followed by a discussion of the minimum functional requirements that an EHR must meet to enable the satisfactory integration of genomic results as well as the open issues that remain.

Keywords: EHRs, EHR implementation, clinical genomics, evaluation of EHRs, functional requirements of EHRs

Introduction

Electronic Health Records (EHRs) provide a number of benefits to the field of clinical genomics. These range from the ability to return results to the practitioner, to the ability to use genetic findings in clinical decision support, to having data collected in the EHR serve as a source of phenotypic information for analysis purposes. Not all EHRs are created equal, however. They differ in terms of features, capabilities and ease-of-use. Even with a given EHR, no two customers' implementations are exactly alike since they have different institutional characteristics and clinical workflows. Therefore, in order to understand the potential of the EHR as a tool to support the practice of clinical genomics and to serve as a source of data for genomics research, it is necessary to understand the capabilities of the EHR as well as the impact that both implementation strategy and institutional characteristics have on usability. We provide an overview of these topics by focusing on the following areas: 1) how the EHR is used to capture data in clinical practice settings; 2) how the implementation and configuration of the EHR affects the quality and availability of data; 3) the management of clinical genetic test results and the feasibility of EHR integration; and 4) the challenges of implementing an EHR in a research-intensive environment. This is followed with a discussion of the minimum functional requirements that an EHR must meet to enable the satisfactory integration of genomic results and the open issues that remain.

The Use of the Ehr in Clincal Practice Settings

The EHR has become the primary source of data for the practice of clinical genetics as well as an important source of information for genomic research.

Role of the EHR in the U.S. healthcare environment

While the use of electronic health record (EHR) systems to manage patient information is not required by U.S. law, the Meaningful Use incentives from the Health Information Technology for Economic and Clinical Health (HITECH) Act, enacted as part of the American Recovery and Reinvestment Act of 20091 has compelled widespread adoption.2 The net effect of Meaningful Use (MU)3 and new electronic reporting requirements for quality measures4 is that EHRs are becoming de facto requirements for medical practice in the United States. Since the MU program is specifically aimed at the goal of meaningful information exchange (“interoperability”), the adoption of these systems has accelerated the exchange of phenotypic and genetic data. The MU ideal is that all medical information about a patient can travel with the patient regardless of care site. Such ubiquitous, long-term access has important implications for clinical genetics lab results, which have been relatively immovable in their traditional format of scanned documents accessible only to the ordering clinician..

As of 2011, 35% of hospitals and 39% of providers have adopted fully functional EHR systems.5 Given that academic centers and large group practices are the most likely to adopt EHRs, it is highly likely that a patient with a genetic condition will have some of his or her genetic information stored in an EHR and will need to transmit that data across different sites of care. The Meaningful Use program focuses heavily in its requirement to exchange medical records electronically, and, in particular, exchange laboratory results as structured data.3 The net result of the MU program is that there will be a sharp rise in the availability of computable genetic data derivable from clinical sources, compared to the former state where genetic testing existed in the form of scanned document images.

One might be tempted to imagine that this genetic laboratory data would be accompanied by a large amount of discrete phenotypic data (historical findings, physical exam descriptions, family history data, etc.) but the Meaningful Use program does not require that. In fact, such data are likely to remain in free text form indefinitely. This is because the methods required to record such findings as discrete data are both time consuming and expressively restrictive. Stage 2 of Meaningful Use requirements (which providers will begin qualifying for in 2014) require discrete family history data in primary relatives of only 20% of patients, and require no discrete data capture of the patient's historical information or physical exam findings. Factor in the highly variable extent to which providers implement fully functional systems, and it appears that a totally computable medical record may never exist in the general clinical setting.

One factor that affects the variability in the implementation of fully functional systems is the varying level of enthusiasm for this method of managing patient data. While providers seem generally satisfied at their EHR implementations,6-8 and there are scattered reports on the evidence for value of various subcomponents of EHRs,9 there remains a lack of evidence of these systems' direct positive effects on patient care.10,11 Most of the literature on the positive effects of EHRs comes from limited trails of homegrown systems designed specifically to solve a problem that is the focus of the study.9 Such results have not generally been replicated in the more typical case of the vendor-provided system, but studies are beginning to emerge.12 Another factor is cost. Despite large incentives available through the MU program, the cost—for software licensing, hardware, and training—is still substantial. The American Academy of Family Physicians estimates that the average cost for a provider in primary care practice to implement an EHR is $40,000 per provider, with additional maintenance costs.13 Estimates for specialty providers do not exist.

Variation in the quality of data in the EHR

As mentioned above, documentation within the EHR generally falls into two categories: discrete data and free text. Discrete elements are those that can be captured within a structured data collection form. Common discrete elements include allergies, immunizations, encounter diagnoses, and problems. Less commonly available as discrete data elements are presenting findings and family, surgical and social history. By capturing data in a discrete field, it is possible to use the information for reporting, analytics, and decision support. Even so, a large amount of information within the EHR is captured in the form of free text notes. This leads to a large amount of variation in the quality and completeness of the documentation, since practitioners often exercise choice in whether to record a finding as data. Only in the case where there is a financial penalty for missing data (e.g., failing to record an encounter diagnosis) can one assume reliable data entry. Natural language processing, then, is emerging as a method for EHR data analysis,14 but is still far from reliable enough to replace prospective data collection for particular purposes.15

Even in areas where EHR adoption is widespread, the only clinical data that is collected reliably enough to permit analysis remains the data that are submitted to payers in the form of claims (and the reliability of this data is contingent on the accuracy of the provider). Other data in the record, like clinical descriptions of phenotypes, remains in free text or is gathered so sporadically that valid analysis is not possible. Claims data within the EHR will typically be coded to one of the following terminologies, depending on domain:

  • ICD-9-CM: The International Classification of Diseases, Version 9, Clinical Modification has been used in the U.S. for decades to encode diagnoses in claims.16 This system is a classification system, which means that an item is a member of only one hierarchy. For example, streptococcal meningitis is a type of meningitis, but not a type of strep infection. The inflexibility of a classification system reduces ambiguity—a desirable feature in a system used to submit administrative data efficiently—but severely limits expressivity. Still, because of the long familiarity we have with ICD-9, it is often used to describe phenotypes.

  • ICD-10: As of this writing, all diagnosis data submitted with claims for payment must be encoded with the World Health Organization's ICD-10 system on October 1, 2014.17 While the rest of the industrial world moved to ICD-10 long ago, the United States has delayed its adoption owing to concerns about the cost of modifying systems to accept these codes. Once ICD-10 is in place, researchers hoping to use EHR data will have a somewhat richer terminology system to use (the 6,969 diagnosis terms in ICD-9 go to 12,420 in ICD-10).18 Still, it is a classification scheme, so expressivity is limited.

  • SNOMED-CT: The Systemized Nomenclature of Medicine-Clinical Terms is an extensive clinical terminology standard,19 endorsed by the Meaningful Use program as a general-purpose reference terminology system,20 that includes diagnoses, conditions, historical findings, exam findings, and test results. EHRs typically map ICD codes to SNOMED-CT (through proprietary terminology systems) in order to provide a more flexible method of expressing diagnostic terms. These codes may not appear to the clinical user, but are present in the data that one may extract from an EHR.

  • Procedure terminology (Current Procedural Terminology - CPT21): CPT is a code set maintained by the American Medical Association that is used to describe medical, surgical and diagnostic services that are rendered during a visit or hospital stay.

  • Diagnosis-related groups – DRGs: DRGs22 are used to classify hospital cases into groups. A case is assigned to a DRG by a “grouper” program that makes the decision based on factors like ICD diagnosis, CPT procedure, age, gender, discharge status and comorbidities.

  • Logical Observation Identifiers Names and Codes – LOINC: LOINC is a standard for identifying laboratory and clinical observations.23 The certification standards for EHRs promulgated by the ONC require that EHRs be able to accept LOINC. This will allow the exchange of laboratory results for the purposes of Meaningful Use.

  • RxNorm -- The National Library of Medicine developed this standard naming terminology that assigns a unique concept identifier for each synonymous drug term complied from several drug.24 While adoption of RxNorm is not yet widespread, it is endorsed in EHR certification guidelines for Meaningful Use, so it is expected to be widely available in the next few years. RxNorm's includes semantic relationships between concepts like “has-ingredient” for combination preparations or “has-tradename” to identify brands.

Shortcomings of terminology systems inherent in the domain of human genetics

In any area of medicine where new syndromes are described frequently, standard terminology systems are going to lag medical knowledge. Another area where terminology systems fall short is with rare syndromes. Insofar as human genetics involves many rare syndromes, with many new ones described every year, no terminology system is going to be perfectly adequate at any time. The solution is to use less specific terms, or enter syndrome names in free-text. This limits the ability to analyze data, of course.

Another factor that makes terminology systems seem inadequate for human genetics is the need to assign diagnoses to patients that consist of descriptions of chromosomal abnormalities (e.g., deletions) and specific mutations. In many cases these descriptions may not be associated with a particular clinical syndrome. In addition, patients may need to be described in terms of a mutation that they personally may not have, but for which a family member is positive. Even the family member may not have the clinical syndrome, but only the mutation, as in the sibling of a patient discovered to have a mutation for familial adenomatous polyposis coli. A pediatric genetics provider is therefore at a loss when a diagnostic terminology system does not have a “family history of” term for a specific gene mutation.

Implementation Decisions Affect Both the Quality and Availability of EHR Data

While having complete, high quality data in the EHR is ultimately reliant on having someone enter it, there are factors that influence whether robust data collection is even possible. One is the category of EHR, in particular, whether it is a homegrown, best of breed, or enterprise (i.e., vendor) system. Another relates to the configuration of the EHR, whether the system was customized for each clinic or simply deployed in a “big bang” fashion. We discuss the impact of these factors in turn.

Homegrown systems

Homegrown solutions are those that were developed at a single institution (or healthcare system) and customized for that institution's specific workflows and clinical needs. In some cases, they may have been sold to a vendor and integrated into a commercial product, but typically, they are maintained using internal institutional resources. Examples of homegrown EHRs include Vanderbilt's StarPanel and the Massachusetts General Hospital's Longitudinal Medical Record (LMR). While homegrown EHRs are appealing because they can be uniquely tailored to the needs of an institution,6,9 they are falling out of favor as the cost of maintenance and certification grows.

Best of breed

Best of breed solutions were popular in the 1990s, before enterprise EHR systems reached the level of maturity they have today. In a best of breed system, an institution would simply select the product that they thought best met the needs of each specialty or function. Since no one sold a truly integrated, institution-wide system anyway, this was a rational approach. An organization could start by implementing systems for administrative functions, then add a laboratory information management system (LIMS), a picture archiving and communication system (PACS), and defer the decision and expense of an electronic health record for later when the clinical culture was more prepared. Such a staged approach to building health information technology is described by the Health Information Management Systems Society (HIMSS) in their survey data that describes the seven stages of a hospital's maturation.25 At present (Q4 2012), only 2% of U.S. hospitals are described as being at the highest level of implementation (Stage 7), which requires a fully integrated system, while over 80% are at Stage 3 (this number includes those institutions at Stages 3-7), which only requires the installation of ancillary systems (laboratory, radiology, pharmacy), physician access to a clinical data repository for the review of order and results, nursing/clinical documentation, order-based decision support and PACS image access.26 (HIMSS has launched a similar staging system for ambulatory care.) The cost of maintaining the interfaces between best-of-breed systems usually drives larger organizations to seek an integrated solution, for which there is a burgeoning market in the Meaningful Use age.

Enterprise

With enterprise EHRs, the various components (registration, billing, laboratory, ED, inpatient, outpatient, etc.) are integrated into a single product, which uses a common data repository for all functions. While the concept of total integration is appealing, the reality is that no one is 100% integrated onto a single product. This is especially true when some of the care occurs in highly specialized clinical areas, like neonatal intensive care or genetics. The driver of information exchange promoted by Meaningful Use will tend to drive organizations to more integration, which can be seen as a threat to surviving niche applications in clinical specialty areas. The Meaningful Use driver of patient engagement will also tend to encourage integration since patients will become less tolerant of the gaps in access to their information that niche systems create.

This also means that any other activity that involves modifying the EHR, such as the integration of genomic data and results, must compete for finite set of IT resources. Those with the best chances of having resources successfully allocated will be those that are complementary to the MU priorities.

EHR configuration

Another major factor that affects the availability and usability of EHR data is the level of customization that went into the build and deployment of the EHR. When implementing an EHR, institutions tend to follow one of two paths: customized builds for specific conditions and specialties, or generic builds, where each clinic or specialty receives the default, or “model” system. With a customized build, one can create screens that allow for the collection of condition-specific information. This can often lead to increased clinician engagement, as they are able to capture the data that matters most to their particular specialty. It can also lead to more robust clinical phenotypes. There are several drawbacks, however. The creation of clinic-specific builds often leads to clinic-specific workflows within the EHR. In many EHRs, the workflow used to collect the data has an impact on where that data is stored in the underlying reporting database. Knowledge of those workflows is therefore critical when trying to work with the EHR data for analytical or research purposes. Otherwise, there is significant risk that portions of the clinic population will be excluded. Another challenge posed by customized builds is that strong institutional governance is needed to ensure that data elements are defined consistently across clinics. The same data elements should not be defined in multiple places with different names. At the same time, it might be necessary to create additional elements to capture more nuanced versions of standard data elements (blood pressure at the ankle for nephrology, instead of the standard measure at the arm). If there is a desire to share this information across institutions – for research or quality improvement purposes, for instance – then the custom data elements are typically mapped to a standard terminology (when it exists). This can also be expensive, especially for large institutions or clinics that frequently add, modify or delete data elements from their EHR data collection forms. As one might imagine, customized builds are also time consuming, making them more expensive in terms of resources. Most institutions that opt for customized EHR builds elect to implement the EHR in a phased rollout, going live with a few clinics every quarter to make the process more manageable.

Generic builds, on the other hand, simply use default workflows from the vendor's pre-configured system. Generic builds are typically used when an institution deploys the EHR in a “big bang” fashion, going live with all clinics at once. While requiring less resources and yielding a shorter implementation cycle, there are drawbacks to deploying the EHR with little in the way of customization. For institutions with sub-specialties or clinics with specialized workflows, the standard EHR build may be a poor fit and require condition-specific variables be captured in text instead of in discrete fields. If those institutions also have a research focus, clinicians may be disappointed when they realize that the only way they can “get the data out” of the EHR is in a blob of text.

The Impact of the Interface Between the Genetic Lab Management System and the EHR

To be useful as a tool for the management of genetic data, EHRs need to contain information on both patient phenotypes and genetic results. We have illustrated why the quantity and quality of phenotypic data in the EHR will depend on both the type of EHR and the level of customization. In a similar fashion, the ability to manage genetic results and leverage them for decision support also depends on the configuration of the EHR. With genetic results, the EHR can be used to store individual mutations and/or variations, a text report of the findings along with an interpretation, or both. At this point, EHRs are only able to store a handful of variants for a given test, posing a problem for next-generation or whole genome sequence results.

Because the data management and operation of a hospital's clinical lab differ greatly from that of a clinic or hospital, it is typical that labs have their own information systems and even their administrative infrastructure for managing them. Major vendors of EHRs like Cerner (Kansas City, MO) and Epic (Madison, WI) have laboratory information management systems (LIMS) that integrate with the EHR, but full implementation of both clinical information systems and LIMS under the same vendor is still rare. For this reason, interfaces are required to move orders from the EHR to the LIMS and for results to flow back to the EHR. As with all data interfaces, it is impractical or even impossible to represent the data from one system with exact fidelity in the other. For example, the LIMS may store some results as discrete data that are incorporated into a free-text report on the EHR end for the sake of feasibility. From the clinician's point of view, this free-text representation may be perfectly adequate for care of individual patients, but is inadequate to support population management or automated decision support.

EHRs have a number of ways that to accept these results. The most common method would be to transmit the results via an HL727 message as part of a two-way, real-time interface. HL7 specifies message formats that can store lab results of any type, and other clinical information. In the LIMS world, HL7 message formats are used almost universally in these interfaces. Health Information Exchanges (HIEs) can also use HL7 messages to transmit data between EHRs and between EHRs and other systems. Service-oriented architecture (SOA), or “web services” is a newer way that LIMS and EHRs may be connected. Such SOA systems may be proprietary, however, and therefore not available for general use.

A very common way that genetic results are transferred to an EHR is via a document-scanning system, in which the images of printed reports are stored in the LIS and transmitted to the EHR. This method is the least satisfactory from the point of view of interoperability, data access, computability, or security, but has been the standard method for years for dealing with the kind of complexity reflected within a genetic testing report. In some cases, EHRs allow manual entry of discrete data from results. For genetic testing, the volume of the data is not likely to lend itself to that kind of workflow.

Implementing the EHR in A Research-Intensive Environment

When an EHR is implemented in a research-intensive environment, its data must be integrated with a variety of sources

Research data management vs. clinical data management

The objective of clinical data management is first to satisfy the security requirements imposed by HIPAA and state law. After that, the big driver of clinical data management to offer highly reliable, fast access in all environments where it is reasonable to expect a need for clinical access. Research data management entails the same security concerns, but entails far more complex requirements for novel data access, analytic tools, and the ability to access data without individual identifiable health information (“protected health information” or PHI as defined by HIPAA). Because of these differing missions, the research IT administration and the clinical IT administration are often at odds on priorities. They may even be in different organizational structures—clinical IT on the hospital or practice plan side, and research IT on the academic side. To complicate matters further, formal organizational structures for quality improvement often straddle the academic and operational sides of an organization.

To succeed in an environment that is attempting to achieve ambitious clinical, research, and improvement goals, one must either consolidate all these operations into one (not usually possible) or work out boundaries of responsibility within a general agreement of cooperation. When the responsible organizations are independent, such an agreement is largely dependent on goodwill, but should be cast as a formula for mutual success. Because techniques for creating meaningful genetic data are often the topic of research, those who work with those data must engage effectively with both clinical and research IT administration—an impossible task unless the two sides work together.

Discussion – Minimum Functional Requirements of the EHR and Open Issues

While the category and configuration of the EHR have a large influence on the EHR's suitability for the optimal practice of clinical genetics, there nonetheless remains a basic set of functional requirements that every EHR must be able to satisfy. These requirements are intended to be general and not focused on specific technical details, which have been covered elsewhere. 28 They are:

  • It must be possible to store genetic test results in a discrete, computable format. Storing the various components of the result – e.g., the gene, protein/nucleotide variant, single nucleotide polymorphism (SNP), copy number variant (CNV), existence of the test result itself – in a discrete format allows them to be reasoned on within the EHR.

  • The results of a genetic test must be output in such a way that they are suitable for EHR interoperability (i.e., so that they can follow the patient as they go through transitions of care). Initially, this may just mean that it is possible to transmit the text version of the test results, but as EHRs develop the capacity to better accept discrete results, those components should be transmittable as well.

  • It should be possible to record phenotypic data in a sufficiently expressive terminology system to enable robust analysis. It should also be possible to crosswalk from the source terminology to alternate ones should the need arise. This analysis may or may not occur within the EHR itself. Ideally, EHR interoperability would evolve to the point where phenotypic data on a single patient could be pulled from multiple institutions.

  • It should be possible to expose the genetic data to clinical decision support processes in the EHR. If the EHR has a sophisticated enough rules engine, having the various components of the test result stored in a discrete format allows them to trigger various rules and processes – dosing alerts, consults, study recruitment, appointment follow-ups, etc.

  • The EHR should be able to retrieve/display external content to assist in patient/provider education about the findings. This is particularly important as the knowledge about a test or condition evolves over time. Having this information external from the EHR frees an institution from having to maintain a copy locally and keep it up-to-date.

If an EHR is able to satisfy the above criteria, then it will be possible to achieve a basic level of integration. Of course, there is a significant difference between possible and feasible, given available resources; the costs of achieving high quality discrete data in an EHR are significant. As the field evolves, additional requirements are likely to emerge, but over time, EHRs will reach a level of maturity, where most, if not all, are able to satisfy them.

While the technical barriers to EHR integration have been identified, there are a number of open social issues that remain. It will be imperative to find solutions to these problems in order to truly achieve the integration of clinical genetics into the EHR.

  • Transitions of care. Genetic test results remain relevant far longer than most other types of testing. While a peripheral white blood cell count usually loses its clinical significance after a day or so, genetic information may actually become more important years later after new knowledge can be brought to bear on it. For this reason, it will be necessary to have the ability to transmit computable genetic data that endures throughout the lifetime of the patient, and perhaps through the lifetimes of his or her offspring. There is a lack of clarity on how to effectively maintain accessibility to this information in the long-term. It is unclear on how to determine to whom this information should be transmitted as patients change locations and providers. Perhaps the responsibility should lie with the patient instead of the provider. We have not begun to answer these questions in western societies.

  • Managing results over the pediatric-adult transition. As children with chronic, heritable disease receive better treatment, they increasingly grow to an age where they need to transition from their pediatric specialty provider to an adult specialty provider.29 In the past, which dovetailed with the days of paper medical records, such transitions were less common, but the nature of paper lessened the complexity and volume of the information transfer. Because there was no better alternative, such a throttled information flow was accepted and workarounds were developed. Now, with widespread EHRs, there is no limit on the amount of text and computable information that can be transmitted. The higher bandwidth of these transitions, coupled with their increased frequency, creates special challenges to providers burdened with increased care management duties imposed by the current accountable-care trend. Given that we already have a difficult time digesting the decision support that EHR systems provide for simple matters like acute medication ordering, it is difficult to imagine how to construct effective decision support for highly complex genetic data that lands in the hands of an adult provider unaccustomed to the care of patients with pediatric illnesses.30

  • Changes in genetic testing technology. When tests become more sensitive or more of them are run, it has the potential to affect clinical significance. This makes older results less useful. For these tests, should interpretations be updated as more tests are generated and more clinical information becomes available? If so, who bears the responsibility for communicating and educating the patient?

It is likely that the clinical genetics community will grapple with these issues for some time. They make many of the technical issues with integration, which are daunting, appear much more tractable. The interoperability requirements of Meaningful Use may enable progress in these areas, but effective solutions may require larger re-engineering.

Acknowledgments

This work was funded in part by grant award U01HG006828 as well as internal funding from Cincinnati Children's Hospital Medical Center. The views expressed are those of the authors.

Footnotes

Conflict of interest statement: The authors report no conflict of interest.

References

  • 1.Blumenthal D. Launching HITECH. N Engl J Med. 2010 Feb 4;362(5):382–385. doi: 10.1056/NEJMp0912825. [DOI] [PubMed] [Google Scholar]
  • 2.Charles D, King J, Patel V, Furukawa MF. ONC Data Brief■ No 9■ March 2013 Adoption of Electronic Health Record Systems among US Non-federal Acute Care Hospitals: 2008-2012 [Google Scholar]
  • 3.Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. New England Journal of Medicine. 2010;363(6):501–504. doi: 10.1056/NEJMp1006114. [DOI] [PubMed] [Google Scholar]
  • 4.PQRS. Physician Quality Reporting System. [Accessed April 11, 2013];2013 http://www.cms.gov/pqrs.
  • 5.HealthIT Dashboard. [Accessed April 11, 2013];2013 http://dashboard.healthit.gov/
  • 6.Sittig DF, Kuperman GJ, Fiskio J. Evaluating physician satisfaction regarding user interactions with an electronic medical record system. Proceedings / AMIA … Annual Symposium AMIA Symposium. 1999:400–404. [PMC free article] [PubMed] [Google Scholar]
  • 7.O'Connell RT, Cho C, Shah N, Brown K, Shiffman RN. Take note(s): differential EHR satisfaction with two implementations under one roof. J Am Med Inform Assn. 2004;11(1):43–49. doi: 10.1197/jamia.M1409. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Edsall RL, Adler KG. The 2012 EHR User Satisfaction Survey. 2011 [PubMed] [Google Scholar]
  • 9.Chaudhry B, Wang J, Wu S, et al. Systematic review: Impact of health information technology on quality, efficiency, and costs of medical care. Annals of internal medicine. 2006;144(10):742–752. doi: 10.7326/0003-4819-144-10-200605160-00125. [DOI] [PubMed] [Google Scholar]
  • 10.Kern LM, Barron Y, Dhopeshwarkar RV, Edwards A, Kaushal R. Electronic health records and ambulatory quality of care. Journal of general internal medicine. 2013 Apr;28(4):496–503. doi: 10.1007/s11606-012-2237-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Poon EG, Wright A, Simon SR, et al. Relationship between use of electronic health record features and health care quality: results of a statewide survey. Med Care Mar. 2010;48(3):203–209. doi: 10.1097/MLR.0b013e3181c16203. [DOI] [PubMed] [Google Scholar]
  • 12.Bright TJ, Wong A, Dhurjati R, et al. Effect of Clinical Decision-Support SystemsA Systematic Review. Annals of internal medicine. 2012;157(1):29–43. doi: 10.7326/0003-4819-157-1-201207030-00450. [DOI] [PubMed] [Google Scholar]
  • 13.Mitchell D. FPs Stack Up Well in Implementing EHRs. [Accessed April 11, 2013];2011 http://www.aafp.org/online/en/home/publications/news/news-now/ehr/20110401ehrstats.html.
  • 14.Nadkarni PM, Ohno-Machado L, Chapman WW. Natural language processing: an introduction. J Am Med Inform Assn. 2011 Sep 1;18(5):544–551. doi: 10.1136/amiajnl-2011-000464. 2011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Meystre SM, Savova GK, Kipper-Schuler KC, Hurdle JF. Extracting information from textual documents in the electronic health record: a review of recent research. Yearb Med Inform. 2008;35:128–144. [PubMed] [Google Scholar]
  • 16.ICD-9-CM. [Accessed April 11, 2013];2013 http://www.cms.gov/Medicare/Coding/ICD9ProviderDiagnosticCodes/index.html.
  • 17.ICD-10. About ICD-10. [Accessed April 11, 2013]; Available at. [Google Scholar]
  • 18.FAQ on ICD. [Accessed April 11, 2013]; http://www.who.int/classifications/help/icdfaq/en/index.html.
  • 19.SNOMED CT. [Accessed April 11, 2013]; http://www.ihtsdo.org/snomed-ct/
  • 20.Medicare and Medicaid Programs. Services DoHaH, editor. Electronic Health Record Incentive Program - Stage 2. 42 CFR Parts 412, 413 and 495. Federal Registry 2012. [PubMed] [Google Scholar]
  • 21.CPT - Current Procedural Terminology. [Accessed April 11, 2013];2013 http://www.ama-assn.org/ama/pub/physician-resources/solutions-managing-your-practice/coding-billing-insurance/cpt.page.
  • 22.Fetter RB, Shin Y, Freeman JL, Averill RF, Thompson JD. Case mix definition by diagnosis-related groups. Med Care. 1980 Feb;18(2 Suppl):iii, 1–53. [PubMed] [Google Scholar]
  • 23.Logical Observation Identifiers Names and Codes. [Accessed April 11, 2013]; http://loinc.org.
  • 24.RxNorm. [Accessed April 11, 2013]; http://rxnav.nlm.nih.gov/
  • 25.HIMSS Analytics - Structure and Stage Detail. [Accessed April 11, 2013];2013 http://www.himssanalytics.org/docs/HA_EMRAM_Overview_Eng011812.pdf.
  • 26.Electronic Medical Record Adoption Model (EMRAM) [Accessed April 11, 2013];2013 http://www.himssanalytics.org/emram/scoreTrends.aspx.
  • 27.Health Level 7. [Accessed April 11, 2013]; http://www.hl7.org.
  • 28.Masys DR, Jarvik GP, Abernethy NF, et al. Technical desiderata for the integration of genomic data into Electronic Health Records. Journal of biomedical informatics. 2012;45(3):419–422. doi: 10.1016/j.jbi.2011.12.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.American Academy of Pediatrics AAoFP, American College of Physicians TCRAG. Supporting the Health Care Transition From Adolescence to Adulthood in the Medical Home. Pediatrics. 2011 Jul 1;128(1):182–200. doi: 10.1542/peds.2011-0969. 2011. [DOI] [PubMed] [Google Scholar]
  • 30.Fortuna RJ, Ting DY, Kaelber DC, Simon SR. Characteristics of Medicine-Pediatrics Practices: Results From the National Ambulatory Medical Care Survey. Academic Medicine. 2009;84(3):396–401. doi: 10.1097/ACM.0b013e3181970bb9. 310.1097/ACM.1090b1013e3181970bb3181979. [DOI] [PubMed] [Google Scholar]

RESOURCES