Abstract
Problems in the structure, consistency, and completeness of electronic health record data are barriers to outcomes research, quality improvement, and practice redesign. This nonexperimental retrospective study examines the utility of importing de-identified electronic health record data into an external system to identify patients with and at risk for essential hypertension. We find a statistically significant increase in cases based on combined use of diagnostic and free-text coding (mean = 1,256.1, 95% CI 1,232.3–1,279.7) compared to diagnostic coding alone (mean = 1,174.5, 95% CI 1,150.5—1,198.3). While it is not surprising that significantly more patients are identified when broadening search criteria, the implications are critical for quality of care, the movement toward the National Committee for Quality Assurance's Patient-Centered Medical Home program, and meaningful use of electronic health records. Further, we find a statistically significant increase in potential cases based on the last two or more blood pressure readings greater than or equal to 140/90 mm Hg (mean = 1,353.9, 95% CI 1,329.9—1,377.9).
Key words: electronic health record, data quality, outcomes research, quality care, hypertension, registry
Introduction
The benefits of electronic health records (EHRs) for primary care and the application of these systems to outcomes research and current efforts in practice redesign such as the National Committee for Quality Assurance's Patient-Centered Medical Home program are often hampered by barriers to full integration of EHRs. Common barriers include lack of trust in EHRs to securely store medical records,1, 2, 3, 4, 5 physicians’ views that EHRs interfere with clinical judgment;6, 7 lack of standards in data formatting and lack of interoperability;8, 9, 10, 11, 12, 13, 14, 15, 16 the required time, training, and investment to become proficient in using the systems;17, 18, 19, 20, 21, 22 the absence of local leadership to champion the systems;23, 24, 25, 26, 27, 27 difficulties in organizational redesign to use the EHR;28, 29, 30, 31, 32, 33, 34 and lack of readiness to implement EHRs successfully.35, 36, 37 We sought to examine one problem—the structure, consistency, and completeness of EHR data—by importing de-identified EHR data into an external system for analysis of diagnostic information.
Background
EHRs have the potential to be valuable tools for health outcomes research in primary care38, 39, 40, 41, 42, 43 and a critical component in practice redesign and prevention of chronic diseases such as hypertension through identification of at-risk patients.44, 45 While manual review of medical records is resource intensive,46 using diagnosis codes stored within EHRs permits searching in a more comprehensive and efficient manner.47 However, problems in the structure, consistency, and completeness of EHR data and the use of free-text entries rather than discrete data fields48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58 create barriers to research, outcomes reporting, and quality improvement activities, particularly among smaller, rural practices.59, 60, 61, 62, 63, 64, 65
Given the challenges created by free-text data entry into EHRs, the current study examines the ability to identify cases with essential hypertension by importing de-identified EHR data from 11 West Virginia primary care centers into an external system, in this case a public-domain patient registry. An advantage of the registry is that it is accessible at the practice level and requires no programming or statistical expertise to use. This study examines whether patients with a diagnosis of essential hypertension are missed if searching only by International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) diagnostic codes (401.0–401.9). ICD-9-CM coding is currently used in this particular EHR system. We test the hypothesis that there will be significantly fewer patients identified with hypertension based on ICD-9-CM diagnosis codes relative to use of diagnosis codes plus free-text coding of hypertension. Support of this hypothesis would document the benefits of auditing EHR data for completeness and consistency, inform quality improvement efforts in overcoming barriers to EHR data quality and reliability, and support the National Committee for Quality Assurance health information framework, which highlights the need for interventions designed to improve the management and application of EHR data for research and quality improvement. Improving the management and application of EHR data has gained increased attention as a vital component in the overall success of health information technology endeavors.66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76 Secondarily, we hypothesize that significantly more cases will be identified through a third measure based on the guidelines for diagnosis of hypertension presented in the Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure (two or more most recent blood pressure readings greater than or equal to 140/90 mm Hg among those without any diagnosis of essential hypertension).77 This third measure identifies those at risk for or undiagnosed with hypertension, and would help document the benefits of analyzing EHR data in an external format.
Methods
This research is a nonexperimental retrospective study of essential hypertension cases identified across 11 West Virginia primary care centers using the same EHR system. We used a previously developed tool to import data from the EHRs into the Chronic Disease Electronic Management System (CDEMS).78 CDEMS is a Microsoft Access–based public-domain registry originally developed by the Washington State Department of Health. Moving the de-identified EHR data to an external system, in this case a registry, allows for data transparency in that key data within the EHR (i.e., patient diagnoses, demographics, vitals, laboratory results and services) can be queried for coding consistency and completeness. Table 1 lists all data elements imported from the EHR into the registry. This registry was chosen as the tool for analysis because it is accessible by each primary care center, allowing methods and tools for this research to be applied at the practice level for quality improvement efforts in data management, identification of at-risk patients, and quality-of-care improvement. De-identified data included in this analysis are for all active patients in the 11 sites as of December 31, 2010.
Table 1.
Registry Data Fields Imported from the Electronic Health Record
Field Name | Description |
patient_ID | Auto-generated ID used in the creation of de-identified data files |
clinic_code | Used for subgrouping of patient populations (identifies site at which care is being provided) |
sex | Sex |
ethnicity | Ethnicity |
insurance | Insurance classification (i.e., Medicare, Medicaid, commercial insurance, uninsured) |
start date | Date on which patient was added to the electronic record |
migrant | Migrant status (Yes/No) |
homeless | Homeless status (Yes/No) |
raw_code (health) | Health condition |
start_date (health) | Date on which diagnosis was added to the patient health profile |
end_date (health) | Date on which diagnosis was archived in the patient health profile |
raw_code (lab) | Laboratory test |
result (lab) | Laboratory result |
service_date (lab) | Date on which lab result was received |
raw_code (service) | Service |
result (service) | Service result |
service_date (service) | Date on which service was provided |
raw_code (medication) | Medication |
start_date (medication) | Date on which medication was prescribed |
end_date (medication) | Date on which medication was discontinued |
visit date | Date on which office visit occurred |
bp_systolic | Systolic blood pressure (linked to visit_date) |
bp_diastolic | Diastolic blood pressure (linked to visit_date) |
weight | Weight (linked to visit_date) |
height | Height (linked to visit_date) |
waist_circ | Waist circumference (linked to visit_date) |
Queries were built in the registry to search the de-identified EHR data to 1) identify unduplicated patients with a diagnosis of essential hypertension based on ICD-9-CM codes (using the diagnosis and demographic portions of the data); 2) identify unduplicated patients with a diagnosis of essential hypertension based on free-text entries (using the diagnosis and demographic portions of the data); and 3) identify unduplicated patients whose last two or more blood pressure readings were greater than or equal to 140/90 mm Hg and who did not have a documented diagnosis of essential hypertension in either ICD-9-CM code or free-text format (using the diagnosis, demographic, and vital signs portions of the data). Table 2 provides a listing of queries used to identify patients, a description of the functions of each query, and a list of the free-text diagnoses that were detected. Identification of patients with a diagnosis of essential hypertension by ICD-9-CM code was accomplished by limiting search criteria to codes 401.0–401.9. Identification of patients with a free-text diagnosis of essential hypertension required more search steps. Search of the diagnosis field called “Other” required use of the LIKE condition function in
Table 2.
Query Names and Descriptions
Sequence Number | Description of the Query Function | |
---|---|---|
1 | Returns the number of patients with a diagnosis of essential hypertension in the EHR by ICD-9-CM codes of 401.0-401.9, by site. | |
2 | Builds on the prior query to return the number of unduplicated patients with a diagnosis of essential hypertension in the EHR based on an ICD-9-CM code of 401.0–401.9, by site. | |
3 | Returns the number of active patients with a diagnosis of “Other” and then free-text documentation of essential hypertension in the EHR, by site. The following free-text diagnoses were found: | |
OTHER | HTN | |
OTHER | HTN, ESSENTIAL | |
OTHER | HTN since 2008 | |
OTHER | HTN. | |
OTHER | HTN DIET CONTROLED | |
OTHER | HTN CHONIC. | |
OTHER | ISTORY OF HYPERTENSION | |
OTHER | IGH BLOODPRESSURE | |
OTHER | IGH BLOOD PRESSURE | |
OTHER | TN, mild | |
OTHER | IGH BLOOD PRESSURE | |
OTHER | X HYPERTENSION | |
OTHER | IGH BLOOD PRESSUER | |
OTHER | TN, UNCONTROLLED | |
OTHER | TN, UNTREATED | |
OTHER | TPERTENSION | |
OTHER | IGH BLLOD PRESSURE | |
OTHER | X HTN | |
OTHER | IASTOLIC HYPERTENSION | |
OTHER | X HYPERTENSION. | |
OTHER | X OF HTN | |
OTHER | X OF HYPERTENSION | |
OTHER | X OF HYPERTENTSION | |
OTHER | YEPRTENSION | |
OTHER | YERTENSION | |
OTHER | TPERTENSION WITH LVH | |
OTHER | 401.9 HYPERTENSION | |
OTHER | YPERTENSION | |
OTHER | 1. HYPERTENSION | |
OTHER | 401.0 | |
OTHER | 401.01 | |
OTHER | 401.1 | |
OTHER | 401.1 HTN | |
OTHER | 401.1 HTN | |
OTHER | 401.12 | |
OTHER | 401.219 | |
OTHER | 401.25 | |
OTHER | 401.4 | |
OTHER | ELEVATED BP | |
OTHER | 401.9 HYPERTENSION | |
OTHER | IGH BLOOD PRESSURE | |
OTHER | 401.90 | |
OTHER | benigh essential HYPERTESION | |
OTHER | BENIGN ESSENTIAL HYPERTENSION | |
OTHER | BENIGN ESSENTIAL HYPERTENSION | |
OTHER | BLOOD PRESSURE HIGH | |
OTHER | YPER TENSION | |
OTHER | YPEERTENSION | |
OTHER | ESSENTIAL HYPERTENSION | |
OTHER | I NML HYPERTENSION | |
OTHER | 401.9 | |
OTHER | YPERTESNION | |
OTHER | YPERTENSION/NEW. | |
OTHER | YPTERTENSION | |
OTHER | YPTERNSION | |
OTHER | YPRERTENSION | |
OTHER | YPPERTENSION | |
OTHER | MILD HYPERTENSION | |
OTHER | YPERYTENSION | |
OTHER | YPERTENTISON | |
OTHER | YPERTENTION | |
OTHER | YPERTENSTION. | |
OTHER | YPERTENSTION | |
OTHER | YPERTENSON | |
OTHER | YHPERTENSION | |
OTHER | YPETENSION | |
OTHER | SYSTOLIC HYPERTENSION | |
OTHER | STABLE CARDIOMEGALY W/MILD VENOUS | |
OTHER | YPERTENSION | |
OTHER | SIGNIFICANT FOR HYPERTENSION | |
OTHER | Severe Hypertension | |
OTHER | RESISTANT HYPERTENSION | |
OTHER | Malignant Hypertension | |
OTHER | YPERTENSION/HI NML. | |
OTHER | porly controlled HTN | |
OTHER | YPERTENISON | |
OTHER | YPERTENSION– | |
OTHER | YPERTENSION 2007 | |
OTHER | YPERTENSION | |
OTHER | YPERTENSIOIN | |
OTHER | YPERTENSION () | |
OTHER | YPERTENSIION, UNCONTROLLED | |
OTHER | YPERTENSION. | |
OTHER | YPERTENIOSN | |
OTHER | YPERTENION. | |
OTHER | YPERTENION | |
OTHER | YPERTEENSION UNCONTROLLED | |
OTHER | ypert | |
OTHER | YPER TENSION. | |
OTHER | YPERTENSIN | |
OTHER | YPERTENSION UNCONTROLLED | |
OTHER | YPERTENSION/EPISODE. | |
OTHER | YPERTENSION/DIASTOLIC DYSTXN | |
OTHER | YPERTENSION/DIASTOLIC | |
OTHER | YPERTENSION. | |
OTHER | YPERTENSION, CONTROLLED | |
OTHER | YPERTENSION - STAGE II | |
OTHER | YPERTENSION W/TACHY CARDIA | |
OTHER | UNCONTROLLED HYPERTENSION | |
OTHER | YPERTENSION SYST. | |
OTHER | YPERTENSION NEW. | |
OTHER | YPERTENSION LVH | |
OTHER | YPERTENSION ESSENTIAL | |
OTHER | YPERTENSION CHR. | |
OTHER | YPERTENSION 401.9 | |
OTHER | YPERTENSION WITH ELEVATED WEDP | |
4 | Builds on the prior query to return the number of unduplicated patients with a free-text diagnosis of essential hypertension, by site. | |
5 | Locates duplicate patient records within the list of patients by ICD-9-CM code and unduplicated patients by free text and determines the total number of unduplicated patients with a diagnosis of essential hypertension, by site. | |
6 | Returns a list of all blood pressure readings, by patient, that are greater than or equal to 140/90 mm Hg, by site. | |
7 | Builds on the prior query to return a list of all patients whose most recent two or more blood pressure readings are greater than or equal to 140/90 mm Hg, by site. | |
8 | Returns a list of patients whose most recent two or more blood pressure readings are consistently greater than or equal to 140/90 mm Hg without a diagnosis of essential hypertension by ICD-9-CM code or by free text, by site. |
Microsoft Access, also known as wildcards, to locate all matching criteria. Wildcard expressions used in the search were “*Hyperten*”; “*HTN*”; “*401*”; and “*Hyper ten*”. Upon review of all free-text results, it was evident that the search returned results relating to other forms of hypertension that needed to be excluded in this study. Excluded from search criteria were the following: “*Pulm*”; “*Neph*”;
“*Coat*”; “*Retino*”; “*Pre*”; “*Ocul*”; “*Occul*”; “*Portal*”; “*Gastro*”; “*Partum*”; “*Ortho*”;
“*Oval*”; “*Border*”; “*Myopathy*”; “*Medic*”; “*Renal*”; “*Venous*”; “*FH*”; “*Family*”; “*Gest*”; “*Decea*”; “*Tight*”; “*Disea*”; “*Infar*”; “*Intracran*”; and “*Elevated*”. Means, standard deviations, and 95 percent confidence intervals were calculated for the number of cases to measure the differences between each method.
Results
Based on use of ICD-9-CM codes alone, 12,919 unduplicated patients with essential hypertension were identified in the 11 sites. Searching free-text diagnoses, 898 additional unduplicated patients were identified. Broadening the search criteria to patients whose last two or more blood pressure readings were consistently greater than or equal to 140/90 mm Hg identifies an additional 1,076 unduplicated patients not identified by ICD-9-CM codes or free-text entries (range = 297). Use of all three methods identified 14,893 cases. Table 3 presents these findings.
Table 3.
Count of Patients with Essential Hypertension, by Search Criteria
Search Criteria | Number | Number Added | Cumulative Percent |
Patient count by ICD-9-CM code | 12,919 | — | 86.7 |
Patient count by ICD-9-CM code plus free text | 13,817 | 898 | 92.8 |
Patient count by ICD-9-CM code plus free text plus last two or more blood pressure readings greater than or equal to 140/90 mm Hg | 14,893 | 1,076 | 100.0 |
Total | 1,974 | — |
Placing confidence intervals around the means of each patient count method, we find a statistically significant increase in total cases identified with essential hypertension based on combined use of ICD-9-CM coding and free text (mean = 1,256.1, 95% CI = 1,232.3–1,279.7) compared to ICD-9-CM coding alone (mean = 1,174.5, 95% CI = 1,150.5–1,198.3). Furthermore, we find a statistically significant increase in identification of potential cases based on cases in which the last two or more blood pressure readings were greater than or equal to 140/90 mm Hg (mean = 1,353.9, 95% CI = 1,329.9–1,377.9) compared to ICD-9-CM coding plus free-text search. Use of only ICD-9-CM codes missed 13.3 percent of cases as identified using all three methods. Table 4 and Figure 1 present these findings.
Table 4.
Increase in Count of Patients with Essential Hypertension, by Search Criteria and Primary Care Center
Primary Care Center | A: Patients with Hypertension: ICD-9-CM Coding | B: Patients with Hypertension: ICD-9-CM Coding Plus Free Text | C: Patients with Hypertension: ICD-9-CM Coding Plus Free Text Plus Last 2+ Blood Pressure Readings =140/90 mm Hg | Percent Missed Based on ICD-9-CM Coding Only (100% – AC) |
---|---|---|---|---|
A | 5,124 | 5,270 | 5,535 | 7.4% |
B | 1,605 | 1,868 | 1,945 | 17.5% |
C | 476 | 505 | 596 | 20.1% |
D | 658 | 660 | 724 | 9.1% |
E | 852 | 859 | 884 | 3.6% |
F | 313 | 313 | 325 | 3.7% |
G | 228 | 418 | 438 | 47.9% |
H | 396 | 407 | 446 | 11.2% |
I | 666 | 714 | 749 | 11.1% |
J | 1,143 | 1,217 | 1,526 | 25.1% |
K | 1,458 | 1,586 | 1,725 | 15.5% |
Sum | 12,919 | 13,817 | 14,893 | 13.3% |
Mean | 1,174.45 | 1,256.09 | 1,353.91 | |
Standard Deviation | 1,386.60 | 1,424.08 | 1,492.58 | |
95% CI, Lower | 1,150.49 | 1,232.26 | 1,329.93 | |
95% CI, Upper | 1,198.31 | 1,279.74 | 1,377.87 |
Note.
Figure shows statistically significant increases in identification of essential hypertension cases using three search criteria methods. Electronic health record data are from all active patients in each primary care center as of December 31, 2010.
Discussion
By auditing EHR data in an external system, this study finds significant limitation in the ability to identify patients with a diagnosis of essential hypertension due to the use of free-text diagnosis entries. This study allows for the identification of a problem in data quality and completeness, and is translational in nature in that the study methods and tools are accessible to each site to monitor documentation processes and make adjustments as needed without time-intensive chart reviews or special programming. Further, importing the EHR data into an external system allows for analysis of blood pressure results to identify patients either undiagnosed with or at risk for development of the condition.
While it may not be surprising that significantly more patients are identified when broadening the search criteria, the implications are critical for quality of care because the identification of patients by health condition is a fundamental step in the process of applying data for quality improvement and reporting. Furthermore, the ability to accurately report data at the population level is central to the Patient-Centered Medical Home program and to meaningful use criteria. The inability to capture all patients by health condition yields reports for Patient-Centered Medical Home and meaningful use purposes that are inaccurate. Likewise, EHRs offer the promise of better patient care through decision support tools such as those that suggest care guidelines and treatment based on a patient's health condition. However, problems in data quality can result in lower levels of provider trust in the data and the therefore decreased application of EHR data to patient care. Auditing data within the EHR can help identify these problems and provide the opportunity to correct them, for example, through training on the use of EHRs and through development of practice policies and procedures aimed at eliminating free-text entry of diagnoses. While it may not be feasible to alter the structure or functions of the EHR, it is reasonable to expect that quality improvement efforts centered on training and practice policies will help overcome barriers to data quality.
The substantial variability between clinics that was detected enables identification of clinics that follow best practices (i.e., those with relatively low proportions of diagnoses of hypertension recorded by free text, such as clinics E and F in Table 4), from which other sites can learn and apply documentation practices and policies. Likewise, this analysis aids in identifying clinics at which data management support and follow-up training is warranted (e.g., clinics J and G in Table 4). While clinic-level variability is not addressed within this study, results from this research allow for follow-up research efforts to be designed and conducted with these sites.
Conclusions
Our study reported significant loss in the ability to identify essential hypertension cases due to use of free-text coding. However, the study methods and tools offer translational opportunities at the primary care level, enabling each participating site to use these methods and tools to improve their own office procedures, training, and policies surrounding data entry into EHRs. This study highlights the need for training in data quality and management, even on basic levels such as using EHR templates and discrete fields for data entry rather than free-text fields. Targeted training is advisable because various members of a care team, such as physicians, nurses, medical assistants, and front-office staff, contribute data to the EHR at various points in the care process. Continued monitoring of these sites using tools developed in this research will help determine the long-term benefits of increased attention to EHR data quality. It is reasonable to expect that efforts to improve data quality will bolster improved integration of these systems while also facilitating the use of EHRs for quality-of-care improvement and efforts in practice redesign.
This study points to the need for future research. First, only essential hypertension was studied. Additional health conditions, such as other forms of hypertension, comorbid cardiovascular health conditions, diabetes, or chronic kidney disease, need to be examined. Second, the de-identified data are from only one EHR system. Future research needs to account for data from other systems to see if these findings are replicated. Third, patients with consistently high blood pressure readings need clinical follow-up to determine whether or not they have hypertension. Lastly, additional analyses are needed to account for patient age criteria (i.e., 25–79 years of age) when identifying patients with hypertension. The intent of this research was to identify patients with essential hypertension regardless of age or demographic criteria, thereby permitting initial exploration of the ability to conduct a more rigorous level of analysis of EHR data through importation of data into an external system.
Acknowledgments
The authors would like to acknowledge the support of ongoing partnership with the West Virginia Bureau for Public Health, Office of Community Health Systems and Health Promotion.
Contributor Information
Adam Baus, the Office of Health Services Research in the West Virginia University Department of Community Medicine in Morgantown, WV..
Michael Hendryx, the West Virginia Rural Health Research Center in Morgantown, WV..
Cecil Pollard, the Office of Health Services Research in the West Virginia University Department of Community Medicine in Morgantown, WV..
Notes
- 1.Wagner K.A, Lee F. W, White A. W, Ward D. M, Ornstein S. M. “Impact of an Electronic Medical Record System on Community-based Primary Care Clinics”. Journal of the American Board of Family Practice. 2000;13(no. 5):338–48. [PubMed] [Google Scholar]
- 2.Kaushal R, Bates D. W, Poon E. G, Jha A. K, Blumenthal D. “Functional Gaps in Attaining a National Health Information Network”. Health Affairs. 2005;24(no. 5):1281–89. doi: 10.1377/hlthaff.24.5.1281. [DOI] [PubMed] [Google Scholar]
- 3.Burton L.C, Anderson G. F, Kues I. W. “Using Electronic Health Records to Help Coordinate Care”. Milbank Quarterly. 2004;82(no. 3):457–81. doi: 10.1111/j.0887-378X.2004.00318.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Miller R.H, Sim I. “Physicians’ Use of Electronic Medical Records: Barriers and Solutions”. Health Affairs. 2004;23(no. 2):116–26. doi: 10.1377/hlthaff.23.2.116. [DOI] [PubMed] [Google Scholar]
- 5.Kristianson K, Ljunggren H, Gustafsson L. “Data Extraction from a Semi-structured Electronic Medical Record System for Outpatients: A Model to Facilitate the Access and Use of Data for Quality Control and Research”. Health Informatics Journal. 2009;15(no. 4):305–19. doi: 10.1177/1460458209345889. [DOI] [PubMed] [Google Scholar]
- 6.Rousseau N, McColl E, Newton J, Grimshaw J, Eccles M. “Practice Based, Longitudinal, Qualitative Interview Study of Computerised Evidence Based Guidelines in Primary Care”. British Medical Journal. 2003;326(2):314–22. doi: 10.1136/bmj.326.7384.314. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Hanna K.E, Anderson S. M, Maddox S. D. Think Research: Using Electronic Medical Records to Bridge Patient Care and Research. Washington, DC: Center for Accelerating Medical Solutions; 2005. [Google Scholar]
- 8.Burton, L. C., G. F. Anderson, and I. W. Kues. “Using Electronic Health Records to Help Coordinate Care.” [DOI] [PMC free article] [PubMed]
- 9.Miller, R. H., and I. Sim. “Physicians’ Use of Electronic Medical Records: Barriers and Solutions.” [DOI] [PubMed]
- 10.Hanna, K. E., S. M. Anderson, and S. D. Maddox. Think Research: Using Electronic Medical Records to Bridge Patient Care and Research
- 11.Amatayakul M. “EHR? Assess Readiness First”. Healthcare Financial Management. 2005;59(no. 5):112–13. [PubMed] [Google Scholar]
- 12.Bristol N. “The Muddle of US Electronic Medical Records”. Lancet. 2005;365(no. 9471):1610–11. doi: 10.1016/S0140-6736(05)66492-6. [DOI] [PubMed] [Google Scholar]
- 13.Taylor R, Bower A, Girosl F, Bigelow J, Fonkych K, Hillstead R. “Promoting Health Information Technology: Is There a Case for More-Aggressive Government Action?”. Health Affairs. 2005;24(no. 5):1234–45. doi: 10.1377/hlthaff.24.5.1234. [DOI] [PubMed] [Google Scholar]
- 14.Goldschmidt P.G. “HIT and MIS: Implications of Health Information Technology and Medical Information Systems”. Communications of the ACM. 2005;48(no. 10):69–74. [Google Scholar]
- 15.Bradley C.J, Penberthy L, Devers K. J, Holden D. J. “Health Services Research and Data Linkages: Issues, Methods, and Directions for the Future”. Health Services Research. 2010;45(no. 5):1468–88. doi: 10.1111/j.1475-6773.2010.01142.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Baron R.J. “Quality Improvement with an Electronic Health Record: Achievable, But Not Automatic”. Annals of Internal Medicine. 2007;147(no. 8):549–52. doi: 10.7326/0003-4819-147-8-200710160-00007. [DOI] [PubMed] [Google Scholar]
- 17.Wagner, K. A., F. W. Lee, A. W. White, D. M. Ward, and S. M. Ornstein. “Impact of an Electronic Medical Record System on Community-based Primary Care Clinics.” [PubMed]
- 18.Kristianson, K., H. Ljunggren, and L. Gustafsson. “Data Extraction from a Semi-structured Electronic Medical Record System for Outpatients: A Model to Facilitate the Access and Use of Data for Quality Control and Research.” [DOI] [PubMed]
- 19.Hersh W.R. “Medical Informatics: Improving Health Care through Information”. Journal of the American Medical Association. 2002;288(no. 16):1955–58. doi: 10.1001/jama.288.16.1955. [DOI] [PubMed] [Google Scholar]
- 20.Walsh S.H. “The Clinician's Perspective on Electronic Health Records and How They Can Affect Patient Care”. British Medical Journal. 2004;328(no. 7449):1184. doi: 10.1136/bmj.328.7449.1184. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.May J. “The Electronic Medical Record: A Valuable Partner”. Journal of Medical Practice Management. 2005;21(no. 2):100–102. [PubMed] [Google Scholar]
- 22.Bates D.W. “Physicians and Ambulatory Electronic Health Records”. Health Affairs. 2005;24(no. 5):1180–89. doi: 10.1377/hlthaff.24.5.1180. [DOI] [PubMed] [Google Scholar]
- 23.Wagner, K. A., F. W. Lee, A. W. White, D. M. Ward, and S. M. Ornstein. “Impact of an Electronic Medical Record System on Community-based Primary Care Clinics.” [PubMed]
- 24.Burton, L. C., G. F. Anderson, and I. W. Kues. “Using Electronic Health Records to Help Coordinate Care.” [DOI] [PMC free article] [PubMed]
- 25.Lorenzi N.M, Riley R. T, Blyth A. J. C, Southon G, Dixon B. J. “Antecedents of the People and Organizational Aspects of Medical Informatics”. Journal of the American Medical Informatics Association. 1997;4(no. 2):79–93. doi: 10.1136/jamia.1997.0040079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Doolan D.F, Bates D. W, James B. C. “The Use of Computers for Clinical Care: A Case Series of Advanced US Sites”. Journal of the American Medical Informatics Association. 2003;10:94–107. doi: 10.1197/jamia.M1127. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Miller R.H, Sim I, Newman J. Electronic Medical Records: Lessons from Small Physician Practices. San Francisco: California HealthCare Foundation; 2003. [Google Scholar]
- 28.Baron, R. J. “Quality Improvement with an Electronic Health Record: Achievable, But Not Automatic.” [DOI] [PubMed]
- 29.Hersh, W. R. “Medical Informatics: Improving Health Care through Information.” [DOI] [PubMed]
- 30.Lorenzi, N. M., R. T. Riley, A. J. C. Blyth, G. Southon, and B. J. Dixon. “Antecedents of the People and Organizational Aspects of Medical Informatics.” [PubMed]
- 31.Bergh M. “Patient Care Information Systems and Health Care Work: A Sociotechnical Approach”. International Journal of Medical Informatics. 1999;55(no. 2):87–101. doi: 10.1016/s1386-5056(99)00011-8. [DOI] [PubMed] [Google Scholar]
- 32.Lorenzi N.M, Riley R. T. “Managing Change: An Overview”. Journal of the American Medical Informatics Association. 2000;7(no. 2):116–24. doi: 10.1136/jamia.2000.0070116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Kuhn K.A, Guise D. A. “From Hospital Information Systems to Health Information Systems”. Methods of Medical Informatics. 2001;40(no. 4):275–87. [PubMed] [Google Scholar]
- 34.Vishwanath A, Singh S. R, Winkelstein P. “The Impact of Electronic Medical Record Systems on Outpatient Workflows: A Longitudinal Evaluation of Its Workflow Effects”. International Journal of Medical Informatics. 2010;79(2):778–91. doi: 10.1016/j.ijmedinf.2010.09.006. [DOI] [PubMed] [Google Scholar]
- 35.Burton, L. C., G. F. Anderson, and I. W. Kues. “Using Electronic Health Records to Help Coordinate Care.” [DOI] [PMC free article] [PubMed]
- 36.Amatayakul, M. “EHR? Assess Readiness First.” [PubMed]
- 37.Harris, K. D., J. T. Parsons, and R. Jimenez. “Developing a Methodology for the Customization of an Electronic Medical Record in a Rural Health Care Setting.” Arizona School of Health Sciences, Sun Life Community Health Center, n.d.
- 38.Hanna, K. E., S. M. Anderson, and S. D. Maddox. Think Research: Using Electronic Medical Records to Bridge Patient Care and Research
- 39.Terry, A. L., V. Chevendra, A. Think, M. Stewart, J. N. Marshall, and S. Cejic. “Using Your Electronic Medical Record for Research: A Primer for Avoiding Pitfalls.” Family Practice 27 (2010): 121—26. [DOI] [PubMed]
- 40.Etheredge L.M. “Creating a High-Performance System for Comparative Effectiveness Research”. Health Affairs. 2010;29(no. 10):1761–67. doi: 10.1377/hlthaff.2010.0608. [DOI] [PubMed] [Google Scholar]
- 41.Dean B.B, Lam J, Natoli J. L, Butler Q, Aguilar D, Nordyke R. J. “Use of Electronic Medical Records for Health Outcomes Research”. Medical Care Research and Review. 2009;66(no. 6):611–38. doi: 10.1177/1077558709332440. [DOI] [PubMed] [Google Scholar]
- 42.Weiner M.G, Lyman J. A, Murphy S, Weiner M. “Electronic Health Records: High-Quality Electronic Data for Higher-Quality Clinical Research”. Informatics in Primary Care. 2007;15:121–27. doi: 10.14236/jhi.v15i2.650. [DOI] [PubMed] [Google Scholar]
- 43.Persell S.D, Kho A. N, Thompson J. A, Baker D. W. “Improving Hypertension Quality Measurement Using Electronic Health Records”. Medical Care. 2009;47(no. 4):388–94. doi: 10.1097/mlr.0b013e31818b070c. [DOI] [PubMed] [Google Scholar]
- 44.Farley T.A, Dalal M. A, Mostashari F, Frieden T. R. “Deaths Preventable in the US by Improvements in the Use of Clinical Preventive Services”. American Journal of Preventive Medicine. 2010;38(no. 6):600–609. doi: 10.1016/j.amepre.2010.02.016. [DOI] [PubMed] [Google Scholar]
- 45.US Preventive Services Task Force. “Screening for High Blood Pressure in Adults.” December 2007. Available at http://www.uspreventiveservicestaskforce.org/uspstf/uspshype.htm
- 46.Pakhomov S, Bjornsen S, Hanson P, Smith S. “Quality Performance Measurement Using the Text of Electronic Medical Records”. Medical Decision Making. 2008;28(no. 4):462–70. doi: 10.1177/0272989X08315253. [DOI] [PubMed] [Google Scholar]
- 47.Persell, S. D., A. N. Kho, J. A. Thompson, and D. W. Baker. “Improving Hypertension Quality Measurement Using Electronic Health Records.” [DOI] [PubMed]
- 48.Hanna, K. E., S. M. Anderson, and S. D. Maddox. Think Research: Using Electronic Medical Records to Bridge Patient Care and Research
- 49.Terry, A. L., V. Chevendra, A. Think, M. Stewart, J. N. Marshall, and S. Cejic. “Using Your Electronic Medical Record for Research: A Primer for Avoiding Pitfalls.” [DOI] [PubMed]
- 50.Dean, B. B., J. Lam, J. L. Natoli, Q. Butler, D. Aguilar, and R. J. Nordyke. “Use of Electronic Medical Records for Health Outcomes Research.” [DOI] [PubMed]
- 51.Weiner, M. G., J. A. Lyman, S. Murphy, and M. Weiner. “Electronic Health Records: High-Quality Electronic Data for Higher-Quality Clinical Research.” [DOI] [PubMed]
- 52.Millery M, Kukafka R. “Health Information Technology and Quality of Health Care: Strategies for Reducing Disparities in Underresourced Settings”. Medical Care Research and Review. 2010;67(no. 5):268S–98S. doi: 10.1177/1077558710373769. [DOI] [PubMed] [Google Scholar]
- 53.Hoff G, Ottestad P. M, Skaflotten S. R, Bretthauer M, Moritz V. “Quality Assurance as an Integrated Part of the Electronic Medical Record: A Prototype Applied for Colonoscopy”. Scandinavian Journal of Gastroenterology. 2009;44:1259–65. doi: 10.1080/00365520903132021. [DOI] [PubMed] [Google Scholar]
- 54.Nahm M.L, Pieper C. F, Cunningham M. M. “Quantifying Data Quality for Clinical Trials Using Electronic Data Capture”. PLoS One. 2008;3(no. 8):e3049. doi: 10.1371/journal.pone.0003049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Forster M, Bailey C, Brinkhof M, Graber C, Boulle A, Sophr M, Balestre E, et al. “Electronic Medical Record Systems, Data Quality and Loss to Follow-up: Survey of Antiretroviral Therapy Programmes in Resource-Limited Settings”. Bulletin of the World Health Organization. 2008;86:939–47. doi: 10.2471/BLT.07.049908. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Benin A.L, Vitkauskas G, Thornquist E, Shapiro E. D, Concato J, Aslan M, Krumholz H. M. “Validity of Using an Electronic Medical Record for Assessing Quality of Care in an Outpatient Setting”. Medical Care. 2005;43(no. 7):691–98. doi: 10.1097/01.mlr.0000167185.26058.8e. [DOI] [PubMed] [Google Scholar]
- 57.Wrightson W. “A Comparison of Electronic and Handwritten Anaesthetic Records for Completness of Information”. Anaesthesia and Intensive Care. 2010;38(no. 6):1052–58. doi: 10.1177/0310057X1003800615. [DOI] [PubMed] [Google Scholar]
- 58.Chan K.S, Fowles J. B, Weiner J. P. “Electronic Health Records and the Reliability and Validity of Quality Measures: A Review of the Literature”. Medical Care Research and Review. 2009;2010(no. 67):503–27. doi: 10.1177/1077558709359007. [DOI] [PubMed] [Google Scholar]
- 59.Hanna, K. E., S. M. Anderson, and S. D. Maddox. Think Research: Using Electronic Medical Records to Bridge Patient Care and Research
- 60.Bristol, N. “The Muddle of US Electronic Medical Records.” [DOI] [PubMed]
- 61.Taylor, R., A. Bower, F. Girosl, J. Bigelow, K. Fonkych, and R. Hillstead. “Promoting Health Information Technology: Is There a Case for More-Aggressive Government Action?” [DOI] [PubMed]
- 62.Goldschmidt, P. G. “HIT and MIS: Implications of Health Information Technology and Medical Information Systems.”
- 63.Harris, K. D., J. T. Parsons, and R. Jimenez. “Developing a Methodology for the Customization of an Electronic Medical Record in a Rural Health Care Setting.”
- 64.Dean, B. B., J. Lam, J. L. Natoli, Q. Butler, D. Aguilar, and R. J. Nordyke. “Use of Electronic Medical Records for Health Outcomes Research.” [DOI] [PubMed]
- 65.Lee J, Cain C, Young S, Chockley N, Burstin H. “The Adoption Gap: Health Information Technology in Small Physician Practices”. Health Affairs. 2005;24(no. 5):1364–66. doi: 10.1377/hlthaff.24.5.1364. [DOI] [PubMed] [Google Scholar]
- 66.Kristianson, K., H. Ljunggren, and L. Gustafsson. “Data Extraction from a Semi-structured Electronic Medical Record System for Outpatients: A Model to Facilitate the Access and Use of Data for Quality Control and Research.” [DOI] [PubMed]
- 67.Terry, A. L., V. Chevendra, A. Think, M. Stewart, J. N. Marshall, and S. Cejic. “Using Your Electronic Medical Record for Research: A Primer for Avoiding Pitfalls.” [DOI] [PubMed]
- 68.Dean, B. B., J. Lam, J. L. Natoli, Q. Butler, D. Aguilar, and R. J. Nordyke. “Use of Electronic Medical Records for Health Outcomes Research.” [DOI] [PubMed]
- 69.Farley, T. A., M. A. Dalal, F. Mostashari, and T. R. Frieden. “Deaths Preventable in the US by Improvements in the Use of Clinical Preventive Services.” [DOI] [PubMed]
- 70.Hoff, G., P. M. Ottestad, S. R. Skaflotten, M. Bretthauer, and V. Moritz. “Quality Assurance as an Integrated Part of the Electronic Medical Record: A Prototype Applied for Colonoscopy.” [DOI] [PubMed]
- 71.Benin, A. L., G. Vitkauskas, E. Thornquist, E. D. Shapiro, J. Concato, M. Aslan, and H. M. Krumholz. “Validity of Using an Electronic Medical Record for Assessing Quality of Care in an Outpatient Setting.” [DOI] [PubMed]
- 72.Chan, K. S., J. B. Fowles, and J. P. Weiner. “Electronic Health Records and the Reliability and Validity of Quality Measures: A Review of the Literature.” [DOI] [PubMed]
- 73.Schneider E.C, Riehl V, Courte-Wienecke S, Eddy D. M, Sennett C. “Enhancing Performance Measurement: NCQA's Road Map for a Health Information Network”. Journal of the American Medical Association. 1999;282(no. 12):1184–90. doi: 10.1001/jama.282.12.1184. [DOI] [PubMed] [Google Scholar]
- 74.Pandza H. “Minimal Data Sets for Electronic Medical Records in Hospital Settings”. Acta Informatica Medica. 2009;17(no. 2):71–73. [Google Scholar]
- 75.Romano M.J, Stafford R. S. “Electronic Health Records and Clinical Decision Support Systems”. Archives of Internal Medicine. 2011;171(no. 10) doi: 10.1001/archinternmed.2010.527. online version. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Damberg C.L, Shortell S. M, Raube K, Gillies R. R, Rittenhouse D, McCurdy R. K, Casalino L. P, Adams J. “Relationship between Quality Improvement Processes and Clinical Performance”. American Journal of Managed Care. 2010;16(no. 8):601–6. [PubMed] [Google Scholar]
- 77.National Heart, Lung, and Blood Institute. The Seventh Report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure (NIH Publication No. 04-523). National Heart, Lung, and Blood Institute, 2003. [DOI] [PubMed]
- 78.Chronic Disease Electronic Management System (CDEMS). “The CDEMS User Network.” Available at http://www.cdems.com