Dr Park and her team have had their electronic medical record (EMR) for almost 2 years. Throughout this time, they have been recording questions they hope their EMR might help them answer. These questions have arisen from practice-management concerns, proposed quality-improvement initiatives, and old-fashioned clinical curiosity. They are wondering how to begin using the EMR to provide some answers.
Electronic medical records can be used to answer many practice-level questions. Regardless of your motivation for querying your EMR, several matters must be considered.
What is your question?
A clear answer can only arise from a focused question. A broad area of interest (eg, blood pressure measurement) will need to be narrowed to a specific research question that meets the FINER (feasible, interesting, novel, ethical, and relevant) criteria.1 Quantitative research questions* fall into 2 broad categories: descriptive and analytic. Descriptive questions portray important characteristics of a phenomenon, group, or process of interest (eg, What proportion of office visits has a blood pressure measurement recorded in the patient’s record?). Analytic questions compare 2 or more groups or conditions (eg, Did changing office procedures affect the proportion of office visits at which a patient’s blood pressure reading is documented?). The mnemonic PICOT2 (population, intervention, comparator, outcome, time frame) can help in formulating a good analytic research question.
Is the information you need to answer your question present and accessible in the EMR?
To answer any question from your EMR, you must be able to define a numerator and a denominator for the phenomenon, group, or process of interest, and you must be able to reliably identify these based on information present in the EMR. Experienced EMR researchers will tell you that fulfilling these criteria is more complicated than it might initially seem. For example, in one study investigating 6 different potential ways of identifying patients with diabetes in a primary care EMR database, the prevalence of diabetes ranged more than 2-fold (from 5.0% to 12.0%) depending on which definition was used.3
In EMRs, key information might be recorded in a variety of different places or might be missing altogether. For example, a patient’s height might appear in a note, on a periodic health examination template, in a structured height-and-weight field, or in a customized field created by an individual clinician. For many patients, height might not have yet been documented anywhere in the EMR. The research query must take into account and search for the variety of ways that information will be recorded in the EMR.
How will you translate patient information into a numerator and a denominator?
Imagine you are interested in determining the proportion of your patients with renal failure who have been referred to a nephrologist. In order to answer your question, relevant data from individual patient records will need to be translated into numbers that can be counted by the computer. If the EMR contained a tick box for “renal failure present,” then your denominator could be readily distinguished. Because EMRs are not designed this way, you will need to translate (recode) the data that do exist (eg, text in the cumulative patient profile) into a form that can be recognized and counted by the computer. This entails identifying all possible variations on “renal failure” that might be present in the cumulative patient profile (“renal failure,” “nephropathy,” “CRF” [chronic renal failure], “microalbuminuria,” etc) and translating them into a new variable: renal failure present or absent. Consistency in data entry4 (eg, ensuring all users reliably record renal failure in an identical fashion) will reduce the burden of recoding.
How will you extract and analyze the information?
Depending on the specific EMR used, many descriptive, practice-level questions of clinical interest in family physicians’ offices (eg, What proportion of women older than age 50 had a mammogram in the past 2 years?) can be answered by the EMR software using customizable queries or a structured query language interface. For analytic questions (eg, Are obese and nonobese women equally likely to have undergone a screening mammogram in the past 2 years?), it will likely be necessary to export the data into a separate software package (eg, Excel, SPSS) for analysis. Statistical capabilities, available technical support, and ease of exporting data vary among EMR products and should be considered at the outset of the research process.5–7
Do you need special permission to analyze and report the data?
Formal approval from an institutional (hospital or university) research ethics board might not be required for chart audit research or queries that remain entirely internal to the practice (eg, quality improvement). If it is hoped that any portion of the study will be shared outside the practice, then clearance from the local research ethics board might be necessary, particularly if the study involves combining data from multiple providers or exporting data from the EMR into a separate database. For physicians in clinics associated with hospitals, additional procedures might be necessary to obtain approval from hospital data custodians.8 Investigating applicable local standards should be an early step in the research-planning process.
Today’s EMRs make it possible for individual physicians to ask and answer important questions about their own practices; however, doing so requires attention to several issues and processes that are best considered well before they hope to analyze data. A little foresight goes a long way in practice-level EMR research.
Acknowledgments
Dr Ryan is funded by a postdoctoral fellowship from the Dr Brian W. Gilbert Canada Research Chair in Primary Health Care Research. Dr Stewart is funded by the Dr Brian W. Gilbert Canada Research Chair in Primary Health Care Research. Dr Thind is a Canada Research Chair in Health Services Research.
Hypothesis is a quarterly series in Canadian Family Physician, coordinated by the Section of Researchers of the College of Family Physicians of Canada. The goal is to explore clinically relevant research concepts for all CFP readers. Submissions are invited from researchers and nonresearchers. Ideas or submissions can be submitted online at http://mc.manuscriptcentral.com/cfp or through the CFP website www.cfp.ca under “Authors and Reviewers.”
Footnotes
The potential of EMRs for qualitative research is, at present, underexplored.
Competing interests
Dr Cejic is Chair of the Nightingale Advisory Board at Nightingale Informatix (the vendor of the electronic medical record that Dr Cejic uses). None of the other authors has any competing interests to declare.
References
- 1.Cummings SR, Browner WS, Hulley SB. Conceiving the research question. In: Hulley SB, Cummings SR, Browner WS, Grady DG, Newman TB, editors. Designing clinical research. 3rd ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2007. pp. 17–26. [Google Scholar]
- 2.Haynes R. Forming research questions. In: Haynes R, Sacket D, Guyatt G, Tugwell P, editors. Clinical epidemiology. How to do clinical practice research. Philadelphia, PA: Lippincott Williams & Wilkins; 2006. pp. 3–14. [Google Scholar]
- 3.Harris SB, Glazier RH, Tompkins JW, Wilton AS, Chevendra V, Stewart MA, et al. Investigating concordance in diabetes diagnosis between primary care charts (electronic medical records) and health administrative data: a retrospective cohort study. BMC Health Serv Res. 2010;10:347. doi: 10.1186/1472-6963-10-347. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Ryan BL, Shadd JD, Terry A, Cejic S, Chevendra V, Thind A. You and your EMR: the research perspective. Part 2. How structure matters. Can Fam Physician. 2011;57:1473–4. Available from: www.cfp.ca/content/57/12/1473.full.pdf+html. Accessed 2012 Jan 23. [PMC free article] [PubMed] [Google Scholar]
- 5.Terry AL, Chevendra V, Thind A, Stewart M, Marshall JN, Cejic C. Using your electronic medical record for research: a primer for avoiding pitfalls. Fam Pract. 2010;27(1):121–6. doi: 10.1093/fampra/cmp068. Epub 2009 Oct 14. [DOI] [PubMed] [Google Scholar]
- 6.Holbrook A, Keshavjee K, Troyan S, Pray M, Ford PT, COMPETE Investigators Applying methodology to electronic medical record selection. Int J Med Inform. 2003;71(1):43–50. doi: 10.1016/s1386-5056(03)00071-6. [DOI] [PubMed] [Google Scholar]
- 7.Ryan BL, Cejic S, Shadd JD, Terry A, Chevendra V, Thind A. You and your EMR: the research perspective. Part 1. Selecting and implementing an EMR. Can Fam Physician. 2011;57:1090–1. Available from: www.cfp.ca/content/57/9/1090.full.pdf+html. Accessed 2012 Jan 23. [PMC free article] [PubMed] [Google Scholar]
- 8.Gold JL. Whose medical records are these, anyway? Ownership, access, custodianship and ethical duties. Ont Med Rev. 2011;78:20–2. [Google Scholar]