Abstract
Context
Laboratories must ensure that the test results and pathology reports they transmit to a patient’s electronic health record (EHR) are accurate, complete, and presented in a useable format.
Objective
To determine the accuracy, completeness, and formatting of laboratory test results and pathology reports transmitted from the laboratory to the EHR.
Design
Participants from 45 institutions retrospectively reviewed results from 16 different laboratory tests, including clinical and anatomic pathology results, within the EHR used by their providers to view laboratory results. Results were evaluated for accuracy, presence of required elements, and usability. Both normal and abnormal results were reviewed for tests, some of which were performed in-house and others at a reference laboratory.
Results
Overall accuracy for test results transmitted to the EHR was greater than 99.3% (1052 of 1059). There was lower compliance for completeness of test results, with 69.6% (732 of 1051) of the test results containing all essential reporting elements. Institutions that had fewer than half of their orders entered electronically had lower test result completeness rates. The rate of appropriate formatting of results was 90.9% (98 of 1010).
Conclusions
The great majority of test results are accurately transmitted from the laboratory to the EHR; however, lower percentages are transmitted completely and in a useable format. Laboratories should verify the accuracy, completeness, and format of test results at the time of test implementation, after test changes, and periodically.
Laboratories must ensure the accuracy, completeness, and usability of information that is transmitted to the patient’s electronic health record (EHR). This information includes the results of tests performed in-house and by reference laboratories and reported by manual entry or transferred from the laboratory information system (LIS) or middleware programs. Thorough reviews of electronic test results and transmission of test results across electronic interfaces have become more important as health care providers (HCPs) increasingly request laboratory tests using computerized order entry and review most test results within the EHR. This Q-Probes study is focused on the electronic reporting of laboratory results and the appearance of test results and narrative reports in the EHR.
Historically, laboratories have met regulatory requirements for verifying test result accuracy and completeness by reviewing test results within the LIS. As hard-copy paper reports have increasingly been replaced by electronic reporting, HCPs manage test results and other aspects of patient care within an integrated EHR.1,2 A number of information technology (IT) requirements for test reporting are set forth in the College of American Pathologists’ (CAP’s) Laboratory Accreditation Program Laboratory General Checklist3 and the Code of Federal Regulations4; however, the rate of compliance with these requirements is poorly documented. This Q-Probes study was designed to measure the accuracy, completeness, and usability of electronically reported and transmitted test results, and to assess laboratory practices regarding validation of electronic test results and pathology reports.
MATERIALS AND METHODS
Participants in this CAP Q-Probes study retrospectively reviewed results from 16 different laboratory tests by directly viewing results within the EHR. If the laboratory transmitted results to more than one EHR, the results were reviewed in the EHR primarily used by providers to view laboratory results. Results were reviewed for a spectrum of laboratory tests that were selected to include tests performed by most laboratories, tests often sent to reference laboratories, tests with numeric and textual results, manually entered results, automatically resulted (ie, autoverified/autovalidated), and anatomic pathology reports, including surgical pathology and cytology. These included: creatinine, corrected platelet count, hemoglobin A1c, international normalized ratio, blood bank antibody screen, blood culture with sensitivities, estimated glomerular filtration rate, human immunodeficiency virus (HIV-1) quantitative polymerase chain reaction assay, serum protein electrophoresis, Epstein-Barr virus viral-capsid antigen immunoglobulin (Ig) G antibody, factor V Leiden mutational assay, breast estrogen receptor studies, surgical pathology report with synoptic component, Papanicolaou cytology report with human papillomavirus result, second-trimester maternal (Quad) screen, and heparin-dependent antibody testing. Point-of-care test results and preliminary nonverified results were excluded.
Worksheets were provided to participants to facilitate data collection. One normal and one abnormal (ie, outside of reference range) test result were identified for each test using sources where this information was most readily available (eg, LIS, log books, reference laboratory reports, etc). Recent results were selected whenever possible. Using patient identifiers, the test results were located within the EHR. Surgical pathology and cytology reports were also reviewed in the electronic system used by providers. Because there are often several ways for providers to view laboratory results within an EHR, participants were asked to select the results screen used by most providers. Participants followed their local policies for accessing patient information within the EHR.
Test result accuracy was assessed by comparing the numeric or textual result in the EHR to the result in the LIS, paper worksheets, instruments, or other primary source. Test result completeness was determined by verifying the presence of the following result components: (1) name/address of performing laboratory, (2) linkage of result to the physician of record, (3) date/time of specimen collection, (4) date/time of test result/report, (5) specimen source, (6) units of measurement when applicable, (7) result interpretation when applicable, (8) information regarding condition and disposition of suboptimal specimens (eg, specimen suitability), (9) reference intervals appropriate for patient age/sex when relevant, (10) flagging appropriate to clearly indicate abnormal results (eg, color highlighting, up/down arrows, exclamation marks, etc), (11) audit trail for corrected results, (12) limitations of test, and (13) Food and Drug Administration disclaimer when applicable. Result formatting was assessed by reviewing the result on the EHR computer screen and on a paper printout of the EHR report. The appropriateness of result formatting was judged using the following criteria:
Appropriate: All results, reference information, and other report elements are presented in a visually easily understandable format, with report elements easily located, clearly labeled, and properly aligned.
Appropriate with minor defects: Results are presented with minimal defects. For example, a report with a minor misalignment or formatting problem that does not render the result difficult to read is considered as having a minor defect.
Inappropriate: Results missing one or more reporting elements and/or presented in a way that is difficult for an HCP to interpret, including major misalignment of results and/or inclusion of extraneous information.
Participants were asked to answer survey questions regarding their IT capabilities and practices. Individual associations between the frequency metrics and time intervals with the demographic and practice variables were analyzed using Kruskal-Wallis tests for discrete-valued independent variables and regression analysis for continuous independent variables. Variables with significant associations (P < .10) were then included in a forward-selection multivariate regression model. A significance level of .05 was used for this final model. For the aggregate case results analyses, t tests were used. All analyses were performed using SAS v9.2 (SAS Institute, Cary, North Carolina).
RESULTS
Performance Indicators
Three major performance indicators were determined for this study, including: (1) the percent of tests accurately transmitted to the EHR, (2) the percent of test results containing essential reporting elements, and (3) the percent of test results transmitted in a usable format (Table 1). Results are based on information provided by 45 participants who submitted test result transmission data for more than 1000 test results in aggregate. These included results that were transmitted to the EHR from an instrument, LIS, paper worksheet, or other primary source. Overall accuracy of result transmission to the EHR was 99.3% (1052 of 1059). There was no difference in the accuracy of result transmission between normal (99.4%; 526 of 529) and abnormal (99.2%; 526 of 530) test results.
Table 1.
Performance Indicators Showing Electronic Health Record (EHR) Result Correctness, Completeness, and Usability for 45 Reporting Institutions
| Performance Indicators | All Institutions: Percentiles | |||||
|---|---|---|---|---|---|---|
|
| ||||||
| 5th | 10th | 25th | Median | 75th | 90th | |
| Percent of tests accurately transmitted to the EHR | 95.7 | 100.0 | 100.0 | 100.0 | 100.0 | 100.0 |
| Percent of test results containing essential reporting elements | 9.1 | 20.0 | 45.0 | 92.9 | 100.0 | 100.0 |
| Percent of test results transmitted in a usable format | 36.8 | 85.7 | 93.8 | 100.0 | 100.0 | 100.0 |
There was lower compliance for completeness of test results in that only 69.6% (732 of 1051) of the results reviewed contained all of the essential reporting elements. The overall rate for appropriate formatting of test results was 90.9% (918 of 1010). Appropriately formatted results included those that were correctly configured on the EHR screen views and EHR paper printouts, and did not contain irrelevant or incorrect information. There were 2 practice characteristics that were significantly associated with the major performance indicators (Table 2). First, institutions that had 50% or less of test orders entered electronically by providers had lower test result completeness rates. Second, institutions that rarely received documented complaints regarding the formatting of test results within the EHR had a higher percent of test results that were appropriately formatted.
Table 2.
Relationships Between the Primary Study Indicators and Practice Characteristics
| No. (%) of Institutions | All Institutions: Percentiles | ||||||
|---|---|---|---|---|---|---|---|
|
| |||||||
| Test Results Containing Essential Reporting Elements, % | Test Results With Appropriate Formatting, % | ||||||
|
|
|
||||||
| 10th | Median | 90th | 10th | Median | 90th | ||
| Percent of orders entered electronically by ordering provider (P = .01) | |||||||
| ≤50% | 11 (25.0) | 15.4 | 28.6 | 100.0 | |||
| >50% | 33 (75.0) | 34.5 | 93.8 | 100.0 | |||
| Frequency of complaints regarding formatting of test results within EHR (P = .001) | |||||||
| Rarely (<1 per month) | 33 (78.6) | 92.9 | 100.0 | 100.0 | |||
| Very/somewhat often | 9 (21.4) | 0.0 | 93.8 | 100.0 | |||
Abbreviation: EHR, electronic health record.
Results Transmission Methods
Participants provided detailed information regarding their transmission methods for tests performed in-house and at reference laboratories (Table 3). Overall, for in-house–performed tests, most laboratories used electronic means to transfer data from the LIS to the EHR (61.8%; 261 of 422 reviewed results) or the data were manually entered into the LIS (33.2%; 140 of 422 results). Results were less commonly transmitted from middleware to the EHR (4.3%; 18 of 422 results) and were rarely entered directly into the EHR. The frequency of manual entry of results may be due to the spectrum of tests examined in this study, which included surgical pathology and cytology reports (Table 4). Other tests that were less frequently electronically interfaced included HIV-1 quantitative polymerase chain reaction, serum protein electrophoresis, and factor V Leiden polymerase chain reaction.
Table 3.
Test Result Transmission Methods for Tests Performed In-House and at Reference Laboratories
| No. (%) | |
|---|---|
| In-house–performed test results | |
| Electronic: instrument to LIS to EHR | 261 (61.8) |
| Manual entry in LIS; electronic transmission to EHR | 140 (33.2) |
| Electronic transmission from middleware to EHR | 18 (4.3) |
| Manual entry in EHR | 3 (0.7) |
| Reference laboratory performed test results | |
| Electronic: reference laboratory to LIS to EHR | 128 (84.8) |
| Manual entry in LIS and electronic transmission to EHR | 11 (7.3) |
| Scanned, copy/paste, etc, into EHR | 10 (6.6) |
| Electronic: reference laboratory to EHR | 1 (0.7) |
| Manual entry in EHR | 1 (0.7) |
Abbreviations: EHR, electronic health record; LIS, laboratory information system.
Table 4.
Transmission Methods for In-House–Performed Laboratory Tests
| Test | Transmission Method, % (No. of Labs) | |||
|---|---|---|---|---|
|
| ||||
| Electronic: Instrument to LIS to EHR | Manual Entry in LIS | Electronic: Middleware to EHR | Manual Entry in EHR | |
| Corrected platelet count | 65.6 (21) | 31.3 (10) | 3.1 (1) | 0.0 |
| Creatinine | 88.6 (39) | 2.3 (1) | 9.1 (4) | 0.0 |
| Estimated glomerular filtration rate | 90.2 (37) | 2.4 (1) | 7.3 (3) | 0.0 |
| International normalized ratio | 95.5 (42) | 2.3 (1) | 2.3 (1) | 0.0 |
| Hemoglobin A1c | 83.7 (36) | 11.6 (5) | 4.7 (2) | 0.0 |
| Human immunodeficiency virus quantitative PCR | 50.0 (6) | 41.7 (5) | 8.3 (1) | 0.0 |
| Serum protein electrophoresis | 47.4 (9) | 42.1 (8) | 5.3 (1) | 5.3 (1) |
| Epstein-Barr virus viral-capsid antigen IgG antibody | 83.3 (10) | 16.7 (2) | 0.0 | 0.0 |
| Factor V Leiden mutational assay (PCR) | 33.3 (4) | 58.3 (7) | 8.3 (1) | 0.0 |
| Blood bank antibody screen | 39.5 (15) | 57.9 (22) | 2.6 (1) | 0.0 |
| Blood culture with sensitivity results | 64.1 (25) | 30.8 (12) | 5.1 (2) | 0.0 |
| Breast pathology result with estrogen receptor studies | 16.0 (4) | 80.0 (20) | 0.0 | 4.0 (1) |
| Anatomic pathology routine surgical result with synoptic report | 23.1 (6) | 73.1 (19) | 0.0 | 3.8 (1) |
| Papanicolaou cytology report with human papillomavirus testing results | 17.6 (3) | 76.5 (13) | 5.9 (1) | 0.0 |
| Second-trimester maternal screen | 28.6 (2) | 71.4 (5) | 0.0 | 0.0 |
| Heparin-dependent antibody | 18.2 (2) | 81.8 (9) | 0.0 | 0.0 |
Abbreviations: EHR, electronic health record; LIS, laboratory information system; PCR, polymerase chain reaction.
Most—84.8% (128 of 151)—of the results reviewed that were received from reference laboratories were electronically transferred through the LIS to the EHR. Small numbers of reference laboratory results were manually entered into the LIS or scanned into the EHR (Table 5). As for in-house–performed services, anatomic pathology reports were frequently entered manually into the LIS or scanned into the EHR.
Table 5.
Transmission Methods for Tests Performed at Reference Laboratories
| Testa | Transmission Method, % (No. of Labs) | |||
|---|---|---|---|---|
|
| ||||
| Electronic: Reference Lab to LIS to EHR | Manual Entry in LIS | Scan, Copy/Paste, etc to EHR | Electronic: Reference Lab to EHR | |
| Human immunodeficiency virus quantitative PCR | 83.3 (20) | 8.3 (2) | 8.3 (2) | 0.0 |
| Serum protein electrophoresis | 95.2 (20) | 0.0 | 4.8 (1) | 0.0 |
| Epstein-Barr virus viral-capsid antigen IgG antibody | 94.4 (17) | 5.6 (1) | 0.0 | 0.0 |
| Factor V Leiden mutational assay (PCR) | 86.4 (19) | 0.0 | 9.1 (2) | 4.5 (1) |
| Anatomic pathology routine surgical result with synoptic report | 50.0 (3) | 33.3 (2) | 16.7 (1) | 0.0 |
| Papanicolaou cytology report with human papillomavirus testing results | 72.7 (8) | 18.2 (2) | 9.1 (1) | 0.0 |
| Second-trimester maternal screen | 85.0 (17) | 5.0 (1) | 10.0 (2) | 0.0 |
| Heparin-dependent antibody | 84.6 (11) | 7.7 (1) | 7.7 (1) | 0.0 |
Abbreviations: EHR, electronic health record; IgG, immunoglobulin G; LIS, laboratory information system; PCR, polymerase chain reaction.
Only tests with at least 5 participant responses are summarized in this table.
Test Result Completeness and Formatting
Most of the test results reviewed by participants contained all of the reporting elements considered necessary for a complete report (Table 6). There was little difference between the completeness of reporting elements between normal and abnormal test results. The name/address of the performing laboratory and date/time of test result/report were the elements most frequently missing on result review. More than 99% (1038 of 1045) of test results reviewed were appropriately formatted, whether the result was observed in the EHR on a computer screen or a paper printout of the EHR result (Table 7). There was no clear difference in the appropriateness of formatting between normal and abnormal test results. However, almost 9% (85 of 1027) of the test results reviewed on an EHR computer screen contained extraneous information and/or information that did not need to be reported. This extra information can potentially complicate test result interpretation by the HCP.
Table 6.
Completeness of Test Result Report by Report Element for Normal and Abnormal Test Results
| Test Result Element | Percent (No.) Containing Element | ||
|---|---|---|---|
|
| |||
| Overall | Normal Results | Abnormal Results | |
| Name/address of performing laboratory | 87.4 (1057) | 87.5 (527) | 87.4 (530) |
| Result linked to the physician of record | 99.3 (1061) | 99.4 (529) | 99.2 (532) |
| Date/time of specimen collection | 97.4 (1058) | 97.5 (527) | 97.4 (531) |
| Date/time of test result/report | 87.2 (1059) | 86.6 (528) | 87.8 (531) |
| Specimen source, when applicable | 97.6 (539) | 97.4 (266) | 97.8 (273) |
| Unit of measurement, when applicable | 99.9 (691) | 100.0 (343) | 99.7 (348) |
| Test interpretation, when applicable | 99.2 (723) | 99.4 (357) | 98.9 (366) |
| Information regarding condition and disposition of suboptimal specimens, if applicable | 97.0 (233) | 95.8 (118) | 98.3 (115) |
| Reference intervals present and appropriate | 97.1 (771) | 96.9 (384) | 97.4 (387) |
| Flagging appropriate | 95.8 (697) | 96.2 (288) | 95.6 (409) |
| Audit trail for corrected result, when applicable | 95.0 (320) | 95.6 (158) | 94.4 (162) |
| Limitations of test, when applicable | 94.2 (326) | 95.1 (164) | 93.2 (162) |
| FDA disclaimer, when applicable | 97.1 (137) | 97.1 (70) | 97.0 (67) |
Abbreviation: FDA, Food and Drug Administration.
Table 7.
Appropriateness of Test Result Formatting for Normal and Abnormal Test Results
| Test Result View Assessed | Percent (No.) Appropriate | ||
|---|---|---|---|
|
| |||
| Overall | Normal Results | Abnormal Results | |
| Appropriate formatting on EHR computer screen | 99.3 (1045) | 99.4 (519) | 99.2 (526) |
| Appropriate formatting on EHR paper printout | 99.4 (1044) | 99.6 (519) | 99.2 (525) |
| EHR computer screen does NOT contain extraneous or nonreportable information | 91.7 (1027) | 91.8 (513) | 91.6 (514) |
Abbreviation: EHR, electronic health record.
IT Practices
Participating institutions provided information regarding their IT practices related to laboratory testing (Table 8). There was a broad distribution concerning the percent of tests that were electronically ordered by the provider. All laboratories used an LIS, and all institutions had implemented an EHR. Approximately half of laboratories also used middleware. Slightly more than half (55.8%; 24 of 43) of the institutions had test information (eg, specimen type, patient preparation, turnaround time, etc) available in the electronic ordering system. Most (70.5%; 31 of 44) of the institutions reported that most test results transmitted to the EHR were routed to an “inbox” or other electronic system used by the ordering HCP. In addition, most (79.5%; 35 of 44) participants reported that most point-of-care test results were available in the EHR. Slightly more than half (54.5%; 24 of 44) of the participants stated that patients were able to review their laboratory results within a personal health record or other electronic patient portal.
Table 8.
Information Technology Practices and Practices of Participating Institutions
| Practice or Characteristic | Percent (No.) |
|---|---|
| Types of information systems used by institutiona | |
| LIS | 100.0 (44) |
| EHR | 97.7 (43) |
| Middleware | 54.5 (24) |
| Dedicated anatomic pathology information system | 40.9 (18) |
| Percent of laboratory orders entered electronically by the ordering provider | |
| 10–40 | 22.7 (10) |
| 41–80 | 25.0 (11) |
| 81–90 | 22.7 (10) |
| 91–100 | 29.5 (13) |
| System types used by providers to view electronic laboratory resultsa | |
| EHR | 95.5 (42) |
| Web portals | 56.8 (25) |
| iPads or other tablet devices | 40.9 (18) |
| Smart phones (iPhone, Android, etc) | 29.5 (13) |
| LIS | 27.3 (12) |
| Frequency of documented complaints received by the laboratory regarding the formatting of test results within the EHR | |
| Rarely (<1 per month) | 77.3 (34) |
| Somewhat often (1–3 per month) | 4.5 (2) |
| Very often (>3 per month) | 18.2 (8) |
| Frequency of verification of test results to and from the EHRa | |
| At installation | 75.0 (33) |
| When a problem is identified | 63.6 (28) |
| At least once a year | 47.7 (21) |
| At least twice a year | 25.0 (11) |
| Otherb | 22.7 (10) |
| Mechanism used by laboratory director to ensure that the content of laboratory reports electronically transmitted to the EHR effectively communicates patient test resultsa | |
| Review of results in EHR at time of implementation | 79.5 (35) |
| Review of results in the EHR at least every 2 y | 61.4 (27) |
| Director does not review test results within the EHR | 6.8 (3) |
Abbreviations: EHR, electronic health record; LIS, laboratory information system.
Multiple responses permitted.
Other responses included after testing/upgrade (6), daily (1), downtime (1), and random sampling (1).
Institution Demographics
Of the 45 institutions participating in the study, 41 (91%) were from the United States. The remaining 4 institutions were from Saudi Arabia (2), Brazil, and Canada. Within the last 2 years prior to data collection, 77.8% (35 of 45) of participating laboratories were inspected by the CAP. The size of most hospitals with hospital-based laboratories (69.8%; 30 of 43) was less than 300 occupied beds. Approximately one-third of participating laboratories were teaching hospitals that also trained pathology residents. Overall, 45.5% (20 of 44) of institutions were located in cities and 75.0% (33 of 44) were nongovernmental. Mean test volumes for participating laboratories were 1 809 998 for clinical pathology tests, 33 457 for surgical pathology tests, and 14 744 for gynecologic cytology.
COMMENTS
This Q-Probes study focused on the electronic reporting of laboratory results within the EHR. It is important for laboratories to verify test result accuracy, completeness, and usability within the EHR because HCPs frequently manage test results and other patient information directly within these systems. There are also several IT requirements for reporting laboratory test results that must be met, as stipulated in the Code of Federal Regulations4 and the CAP’s Laboratory Accreditation Program Laboratory General Checklist3 (Table 9). The Code of Federal Regulations requires that a manual or electronic system be in place to ensure test results are reliably sent from the point of data entry to the final report destination. This requirement applies to both results transmitted via an electronic interface and manually entered results, and includes results for tests performed in-house and at reference laboratories.
Table 9.
Data Elements Required for Laboratory Test Resulting
| Test Result Element |
|---|
| Positive patient identifiers |
| Name and address of laboratory location where test was performed |
| Test report date |
| Test performed |
| Specimen source, when appropriate |
| Test result, including measurement units and/or interpretation when applicable |
| Information regarding the condition and disposition of specimens that do not meet the laboratory’s acceptability criteria |
The IT requirements for test resulting can be broadly categorized into “accuracy,” “completeness,” and “usability” of test result information that is transmitted to the EHR. The participants of this Q-Probes study documented that 99.3% (1052 of 1059) of results reviewed were accurately transmitted to the EHR. This finding is expected in that most results are electronically, not manually, entered. However, there was lower compliance for completeness of test results, with only 69.6% (732 of 1051) of the test results containing all of the essential reporting elements outlined above. Institutions at which less than half of test orders are entered electronically had lower test result completeness rates. This may be due to less developed electronic interfaces at these institutions. The report components that were most commonly missing included the “name/address of performing lab” and the “date/time of test result/report.” The most important information (eg, result, reference range, interpretation) should be prominently displayed and not obscured by other elements that are less important to the HCP (eg, disclaimers, test methodology, etc). Reference intervals were available within the EHR for 97.1% (749 of 771) of the results reviewed. The required reporting elements also apply to point-of-care test results.
Most laboratories in this study electronically transmitted results from the performing instrument to the LIS and then to the EHR for commonly performed tests, including platelet counts, creatinine, estimated glomerular filtration rate, and international normalized ratio. Tests that are performed less frequently and/or may not be automated (eg, quantitative HIV polymerase chain reaction, protein electrophoresis, and factor V Leiden mutational assay) often required manual result entry. Electronic interfaces were used to transmit most (84.8%; 128 of 151) of the results reviewed for tests performed at the participant’s primary reference laboratory. A small number of laboratories manually entered referred testing results into the LIS or scanned/copied results directly into the EHR. The CAP Laboratory Accreditation Program Checklist requirements (GEN.41440) stipulate that essential elements of referred test results be reported by the referring laboratory as received from the reference laboratory, without alternations that could affect clinical interpretation. Formatting of results can be altered when results are electronically transmitted from an LIS to an EHR. For example, tables, underlining, and alignment are often lost or transmitted inaccurately during electronic transfer. This can be especially problematic for surgical pathology and cytology reports that are often prepared using text editors with richer formatting features. In these cases, creating a report using an open standard for electronic document exchange (eg, PDF format) that can be directly viewed in the EHR without the need for discrete data transfer will preserve formatting. Maintaining consistency of formatting for test results may also improve their usability. Laboratory IT specialists will need to develop particularly rigorous strategies for formatting results from newer genomics technologies.5
Electronic interfaces have enabled more rapid and accurate transmission of laboratory results. However, it is critical that laboratories review transmitted results to ensure they are complete, accurate, and in a maximally usable format. Laboratory results should be reviewed before going live with a new interface that transmits results to the EHR, when changes are made at the laboratory or EHR level that could alter test resulting, and periodically. In this study, a relatively low percentage of laboratories were shown to verify the transmission of data to the EHR at least once a year or every other year. The CAP Laboratory General Checklist3 requires that the CAP laboratory director review and approve the content and format of paper and electronic patient reports at least every 2 years.
A strength of this study was that participants evaluated both clinical and anatomic pathology results because the content and format of these reports differ significantly. However, the study did have limitations, the most important being the variability of the persons who assessed the reports. Participants did not have difficulty determining whether a required reporting element was present or absent, but this may not be true for the more subjective assessments of report formatting and usability. Although guidelines were provided as described in “Materials and Methods” for judging these aspects, each participating laboratory assessed the quality of its own reports; significant variability between sites in the more subjective assessments cannot be excluded. Furthermore, the background and experience of evaluators could also influence how they critiqued reports. Participants did not specify who at their institution evaluated the reports (eg, pathologist, laboratory personnel, technologist, clinician, etc), and it is possible that more than one individual at a site was needed to review all tests. Finally, some participants did not fully complete data collection forms for all 16 tests. This frequently occurs in multisite Q-Probes studies when participants have difficulty finding requested information or do not fully understand the data collection instructions.
The methods outlined in this study can be used to help laboratories meet requirements for verifying laboratory test resulting within an EHR. The verification process should include careful scrutiny for the required reporting elements described in this study that are considered best practices and are required by regulatory agencies. In some medical systems, it may be necessary to review electronic results in more than one electronic system. For example, because laboratories are increasingly providing patients access to laboratory test information, the accuracy and usability of these results within patient portals should also be verified.6,7 In fact, many medical laboratories in the United States are required to provide patient access to their laboratory test results. Although patients are generally satisfied when they can view their test results online, it remains unclear whether patient access to laboratory reports and other elements of their EHR improves the quality and safety of health care.8 Medical and laboratory professionals express concerns that patients may not fully appreciate the implications of their test results. This is particularly true for anatomic and cytology reports that are inherently difficult for most patients to understand. Finally, laboratories should also focus on the usability of test resulting to reduce the risk of the HCP misinterpreting a test result. This may require interaction with a medical informatics officer or other clinicians who participate in institutional IT design and implementation. Overall, laboratory professionals should be actively involved in the development and maintenance of electronic test ordering9 and resulting systems10 in collaboration with their IT specialists.
Footnotes
The authors have no relevant financial interest in the products or companies described in this article.
References
- 1.Elder NC, McEwen TR, Flach J, Pallerla H. The management of test results in primary care: does an electronic medical record make a difference? Fam Med. 2010;42(5):327–333. [PubMed] [Google Scholar]
- 2.Natarajan K, Stein D, Jain S, et al. An analysis of clinical queries in an electronic health record search utility. Int J Med Inform. 2010;79(7):515–522. doi: 10.1016/j.ijmedinf.2010.03.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.College of American Pathologists’ Commission on Laboratory Accreditation. Laboratory General Checklist. Northfield, IL: College of American Pathologists; Apr 21, 2014. [Google Scholar]
- 4.Centers for Disease Control and Prevention. Clinical Laboratory Improvement Amendments of 1988; Final Rule. Atlanta, GA: Centers for Disease Control and Prevention; 1992. 42 CFR Part 493.1291 Laboratory Requirement, Standard: Test Report. [Google Scholar]
- 5.Haga SB, Mills R, Pollak KI, et al. Developing patient-friendly genetic and genomic test reports: formats to promote patient engagement and understanding. Genome Med. 2014;6(7):58. doi: 10.1186/s13073-014-0058-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Zikmund-Fisher BJ1, Exe NL, Witteman HO. Numeracy and literacy independently predict patients’ ability to identify out-of-range test results. J Med Internet Res. 2014;16(8):e187. doi: 10.2196/jmir.3241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Colpaert K, Decruvenaere J. Computerized physician order entry in clinical care. Best Pract Res Clin Anaesthesiol. 2009;23(1):27–38. doi: 10.1016/j.bpa.2008.07.002. [DOI] [PubMed] [Google Scholar]
- 8.De Lusignan S, Mold F, Sheikh A, et al. Patients’ online access to their electronic health records and linked online services: a systematic interpretative review. BMJ Open. 2014;4:e006021. doi: 10.1136/bmjopen-2014-006021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Ali Baddour A, Dablool AS, Al-Ghamdi SS. Improving laboratory test-ordering with information technology. Int J Clin Med. 2012;3:446–458. [Google Scholar]
- 10.Singh H, Thomas EJ, Sittig DF, et al. Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain? Am J Med. 2010;123(3):238–244. doi: 10.1016/j.amjmed.2009.07.027. [DOI] [PMC free article] [PubMed] [Google Scholar]