Skip to main content
HHS Author Manuscripts logoLink to HHS Author Manuscripts
. Author manuscript; available in PMC: 2020 Jan 3.
Published in final edited form as: Arch Pathol Lab Med. 2018 Dec 10;143(4):518–524. doi: 10.5858/arpa.2018-0093-OA

Identifying Preanalytic and Postanalytic Laboratory Quality Gaps Using a Data Warehouse and Structured Multidisciplinary Process

Marsha A Raebel 1, LeeAnn M Quintana 1, Emily B Schroeder 1, Susan M Shetterly 1, Lisa E Pieper 1, Paul L Epner 1, Laura K Bechtel 1, David H Smith 1, Andrew T Sterrett 1, Joseph A Chorny 1, Ira M Lubin 1
PMCID: PMC6941735  NIHMSID: NIHMS1064718  PMID: 30525932

Abstract

Context.—

The laboratory total testing process includes preanalytic, analytic, and postanalytic phases, but most laboratory quality improvement efforts address the analytic phase. Expanding quality improvement to preanalytic and postanalytic phases via use of medical data warehouses, repositories that include clinical, utilization, and administrative data, can improve patient care by ensuring appropriate test utilization. Cross-department, multidisciplinary collaboration to address gaps and improve patient and system outcomes is beneficial.

Objective.—

To demonstrate medical data warehouse utility for characterizing laboratory-associated quality gaps amenable to preanalytic or postanalytic interventions.

Design.—

A multidisciplinary team identified quality gaps. Medical data warehouse data were queried to characterize gaps. Organizational leaders were interviewed about quality improvement priorities. A decision aid with elements including national guidelines, local and national importance, and measurable outcomes was completed for each gap.

Results.—

Gaps identified included (1) test ordering; (2) diagnosis, detection, and documentation, and (3) high-risk medication monitoring. After examination of medical data warehouse data including enrollment, diagnoses, laboratory, pharmacy, and procedures for baseline performance, high-risk medication monitoring was selected, specifically alanine aminotransferase, aspartate aminotransferase, complete blood count, and creatinine testing among patients receiving disease-modifying antirheumatic drugs. The test utilization gap was in monitoring timeliness (eg, >60% of patients had a monitoring gap exceeding the guideline recommended frequency). Other contributors to selecting this gap were organizational enthusiasm, regulatory labeling, and feasibility of a significant laboratory role in addressing the gap.

Conclusions.—

A multidisciplinary process facilitated identification and selection of a laboratory medicine quality gap. Medical data warehouse data were instrumental in characterizing gaps.


The complete laboratory testing process includes preanalytic (eg, test selection, ordering, and specimen collection), analytic (eg, specimen analysis), and postanalytic (eg, result reporting) components.1 Laboratory quality improvement (QI) efforts have emphasized the analytic phase, in part because analytic data are generated within the laboratory; thus, those data are readily available for QI activities. Laboratories also focus on analytic-phase QI because analytic issues often negatively impact productivity or budget. Addressing preanalytic and postanalytic quality gaps is challenging for several reasons, one of which is that data generated outside the laboratory (eg, patient outcomes) have been of limited availability within the laboratory.2 Unfortunately, emphasis on analytic-phase QI initiatives has contributed to a focus on test performance characteristics or cost per test rather than issues such as test utilization. Test utilization addresses questions that include whether the most appropriate test is ordered and performed in a timely manner, as well as whether the test results achieve the clinical intent. Nonlaboratory professionals are rarely included in analytic-focused laboratory QI activities, and conversely, efforts that use laboratory tests to improve health care outcomes often lack the input of laboratory professionals. Then again, laboratory test utilization teams, composed of laboratory professionals, clinicians, and others, have been established in many health care settings and tasked to assess the introduction of new tests and to recommend changes to test use based on cost, professional practice, and regulatory guidance.

Because most laboratory errors occur in the preanalytic and postanalytic phases of the total testing process,3 laboratory QI projects should expand beyond analytic sources of error. This expanded approach requires timely access to comprehensive health care data including clinical, utilization, and administrative information. Electronic linkage of laboratory data with other health care data can support QI interventions to reduce quality gaps and to inform evidence-based laboratory practices. Importantly, decisions across the testing process can be facilitated by linking near–real-time laboratory, systems, and patient data to better understand relationships between test utilization and outcomes.

Medical data warehouses (MDWs) are repositories of clinical, utilization, and administrative data. Medical data warehouses have been used for research, surveillance, and QI.418 An MDW contains data generated during health care delivery and payment. Medical data warehouse data originate from diverse sources that include the electronic health record (EHR), laboratory information system (LIS), pharmacy, and administrative databases (eg, patient enrollment, claims reimbursement). Data in an MDW are available in an architecture conducive to rapid searching.19 These data are regularly updated, stored in a structured and consistent manner, quality checked, and linked to facilitate cross-table querying and analysis. Because data in an MDW reside in a database maintained separately from the source production information system databases (eg, the EHR), MDW data can be accessed and used at the same time as production information systems19 without slowing production system response time or otherwise compromising production systems’ requirements for real-time data access.

Medical data warehouses can be single site or multisite. One of the largest multisite MDWs is the Sentinel Initiative Distributed Database. It includes data from 17 data partners and contains information on more than 223 million members.20,21 One of the most comprehensive multisite MDWs is the 19-site Health Care Systems Research Network Virtual Data Warehouse (VDW).22 Kaiser Permanente of Colorado (KPCO), Denver, Colorado, is one Health Care Systems Research Network site.

Studies using laboratory results data in an MDW6,18,2325 have addressed static questions relevant to laboratory testing (eg, adherence to testing guidelines), but have not been used as a tool to monitor test utilization to inform an intervention. Because laboratory professionals have specialized training and expertise in clinical testing, making data from an MDW available to laboratory professionals for QI initiatives can aid in identifying and solving practice gaps that otherwise might be missed. Therefore, the Centers for Disease Control and Prevention Division of Laboratory Systems, Atlanta, Georgia, and KPCO collaborated on a project to evaluate MDW usefulness in addressing a laboratory medicine–based QI intervention that links to patient or system outcomes. In this paper, we present the methods and findings from the first activities of this project (1) to demonstrate the utility of an MDW in characterizing laboratory QI opportunities and (2) to establish a multidisciplinary process that enables successful selection of a laboratory medicine–based QI opportunity for intervention.

MATERIALS AND METHODS

This project was conducted in the KPCO Denver-Boulder metropolitan area. Kaiser Permanente of Colorado is a not-forprofit, integrated health care delivery system that in 2017 had more than 700 000 members, approximately 600 000 of whom were in the Denver-Boulder area. Members of KPCO receive outpatient health care at KP-owned medical facilities; facilities additionally provide laboratory, radiology, and pharmacy services. All KPCO facilities have fully integrated ambulatory EHR in all patient care areas with access from any KPCO location.

We applied a systematic, multicomponent approach to identify preanalytic and postanalytic laboratory medicine QI opportunities in the KPCO ambulatory care environment. We convened a Gap Identification Core Team (the Team) composed of local and national laboratory leaders, clinical content experts with diverse knowledge of quality issues, clinical medicine and pharmacy content experts, health information technology professionals, medical education specialists, evaluators, researchers, MDW experts, and project managers. For example, KPCO laboratory leaders who participated in the Team included the director of chemistry and toxicology (organizational leader), the director of pathology (physician champion; topic suggestions), the manager of laboratory QI (expertise on current laboratory QI projects), and the LIS manager (LIS capabilities; EHR interface). Team member expertise was instrumental in identifying, prioritizing, and selecting quality gaps. Because many evidence-based findings are not successfully implemented into routine clinical care, by carefully planning the composition of the Team and engaging key stakeholders early, our plan was to maximize the potential for success of this work. We intended to identify high-priority gaps that had local and national public health significance through proactively seeking KPCO sponsors and collaborators, educating internal stakeholders, and focusing on sustainability from the time of project initiation.

The Team interviewed 11 KPCO organizational and opinion leaders about QI priorities. These interviews established the local importance of the candidate gaps the Team had identified, while also identifying new potential quality gaps. The interviews also helped determine whether the local health care system was conducive to engagement with laboratory professionals to reduce the identified gaps. The leaders interviewed were selected because they represented expertise in clinical and operational quality, value, resource stewardship, health and prevention, chronic care, nursing, primary care, risk management, patient safety, and chemistry/toxicology. Interviews were conducted by project managers and/or the project lead and began with an explanation of project goals and objectives. After the interviewers answered any general questions the interviewees had about the project, the interviewers asked the leaders about KPCO QI priorities, complementary or competing ongoing initiatives, and challenges the leaders believed should be addressed. Leaders were asked to prioritize (ie, high, medium, or low) several candidate potential laboratory medicine quality gaps. The interviewers also asked questions about the leaders’ knowledge of the KPCO VDW. The qualitative input gathered during these interviews was incorporated into Team deliberations around potential gaps for intervention.

The MDW at KPCO, the VDW, is a comprehensive data repository that contains the timely, electronically linked data needed to characterize preanalytic and postanalytic laboratory medicine quality gaps. Key VDW content areas include demographics, enrollment, encounters, diagnoses, procedures, death, cause of death, tumor, census, pharmacy, vital signs, social history, provider, and LIS data such as laboratory results. Data tables are typically updated monthly or quarterly, but can be updated as often as daily if needed and if sufficient resources are available. Virtual data warehouse data lags range from essentially no lag (eg, laboratory results and other clinical data elements are available the same day) to 1 to 3 months (eg, external claims) to more than a year (eg, state death data). Virtual Data Warehouse tables are linked by a common, unique patient identifier that is different from the patient’s health record number. The crosswalk between the VDW patient identifier and the patient’s health record number is maintained in a separate data table for additional privacy and confidentiality protection. Implementation and operations of the VDW are governed by an operations committee. Ongoing Health Care Systems Research Network and KPCO processes ensure VDW quality is assessed and improved through programming and crowdsourcing via the user base.22 Virtual data warehouse data were used to determine if current performance for each potential laboratory quality gap could be quantified, and, if so, whether those data indicated a gap. In addition, for each potential gap, the Team evaluated the feasibility of measuring patient or system outcomes using VDW data.

To select potential quality gaps, the Team used a standard decision aid tool (see examples in Table 1 and in Supplemental Tables 1 and 2 [see supplemental digital content at www.archivesofpathology.org in the April 2019 table of contents]). The decision aid included health care system, patient, and data considerations. Completion of the decision aid for each potential gap was assisted by data and information gleaned from published literature, Team members’ knowledge, leader input, and VDW data. The national significance of each potential quality gap was also considered with this tool.

Table 1.

Completed Decision Aid for Identifying and Selecting a Laboratory Medicine Quality Gap for Potential Intervention: High-Risk Medication Monitoringa

Consideration Completed Assessment (in Brief) for High-Risk Medication Monitoring Potential Gap
Quality gap is preventable or has potential targets for improvement (list specifics Yes. Laboratory monitoring (CBC, ALT, AST, SCr) is recommended for many of these agents for safety and/or appropriate dosage
Strategies/interventions could be used to reduce the gap (list) Practice level intervention using EHR or laboratory decision support reminder to order recommended laboratory monitoring; patient IVR laboratory test reminder intervention
Potential harms that might be associated with the interventions (list) Unintended consequences that change existing workflow
Intermediate surrogate outcomes that could be measured (list) Yes. Compliance with guidelines/labeling recommendations: No. (%) with laboratory test(s) completed System: Time to dosage or medication change after laboratory test result available
Clinical: (1) No. (%) with elevated ALT/AST, (2) No. (%) with neutropenia, (3) No. (%) with elevated SCr
Long-term outcomes that could directly affect patients or the health care system (list) Early detection of developing adverse events
Timely laboratory results enhance ability to titrate dosage to better manage condition
Decreased provider burden associated with laboratory outreach
Enhanced guideline concordance
Local importance (low/medium/high; potential effect size at least moderate) Medium
National importance (low/medium/high; include references) Medium. Impacts moderate No. of patients
Drug toxicity contributes to patient morbidity and mortality
HEDIS criteria include DMARD use
American College of Rheumatology recommends optimal follow-up intervals for complete blood count, liver transaminase levels, and creatinine for patients with rheumatoid arthritis receiving DMARDs
Product labeling from FDA recommends laboratory monitoring for safe DMARD use
Local health care system conducive to the intervention (yes/no; explain) Yes. Rheumatoid arthritis registry in development that includes patient-specific laboratory monitoring status. EHR Smart Set reminds providers to order laboratory tests for rheumatoid arthritis patients
Registries planned for gastrointestinal and dermatology patients receiving these agents
Clinical pharmacy specialist resources in rheumatology, gastroenterology, and dermatology are enthusiastic about opportunity to support appropriate laboratory monitoring of these high-risk drugs
Feasibility of establishing baseline status (low/medium/high; explain) High. Required data already in VDW
Baseline data indicate a gap in performance (yes/no; provide summary) Yes
Availability of published standards/criteria to enable evaluation (provide references) Singh et al32
Feasibility of assessing outcomes using MDW (low/medium/high; explain) High. Data in VDW
Experience using these laboratory and drug data
Relevant data in MDW (list data needed) Laboratory results (CBC, ALT/AST, SCr)
Drug dispensing and infusion data
Data needed from outside MDW (yes/no; if yes, list) No
Potential challenges (list) Interventions to reduce quality gap likely will require electronic patient outreach and/or EHR alerts or messages. These intervention types require development assistance and approvals from departments not on the study. Such activities have been collaboratively accomplished in other projects; time frame to develop must be coordinated with these other departments
Guidelines for monitoring are changing over time
Differences in laboratory monitoring frequencies exist between patients newly started on DMARD and patients being chronically maintained on DMARD. Different programming and evaluation needed for different patient groups
Differences in recommended laboratory monitoring by individual agents increases complexity
Not a high-intensity intervention

Abbreviations: ALT, alanine aminotransferase; AST, aspartate aminotransferase; CBC, complete blood count; DMARD, disease-modifying antirheumatic drug; EHR, electronic health record; FDA, US Food and Drug Administration; HEDIS, Healthcare Effectiveness Data and Information Set; IVR, interactive voice response; MDW, medical data warehouse; SCr, serum creatinine; VDW, virtual data warehouse.

a

Completed decision aids for the laboratory medicine quality gaps test ordering and diagnosis, detection, and documentation are available in Supplemental Tables 1 and 2.

This work is a public health activity. The KPCO Institutional Review Board determined that this project did not meet the regulatory definition of research involving human subjects.

RESULTS

Preanalytic and postanalytic laboratory medicine quality gap topics preliminarily considered are shown in Table 2. Based on knowledge developed using the decision aid, the preliminary list was narrowed to 3 topics for further consideration: (1) test ordering; (2) diagnosis, detection, and documentation; and (3) high-risk medication monitoring. The completed decision aid for high-risk medication monitoring is shown in Table 1. Completed decision aids for test ordering and diagnosis, detection, and documentation are available in Supplemental Tables 1 and 2.

Table 2.

Laboratory Medicine Quality Gap Topics Considered

Gap
Testing Phase(s) Impacted How Gap Identified Consideration Status
Topic Subtopic(s)
Decrease inappropriate test ordering CK-MB Preanalytic Gap Identification Core Team Finalist
PSA
1,25-dihydroxyvitamin D
Genetic tests
Improve diagnosis, detection, and documentation CKD at risk—no diagnosis; laboratory test evidence of CKD Preanalytic and postanalytic Gap Identification Core Team Finalist
Diabetes and prediabetes
Anemia
Improve high-risk medication monitoring Anticoagulants Preanalytic and postanalytic Organizational leaders Finalist and selected for future intervention
DMARDs
Improve CKD monitoring, automated ordering CKD diagnosis; no microalbuminuria/creatinine ratio, SCr Preanalytic Gap Identification Core Team Preliminary only
Test grouping with orders (microalbuminuria, SCr, lipids)
Improve workup of polycythemia JAK2 testing for unexplained polycythemia Preanalytic Gap Identification Core Team Preliminary only
Address posttesting gaps in colorectal cancer screening Follow-up testing for positive fecal immunochemical test results Postanalytic Gap Identification Core Team Preliminary only
Time to diagnosis
Address failure to retrieve laboratory test results Test pending at discharge but after discharge, primary care provider unaware Postanalytic Gap Identification Core Team Preliminary only
Results not looked at until the next office visit
Reduce diabetes-related gaps Prediabetes diagnosis not in problem list Postanalytic Gap Identification Core Team Preliminary only
Microalbumin annually
Improve secondary hyperparathyroidism recognition Elevated parathyroid hormone without a diagnosis of hyperparathyroidism Postanalytic Organizational leaders Preliminary only
Address laboratory testing noncompletion By test type Preanalytic Organizational leaders Preliminary only
By patient characteristics
By clinic

Abbreviations: CKD, chronic kidney disease; CK-MB, creatine kinase–MB isoenzyme; DMARD, disease-modifying antirheumatic drug; JAK2, Janus kinase 2 gene; PSA, prostate-specific antigen; SCr, serum creatinine.

Each of these 3 gap topics had several potential subtopics. Given available resources, the only subtopics examined within each topic were those of national importance identified by leaders as of high or medium interest at KPCO. For test ordering, subtopics included (1) tests that should be ordered only in certain circumstances (ie, prostate-specific antigen [PSA] testing,26 1,25-dihydroxyvitamin D testing,26 and genetic testing), and (2) obsolete test ordering (ie, creatine kinase–MB isoenzyme for acute myocardial infarction).26 Within diagnosis, detection, and documentation, the subtopics were conditions where laboratory testing was integral to diagnosis, including (1) serum creatinine (SCr) and glomerular filtration rate for chronic kidney disease,27,28 (2) glycosylated hemoglobin and fasting glucose for diabetes and prediabetes,2931 and (3) hemoglobin for anemia. For high-risk medication monitoring, the subtopics considered were areas where laboratory testing was important to safe and effective medication use. These included (1) international normalized ratio monitoring among patients with atrial fibrillation receiving warfarin and (2) alanine aminotransferase (ALT), aspartate aminotransferase (AST), complete blood count (CBC), and SCr monitoring among patients with a rheumatologic condition receiving a disease-modifying antirheumatic drug (DMARD).32

The Team examined and deliberated on data extracted from the VDW and other evidence related to these potential quality gaps during 4 to 5 months. At the completion of this process, high-risk medication monitoring was selected as the laboratory medicine quality gap topic for future intervention, with ALT, AST, CBC, and SCr laboratory monitoring for DMARD therapy as the subtopic. A major consideration in selecting this quality gap was the potential for clinically important adverse events associated with DMARD use. For example, approximately 9% of patients taking the DMARD leflunomide have ALT and/or AST elevations exceeding 2- to 3-fold the upper limit of normal, with 2 to 4.9 per 10 000 patients per year experiencing leflunomide-associated hepatotoxicity of sufficient severity to require hospitalization.33,34 Similarly, the DMARD methotrexate is associated with a 15% occurrence of ALT and/or AST abnormalities during the first year of therapy, with 5% of patients discontinuing methotrexate because of hepatotoxicity.35 Risks of DMARD-associated adverse events such as hepatotoxicity are minimized if laboratory test results are monitored in a timely manner and DMARD dosages adjusted or the DMARD discontinued if laboratory abnormalities are present or emerging.36

The VDW data tables accessed and linked to characterize the high-risk medication monitoring QI opportunity included enrollment, diagnoses (all individuals had at least 2 diagnoses of one of the following: rheumatoid arthritis, ankylosing spondylitis, psoriatic arthritis, or plaque psoriasis), laboratory results (dates of completion, result values, and reference ranges), pharmacy (dispensing dates and DMARD generic names), procedures (for DMARDs administered by infusion or injection), and death (an exclusion). From these VDW data, a gap in DMARD laboratory monitoring was characterized in guideline-concordant completion of laboratory tests by patients (timeliness of testing) (Table 3). For example, in patients treated with leflunomide or methotrexate, ALT, AST, CBC, and SCr are recommended to be evaluated at least every 12 weeks (84 days).32 In preliminarily characterizing the gap, we used VDW pharmacy and laboratory data to estimate the proportion of patients with guideline-concordant completion of ALT, AST, CBC, and SCr, allowing a grace period of 16 days (ie, testing within 100 days). As shown in Table 3, among patients treated with leflunomide or methotrexate, many patients did not make themselves available for a blood sample to be drawn. More than 100 days elapsed between ALT test completions in 328 (65.5%) and 922 patients (60.7%) taking leflunomide or methotrexate, respectively. Similarly, more than 100 days elapsed between completion of CBC testing in 288 (57.5%) and 847 patients (55.7%), respectively.

Table 3.

Data From Virtual Data Warehouse Indicating Gap in Timeliness of Disease-Modifying Antirheumatic Drug (DMARD) Monitoring Among 2203 Patients With a Rheumatologic Diagnosisa

Laboratory Testing for the DMARDs Leflunomide and Methotrexate Patients With a Gap Between Laboratory Testings >100 d, No. (%)b
Leflunomide (501 patients)
  Alanine aminotransferase 328 (65.5)
  Aspartate aminotransferase 305 (60.9)
  Complete blood count 288 (57.5)
  Serum creatinine 293 (58.5)
Methotrexate (1520 patients)
  Alanine aminotransferase 922 (60.7)
  Aspartate aminotransferase 886 (58.3)
  Complete blood count 847 (55.7)
  Serum creatinine 587 6.4)
a

Date range: January 1, 2014–September 30, 2016. Patients were counted only once within a DMARD and within a specific laboratory test. Patients could appear more than once across laboratory tests (eg, have a gap in both alanine aminotransferase testing and complete blood count testing) and could have gaps in both DMARDs if they were taking both medications.

b

Patients were counted as having a gap of >100 days only if they remained enrolled in the health plan, remained alive, had at least >100 days elapse after starting DMARD therapy, and did not have the DMARD discontinued during those >100 days (based on both DMARD dispensing/administration data and no DMARD discontinuation documented). National32 and Kaiser Permanente Colorado guidelines recommend monitoring every 12 weeks (ie, 84 days).

Additional considerations that contributed to selecting this quality gap were organizational leadership, rheumatology, pharmacy, and laboratory departmental interest and the presence of DMARD regulatory labeling and national and local guidelines for laboratory testing and frequencies of testing. A final consideration in selecting high-risk medication monitoring as the gap for intervention was an intent to demonstrate that laboratory professionals are positioned to have leadership roles not only in identifying and characterizing quality gaps, but also in developing preanalytic or postanalytic interventions that link to health outcomes and process improvement when data through an MDW are available for analysis.

A test-ordering subtopic was not selected as the gap for intervention largely because the organization was already addressing several testing subtopics, including low-risk PSA testing, 1,25-dihydroxyvitamin D testing, and creatine kinase–MB isoenzyme ordering. For example, data from the VDW illustrated that an ongoing initiative to decrease low-risk PSA testing was effective: in 2012 (preintervention), 36 168 PSA results were documented in the VDW laboratory results table, whereas in 2015 (postintervention), 19 498 PSA results were documented. Further information is in Supplemental Table 1.

A diagnosis, detection, and documentation subtopic was not selected for intervention because the impact of a laboratory-led QI intervention would have been difficult to separate from the impact of ongoing initiatives led by other departments. For example, data extracted using VDW enrollment, death, diagnosis, and laboratory result tables indicated that an existing initiative was effective at ensuring diabetes was documented: among 6154 patients with initial and follow-up glycosylated hemoglobin result values of 6.5% or higher, 5817 (94.5%) had a diabetes diagnosis within 1 year. Further, because of multiple ongoing efforts within the organization aimed at improving diagnosis, detection, and documentation subtopics, organizational leaders encouraged the Team to pursue a different gap topic for this project. Further details are in Supplemental Table 2.

DISCUSSION

These results demonstrate the utility of an MDW for providing data to document the presence or absence of quality gaps in preanalytic and postanalytic phases of laboratory medicine. To develop the information needed to identify QI opportunities, we used linked MDW data content that included enrollment, demographics, diagnoses, pharmacy, laboratory results, and death. We then extracted relevant data and examined the results to confirm performance gaps.

Although production databases such as EHR and LIS usually have the capability to interrogate data within that database (eg, the LIS can be queried to provide data about laboratory testing), production databases typically cannot access and link data from other databases. This technical capability is a major strength of MDWs that enables their use for identifying preanalytic and postanalytic laboratory medicine QI opportunities. For example, because MDW data include dates of medication dispensing and laboratory results, temporal relationships relevant to patient testing are readily derived. Further, the quality of the data in MDWs such as the KPCO VDW and the VDWs at other Health Care Systems Research Network sites is maintained and improved through routine, ongoing characterization and quality checks of content areas. Also, all sites that participate in a multisite MDW use the same data structure, supporting conduct of the same or similar studies at other sites and enabling cross-site comparisons.

The innovative approach we applied to use MDW data to select laboratory medicine QI opportunities is generalizable and transferable, as health systems increasingly have MDWs as well as health information technology capabilities that can use MDW data. The potential scope of MDW utility in laboratory medicine QI is significant when placed within the context of the role that laboratory testing plays in medical care. Laboratory tests are ordered during one-third of primary care encounters37 and laboratory results inform diagnosis, treatment selection, and monitoring of conditions and therapies.2 Up to 54% of errors reported by primary care physicians and staff are related to laboratory medicine.37

Timeliness of guideline-concordant testing during DMARD therapy is a potential gap involving appropriate test utilization that the laboratory can identify and characterize using data available in an MDW. Characterizing this gap enables the laboratory to collaborate with clinicians to bring patients in for specimen collection (preanalytic) so that timely testing can be performed and reported (postanalytic) to inform medication adjustment, if needed. Contributing to appropriate clinical test utilization is within the laboratory’s role,38 but is part of the role that is difficult to fulfill without linking laboratory data to patient and outcomes data via an MDW. This linkage provides opportunities to advance the laboratory’s role in improving health outcomes, considering that the intervention will include identifying patients who are not guideline concordant (a laboratory role relative to the DMARD gap).

Notably, our method included convening a multidisciplinary team to identify quality gaps and to select a gap for future intervention. The Team’s work was supported by a decision aid tool where relevant information was compiled and reviewed. The expertise of Team members was instrumental in identifying performance gaps. Additionally, Team engagement was crucial to developing commitment to the project, agreement on gap topics to pursue, awareness around MDW utility in quality initiatives, and building the trust necessary for laboratory professionals to initiate and effectively engage with the local health care system. Furthermore, we believe that the project work now underway (developing and implementing the intervention to improve timeliness of laboratory monitoring of DMARD therapy) is progressing smoothly in large part because of the multidisciplinary relationships established during the gap selection activities.

Interviewing leaders to determine their knowledge and QI priorities served the dual purpose of also educating them about preanalytic and postanalytic laboratory QI opportunities. The interviews also aided in developing the organizational commitments necessary to identify a locally important laboratory medicine QI gap and to establish engagement for a future intervention targeting that gap.

One fact the Team learned from the leader interviews was that, in a large organization such as KPCO, no single individual is knowledgeable about all ongoing QI initiatives or all complementary or competing priorities. This learning underscores the importance of the multidisciplinary process when identifying and planning for a successful laboratorycentric QI intervention that impacts the preanalytic or postanalytic phase of the total testing process.

The multidisciplinary team approach and organizational leader engagement efforts are key strategies to, and activities for, local success and internal sustainability, as well as strategies to enhance external generalizability and dissemination. The multistakeholder involvement approach intersects with a recommendation regarding the utility of diagnostic management teams (and health care teams in general) made in the Institute of Medicine39 (now National Academy of Medicine) report, Improving Diagnosis in Health Care. It also intersects with laboratory test utilization teams. It is potentially more accurate to consider our project’s multidisciplinary team as a combination of a diagnostic management team and a laboratory test utilization team (ie, to improve test utilization in conjunction with an intervention/outreach). The Institute of Medicine report also emphasizes the importance of health information technologies such as MDWs to support patients and health care professionals.

A limitation to the transferability of our work is that although all MDWs contain administrative data, some MDWs do not include the clinical data needed to identify laboratory QI opportunities.20,40 However, even at organizations with this constraint, MDW tables such as diagnosis, pharmacy, and procedures (eg, whether a laboratory test was completed) can be linked to identify QI opportunities.

In conclusion, providing laboratory access to clinical and other data contained within an MDW provides novel and important opportunities to identify and characterize quality gaps that may otherwise not be addressed. The process described also highlights the need for the laboratory to engage with other departments because patient and system outcomes include broad components of a health care delivery system. Our example demonstrated that the combination of laboratory, clinical, and administrative health care data available in a comprehensive MDW, together with the expertise of a multidisciplinary team of professionals, supplemented by organizational stakeholder engagement, is effective at identifying, prioritizing, and characterizing quality gaps in the preanalytic and postanalytic phases of laboratory testing. The baseline data developed and the information learned to date will inform the development and implementation of a specific QI intervention.

Supplementary Material

Supplemental

Acknowledgments

We thank Glenn Goodrich, MS, for programming support. We also thank Matthew Rubinstein MS, MT (ASCP), for his valued consultation when the project was beginning. Finally, we thank Bharati Bhardwaja, PharmD, BCPS, LSSBB, for her guidance on laboratory monitoring among patients with a rheumatologic condition receiving a disease-modifying antirheumatic drug. Drs Raebel, Smith, and Sterrett, Mss Quintana, Shetterly, and Pieper, and Mr Epner received salary support for this work through a cooperative agreement from the Centers for Disease Control and Prevention (5NU47OE000102-02-00) to Kaiser Permanente Colorado.

The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the Centers for Disease Control and Prevention or the US Agency for Toxic Substances and Disease Registry.

Footnotes

The authors have no relevant financial interest in the products or companies described in this article.

Supplemental digital content is available for this article at archivesofpathology.org in the April 2019 table of contents.

References

  • 1.Smith ML, Raab SS, Fernald DH, et al. Evaluating the connections between primary care practice and clinical laboratory testing: a review of the literature and call for laboratory involvement in the solutions. Arch Pathol Lab Med 2013; 137(1):120–125. [DOI] [PubMed] [Google Scholar]
  • 2.Plebani M Exploring the iceberg of errors in laboratory medicine. Clin Chim Acta 2009;404(1):16–23. [DOI] [PubMed] [Google Scholar]
  • 3.Christenson RH, Snyder SR, Shaw CS, et al. Laboratory medicine best practices: systematic evidence review and evaluation methods for quality improvement. Clin Chem 2011;57(6):816–825. [DOI] [PubMed] [Google Scholar]
  • 4.Raebel MA, Zeng C, Cheetham TC, et al. Risk of breast cancer with long-term use of calcium channel blockers or angiotensin-converting enzyme inhibitors among older women. Am J Epidemiol 2017;185(4):264–273. [DOI] [PubMed] [Google Scholar]
  • 5.Andrade SE, Raebel MA, Brown J, et al. Use of antidepressant medications during pregnancy: a multi-site study. Am J Obstet Gynecol 2008;198(2): 194.e191–e195. [DOI] [PubMed] [Google Scholar]
  • 6.Raebel MA, Ross C, Xu S, et al. Diabetes and drug-associated hyperkalemia: effect of potassium monitoring. J Gen Intern Med 2010;25(4):326–333. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Raebel MA, Newcomer SR, Reifler LM, et al. Chronic use of opioid medication before and after bariatric surgery. JAMA 2013;310(13):1369–1376. [DOI] [PubMed] [Google Scholar]
  • 8.Raebel MA, Ellis JL, Schroeder EB, et al. Intensification of antihyperglycemic therapy among patients with incident diabetes: a Surveillance Prevention and Management of Diabetes Mellitus (SUPREME-DM) study. Pharmacoepidemiol Drug Saf 2014;23(7):699–710. [DOI] [PubMed] [Google Scholar]
  • 9.Nichols GA, Schroeder EB, Karter AJ, et al. Trends in diabetes incidence, 2006–2011, in seven million insured US adults: the SUPREME-DM project. Am J Epidemiol 2015;181(1):32–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Lafata EJ, Schmittdiel J, Karter AJ, et al. Medication adherence does not explain black-white differences in cardiometabolic risk factor control among insured patients with diabetes. J Gen Intern Med 2016;31(2):188–195. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lu CY, Zhang F, Lakoma MD, et al. Changes in antidepressant use by young people and suicidal behavior after FDA warnings and media coverage: quasi-experimental study. BMJ 2014;348:g3596. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Neugebauer R, Fireman B, Roy J, O’Connor PJ, Selby JV. Dynamic marginal structural modeling to evaluate the comparative effectiveness and safety of more or less aggressive treatment intensification strategies in type 2 diabetes. Pharmacoepidemiol Drug Saf 2012;21(suppl 2):99–113. [DOI] [PubMed] [Google Scholar]
  • 13.Nichols GA, Desai J, Elston LJ, et al. Construction of a multisite DataLink using electronic health records for the identification, surveillance, prevention, and management of diabetes mellitus: the SUPREME-DM project. Prev Chronic Dis 2012;9:E110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Schroeder EB, Goodrich GK, Newton KM, Schmittdiel JA, Raebel MA. Implications of different laboratory-based incident diabetic kidney disease definitions on comparative effectiveness studies. J Comp Eff Res 2014;3(4): 359–369. [DOI] [PubMed] [Google Scholar]
  • 15.Schmittdiel JA, Raebel MA, Dyer W, et al. Medicare STAR excludes patients with poor CVD risk factor control. Am J Manag Care 2014;20(12):e581–e589. [PMC free article] [PubMed] [Google Scholar]
  • 16.Flory JH, Roy J, Gagne JJ, et al. Missing laboratory results data in electronic health databases: implications for monitoring diabetes risk. J Comp Eff Res 2017; 6(1):25–32. [DOI] [PubMed] [Google Scholar]
  • 17.Raebel MA, Shetterly S, Lu CY, et al. Methods for using clinical laboratory test results as baseline confounders in multi-site observational database studies when missing data are expected. Pharmacoepidemiol Drug Saf 2016;25(7):798–814. [DOI] [PubMed] [Google Scholar]
  • 18.Raebel MA, Penfold R, McMahon AW, et al. Adherence to guidelines for glucose assessment in starting second-generation antipsychotics. Pediatrics 2014;134(5):e1308–e1314. [DOI] [PubMed] [Google Scholar]
  • 19.Krasowski MD, Schriever A, Mathur G, Blau JL, Stauffer SL, Ford BA. Use of a data warehouse at an academic medical center for clinical pathology quality improvement, education, and research. J Pathol Inform 2015;6:45. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Sentinel Initiative. Distributed database and common data model Available at https://www.sentinelinitiative.org/sentinel/data/distributed-database-common-data-model. Published 2017. Accessed October 26, 2017.
  • 21.Curtis LH, Weiner MG, Boudreau DM, et al. Design considerations, architecture, and use of the Mini-Sentinel distributed data system. Pharmacoepidemiol Drug Saf 2012;21(suppl 1):23–31. doi: 10.1002/pds.2336 [DOI] [PubMed] [Google Scholar]
  • 22.Ross TR, Ng D, Brown JS, et al. The HMO Research Network Virtual Data Warehouse: a public data model to support collaboration. EGEMS (Wash DC) 2014;2(1):1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Feldstein AC, Smith DH, Perrin N, et al. Improved therapeutic monitoring with several interventions: a randomized trial. Arch Intern Med 2006;166(17): 1848–1854. [DOI] [PubMed] [Google Scholar]
  • 24.Raebel MA, Chester EA, Newsom EE, et al. Randomized trial to improve laboratory safety monitoring of ongoing drug therapy in ambulatory patients. Pharmacotherapy 2006;26(5):619–626. [DOI] [PubMed] [Google Scholar]
  • 25.Raebel MA, Carroll NM, Andrade SE, et al. Monitoring of drugs with a narrow therapeutic range in ambulatory care. Am J Manag Care 2006;12(5):268–274. [PubMed] [Google Scholar]
  • 26.ABIM Foundation. Choosing wisely Available at http://www.choosingwisely.org/. Published 2017. Accessed October 30, 2017.
  • 27.Centers for Disease Control and Prevention Office of Disease Prevention and Health Promotion. Healthy People 2020: chronic kidney disease objectives Available at https://www.healthypeople.gov/2020/topics-objectives/topic/chronic-kidney-disease/objectives. Published 2010. Accessed October 30, 2017.
  • 28.KDIGO. CKD evaluation and management Available at http://kdigo.org/guidelines/. Accessed October 30, 2017.
  • 29.American Diabetes Association. Classification and diagnosis of diabetes. Diabetes Care 2015;38(suppl 1):S8–S16. [DOI] [PubMed] [Google Scholar]
  • 30.Centers for Disease Control and Prevention Office of Disease Prevention and Health Promotion. Healthy People 2010: diabetes Available at http://www.healthypeople.gov/2010/document/pdf/Volume1/05Diabetes.pdf. Accessed November 22, 2017.
  • 31.American Diabetes Association. Standards of medical care in diabetes—2016. Diabetes Care 2016;39(suppl 1):S1–S112. [DOI] [PubMed] [Google Scholar]
  • 32.Singh JA, Saag KG, Bridges SL Jr, et al. 2015. American College of Rheumatology guideline for the treatment of rheumatoid arthritis. Arthritis Care Res (Hoboken) 2016;68(1):1–25. [DOI] [PubMed] [Google Scholar]
  • 33.Suissa S, Ernst P, Hudson M, et al. Newer disease-modifying antirheumatic drugs and the risk of serious hepatic adverse events in patients with rheumatoid arthritis. Am J Med 2004;117(2):87–92. [DOI] [PubMed] [Google Scholar]
  • 34.Alcorn N, Saunders S, Madhok R. Benefit-risk assessment of leflunomide: an appraisal of leflunomide in rheumatoid arthritis 10 years after licensing. Drug Saf 2009;32(12):1123–1134. [DOI] [PubMed] [Google Scholar]
  • 35.Lopez-Olivo MA, Siddhanamatha HR, Shea B, Tugwell P, Wells GA, Suarez-Almazor ME. Methotrexate for treating rheumatoid arthritis. Cochrane Database Syst Rev 2014;(6):CD000957. doi: 10.1002/14651858.CD000957.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Saag KG, Teng GG, Patkar NM, et al. American College of Rheumatology 2008 recommendations for the use of nonbiologic and biologic disease modifying antirheumatic drugs in rheumatoid arthritis. Arthritis Rheum 2008; 59(6):762–784. [DOI] [PubMed] [Google Scholar]
  • 37.Hickner J, Fernald D, Harris D, Poon EG, Elder N, Mold J. Issues and initiatives in the testing process in primary care physician offices. Jt Comm J Qual Patient Saf 2005;31(2):81–89. [DOI] [PubMed] [Google Scholar]
  • 38.Sarkar MK, Botz CM, Laposata M. An assessment of overutilization and underutilization of laboratory tests by expert physicians in the evaluation of patients for bleeding and thrombotic disorders in clinical context and in real time. Diagnosis 2017;4(1):21–26. [DOI] [PubMed] [Google Scholar]
  • 39.Institute of Medicine, National Academies of Sciences, Engineering, Medicine. Improving Diagnosis in Health Care Washington, DC: National Academies Press; 2015. [Google Scholar]
  • 40.Raebel MA, Haynes K, Woodworth TS, et al. Electronic clinical laboratory test results data tables: lessons from Mini-Sentinel. Pharmacoepidemiol Drug Saf 2014;23(6):609–618. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplemental

RESOURCES