Abstract
Objective
To identify challenges and pragmatic strategies for improving diagnostic safety at an organizational level using concepts from learning health systems
Methods
We interviewed 32 safety leaders across the USA on how their organizations approach diagnostic safety. Participants were recruited through email and represented geographically diverse academic and non-academic settings. The interview included questions on culture of reporting and learning from diagnostic errors; data gathering and analysis activities; diagnostic training and educational activities; and engagement of clinical leadership, staff, patients, and families in diagnostic safety activities. We conducted an inductive content analysis of interview transcripts and two reviewers coded all data.
Results
Of 32 participants, 12 reported having a specific program to address diagnostic errors. Multiple barriers to implement diagnostic safety activities emerged: serious concerns about psychological safety associated with diagnostic error; lack of infrastructure for measurement, monitoring, and improvement activities related to diagnosis; lack of leadership investment, which was often diverted to competing priorities related to publicly reported measures or other incentives; and lack of dedicated teams to work on diagnostic safety. Participants provided several strategies to overcome barriers including adapting trigger tools to identify safety events, engaging patients in diagnostic safety, and appointing dedicated diagnostic safety champions.
Conclusions
Several foundational building blocks related to learning health systems could inform organizational efforts to reduce diagnostic error. Promoting an organizational culture specific to diagnostic safety, using science and informatics to improve measurement and analysis, leadership incentives to build institutional capacity to address diagnostic errors, and patient engagement in diagnostic safety activities can enable progress.
Supplementary Information
The online version contains supplementary material available at 10.1007/s11606-022-07554-w.
KEY WORDS: patient safety, diagnostic errors, learning health systems, health care quality, diagnostic excellence
BACKGROUND
The National Academies of Sciences, Engineering and Medicine (NASEM) report, “Improving Diagnosis in Health Care”1 called on health care organizations (HCOs) to create environments that identify, learn, and reduce diagnostic errors in care. However, most HCOs find diagnostic safety harder to address compared to other safety concerns2, 3—diagnosis is a complex and evolving process involving uncertainty.4, 5 Diagnostic errors are harder to identify and analyze.6–8 Consequently, guidance is limited on how to approach measurement and improvement of diagnostic error in clinical settings.9
Learning health systems (LHS) approaches can be useful to advance diagnostic safety.2, 10 According to the National Academies, a learning health care system is “one in which science, informatics, incentives, and culture are aligned for continuous improvement, innovation, and equity - with best practices and discovery seamlessly embedded in the delivery process, individuals and families active participants in all elements, and new knowledge generated as an integral by-product of the delivery experience.”11 Quality and safety are inherent in a LHS where measurement to produce actionable data for improvement is foundational. LHS approaches may be useful to consider in addressing diagnostic errors.9
Diagnostic errors pose unique challenges for learning and improvement due to the complexity of the diagnostic process, the human-system interaction inherent to making a diagnosis, and resources necessary to analyze those errors to determine contributing factors.9 Many HCOs do not have adequate infrastructure or processes in place to identify diagnostic errors let alone learn from them.12 Given the limited practical guidance in the literature on how health care organizations can reduce diagnostic errors, we sought to advance understanding of how organizations are currently approaching diagnostic safety. Using concepts from learning health systems, we interviewed health care quality and safety leaders across the USA to identify both challenges and pragmatic strategies for improving diagnostic safety at an organizational level.
METHODS
Study Setting and Population
We recruited 32 health system quality and safety leaders from a diverse set of 30 US health care organizations. The HCOs are primarily academic health systems with larger hospitals in urban areas and associated primary, urgent, and specialty care locations in surrounding and outlying areas. The leaders identified their primary roles as senior level personnel in quality and patient safety, institutional leadership, and/or frontline clinicians (Table 1). We used two methods for recruitment: (1) an invitation sent by Institute for Healthcare Improvement (IHI) to a list of patient safety professionals in the combined IHI and National Patient Safety Foundation database (including Chief Quality Officers, certified professionals in patient safety, American Society for Professionals in Patient Safety) to explore interest. The invitation included a brief recruitment survey to identify individuals who had the experience and authority to discuss barriers as well as opportunities to help clinicians and their organizations address or improve diagnostic safety. Our team then followed up with interested participants to schedule an interview. (2) Due to the low response rate (n=18), the team sent out direct recruitment emails to quality/safety leaders at different HCOs known to be working on diagnostic safety initiatives (i.e., based on knowledge from published literature, blogs, or personal knowledge based on existing networks). A final list of participants represented geographically diverse academic and non-academic settings caring for adults and/or children.
Table 1.
Primary role identified | # | |
---|---|---|
Quality and patient safety role (e.g., Chief, Manager, Officer) | 14 | |
Facility leadership role (e.g., Director, VP, Chair) | 13 | |
Clinicians | 5 | |
Total participants | 32 | |
Region | ||
Midwestern US | 7 | |
Northeastern US | 13 | |
Southern US | 5 | |
Western US | 5 | |
Total HCOs | 30 | |
Academic affiliation | ||
Academic | 27 | |
Non-academic | 3 | |
Total HCOs | 30 |
Interview Guide Development
We developed a semi-structured interview guide to facilitate data collection. The content of the interview guide was divided into five domain areas generated by literature review and extensive team discussions. The final interview guide included 23 questions (Appendix 1) with probes, as needed, exploring the challenges of addressing diagnostic error and patient safety within learning health care organizations. The 5 domains assessed by the interview guide included (1) clinical staff/leadership (e.g., are there teams/programs to address diagnostic error, if not, what are the barriers; does your board/senior leadership (C-suite) demonstrate culture and commitment towards addressing diagnostic errors?); (2) culture of reporting and learning (e.g., how do you encourage your staff and employees to voice their concerns?); (3) quality and safety activities (e.g., how do you identify cases, how often do you discuss cases of diagnostic error at venues such as Morbidity & Mortality sessions or peer reviews?); (4) training and education (e.g., what are you doing to reinforce clinician training around diagnostic errors including using strategies such as simulation, cognitive training, and better teamwork?); and finally (5) patient engagement (e.g., how do you encourage patient/families to provide feedback or voice concerns?). Lastly, all participants were asked to make recommendations on how to promote correct and timely diagnosis and move towards high reliability in this area.
Data Collection and Analysis
Individual interviews were conducted by telephone between August 2019 and January 2020. One author (US), a qualitative researcher, conducted all the interviews. The average length of interview was 40 minutes (range 35–45 minutes). All interviews were audio-recorded and transcribed. We conducted an inductive qualitative content analysis allowing codes and categories to emerge from the data and new insights to be included as they arise. The interviewer (US) conducted the initial data analysis by reading transcripts repeatedly. Codes were primarily derived by highlighting the exact words from the text that appeared to capture key thoughts or concepts and a codebook was drafted. This process continued for each transcript, until no more new or meaningful concepts emerged.
After reviewing and revising the initial coding scheme with the study team, a second coder (UM) with expertise in quality and health informatics independently coded all interviews to ensure all information is captured. The two reviewers merged data and reviewed all codes to resolve any discrepancies. The team then met to refine the codebook and group codes with similar meanings into higher order categories representing main barriers to diagnostic safety that the HCO faces. The final codebook and categories were shared with the research team for discussion, and all identified risk areas were reviewed with the entire research team to resolve any questions or discrepancies.
RESULTS
We analyzed interviews of 32 participants including who primarily identified themselves as chief quality and patient safety officer/managers (n=14), facility leadership (n=13), and frontline clinicians (n=5) (Table 1). Qualitative analysis revealed four main barriers to diagnostic safety that HCOs face related to (1) Diagnostic safety culture; (2) Infrastructure for measurement, monitoring, and improvement activities; (3) Leadership investment; and (4) Dedicated team structure to work on diagnostic safety. Participant suggestions for improvement are included in each section. In addition, all participants included patient engagement in diagnostic safety activities as an overarching foundation of this work and provided examples of how their organization was trying to meet this goal. Representative quotes for each theme are presented in Table 2.
Diagnostic safety culture
Table 2.
Barriers to diagnostic safety themes | n(%) | Representative quotes |
---|---|---|
1. Diagnostic safety culture | 19(59%) |
“When we call in medical staff quality committee to discuss an event…It’s an embarrassment...Diagnosis, as you know, with physicians is tied to your identity to some degree, and so these things are hard to discuss.” (R037) “I’m trying to be as transparent as possible, I would say the culture has been rather punitive when it comes to error, and not just diagnostic error but any kind of error…”. (R042) “Most of us work under a lot of time pressures and workflow issues that really require us to keep moving, and often times, transparency, especially transparency with your thought process of making a diagnosis, takes time and energy that could wear you down.” (R037) |
Positive comments/recommendations | 18(56%) |
“We have a safety initiative in place that we refer to as we ARE safe, which stands for accountable, reliable, and empowered, and as part of that initiative, we promote certain safety behaviors that are intended to be high reliability practices that reduce the likelihood of human error.” (R059) “We talked about the safety at our departmental meetings and at our general staff meetings. We talk about our serious safety event rate, and so we are being more transparent with that and trying to develop more of a just culture where people feel comfortable reporting....” (R038) |
2. Infrastructure for measurement, monitoring, and improvement activities | ||
Measure and monitor diagnostic errors | 25(78%) |
“We haven’t really figured out our tools, haven’t measured it…You get a measure and then there’s no benchmark. We don’t know what the rate is…we haven’t been able to design the right kind of net to capture those things.” (R049) “We have a deep understanding of machine learning and artificial intelligence, and I think that we are really on the cutting edge ….so that piece, the technology is phenomenal…using digital tools to support the cognitive skills of providers.” (R054) “We know from some of our surveys that physicians don’t really think that they make errors. They don’t really appreciate how often they make diagnostic errors. That’s a big barrier so they don’t self-report and then you [have to] rely on other people to capture them.” (R049) |
Positive comments/recommendations | 8(25%) | “We do have rewards and recognition for people who do the right thing. We do try to set some goals for physician reporting each year to try to increase physician reporting.” (R050) |
Unclear process to address diagnostic errors cases | 13(40%) |
“The main thing is that there is not a ready process that we can point to and say we need to be doing this about diagnostic error. Right now, we’re sort of floating, and we’re not doing what we need to be doing...” (R037) “There isn’t a lot of infrastructure that kind of guides…the best practices for an institution to track and respond to diagnostic events.” (R072) “Here at this organization, we’re very reactive and not proactive, so a lot of our stuff is retrospective instead of being able to dig into the data yet to be proactive and identify opportunities before they happen.” (R062) |
Positive comments/recommendations | 6(18.7%) | “They [physicians] worked with our IT department and built a smart phone app that links to the electronic medical record…we put this smart phone-based diagnostic error reporting system in the hands of the physician where we’re collecting additional cases that are largely fodder for their M and M’s [morbidity and mortality conferences]. We’re increasingly using those in places where we learn and make systems improvements.” (R040) |
Limited sharing of findings and feedback | 13(40%) |
“The most important far and away is to provide clinicians with feedback about their diagnosis performance so they know whether they’re right or wrong, because if we can’t give people feedback, they can’t get better.” (R048) “We actually still are struggling I believe with having good mechanisms in place to share learning from M&Ms and sometimes it’s been RCAs more broadly across the organization. It’s something that we’re aware of and have been actually working this year to figure out ways to better spread the learning’s. But right now, we’re still in a situation where we don’t do a good job of that.” (R055) |
Positive comments/recommendations | 9(28%) | “We encourage people to put their names in when they report things and we make sure that we give them feedback, so they know we just didn’t put a piece of paper in a box or file an electronic thing and then nobody ever pays attention to it. We give direct feedback to what…would be corrective action based on what they reported.” (R041) |
3. Leadership investment | 9(28%) |
“The attention of leadership seems to be focused on easy, low-hanging measures that do wind up determining your scores that are publicly reported. The diagnostic error, I think has not been framed as neatly as it can be.” (R050) “I think that at a leadership level, there is an understanding that this [diagnostic safety] is important, but…how to actually translate that into action is still something that leadership is considering…” (R061) “I think it’s at the governance level, particularly at the Board level. As I say, once in a while we’ll have a presentation on diagnostic error; it grabs everyone’s attention, but then they’re back to looking at your surgical site infection rates, we have not transitioned to a point where it gets consistent and regular attention.... there’s institutional awareness, but it has not been a leadership priority, not only awareness but efforts to intervene or change the tide so to speak.” (R055) |
Positive comments/recommendations | 4(12.5%) | “It’s really about having those leaders come to the steering committee with the others on a monthly basis to update and let us know. So, the board is very in tune, and I think that we’ve done a very good job of that.” (R040) |
4. Diagnostic safety teams that work on diagnostic safety | 18(56%) |
“There’s no standing team… to deal with cases of diagnostic error. The teams are always ad-hoc and include representatives from risk, quality department, and medical leadership.” (R051) “One of the challenges in our health system is resources and the budget and all those kinds of things so we are very resource constrained.” (R070) “I think that the coordination between teams is one of the most challenging things we deal with. I think that all the way from…who’s on the team and what are the roles and responsibilities. Those are not defined well.” (R048) |
Positive comments/recommendations | 12(37%) | “I would say cultivating local expertise across your institution, so having people who are up to date on the literature and engaged…so having representatives on an institution-wide committee on diagnosis that come from the ED, from the inpatient setting, from subspecialty care, from ambulatory clinics, because I really think that this is a multifaceted problem that doesn’t just live in one clinical context.” (R072) |
More than half the participants (n=18) mentioned serious concerns about psychological safety associated with diagnostic error. For instance, the belief that diagnosis is linked with a clinician’s identity—perhaps seen as a failure—made open discussion uncomfortable. Additionally, some participants noted the negative influence of work-related stress on thinking and performance related to diagnosis. This included mounting time pressure and escalating cognitive load that affect diagnostic decision-making.
Participants recommended ways to improve diagnostic safety culture, specifically methods to reduce blaming clinicians. Some suggestions included replacing the word ‘error’ with ‘diagnostic learning’ or ‘learning opportunity’; freely sharing and discussing serious safety events among clinicians and more specifically, how it can lead to improvement; promoting a non-judgmental/non-punitive safety culture by coaching clinicians and fixing problems they or others identify, rather than blaming individual clinicians; and lastly, development of clinician safety champions in department/units to spread a peer-to-peer reminder of high-reliability safety practice in everyday operations.
-
(2)
Infrastructure for measurement, monitoring, and improvement activities
Many of the participants (n=25) were struggling on how to measure and monitor diagnostic errors. Their challenges included not having a pragmatic and concise definition of diagnostic error; diversity of settings and situations in which diagnostic error can occur; lack of effective tools to report errors; limited approaches to address cognitive biases; and how to measure and benchmark diagnostic error. Some participants indicated the lack of infrastructure for support staff to collect the data necessary to identify diagnostic errors. They were concerned that even after much research on diagnostic error, the definition remains hard to operationalize and translate to clinical care.
Almost all participants had suggestions to move forward with measuring and monitoring diagnostic errors. For instance, developing a more pragmatic and concise definition of diagnostic error, adapting trigger tools that can identify safety events or near-misses, moving towards another electronic health record (EHR) with better data capture, increasing clinician awareness about cognitive vulnerabilities, developing a safety event classification system (that includes diagnostic error), evaluating EHR functionality for monitoring, structured tools, or processes to think through differential diagnosis, designating diagnostic time-outs in certain risky situations, and lastly, investing in advanced techniques such as artificial intelligence (AI) and machine learning.
Additionally, participants were asked to discuss the role of incident reporting for diagnostic error. Some (n=10) expressed dissatisfaction with low rates of reporting indicating that while most diagnostic errors are identified through incident reporting, they only represent a small proportion of actual diagnostic errors. Some suggested (n=5) that clinicians do not think or do not know they have made an error. It becomes the responsibility of a colleague or staff members who observed an event to decide to report. Moreover, organizations that are diligently collecting safety issues may not be specifically collecting data on diagnostic errors.
Eight participants indicated that they were pleased with their current system of diagnostic event reporting. Many of them had developed specific diagnostic error reporting mechanisms built into the existing workflow: smart phone–based incident reporting system, hotline, and text messaging. These ‘dedicated’ reporting systems also prioritized feedback to facilitate action and learning: a direct feedback system with corrective measures, recognition for reporting, system-wide communication and education about safety, and daily huddles.
Another barrier mentioned was the absence of a clearly laid process on how to address cases of diagnostic error. Participants (n=13) expressed their dissatisfaction over the lack of organizational direction or guidance on how to manage cases of diagnostic errors after they occur. In the absence of formal processes or guidelines to deal with cases of error, participants suggested the need for clinician champions to advocate change.
Some noted there is organizational awareness for the need to create formal processes to address diagnostic error. Organizations are lacking a strategic plan to tackle diagnostic error or if such a plan is present, it is occurring at the front lines of care and poorly coordinated across multiple settings within the institution. Participants indicated that current systems tend to be reactive. However, some participants (n=6) were pleased with their follow-up process for cases of error. Some organizations had invested in this infrastructure and had a robust process and dedicated team in place to address errors.
During the interview, participants also described their concerns on limited sharing of findings and feedback after incident reporting within their organization (n=13). Some attributed this to risk management policies prioritizing confidentiality, some held their senior leadership responsible, and some suggested it was system inefficiency. Additionally, confidentiality requirements can impact feedback, making it hard for clinicians to learn from mistakes or identify appropriate improvement measures.
There were few (n=9) who were satisfied and supported their organizational efforts of sharing findings from incident report throughout their organization. These efforts included a direct feedback system (e.g., outlining what corrective measures were taken, as a result of what clinical staff initially reported); emails sent to all providers that identify learning opportunities based on an incident; and encouraging Morbidity and Mortality conference attendees to disperse information back to their departments.
-
(3)
Leadership investment
Participants (n=9, 5 in leadership positions) acknowledged that leadership involvement, commitment, and engagement were essential to influence diagnostic safety. They noted challenges in securing resources for diagnostic safety initiatives and personnel. While they expressed an awareness of the value of leadership engagement in achieving diagnostic safety, they also conveyed concerns about next steps. Participants believed that leaders are aware and understand the importance of diagnostic safety but have not prioritized it into actionable items. Further, they indicated that if leadership (i.e., C-suite, Executive Board) attention is focused solely on publicly reported patient safety issues and measures or other issues of interest (e.g., readmissions or opioid crisis), diagnostic safety will lag. Of note, some participants (n=4, 1 in leadership) indicated they do have highly motivated and engaged leadership, with robust improvement capabilities, and safety culture.
-
(4)
Diagnostic safety teams that work on diagnostic safety
Lacking a diagnostic error–focused team at the organization level was discussed in 18 interviews. Reasons included cultural barriers, lack of resources and organizational commitment, need for champions/leader, unclear priorities, and general lack of awareness about diagnostic errors at the system level. Additionally, coordination is challenging as providers, department leads, and other safety professionals sometimes function in isolation and when they do begin to engage as a team, new issues emerge such as lack of clarity in roles and responsibility. Few participants with a team stated it was informal.
Participants suggested building institutional capacity, specifically a dedicated team at the institutional level.
Patient Engagement
Engaging patient and their families to voice their concerns about suboptimal care was documented across all respondents. Almost all the participants indicated having a program to engage patient and families for capturing information on adverse events and near misses (e.g., patient complaint process, patient advocates). Many respondents (n=16) mentioned additional engagement activities, such as having a dedicated patient initiative for improving test results follow-up; having patients on key HCO committees and root cause analysis teams; having a Patient and Family Advisory Council (PFAC) system; adopting methods to increase patient access to EHR notes; and train-the-trainer program.
DISCUSSION
Safety leaders across 30 health care organizations in the USA identified several barriers and facilitators to improving diagnostic safety. Four major themes emerged as barriers—lack of a psychologically safe organizational culture for diagnostic safety; underdeveloped infrastructure for measurement, monitoring, and improvement activities; absence of leadership investment in diagnostic safety; and lack of dedicated teams at the institutional level that focus on diagnostic safety. Several corresponding suggestions were provided to overcome these barriers. These findings align with several core elements of the learning health system: culture, science and informatics, incentives, and engaged patients.13 These four elements provide a robust foundation that HCOs can operationalize and integrate in their efforts to develop into organizations that learn and explore diagnostic excellence (recently described as ‘LEDE organizations’).14
Within HCOs, frontline clinicians are in the best position to identify issues they face in making a diagnosis. Several initiatives to encourage safety reporting have been implemented over the last two decades but few have focused on diagnosis.15–20 Clinicians still fear punitive action rather than perceiving reporting as opportunities for learning and improvement21 and a lack of psychological safety results in under-reporting. Making a correct and timely diagnosis is considered a core component of patient care and getting it wrong or delayed may make clinicians uncomfortable because it may invite judgements about their competence. This is somewhat different from safety issues where diagnosticians are not the central focus of discussion such as in safety issues related to line infections, falls, pressure injuries, and medications. While blame culture is a common concern in patient safety, there is data to suggest there is particular sensitivity around the diagnostic process.22, 23 Prior work also suggests that clinicians fear judgement about their knowledge base and are uncomfortable in discussing diagnostic errors in both public and private settings, more so when compared with other types of medical errors.23 Because of these clinicians’ concerns, it is not surprising that we found respondents suggested reframing discussions around diagnostic errors as learning opportunities. However, this also brings up a need to balance these discussions with accountability and disclosure to patients and families who have experienced harm. Additional work will be needed to strike the right balance to ease the tension in these requirements and help advance the implementation of diagnostic safety concepts and tools into practice. Our study identifies that additional work to engage clinicians will be needed to promote diagnostic safety culture, one that supports and encourages clinicians to freely report, learn, and make corrective changes. Recently, Agency for Healthcare Research and Quality (AHRQ) in the USA released supplement items to the core medical office safety culture surveys to assess how medical offices support the diagnostic process, accurate diagnoses, and communication around diagnoses.24 Similar surveys could be developed and used for other care settings as an initial step in measuring diagnostic safety culture and improving it.
Several strategies to promote science and informatics components of LHS are ready for implementation starting with measurement for discovery, analysis, and learning. While currently there are no good measures related to diagnostic safety9, 25, 26, HCOs can identify and analyze diagnostic errors and implement actions to reduce harm based on findings. Recent guidance provides pragmatic recommendations for HCOs to start using measurement for learning and improvement of diagnostic safety using data sources currently available to them.27 For example, clinically rich EHR data can be harvested by using electronic algorithms to identify patients with actual or potential diagnostic harm.28–30 However, for moving such algorithms into practice, additional research and development will be needed. HCOs will need to be willing to test and implement these algorithms and integrate them into their existing quality and safety infrastructure.31 Because few HCOs currently conduct robust patient safety–related EHR data analytics, novel forms of embedded research partnerships32 will be needed to accelerate measurement.
Our findings suggest most diagnostic safety work is being conducted at a grass roots level and is poorly coordinated within and across institutions. Publicly reported patient safety issues and measures for payment drive leadership interest. Currently, there are no incentives to promote diagnostic safety as compared to certain other quality and safety targets. We found that leadership incentives must be aligned for generating value and transparency related to diagnostic safety. Diagnostic safety could be prioritized by payers not just to prevent harm, but also because diagnostic errors lead to increased costs and utilization. There is growing interest in measuring diagnostic excellence that may incentivize leadership investment. For example, the Leapfrog Group is developing a survey that aims to help hospitals assess and implement certain best practices to achieve diagnostic excellence.33 Additional incentives could be created by accrediting bodies who aim to protect consumer interests by maintaining high safety standards. Several proposed payment innovations can inform policy in this area.34
Patient and family engagement is a key component of diagnostic safety.14 While all sites in our study indicated that there are opportunities for patients to report concerns, it is unclear how that data is integrated into existing HCOs’ data streams to ensure system-wide learning. To our knowledge, there are no standard patient-reported outcome measures to identify diagnostic safety issues making it difficult to know which data is most actionable. Nevertheless, this is an area of emerging interest.35–37 Existing reporting methods, such as patient complaints, have shown promise, including for diagnostic safety,38–41 and additional methods to capture diagnosis related data from patients are being developed.
Our study has several limitations. Although our sample is national, it may not be representative, and all themes may not be generalizable to other health care organizations, especially smaller HCOs. Additionally, generalizability to non-US health care organizations may be limited because of differences in health system structure and incentives. However, several barriers we identified are quite universal (e.g., how to measure and monitor diagnostic errors,9, 42, 43 diagnostic safety teams). We also collected suggestions for improvements without consideration for effectiveness or feasibility, which would need to be assessed and contextualized. Finally, while several emergent factors related to diagnostic safety culture are known salient patient safety issues, diagnostic errors are particularly vulnerable to clinician fear and discomfort due to possible blame and judgement-related issues.22 Additional qualitative and quantitative exploration is warranted.
CONCLUSIONS
We identified specific barriers for diagnostic safety and strategies to advance improvement efforts at an organizational level. Despite modern patient safety systems in place, a focus on diagnostic safety is not common. Diagnostic errors are more difficult to assess and address even in organizations that have established patient safety systems. Most HCOs do not have processes in place to identify and/or analyzing diagnostic errors in clinical practice. Because the diagnostic process is complex and involves clinician’s knowledge and its application, additional considerations are necessary beyond traditional safety (e.g., medication errors, hospital-acquired infections, falls, surgical safety issues). Findings provide several strategies for development of a learning health system for diagnostic safety at an organizational level including culture that engages clinicians in diagnostic safety, science and informatics focused on using measurement for learning and improvement of diagnostic safety, incentives for diagnostic excellence initiatives, and engaged patients through opportunities to report diagnostic concerns and involvement in diagnostic safety. Implementation of these strategies can bolster development of organizations that learn and explore diagnostic excellence.
Supplementary Information
Funding
This work is supported by the Gordon and Betty Moore Foundation (GBMF 8126) and partially supported by the Houston Veterans Administration (VA) Health Services Research and Development (HSR&D) Center for Innovations in Quality, Effectiveness and Safety (CIN 13–413). Dr. Giardina is additionally supported by an Agency for Healthcare Research and Quality Mentored Career Development Award (K01- HS025474), Dr. Singh is additionally supported by the VA HSR&D Service (IIR17-127 and the Presidential Early Career Award for Scientists and Engineers USA 14-274), the Agency for Healthcare Research and Quality (R01HS27363), the Gordon and Betty Moore Foundation (GBMF 8838 and GBMF 5498), and the CanTest Research Collaborative funded by a Cancer Research UK Population Research Catalyst award (C8640/A23385).
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.National Academies of Science, Engineering and Medicine. Improving Diagnosis in Health Care.; 2015. doi:10.17226/21794
- 2.Toward a Learning Ecosystem for Diagnostic Excellence. Accessed August 18, 2020. https://deepblue.lib.umich.edu/handle/2027.42/145487
- 3.Graber ML, Wachter RM, Cassel CK. Bringing Diagnosis Into the Quality and Safety Equations. JAMA. 2012;308(12):1211–1212. doi: 10.1001/2012.jama.11913. [DOI] [PubMed] [Google Scholar]
- 4.Schiff GD, Kroenke K, Lambert BL, Sanders L, Sheikh A. Ten Principles for More Conservative, Care-Full Diagnosis. Ann Intern Med. 2019;170(11):823-824. doi:10.7326/L19-0149 [DOI] [PubMed]
- 5.Zwaan L, Singh H. The challenges in defining and measuring diagnostic error. Diagn Berl Ger. 2015;2(2):97–103. doi: 10.1515/dx-2014-0069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Wachter RM. Why Diagnostic Errors Don’t Get Any Respect—And What Can Be Done About Them. Health Aff (Millwood). 2010;29(9):1605–1610. doi: 10.1377/hlthaff.2009.0513. [DOI] [PubMed] [Google Scholar]
- 7.Fatemi Y, Coffin S. The COVID trap: pediatric diagnostic errors in a pandemic world. Diagnosis. Published online August 4, 2021. doi:10.1515/dx-2020-0150 [DOI] [PubMed]
- 8.Satterfield K, Rubin JC, Friedman CP. Toward a Learning Ecosystem for Diagnostic Excellence. 2018. p. 26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Singh H, Graber ML, Hofer TP. Measures to Improve Diagnostic Safety in Clinical Practice. J Patient Saf. 2019;15(4):311–316. doi: 10.1097/PTS.0000000000000338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Satterfield K, Rubin JC, Yang D, Friedman CP. Understanding the roles of three academic communities in a prospective learning health ecosystem for diagnostic excellence. Learn Health Syst. 2020;4(1):e210204. doi: 10.1002/lrh2.10204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.NAM Leadership Consortium. Collaboration for a Value & Science-Driven Health Care System. National Academy of Medicine. Accessed July 6, 2021. https://nam.edu/programs/value-science-driven-health-care/
- 12.Shenvi EC, El-Kareh R. Clinical criteria to screen for inpatient diagnostic errors: a scoping review. Diagnosis. 2015;2(1):3–19. doi: 10.1515/dx-2014-0047. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Institute of Medicine . Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. 2012. [PubMed] [Google Scholar]
- 14.Singh H, Upadhyay DK, Torretti D. Developing Health Care Organizations That Pursue Learning and Exploration of Diagnostic Excellence: An Action Plan. Acad Med. 2020;95(8):1172–1178. doi: 10.1097/ACM.0000000000003062. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Okafor N, Payne VL, Chathampally Y, Miller S, Doshi P, Singh H. Using voluntary reports from physicians to learn from diagnostic errors in emergency medicine. Emerg Med J. 2016;33(4):245–252. doi: 10.1136/emermed-2014-204604. [DOI] [PubMed] [Google Scholar]
- 16.Marshall TL, Ipsaro AJ, Le M, et al. Increasing Physician Reporting of Diagnostic Learning Opportunities. Pediatrics. 2021;147(1):e20192400. doi: 10.1542/peds.2019-2400. [DOI] [PubMed] [Google Scholar]
- 17.Graber ML, Trowbridge R, Myers JS, Umscheid CA, Strull W, Kanter MH. The Next Organizational Challenge: Finding and Addressing Diagnostic Error. Jt Comm J Qual Patient Saf. 2014;40(3):102–110. doi: 10.1016/S1553-7250(14)40013-8. [DOI] [PubMed] [Google Scholar]
- 18.Anderson JE, Kodate N, Walters R, Dodds A. Can incident reporting improve safety? Healthcare practitioners’ views of the effectiveness of incident reporting. Int J Qual Health Care. 2013;25(2):141–150. doi: 10.1093/intqhc/mzs081. [DOI] [PubMed] [Google Scholar]
- 19.Aaron M, Webb A, Luhanga U. A Narrative Review of Strategies to Increase Patient Safety Event Reporting by Residents. J Grad Med Educ. 2020;12(4):415–424. doi: 10.4300/JGME-D-19-00649.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Ahlberg EL, Elfström J, Borgstedt MR, et al. Learning From Incident Reporting? Analysis of Incidents Resulting in Patient Injuries in a Web-Based System in Swedish Health Care. J Patient Saf. 2020;16(4):264–268. doi: 10.1097/PTS.0000000000000343. [DOI] [PubMed] [Google Scholar]
- 21.Feeser VR, Jackson AK, Savage NM, et al. When Safety Event Reporting Is Seen as Punitive: “I’ve Been PSN-ed!”. Ann Emerg Med. 2021;77(4):449–458. doi: 10.1016/j.annemergmed.2020.06.048. [DOI] [PubMed] [Google Scholar]
- 22.Lipitz-Snyderman A, Kale M, Robbins L, et al. Peers without fears? Barriers to effective communication among primary care physicians and oncologists about diagnostic delays in cancer. BMJ Qual Saf. 2017;26(11):892–898. doi: 10.1136/bmjqs-2016-006181. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Grubenhoff JA, Ziniel SI, Cifra CL, Singhal G, McClead REJ, Singh H. Pediatric Clinician Comfort Discussing Diagnostic Errors for Improving Patient Safety: A Survey. Pediatr Qual Saf. 2020;5(2):e259. doi: 10.1097/pq9.0000000000000259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Diagnostic Safety Supplemental Items for Medical Office SOPS. Agency for Healthcare Research and Quality, Rockville, MD. 2021. https://www.ahrq.gov/sops/surveys/medical-office/supplemental-items/diagnostic-safety.html
- 25.Schiff GD, Ruan EL. The Elusive and Illusive Quest for Diagnostic Safety Metrics. J Gen Intern Med. 2018;33(7):983–985. doi: 10.1007/s11606-018-4454-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Zwaan L, Olson APJ. When Measuring Is More Important than Measurement: The Importance of Measuring Diagnostic Errors in Health Care. J Pediatr. 2021;232:14–16. doi: 10.1016/j.jpeds.2020.12.076. [DOI] [PubMed] [Google Scholar]
- 27.Singh H, Bradford A, Goeschel C. Operational measurement of diagnostic safety: state of the science. Diagnosis. 2020;1(ahead-of-print). doi:10.1515/dx-2020-0045 [DOI] [PubMed]
- 28.Murphy DR, Meyer AND, Vaghani V, et al. Development and Validation of Trigger Algorithms to Identify Delays in Diagnostic Evaluation of Gastroenterological Cancer. Clin Gastroenterol Hepatol. 2018;16(1):90–98. doi: 10.1016/j.cgh.2017.08.007. [DOI] [PubMed] [Google Scholar]
- 29.Murphy DR, Meyer AND, Vaghani V, et al. Application of Electronic Algorithms to Improve Diagnostic Evaluation for Bladder Cancer. Appl Clin Inform. 2017;8(1):279–290. doi: 10.4338/ACI-2016-10-RA-0176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Murphy DR, Meyer AN, Sittig DF, Meeks DW, Thomas EJ, Singh H. Application of electronic trigger tools to identify targets for improving diagnostic safety. BMJ Qual Saf. 2019;28(2):151–159. doi: 10.1136/bmjqs-2018-008086. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Mathews BK, Fredrickson M, Sebasky M, et al. Structured case reviews for organizational learning about diagnostic vulnerabilities: initial experiences from two medical centers. Diagn Berl Ger. 2020;7(1):27–35. doi: 10.1515/dx-2019-0032. [DOI] [PubMed] [Google Scholar]
- 32.Atkins D, Kullgren JT, Simpson L. Enhancing the role of research in a learning health care system. Healthcare. 2021;8:100556. doi: 10.1016/j.hjdsi.2021.100556. [DOI] [PubMed] [Google Scholar]
- 33.The Leapfog Group. Patient Safety Watchdog The Leapfrog Group Funded for National Initiative on Preventing Harm from Diagnostic Error. Leapfrog. Published January 27, 2021. Accessed February 8, 2022. https://www.leapfroggroup.org/news-events/patient-safety-watchdog-leapfrog-group-funded-national-initiative-preventing-harm
- 34.Berenson R, Singh H. Payment Innovations To Improve Diagnostic Accuracy And Reduce Diagnostic Error. Health Aff Proj Hope. 2018;37(11):1828–1835. doi: 10.1377/hlthaff.2018.0714. [DOI] [PubMed] [Google Scholar]
- 35.Fisher KA, Smith KM, Gallagher TH, Huang JC, Borton JC, Mazor KM. We want to know: patient comfort speaking up about breakdowns in care and patient experience. BMJ Qual Saf. 2019;28(3):190–197. doi: 10.1136/bmjqs-2018-008159. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Giardina TD, Haskell H, Menon S, et al. Learning From Patients’ Experiences Related To Diagnostic Errors Is Essential For Progress In Patient Safety. Health Aff (Millwood). 2018;37(11):1821–1827. doi: 10.1377/hlthaff.2018.0698. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Fisher KA, Gallagher TH, Smith KM, et al. Communicating with patients about breakdowns in care: a national randomised vignette-based survey. BMJ Qual Saf. 2020;29(4):313–319. doi: 10.1136/bmjqs-2019-009712. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Giardina TD, Korukonda S, Shahid U, et al. Use of Patient Complaints to Identify Diagnosis-Related Safety Concerns: A Mixed-Method Evaluation. BMJ Qual Saf. 2021;Published Online First: 17 February 2021. doi:10.1136/bmjqs-2020-011593 [DOI] [PMC free article] [PubMed]
- 39.Gillespie A, Reader TW. Patient-Centered Insights: Using Health Care Complaints to Reveal Hot Spots and Blind Spots in Quality and Safety. Milbank Q. 2018;96(3):530–567. doi: 10.1111/1468-0009.12338. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Van Dael J, Reader TW, Gillespie A, Neves AL, Darzi A, Mayer EK. Learning from complaints in healthcare: a realist review of academic literature, policy evidence and front-line insights. BMJ Qual Saf. Published online February 4, 2020. doi:10.1136/bmjqs-2019-009704 [DOI] [PMC free article] [PubMed]
- 41.Van Dael J, Gillespie A, Reader T, et al. Getting the whole story: Integrating patient complaints and staff reports of unsafe care. J Health Serv Res Policy, 2021:13558196211029324. doi:10.1177/13558196211029323 [DOI] [PMC free article] [PubMed]
- 42.Perry MF, Melvin JE, Kasick RT, et al. The Diagnostic Error Index: A Quality Improvement Initiative to Identify and Measure Diagnostic Errors. J Pediatr. Published online December 7, 2020. doi:10.1016/j.jpeds.2020.11.065 [DOI] [PubMed]
- 43.Singh H, Sittig DF. Advancing the science of measurement of diagnostic errors in healthcare: the Safer Dx framework. BMJ Qual Saf. 2015;24(2):103–110. doi: 10.1136/bmjqs-2014-003675. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.