Abstract
Cancer will affect more than one in three U.S. residents in their lifetime, and although the diagnosis will be made efficiently in most of these cases, roughly one in five patients will experience a delayed or missed diagnosis. In this integrative review, we focus on missed opportunities in the diagnosis of breast, lung, and colorectal cancer in the ambulatory care environment. From a review of 493 publications, we summarize the current evidence regarding the contributing factors to missed or delayed cancer diagnosis in ambulatory care, as well as evidence to support possible strategies for intervention. Cancer diagnoses are made after follow-up of a positive screening test or an incidental finding, or most commonly, by following up and clarifying non-specific initial presentations to primary care. Breakdowns and delays are unacceptably common in each of these pathways, representing failures to follow-up on abnormal test results, incidental findings, non-specific symptoms, or consults. Interventions aimed at ‘closing the loop’ represent an opportunity to improve the timeliness of cancer diagnosis and reduce the harm from diagnostic errors. Improving patient engagement, using ‘safety netting,’ and taking advantage of the functionality offered through health information technology are all viable options to address these problems.
Keywords: cancer diagnosis, missed diagnosis, diagnostic errors, incidental findings, patient engagement, referral management
Introduction
Cancer is a leading cause of death, and nearly 40 % of United States residents will ultimately be diagnosed with cancer in their lifetime [1], 2]. Although the great majority of cancers are diagnosed promptly and accurately, missed and delayed diagnoses of cancer are estimated to affect roughly one in every five patients [3]. These delays compound the suffering of patients who receive an unwelcome diagnosis and, in many cases, contribute to potentially avoidable harm due to delayed treatment. In many cases of delayed cancer diagnosis, disease progression may actually preclude use of the most effective treatment regimens.
Most patients with cancer will be cared for in ambulatory settings, especially primary care, before the diagnosis is made. New and improved diagnostic tests will likely improve the earlier diagnosis of cancer in the future, but at the present time, diagnostic delays can be conceptualized as a breakdown at one or more points in the cancer diagnostic process as shown in Figure 1. The model is derived from prior models outlining general and cancer-specific diagnostic pathways [4], [5], [6], [7], [8]. Patients usually enter the cancer diagnostic pathway in one of three ways: (1) from an incidental finding on a lab or medical imaging result, (2) through cancer screening programs (although even in cancers for which screening strategies exist, these do not account for the majority of new diagnoses [9]), or, most often (3), upon investigation of new symptoms or signs, such as blood in the stool, a breast mass, or hemoptysis [10], 11].
Figure 1:
The cancer diagnostic pathway: a model to understand the diagnostic process in cancer.
These various points of entry into the diagnostic pathway create different challenges for clinicians who see these patients in the ambulatory setting. What is common to all three presentation modes is the need to ensure that follow-up tests and consults are completed, and that these results are reviewed and acted upon in a timely manner. “Closing the loop” has been used to describe procedures to ensure follow-up of diagnosed test results [12] and has been elaborated more recently to include other types of follow-up (such as clinical follow-up of suspicious symptoms [13]). The patient’s clinical team must ensure that these loops are closed in a timely manner, and patients with access to their medical records can play an important assistive role as well [14].
A wide range of factors contribute to delayed and missed cancer diagnosis with an equally wide range of proposed solutions [15]. The goal of this integrative review [16], 17] is to summarize the current evidence regarding the frequency of and contributing factors to missed and delayed diagnosis, as well as to present evidence to support possible prevention strategies. We focus in particular on three cancer types (breast, lung, and colorectal cancer) as these all have high incidence [18] and are believed to have appreciable rates of diagnostic error [19].
Methods
We looked for evidence pertaining to missed and delayed diagnosis of breast, lung, and colorectal cancers using a structured search of English language publications in PubMed, Embase, and CINAHL for the period of 2014–2022. We also sought evidence relevant to the primary care setting where many of these missed opportunities in diagnosis occur, although we did not exclude articles from other relevant ambulatory settings. We included search terms related to telemedicine and telediagnosis because of the growth of telemedicine in primary care over the past several years.
In addition to the database search process described above, four researchers (AB, BW, MG, RM) manually searched additional sources from the grey literature, including PSNet (Agency for Healthcare Research and Quality), websites of professional organizations (e.g., Institute for Healthcare Improvement, American Telemedicine Association, Society to Improve Diagnosis in Medicine), and general web searches using the terms “telemedicine,” “safety,” and “diagnosis.” Relevant publications were also identified from the bibliographies of Improving Diagnosis in Health Care, from Recognizing Excellence in Diagnosis: Recommended Practices for Hospitals [20], and from the personal collection of over 3,000 publications on diagnostic error collected by one of the authors (MG). Finally, the research team perused the references cited in full-text articles retrieved for additional relevant publications (snowball sampling).
Results
We identified 493 relevant publications from the combined search strategies described above. Results are summarized thematically by prevalence and risk factors for diagnostic error and potential interventions to improve diagnosis, and by cancer type (cancer in general and breast, lung, and colorectal cancers specifically). We identified the concept of ‘closing the loop’ as a cross-cutting theme.
Delays in cancer diagnosis
Delays in cancer diagnosis are common [21], 22]. Studies from the UK indicate that the median interval from presentation to diagnosis is 40 days, but significant delays were reported in 22–24 % of patient cases [21], 23]. A systematic review summarized the impact of diagnostic delay for seven major cancer types and concluded that for every month the diagnosis is delayed, mortality increases 6–8 % [24]. Additionally, missed and delayed cancer diagnoses are the leading causes for outpatient malpractice claims in the United States [25].
Breast cancer
A large, single-institution retrospective cohort study found that delayed diagnosis was more common when women self-identified an abnormality such as a palpable breast mass or other symptoms, compared with being identified by an abnormal screening mammogram [26]. In a cohort study of 585 U.S. women with breast cancer under the age of 40, a population generally ineligible for routine screening, 17 % reported delayed care seeking and 12 % reported care delays [27].
The World Health Organization’s Breast Health Global Initiative target for disease confirmation after initial presentation is 60 days [28]. This target is often missed; a systematic review found that lack of follow-up after an abnormal mammogram within the next 6 months occurs in 27–72 % of cases [29], 30]. Women with lower educational attainment and women from minority racial and ethnic groups were found to be disproportionately affected by delayed follow-up of abnormal screening mammograms [30]. In a study looking at contributing factors, the most common reason was that follow-up was ordered but never scheduled [31]. Less than 10 % of delays were attributed to patients declining follow-up.
Lung cancer
In a survey of 135 specialists in Australia, 80 % of respondents thought a diagnosis of lung cancer should be obtained within 14 days of first clinical suspicion, but only 56 % estimated that this occurred, mainly due to delays in the primary care setting [32]. Another study suggested that delays in diagnosis of lung cancer in primary care are due to factors preventing expedient referral to specialists [33]. A retrospective cohort case review study conducted at two tertiary Veteran Affairs medical centers identified missed opportunities in 222 out of 587 (37.8 %) patients with lung cancer. The median time to diagnosis rose from 19 days in cases without missed opportunities to 132 days for cases where missed opportunities had occurred [34].
Colorectal cancer
A retrospective cohort study of newly diagnosed cases of colorectal cancer found that 161 of 513 (31.4 %) had experienced at least one diagnostic missed opportunity [35]. Common contributing factors included deficiencies in the history and physical examination and breakdowns in documenting or following up on red flag signs and symptoms [36], 37]. In one study of patients presenting with advanced colon cancer, 18 % had a history of rectal bleeding that was not promptly investigated [38].
Opportunities to improve timely cancer diagnosis
Delays that occur after presentation are prime targets for improving the timeliness of cancer diagnosis. We identified four areas, all under the purview of ambulatory practice, where improvement opportunities have been identified:
Closing the loop on uncertain presentations and non-specific symptoms
Many patients with cancer first present to primary care providers with non-specific symptoms [39]. Compared to age- and sex-matched controls, patients with cancer pursue general practitioner consultations twice as often during the three months prior to their cancer diagnosis [40]. Studies have found that roughly one in five patients with cancer consulted with their general practitioner three or more times for symptoms that were related to the cancer before being referred to a specialist for diagnostic evaluation [41], 42], and an increased risk of cancer diagnosis is found in multiple studies of suddenly increased healthcare utilization [43]. Even when cancer is considered as a possibility, delays in evaluation are common. Hardy et al. concluded that roughly half of patients with delayed cancer diagnosis experienced delays in receiving the appropriate tests or consults [4].
Additional evidence pointing to missed opportunities for diagnosis in primary care emerges from studies of emergency presentations of cancer [44], 45]. Roughly one-third of cancer patients may have an emergency presentation, ranging from 12 % of patients with colorectal cancer to 46 % of patients with pancreatic cancer [45]. These patients are older, have more advanced stages of cancer at presentation, and have poorer survival. In a study of patients with emergency presentations of cancer, two-thirds had recent ambulatory care visits, and one-third had 3 or more such visits [44].
Studies of missed opportunities for diagnosis in primary care have identified a wide range of factors that contribute to delays in the primary care setting [46]. These can be mapped out using a systems-engineering approach (Figure 1), emphasizing the many possible breakdown points in the cancer diagnostic pathway that involve primary care [13]. Delays begin when symptomatic patients delay seeking care or experience delays in engaging the healthcare system.
Ineffective communication during the clinical encounter can also lead to delayed diagnosis. Almost one-third of videotaped analyses of physicians obtaining the patient’s medical history identified misalignment between what the patient was trying to convey about their symptoms and the physician’s interpretation of what was said [47]. Clinical judgment regarding non-specific symptoms that were possibly suggestive of cancer, and ‘gut feelings’ of possible cancer, were identified as key factors in several studies. Having a ‘gut feeling’ of cancer doubled the odds of a cancer diagnosis within 6 months [4]. Complicating the management of patients with nonspecific symptoms is the reality that the vast majority of these patients do not have cancer. Even patients with ‘red flag’ presentations such as rectal bleeding have less than a 10 % likelihood of harboring a related malignancy [48], creating challenges in deciding who needs urgent and comprehensive evaluation and who does not.
Besides emphasizing the importance of improving the initial patient encounter and the need to follow these patients at appropriate intervals, system-based interventions, such as the use of urgent-referral pathways, may also be effective [49], 50]. Okoli et al. reviewed ten types of interventions to improve early cancer diagnosis of symptomatic patients and identified several effective practices, including the use of rapid referral pathways, standardized care pathways, nurse navigators, and technology-based approaches to monitor follow-up [49]. Another effective practice to manage uncertainty is “safety-netting” [51], a management approach that focuses on establishing clear communication during the patient encounter, agreeing on a plan for follow-up, and outlining actions to be taken by both the patient and the clinician to ensure follow-up takes place.
Ultimately, better tools and tests are needed to identify which patients with non-specific presentations are at highest risk for cancer, which will require large epidemiologic studies looking at the positive predictive value of various presentations [52]. As an example, adult patients seen in primary care settings with non-specific abdominal pain or bloating have an overall risk of developing cancer within 1 year of roughly 2 %, but this risk increased substantially with abnormal lab tests: 10 % with raised ferritin, 9 % with low albumin, 8 % with raised platelets, 6 % with raised inflammatory markers, and 4 % with anemia [53].
Closing the loop on incidental findings
Incidental findings on imaging present the opportunity to diagnose and treat malignancies at the earliest possible stage. One in every twenty-five lung cancers is first detected as an incidental finding [54]. Unfortunately, this opportunity is often missed due to delays and failures in appropriate follow-up [55]. For example, in a large study of almost 3 million imaging examinations, 10.6 % of the imaging interpretations contained a recommendation for follow-up imaging, but adherence was only 58 % within 14 months [56]. Breakdowns in follow-up are most common for imaging performed in emergency department settings for children and the elderly [57].
Roughly 4 % of cancers are diagnosed from incidental findings on radiologic imaging [54]. Incidental findings are encountered in approximately one in three CT [58] and MRI [59] studies. Roughly two-thirds of incidental imaging findings are considered actionable [55], and most of these turn out to be false positives or benign conditions. Only one in twenty incidental findings are ultimately diagnosed as a malignancy [60], 61].
Improving communication amongst radiologists, front-line clinicians, and patients is the focus of most recommendations to improve the management of incidental findings [62], and a range of health information technology (IT)-based applications to track and ensure follow-up actions are emerging. It is not sufficient to simply include follow-up recommendations in a report: “a mandatory phone call from the radiologist to the ordering physician should be instituted for all important or potentially actionable unanticipated findings” [63]. The federal Mammography Quality Standards Act codified the requirement for radiologists to communicate suspicious findings directly to patients and serves as a role model for how direct communication could similarly improve the follow-up of incidental findings. The “Failsafe” program at Hershey Medical Center uses a telemedicine approach to complement these practices. The program leverages health IT applications that identify patients with important incidental findings, facilitate a phone call to these patients, and enable tracking of the process and ultimate completion of the follow-up [64].
Interventions that target incidental findings include recommendations to standardize the nomenclature and classification of incidental findings and the language used to convey the importance of a given finding [60], 63], 65]. For example, new fields in the radiology report could include: (1) What is recommended? (e.g., repeat a test or perform a different test), and (2) What is the time frame in which to perform the recommended action? After one institution implemented this approach, 87 % of patients with incidental findings complied with recommended follow-up [66]. A similar intervention focused on patients imaged as part of an emergency visit, 95 % of patients received appropriate follow-up communication and had documented follow-up plans [67].
The argument has also been made that the pursuit of incidental findings on medical imaging examinations is costly, time-consuming, anxiety-producing, and potentially dangerous in terms of additional exposure to ionizing radiation and possibly invasive procedures [68], 69], especially in relation to the relatively low rate with which incidental findings ultimately turn out to be malignancies [47], 48]. The pursuit of incidental findings also engenders overdiagnosis of small and slow-growing cancers that have low potential for harm. Carefully considered guidelines from the American College of Radiology provide recommendations on when and how to pursue incidental findings that balance these benefits and hazards [70].
Closing the loop on testing and positive screening tests
Cancer diagnosis very often hinges on the results of diagnostic tests. Improving the timeliness and reliability of acknowledging and acting on these results would have a large impact on improving cancer diagnosis. The frequency of missed test results varies considerably from study to study, ranging from 6 to 62 % [71], 72]. Tests requiring “send outs” to specialized labs and tests pending at discharge from a hospitalization have especially high rates of communication failure [73].
Similar problems are encountered regarding appropriate follow-up after imaging as noted previously [56]. Minimizing the use of vague or conditional language in imaging reports may facilitate follow-up of abnormal imaging results [66]. Recent publications have highlighted the importance of closing the loop on suspicious imaging results [62], 66], 74].
Ensuring appropriate review and follow-up of tests is a significant problem. A survey of 275 primary care providers found widespread dissatisfaction with their existing processes for managing abnormal test results, citing patients’ practical and logistical barriers to pursuing follow-up and a paucity of tools within their electronic record systems for managing these situations [75]. A proposal for clinicians to audit their own practices for test result follow-up showed a small improvement in rates of appropriate follow-up [76]. However, these problems reflect overarching limitations such as poor communication and systems failures, which involve all of the parties involved in the diagnostic process as well as the organization’s electronic health record system.
Many breakdowns in test result communication reflect ambiguity in defining responsibility for follow-up, absence of backup or fail-safe processes, and the unfortunate assumption on the part of the patient that “no news is good news” [77]. Several comprehensive reviews have summarized recommendations for improving test result follow-up [78], [79], [80]. Both clinician groups [78] and a wide range of organizations have also outlined suggestions and best practices for test results management that address these issues [12], [81], [82], [83], [84]. Among these is the recommendation that organizations adopt comprehensive and clear communication policies that unambiguously define who is responsible for test result follow-up [85]. Ideally, these policies would adopt a ‘chain of custody’ mindset, similar to that in many transaction-based industries, such as shipping companies or airlines [86], 87]. In this approach, diagnostic test results are electronically tracked to ensure timely delivery. These solutions could include additional features like alerts, notes, and patient instructions [88].
Progress in adopting and using these recommendations effectively has been mixed. One systematic review found that many EHR-based notifications and related health IT innovations had little impact on time to further action and diagnostic resolution [89]. Moreover, these interventions come at the cost of increased workload [90], [91], [92]. Qualitative observations of implementing test result management systems underscore the range of factors affecting implementation, the potentially pivotal role of less frequently acknowledged nonclinical team members, and contextual factors that determine the gap between ideal and actual use.
One promising development in the detection of potential diagnostic delays is the development of algorithms that identify patients at risk for lack of follow-up for abnormal test results [79], 93]. These algorithms identify patients with abnormal findings who have not received timely follow-up within a set time period. This approach is used by the SureNet system at Kaiser Permanente health system [94]. Another approach, described as the “Backstop” system, is a similar tracking system for imaging. One month after the recommended follow-up test is past due, the original radiology report is re-sent to the primary care provider if expected follow-up action could not be detected. After two months, a navigator telephones the primary care provider’s practice. After three months, the radiologist telephones the primary care provider directly. Use of these interventions increased the proportion of completed follow-up imaging studies from 43 to 54 % [95].
Closing the loop on consults and referrals
Vulnerabilities related to consults and referral processes in regard to cancer diagnosis have been documented and discussed in several studies [96], [97], [98]. In one study involving 100,000 consults and referrals across 34 primary care clinics, only about one-third were associated with a subsequent documented and completed specialty visit [99]. Factors associated with failure included ambiguous documentation, inability to contact patients for scheduling, patient refusal of specialty care, geographical barriers, and out-of-network referrals.
The Institute for Healthcare Improvement has published a comprehensive toolkit to improve management of consults and referrals [100], and recommendations are also available from others [101], 102]. In a successful field trial in another specialty (cardiology), the research team engaged primary care providers and specialists to develop and implement a change package for referral management. From pre- to post-intervention, a higher proportion of referrals was closed within seven days of the specialist visit (from 40 to 70 %), and a higher proportion of specialist reports were found to answer the referral question (from 50 to 75 %) [103]. Other outcomes included improved provider satisfaction and perceived improvements in the communication among both providers and patientst.
Patient engagement to close the loop
To complement the efforts of organizations to successfully follow-up on abnormal tests and imaging studies, there is great potential for patients to participate in this effort, promoting safety in their own care [64]. Not all patients, however, may be willing or able to take appropriate next steps, and the act of notifying a patient about an abnormal finding does not guarantee that the information will be understood, acted upon, or even recalled [64], 71]. A study of 1,152 patients in Singapore with positive screening tests for colon cancer found that only 56 % agreed to a follow-up consultation with a gastroenterologist [104]. About 40 % of the patients who initially declined follow-up went on to arrange follow-up on their own. Of those who did not, the most frequently reported barriers to follow-up included denial of a significant result (41.8 %), knowledge deficits about the meaning and significance of the abnormal test result (34.5 %), unwillingness to see an unfamiliar provider (20 %), and lack of follow-up reminders (20 %). Following a scripted telephone call informed by a health behavior change theory, 20 % of patients lacking follow-up agreed to a gastroenterology consultation.
Discussion
Primary care providers play a critical role in recognizing cancer at the earliest possible stages and guiding patients through the many steps between suspicion and a confirmed diagnosis. For most patients this process works well, and the diagnosis is made quickly. Unfortunately, there are myriad opportunities for the diagnostic process to be delayed or not completed at all, and each of these represents a possibly unacceptable outcome. Our review identified ‘closing the loop’ as a cross-cutting theme underlying the following practices to improve timely diagnosis of cancer:
-
–
For patients with non-specific symptoms – ensuring follow-up until symptoms resolve or a diagnosis is established;
-
–
For patients with incidental findings – ensuring these are followed up according to accepted guidelines;
-
–
For patients with abnormal screening tests – ensuring that appropriate confirmatory tests are completed promptly;
-
–
For patients with abnormal test results or tests pending at discharge – ensuring that these results are reviewed, communicated, and acted on;
-
–
For patients for whom specialty consultation is needed – ensuring that the consult or referral is completed, and the impressions are communicated.
Several of the interventions reviewed here are cross-cutting and represent applications of the ambulatory ‘safety net’ concept to catch cases headed for a diagnostic delay [105]. These include improving patient engagement, using patient navigators to monitor and guide care, and employing electronic monitoring systems to detect instances of delay or failure of follow-up. No one solution will completely solve the problem of delayed cancer diagnosis, and each practice will need to consider and prioritize their own interventions. Public health education on cancer risk would be helpful as a general measure, along with more specific campaigns targeting low-income and other marginalized patient populations. Delays in diagnosis often reflect some combination of fear, lack of awareness, and practical barriers (no health insurance, no transportation, etc.) that result in patients not being screened or following up afterwards.
Progress will require addressing the current implementation gap for adopting known practices in ambulatory care, and new incentives and programs are needed [106]. Practices often do not have adequate data to show them how well they are closing the loop. Resources and infrastructure for safety are less developed for ambulatory vs. inpatient settings. Practices will require additional time, incentives, and resources to implement interventions to close the loop. Local champions are needed with dedicated time to identify barriers and opportunities for improvement, and multi-site collaboratives could host research projects to study and compare different solutions. Whitfield et al. have conceptualized the path ahead as addressing five key questions [107]: (Table 1), and seeking answers will require a range of different research approaches, including epidemiologic studies based on medical records data, clinical audit studies of individual patients, and patient surveys.
Table 1:
Questions to direct future research on improving timely cancer diagnosis.
| 1. | Do healthcare usage patterns suggest earlier diagnosis could be possible? (Studies looking at the pre-diagnostic ‘window’ period) |
| 2. | How does the diagnostic process begin? (Studies looking at prodromal presentations) |
| 3. | How do patients progress from presentation to diagnosis? (Studies looking at progression pathways) |
| 4. | How long does the diagnostic process take? (Studies looking at the various intervals) |
| 5. | Could anything have been done differently to reach the correct diagnosis? (Studies looking at missed opportunities) |
In sum, we find that breakdowns and delays are unacceptably common in cancer diagnosis pathway, representing failures to follow-up on abnormal test results, incidental findings, non-specific symptoms, or consults. Interventions aimed at ‘closing the loop’ represent an opportunity to improve the timeliness of cancer diagnosis and reduce the harm from diagnostic errors. Closing these loops represents an actionable approach to improving the timeliness of cancer diagnosis and reducing the harm from diagnostic errors in the United States and internationally.
Footnotes
Research ethics: Not applicable.
Informed consent: Not applicable.
Author contributions: All authors have accepted responsibility for the entire content of this manuscript and approved its submission.
Use of Large Language Models, AI and Machine Learning Tools: None declared.
Conflict of interest: The authors state no conflict of interest.
Research funding: This project was funded under contract number 75Q80120D00018/75Q20121F32004 from the Agency for Healthcare Research and Quality (AHRQ), U.S. Department of Health and Human Services. Drs. Murphy, Singh, and Bradford are partially supported by the Houston VA Health Services Research and Development (HSR&D) Center for Innovations in Quality, Effectiveness and Safety (CIN13-413). Dr. Singh is additionally supported by AHRQ (R01HS028595 and R18HS029347). Dr. Bradford is additionally supported by AHRQ (R01HS029318).
Data availability: Not applicable.
References
- 1.National Center for Health Statistics, U.S. Centers for Disease Control and Prevention Leading causes of death. [14 Oct 2024];. https://www.cdc.gov/nchs/fastats/leading-causes-of-death.htm Accessed. [Google Scholar]
- 2.National Cancer Institute Cancer statistics [Online] . Oct 2024]. https://www.cancer.gov/about-cancer/understanding/statistics [Accessed 14.
- 3.Singh H, Meyer AN, Thomas EJ. The frequency of diagnostic errors in outpatient care: estimations from three large observational studies involving US adult populations. BMJ Qual Saf. 2014;23:727–31. doi: 10.1136/bmjqs-2013-002627. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Hardy V, Yue A, Archer S, Merrial S, Thompson M, Emery J, et al. Role of primary care physician factors on diagnostic testing and referral decisions for symptoms of possible cancer: a systematic review. BMJ Open. 2022;12:e053732. doi: 10.1136/bmjopen-2021-053732. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Weller D, Vedsted P, Rubin G, Walter F, Emery J, Scott S, et al. The Aarhus statement: improving design and reporting of studies on early cancer diagnosis. Br J Cancer. 2012;106:1262–7. doi: 10.1038/bjc.2012.68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Balogh E, Miller B, Ball J. Improving diagnosis in health care. Washington, DC: National Academies Press; 2015. [PubMed] [Google Scholar]
- 7.Scott SE, Walter FM, Webster A, Sutton S, Emery J. The model of pathways to treatment: conceptualization and integration with existing theory. Br J Health Psychol. 2013;18:45–65. doi: 10.1111/j.2044-8287.2012.02077.x. [DOI] [PubMed] [Google Scholar]
- 8.Singh H, Sittig D. Advancing the science of measurement of diagnostic errors in healthcare: the Safer Dx framework. BMJ Qual Saf. 2015;24:103–10. doi: 10.1136/bmjqs-2014-003675. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Sarma EA, Kobrin SC, Thompson MJ. A proposal to improve the early diagnosis of symptomatic cancers in the United States. Cancer Prev Res. 2020;13:715–20. doi: 10.1158/1940-6207.capr-20-0115. [DOI] [PubMed] [Google Scholar]
- 10.Sarma E. National academies of sciences, engineering and medicine achieving excellence in cancer diagnosis: a workshop [Presentation] 2021. The diagnostic pathways of symptom-detected cancers. [Google Scholar]
- 11.Sarma E, Walter FM, Kobrin SC. Achieving diagnostic excellence for cancer symptom detection as a partner to screening. JAMA. 2022;328:525–6. doi: 10.1001/jama.2022.11744. [DOI] [PubMed] [Google Scholar]
- 12.ECRI Institute Closing the loop: using health IT to mitigate delayed, missed, and incorrect diagnoses related to diagnostic testing and medication changes. . 2018. https://www.ecri.org/Resources/HIT/Closing_Loop/Closing_the_Loop_Toolkit.pdf Available from.
- 13.Phillips RS, Benneyan J, Bargal B, Schiff GD. Closing the loop: re-engineering the assessment and tracking of symptoms in primary care. J Gen Intern Med. 2023;38:1054–8. doi: 10.1007/s11606-022-07886-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Bell S, Amat M, Anderson T, Aronson M, Benneyan J, Fernandez L, et al. Do patients who read visit notes on the patient portal have a higher rate of “loop closure” on diagnostic tests and referrals in primary care? A retrospective cohort study. J Am Med Inform Assoc. 2024;31:622–30. doi: 10.1093/jamia/ocad250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Dave N, Bui S, Morgan C, Hickey S, Paul C. Interventions targeted at reducing diagnostic error: systematic review. BMJ Qual Saf. 2022;31:297–307. doi: 10.1136/bmjqs-2020-012704. [DOI] [PubMed] [Google Scholar]
- 16.Whittemore R, Knafl K. The integrative review: updated methodology. J Adv Nurs. 2005;52:546–53. doi: 10.1111/j.1365-2648.2005.03621.x. [DOI] [PubMed] [Google Scholar]
- 17.Snyder H. Literature review as a research methodology: an overview and guidelines. J Bus Res. 2019;104:333–9. doi: 10.1016/j.jbusres.2019.07.039. [DOI] [Google Scholar]
- 18.Siegel RL, Miller KD, Wagle NS, Jemal A. Cancer statistics, 2023. CA Cancer J Clin. 2023;73:17–48. doi: 10.3322/caac.21763. [DOI] [PubMed] [Google Scholar]
- 19.Schiff GD, Volodarskaya M, Ruan E, Lim A, Wright A, Singh H, et al. Characteristics of disease-specific and generic diagnostic pitfalls: a qualitative study. JAMA Netw Open. 2022;5:e2144531. doi: 10.1001/jamanetworkopen.2021.44531. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.The Leapfrog Group . Recognizing excellence in diagnosis: recommended practices for hospitals. Washington, DC: The Leapfrog Group; 2022. [Google Scholar]
- 21.Swann R, McPhail S, Witt J, Shand B, Abel GA, Hiom S, et al. Diagnosing cancer in primary care: results from the national cancer diagnosis audit. Br J Gen Pract. 2018;68:e63–72. doi: 10.3399/bjgp17x694169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Murchie P, Adam R, McNair E, Swann R, Witt J, Wood R, et al. Cancer diagnosis in Scottish primary care: results from the national cancer diagnosis audit. Eur J Cancer Care. 2020;29:e13234. doi: 10.1111/ecc.13234. [DOI] [PubMed] [Google Scholar]
- 23.Swan R, Lyratzopoulos G, Rubin G, Pickworth E, McPhail S. The frequency, nature and impact of GP-assessed avoidable delays in a population-based cohort of cancer patients. Cancer Epidemiol. 2019;64:101617. doi: 10.1016/j.canep.2019.101617. [DOI] [PubMed] [Google Scholar]
- 24.Hanna TP, King WD, Thibodeau S, Jalink M, Paulin GA, Harvey-Jones E, et al. Mortality due to cancer treatment delay: systematic review and meta-analysis. BMJ. 2020;371:m4087. doi: 10.1136/bmj.m4087. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Newman-Toker DE, Schaffer AC, Yu-Moe CW, Nassery N, Saber Tehrani AS, Clemens GD, et al. Serious misdiagnosis-related harms in malpractice claims: the “big three” – vascular events, infections, and cancers. Diagnosis. 2019;6:227–40. doi: 10.1515/dx-2019-0019. [DOI] [PubMed] [Google Scholar]
- 26.Stuver SO, Zhu J, Simchowitz B, Hassett MJ, Shulman LN, Weingart SN. Identifying women at risk of delayed breast cancer diagnosis. Jt Comm J Qual Patient Saf. 2011;37:568–AP2. doi: 10.1016/s1553-7250(11)37073-0. [DOI] [PubMed] [Google Scholar]
- 27.Ruddy K, Gelber S, Tamimi R, Scapira L, Come S, Meyer M, et al. Breast cancer presentation and diagnostic delays in young women. Cancer. 2014;120:20–5. doi: 10.1002/cncr.28287. [DOI] [PubMed] [Google Scholar]
- 28.Duggan C, Dvaladze A, Rositch AF, Ginsburg O, Yip CH, Horton S, et al. The breast health global initiative 2018 global summit on improving breast healthcare through resource-stratified phased implementation: methods and overview. Cancer. 2020;126:2339–52. doi: 10.1002/cncr.32891. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Errea RA, Garcia PJ, Pace LE, Galea JT, Franke MF. Understanding linkage to biopsy and treatment for breast cancer after a high-risk telemammography result in Peru: a mixed-methods study. BMJ Open. 2022;12 doi: 10.1136/bmjopen-2021-050457. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Reece J, Neal E, Nguyen P, McIntosh J, Emery J. Delayed or failure to follow-up abnormal breast cancer screening mammograms in primary care: a systematic review. BMC Cancer. 2021;7:373. doi: 10.1186/s12885-021-08100-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Murphy D, Meyer A, Vaghani V, Russo E, Sittig DF, Wei L, et al. Electronic triggers to identify delays in follow-up of mammography: harnessing the power of big data in health care. J Am Coll Radiol. 2018;15:287–95. doi: 10.1016/j.jacr.2017.10.001. [DOI] [PubMed] [Google Scholar]
- 32.Malalasekera A, Dhillon HM, Blinman PL, Kao SC, Vardy JL. Delays to diagnosis and treatment of lung cancer in Australia: healthcare professional perceptions of actual versus acceptable timeframes. Intern Med J. 2018;48:1063–71. doi: 10.1111/imj.13970. [DOI] [PubMed] [Google Scholar]
- 33.Barata F, Fidalgo P, Figueiredo S, Tonin FS, Duarte-Ramos F. Limitations and perceived delays for diagnosis and staging of lung cancer in Portugal: a nationwide survey analysis. PLoS One. 2021;16:e0252529. doi: 10.1371/journal.pone.0252529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Singh H, Hirani K, Kadiyala H, Rudomiotov O, Davis T, Khan M, et al. Characteristics and predictors of missed opportunities in lung cancer diagnosis: an electronic health record-based study. J Clin Oncol. 2010;28:3307–15. doi: 10.1200/jco.2009.25.6636. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Singh H, Daci K, Petersen LA, Collins C, Shethia A, Petersen NJ, et al. Missed opportunities to initiate endoscopic evaluation for colorectal cancer diagnosis. Am J Gastroenterol. 2009;104:2543–54. doi: 10.1038/ajg.2009.324. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Mitchell E, Macdonald S, Campbell NC, Weller D, Macleod U. Influences on pre-hospital delay in the diagnosis of colorectal cancer: a systematic review. Br J Cancer. 2008;98:60–70. doi: 10.1038/sj.bjc.6604096. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Singh H, Sethi S, Raber M, Petersen LA. Errors in cancer diagnosis: current understanding and future directions. J Clin Oncol. 2007;25:5009–18. doi: 10.1200/jco.2007.13.2142. [DOI] [PubMed] [Google Scholar]
- 38.Graber ML, Trowbridge R, Myers JS, Umscheid CA, Strull W, Kanter MH. The next organizational challenge: finding and addressing diagnostic error. Joint Comm J Qual Patient Saf. 2014;40:102–10. doi: 10.1016/s1553-7250(14)40013-8. [DOI] [PubMed] [Google Scholar]
- 39.Lyratzopoulos G, Vedsted P, Singh H. Understanding missed opportunities for more timely diagnosis of cancer in symptomatic patients after presentation. Br J Cancer. 2015;112(1 Suppl):S84–91. doi: 10.1038/bjc.2015.47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Christensen KG, Fenger-Grøn M, Flarup KR, Vedsted P. Use of general practice, diagnostic investigations and hospital services before and after cancer diagnosis-a population-based nationwide registry study of 127,000 incident adult cancer patients. BMC Health Serv Res. 2012;12:1–8. doi: 10.1186/1472-6963-12-224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Lyratzopoulos G, Neal RD, Barbiere JM, Rubin GP, Abel GA. Variation in number of general practitioner consultations before hospital referral for cancer: findings from the 2010 national cancer patient experience survey in England. Lancet Oncol. 2012;13:353–65. doi: 10.1016/s1470-2045(12)70041-4. [DOI] [PubMed] [Google Scholar]
- 42.Lyratzopoulos G, Abel GA, McPhail S, Neal RD, Rubin GP. Measures of promptness of cancer diagnosis in primary care: secondary analysis of national audit data on patients with 18 common and rarer cancers. Br J Cancer. 2013;108:686–90. doi: 10.1038/bjc.2013.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.White B, Renzi C, Rafiq M, Abel G, Jensen H, Lyratzopoulos G. Does changing healthcare use signal opportunities for earlier detection of cancer? A review of studies using information from electronic patient records. Cancer Epidemiol. 2022;76:102072. doi: 10.1016/j.canep.2021.102072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Abel GA, Mendonca SC, McPhail S, Zhou Y, Elliss-Brookes L, Lyratzopoulos G. Emergency diagnosis of cancer and previous general practice consultations: insights from linked patient survey data. Br J Gen Pract. 2017;67:e377–87. doi: 10.3399/bjgp17x690869. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.McPhail S, Swann R, Johnson SA, Barclay ME, Abd Elkader H, Alvi R, et al. Risk factors and prognostic implications of diagnosis of cancer within 30 days after an emergency hospital admission (emergency presentation): an international cancer benchmarking partnership (ICBP) population-based study. Lancet Oncol. 2022;23:587–600. doi: 10.1016/s1470-2045(22)00127-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Harris M, Thulesius H, Neves AL, Harker S, Koskela T, Petek D, et al. How European primary care practitioners think the timeliness of cancer diagnosis can be improved: a thematic analysis. BMJ Open. 2019;9:e030169. doi: 10.1136/bmjopen-2019-030169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Amelung D, Whitaker KL, Lennard D, Ogden M, Sheringham J, Zhou Y, et al. Influence of doctor-patient conversations on behaviours of patients presenting to primary care with new or persistent symptoms: a video observation study. BMJ Qual Saf. 2020;29:198–208. doi: 10.1136/bmjqs-2019-009485. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Jones R, Latinovic R, Charlton J, Gulliford MC. Alarm symptoms in early diagnosis of cancer in primary care: cohort study using general practice research database. BMJ. 2007;334:1040. doi: 10.1136/bmj.39171.637106.ae. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Okoli GN, Lam OLT, Reddy VK, Copstein L, Askin N, Prashad A, et al. Interventions to improve early cancer diagnosis of symptomatic individuals: a scoping review. BMJ Open. 2021;11 doi: 10.1136/bmjopen-2021-055488. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Black GB, Lyratzopoulos G, Vincent CA, Fulop NJ, Nicholson BD. Early diagnosis of cancer: systems approach to support clinicians in primary care. BMJ. 2023;380 doi: 10.1136/bmj-2022-071225. [DOI] [PubMed] [Google Scholar]
- 51.Smith CF, Lunn H, Wong G, Nicholson BD. Optimising GPs ‘communication of advice to facilitate patients’ self-care and prompt follow-up when the diagnosis is uncertain: a realist review of ‘safety-netting’ in primary care. BMJ Qual Saf. 2022;31:541–54. doi: 10.1136/bmjqs-2021-014529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Lyratzopoulos G, Abel G. Assessing patients at risk of symptomatic-but-as-yet undiagnosed cancer in primary care using information from patient records. Br J Cancer. 2020;122:1729–31. doi: 10.1038/s41416-020-0828-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Rafiq M, Renzi C, White B, Zakkak N, Nicholson B, Lyratzopoulos G, et al. Predictive value of abnormal blood tests for detecting cancer in primary care patients with nonspecific abdominal symptoms: a population-based cohort study of 477,870 patients in England. PLoS Med. 2024;21:e1004426. doi: 10.1371/journal.pmed.1004426. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Koo MM, Rubin G, McPhail S, Lyratzopoulos G. Incidentally diagnosed cancer and commonly preceding clinical scenarios: a cross-sectional descriptive analysis of English audit data. BMJ Open. 2019;9:e028362. doi: 10.1136/bmjopen-2018-028362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Lumbreras B, Donat L, Hernandez-Aguado I. Incidental findings in imaging diagnostic tests: a systematic review. Br J Radiol. 2010;83:276–89. doi: 10.1259/bjr/98067945. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Mabotuwana T, Hombal V, Dalal S, Hall CS, Gunn M. Determining adherence to follow-up imaging recommendations. J Am Coll Radiol. 2018;15:422–8. doi: 10.1016/j.jacr.2017.11.022. [DOI] [PubMed] [Google Scholar]
- 57.Cho JK, Zafar HM, Lalevic D, Cook TS. Patient factor disparities in imaging follow-up rates after incidental abdominal findings. Am J Radiol. 2019;212:589–95. doi: 10.2214/ajr.18.20083. [DOI] [PubMed] [Google Scholar]
- 58.Evans CS, Arthurs R, Kane M, Omofoye F, Chung AE, Moreton E, et al. Incidental radiology findings on computed tomography studies in emergency department patients: a systematic review and meta-analysis. Ann Emerg Med. 2022;80:243–56. doi: 10.1016/j.annemergmed.2022.03.027. [DOI] [PubMed] [Google Scholar]
- 59.Kwee RM, Kwee TC. Whole-body MRI for preventive health screening: a systematic review of the literature. J Magn Reson Imag. 2019;50:1489–503. doi: 10.1002/jmri.26736. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Makeeva V, Schofield K, Davis M, Kadom N. Managing incidental findings. Appl Radiol. 2021:22–6. doi: 10.37549/ar2774. [DOI] [Google Scholar]
- 61.McWilliams A, Tammemagi MC, Mayo JR, Roberts H, Liu G, Soghrati K, et al. Probability of cancer in pulmonary nodules detected on first screening CT. N Engl J Med. 2013;369:910–9. doi: 10.1056/nejmoa1214726. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Vizient . Closing the loop on actionable radiology finding. Irving, Texas: Vizient Patient Safety Organization Safety Alert; 2019. [Google Scholar]
- 63.Oren O, Gersh BJ, Bhatt DP. Improving communication of incidental imaging findings. Mayo Clin Proc. 2021;96:2753–6. doi: 10.1016/j.mayocp.2021.06.021. [DOI] [PubMed] [Google Scholar]
- 64.Carr S. Asking patients to close the loop on diagnostic imaging test results. ImproveDx; 2019. https://www.improvediagnosis.org/improvedx-may-2019/using-patients-to-close-the-loop-on-diagnostic-imaging-test-results/ Available from. [Google Scholar]
- 65.Aase A, Fabbrini AE, White KM, Averill S, Gravely A, Melzer AC. Implementation of a standardized template for reporting of incidental pulmonary nodules: feasibility, acceptability, and outcomes. J Am Coll Radiol. 2020;17:216–23. doi: 10.1016/j.jacr.2019.11.013. [DOI] [PubMed] [Google Scholar]
- 66.White T, Aronson MD, Sternberg SB, Shafiq U, Berkowitz SJ, Benneyan J, et al. Analysis of radiology report recommendation characteristics and rate of recommended action performance. JAMA Netw Open. 2022;5:e2222549. doi: 10.1001/jamanetworkopen.2022.22549. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Barrett TW, Garland NM, Freeman CL, Klar K, Dahlke J, Lancaster P, et al. Catching those who fall through the cracks: integrating a follow-up process for emergency department patients with incidental radiologic findings. Ann Emerg Med. 2022;80:235–42. doi: 10.1016/j.annemergmed.2022.04.026. [DOI] [PubMed] [Google Scholar]
- 68.Ganguli I, Simpkin AL, Lupo C, Weissman A, Mainor AJ, Orav EJ, et al. Cascades of care after incidental findings in a US national survey of physicians. JAMA Netw Open. 2019;2:e1913325. doi: 10.1001/jamanetworkopen.2019.13325. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Davenport MS. Incidental findings and low-value care. Am J Roentgenol. 2023;221:117–23. doi: 10.2214/ajr.22.28926. [DOI] [PubMed] [Google Scholar]
- 70.American College of Radiology Incidental findings. . 2022. https://www.acr.org/Clinical-Resources/Incidental-Findings Available from.
- 71.Callen J, Westbrook J, Georgiou A, Li J. Failure to follow-up test results for ambulatory patients: a systematic review. J Gen Intern Med. 2012;27:1334–48. doi: 10.1007/s11606-011-1949-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Casolino L, Dunham D, Chin M, Bielang R, Kistner E, Karrison T, et al. Frequency of failure to inform patients of clinically significant outpatient test results. Arch Intern Med. 2009;159:1123–9. doi: 10.1001/archinternmed.2009.130. [DOI] [PubMed] [Google Scholar]
- 73.Cole B, Dickerson JA, Graber ML, Fantz CR, Laposata M, Henriksen K, et al. A prospective tool for risk assessment of sendout testing. Clin Chim Acta. 2014;434:1–5. doi: 10.1016/j.cca.2014.03.028. [DOI] [PubMed] [Google Scholar]
- 74.Kadom N, Doherty G, Solomon A, Close M, Friedman S, Gregson D, et al. Safety-net academic hospital experience in following up noncritical yet potentially significant radiologist recommendations. Am J Roentgenol. 2017;209:982–6. doi: 10.2214/ajr.17.18179. [DOI] [PubMed] [Google Scholar]
- 75.Atlas SJ, Tosteson ANA, Burdick TE, Wright A, Breslau ES, Dang TH, et al. Primary care practitioner perceptions on the follow-up of abnormal cancer screening test results. JAMA Netw Open. 2022;5:e2234194. doi: 10.1001/jamanetworkopen.2022.34194. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Boggan JC, Swaminathan A, Thomas S, Simel DL, Zaas AK, Bae JG. Improving timely resident follow-up and communication of results in ambulatory clinics utilizing a web-based audit and feedback module. J Grad Med Educ. 2017;9:195–200. doi: 10.4300/jgme-d-16-00460.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Zimolzak AJ, Shahid U, Giardina TD, Memon SA, Mushtaq U, Zubkoff L, et al. Why test results are still getting “lost” to follow-up: a qualitative study of implementation gaps. J Gen Intern Med. 2022;37:137–44. doi: 10.1007/s11606-021-06772-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Wright B, Lennox A, Goodwin D, Bragge P. How can we close the loop on test results to reduce risks associated with diagnostic error in emergency departments? Briefing document. Monash University. 2018 https://www.behaviourworksaustralia.org/wp-content/uploads/2019/07/Misdiagnosis-2_Briefing-Document.pdf [Google Scholar]
- 79.Dalal AK, Pesterev BM, Eibensteiner K, Newmark LP, Samal L, Rothschild JM. Linking acknowledgement to action: closing the loop on non-urgent, clinically significant test results in the electronic health record. J Am Med Inf Assoc. 2015;22:905–8. doi: 10.1093/jamia/ocv007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Zuccotti G, Samal L, Maloney FL, Ai A, Wright A. The need for closed-loop systems for management of abnormal test results. Ann Intern Med. 2018;168:820–1. doi: 10.7326/m17-2425. [DOI] [PubMed] [Google Scholar]
- 81.Campbell WS, Talmon GA, Foster KW, Lele SM, Kozel JA, West WW. Sixty-five thousand shades of gray: importance of color in surgical pathology diagnoses. Hum Pathol. 2015;46:1945–50. doi: 10.1016/j.humpath.2015.08.016. [DOI] [PubMed] [Google Scholar]
- 82.Office of the National Coordinator for Health Information Technology (ONC) SAFER guides. . 2018. https://www.healthit.gov/ Available from.
- 83.The Joint Commission Quick safety issue 52: advancing safety with closed-loop communication of test results. . 2019 https://www.jointcommission.org/resources/news-and-multimedia/newsletters/newsletters/quick-safety/quick-safety-issue-52-advancing-safety-with-closed-loop-communication-of-test-results/ [Google Scholar]
- 84.Improving your laboratory testing process. Rockville, MD: Agency for Healthcare Research and Quality; 2018. https://ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/quality-resources/tools/lab-testiing/lab-testing-toolkit.pdf [Google Scholar]
- 85.Singh H, Vij MS. Eight recommendations for policies for communicating abnormal test results. Joint Comm J Qual Patient Saf. 2010;36:226–32. doi: 10.1016/s1553-7250(10)36037-5. [DOI] [PubMed] [Google Scholar]
- 86.Kros J, Liao Y, Kirchoff J, Zemanek JJ. Traceability in the supply chain. Int J Appl Logist. 2019;9:1–22. doi: 10.4018/ijal.2019010101. [DOI] [Google Scholar]
- 87.Yirui J, Trung Hieu T, Leon W. A surveillance-and-blockchain-based tracking system for mitigation of baggage mishandling at smart airports. J Airl Oper Aviat Manag. 2023;2:33–51. [Google Scholar]
- 88.Rajan SS, Baldwin JL, Giardina TD, Singh H. Technology-based closed-loop tracking for improving communication and follow-up of pathology results. J Patient Saf. 2022;18:e262–6. doi: 10.1097/pts.0000000000000759. [DOI] [PubMed] [Google Scholar]
- 89.Georgiou A, Li J, Thomas J, Dahm M, Westbrook J. The impact of health information technology on the management and follow-up of test results – a systematic review. JAMIA. 2019;26:678–88. doi: 10.1093/jamia/ocz032. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Grant S, Checkland K, Bowie P, Guthrie B. The role of informal dimensions of safety in high-volume organisational routines: an ethnographic study of test results handling in UK general practice. Implement Sci. 2017;12:1–2. doi: 10.1186/s13012-017-0586-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Li J, Dahm M, Thomas J, Callen J, Westbrook J, Georgiou A. Balancing risk and resilience: a comparison of the use of a test result management system across two EDs. Stud Health Technol Inform. 2018;252:92–8. [PubMed] [Google Scholar]
- 92.Litchfield I, Bentham L, Hill A, McManus RJ, Lilford R, Greenfield S. Routine failures in the process for blood testing and the communication of results to patients in primary care in the UK: a qualitative exploration of patient and provider perspectives. BMJ Qual Saf. 2015;24:681–90. doi: 10.1136/bmjqs-2014-003690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Murphy DR, Wu L, Thomas EJ, Forjuoh SN, Meyer AND, Singh H. Electronic trigger based intervention to reduce delays in diagnostic evaluation for cancer: a cluster randomized controlled trial. J Clin Oncol. 2015;33:3560–7. doi: 10.1200/jco.2015.61.1301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94.Kanter MH, Schottinger JE, Joshua A, Slezak JM. Beyond screening: an interim report and analysis of a multimodal initiative to decrease colon cancer mortality. Joint Comm J Qual Patient Saf. 2022;48:388–94. doi: 10.1016/j.jcjq.2022.04.008. [DOI] [PubMed] [Google Scholar]
- 95.Wandtke B, Gallagher S. Reducing delay in diagnosis: multistage recommendation tracking. Am J Roentgenol. 2017;209:970–5. doi: 10.2214/ajr.17.18332. [DOI] [PubMed] [Google Scholar]
- 96.Bhise V, Modi V, Kalavar A, Espadas D, Hanser L, Gould M, et al. Patient-reported attributions for missed colonoscopy appointments in two large healthcare systems. Dig Dis Sci. 2016;61:1853–61. doi: 10.1007/s10620-016-4096-3. [DOI] [PubMed] [Google Scholar]
- 97.Singh H, Petersen LA, Daci K, Collins C, Khan M, El-Serag HB. Reducing referral delays in colorectal cancer diagnosis: is it about how you ask? Qual Saf Health Care. 2010;19:e27. doi: 10.1136/qshc.2009.033712. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Singh H, Khan R, Giardina TD, Paul LW, Daci K, Gould M, et al. Postreferral colonoscopy delays in diagnosis of colorectal cancer: a mixed-methods analysis. Qual Manag Health Care. 2012;21:252–61. doi: 10.1097/qmh.0b013e31826d1f28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Patel MP, Schettini P, O’Leary CP, Bosworth HB, Anderson JB, Shah KP. Closing the referral loop: an analysis of primary care referrals to specialists in a large health system. J Gen Intern Med. 2018;33:715–21. doi: 10.1007/s11606-018-4392-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 100.Institute for Healthcare Improvement/National Patient Safety Foundation . Closing the loop: a guide to safer ambulatory referrals in the EHR era. Cambridge, MA: IHI; 2017. [Google Scholar]
- 101.Nehls N, Yap TS, Salant T, Aronson M, Schiff G, Olbricht S, et al. Systems engineering analysis of diagnostic referral closed-loop processes. BMJ Open. 2021;10 doi: 10.1136/bmjoq-2021-001603. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Ramelson H, Nederlof A, Karmiy S, Neri P, Kiernan D, Krishnamurthy R, et al. Closing the loop with an enhanced referral management system. J Am Med Inf Assoc. 2018;25:715–21. doi: 10.1093/jamia/ocy004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Davidow S, Sheth J, Sixta C, Thomas-Hemak L. Closing the referral loop; improving ambulatory referral management, electronic health record connectivity, and care coordination processes. J Ambul Care Manag. 2018;41:240–9. doi: 10.1097/jac.0000000000000247. [DOI] [PubMed] [Google Scholar]
- 104.Wong GJ, Lau J, Tan KK. The effect of a simple phone call intervention on FIT-positive individuals: an exploratory study. Int J Colorectal Dis. 2021;36:187–90. doi: 10.1007/s00384-020-03742-4. [DOI] [PubMed] [Google Scholar]
- 105.Emani S, Sequist TD, Lacson R, Khorasani R, Jajoo K, Holtz L, et al. Ambulatory safety nets to reduce missed and delayed diagnoses of cancer. Joint Comm J Qual Patient Saf. 2019;45:552–7. doi: 10.1016/j.jcjq.2019.05.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.Singh H, Carayon P. A roadmap to advance patient safety in ambulatory care. JAMA. 2020;324:2481–2. doi: 10.1001/jama.2020.18551. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Whitfield E, White B, Denaxas S, Barclay M, Renzi C, Lyratzopoulos G. A taxonomy of early diagnosis research to guide study design and funding prioritization. Br J Cancer. 2023;129:1527–34. doi: 10.1038/s41416-023-02450-4. [DOI] [PMC free article] [PubMed] [Google Scholar]

