Abstract
Medical imaging is an essential component of healthcare, enabling accurate diagnoses and facilitating effective treatment plans. However, the field is not without its challenges, including medical imaging errors, overutilization of procedures, and adverse reactions to contrast agents. This review explores the impact of computerized physician order entry (CPOE) systems coupled with clinical decision support (CDS) on radiologic services. By analyzing the findings from various studies, this paper highlights how CPOE coupled with CDS can significantly reduce inappropriate imaging, enhance adherence to clinical guidelines, and improve overall patient safety. The implementation of CPOE with CDS optimizes the utilization of radiologic procedures, thereby reducing healthcare costs and minimizing patients' exposure to unnecessary radiation. Despite its benefits, the adoption of CPOE with CDS encounters challenges such as high implementation costs, changes in workflow, and alert fatigue among healthcare providers. Addressing these challenges requires careful system design, including the customization of alerts to reduce override rates and improve the specificity of CDS recommendations. This review underscores the potential of CPOE with CDS to transform radiologic services, enhancing both the quality and safety of patient care. Further research is needed to explore the system's effectiveness in preventing adverse reactions to contrast media and to identify best practices for overcoming the barriers to its broader adoption.
Keywords: alert, alert fatigue, clinical decision support, computerized physician order entry, medical imaging, radiology
Introduction and background
Medical imaging exams are an important part of healthcare that have led to enhancements in the diagnosis and treatment of many health conditions. Medical imaging enables the visualization of internal organs, allowing physicians to examine, diagnose, and treat various medical conditions [1]. The field has evolved rapidly with the advancement of technology and computing [1]. Following the ALARA principle ("As Low As Reasonably Achievable") is crucial for healthcare providers, emphasizing the delivery of high-quality care while minimizing patients' exposure to unnecessary radiation [2]. However, medical imaging is not an exception to other healthcare services. Radiologic medical imaging suffers from several issues that can affect the quality of care, patient safety, and healthcare expenses.
Several issues could occur in medical imaging services. Medical imaging errors are one of the issues in radiologic services and are not uncommon [3]. The types of errors that could happen in radiologic medical imaging include wrong-procedure errors, wrong-patient errors, and wrong-site errors [3]. Unnecessary or inappropriate radiologic procedures are also a major problem in medical imaging services. They increase costs to the government and patients and expose patients to unnecessary doses of radiation [4,5]. Materials that are administered to patients to enhance images could be problematic as well. They can cause adverse reactions and, in rare cases, death [6].
A computerized physician order entry (CPOE) system coupled with clinical decision support (CDS) could be an effective way to reduce the issues and improve healthcare services in radiologic medical imaging [7-20]. This paper aims to synthesize existing evidence on the effectiveness of integrating CDS within a CPOE system to enhance the quality of radiologic services.
Review
Methods
This review was conducted and reported in accordance with the PRISMA Extension for Scoping Reviews (PRISMA-ScR) guidelines [21]. Articles for this review were sourced from Google Scholar, PubMed, and Ovid. The search keywords included "CPOE," "computerized physician order entry," "CDS," "clinical decision support," "radiology," "radiologic imaging," "medical imaging," and "imaging." Boolean operators "OR" and "AND" were utilized to combine these keywords, ensuring comprehensive coverage of relevant studies. Additionally, the references of the included articles were reviewed to identify other relevant studies.
The inclusion criteria required that articles be peer-reviewed, in English, published in or after 2001, and relevant to the scope of this paper, the impact of CPOE with CDS on radiologic services. Restricting the review to English-language articles ensures accessibility and comprehension, given that English is the predominant language of scientific publications, thus maintaining the quality and reliability of the review by focusing on peer-reviewed and reputable sources. The chosen timeframe of 2001 to 2024 captures the significant advancements in CPOE and CDS systems over the past two decades, reflecting contemporary practices and the most recent evidence. This criterion also aids in maintaining the review's scope and manageability, allowing for a focused and rigorous analysis without being overwhelmed by an excessive volume of literature. The search and selection process is detailed in Figure 1, illustrating the steps from the initial search to the final inclusion of articles.
Figure 1. Flowchart of the article selection process for the review.
Results
The search yielded 976 articles: 462 from Google Scholar, 213 from Ovid, and 301 from PubMed. Duplicate and non-English articles were excluded, as well as those published before 2001, resulting in 652 articles. Based on the titles, 281 articles were excluded, leaving 371 articles. After reviewing the abstracts, 328 articles were excluded, leaving 43 articles. Following a full review, 21 articles were excluded because their primary subject matter was not aligned with the scope of this review or because they were non-peer-reviewed, leaving a total of 22 articles included in the review. These 22 articles served as the primary sources for this review, while the remaining articles were used to support the discussion. A summary of the included articles is provided in Table 1.
Table 1. Summary table of reviewed articles.
CDS: clinical decision support, CPOE: computerized physician order entry, US: United States, CT: computed tomography, CTPA: computed tomography pulmonary angiography, MRI: magnetic resonance imaging, ED: emergency department, ESR: European Society of Radiology
No. | Article title | Authors | Year of publication | Objective/purpose | Methodology | Key findings | Relevance to CPOE and CDS in radiologic services |
1 | The effects on clinician ordering patterns of a computerized decision support system for neuroradiology imaging studies [7] | Sanders DL, Miller RA | 2001 | To evaluate the impact of a CDS system on clinician ordering patterns for neuroradiology imaging. | Retrospective pre-post analysis. | Increased appropriateness of neuroradiology imaging orders. | Demonstrates the effectiveness of CDS in specific radiologic subspecialties within CPOE. |
2 | Assessment of radiological referral practice and effect of computer-based guidelines on Radiological requests in two emergency departments [8] | Carton M, Auvert B, Guerini H, et al. | 2002 | To assess the impact of computer-based guidelines on radiology referral practices in emergency departments. | Comparative study across two hospitals. | Improved adherence to guidelines and reduced inappropriate referrals. | Highlights the role of CDS in enhancing radiologic referrals through CPOE systems. |
3 | A utilization management intervention to reduce unnecessary testing in the coronary care unit [9] | Wang TJ, Mort EA, Nordberg P, et al. | 2002 | To evaluate the effectiveness of utilization management interventions in reducing unnecessary testing. | Intervention study with before-and-after comparison. | Reduced unnecessary testing in coronary care units. | Relevant to understanding the broader impact of CPOE with CDS on various medical specialties. |
4 | Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis [10] | Sistrom CL, Dang PA, Weilburg JB, et al. | 2009 | To analyze the long-term impact of CPOE with integrated CDS on outpatient procedure volumes. | Time series analysis over seven years. | Gradual increase in appropriate outpatient imaging procedures. | Demonstrates the long-term benefits of CPOE with CDS on procedural growth and appropriateness. |
5 | Meaningful use of computerized prescriber order entry [11] | Classen D, Bates DW, Denham CR | 2010 | To discuss the meaningful use criteria for CPOE and its implications for healthcare delivery. | Review and policy analysis. | CPOE meaningful use can improve patient safety and reduce errors. | Relevant to understanding the regulatory and policy framework for CPOE with CDS. |
6 | Increasing the appropriateness of outpatient imaging: effects of a barrier to ordering low-yield examinations [12] | Vartanians VM, Sistrom CL, Weilburg JB, et al. | 2010 | To assess the impact of barriers to ordering low-yield imaging exams on outpatient imaging practices. | Analysis of imaging order patterns before and after barrier implementation. | Significant reduction in low-yield exams ordered. | Highlights how CDS can guide better decision-making in outpatient imaging through CPOE systems. |
7 | Electronic decision support for diagnostic imaging in a primary care setting [13] | Curry L, Reed MH | 2011 | To examine the impact of electronic decision support on diagnostic imaging in primary care. | Comparative study of imaging orders before and after CDS implementation. | Increased appropriateness of imaging orders in primary care. | Demonstrates the potential of CDS in improving imaging decisions. |
8 | Standard practices for computerized clinical decision support in community hospitals: a national survey [14] | Ash JS, McCormack JL, Sittig DF, et al. | 2012 | To survey the adoption and standard practices of CDS in community hospitals across the US. | National survey of hospital practices. | Wide variability in CDS practices; need for standardization identified. | Provides context on the varying implementation of CPOE and CDS in different hospital settings. |
9 | Clinical decision support systems for utilization of CT in the emergency department [15] | Ip IK, Drescher FS | 2012 | To evaluate the role of CDS in managing the use of CT scans in the emergency department. | Review of clinical studies and systems analysis. | CDS can reduce unnecessary CT scans and improve adherence to guidelines. | Relevant to understanding the application of CDS in radiologic services within CPOE systems. |
10 | Effect of computerized clinical decision support on the use and yield of CT pulmonary angiography in the emergency department [16] | Raja AS, Ip IK, Prevedello LM, et al. | 2012 | To assess the impact of CDS on the utilization and diagnostic yield of CTPA in the ED. | Retrospective analysis comparing pre- and post-CDS implementation data. | Reduced the number of unnecessary CTPA exams without affecting diagnostic yield. | Highlights how CPOE with CDS can optimize the use of high-radiation imaging studies. |
11 | The effect of computerized provider order entry systems on clinical care and work processes in emergency departments: a systematic review of the quantitative literature [17] | Georgiou A, Prgomet M, Paoloni R, et al. | 2013 | To systematically review the impact of CPOE systems on clinical care and workflows in emergency departments. | Systematic review of quantitative studies. | Mixed effects on workflow but generally improved order accuracy and patient safety. | Provides insights into how CPOE with CDS can be optimized to balance workflow efficiency and safety. |
12 | Requiring clinical justification to override repeat imaging decision support: impact on CT use [18] | O'Connor SD, Sodickson AD, Ip IK, et al. | 2014 | To examine the effects of requiring clinical justification for overriding CDS alerts on repeat CT imaging orders. | Prospective study with data collection before and after intervention. | Decreased the number of unnecessary repeat CT scans. | Demonstrates the importance of structured CDS in preventing redundant imaging in CPOE systems. |
13 | Radiology reporting: a closed-loop cycle from order entry to results communication [19] | Weiss DL, Kim W, Branstetter BF, Prevedello LM | 2014 | To assess the complete cycle of radiology reporting from order entry to results communication. | Review of existing systems and workflows in radiology departments. | Identified gaps in communication and reporting; proposed a closed-loop system to ensure accuracy. | Relevant in ensuring that CPOE and CDS systems contribute to a comprehensive radiology workflow. |
14 | Impact of clinical decision support on head computed tomography use in patients with mild traumatic brain injury in the ED [20] | Ip IK, Raja AS, Gupta A, Andruchow J, Sodickson A, Khorasani R | 2015 | To evaluate the impact of CDS on the utilization of head CT for patients with mild traumatic brain injury in the emergency department. | Retrospective study analyzing CT scan usage before and after CDS implementation. | Significant reduction in unnecessary head CT scans. | Demonstrates how CDS within CPOE can reduce unnecessary imaging and improve decision-making. |
15 | Radiology order decision support: examination-indication appropriateness assessed using 2 electronic systems [22] | Schneider E, Zelenka S, Grooff P, et al. | 2015 | To compare two CDS systems in evaluating the appropriateness of MRI and CT orders. | Retrospective analysis of 2,000 MRI and CT orders across two CDS systems. | The study found notable differences in appropriateness ratings between the systems, influenced by their design and implementation. | Highlights the need for careful selection and configuration of CDS in CPOE systems to ensure accurate imaging appropriateness assessments. |
16 | Provider feedback about imaging appropriateness using scores from order entry decision support: raw rates misclassify outliers [23] | Sistrom CL, Weilburg JB, Dreyer KJ, Ferris TG | 2015 | To evaluate how feedback on imaging appropriateness based on order entry decision support scores affects provider behavior. | Retrospective analysis of outpatient imaging orders over five years, using statistical methods to identify factors influencing low-utility imaging rates. | Significant variation in low-utility imaging rates among providers, with caution advised in using raw rates for feedback. | Emphasizes the need for accurate metrics in CDS within CPOE systems to avoid misclassification and improve imaging practices. |
17 | Integrity of clinical information in computerized order requisitions for diagnostic imaging [24] | Lacson R, Laroya R, Wang A, et al. | 2018 | To evaluate the accuracy and integrity of clinical information in CPOE systems for diagnostic imaging. | Data quality analysis of CPOE entries. | Identified issues in data integrity affecting CDS effectiveness. | Highlights the importance of accurate data entry in CPOE systems for effective CDS functioning. |
18 | Can emergency department provider notes help to achieve more dynamic clinical decision support? [25] | Rousseau JF, Ip IK, Raja AS, Schuur JD, Khorasani R | 2020 | To investigate whether integrating provider notes in the ED can enhance CDS functionality. | Prospective observational study. | Provider notes enhanced the specificity of CDS alerts. | Relevant to improving the dynamic nature of CDS in radiologic services within CPOE systems. |
19 | A systematic analysis of the optimization of computerized physician order entry and clinical decision support systems: a qualitative study in English hospitals [26] | Wiegel V, King A, Mozaffar H, et al. | 2020 | To analyze the optimization of CPOE and CDS systems in English hospitals. | Qualitative study using interviews and observations. | Identified best practices and challenges in CPOE and CDS implementation. | Provides insights into optimizing CPOE with CDS in healthcare settings. |
20 | Evaluation criteria for the effects of decision support integrated into computerized provider order entry system: a scoping review [27] | Karajizadeh M, Zand F, Vazin A, et al. | 2022 | To review and identify evaluation criteria for CDS integrated into CPOE systems. | Scoping review of evaluation studies. | Proposed a set of criteria for evaluating CPOE with CDS. | Relevant to understanding how to assess and improve CPOE with CDS in radiologic services. |
21 | Analytics to monitor local impact of the protecting access to Medicare Act’s imaging clinical decision support requirements [28] | Valtchinov VI, Murphy SN, Lacson R, et al. | 2022 | To monitor the impact of the Protecting Access to Medicare Act’s imaging CDS requirements. | Analytics-based study using hospital data. | Provided insights into compliance and effectiveness of CDS requirements. | Relevant to understanding the regulatory impacts on CDS and CPOE in radiologic services. |
22 | Medical imaging decision and support (MIDAS): study protocol for a multi-centre cluster randomized trial evaluating the ESR iGuide [29] | Dijk SW, Kroencke T, Wollny C, et al. | 2023 | To outline the protocol for a trial evaluating the ESR iGuide for medical imaging decision support. | Protocol for a cluster randomized trial. | Anticipated to reduce inappropriate imaging and improve guideline adherence. | Relevant to the development and evaluation of new CDS tools within CPOE systems. |
Synthesis of the studies
Issues in Radiologic Services
Radiologic services are essential to modern healthcare, but they encounter several significant challenges that can impact both patient safety and the overall quality of care [1,3]. Foremost among these is the issue of medical imaging errors. These errors can occur in various forms, including wrong-procedure errors, where the incorrect imaging procedure is performed; wrong-patient errors, where the wrong patient's imaging is conducted; and wrong-site errors, where imaging is performed on the incorrect part of the body [3]. Such errors may lead to misdiagnoses, delayed treatment, and even unnecessary surgical interventions. According to the Pennsylvania Patient Safety Authority, several factors contribute to errors in radiologic services. One significant cause is the inaccurate entry of radiologic orders, such as when a healthcare provider fails to specify whether the exam should be conducted with contrast media [3,24]. This type of error accounts for half of the errors in radiologic services [3]. Another common cause, responsible for approximately one-third of the errors, is the failure to confirm the patient's identity, which can result in exposing the wrong patient to radiation [3]. Additionally, errors can occur due to the failure to verify the site or procedure of the radiologic exam, a factor that contributes to one-fifth of the errors in radiologic services [3].
Another critical issue in radiologic services is the overutilization of imaging procedures [7,12]. Overutilization involves performing unnecessary or inappropriate imaging exams that do not contribute to the patient's care but instead increase healthcare costs and expose patients to unnecessary radiation [4,5]. The use of unnecessary imaging procedures not only wastes resources but also puts patients at risk for adverse outcomes, including radiation-induced injuries and adverse reactions to contrast agents used during imaging [4,6].
Results from a study conducted by Dehn et al. suggest that 30-40% of medical imaging exams are inappropriate [30]. Exposure to high doses of radiation may increase the risk of developing cancer [31,32]. In the United States, the number of CT scans performed increased from 3 million in 1980 to 67 million in 2007, and it is increasing by 10% every year [4]. Approximately 29,000 cancers every year could be caused by CT scans [33]. It is estimated that two to three head CT scans done on children aged younger than 15 years old can triple the risk of brain tumors [34]. The availability and convenience of ordering diagnostic procedures such as medical imaging exams may increase the risk of overutilization [35]. Therefore, preventing unnecessary exposure to radiation is a critical priority.
In addition to errors and overutilization, there is the issue of adverse reactions to contrast media. These agents are commonly used to enhance the visibility of specific structures or fluids within the body during imaging [36], but they can cause allergic reactions, ranging from mild to severe, and in rare cases, they can be life-threatening [6,37]. Managing these reactions requires prompt recognition and intervention, and the risk of such reactions must be carefully weighed against the potential benefits of the imaging procedure. Despite the existence of protocols for the safe administration of contrast media, incidents of adverse reactions still occur, highlighting the need for enhanced safety measures and improved risk assessment tools [6]. Incorporating CDS into a CPOE system presents a promising approach to enhancing the quality of medical imaging services. However, this area requires further research.
What Is a CPOE System With CDS?
The CPOE component is an electronic system that replaces traditional methods of ordering medications, laboratory tests, imaging studies, and other diagnostic procedures. Instead of handwriting or verbally communicating orders, healthcare providers enter orders directly into an electronic health record (EHR) system [15,38]. This not only reduces the risk of errors associated with handwriting and miscommunication but also ensures that orders are transmitted directly to the appropriate department (e.g., pharmacy, laboratory, radiology) for execution [38]. To maximize the benefits of utilizing CPOE, it should be combined with the CDS system. CDS is designed to assist healthcare providers in making informed decisions about patient care [39].
The CDS component complements the CPOE system by providing real-time, evidence-based guidance to healthcare providers as they enter orders [15]. CDS tools can include alerts, reminders, clinical guidelines, diagnostic support, and drug interaction checks, all aimed at improving the safety and quality of patient care [10]. For instance, when a physician orders a CT scan for a patient with mild symptoms, the CDS system may generate an alert indicating that, based on the patient's condition and current clinical guidelines, the CT scan may not be necessary. This type of guidance enables healthcare providers to make more informed decisions, reduce unnecessary procedures, and adhere to best practices [10,13].
Patient-specific recommendations or alerts are generated by software algorithms when the characteristics of a patient match a computerized knowledge base. The characteristics of a patient can be entered manually or retrieved from an EHR [39]. These computer-generated recommendations or alerts are displayed on the healthcare provider’s screen when there appears to be an issue. The accuracy of clinical information within CPOE is crucial for the effective operation of CDS systems, which in turn helps to minimize diagnostic errors and enhance patient safety [24].
CPOE With CDS as a Means to Eliminate Issues and Improve Quality in Radiologic Services
Medical imaging procedures are evolving rapidly, becoming increasingly complex over time [19]. As a result, many healthcare providers find it difficult to select the most appropriate radiologic exam for their patients, leading to the selection of inappropriate or suboptimal imaging procedures [19]. When CPOE is coupled with CDS and applied to radiologic services, it can guide healthcare providers toward more optimized utilization of medical imaging examinations [9,15,22,23,25,27,29].
Currently, numerous clinical decision rules related to radiologic services, such as the Ottawa ankle and knee rules [40,41], have been developed to assist healthcare providers in their decision-making. However, applying these rules in clinical practices remains challenging [42]. CDS within a CPOE system can facilitate the application of these rules and help healthcare providers make more appropriate decisions [15,27]. Evidence suggests that CPOE with CDS improves healthcare providers' adherence to guidelines and rules [8,11,27]. When these guidelines are followed, the number of inappropriate and unnecessary medical imaging examinations significantly decreases [7,9,20,27,43,44], which subsequently lowers healthcare expenses and reduces radiation exposure to patients [8,20,45]. For instance, adherence to head CT scan guidelines alone could reduce healthcare expenditures in the United States by $120 million annually [45]. Additionally, a CPOE system with CDS not only reduces unnecessary medical imaging procedures but also enhances healthcare quality without increasing the risk of delayed diagnoses [20]. Furthermore, administrators can utilize the CPOE system's database to review historical physician orders, identify patterns of undesirable ordering, and provide targeted advice to improve decision-making [19].
Incorporating CDS within CPOE can significantly improve healthcare quality by reducing inappropriate medical imaging exams and decreasing the utilization of high-radiation radiologic procedures [27,28,46]. A study conducted by Bairstow et al. [46] revealed that CDS decreased inappropriate diagnostic imaging procedures by 13%; moreover, the finding of their study showed that 35% of the medical imaging procedures performed before the CDS implementation were not adherent to guidelines, whereas only 22% of which were not adherent to guidelines after the implementation of CDS [46]. Patients are exposed to very high radiation doses when they undergo CT scans [47]. CDS can help reduce the utilization of CT angiography, which means decreasing patients’ exposure to unnecessary high radiation doses [10,16,48].
Radiographic contrast media used in medical imaging are highly valuable, as they can significantly enhance the images of body organs produced by various radiologic imaging procedures. However, these contrast agents can also cause adverse reactions, including life-threatening ones [6,37]. It is crucial to identify patients at high risk for contrast media reactions, such as those with a previous reaction to contrast media, asthma, or food allergies [49] so that they can receive special care to prevent such reactions. CPOE with CDS could assist in identifying patients at high risk for reactions to contrast agents. Currently, there appears to be no existing study that specifically examines the impact of CPOE coupled with CDS on identifying patients at high risk for contrast media reactions. Several studies have explored the effectiveness of CPOE with CDS in reducing adverse drug reactions, with findings indicating that CPOE with CDS significantly reduced adverse drug events [17,50-52]. It is reasonable to suggest that CPOE with CDS could prevent contrast media reactions in the same way it has been shown to prevent adverse drug reactions. Further research is needed to explore this area and validate these potential benefits.
Problem of CDS Alerts Override
CDS alerts are specific types of CDS automation designed to notify healthcare providers about critical information. Alerts can be either interruptive or simply informative, appearing somewhere on the healthcare provider’s screen [53]. These alerts can be highly important and beneficial. In a study conducted by Persell et al. [54], the results showed that CDS alerts helped boost physician performance and enhanced patient care. However, it has been observed that many physicians tend to override these alerts, with override rates occurring in 49-98% of cases [55].
In CPOE systems, alert overriding is a common issue. There are two types of overriding: those that are justified due to valid reasons and those that are unjustified and, therefore, incorrect. Incorrect overriding can result in serious health issues for patients [22,25,29]. Such actions should, therefore, be avoided whenever possible. Most of the time, however, incorrect overriding results from alert fatigue, which arises from a continuous flow of alerts that are sometimes irrelevant [26-28,56]. As physicians receive more alerts, they become overwhelmed, leading to a decrease in responsiveness, a phenomenon known as alert fatigue, which is the major cause of alert override [57,58].
Alert fatigue can be defined as a decline in the responsiveness of healthcare providers as the number of simultaneous alerts increases [57-59]. Healthcare providers have limited ability to modify alerts to ensure only important ones are displayed. This limitation is due to concerns from vendors and designers about potential liability if they allow healthcare providers to remove or modify an alert that could have prevented a medical error, thereby restricting the ability to adjust or modify alerts [26,58].
Alert Fatigue and CDS Alerts Within CPOE
In some cases, incorrect overriding can result in serious consequences. Therefore, many CDS systems are designed with a high sensitivity rate, which often comes at the expense of specificity [60]. Systems with lower specificity are more likely to be overridden as physicians receive more false-positive alerts and become desensitized to the importance of these alerts [14,61]. False-positive alerts increase the cognitive load and consume more time as physicians try to assess the relevance of the alerts [60].
Although the issue of alert fatigue is well documented, the solution is not straightforward. The high number of overridden alerts suggests that many alerts should not be triggered; however, studies have shown that physicians may disagree on which alerts can be safely removed [62,63]. Overridden alerts are not always irrelevant. Some of the reasons for overriding alerts include "alert well known," "alert not serious," "alert not needing (additional) action," or "the effects of the combination were monitored or intended" [63].
Another attempt to improve the quality of triggered alerts was made through machine learning. Lee et al. [62] applied machine learning to predict which alerts could be safely removed based on previously overridden alerts. The method predicted the overridden alerts with 91-96% accuracy. The study also emphasized the importance of patient safety when filtering alerts, as some of the filtered alerts might be important. Additionally, the study showed that reducing the number of alerts triggered may compromise quality [62]. To reduce override rates of CDS alerts within CPOE, the alerts need to be carefully constructed, considering both sensitivity and specificity [62].
Recommendations to Design Good CDS Alerts Within CPOE
Alert override is a significant problem because, as physicians override irrelevant alerts, they may also end up overriding important alerts due to a lack of responsiveness [26,64]. CDS alerts within a CPOE system should be designed in a way that encourages healthcare providers to follow the information presented in them [22,23,26,29].
Several factors should be considered to ensure that CDS alerts are effective. First, CDS alerts should be reliable and accurate so that healthcare providers can trust them [65]. Approximately 41% of physicians do not trust the information presented in CDS alerts [14]. Second, in interviews conducted by Birmingham et al. [66], healthcare providers expressed a desire for CDS alerts to include the patient’s medical history so that physicians do not have to search for the required health information. Moreover, CDS alerts should remain on the screen without interrupting the workflow until the physician is ready to act on them. CDS alerts should not require multiple responses or immediate actions, and they should not interrupt or disturb the physician’s workflow; however, they should be noticeable [67]. Third, for potentially serious clinical circumstances, the CDS alert should use a “hard stop” to prevent healthcare providers from proceeding with orders that conflict with the evidence presented in the alert [50,56,60,68]. Fourth, the CDS alert should be placed in an area that is within the users’ field of operation. The viewing angle should be at most 50 degrees down from the straight line of normal view, allowing targets to be observed without eye movement [60]. Fifth, CDS alerts should be tiered based on the level of clinical severity. This can be achieved by using colors to represent different levels of clinical severity. For instance, red and orange could represent high levels of danger, while green and blue could represent lower levels [69,70]. Additionally, alerts should be designed to be as distinct as possible, making them easy to differentiate [67]. Sixth, CDS alerts should be actionable, meaning that healthcare providers can take action directly through the alert. Passive alerts are not as effective as actionable alerts [13,71]. Seventh, CDS alerts that are not specific to the clinical context are less effective. Therefore, alerts should be tailored to the patient under examination [15,72-74]. Finally, if a healthcare provider wishes to override a serious CDS alert, they should justify or obtain authorization. CDS alerts should either include a space for the provider to enter a written justification [18,75] or require authorization from a responsible clinician to override them [12].
Barriers to Implement CPOE With CDS
Despite the benefits of the CPOE system with CDS, its adoption has been slow [76]. There are a number of barriers to CPOE adoption, summarized in Table 2. The primary barrier to CPOE adoption is the cost [15,77-79]. In a study published in 2005, it was estimated that the implementation of a CPOE system could cost between $1.3 million and $4.4 million [80]. Another financial barrier is that reducing the number of medical imaging examinations could lead to lower profits for private-for-profit healthcare centers, whose revenues primarily depend on fees for services [15]. Other barriers include the time required to use the system [15], the changes in workflow [78,81], the need for training for healthcare professionals [79,82], and the complexity of the system [11,79,83].
Table 2. Summary of CPOE adoption barriers.
CPOE: computerized physician order entry
Barrier | Detail |
Cost | The start-up cost of a CPOE system could be a significant obstacle |
Time | CPOE may require physicians to spend substantial time away from their patients |
Changes in workflow | Changes in workflow and increased workload can be a barrier to CPOE adoption |
Training | Training may be required for healthcare providers to effectively use the CPOE system |
Complexity | The complexity of the CPOE system could be a barrier to its implementation |
Practical Recommendations for Implementing CPOE With CDS in Radiologic Services
Based on the findings of this review, several practical recommendations can be made for healthcare organizations considering the implementation of CPOE with CDS in radiologic services. First, institutions should prioritize user training and ongoing support to reduce the learning curve and enhance adoption rates. Second, customizing CDS alerts to minimize alert fatigue and increase relevance can significantly improve user engagement and effectiveness. Lastly, organizations should consider the initial and ongoing costs of implementing these systems and explore funding options or phased implementations to manage financial constraints. These steps can help maximize the benefits of CPOE with CDS while mitigating the challenges identified in this review.
Limitations of This Review
While this review provides a comprehensive analysis of the impact of CPOE with CDS on radiologic services, several limitations must be acknowledged. First, the review was limited to studies published in English, which may exclude relevant research in other languages. Second, the variation in study designs and populations among the included studies makes it challenging to generalize the findings across all healthcare settings. Lastly, the rapidly evolving nature of CPOE and CDS technologies means that some of the findings may not fully capture the latest advancements in this field. Future research should aim to address these limitations by including a broader range of studies and considering the latest technological developments.
Conclusions
Even with all the advancements in radiologic medical imaging, certain issues still persist. Medical imaging errors, unnecessary exposure to radiation, and adverse reactions to contrast agents are some of the problems that can occur in radiologic services. The studies included in this review suggest that CPOE with CDS can have a significant impact on the services provided in radiologic medical imaging. Through a CPOE system with CDS, healthcare providers could deliver optimal care, reduce issues in medical imaging, and lower healthcare expenses.
On the other hand, CPOE with CDS also has its challenges, such as the overriding of CDS alerts by healthcare providers, which could result in serious consequences. These problems can be eliminated by designing effective CDS alerts that are reliable, accurate, and actionable. Barriers to the adoption of the CPOE system with CDS for radiologic services need to be thoroughly studied to ensure successful implementation of the system.
This review highlights the transformative potential of CPOE with CDS in enhancing the quality and safety of radiologic services. However, several areas require further investigation to fully realize this potential. Future research should focus on evaluating the system's effectiveness in real-world clinical settings, where variables such as workflow integration, user adoption, and patient outcomes can be more accurately assessed. Additionally, more studies are needed to develop and test strategies to mitigate the challenges identified in this review, including high implementation costs, alert fatigue, and the need for user-friendly interface designs. Research should also explore the long-term impact of CPOE with CDS on patient safety, particularly in preventing adverse reactions to contrast media. Addressing these gaps will be crucial for optimizing the use of CPOE with CDS in radiologic services and ensuring its broader adoption in healthcare systems.
Acknowledgments
The author extends his appreciation to the College of Applied Medical Sciences Research Center and the Deanship of Scientific Research at King Saud University for supporting this work.
Disclosures
Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following:
Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work.
Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work.
Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.
Author Contributions
Concept and design: Mansour Almanaa
Acquisition, analysis, or interpretation of data: Mansour Almanaa
Drafting of the manuscript: Mansour Almanaa
Critical review of the manuscript for important intellectual content: Mansour Almanaa
References
- 1.The impact of computerized provider order entry systems on medical-imaging services: a systematic review. Georgiou A, Prgomet M, Markewycz A, Adams E, Westbrook JI. J Am Med Inform Assoc. 2011;18:335–340. doi: 10.1136/amiajnl-2010-000043. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Munro L. Malta: World Health Organization; 2004. Basics of radiation protection for everyday use: how to achieve ALARA: working tips and guidelines. [Google Scholar]
- 3.Applying the universal protocol to improve patient safety in radiology. https://patientsafety.pa.gov/ADVISORIES/documents/201106_63.pdf Pa Patient Saf Advis. 2011;8:63–70. [Google Scholar]
- 4.Radiologic and nuclear medicine studies in the United States and worldwide: frequency, radiation dose, and comparison with other radiation sources--1950-2007. Mettler FA Jr, Bhargavan M, Faulkner K, et al. Radiology. 2009;253:520–531. doi: 10.1148/radiol.2532082010. [DOI] [PubMed] [Google Scholar]
- 5.Improving safety and eliminating redundant tests: cutting costs in U.S. hospitals. Jha AK, Chan DC, Ridgway AB, Franz C, Bates DW. Health Aff (Millwood) 2009;28:1475–1484. doi: 10.1377/hlthaff.28.5.1475. [DOI] [PubMed] [Google Scholar]
- 6.Survey of radiologists' knowledge regarding the management of severe contrast material-induced allergic reactions. Lightfoot CB, Abraham RJ, Mammen T, Abdolell M, Kapur S, Abraham RJ. Radiology. 2009;251:691–696. doi: 10.1148/radiol.2513081651. [DOI] [PubMed] [Google Scholar]
- 7.The effects on clinician ordering patterns of a computerized decision support system for neuroradiology imaging studies. Sanders DL, Miller RA. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2243405/pdf/procamiasymp00002-0622.pdf. Proc AMIA Symp. 2001:583–587. [PMC free article] [PubMed] [Google Scholar]
- 8.Assessment of radiological referral practice and effect of computer-based guidelines on radiological requests in two emergency departments. Carton M, Auvert B, Guerini H, et al. Clin Radiol. 2002;57:123–128. doi: 10.1053/crad.2001.0827. [DOI] [PubMed] [Google Scholar]
- 9.A utilization management intervention to reduce unnecessary testing in the coronary care unit. Wang TJ, Mort EA, Nordberg P, et al. Arch Intern Med. 2002;162:1885–1890. doi: 10.1001/archinte.162.16.1885. [DOI] [PubMed] [Google Scholar]
- 10.Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis. Sistrom CL, Dang PA, Weilburg JB, Dreyer KJ, Rosenthal DI, Thrall JH. Radiology. 2009;251:147–155. doi: 10.1148/radiol.2511081174. [DOI] [PubMed] [Google Scholar]
- 11.Meaningful use of computerized prescriber order entry. Classen D, Bates DW, Denham CR. J Patient Saf. 2010;6:15–23. doi: 10.1097/PTS.0b013e3181d108db. [DOI] [PubMed] [Google Scholar]
- 12.Increasing the appropriateness of outpatient imaging: effects of a barrier to ordering low-yield examinations. Vartanians VM, Sistrom CL, Weilburg JB, Rosenthal DI, Thrall JH. Radiology. 2010;255:842–849. doi: 10.1148/radiol.10091228. [DOI] [PubMed] [Google Scholar]
- 13.Electronic decision support for diagnostic imaging in a primary care setting. Curry L, Reed MH. J Am Med Inform Assoc. 2011;18:267–270. doi: 10.1136/amiajnl-2011-000049. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Standard practices for computerized clinical decision support in community hospitals: a national survey. Ash JS, McCormack JL, Sittig DF, Wright A, McMullen C, Bates DW. J Am Med Inform Assoc. 2012;19:980–987. doi: 10.1136/amiajnl-2011-000705. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Clinical decision support systems for utilization of CT in the emergency department. Ip IK, Drescher FS. https://www.proquest.com/openview/013539055072681ef971a200453a5b2c/1?pq-origsite=gscholar&cbl=135347 Imaging Med. 2012;4:605–611. [Google Scholar]
- 16.Effect of computerized clinical decision support on the use and yield of CT pulmonary angiography in the emergency department. Raja AS, Ip IK, Prevedello LM, et al. Radiology. 2012;262:468–474. doi: 10.1148/radiol.11110951. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.The effect of computerized provider order entry systems on clinical care and work processes in emergency departments: a systematic review of the quantitative literature. Georgiou A, Prgomet M, Paoloni R, Creswick N, Hordern A, Walter S, Westbrook J. Ann Emerg Med. 2013;61:644–653. doi: 10.1016/j.annemergmed.2013.01.028. [DOI] [PubMed] [Google Scholar]
- 18.Journal club: requiring clinical justification to override repeat imaging decision support: impact on CT use. O'Connor SD, Sodickson AD, Ip IK, Raja AS, Healey MJ, Schneider LI, Khorasani R. AJR Am J Roentgenol. 2014;203:482–490. doi: 10.2214/AJR.14.13017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Radiology reporting: a closed-loop cycle from order entry to results communication. Weiss DL, Kim W, Branstetter BF 4th, Prevedello LM. J Am Coll Radiol. 2014;11:1226–1237. doi: 10.1016/j.jacr.2014.09.009. [DOI] [PubMed] [Google Scholar]
- 20.Impact of clinical decision support on head computed tomography use in patients with mild traumatic brain injury in the ED. Ip IK, Raja AS, Gupta A, Andruchow J, Sodickson A, Khorasani R. Am J Emerg Med. 2015;33:320–325. doi: 10.1016/j.ajem.2014.11.005. [DOI] [PubMed] [Google Scholar]
- 21.Prisma extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Tricco AC, Lillie E, Zarin W, et al. Ann Intern Med. 2018;169:467–473. doi: 10.7326/M18-0850. [DOI] [PubMed] [Google Scholar]
- 22.Radiology order decision support: examination-indication appropriateness assessed using 2 electronic systems. Schneider E, Zelenka S, Grooff P, Alexa D, Bullen J, Obuchowski NA. J Am Coll Radiol. 2015;12:349–357. doi: 10.1016/j.jacr.2014.12.005. [DOI] [PubMed] [Google Scholar]
- 23.Provider feedback about imaging appropriateness by using scores from order entry decision support: raw rates misclassify outliers. Sistrom CL, Weilburg JB, Dreyer KJ, Ferris TG. Radiology. 2015;275:469–479. doi: 10.1148/radiol.14141092. [DOI] [PubMed] [Google Scholar]
- 24.Integrity of clinical information in computerized order requisitions for diagnostic imaging. Lacson R, Laroya R, Wang A, et al. J Am Med Inform Assoc. 2018;25:1651–1656. doi: 10.1093/jamia/ocy133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Can emergency department provider notes help to achieve more dynamic clinical decision support? Rousseau JF, Ip IK, Raja AS, Schuur JD, Khorasani R. J Am Coll Emerg Physicians Open. 2020;1:1269–1277. doi: 10.1002/emp2.12232. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.A systematic analysis of the optimization of computerized physician order entry and clinical decision support systems: a qualitative study in English hospitals. Wiegel V, King A, Mozaffar H, Cresswell K, Williams R, Sheik A. Health Informatics J. 2020;26:1118–1132. doi: 10.1177/1460458219868650. [DOI] [PubMed] [Google Scholar]
- 27.Evaluation criteria for the effects of decision support integrated into computerized provider order entry system: a scoping review. Karajizadeh M, Zand F, Vazin A, Nasiri M, Sarikhani Y, Sharifian R. Shiraz E-Med J. 2022;23:120195. [Google Scholar]
- 28.Analytics to monitor local impact of the Protecting Access to Medicare Act's imaging clinical decision support requirements. Valtchinov VI, Murphy SN, Lacson R, et al. J Am Med Inform Assoc. 2022;29:1870–1878. doi: 10.1093/jamia/ocac132. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Medical imaging decision and support (MIDAS): study protocol for a multi-centre cluster randomized trial evaluating the ESR iGuide. Dijk SW, Kroencke T, Wollny C, et al. Contemp Clin Trials. 2023;135:107384. doi: 10.1016/j.cct.2023.107384. [DOI] [PubMed] [Google Scholar]
- 30.Appropriateness of imaging examinations: current state and future approaches. Dehn T, O'Connell B, Hall R, Moulton T. Imaging Econ. 2000;13:18–26. [Google Scholar]
- 31.Medical effects and risks of exposure to ionising radiation. Mettler FA. J Radiol Prot. 2012;32:9–13. doi: 10.1088/0952-4746/32/1/N9. [DOI] [PubMed] [Google Scholar]
- 32.Risk of cancer after low doses of ionising radiation: retrospective cohort study in 15 countries. Cardis E, Vrijheid M, Blettner M, et al. BMJ. 2005;331:77. doi: 10.1136/bmj.38499.599861.E0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Projected cancer risks from computed tomographic scans performed in the United States in 2007. Berrington de González A, Mahesh M, Kim KP, Bhargavan M, Lewis R, Mettler F, Land C. Arch Intern Med. 2009;169:2071–2077. doi: 10.1001/archinternmed.2009.440. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Radiation exposure from CT scans in childhood and subsequent risk of leukaemia and brain tumours: a retrospective cohort study. Pearce MS, Salotti JA, Little MP, et al. Lancet. 2012;380:499–505. doi: 10.1016/S0140-6736(12)60815-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.The new era of medical imaging--progress and pitfalls. Iglehart JK. N Engl J Med. 2006;354:2822–2828. doi: 10.1056/NEJMhpr061219. [DOI] [PubMed] [Google Scholar]
- 36.Side effects of radiographic contrast media: pathogenesis, risk factors, and prevention. Andreucci M, Solomon R, Tasanarong A. Biomed Res Int. 2014;2014:741018. doi: 10.1155/2014/741018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Anaphylactoid and adverse reactions to radiocontrast agents. Hagan JB. Immunol Allergy Clin North Am. 2004;24:507-19, vii-viii. doi: 10.1016/j.iac.2004.03.005. [DOI] [PubMed] [Google Scholar]
- 38.Dixon BE, Zafar A. Inpatient Computerized Provider Order Entry (CPOE): Findings from the AHRQ Portfolio (Prepared by the AHRQ National Resource Center for Health IT under Contract No. 290-04-0016). AHRQ Publication No. 09-0031-EF. Rockville, MD: Agency for Healthcare Research and Quality; [ Dec; 2023 ]. 2009. Inpatient computerized provider order entry (CPOE): findings from the AHRQ portfolio. [Google Scholar]
- 39.Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. Garg AX, Adhikari NK, McDonald H, et al. JAMA. 2005;293:1223–1238. doi: 10.1001/jama.293.10.1223. [DOI] [PubMed] [Google Scholar]
- 40.Derivation of a decision rule for the use of radiography in acute knee injuries. Stiell IG, Greenberg GH, Wells GA, et al. Ann Emerg Med. 1995;26:405–413. doi: 10.1016/s0196-0644(95)70106-0. [DOI] [PubMed] [Google Scholar]
- 41.A study to develop clinical decision rules for the use of radiography in acute ankle injuries. Stiell IG, Greenberg GH, McKnight RD, Nair RC, McDowell I, Worthington JR. Ann Emerg Med. 1992;21:384–390. doi: 10.1016/s0196-0644(05)82656-3. [DOI] [PubMed] [Google Scholar]
- 42.Imaging pathways: will they be well trodden or less traveled? Mendelson RM, Bairstow PJ. J Am Coll Radiol. 2009;6:160–166. doi: 10.1016/j.jacr.2008.09.006. [DOI] [PubMed] [Google Scholar]
- 43.Impact of clinical decision rules on clinical care of traumatic injuries to the foot and ankle, knee, cervical spine, and head. Perry JJ, Stiell IG. Injury. 2006;37:1157–1165. doi: 10.1016/j.injury.2006.07.028. [DOI] [PubMed] [Google Scholar]
- 44.Implementation of the Canadian C-Spine Rule: prospective 12 centre cluster randomised trial. Stiell IG, Clement CM, Grimshaw J, et al. BMJ. 2009;339:4146. doi: 10.1136/bmj.b4146. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Minor head injury: CT-based strategies for management--a cost-effectiveness analysis. Smits M, Dippel DW, Nederkoorn PJ, et al. Radiology. 2010;254:532–540. doi: 10.1148/radiol.2541081672. [DOI] [PubMed] [Google Scholar]
- 46.Reducing inappropriate diagnostic practice through education and decision support. Bairstow PJ, Persaud J, Mendelson R, Nguyen L. Int J Qual Health Care. 2010;22:194–200. doi: 10.1093/intqhc/mzq016. [DOI] [PubMed] [Google Scholar]
- 47.We Are Giving Ourselves Cancer. Redberg R, Smith-Bindman R. http://sapheneia.com/wp-content/uploads/2014/10/2014-01-30-We-are-giving-ourselves-cancer-NYT.pdf New York Times. 2014;30:0. [Google Scholar]
- 48.Effectiveness and acceptability of a computerized decision support system using modified Wells criteria for evaluation of suspected pulmonary embolism. Drescher FS, Chandrika S, Weir ID, et al. Ann Emerg Med. 2011;57:613–621. doi: 10.1016/j.annemergmed.2010.09.018. [DOI] [PubMed] [Google Scholar]
- 49.Safe use of contrast media: what the radiologist needs to know. Beckett KR, Moriarity AK, Langer JM. Radiographics. 2015;35:1738–1750. doi: 10.1148/rg.2015150033. [DOI] [PubMed] [Google Scholar]
- 50.CPOE and clinical decision support in hospitals: getting the benefits: comment on "Unintended effects of a computerized physician order entry nearly hard-stop alert to prevent a drug interaction". Bates DW. Arch Intern Med. 2010;170:1583–1584. doi: 10.1001/archinternmed.2010.325. [DOI] [PubMed] [Google Scholar]
- 51.Journal club: Structured feedback from patients on actual radiology reports: a novel approach to improve reporting practices. Gunn AJ, Gilcrease-Garcia B, Mangano MD, Sahani DV, Boland GW, Choy G. AJR Am J Roentgenol. 2017;208:1262–1270. doi: 10.2214/AJR.16.17584. [DOI] [PubMed] [Google Scholar]
- 52.Quality and safety in health care, part IX: computerized provider order entry. Harolds JA, Harolds LB. Clin Nucl Med. 2016;41:310–312. doi: 10.1097/RLU.0000000000001135. [DOI] [PubMed] [Google Scholar]
- 53.Notifications received by primary care practitioners in electronic health records: a taxonomy and time analysis. Murphy DR, Reis B, Sittig DF, Singh H. Am J Med. 2012;125:209–207. doi: 10.1016/j.amjmed.2011.07.029. [DOI] [PubMed] [Google Scholar]
- 54.Changes in performance after implementation of a multifaceted electronic-health-record-based quality improvement system. Persell SD, Kaiser D, Dolan NC, et al. Med Care. 2011;49:117–125. doi: 10.1097/MLR.0b013e318202913d. [DOI] [PubMed] [Google Scholar]
- 55.Understanding handling of drug safety alerts: a simulation study. van der Sijs H, van Gelder T, Vulto A, Berg M, Aarts J. Int J Med Inform. 2010;79:361–369. doi: 10.1016/j.ijmedinf.2010.01.008. [DOI] [PubMed] [Google Scholar]
- 56.Unintended effects of a computerized physician order entry nearly hard-stop alert to prevent a drug interaction: a randomized controlled trial. Strom BL, Schinnar R, Aberra F, Bilker W, Hennessy S, Leonard CE, Pifer E. Arch Intern Med. 2010;170:1578–1583. doi: 10.1001/archinternmed.2010.324. [DOI] [PubMed] [Google Scholar]
- 57.Prescribers' interactions with medication alerts at the point of prescribing: a multi-method, in situ investigation of the human-computer interaction. Russ AL, Zillich AJ, McManus MS, Doebbeling BN, Saleem JJ. Int J Med Inform. 2012;81:232–243. doi: 10.1016/j.ijmedinf.2012.01.002. [DOI] [PubMed] [Google Scholar]
- 58.Clinical decision support systems could be modified to reduce 'alert fatigue' while still minimizing the risk of litigation. Kesselheim AS, Cresswell K, Phansalkar S, Bates DW, Sheikh A. Health Aff (Millwood) 2011;30:2310–2317. doi: 10.1377/hlthaff.2010.1111. [DOI] [PubMed] [Google Scholar]
- 59.Evaluating alert fatigue over time to EHR-based clinical trial alerts: findings from a randomized controlled study. Embi PJ, Leonard AC. J Am Med Inform Assoc. 2012;19:145–148. doi: 10.1136/amiajnl-2011-000743. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Overriding of drug safety alerts in computerized physician order entry. van der Sijs H, Aarts J, Vulto A, Berg M. J Am Med Inform Assoc. 2006;13:138–147. doi: 10.1197/jamia.M1809. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Characteristics of clinical decision support alert overrides in an electronic prescribing system at a tertiary care paediatric hospital. Jani YH, Barber N, Wong IC. Int J Pharm Pract. 2011;19:363–366. doi: 10.1111/j.2042-7174.2011.00132.x. [DOI] [PubMed] [Google Scholar]
- 62.Improving patient safety through medical alert management: an automated decision tool to reduce alert fatigue. Lee EK, Mejia AF, Senior T, Jose J. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3041356/ AMIA Annu Symp Proc. 2010;2010:417–421. [PMC free article] [PubMed] [Google Scholar]
- 63.Turning off frequently overridden drug alerts: limited opportunities for doing it safely. van der Sijs H, Aarts J, van Gelder T, Berg M, Vulto A. J Am Med Inform Assoc. 2008;15:439–448. doi: 10.1197/jamia.M2311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Overrides of medication alerts in ambulatory care. Rosenberg SN, Sullivan M, Juster IA, Jacques J. Arch Intern Med. 2009;169:1337. doi: 10.1001/archinternmed.2009.224. [DOI] [PubMed] [Google Scholar]
- 65.Electronic health record-based decision support to improve asthma care: a cluster-randomized trial. Bell LM, Grundmeier R, Localio R, et al. Pediatrics. 2010;125:770–777. doi: 10.1542/peds.2009-1385. [DOI] [PubMed] [Google Scholar]
- 66.FluAlert: a qualitative evaluation of providers' desired characteristics and concerns regarding computerized influenza vaccination alerts. Birmingham E, Catallozzi M, Findley SE, Vawdrey DK, Kukafka R, Stockwell MS. Prev Med. 2011;52:274–277. doi: 10.1016/j.ypmed.2011.01.008. [DOI] [PubMed] [Google Scholar]
- 67.A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems. Phansalkar S, Edworthy J, Hellier E, Seger DL, Schedlbauer A, Avery AJ, Bates DW. J Am Med Inform Assoc. 2010;17:493–501. doi: 10.1136/jamia.2010.005264. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Electronic health record-based interventions for improving appropriate diagnostic imaging: a systematic review and meta-analysis. Goldzweig CL, Orshansky G, Paige NM, Miake-Lye IM, Beroes JM, Ewing BA, Shekelle PG. Ann Intern Med. 2015;162:557–565. doi: 10.7326/M14-2600. [DOI] [PubMed] [Google Scholar]
- 69.Tiering drug-drug interaction alerts by severity increases compliance rates. Paterno MD, Maviglia SM, Gorman PN, et al. J Am Med Inform Assoc. 2009;16:40–46. doi: 10.1197/jamia.M2808. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Drug safety alert generation and overriding in a large Dutch university medical centre. van der Sijs H, Mulder A, van Gelder T, Aarts J, Berg M, Vulto A. Pharmacoepidemiol Drug Saf. 2009;18:941–947. doi: 10.1002/pds.1800. [DOI] [PubMed] [Google Scholar]
- 71.The effect of a passive reminder on computed tomography utilization in the emergency department. Horng S, Reichenbach S, Nathanson L, Fischer C, Sarwar A, Sanchez L. Ann Emerg Med. 2011;58:293–294. [Google Scholar]
- 72.Improving acceptance of computerized prescribing alerts in ambulatory care. Shah NR, Seger AC, Seger DL, et al. J Am Med Inform Assoc. 2006;13:5–11. doi: 10.1197/jamia.M1868. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Taylor LK, Tamblyn R. Stud Health Technol Inform. Vol. 107. Amsterdam, Netherlands: IOS Press; 2004. Reasons for physician non-adherence to electronic drug alerts; pp. 1101–1105. [PubMed] [Google Scholar]
- 74.Medication-related clinical decision support in computerized provider order entry systems: a review. Kuperman GJ, Bobb A, Payne TH, et al. J Am Med Inform Assoc. 2007;14:29–40. doi: 10.1197/jamia.M2170. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Effect of guideline based computerised decision support on decision making of multidisciplinary teams: cluster randomised trial in cardiac rehabilitation. BMJ. 2009;338:1880. doi: 10.1136/bmj.b1440. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Summary and frequency of barriers to adoption of CPOE in the U.S. Kruse CS, Goetz K. J Med Syst. 2015;39:15. doi: 10.1007/s10916-015-0198-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Costs and benefits of health information technology: new trends from the literature. Goldzweig CL, Towfigh A, Maglione M, Shekelle PG. Health Aff (Millwood) 2009;28:282–293. doi: 10.1377/hlthaff.28.2.w282. [DOI] [PubMed] [Google Scholar]
- 78.Hospital computerized provider order entry adoption and quality: an examination of the United States. Swanson Kazley A, Diana ML. Health Care Manage Rev. 2011;36:86–94. doi: 10.1097/HMR.0b013e3181c8b1e5. [DOI] [PubMed] [Google Scholar]
- 79.Ballard DJ, Ogola G, Fleming NS, et al. Advances in patient safety: new directions and alternative approaches. Vol. 2. Rockville, MD: Agency for Healthcare Research and Quality (US); 2008. The impact of standardized order sets on quality and financial outcomes; pp. 1101–1105. [PubMed] [Google Scholar]
- 80.Implementation of hospital computerized physician order entry systems in a rural state: feasibility and financial impact. Ohsfeldt RL, Ward MM, Schneider JE, Jaana M, Miller TR, Lei Y, Wakefield DS. J Am Med Inform Assoc. 2005;12:20–27. doi: 10.1197/jamia.M1553. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Potential benefits and problems with computerized prescriber order entry: analysis of a voluntary medication error-reporting database. Zhan C, Hicks RW, Blanchette CM, Keyes MA, Cousins DD. Am J Health Syst Pharm. 2006;63:353–358. doi: 10.2146/ajhp050379. [DOI] [PubMed] [Google Scholar]
- 82.Evaluation of the impact of computerized prescriber order entry on medication use system performance at an academic medical center. Dow J, Brummond P, Cesarz J, Ludwig B, Rough S. Hosp Pharm. 2012;47:776–782. [Google Scholar]
- 83.Full implementation of computerized physician order entry and medication-related quality outcomes: a study of 3364 hospitals. Yu FB, Menachemi N, Berner ES, Allison JJ, Weissman NW, Houston TK. Am J Med Qual. 2009;24:278–286. doi: 10.1177/1062860609333626. [DOI] [PMC free article] [PubMed] [Google Scholar]