Abstract
Clinical decision support systems (CDSSs) are increasingly integrated into healthcare settings to improve patient outcomes, reduce medical errors and enhance clinical efficiency by providing clinicians with evidence-based recommendations at the point of care. However, the adoption and optimisation of these systems remain a challenge. This review aims to provide an overview of the current state of CDSS, discussing their development, implementation, benefits, limitations and future directions. We also explore the potential for enhancing their effectiveness and provide an outlook for future developments in this field. There are several challenges in CDSS implementation, including data privacy concerns, system integration and clinician acceptance. While CDSS have demonstrated significant potential, their adoption and optimisation remain a challenge.
Keywords: public health; health services; outcome assessment, health care; quality of health care; global health
Introduction
Clinical decision support systems (CDSSs) have evolved significantly over the past few decades,1 2 providing clinicians with essential tools for making informed decisions in patient care.3 CDSSs have emerged as a promising tool for improving patient outcomes and reducing healthcare costs. These systems utilise electronic health records (EHRs),4 medical knowledge databases and advanced algorithms (artificial intelligence (AI), machine learning (ML), etc) to assist clinicians in making more informed decisions by providing evidence-based5 and patient-specific recommendations at the point of care.6–8 Despite their potential benefits, there are several challenges in CDSS implementation, including data privacy concerns, system integration and clinician acceptance.9–11 While CDSS have demonstrated significant potential, their adoption and optimisation remain a challenge.
These systems leverage AI, ML and data analytics to assist clinicians in making more informed decisions by providing evidence-based recommendations at the point of care.12–15 While CDSS have demonstrated significant potential, their adoption and optimisation remain a challenge. This review discusses the current state of CDSS, ethical considerations and the opportunities for enhancing their effectiveness, exploring their benefits, limitations, and future prospects.
Current state of CDSS
History of CDSS
CDSSs have undergone significant development since their inception, evolving from rule-based expert systems to more advanced AI-driven tools.16 This overview traces the history of CDSSs, highlighting key milestones and technological advancements.17
The evolution of CDSSs has been marked by significant milestones and technological advancements, from the early rule-based expert systems to the sophisticated AI-driven tools of today.18 As CDSSs continue to evolve, they hold tremendous potential for improving patient outcomes,19 reducing healthcare costs and revolutionising the way healthcare providers make clinical decisions20 (figure 1)
Early beginnings (1950s–1960s)
The initial concept of CDSS emerged with the advent of electronic computers. In the late 1950s, Ledley and Lusted introduced the idea of using computers for medical decision-making in their paper ‘Reasoning Foundations of Medical Diagnosis’. This was a turning point that paved the way for future developments in the field.
Early expert systems (1970s–1980s)
The emergence of CDSSs can be traced back to the 1970s, when researchers began developing expert systems using AI techniques. Early examples of these systems include MYCIN, an antibiotic selection support system, and INTERNIST-1, which aimed to assist physicians in diagnosing complex medical cases. These systems were primarily rule-based, relying on knowledge encoded by medical experts in the form of ‘if-then’ rules.
Integration with EHRs (1990s–2000s)
As EHRs became more prevalent in the 1990s and 2000s, the integration of CDSSs with EHRs emerged as a priority. This integration enabled more seamless access to patient data, allowing CDSSs to provide context-specific recommendations based on individual patient information. Standards such as Health Level Seven and Clinical Document Architecture were developed during this period to facilitate data exchange between EHRs and CDSSs.
The rise of evidence-based medicine (late 1990s–2000s)
The late 1990s saw a growing emphasis on evidence-based medicine, which aimed to use the best available evidence to inform clinical decision-making.21 Evidence-based medicine (EBM) is a process of systematically reviewing, appraising, and using clinical research findings to aid the delivery of optimum clinical care to patients. This shift prompted the development of CDSSs that incorporated evidence-based guidelines and clinical practice recommendations, helping clinicians to make decisions based on the latest research findings.
Advancements in AI and ML (2010s–present)
The 2010s witnessed rapid advancements in AI and ML techniques, which have significantly impacted the development of CDSSs. By leveraging large-scale data sets and advanced algorithms, these AI-driven CDSSs can provide more personalised and accurate recommendations.22 Examples include IBM Watson Health and Google’s DeepMind, which have demonstrated the potential of AI and ML in transforming healthcare decision-making.
Mobile health and telemedicine (2010s–present)
With the widespread adoption of mobile technology and the growth of telemedicine, CDSSs have expanded beyond traditional clinical settings.23 Mobile health (mHealth) applications and remote monitoring tools have integrated CDSSs to support patients and healthcare providers outside the clinical environment, enabling more proactive and personalised care.
Development of CDSS
The evolution of CDSS, from its inception to the modern sophisticated systems we witness today, provides a rich tapestry of progress and technological integration. Diving deeper into its development, it becomes evident that the nexus between AI, ML and data analytics plays a pivotal role in this transformation.24 With the advent of robust ML algorithms, contemporary CDSSs have transcended these boundaries. These systems now possess the capability to not only process vast datasets25 but also refine their recommendations continually, ensuring that they remain relevant and actionable.
As CDSS continue to evolve, research and development efforts should focus on several key areas to maximise their potential impact on healthcare. These areas include:
Personalised medicine: CDSS can play a significant role in the growing field of personalised medicine,26 which seeks to tailor treatments to individual patients based on their unique genetic, environmental and lifestyle factors. Integrating genomic, proteomic and other -omics data into CDSS can help clinicians identify the most effective therapies for each patient, minimising adverse effects and improving treatment outcomes.
Predictive analytics: The incorporation of predictive analytics into CDSS can enable healthcare providers to anticipate potential complications and disease progression, facilitating early intervention and preventative care. Developing CDSS that can accurately predict outcomes based on historical patient data and other relevant factors will be critical in this regard.
Natural language processing (NLP): As much of the clinical data stored in electronic health records is unstructured, advancements in NLP can help unlock valuable insights from these sources. By extracting and analysing relevant information from free-text clinical notes, CDSS can provide more comprehensive and accurate recommendations to clinicians.
Real-time data integration: Integrating real-time patient data from various sources, such as wearable devices and remote monitoring systems, can enable CDSS to provide timely and actionable insights to clinicians. This data can help inform treatment decisions and enhance patient monitoring, ultimately improving patient outcomes.
Multi-modal data analysis: The analysis of multi-modal data, including medical imaging, laboratory results and patient-reported outcomes, can provide a more holistic view of a patient’s condition. CDSS that can effectively integrate and analyse data from diverse sources will be better equipped to support clinical decision-making.
Advancements in AI and ML: As AI and ML technologies continue to advance,27 CDSS will likely benefit from these developments. The integration of more advanced AI and ML techniques can enable CDSS to process and analyse large volumes of data more efficiently, improve the accuracy of their recommendations and identify previously unrecognised patterns and associations. Future research should focus on developing and evaluating novel AI and ML methodologies for CDSS and exploring their potential applications in various clinical contexts.
In summary, the future of CDSS research and development should focus on addressing current limitations, expanding the use of these systems to diverse settings and adapting to emerging technologies and data sources. By fostering collaboration among stakeholders and exploring innovative solutions, CDSS can continue to evolve and play an increasingly vital role in shaping the future of healthcare delivery.
Implementation and integration
Implementing and integrating CDSS into existing healthcare systems is a complex process that requires careful planning and execution.28–31 Here is a step-by-step guide to help you with the process:
Assess the needs and goals
Before selecting a CDSS, it is important to evaluate the specific needs and goals of your healthcare organisation.32 Identify the areas where the CDSS can have the greatest impact and determine the desired outcomes.33
Choose the appropriate CDSS
Evaluate various CDSS solutions available in the market based on their features, compatibility with existing systems, ease of use and scalability. Select a system that aligns with your organisation’s needs, goals and budget.
Assemble a multidisciplinary team
Form a team comprising clinical experts, IT professionals and administrative staff to oversee the implementation and integration process. This team should be responsible for developing a comprehensive plan, setting timelines, and ensuring that the project stays on track.
Develop a comprehensive plan
Create a detailed project plan, including timelines, milestones and success metrics. This plan should outline the steps needed for successful implementation and integration of the CDSS, such as data migration, system configuration, training, and pilot testing.
Data migration and integration
Migrate relevant patient data and integrate the CDSS with existing EHR systems,34 ensuring seamless data exchange and interoperability. This step may require collaboration with CDSS vendors and EHR providers to ensure proper integration and data security.35
System configuration and customization
Configure the CDSS to align with your organisation’s clinical workflows and preferences. Customise the system to accommodate the unique needs of your healthcare setting, such as local practice guidelines, specific diagnostic criteria, and preferred treatments.
Training and support
Provide comprehensive training to healthcare professionals who will be using the CDSS. This may include workshops, webinars and hands-on sessions. Develop a support system to address any questions or concerns that arise during the implementation process.
Pilot testing
Conduct a pilot test to evaluate the performance of the CDSS in a controlled setting. Use the feedback from the pilot test to refine the system and address any issues before full-scale implementation.
Full-Sscale implementation
Roll out the CDSS across the organisation, monitoring its performance and impact on patient care. Continuously evaluate the system’s effectiveness and make necessary adjustments to ensure that it meets the desired goals.
Continuous improvement and evaluation
Regularly assess the CDSS’s performance and gather feedback from users to identify areas for improvement. Stay up-to-date with advancements in the field and incorporate new features and updates to ensure that the system remains effective and relevant.
Beyond the aforementioned steps, integrating a CDSS requires a careful understanding of the organisational culture, including the willingness of staff to adapt to change. Recognising that each healthcare setting has its unique set of challenges, whether in terms of infrastructure, patient demographics, or prevailing practices, is pivotal.36 37
By following these steps, healthcare organisations can successfully implement and integrate a CDSS into their practice. It is also imperative to understand that integrating CDSS does not negate the significance of human intuition and judgement. In fact, the efficacy of CDSS is maximised when human expertise synergises with technology. Regular feedback loops, wherein clinicians and healthcare professionals provide insights about the system’s functionality, can be instrumental in refining CDSS.38 39
The future of CDSS will likely involve further advancements in AI40 and ML. By staying attuned to these developments and continuing to address the challenges and opportunities outlined in this article, healthcare organisations can harness the full potential of CDSS to enhance patient care and optimise healthcare delivery.
Moreover, as technology continues its rapid advancement, ensuring the CDSS remains updated is paramount. This includes software updates for improved functionality, incorporating new research findings to keep the decision-making process current and integrating with newer patient care technologies.
Benefits of CDSS (PRECISE-CARING)
A CDSS is a health information technology tool that provides doctors, nurses and other healthcare professionals with clinical decision-making support in real-time.41 CDSS can assist with diagnosis, treatment and care management by leveraging patient data, evidence-based guidelines and best practices.42 CDSS have been shown to improve patient outcomes by streamlining clinical workflows, reducing mortality rates and facilitating evidence-based decision-making. They can also enhance clinician satisfaction by providing real-time feedback and reducing cognitive burden.43 Moreover, there are numerous benefits of CDSS,44 including patient-centric care,45 46 reduced medical errors,47 enhanced decision-making,48–50 cost savings,51 increased efficiency,5 52–54 scalability,55–57 enhanced patient safety,58–60 compliance with guidelines and regulations,61 62 adaptive approaches,5 resource optimisation,63 64 interoperability and data sharing17 65 66, networked collaboration,67–69 global knowledge access and gaining foresight70–72 (PRECISE-CARING) (figure 2).
Patient-centric care: CDSS facilitates the delivery of personalised care by providing tailored treatment recommendations based on each patient’s unique circumstances and medical history.
Reduced medical errors: By providing alerts and reminders for potential medication interactions, allergies or contraindications, CDSS can help prevent medical errors and enhance patient safety.
Enhanced decision-making: CDSS can reduce cognitive overload and human error by assisting healthcare providers in analysing complex patient data, synthesising relevant information and offering tailored treatment suggestions.
Cost savings: CDSS can help healthcare providers reduce healthcare costs by identifying unnecessary tests, avoiding duplicate procedures and preventing complications that can result from medical errors. By supporting more accurate diagnoses and treatment plans, CDSS can reduce unnecessary tests and procedures, leading to decreased healthcare costs.
Increased efficiency: CDSS can reduce the time spent on manual tasks, such as searching for information or calculating dosages, by providing quick access to relevant information and automating certain processes. This can save time for healthcare providers and allow them to focus on more critical aspects of patient care.
Scalability: CDSS can be implemented across various healthcare settings, from large hospitals to small clinics, allowing healthcare providers of all sizes to benefit from improved decision-making and patient care.
Enhanced patient safety: By reducing the risk of diagnostic errors and adverse drug events, CDSS can help minimise harm to patients and improve overall safety.73 74
Compliance with guidelines and regulations: By incorporating evidence-based guidelines and regulations into the system, CDSS can help healthcare providers stay compliant with industry standards and avoid penalties.
Adaptive approaches: With CDSS, medical professionals deliver personalised care by customising treatment plans based on individual patient details and medical history.
Resource optimisation: CDSS streamlines healthcare tasks and automates certain processes, leading to more efficient resource allocation and reduced time spent on manual tasks for healthcare professionals.
Interoperability and data sharing: CDSS can facilitate communication between different healthcare systems, ensuring that providers have access to the most up-to-date patient information when making clinical decisions.
Networked collaboration: CDSS fosters better communication and cooperation among healthcare teams by centralising patient data and providing a platform for sharing insights, ultimately improving patient outcomes.
Global knowledge access and gaining foresight: CDSS serves as a valuable educational resource, connecting medical professionals to the latest research, clinical guidelines and best practices from around the world. CDSS assists in identifying patients who may be at risk for developing certain conditions, allowing for earlier interventions and potentially preventing more severe health issues in the future.75
CDSS offer a wide range of benefits that can be captured by the acronym PRECISE-CARING. By leveraging these benefits, CDSS has the potential to revolutionise healthcare practices and significantly improve patient care quality and outcomes.
PRECISE-CARING serves as a useful reminder of how CDSS can help healthcare professionals make more informed decisions, reduce errors, streamline processes and facilitate collaboration. It also emphasises the importance of adapting to changing patient needs, optimising resource allocation and fostering a continuous learning environment to ensure the most up-to-date and evidence-based care possible.
When considering the comprehensive advantages of CDSS, it is also worth noting the empowerment of patients. As healthcare transitions towards a more patient-centric model, CDSS can significantly improve patient engagement by providing them access to easy-to-understand information, allowing them to be active participants in their care journey.76
Furthermore, CDSS reduces variations in practice, ensuring that irrespective of the caregiver, patients receive consistent, high-quality care. By flagging potential deviations from best practice guidelines, CDSS ensures a standardised yet personalised approach to care.77 78 In addition, as the global health community moves towards value-based care, the role of CDSS in improving healthcare quality while reducing costs becomes more pronounced. It aids in eliminating wasteful spending, optimising resource use and ensuring each patient interaction is maximally beneficial.79 80
In summary, PRECISE-CARING highlights the key benefits and clinical significance of CDSS, underscoring the potential for these systems to revolutionise healthcare practices and enhance patient care quality and outcomes.
Evaluating the impact of CDSS
The current state of evaluating the impact of CDSSs is evolving as technology and methodologies continue to develop.81 To determine the true value of CDSS, it is crucial to conduct rigorous evaluations that measure their impact on patient outcomes,82 healthcare processes9 83 and costs. These evaluations should involve the use of appropriate research designs and methodologies, such as randomised controlled trials, observational studies and cost-effectiveness analyses. The results of these evaluations can be used to inform decision-making and identify areas for improvement in CDSS design and implementation.
As CDSS adoption increases in healthcare settings, evaluating their impact becomes more crucial for ensuring positive outcomes and optimising system performance. The evaluation process is comprehensive, involving multiple factors such as clinical effectiveness, user satisfaction, cost-effectiveness and integration with existing workflows. This requires a combination of quantitative and qualitative methods to assess the CDSS’s impact accurately.
While the existing methodologies for evaluating CDSS are robust, considering the global variances in healthcare delivery is crucial. CDSS implemented in a tertiary care hospital in an urban setting might differ significantly in its impact compared with a primary care setting in a rural environment.84 85
The evaluation of CDSS impact is an ongoing process,86 with healthcare organisations and researchers continuously monitoring system performance, gathering user feedback and making necessary improvements to ensure the system remains effective and relevant.87 While several studies have demonstrated the positive effects of CDSS on patient outcomes and clinical efficiency,88 more research is needed to assess their long-term impact.89 Future studies should examine the effects of CDSS on healthcare costs, patient satisfaction and the overall quality of care, helping to build a stronger evidence base for their implementation in practice.90
Furthermore, the onset of global pandemics, like COVID-19, underscores the importance of agility in CDSS evaluations. Such systems should be nimble enough to incorporate new findings rapidly and ensure healthcare providers are equipped with the most recent and relevant information at all times.91 92 Moreover, as patient care becomes increasingly digital, the role of cybersecurity in CDSS cannot be overstated. Evaluating the impact of CDSS should also encompass its resilience against cyber threats, ensuring patient data privacy and system functionality remain uncompromised.93 94
In summary, the current state of evaluating the impact of CDSS is characterised by an increasing focus on evidence-based methodologies, data-driven analytics, data privacy, standardisation, collaboration and continuous improvement to ensure that these systems contribute to better patient care and improved healthcare outcomes.95
Ethical considerations
The increasing use of CDSS raises a number of ethical considerations,96 including concerns related to algorithmic bias, transparency and accountability. Future research should explore ways to address these ethical challenges, such as developing transparent and explainable algorithms,97 incorporating diverse patient populations in the development process and establishing guidelines for the responsible use of CDSS in practice.
As CDSS become more prevalent, ethical considerations must be addressed. Issues such as patient privacy, data security and informed consent need to be carefully considered.98–100
In conclusion, as CDSS continue to advance and evolve, addressing the challenges in data privacy, system integration and clinician acceptance will be crucial for realising their full potential in improving patient care and reducing medical errors.
Discussion
CDSS have demonstrated significant potential to improve healthcare delivery, but their widespread adoption remains limited by several challenges.101 Overcoming these obstacles will require innovative solutions and sustained commitment from healthcare providers, developers and policymakers.102
In this review, we have highlighted the potential of CDSSs to improve patient outcomes, reduce medical errors and enhance clinical efficiency. The discussion emphasises various aspects of CDSS, including their history, development, implementation, and integration, as well as the benefits and challenges associated with their use.
While CDSS hold promise for improving patient outcomes and reducing healthcare costs, the challenges associated with their implementation cannot be ignored.103 To overcome these challenges, a comprehensive and systematic approach is required, addressing not only technical issues but also organisational and human factors.
The potential of CDSS to transform healthcare is significant, but the challenges to their adoption and optimisation are substantial. By addressing these challenges and harnessing the opportunities outlined in this article, it is possible to create more effective CDSS that improve patient outcomes and reduce healthcare costs. Future developments in this field should focus on interoperability, transparent and explainable AI, user-centred design, continuous improvement and collaboration.
Geographical disparities in CDSS implementation and adherence
An often-underemphasised aspect of CDSS implementation is the geographical disparities that influence its adoption and effectiveness. Our affiliation and insights from various landscapes allow us to delve deeper into these nuances.
Publication bias
One of the most glaring issues is the publication bias that tends to favour high-income, English-speaking countries. The majority of CDSS literature emerges from these regions, potentially overshadowing significant findings and insights from non-English speaking countries. This bias can skew our understanding of CDSS’s universal applicability and challenges. It is vital for future research to actively seek out and incorporate studies and experiences from a wider range of geographical areas to provide a more balanced global perspective.
Cultural differences
Cultural nuances play a pivotal role in the reception and reliance on CDSS. For instance, certain cultures might lean heavily on traditional medical practices, viewing CDSS recommendations with scepticism. Conversely, in some settings, there might be an over-reliance on technology, potentially overshadowing the clinician’s expertise. Understanding these cultural subtleties is critical to customise CDSS interfaces and recommendations, ensuring better alignment with regional beliefs and practices.
Training paradigms
The varied clinician training frameworks across different geographical terrains further compound these challenges. Clinicians trained in regions where protocol adherence is paramount might find it easier to trust and follow CDSS recommendations. In contrast, those from more flexible training backgrounds might exercise more clinical judgement, potentially overlooking CDSS insights. Recognising and addressing these training paradigms can better inform CDSS design and integration strategies.
In summary, while the potential of CDSS in transforming healthcare remains undeniable, it is crucial to acknowledge and address the geographical, cultural and educational nuances that influence its global adoption. As we move forward, a more inclusive approach, taking into account these factors, will be instrumental in realising the full potential of CDSS across diverse healthcare landscapes.
Challenges and future directions
Future research should focus on addressing the current limitations of CDSS, developing new approaches for system integration and exploring novel ways to enhance clinician acceptance.104 Additionally, more studies are needed to evaluate the long-term impact of CDSS on patient outcomes,105 healthcare costs and clinician satisfaction. As CDSS continue to evolve, they will likely play an increasingly vital role in shaping the future of healthcare.106
Challenges associated with CDSS implementation can be broadly categorised into technical, organisational and human factors.28 Technical challenges include data quality and interoperability, algorithm transparency and system integration. Organisational challenges encompass resistance to change, financial constraints and regulatory issues. Human factors involve user acceptance, usability, and training.
Data privacy concerns
Despite their potential benefits, CDSS face several challenges in practice, including data privacy concerns, system integration issues and clinician acceptance. Addressing these challenges requires ongoing collaboration between stakeholders and investment in CDSS development and evaluation.
Data privacy and security are crucial concerns for healthcare providers and CDSS developers.94 Ensuring that patient information remains confidential and secure is essential for building trust among clinicians and patients. Some potential solutions to address these concerns include adopting advanced encryption techniques, implementing strict access controls and adhering to relevant regulatory frameworks such as the Health Insurance Portability and Accountability Act (HIPAA).107–109
Clinician acceptance
Clinician acceptance of CDSS is crucial for their successful implementation and adoption. To enhance acceptance, CDSS should be designed with a focus on usability, relevance and non-intrusiveness. Involving end-users in the development process can help to ensure that CDSS meet the needs and preferences of clinicians, ultimately promoting their acceptance and use in practice.110
Incorporating patient preferences and values
Another important area for future CDSS research is the incorporation of patient preferences and values into the decision-making process. By integrating patient-reported outcomes and preferences, CDSS can support shared decision-making111 and enhance patient-centred care.112 This will require the development of new methodologies and techniques to elicit and incorporate patient preferences into CDSS algorithms effectively.
Expanding CDSS applications to underserved populations and settings
One of the future directions for CDSS research should involve expanding their use to underserved populations113 and settings, such as rural healthcare facilities and low-resource environments. Developing CDSS solutions that are adaptable to varying resource levels and local contexts can help to address healthcare disparities and ensure that the benefits of these systems are accessible to a broader range of patients.
System integration
Integrating CDSS into existing clinical workflows and electronic health record systems114 can be challenging, particularly in complex healthcare settings. Future research should explore innovative approaches to improve system integration,31 such as utilising standardised data formats, adopting service-oriented architectures, and employing user-centred design principles.
The successful adoption of CDSS requires a supportive ecosystem, including strong leadership, a culture of innovation and the availability of resources for training and education. Creating this environment may involve the development of policies and incentives that encourage the use of CDSS and foster collaboration among stakeholders.
Training and education
To ensure the successful adoption of CDSS in clinical practice, clinicians must be adequately trained and educated on the use of these systems. This includes understanding the capabilities and limitations of CDSS, interpreting their recommendations and integrating these recommendations into their clinical decision-making processes.3 Healthcare organisations should invest in training and educational resources for clinicians to promote the effective use of CDSS and ensure that their potential benefits are realised.
Tailoring CDSS to local contexts
One of the essential aspects of CDSS implementation is ensuring that the system is tailored to the specific needs and requirements of the local healthcare environment.115 This includes adapting the system to local clinical guidelines, workflows and preferences. Customisation of CDSS can lead to higher user acceptance and better integration with existing practices.
CAUCICETCI: multifaceted strategies for CDSS advancement
The current state of research on CDSS is vibrant and multifaceted, with ongoing efforts to address various challenges and seize opportunities to enhance its effectiveness in clinical settings.116 To enhance CDSS effectiveness, several opportunities can be explored:
Customisability: Researchers are examining the potential for customisable CDSS to address unique clinical contexts and user preferences, ultimately enhancing CDSS adoption and utility.
Addressing ethical and legal concerns (responsibility): As CDSS evolves, researchers are exploring ethical and legal issues, such as data privacy, patient consent, and liability, to ensure responsible use and widespread adoption.
User-centred design: Designing CDSS that are intuitive and easy to use, with an emphasis on reducing cognitive burden and information overload for clinicians.
Collaboration: Encouraging multi-disciplinary collaboration between healthcare professionals, software developers and data scientists to create more effective CDSS solutions.
Integration with EHRs: Researchers are working on improving the integration of CDSS with EHRs, focusing on data exchange standards, interoperability and data security. Efforts are being made to create more efficient data flows between systems and ensure real-time access to patient information.
Continuous updates and knowledge expansion: Research on knowledge management and maintenance for CDSS is ongoing, focusing on efficient ways to incorporate the latest medical research and best practices.
Evaluation and feedback mechanisms: Studies are being conducted to assess the impact of CDSS on clinical outcomes, user satisfaction and cost-effectiveness, with the goal of improving CDSS design and performance.
Transparent and explainable AI: Developing CDSS that provide not only recommendations but also explanations for their reasoning, which can help build trust and improve user acceptance.
Continuous improvement: Incorporating feedback loops and real-time performance metrics to facilitate ongoing system refinement and adaptation to changing clinical needs.
Interoperability and standardisation: Ensuring seamless integration with EHRs and other healthcare systems through standardised data formats and application programming interfaces.
By extracting the initials of each phrase and rearranging them, we can form the word ‘CAUCICETCI’ (figure 3), which is related to our topic of improving CDSS effectiveness. In conclusion, the current state of research on CDSS is vibrant and multifaceted, with ongoing efforts to address various challenges and seize opportunities to enhance its effectiveness in clinical settings.
In summary, enhancing the effectiveness of CDSSs relies on addressing key opportunities, such as seamless integration with EHRs, interoperability, leveraging AI and ML, continuous knowledge updates, user-friendly interfaces, customisability, evaluation and feedback, education and training, ethical and legal considerations, and stakeholder engagement.117 By focusing on these areas, healthcare providers can ensure that CDSS remains a valuable tool for improving clinical decision-making, optimising patient outcomes, and transforming the overall quality of care.118
Future directions
As technology continues to evolve, the potential for CDSS to advance healthcare will grow. Future developments in AI and ML can further enhance the diagnostic and predictive capabilities of CDSS.119 120 Additionally, expanding CDSS applications to underserved populations and settings can help address healthcare disparities and improve access to quality care. Collaborative efforts among healthcare providers, policymakers, researchers and industry partners are crucial to realise the full potential of CDSS in the years to come.
Conclusion
This review has provided a comprehensive overview of the current state of CDSSs, examining their development, implementation, benefits, limitations and future directions. We have discussed the challenges associated with data privacy, system integration, clinician acceptance, incorporating patient preferences, expanding CDSS applications to underserved populations and the need for training and education. Furthermore, we have explored the opportunities for enhancing CDSS effectiveness through seamless integration with EHRs, interoperability, leveraging AI and ML, continuous knowledge updates, user-friendly interfaces, customisability, and evaluation and feedback mechanisms.
In conclusion, harnessing the power of CDSS requires a multifaceted approach that addresses the barriers to implementation and optimises their effectiveness. By considering the ethical aspects, ensuring seamless integration with other healthcare IT systems, promoting clinician acceptance, focusing on continuous improvement and fostering collaboration among stakeholders, CDSS can become a powerful tool for transforming patient care and improving overall healthcare outcomes.
Acknowledgments
We would like to thank anonymous reviewers for their valuable comments and improvement suggestions that further led us to improve this paper.
Footnotes
ZC and NL contributed equally.
Contributors: ZC, YW and NS conceived and designed this review. ZC, HZ, HL and YY did the search. XZ and YC selected the studies for inclusion. ZC and NL drafted the manuscript. ZC, HZ and HL edited and approved the final version.
Funding: We thanked the China Academy of Chinese Medical Sciences Independent Selection Project (Z0830) and Institute of Basic Research in Clinical Medicine Independent Selection Project, China Academy of Chinese Medical Sciences Independent Selection Project (Z0830-1) for their support for this work.
Competing interests: None declared.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement
No data are available.
Ethics statements
Patient consent for publication
Not applicable.
Ethics approval
Not applicable.
References
- 1.Kawamoto K, Houlihan CA, Balas EA, et al. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005;330:765. 10.1136/bmj.38398.500764.8F [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Pauker SG, Kassirer JP. The threshold approach to clinical decision making. N Engl J Med 1980;302:1109–17. 10.1056/NEJM198005153022003 [DOI] [PubMed] [Google Scholar]
- 3.Kleppe A, Skrede O-J, De Raedt S, et al. A clinical decision support system optimising adjuvant chemotherapy for colorectal cancers by integrating deep learning and pathological staging markers: a development and validation study. Lancet Oncol 2022;23:1221–32. 10.1016/S1470-2045(22)00391-6 [DOI] [PubMed] [Google Scholar]
- 4.Moja L, Kwag KH, Lytras T, et al. Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis. Am J Public Health 2014;104:e12–22. 10.2105/AJPH.2014.302164 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Sim I, Gorman P, Greenes RA, et al. Clinical decision support systems for the practice of evidence-based medicine. J Am Med Inform Assoc 2001;8:527–34. 10.1136/jamia.2001.0080527 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Manning CL. Artificial intelligence could bring relevant guidelines into every consultation. BMJ 2019;366:l4788. 10.1136/bmj.l4788 [DOI] [PubMed] [Google Scholar]
- 7.Shortliffe EH, Sepúlveda MJ. Clinical decision support in the era of artificial intelligence. JAMA 2018;320:2199–200. 10.1001/jama.2018.17163 [DOI] [PubMed] [Google Scholar]
- 8.Nagendran M, Chen Y, Lovejoy CA, et al. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. BMJ 2020;368:m689. 10.1136/bmj.m689 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Kwan JL, Lo L, Ferguson J, et al. Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials. BMJ 2020;370:m3216. 10.1136/bmj.m3216 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Lu Y, Melnick ER, Krumholz HM. Clinical decision support in cardiovascular medicine. BMJ 2022;377:e059818. 10.1136/bmj-2020-059818 [DOI] [PubMed] [Google Scholar]
- 11.Sittig DF, Wright A, Osheroff JA, et al. Grand challenges in clinical decision support. J Biomed Inform 2008;41:387–92. 10.1016/j.jbi.2007.09.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Rampton V. Artificial intelligence versus clinicians. BMJ 2020;369:m1326. 10.1136/bmj.m1326 [DOI] [PubMed] [Google Scholar]
- 13.Bennett CC, Hauser K. Artificial intelligence framework for simulating clinical decision-making: a Markov decision process approach. Artif Intell Med 2013;57:9–19. 10.1016/j.artmed.2012.12.003 [DOI] [PubMed] [Google Scholar]
- 14.Hopcroft K. Artificial intelligence may not recognise the nuances of general practice. BMJ 2018;363:k5205. 10.1136/bmj.k5205 [DOI] [PubMed] [Google Scholar]
- 15.Loftus TJ, Tighe PJ, Filiberto AC, et al. Artificial intelligence and surgical decision-making. JAMA Surg 2020;155:148–58. 10.1001/jamasurg.2019.4917 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Yu K-H, Beam AL, Kohane IS. Artificial intelligence in healthcare. Nat Biomed Eng 2018;2:719–31. 10.1038/s41551-018-0305-z [DOI] [PubMed] [Google Scholar]
- 17.He J, Baxter SL, Xu J, et al. The practical implementation of artificial intelligence technologies in medicine. Nat Med 2019;25:30–6. 10.1038/s41591-018-0307-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Haug CJ, Drazen JM. Artificial intelligence and machine learning in clinical medicine. Reply. N Engl J Med 2023;388:2398–9. 10.1056/NEJMc2305287 [DOI] [PubMed] [Google Scholar]
- 19.Morrison RS, Meier DE, Arnold RM. What's wrong with advance care planning? JAMA 2021;326:1575–6. 10.1001/jama.2021.16430 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Marzorati C, Pravettoni G. Value as the key concept in the health care system: how it has influenced medical practice and clinical decision-making processes. J Multidiscip Healthc 2017;10:101–6. 10.2147/JMDH.S122383 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Bates DW, Kuperman GJ, Wang S, et al. Ten commandments for effective clinical decision support: making the practice of evidence-based medicine a reality. J Am Med Inform Assoc 2003;10:523–30. 10.1197/jamia.M1370 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Roshanov PS, Fernandes N, Wilczynski JM, et al. Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials. BMJ 2013;346:f657. 10.1136/bmj.f657 [DOI] [PubMed] [Google Scholar]
- 23.Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med 2019;25:44–56. 10.1038/s41591-018-0300-7 [DOI] [PubMed] [Google Scholar]
- 24.Choi D-J, Park JJ, Ali T, et al. Artificial intelligence for the diagnosis of heart failure. NPJ Digit Med 2020;3:54. 10.1038/s41746-020-0261-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Finlayson SG, Subbaswamy A, Singh K, et al. The clinician and dataset shift in artificial intelligence. N Engl J Med 2021;385:283–6. 10.1056/NEJMc2104626 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Collins FS, Varmus H. A new initiative on precision medicine. N Engl J Med 2015;372:793–5. 10.1056/NEJMp1500523 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Beam AL, Kohane IS. Big data and machine learning in health care. JAMA 2018;319:1317–8. 10.1001/jama.2017.18391 [DOI] [PubMed] [Google Scholar]
- 28.Shah NR, Khetpal V, Erqou S. Anticipating and addressing challenges during implementation of clinical decision support systems. JAMA Netw Open 2022;5:e2146528. 10.1001/jamanetworkopen.2021.46528 [DOI] [PubMed] [Google Scholar]
- 29.Schuh C, de Bruin JS, Seeling W. Clinical decision support systems at the Vienna general hospital using Arden syntax: design, implementation, and integration. Artif Intell Med 2018;92:24–33. 10.1016/j.artmed.2015.11.002 [DOI] [PubMed] [Google Scholar]
- 30.Ip IK, Schneider LI, Hanson R, et al. Adoption and meaningful use of computerized physician order entry with an integrated clinical decision support system for radiology: ten-year analysis in an urban teaching hospital. J Am Coll Radiol 2012;9:129–36. 10.1016/j.jacr.2011.10.010 [DOI] [PubMed] [Google Scholar]
- 31.Yao W, Kumar A. Conflexflow: integrating flexible clinical pathways into clinical decision support systems using context and rules. Decision Support Systems 2013;55:499–515. 10.1016/j.dss.2012.10.008 [DOI] [Google Scholar]
- 32.Berner ES, Lande TJ. Overview of clinical decision support systems. Clinical Decision Support Systems: Theory and Practice 2016;2016:1–17. 10.1007/978-3-319-31913-1 [DOI] [Google Scholar]
- 33.Bonney W. Impacts and risks of adopting clinical decision support systems. In: Efficient decision support systems: practice and challenges in biomedical related domain. 2011: 21–30. 10.5772/16265 [DOI] [Google Scholar]
- 34.Forrest GN, Van Schooneveld TC, Kullar R, et al. Use of electronic health records and clinical decision support systems for antimicrobial stewardship. Clin Infect Dis 2014;59 Suppl 3:S122–33. 10.1093/cid/ciu565 [DOI] [PubMed] [Google Scholar]
- 35.Wulff A, Haarbrandt B, Tute E, et al. An Interoperable clinical decision-support system for early detection of SIRS in pediatric intensive care using openEHR. Artif Intell Med 2018;89:10–23. 10.1016/j.artmed.2018.04.012 [DOI] [PubMed] [Google Scholar]
- 36.Wijnhoven F. Organizational learning for intelligence amplification adoption: lessons from a clinical decision support system adoption project. Inf Syst Front 2022;24:731–44. 10.1007/s10796-021-10206-9 [DOI] [Google Scholar]
- 37.Conway D, Mustelin J. Strategies for improving adaptation practice in developing countries. Nature Clim Change 2014;4:339–42. 10.1038/nclimate2199 [DOI] [Google Scholar]
- 38.Velickovski F, Ceccaroni L, Roca J, et al. Clinical decision support systems (CDSS) for preventive management of COPD patients. J Transl Med 2014;12 Suppl 2:S9. 10.1186/1479-5876-12-S2-S9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Zikos D, DeLellis N. CDSS-RM: a clinical decision support system reference model. BMC Med Res Methodol 2018;18:137. 10.1186/s12874-018-0587-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Nundy S, Montgomery T, Wachter RM. Promoting trust between patients and physicians in the era of artificial intelligence. JAMA 2019;322:497–8. 10.1001/jama.2018.20563 [DOI] [PubMed] [Google Scholar]
- 41.Gao S, Tibiche C, Zou J, et al. Identification and construction of combinatory cancer hallmark–based gene signature SETS to predict recurrence and chemotherapy benefit in stage II colorectal cancer. JAMA Oncol 2016;2:37–45. 10.1001/jamaoncol.2015.3413 [DOI] [PubMed] [Google Scholar]
- 42.Sutton RT, Pincock D, Baumgart DC, et al. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med 2020;3:17. 10.1038/s41746-020-0221-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Garg AX, Adhikari NKJ, McDonald H, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA 2005;293:1223–38. 10.1001/jama.293.10.1223 [DOI] [PubMed] [Google Scholar]
- 44.Lobach DF, Kawamoto K, Anstrom KJ, et al. A randomized trial of population-based clinical decision support to manage health and resource use for Medicaid beneficiaries. J Med Syst 2013;37:9922. 10.1007/s10916-012-9922-3 [DOI] [PubMed] [Google Scholar]
- 45.Ploug T, Holm S. The four dimensions of contestable AI diagnostics - a patient-centric approach to explainable AI. Artif Intell Med 2020;107:101901. 10.1016/j.artmed.2020.101901 [DOI] [PubMed] [Google Scholar]
- 46.Holbrook A, Thabane L, Keshavjee K, et al. Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial. CMAJ 2009;181:37–44. 10.1503/cmaj.081272 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.van Doormaal JE, van den Bemt PMLA, Zaal RJ, et al. The influence that electronic prescribing has on medication errors and preventable adverse drug events: an interrupted time-series study. J Am Med Inform Assoc 2009;16:816–25. 10.1197/jamia.M3099 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Purcell GP. What makes a good clinical decision support system. BMJ 2005;330:740–1. 10.1136/bmj.330.7494.740 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Bousquet J. Electronic clinical decision support system (eCDSS) in the management of asthma: from theory to practice. Eur Respir J 2019;53:1900339. 10.1183/13993003.00339-2019 [DOI] [PubMed] [Google Scholar]
- 50.Goud R, de Keizer NF, ter Riet G, et al. Effect of guideline based computerised decision support on decision making of multidisciplinary teams: cluster randomised trial in cardiac rehabilitation. BMJ 2009;338:b1440. 10.1136/bmj.b1440 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Helmons PJ, Grouls RJ, Roos AN, et al. Using a clinical decision support system to determine the quality of antimicrobial dosing in intensive care patients with renal insufficiency. Qual Saf Health Care 2010;19:22–6. 10.1136/qshc.2007.025700 [DOI] [PubMed] [Google Scholar]
- 52.Binkley CE, Green BP. Does intraoperative artificial intelligence decision support pose ethical issues JAMA Surg 2021;156:809–10. 10.1001/jamasurg.2021.2055 [DOI] [PubMed] [Google Scholar]
- 53.Vasey B, Ursprung S, Beddoe B, et al. Association of clinician diagnostic performance with machine learning-based decision support systems: A systematic review. JAMA Netw Open 2021;4:e211276. 10.1001/jamanetworkopen.2021.1276 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Oluoch T, Katana A, Kwaro D, et al. Effect of a clinical decision support system on early action on immunological treatment failure in patients with HIV in Kenya: a cluster randomised controlled trial. Lancet HIV 2016;3:e76–84. 10.1016/S2352-3018(15)00242-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Hu S. Scalable hypertension management tools in communities based on novel technologies in China. Lancet Reg Health West Pac 2022;29:100619. 10.1016/j.lanwpc.2022.100619 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Patel SA, Sharma H, Mohan S, et al. The integrated tracking, referral, and electronic decision support, and care coordination (I-TREC) program: scalable strategies for the management of hypertension and diabetes within the government healthcare system of India. BMC Health Serv Res 2020;20:1022. 10.1186/s12913-020-05851-w [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Kim KM, Yefimova M, Lin FV, et al. A home-recovery surgical care model using AI-driven measures of activities of daily living. NEJM Catal Innov Care Deliv 2022;3. 10.1056/CAT.22.0081 [DOI] [Google Scholar]
- 58.Gordon L, Grantcharov T, Rudzicz F. Explainable artificial intelligence for safe intraoperative decision support. JAMA Surg 2019;154:1064–5. 10.1001/jamasurg.2019.2821 [DOI] [PubMed] [Google Scholar]
- 59.Cresswell K, Majeed A, Bates DW, et al. Computerised decision support systems for healthcare professionals: an interpretative review. Inform Prim Care 2012;20:115–28. 10.14236/jhi.v20i2.32 [DOI] [PubMed] [Google Scholar]
- 60.Middleton B, Bloomrosen M, Dente MA, et al. Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. J Am Med Inform Assoc 2013;20:e2–8. 10.1136/amiajnl-2012-001458 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Durieux P, Nizard R, Ravaud P, et al. A clinical decision support system for prevention of venous thromboembolism: effect on physician behavior. JAMA 2000;283:2816–21. 10.1001/jama.283.21.2816 [DOI] [PubMed] [Google Scholar]
- 62.Du Y, Rafferty AR, McAuliffe FM, et al. An Explainable machine learning-based clinical decision support system for prediction of gestational diabetes mellitus. Sci Rep 2022;12:1170. 10.1038/s41598-022-05112-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Miller K, Mosby D, Capan M, et al. Interface, information, interaction: a narrative review of design and functional requirements for clinical decision support. J Am Med Inform Assoc 2018;25:585–92. 10.1093/jamia/ocx118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Newsome AS, Murray B, Smith SE, et al. Optimization of critical care pharmacy clinical services: a gap analysis approach. Am J Health Syst Pharm 2021;78:2077–85. 10.1093/ajhp/zxab237 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Lehne M, Sass J, Essenwanger A, et al. Why digital medicine depends on interoperability. NPJ Digit Med 2019;2:79. 10.1038/s41746-019-0158-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Bauer NS, Gilbert AL, Carroll AE, et al. Associations of early exposure to intimate partner violence and parental depression with subsequent mental health outcomes. JAMA Pediatr 2013;167:341–7. 10.1001/jamapediatrics.2013.780 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Malik SM, Barlow A, Johnson B. Reconceptualising health security in post-COVID-19 world. BMJ Glob Health 2021;6:e006520. 10.1136/bmjgh-2021-006520 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Prades J, Coll-Ortega C, Dal Lago L, et al. Use of information and communication technologies (Icts) in cancer multidisciplinary team meetings: an explorative study based on EU healthcare professionals. BMJ Open 2022;12:e051181. 10.1136/bmjopen-2021-051181 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Mandl KD, Lee TH. Integrating medical Informatics and health services research: the need for dual training at the clinical health systems and policy levels. J Am Med Inform Assoc 2002;9:127–32. 10.1197/jamia.m0973 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Müller L, Gangadharaiah R, Klein SC, et al. An open access medical knowledge base for community driven diagnostic decision support system development. BMC Med Inform Decis Mak 2019;19:93. 10.1186/s12911-019-0804-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Park JJH, Mogg R, Smith GE, et al. How COVID-19 has fundamentally changed clinical research in global health. Lancet Glob Health 2021;9:e711–20. 10.1016/S2214-109X(20)30542-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72.Thornicroft G, Brohan E, Rose D, et al. Global pattern of experienced and anticipated discrimination against people with schizophrenia: a cross-sectional survey. Lancet 2009;373:408–15. 10.1016/S0140-6736(08)61817-6 [DOI] [PubMed] [Google Scholar]
- 73.Greenberg M, Ridgely MS. Clinical decision support and malpractice risk. JAMA 2011;306:90–1. 10.1001/jama.2011.929 [DOI] [PubMed] [Google Scholar]
- 74.Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med 2003;163:1409. 10.1001/archinte.163.12.1409 [DOI] [PubMed] [Google Scholar]
- 75.Weng SF, Reps J, Kai J, et al. Can machine-learning improve cardiovascular risk prediction using routine clinical data. PLoS One 2017;12:e0174944. 10.1371/journal.pone.0174944 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Zhang X, Svec M, Tracy R, et al. Clinical decision support systems with team-based care on type 2 diabetes improvement for medicaid patients: a quality improvement project. Int J Med Inform 2021;158:104626. 10.1016/j.ijmedinf.2021.104626 [DOI] [PubMed] [Google Scholar]
- 77.Alaa AM, Moon KH, Hsu W, et al. ConfidentCare: a clinical decision support system for personalized breast cancer screening. IEEE Trans Multimedia 2016;18:1942–55. 10.1109/TMM.2016.2589160 [DOI] [Google Scholar]
- 78.Belard A, Buchman T, Forsberg J, et al. Precision diagnosis: a view of the clinical decision support systems (CDSS) landscape through the lens of critical care. J Clin Monit Comput 2017;31:261–71. 10.1007/s10877-016-9849-1 [DOI] [PubMed] [Google Scholar]
- 79.Jacob V, Thota AB, Chattopadhyay SK, et al. Cost and economic benefit of clinical decision support systems for cardiovascular disease prevention: a community guide systematic review. J Am Med Inform Assoc 2017;24:669–76. 10.1093/jamia/ocw160 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Piri S. Missing care: a framework to address the issue of frequent missing values; the case of a clinical decision support system for Parkinson’s disease. Decision Support Systems 2020;136:113339. 10.1016/j.dss.2020.113339 [DOI] [Google Scholar]
- 81.O’Connor PJ, Sperl-Hillen JM, Rush WA, et al. Impact of electronic health record clinical decision support on diabetes care: a randomized trial. Ann Fam Med 2011;9:12–21. 10.1370/afm.1196 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82.Hunt DL, Haynes RB, Hanna SE, et al. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA 1998;280:1339–46. 10.1001/jama.280.15.1339 [DOI] [PubMed] [Google Scholar]
- 83.Murdoch TB, Detsky AS. The inevitable application of big data to health care. JAMA 2013;309:1351–2. 10.1001/jama.2013.393 [DOI] [PubMed] [Google Scholar]
- 84.Pruszydlo MG, Walk-Fritz SU, Hoppe-Tichy T, et al. Development and evaluation of a computerised clinical decision support system for switching drugs at the interface between primary and tertiary care. BMC Med Inform Decis Mak 2012;12:137. 10.1186/1472-6947-12-137 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA 2002;288:1775–9. 10.1001/jama.288.14.1775 [DOI] [PubMed] [Google Scholar]
- 86.Randolph AG, Haynes RB, Wyatt JC, et al. Users' guides to the medical literature: XVIII. How to use an article evaluating the clinical impact of a computer-based clinical decision support system. JAMA 1999;282:67–74. 10.1001/jama.282.1.67 [DOI] [PubMed] [Google Scholar]
- 87.Heard KL, Hughes S, Mughal N, et al. Evaluating the impact of the ICNET® clinical decision support system for antimicrobial stewardship. Antimicrob Resist Infect Control 2019;8:1–6. 10.1186/s13756-019-0496-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Mebrahtu TF, Skyrme S, Randell R, et al. Effects of computerised clinical decision support systems (CDSS) on nursing and Allied health professional performance and patient outcomes: a systematic review of experimental and observational studies. BMJ Open 2021;11:e053886. 10.1136/bmjopen-2021-053886 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89.Jia P, Zhang L, Chen J, et al. The effects of clinical decision support systems on medication safety: an overview. PLoS One 2016;11:e0167683. 10.1371/journal.pone.0167683 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.Taheri Moghadam S, Sadoughi F, Velayati F, et al. The effects of clinical decision support system for prescribing medication on patient outcomes and physician practice performance: a systematic review and meta-analysis. BMC Med Inform Decis Mak 2021;21:98. 10.1186/s12911-020-01376-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Kanwal S, Khan F, Alamri S, et al. COVID‐Opt‐aiNet: a clinical decision support system for COVID‐19 detection. Int J Imaging Syst Technol 2022;32:444–61. 10.1002/ima.22695 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Wu G, Yang P, Xie Y, et al. Development of a clinical decision support system for severity risk prediction and triage of COVID-19 patients at hospital admission: an international multicentre study. Eur Respir J 2020;56:2001104. 10.1183/13993003.01104-2020 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Han S, Zhao S, Li Q, et al. PPM-HDA: privacy-preserving and multifunctional health data aggregation with fault tolerance. IEEE TransInformForensic Secur 2015;11:1940–55. 10.1109/TIFS.2015.2472369 [DOI] [Google Scholar]
- 94.Liu X, Lu R, Ma J, et al. Privacy-preserving patient-centric clinical decision support system on naive Bayesian classification. IEEE J Biomed Health Inform 2015;20:655–68. 10.1109/JBHI.2015.2407157 [DOI] [PubMed] [Google Scholar]
- 95.Lambin P, Zindler J, Vanneste BGL, et al. Decision support systems for personalized and participative radiation oncology. Adv Drug Deliv Rev 2017;109:131–53. 10.1016/j.addr.2016.01.006 [DOI] [PubMed] [Google Scholar]
- 96.Shreve JT, Khanani SA, Haddad TC. Artificial intelligence in oncology: current capabilities, future opportunities, and ethical considerations. Am Soc Clin Oncol Educ Book 2022;42:1–10. 10.1200/EDBK_350652 [DOI] [PubMed] [Google Scholar]
- 97.Holzinger A, Langs G, Denk H, et al. Causability and explainability of artificial intelligence in medicine. Wiley Interdiscip Rev Data Min Knowl Discov 2019;9:e1312. 10.1002/widm.1312 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Kaye J, Boddington P, de Vries J, et al. Ethical implications of the use of whole genome methods in medical research. Eur J Hum Genet 2010;18:398–403. 10.1038/ejhg.2009.191 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Howard HC, Joly Y, Avard D, et al. Informed consent in the context of pharmacogenomic research: ethical considerations. Pharmacogenomics J 2011;11:155–61. 10.1038/tpj.2011.11 [DOI] [PubMed] [Google Scholar]
- 100.Boers SN, Jongsma KR, Lucivero F, et al. SERIES: eHealth in primary care. Part 2: exploring the ethical implications of its application in primary care practice. Eur J Gen Pract 2020;26:26–32. 10.1080/13814788.2019.1678958 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Solomon DH, Rudin RS. Digital health technologies: opportunities and challenges in rheumatology. Nat Rev Rheumatol 2020;16:525–35. 10.1038/s41584-020-0461-x [DOI] [PubMed] [Google Scholar]
- 102.Pramesh CS, Badwe RA, Bhoo-Pathy N, et al. Priorities for cancer research in low-and middle-income countries: a global perspective. Nat Med 2022;28:649–57. 10.1038/s41591-022-01738-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Moja L, Polo Friz H, Capobussi M, et al. Effectiveness of a hospital-based computerized decision support system on clinician recommendations and patient outcomes: a randomized clinical trial. JAMA Netw Open 2019;2:e1917094. 10.1001/jamanetworkopen.2019.17094 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Lyman JA, Cohn WF, Bloomrosen M, et al. Clinical decision support: progress and opportunities. J Am Med Inform Assoc 2010;17:487–92. 10.1136/jamia.2010.005561 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 105.Dullabh P, Sandberg SF, Heaney-Huls K, et al. Challenges and opportunities for advancing patient-centered clinical decision support: findings from a horizon scan. J Am Med Inform Assoc 2022;29:1233–43. 10.1093/jamia/ocac059 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.Overby CL, Kohane I, Kannry JL, et al. Opportunities for Genomic clinical decision support interventions. Genet Med 2013;15:817–23. 10.1038/gim.2013.128 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 107.Kulynych J, Korn D. The new HIPAA (health insurance Portability and accountability act of 1996) medical privacy rule: help or hindrance for clinical research Circulation 2003;108:912–4. 10.1161/01.CIR.0000080642.35380.50 [DOI] [PubMed] [Google Scholar]
- 108.Bhate C, Ho CH, Brodell RT. Time to revisit the health insurance portability and accountability act (HIPAA)? Accelerated telehealth adoption during the COVID-19 pandemic. J Am Acad Dermatol 2020;83:e313–4. 10.1016/j.jaad.2020.06.989 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 109.Breese P, Burman W, Rietmeijer C, et al. The health insurance portability and accountability act and the informed consent process. Ann Intern Med 2004;141:897–8. 10.7326/0003-4819-141-11-200412070-00034 [DOI] [PubMed] [Google Scholar]
- 110.Westerbeek L, Ploegmakers KJ, de Bruijn G-J, et al. Barriers and facilitators influencing medication-related CDSS acceptance according to clinicians: a systematic review. Int J Med Inform 2021;152:104506. 10.1016/j.ijmedinf.2021.104506 [DOI] [PubMed] [Google Scholar]
- 111.Elwyn G, Durand MA, Song J, et al. A three-talk model for shared decision making: multistage consultation process. BMJ 2017;359:j4891. 10.1136/bmj.j4891 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 112.Montori VM, Brito JP, Murad MH. The optimal practice of evidence-based medicine: incorporating patient preferences in practice guidelines. JAMA 2013;310:2503–4. 10.1001/jama.2013.281422 [DOI] [PubMed] [Google Scholar]
- 113.Botts NE, Horan TA, Thoms BP. Healthatm: personal health cyberinfrastructure for underserved populations. Am J Prev Med 2011;40:S115–22. 10.1016/j.amepre.2011.01.016 [DOI] [PubMed] [Google Scholar]
- 114.Wright A, Sittig DF, Ash JS, et al. Development and evaluation of a comprehensive clinical decision support taxonomy: comparison of front-end tools in commercial and internally developed electronic health record systems. J Am Med Inform Assoc 2011;18:232–42. 10.1136/amiajnl-2011-000113 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 115.Betrán AP, Temmerman M, Kingdon C, et al. Interventions to reduce unnecessary caesarean sections in healthy women and babies. The Lancet 2018;392:1358–68. 10.1016/S0140-6736(18)31927-5 [DOI] [PubMed] [Google Scholar]
- 116.Jaspers MWM, Smeulers M, Vermeulen H, et al. Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings. J Am Med Inform Assoc 2011;18:327–34. 10.1136/amiajnl-2011-000094 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 117.Bright TJ, Wong A, Dhurjati R, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med 2012;157:29–43. 10.7326/0003-4819-157-1-201207030-00450 [DOI] [PubMed] [Google Scholar]
- 118.Hughes JH, Woo KH, Keizer RJ, et al. Clinical decision support for precision dosing: opportunities for enhanced equity and inclusion in health care. Clin Pharmacol Ther 2023;113:565–74. 10.1002/cpt.2799 [DOI] [PubMed] [Google Scholar]
- 119.Rajkomar A, Dean J, Kohane I. Machine learning in medicine. Reply. N Engl J Med 2019;380:2589–90. 10.1056/NEJMc1906060 [DOI] [PubMed] [Google Scholar]
- 120.Stead WW. Clinical implications and challenges of artificial intelligence and deep learning. JAMA 2018;320:1107–8. 10.1001/jama.2018.11029 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
No data are available.