Abstract
Computerized decision support (CDS) is the most advanced form of clinical decision support available and has evolved with innovative technologies to provide meaningful assistance to medical professionals. Critical care clinicians are in unique environments where vast amounts of data are collected on individual patients, and where expedient and accurate decisions are paramount to the delivery of quality healthcare. Many CDS tools are in use today among adult and pediatric intensive care units as diagnostic aides, safety alerts, computerized protocols, and automated recommendations for management. Some CDS use have significantly decreased adverse events and improved costs when carefully implemented and properly operated. CDS tools integrated into electronic health records are also valuable to researchers providing rapid identification of eligible patients, streamlining data-gathering and analysis, and providing cohorts for study of rare and chronic diseases through data-warehousing. Although the need for human judgment in the daily care of critically ill patients has limited the study and realization of meaningful improvements in overall patient outcomes, CDS tools continue to evolve and integrate into the daily workflow of clinicians, and will likely provide advancements over time. Through novel technologies, CDS tools have vast potential for progression and will significantly impact the field of critical care and clinical research in the future.
Keywords: Clinical decision support systems, Critical care, Computers, Computer-assisted decision making
Core tip: Computerized decision support (CDS) is increasingly utilized in both adult and pediatric critical care. Improvements in care have been shown in areas including guideline adherence and reduction of medical errors, but reports of meaningful improvements in patient outcome have been scarce to date. However, with technology improvements and widespread acceptance of tools, CDS has the potential to revolutionize critical care medicine with improved diagnosis, monitoring, risk prediction, and treatment. Improvements in multiple aspects of patient care through CDS tools can lead to better patient outcomes.
INTRODUCTION
Decision support tools have been used by the medical profession for decades and evolved with technology to become largely computer based and widely accessible to all clinicians in the form of smart phone applications, web-based search engines, online references and journal access, and bedside tools incorporated into daily clinical practice. The potential for further advancements in biomedical informatics to improve healthcare quality is vast and increasingly studied at the patient care level and in research[1]. The goal of clinical decision support is to provide current and pertinent knowledge to clinicians to aid patient care at the exact time of care delivery[2]. Computerized technology provides the tools to facilitate timely delivery of this knowledge to bedside clinicians. Computerized decision support (CDS) systems have been implemented by hospitals internationally targeting important goals including improved diagnostic accuracy, error reduction, delivery of preventative care, and better patient outcomes[3]. As the field of medicine continues to increase in complexity, these tools are likely to become further integrated into patient care, as well as provide substantial resources for clinical research.
Intensive care unit (ICU) clinicians are in unique environments where vast amounts of information are collected and displayed by computerized systems, and where expedient, accurate diagnosis and treatment may profoundly affect quality of care and patient outcomes. ICU clinicians are tasked daily to manage large volumes of data from multiple sources and incorporate this data into patient-specific decisions. Given the unique position of ICU clinicians, CDS will likely become central to delivery of critical care in the coming years. However, inter-provider decision variability, lack of universal diagnostic and therapeutic protocols for many common diagnoses, and the demand for real-time individual variation at the bedside provide challenges for CDS design in critical care. In this paper, we give an overview of CDS history in clinical medicine, discuss different types of CDS tools, review some current applications in adult and pediatric critical care, address advantages and limitations to CDS tool use, and discuss the potential of CDS for critical care in the future.
HISTORY AND OVERVIEW OF COMPUTERIZED DECISION SUPPORT
CDS is the most efficient form of decision support and is designed to improve the quality of healthcare delivery, assist nurses and physicians in clinical decision making, and reduce variation[1,2]. CDS tools have evolved over time in both content and theoretical design for many healthcare related functions commonly used today: alert, diagnosis, reminder, suggestion, interpretation, prediction, critique, and assistance[4]. The concept of computer aided diagnosis in medicine was introduced as early as by Ledley et al[5]. Warner et al[6] presented a Bayesian theory based system for diagnosing congenital heart disease relying on inputted signs and symptoms. Design of CDS tools has evolved beyond rule-based tools to contain more complex mathematical models incorporating multiple static and dynamic factors rather than just the presence or absence of a variable. Despite the many advantages of CDS tools, widespread acceptance by clinicians across healthcare disciplines remains variable.
Computerized order entry (CPOE) and electronic health records (EHR) represent forms of computer assistance used in healthcare systems worldwide. CPOE and EHR centralize information and CDS can be incorporated into these technologies. CPOE and EHR with integrated CDS enables provision of abnormal lab value and allergy alerts, antibiotic choice assistance, vaccination reminders, mortality prediction tools, compliance with protocols and care guidelines, and suggestions for therapeutic interventions at the bedside[4,7,8]. The warehousing of information in EHR and other computer databases with CDS enables research advancement as databases can be linked and analysis of previously unrecognized relationships between patients and disease states explored[9].
Bedside computer monitoring devices can also be considered a form of CDS and have evolved from display tools to alarm systems and clinical assistance tools. For example, electrocardiography machines now provide a tracing as well as an interpretation. This type of analysis, using various inputs and known associations to generate a weighted output, is known as a neural network and is commonly utilized in both waveform analysis and mortality risk assessment tools[9]. Another type of CDS tool with increasing medical use is fuzzy logic; this permits use of ambiguous and imprecise data in logic control when constructing objective outputs. Applications include mechanical ventilation control, oxygen titration, and medication administration for blood pressure regulation[9]. Belief networks, another type of CDS tool, are algorithms derived from probability trees describing relationships of variables in a system to each other. Belief networks often utilize one of three models: simulation, mathematical, or statistical[10]. Belief networks can be designed to assist clinicians in real-time clinical decision making, and such belief networks have also been used to determine prognosis following head injury[9]. Effective computer decision support tools require high data integration accuracy and quality meshed with error free logic, ease of use, and explicit communication[11].
Experience with decision support and decision making in medicine
Current examples of accepted CDS tools include mortality prediction tools, such as the acute physiology and chronic health evaluation (APACHE) and pediatric risk of mortality (PRISM) scores. These have been validated and revalidated providing accurate mortality risk prediction and are routinely employed to generate risk adjusted mortality estimates to assess ICU performance[12,13]. CDS tools used in outpatient care document improved adherence to recommended vaccine schedules and adherence to recommended asthma care[14,15]. CPOE, with integrated CDS, decreases medical errors and improves pharmacy costs over time[16-20]. CDS tools have improved care in time-sensitive disease states including septic shock[21]. Hunt et al[3] conducted a literature review on > 60 studies evaluating decision support tools to determine if these systems impacted patient care and found that CDS tools consistently enhanced performance for drug dosing and preventative care. Similarly, improvements in practitioner performance are noted in a review by Garg et al[22] with implementation of CDS systems.
Research on the effectiveness of CDS tools for more advanced clinical decisions in disciplines such as critical care are limited. Decisions rely heavily on clinical judgment and provider knowledge, and in the ICU environment, decisions are often affected by uncertainty. Clinical uncertainty among diagnoses and therapies makes conclusive decisions challenging[23]. Use of computer protocols or automated systems is still considered investigational; however, computers could assist clinicians’ decisions by providing probabilistic estimates for diagnosis, choice of therapy, and survival[10]. Additionally, little is known about physician and nurse utilization or opinions of CDS tools[1]. To accurately assess the potential impact of a CDS tool by a clinical parameter, such as patient outcome, widespread tool use and acceptance is required[11]. Currently, use of CDS remains variable across different healthcare professionals and clinical situations[1,23,24]. Furthermore, an unappreciated challenge to CDS tools is that clinical decisions often incorporate patient and provider preferences. Some might term this phenomenon “the art of medicine.” Therefore, it is not surprising that individual clinicians might resist incorporation of automated decision trees into their daily practice.
Despite advancements in the field, many pitfalls in both design and implementation of CDS tools occur and are multifactorial. In the review by Hunt et al[3] only 1 of 5 diagnostic aides showed a quantifiable benefit and in the review by Garg et al[22] only 4 of 10 diagnostic tools showed patient benefit. Diagnostic aides may be limited by variations within a diagnosis between patients and by the uncertainty of symptom variables collected from patients and inputted into systems. Also, measurement of meaningful outcomes in these studies is difficult when the intervention is designed to improve workflow and reduce barriers to guideline compliance. Other reports found no improvement or worsening in patient outcomes and costs after implementation of computerized systems[25-27]. Many reports have suggested that failure of some CDS systems is related to problems with implementation and not to content. Several studies highlighted learned lessons from failed implementation and suggested strategies for improved success. Seamless integration with existing systems and clinician workflow, limiting alarms in a system to prevent alert fatigue, and proper training before and after implementation are particularly important[1,7]. Additionally, the complex nature of human decision making adds confusion to measuring the effectiveness of CDS tools as many healthcare decisions are unstructured with high levels of uncertainty and depend on the judgment of the decision maker[1].
CURRENT APPLICATIONS OF CDS IN ADULT AND PEDIATRIC CRITICAL CARE
CDS systems in critical care continue to advance and are beginning to show improvements in care for both adult and pediatric ICU patients. A large amount of data is available for each ICU patient, and CDS tools are designed to assist the clinician in incorporating this multitude of data into patient specific therapeutic plans. Examples of CDS systems in adult critical care are provided in Table 1. Diagnostic support tools are available to assist in disease identification and also for using symptoms and patient condition on admission to predict outcome[9,28,29]. Ranson’s criteria and various APACHE models are examples that have been validated using real time data to predict mortality risk in critically ill patients[29]. Alert support tools are used to improve workflow, warn practitioners of adverse drug reactions[19,30], and to notify practitioners of potential adverse consequences of an ordered therapy, such as anticoagulation[31,32]. This type of system decreases reported patient complications from drug-drug interactions and adverse drug events in the ICU following implementation[19]. In the prospective cohort study by Bertsche et al[19], implementation of a CDS program showed significant decreases in drug-drug interactions and in adverse events related to drug-drug interactions, including prolonged QT interval and hypokalemia. Additionally, CDS improves adherence to protocols for mechanical ventilation[33-36], sepsis[21], and venous thromboembolism prevention[37-39], and can improve patient care. Such protocol use in critical care standardizes treatments of common physiologic states and is often central to quality improvement efforts in the ICU[40]. Tafelski et al[21] demonstrated significantly increased adherence to standard care protocols for sepsis following implementation of CDS, and additionally reported a significant association between mortality and adherence to those care protocols. CDS is also used to aide patient management independent of protocols by recommending suggestions for ventilator settings and weaning[41,42], antibiotic assistance[43,44], and medication dosing. Mungall et al[45] found significant improvement in achieving desired anticoagulation goals when using a CDS tool for heparin dosing following tissue plasminogen activator treatment in myocardial infarction compared to the standard nomogram. Blood glucose control is a commonly investigated area for support tools, and studies report more consistent target glucose levels and few adverse events with these tools[46-48]. CDS is also used for research in improving mortality risk estimation[29], prediction of hemodynamic instability[49-51], and in forecasting the need for therapies in the ICU, such as dialysis[52,53]. CDS tools can also reduce variability of clinical decisions during critical care research, therefore enabling replicable experimental methods and reproducible results[54].
Table 1.
Type of support tool | Example or subject |
Adult critical care | |
Diagnostic | DXplain[28] |
Mortality and length of stay prediction[9,29] | |
Alert and reminder | Ventilator induced lung injury[84] |
Blood pressure variability while on vasopressors[32] | |
Adverse drug reactions[19] | |
Drug induced thrombocytopenia[30] | |
Epidural hematoma with neuraxial anesthesia[31] | |
Protocol/procedure | Acute respiratory distress syndrome[33-35] |
Sepsis[21] | |
VTE prophylaxis and events in trauma patients[37] | |
VTE prophylaxis[38,39] | |
Tidal volume during mechanical ventilation[36] | |
Management | Ventilator fraction of inspired oxygen[41] |
Pressure support ventilation[42] | |
Antibiotic recommendation[43,44] | |
Blood glucose control[46-48] | |
Sepsis[21] | |
Heparin dosing after myocardial infarction[45] | |
Research | Mortality prediction[29] |
Prediction of fluid requirement[53] | |
Predictive alerts for hemodynamic instability[49-51] | |
Ventilator settings[76] | |
Prediction of dialysis need[52] | |
Insulin e-protocol[54,85] | |
Pediatric and neonatal critical care | |
Diagnostic | ISABEL (www.isabelhealthcare.com)[59,86] |
SimulConsult (www.simulconsult.com)[87] | |
MEDITEL pediatric diagnostic system[58] | |
Outcome prediction and severity of illness[55-57] | |
Alert and Reminder | Drug interaction[62] |
Prescription errors and adverse drug events[18,61] | |
Parenteral nutrition orders[61] | |
NICU pulse oximeter[60] | |
Protocol/Procedure | Blood transfusions[63] |
Medications[61] | |
Parenteral nutrition[64] | |
Management | Oxygen in ventilated newborns[68] |
Antibiotic recommendation[44,65] | |
Blood glucose control[69] | |
Medication information databases[88] | |
Medication dosing calculators[61] | |
Ventilator management in neonates[66,67] | |
Research | Virtual PICU (www.picu.net)[89] |
Pediatric cardiac care consortium[70] | |
Acuity scoring systems for quality improvement[56,57] | |
Ventilator settings in neonates[71] | |
Neonatal seizure detection[72] | |
Glycemic control[90] |
VTE: Venous thromboembolism; PICU: Pediatric intensive care unit; NICU: Neonatal intensive care unit.
Pediatric and neonatal ICUs are also utilizing CDS tools with increasing frequency, and specific examples are provided in Table 1. Multiple support tools are available to aide in diagnosis, classification of disease severity, and outcome prediction[55-59]. ISABEL is one such diagnostic aide that is commercially available as a stand-alone product or for integration into existing EHR systems and has shown good sensitivity for common pediatric diagnoses[59]. PRISM models and score for acute neonatal physiology (SNAP) models are validated tools for mortality risk prediction in pediatric and neonatal patients[55,56]. CDS alerts improve patient safety and are used to warn of drug interactions and adverse events and to improve the specificity of monitor alarms[18,60-62]. Kadmon et al[18] found alert CDS tools integrated with CPOE significantly decreased dosing order errors and potential adverse events in a pediatric ICU. Similarly, use of these tools reduced parenteral nutrition order errors in the neonatal ICU[61]. Similar to adult tools, CDS in pediatrics provides improved adherence to care protocols for blood transfusion, parenteral nutrition, and medication orders[61,63,64]. Adams et al[63] found a significant reduction in pediatric blood transfusions, consistent with best practice guidelines, when CDS was added to CPOE. Pediatric CDS tools also assist patient care by providing antibiotic assistance[65], medication dosing calculators[61], and ventilator management suggestions[66-68]. These management tools have improved attainment of target oxygen saturations in newborns and target blood glucose concentrations in critically ill children[68,69]. CDS tools are also used for pediatric and neonatal research on a variety of topics, including seizure detection and quality improvement[56,57,70-72].
BARRIERS TO WIDESPREAD ACCEPTANCE OF CDS IN THE ICU
CDS tools are not uniformly incorporated into critical care units. There are many barriers to widespread acceptance, including style of implementation, variability in provider preference, and perceived lack of generalizability to patient populations. Use of CDS tools is largely optional and determined by either provider preference or group consensus and a cultural shift must occur to ensure broad utilization[11]. Additionally, the formation of CDS tools through integration of independent systems, such as EHR, with probability estimates from different ICUs is complex and dependent on the quality and generalizability of the data collected[29]. Likewise, data used to create a protocol often rely on imperfect data, such as from meta-analyses, that individual clinicians may determine are not generalizable to their patients[73,74].
Even the use of simple computer protocols for care items like ventilator weaning can ignite objection from clinicians who value the importance of individual patient specific decision making. Some argue CDS tools overly standardize medicine and fail to satisfy the complex nature of ICU decision making. Proponents cite the unique processing capabilities of computer networks and the advantages of analyzing several data points simultaneously[29]. CDS tools also allow for programming models that can respond to patient specific states and data[54]. CDS tools are meant to support, not replace, clinical decisions and can expand limited human recall by presenting several data points simultaneously. The successful use of CDS tools in the ICU relies heavily on the preferences of clinicians and on the specific contexts and degree of uncertainty present for a given clinical decision[1].
Additionally, some failures with CDS tools have been noted in the literature. Han et al[27] reported an unexpected increase in mortality associated with implementation of a CPOE program with integrated CDS due to delays in medication ordering, dispensing, and administration to critically ill patients. These delays were linked to unanticipated delays in workflow with early implementation. The published failures highlight the importance of proper design, implementation, and deployment of CDS tools. Mitigation of changes to clinician workflow and widespread user acceptance are important to production of a successful CDS tool.
POTENTIAL FOR CDS IN CRITICAL CARE
Advancements in computer technology and mathematics have already led to improved technology for aides in critical care, but have the potential to enhance clinician performance and patient care even more. Bedside monitors collect vast amounts of information that are currently analyzed at discrete time periods by clinicians. Neural networks and fuzzy logic systems are two types of tools that can be integrated into these bedside alarms to provide continuous analysis and potentially identify patterns consistent with various diagnoses, such as cardiac ischemia and hypovolemia[9]. Evaluation of hemodynamic data for prediction of instability and hypotension is an ongoing area of research that could translate into bedside tools in the future[49-51].
Continuous electroencephalogram (EEG) is a commonly used critical care tool from which patients and clinicians may benefit from rapid identification of seizures or prediction of seizures before they occur. Retrospective evaluation of EEG data by various mathematical techniques has shown good detection of seizure and identification of pre-ictal states minutes to hours prior to onset of seizure activity; no prospectively evaluated models have proven effective, though new methods are being researched[75]. Fuzzy logic controllers could also be used with bedside devices to provide automatic adjustment of ventilators or dialysis machines by integration of patient specific information and programmed logic controllers[9].
CDS for mechanical ventilation in adults and children has already shown good agreement with clinician recommendations[71,76,77]. In the future, these CDS tools could provide independent control of ventilator settings based on patient specific data. CDS tools also have the potential to manage decisions regarding titration of medications or weaning of support devices, thereby freeing the clinician’s mind to direct the overall care of a patient. CDS incorporated into CPOE could also be used to decrease unnecessary testing or to enhance the proper selection of available tests, such as radiologic exams, based on patient information[78]. Incorporation of belief networks and neural networks into existing EHR could also provide tools for identifying diseases or estimating the probability a patient will develop a disease, such as sepsis or acute respiratory distress syndrome[9]. As septic shock is a disease with time-sensitive implications for outcome, use of prediction tools could alert clinicians to high risk patients that may benefit from additional or different therapies[79]. Additionally, the adoption of CDS linked into EHR systems could identify patients presenting to small facilities with time-sensitive diagnoses and disseminate ICU protocols to providers lacking in-house critical care specialists.
In addition to identification of disease for clinical support, CDS tools integrated into existing EHR or databases can rapidly identify patients for inclusion into research studies[80]. Utilization of CDS in this way has the potential to increase recruitment numbers, especially among studies with time dependent inclusion criteria. CDS can also provide automatic data capture for research studies by tracking patient information and automatically transmitting it to a central data coordination center, saving coordinator time and potentially costs[11]. This automatic capture can also be used to operate research protocols, potentially improving compliance[11]. CDS can standardize co-intervention control during multicenter prospective clinical trials. Co-interventional control improves the signal to noise ratio on pertinent clinical questions, thereby standardizing clinical experimental methods and enhancing the probability of accurate trial results[81,82]. Finally, increased use of CDS with EHR and data warehousing provides opportunities for collecting information across many institutions. This data provides cohorts for research on rare diseases or chronic diseases that could close existing gaps in medical evidence and improve care for patients[83].
CONCLUSION
Computerized decision support systems are becoming increasingly common in medicine, though barriers to widespread acceptance continue to exist. Studies have shown benefits to their use in a variety of applications, but research regarding improvement in patient outcome is limited. Studies have also shown that careful and proper implementation is crucial to the success of these systems. Critical care physicians are in unique environments where the use of CDS could play a significant role in patient safety and outcome over the coming years. CDS has the potential to provide improved care standardization, faster diagnosis and treatment, reduced medical errors, improved health care costs, and unique research opportunities that could all translate into improved patient outcomes over time. Advancements are occurring in the field of CDS and promise to improve current technologies and to yield exciting new technologies for clinicians in the future.
Footnotes
P- Reviewers: Aoyagi K, Hsu CW, Moghazy A S- Editor: Gou SX L- Editor: A E- Editor: Liu XM
References
- 1.Weber S. Clinical decision support systems and how critical care clinicians use them. J Healthc Inf Manag. 2007;21:41–52. [PubMed] [Google Scholar]
- 2.Avansino J, Leu MG. Effects of CPOE on provider cognitive workload: a randomized crossover trial. Pediatrics. 2012;130:e547–e552. doi: 10.1542/peds.2011-3408. [DOI] [PubMed] [Google Scholar]
- 3.Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA. 1998;280:1339–1346. doi: 10.1001/jama.280.15.1339. [DOI] [PubMed] [Google Scholar]
- 4.Ramnarayan P, Britto J. Paediatric clinical decision support systems. Arch Dis Child. 2002;87:361–362. doi: 10.1136/adc.87.5.361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Ledley RS, LUSTED LB. Reasoning foundations of medical diagnosis; symbolic logic, probability, and value theory aid our understanding of how physicians reason. Science. 1959;130:9–21. doi: 10.1126/science.130.3366.9. [DOI] [PubMed] [Google Scholar]
- 6.Warner HR, TORONTO AF, VEASEY LG, STEPHENSON R. A mathematical approach to medical diagnosis. Application to congenital heart disease. JAMA. 1961;177:177–183. doi: 10.1001/jama.1961.03040290005002. [DOI] [PubMed] [Google Scholar]
- 7.Mitchell JA, Gerdin U, Lindberg DA, Lovis C, Martin-Sanchez FJ, Miller RA, Shortliffe EH, Leong TY. 50 years of informatics research on decision support: what’s next. Methods Inf Med. 2011;50:525–535. doi: 10.3414/ME11-06-0004. [DOI] [PubMed] [Google Scholar]
- 8.Johnson KB, Feldman MJ. Medical informatics and pediatrics. Decision-support systems. Arch Pediatr Adolesc Med. 1995;149:1371–1380. doi: 10.1001/archpedi.1995.02170250077014. [DOI] [PubMed] [Google Scholar]
- 9.Hanson CW, Marshall BE. Artificial intelligence applications in the intensive care unit. Crit Care Med. 2001;29:427–435. doi: 10.1097/00003246-200102000-00038. [DOI] [PubMed] [Google Scholar]
- 10.Mallach EG. Understanding Decision Support Systems and Expert Systems. Chicago, IL: Irwin; 1994. [Google Scholar]
- 11.Clemmer TP. Computers in the ICU: where we started and where we are now. J Crit Care. 2004;19:201–207. doi: 10.1016/j.jcrc.2004.08.005. [DOI] [PubMed] [Google Scholar]
- 12.Keegan MT, Gajic O, Afessa B. Severity of illness scoring systems in the intensive care unit. Crit Care Med. 2011;39:163–169. doi: 10.1097/CCM.0b013e3181f96f81. [DOI] [PubMed] [Google Scholar]
- 13.Pollack MM, Ruttimann UE, Getson PR. Pediatric risk of mortality (PRISM) score. Crit Care Med. 1988;16:1110–1116. doi: 10.1097/00003246-198811000-00006. [DOI] [PubMed] [Google Scholar]
- 14.Bell LM, Grundmeier R, Localio R, Zorc J, Fiks AG, Zhang X, Stephens TB, Swietlik M, Guevara JP. Electronic health record-based decision support to improve asthma care: a cluster-randomized trial. Pediatrics. 2010;125:e770–e777. doi: 10.1542/peds.2009-1385. [DOI] [PubMed] [Google Scholar]
- 15.Zhu VJ, Grannis SJ, Tu W, Rosenman MB, Downs SM. Evaluation of a clinical decision support algorithm for patient-specific childhood immunization. Artif Intell Med. 2012;56:51–57. doi: 10.1016/j.artmed.2012.04.004. [DOI] [PubMed] [Google Scholar]
- 16.Potts AL, Barr FE, Gregory DF, Wright L, Patel NR. Computerized physician order entry and medication errors in a pediatric critical care unit. Pediatrics. 2004;113:59–63. doi: 10.1542/peds.113.1.59. [DOI] [PubMed] [Google Scholar]
- 17.Lehmann CU, Kim GR. Computerized provider order entry and patient safety. Pediatr Clin North Am. 2006;53:1169–1184. doi: 10.1016/j.pcl.2006.09.006. [DOI] [PubMed] [Google Scholar]
- 18.Kadmon G, Bron-Harlev E, Nahum E, Schiller O, Haski G, Shonfeld T. Computerized order entry with limited decision support to prevent prescription errors in a PICU. Pediatrics. 2009;124:935–940. doi: 10.1542/peds.2008-2737. [DOI] [PubMed] [Google Scholar]
- 19.Bertsche T, Pfaff J, Schiller P, Kaltschmidt J, Pruszydlo MG, Stremmel W, Walter-Sack I, Haefeli WE, Encke J. Prevention of adverse drug reactions in intensive care patients by personal intervention based on an electronic clinical decision support system. Intensive Care Med. 2010;36:665–672. doi: 10.1007/s00134-010-1778-8. [DOI] [PubMed] [Google Scholar]
- 20.Shekelle P, Morton SC, Keeler EB. Costs and Benefits of Health Information Technology. Evidence Report/Technology Assessment No. 132. (Prepared by the Southern California Evidence-based Practice Center under Contract No. 290-02-0003.) AHRQ Publication No.106-E006. Rockville, MD: Agency for Healthcare Research and Quality; 2006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Tafelski S, Nachtigall I, Deja M, Tamarkin A, Trefzer T, Halle E, Wernecke KD, Spies C. Computer-assisted decision support for changing practice in severe sepsis and septic shock. J Int Med Res. 2010;38:1605–1616. doi: 10.1177/147323001003800505. [DOI] [PubMed] [Google Scholar]
- 22.Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, Sam J, Haynes RB. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293:1223–1238. doi: 10.1001/jama.293.10.1223. [DOI] [PubMed] [Google Scholar]
- 23.Henry SB. Effect of level of patient acuity on clinical decision making of critical care nurses with varying levels of knowledge and experience. Heart Lung. 1991;20:478–485. [PubMed] [Google Scholar]
- 24.Grier MR. Information processing in nursing practice. Annu Rev Nurs Res. 1984;2:265–287. [PubMed] [Google Scholar]
- 25.Al-Dorzi HM, Tamim HM, Cherfan A, Hassan MA, Taher S, Arabi YM. Impact of computerized physician order entry (CPOE) system on the outcome of critically ill adult patients: a before-after study. BMC Med Inform Decis Mak. 2011;11:71. doi: 10.1186/1472-6947-11-71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Teufel RJ, Kazley AS, Ebeling MD, Basco WT. Hospital electronic medical record use and cost of inpatient pediatric care. Acad Pediatr. 2012;12:429–435. doi: 10.1016/j.acap.2012.06.004. [DOI] [PubMed] [Google Scholar]
- 27.Han YY, Carcillo JA, Venkataraman ST, Clark RS, Watson RS, Nguyen TC, Bayir H, Orr RA. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics. 2005;116:1506–1512. doi: 10.1542/peds.2005-1287. [DOI] [PubMed] [Google Scholar]
- 28.Berner ES, Webster GD, Shugerman AA, Jackson JR, Algina J, Baker AL, Ball EV, Cobbs CG, Dennis VW, Frenkel EP. Performance of four computer-based diagnostic systems. N Engl J Med. 1994;330:1792–1796. doi: 10.1056/NEJM199406233302506. [DOI] [PubMed] [Google Scholar]
- 29.Barnato AE, Angus DC. Value and role of intensive care unit outcome prediction models in end-of-life decision making. Crit Care Clin. 2004;20:345–362, vii-viii. doi: 10.1016/j.ccc.2004.03.002. [DOI] [PubMed] [Google Scholar]
- 30.Harinstein LM, Kane-Gill SL, Smithburger PL, Culley CM, Reddy VK, Seybert AL. Use of an abnormal laboratory value-drug combination alert to detect drug-induced thrombocytopenia in critically Ill patients. J Crit Care. 2012;27:242–249. doi: 10.1016/j.jcrc.2012.02.014. [DOI] [PubMed] [Google Scholar]
- 31.Gupta RK. Using An Electronic Clinical Decision Support System to Reduce the Risk of Epidural Hematoma. Am J Ther. 2012:Epub ahead of print. doi: 10.1097/MJT.0b013e31825a3631. [DOI] [PubMed] [Google Scholar]
- 32.Giuliano KK, Jahrsdoerfer M, Case J, Drew T, Raber G. The role of clinical decision support tools to reduce blood pressure variability in critically ill patients receiving vasopressor support. Comput Inform Nurs. 2012;30:204–209. doi: 10.1097/NCN.0b013e3182418c39. [DOI] [PubMed] [Google Scholar]
- 33.Henderson S, East TD, Morris AH, Gardner RM. Performance evaluation of computerized clinical protocols for management of arterial hypoxemia in ARDS patients. Proc 13th Annu Symp Comp Appl Med Care. Washington, DC: IEEE Computer Society Press; 1989. pp. 588–592. [Google Scholar]
- 34.McKinley BA, Moore FA, Sailors RM, Cocanour CS, Marquez A, Wright RK, Tonnesen AS, Wallace CJ, Morris AH, East TD. Computerized decision support for mechanical ventilation of trauma induced ARDS: results of a randomized clinical trial. J Trauma. 2001;50:415–424; discussion 425. doi: 10.1097/00005373-200103000-00004. [DOI] [PubMed] [Google Scholar]
- 35.East TD, Heermann LK, Bradshaw RL, Lugo A, Sailors RM, Ershler L, Wallace CJ, Morris AH, McKinley B, Marquez A, et al. Efficacy of computerized decision support for mechanical ventilation: results of a prospective multi-center randomized trial. Proc AMIA Symp. 1999:251–255. [PMC free article] [PubMed] [Google Scholar]
- 36.Eslami S, Abu-Hanna A, Schultz MJ, de Jonge E, de Keizer NF. Evaluation of consulting and critiquing decision support systems: effect on adherence to a lower tidal volume mechanical ventilation strategy. J Crit Care. 2012;27:425.e1–425.e8. doi: 10.1016/j.jcrc.2011.07.082. [DOI] [PubMed] [Google Scholar]
- 37.Haut ER, Lau BD, Kraenzlin FS, Hobson DB, Kraus PS, Carolan HT, Haider AH, Holzmueller CG, Efron DT, Pronovost PJ, et al. Improved prophylaxis and decreased rates of preventable harm with the use of a mandatory computerized clinical decision support tool for prophylaxis for venous thromboembolism in trauma. Arch Surg. 2012;147:901–907. doi: 10.1001/archsurg.2012.2024. [DOI] [PubMed] [Google Scholar]
- 38.Kucher N, Koo S, Quiroz R, Cooper JM, Paterno MD, Soukonnikov B, Goldhaber SZ. Electronic alerts to prevent venous thromboembolism among hospitalized patients. N Engl J Med. 2005;352:969–977. doi: 10.1056/NEJMoa041533. [DOI] [PubMed] [Google Scholar]
- 39.Adams P, Riggio JM, Thomson L, Brandell-Marino R, Merli G. Clinical decision support systems to improve utilization of thromboprophylaxis: a review of the literature and experience with implementation of a computerized physician order entry program. Hosp Pract (1995) 2012;40:27–39. doi: 10.3810/hp.2012.08.987. [DOI] [PubMed] [Google Scholar]
- 40.Button P. Collaboration strategies for CDS success. Health Manag Technol. 2012;33:12–13. [PubMed] [Google Scholar]
- 41.Karbing DS, Allerød C, Thorgaard P, Carius AM, Frilev L, Andreassen S, Kjaergaard S, Rees SE. Prospective evaluation of a decision support system for setting inspired oxygen in intensive care patients. J Crit Care. 2010;25:367–374. doi: 10.1016/j.jcrc.2009.12.013. [DOI] [PubMed] [Google Scholar]
- 42.Bouadma L, Lellouche F, Cabello B, Taillé S, Mancebo J, Dojat M, Brochard L. Computer-driven management of prolonged mechanical ventilation and weaning: a pilot study. Intensive Care Med. 2005;31:1446–1450. doi: 10.1007/s00134-005-2766-2. [DOI] [PubMed] [Google Scholar]
- 43.Yong MK, Buising KL, Cheng AC, Thursky KA. Improved susceptibility of Gram-negative bacteria in an intensive care unit following implementation of a computerized antibiotic decision support system. J Antimicrob Chemother. 2010;65:1062–1069. doi: 10.1093/jac/dkq058. [DOI] [PubMed] [Google Scholar]
- 44.Mullett CJ, Thomas JG, Smith CL, Sarwari AR, Khakoo RA. Computerized antimicrobial decision support: an offline evaluation of a database-driven empiric antimicrobial guidance program in hospitalized patients with a bloodstream infection. Int J Med Inform. 2004;73:455–460. doi: 10.1016/j.ijmedinf.2004.04.002. [DOI] [PubMed] [Google Scholar]
- 45.Mungall DR, Anbe D, Forrester PL, Luoma T, Genovese R, Mahan J, LeBlanc S, Penney JB. A prospective randomized comparison of the accuracy of computer-assisted versus GUSTO nomogram--directed heparin therapy. Clin Pharmacol Ther. 1994;55:591–596. doi: 10.1038/clpt.1994.73. [DOI] [PubMed] [Google Scholar]
- 46.Eslami S, de Keizer NF, Dongelmans DA, de Jonge E, Schultz MJ, Abu-Hanna A. Effects of two different levels of computerized decision support on blood glucose regulation in critically ill patients. Int J Med Inform. 2012;81:53–60. doi: 10.1016/j.ijmedinf.2011.10.004. [DOI] [PubMed] [Google Scholar]
- 47.Mann EA, Jones JA, Wolf SE, Wade CE. Computer decision support software safely improves glycemic control in the burn intensive care unit: a randomized controlled clinical study. J Burn Care Res. 2011;32:246–255. doi: 10.1097/BCR.0b013e31820aaebf. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Pielmeier U, Rousing ML, Andreassen S, Nielsen BS, Haure P. Decision support for optimized blood glucose control and nutrition in a neurotrauma intensive care unit: preliminary results of clinical advice and prediction accuracy of the Glucosafe system. J Clin Monit Comput. 2012;26:319–328. doi: 10.1007/s10877-012-9364-y. [DOI] [PubMed] [Google Scholar]
- 49.Eshelman LJ, Lee KP, Frassica JJ, Zong W, Nielsen L, Saeed M. Development and evaluation of predictive alerts for hemodynamic instability in ICU patients. AMIA Annu Symp Proc. 2008:379–383. [PMC free article] [PubMed] [Google Scholar]
- 50.Donald R, Howells T, Piper I, Chambers I, Citerio G, Enblad P, Gregson B, Kiening K, Mattern J, Nilsson P, et al. Early warning of EUSIG-defined hypotensive events using a Bayesian Artificial Neural Network. Acta Neurochir Suppl. 2012;114:39–44. doi: 10.1007/978-3-7091-0956-4_8. [DOI] [PubMed] [Google Scholar]
- 51.Lee J, Mark RG. An investigation of patterns in hemodynamic data indicative of impending hypotension in intensive care. Biomed Eng Online. 2010;9:62. doi: 10.1186/1475-925X-9-62. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Verplancke T, Van Looy S, Steurbaut K, Benoit D, De Turck F, De Moor G, Decruyenaere J. A novel time series analysis approach for prediction of dialysis in critically ill patients using echo-state networks. BMC Med Inform Decis Mak. 2010;10:4. doi: 10.1186/1472-6947-10-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Celi LA, Hinske LC, Alterovitz G, Szolovits P. An artificial intelligence tool to predict fluid requirement in the intensive care unit: a proof-of-concept study. Crit Care. 2008;12:R151. doi: 10.1186/cc7140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Morris AH, Orme J, Rocha BH, Holmen J, Clemmer T, Nelson N, Allen J, Jephson A, Sorenson D, Sward K, et al. An electronic protocol for translation of research results to clinical practice: a preliminary report. J Diabetes Sci Technol. 2008;2:802–808. doi: 10.1177/193229680800200508. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Richardson DK, Corcoran JD, Escobar GJ, Lee SK. SNAP-II and SNAPPE-II: Simplified newborn illness severity and mortality risk scores. J Pediatr. 2001;138:92–100. doi: 10.1067/mpd.2001.109608. [DOI] [PubMed] [Google Scholar]
- 56.Marcin JP, Pollack MM. Review of the acuity scoring systems for the pediatric intensive care unit and their use in quality improvement. J Intensive Care Med. 2007;22:131–140. doi: 10.1177/0885066607299492. [DOI] [PubMed] [Google Scholar]
- 57.Marcin JP, Pollack MM. Triage scoring systems, severity of illness measures, and mortality prediction models in pediatric trauma. Crit Care Med. 2002;30:S457–S467. doi: 10.1097/00003246-200211001-00011. [DOI] [PubMed] [Google Scholar]
- 58.Barness LA, Tunnessen WW, Worley WE, Simmons TL, Ringe TB. Computer-assisted diagnosis in pediatrics. Am J Dis Child. 1974;127:852–858. doi: 10.1001/archpedi.1974.02110250078011. [DOI] [PubMed] [Google Scholar]
- 59.Bavdekar SB, Pawar M. Evaluation of an Internet delivered pediatric diagnosis support system (ISABEL) in a tertiary care center in India. Indian Pediatr. 2005;42:1086–1091. [PubMed] [Google Scholar]
- 60.Bosque EM. Symbiosis of nurse and machine through fuzzy logic: improved specificity of a neonatal pulse oximeter alarm. ANS Adv Nurs Sci. 1995;18:67–75. doi: 10.1097/00012272-199512000-00008. [DOI] [PubMed] [Google Scholar]
- 61.Stultz JS, Nahata MC. Computerized clinical decision support for medication prescribing and utilization in pediatrics. J Am Med Inform Assoc. 2012;19:942–953. doi: 10.1136/amiajnl-2011-000798. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.De Giorgi I, Guignard B, Fonzo-Christe C, Bonnabry P. Evaluation of tools to prevent drug incompatibilities in paediatric and neonatal intensive care units. Pharm World Sci. 2010;32:520–529. doi: 10.1007/s11096-010-9403-z. [DOI] [PubMed] [Google Scholar]
- 63.Adams ES, Longhurst CA, Pageler N, Widen E, Franzon D, Cornfield DN. Computerized physician order entry with decision support decreases blood transfusions in children. Pediatrics. 2011;127:e1112–e1119. doi: 10.1542/peds.2010-3252. [DOI] [PubMed] [Google Scholar]
- 64.Peverini RL, Beach DS, Wan KW, Vyhmeister NR. Graphical user interface for a neonatal parenteral nutrition decision support system. Proc AMIA Symp. 2000:650–654. [PMC free article] [PubMed] [Google Scholar]
- 65.Mullett CJ, Evans RS, Christenson JC, Dean JM. Development and impact of a computerized pediatric antiinfective decision support program. Pediatrics. 2001;108:E75. doi: 10.1542/peds.108.4.e75. [DOI] [PubMed] [Google Scholar]
- 66.Carlo WA, Pacifico L, Chatburn RL, Fanaroff AA. Efficacy of computer-assisted management of respiratory failure in neonates. Pediatrics. 1986;78:139–143. [PubMed] [Google Scholar]
- 67.Arrøe M. A computerized aid in ventilating neonates. Comput Biol Med. 1991;21:15–21. doi: 10.1016/0010-4825(91)90031-4. [DOI] [PubMed] [Google Scholar]
- 68.Sun Y, Kohane I, Stark AR. Fuzzy logic assisted control of inspired oxygen in ventilated newborn infants. Proc Annu Symp Comput Appl Med Care. 1994:757–761. [PMC free article] [PubMed] [Google Scholar]
- 69.Faraon-Pogaceanu C, Banasiak KJ, Hirshberg EL, Faustino EV. Comparison of the effectiveness and safety of two insulin infusion protocols in the management of hyperglycemia in critically ill children. Pediatr Crit Care Med. 2010;11:741–749. doi: 10.1097/PCC.0b013e3181e88cfb. [DOI] [PubMed] [Google Scholar]
- 70.Pyles LA, Hills CM, Larson VE, Moller JH. Pediatric Cardiac Care Consortium: an instrument for evidence-based clinical decision support. J Cardiovasc Transl Res. 2009;2:219–224. doi: 10.1007/s12265-009-9091-z. [DOI] [PubMed] [Google Scholar]
- 71.Tehrani FT, Abbasi S. Evaluation of a computerized system for mechanical ventilation of infants. J Clin Monit Comput. 2009;23:93–104. doi: 10.1007/s10877-009-9170-3. [DOI] [PubMed] [Google Scholar]
- 72.Temko A, Thomas E, Marnane W, Lightbody G, Boylan G. EEG-based neonatal seizure detection with Support Vector Machines. Clin Neurophysiol. 2011;122:464–473. doi: 10.1016/j.clinph.2010.06.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Tobin MJ, Jubran A. Meta-analysis under the spotlight: focused on a meta-analysis of ventilator weaning. Crit Care Med. 2008;36:1–7. doi: 10.1097/01.CCM.0000297883.04634.11. [DOI] [PubMed] [Google Scholar]
- 74.Marrie TJ. Blood cultures in ambulatory patients who are discharged from emergency with community-acquired pneumonia. Can J Infect Dis. 2004;15:21–24. doi: 10.1155/2004/530645. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Binder DK, Haut SR. Toward new paradigms of seizure detection. Epilepsy Behav. 2013;26:247–252. doi: 10.1016/j.yebeh.2012.10.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Karbing DS, Allerød C, Thomsen LP, Espersen K, Thorgaard P, Andreassen S, Kjærgaard S, Rees SE. Retrospective evaluation of a decision support system for controlled mechanical ventilation. Med Biol Eng Comput. 2012;50:43–51. doi: 10.1007/s11517-011-0843-y. [DOI] [PubMed] [Google Scholar]
- 77.Jouvet PA, Payen V, Gauvin F, Emeriaud G, Lacroix J. Weaning children from mechanical ventilation with a computer-driven protocol: a pilot trial. Intensive Care Med. 2013;39:919–925. doi: 10.1007/s00134-013-2837-8. [DOI] [PubMed] [Google Scholar]
- 78.Zafar HM, Mills AM, Khorasani R, Langlotz CP. Clinical decision support for imaging in the era of the Patient Protection and Affordable Care Act. J Am Coll Radiol. 2012;9:907–918.e5. doi: 10.1016/j.jacr.2012.09.014. [DOI] [PubMed] [Google Scholar]
- 79.Herasevich V, Afessa B, Chute CG, Gajic O. Designing and testing computer based screening engine for severe sepsis/septic shock. AMIA Annu Symp Proc. 2008:966. [PubMed] [Google Scholar]
- 80.Schmickl CN, Shahjehan K, Li G, Dhokarh R, Kashyap R, Janish C, Alsara A, Jaffe AS, Hubmayr RD, Gajic O. Decision support tool for early differential diagnosis of acute lung injury and cardiogenic pulmonary edema in medical critically ill patients. Chest. 2012;141:43–50. doi: 10.1378/chest.11-1496. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Morris AH. Computerized protocols and bedside decision support. Crit Care Clin. 1999;15:523–545, vi. doi: 10.1016/s0749-0704(05)70069-5. [DOI] [PubMed] [Google Scholar]
- 82.Morris AH, East TD, Wallace CJ, Franklin M, Heerman L, Kinder T, Sailor M, Carlson D, Bradshaw R. Standardization of clinical decision making for the conduct of credible clinical research in complicated medical environments. Proc AMIA Annu Fall Symp. 1996:418–422. [PMC free article] [PubMed] [Google Scholar]
- 83.Fiks AG, Grundmeier RW, Margolis B, Bell LM, Steffes J, Massey J, Wasserman RC. Comparative effectiveness research using the electronic medical record: an emerging area of investigation in pediatric primary care. J Pediatr. 2012;160:719–724. doi: 10.1016/j.jpeds.2012.01.039. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Herasevich V, Tsapenko M, Kojicic M, Ahmed A, Kashyap R, Venkata C, Shahjehan K, Thakur SJ, Pickering BW, Zhang J, et al. Limiting ventilator-induced lung injury through individual electronic medical record surveillance. Crit Care Med. 2011;39:34–39. doi: 10.1097/CCM.0b013e3181fa4184. [DOI] [PubMed] [Google Scholar]
- 85.Thompson BT, Orme JF, Zheng H, Luckett PM, Truwit JD, Willson DF, Duncan Hite R, Brower RG, Bernard GR, Curley MA, et al. Multicenter validation of a computer-based clinical decision support tool for glucose control in adult and pediatric intensive care units. J Diabetes Sci Technol. 2008;2:357–368. doi: 10.1177/193229680800200304. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Isabel Healthcare Ltd. Isabel the diagnosis checklist. Available from: http:\\www.isabelhealthcare.com.
- 87.SimulConsult Inc. SimulConsult: A Simultaneous Consult on Your Patient’s Diagnosis. Available from: http:\\www.simulconsult.com.
- 88.Benavides S, Polen HH, Goncz CE, Clauson KA. A systematic evaluation of paediatric medicines information content in clinical decision support tools on smartphones and mobile devices. Inform Prim Care. 2011;19:39–46. doi: 10.14236/jhi.v19i1.792. [DOI] [PubMed] [Google Scholar]
- 89. Available from: http:\\www.picu.net.
- 90.Agus MS, Steil GM, Wypij D, Costello JM, Laussen PC, Langer M, Alexander JL, Scoppettuolo LA, Pigula FA, Charpie JR, et al. Tight glycemic control versus standard care after pediatric cardiac surgery. N Engl J Med. 2012;367:1208–1219. doi: 10.1056/NEJMoa1206044. [DOI] [PMC free article] [PubMed] [Google Scholar]