Abstract
Objective
Digital dashboards are used to monitor patients and improve inpatient outcomes in hospital settings. A systematic review assessed the impact of dashboards across five outcomes of hospital mortality, hospital length of stay (LOS), economic impacts, harms, and patient and carer satisfaction.
Materials and Methods
Nine databases were searched from inception to May 2024. Studies were included if they reported primary quantitative research on dashboard interventions in hospital settings, were in English, and measured effectiveness for patients, caregivers, healthcare professionals or services. Data synthesis was performed via narrative review. Risk of bias was measured using Cochrane ROBINS-I and RoB 2.
Results
We identified 5755 articles, and 70 met inclusion criteria. Of 20 findings reporting mortality (16 studies), five reported a decrease, whilst the majority (n = 15) found no significant change. LOS was reported across 43 findings (31 studies), with 28 reporting a reduction, an increase in five, and ten reporting no change. Of 21 findings (from 16 studies) reporting on harms, increases were observed in six, decreases in four, and no change in 11. Economic impacts were reported in 34 findings (31 studies), with the majority demonstrating reduced costs (n = 29), an increase in one, and no change in four. Eight findings (eight studies) reported on patient and carer satisfaction with care, with the majority (n = 6) demonstrating increased satisfaction, and two reporting no change.
Discussion
Hospital dashboards do appear associated with either no change or a reduction in mortality, reduced costs, reduced LOS, and improved patient and caregiver satisfaction with care. Association with harms was equivocal.
Conclusion
While there is evidence of potential benefits, actual impacts of hospital digital dashboard will likely be dependent on multiple local factors such as workflow integration.
Keywords: hospitals, dashboard systems, database management systems, hospital stay, hospital costs
Background and significance
Dashboards are digital summaries that integrate critical clinical information for decision makers and often take advantage of data analytic methods.1 Digital dashboards can help monitor health service quality, safety, performance and support strategic management decisions.2–5 In hospitals, dashboards have been used to monitor and control clinical quality (e.g., mortality, surgical site infection rate), clinical efficiency (e.g., length of stay, wait time), patient safety (e.g., falls, medication incidents), patient reported measures and outcomes (e.g., inpatient satisfaction), organizational effectiveness (e.g., inpatient volume, emergency department volume), and staff performance (e.g., employee turnover, employee satisfaction).6
Whilst there is substantial variation in the design and use of dashboards, they may share the following characteristics:
Data: A dashboard may integrate data from multiple sources (e.g., electronic patient records, pathology, pharmacy, imaging, or patient monitoring devices).
Analysis: A dashboard may preprocess data (e.g., remove artefacts, smooth curves), or calculate higher order variables from raw data (e.g., aggregate metrics, risk scores, or performance indicators).
Visual presentation: Dashboards may display selected subsets of data in a visual display designed to support decision-making, potentially in near real time, for example, using traffic light color schemes.
User interaction: Dashboards may display alerts, prompts or reminders triggered by events in a data set to alert human users of potentially actionable events.
Claimed benefits for dashboards include the integration of large data sets into more easily interpretable visual formats for decision making, provision of notifications when measures deviate from predefined acceptable levels, prevention of adverse events, and improvement in the coordination of care.7 Dashboard use may be hindered by anxiety about performance surveillance, information overload, and a perceived lack of control of the performance measures monitored.7 Technical limitations that may hinder effective use include poor quality or nonstandardized data and ethical concerns related to the integration of multiple data sources.7
Despite the wide use of dashboards, to our knowledge, there has been no comprehensive systematic review of clinical and economic outcomes associated with dashboard use with hospital inpatients. One smaller systematic review of quality dashboards did identify a limited number of studies (n = 16) reporting clinical outcomes,8 with a focus on how such dashboards can improve nursing practice. Other systematic reviews have focused on process outcomes,9–11 or dashboard impact on quality and performance in specific clinical settings such as nursing,7,8,12 critical care,13,14 surgery,15 and patient safety.16 A challenge with all such studies is that local clinical characteristics may not be replicated in other settings, making it harder to directly compare the impact of digital health interventions like decision support systems or dashboards.17 Further, a dashboard will be just one element of a more complex socio-technical bundle of workflows and local practices.18
Materials and methods
We conducted a systematic review of the literature to assess the impact of digital dashboards on patient, process, and financial outcomes in hospital settings. The protocol for this PRISMA19 compliant study is registered in PROSPERO (CRD42018106583).20
Data sources and searches
We searched PubMed, CINAHL, MEDLINE and Embase via Ovid, Scopus, PsycINFO, COCHRANE Library, IEEEE Xplore, Web of Science (All Databases Search), and ACM Digital Library (Table S1). An independent librarian peer-reviewed the search strategy. The search was first conducted January 11, 2019-January 14, 2019, and updated on October 22, 2019, October 21, 2020, June 28, 2022, and February 13, 2023-February 14, 2023. A final search was conducted on May 15, 2024. Backward reference searching was conducted on all included studies.
Study selection
We searched for primary quantitative research studies of digital dashboard interventions in hospitals (Table 1). In the initial two searches, two independent reviewers (CT and EC) screened titles and abstracts against inclusion criteria, and full text of included studies was retrieved. Reviewer differences were resolved through discussion. Titles, abstracts, and full text of studies retrieved in the 2020 search were screened by NH and EC in 2022, by KBC and EC in 2023, and in 2024 by KBC and AC.
Table 1.
Study eligibility.
| Inclusion criteria | |
|---|---|
| Population |
|
| Intervention of interest | Electronic dashboard interventions for clinical, management or quality decisions in a hospital setting |
| Comparator | Any comparator or control |
| Outcome measure | Intervention effectiveness measured by: Reported benefits or harms for either patients (e.g., mortality, morbidity, quality of life, harms; timing and effect measures), caregivers (e.g., satisfaction with care), healthcare professionals (e.g., user satisfaction, usability), or healthcare services (e.g., process measures, healthcare output; timing and effect measures) |
| Study design | Primary quantitative research |
| Publication date | No limit |
| Language | English |
| Exclusion criteria | |
| Population | Not human |
| Intervention of interest | Not dashboard intervention |
| Study design | Not primary quantitative research |
| Language | Not English |
Data extraction and quality assessment
A standardized data extraction form21 was used focusing on mortality, patient and caregiver satisfaction with care, length of stay, costs, and harms. Four reviewers (CT, NH, KBC, and AC) independently extracted included study details for their search, with EC resolving conflicts.
Two reviewers evaluated risk of bias using ROBINS-I22 and RoB 2,23 with studies assigned a rating of “low,” “moderate,” “serious,” or “critical” for ROBINS-I and “low,” “some concerns,” and “high” for RoB 2.
Data synthesis and analysis
Data synthesis used narrative methods as heterogeneity in intervention design, implementation, study design, and outcome measures precluded quantitative meta-analysis. Synthesis focused on intervention description, contextual factors (setting, study groups, data collection period), reported outcomes, and clinical domain.
Results
We identified 5755 articles (Figure S1). After removing duplicates (n = 1334), 4421 articles were screened by title and abstract against inclusion and exclusion criteria. Of these, 559 full-text articles remained. After excluding records that could not be retrieved and further duplicates (n = 246), 313 articles were assessed for eligibility. In total, 70 articles were included in the review. Out of these studies, 50 quasi-experimental studies were assessed for bias with ROBINS-I, five randomized studies with RoB 2, and 15 studies were excluded from assessment as they were abstracts only (n = 14) or a PhD thesis (n = 1).
Study characteristics
Of the 70 studies, 61 were quasi-experimental studies (predominantly before/after studies), six were randomized control trials, and three were observational studies, meaning there was some form of control for most studies. Of the 50 full-text studies assessed for risk of bias with ROBINS-I, one was “Critical” risk, 21 were “Serious,” and 28 were “Moderate” (Figures S3 and S4). Of the five studies assessed with RoB 2, three were rated “Some concerns” and two were rated “High” (Figures S5 and S6).
Interventions varied in design and implementation, but all aimed to monitor or improve patient outcomes through data visualization. They included dashboards to improve patient quality of care or safety (n = 21),24–44 organizational and staff performance dashboards (e.g., work efficiency) (n = 11),45–55 financial dashboards (e.g., cost-performance feedback) (n = 8),56–63 compliance dashboards (n = 7),64–70 clinical decision support system (CDSS) dashboards (n = 4),71–74 emergency department dashboards (n = 4),75–78 electronic health record (EHR)-based dashboards for monitoring or improving efficiency of Intensive Care Unit (ICU) data (n = 4),79–82 bedside computerized information systems (n = 3),83–85 dashboards for lab resource management (n = 3),86–88 antibiotic time-out dashboards (n = 2),89,90 bed management dashboards (n = 2),91,92 and a dashboard to increase patient participation (n = 1).93 Thirty-two of the dashboard interventions either leveraged data from the EHR or were embedded in an EHR system. Many dashboards provided real-time or near-time information and alerts, for example, using a traffic-light alert system.
The studies were undertaken in a variety of hospital settings: Inpatient (n = 16), ICU (n = 13), Surgery (n = 11), multiple settings (n = 10), Emergency Department (ED) (n = 4), Transfusion Services (n = 4), Hospital-wide (n = 3), Oncology (n = 2), Surgical ICU (n = 2), Pediatric ICU (n = 2), Infection Control/Prevention (n = 1), Cardiology (n = 1), and Acute care (n = 1).
The studies spanned publication years from 2003 to 2023 and were conducted in the United States (n = 50), Taiwan (n = 4), UK (n = 3), Australia (n = 2), Canada (n = 2), France (n = 1), Indonesia (n = 1), Iran (n = 1), Italy (n = 1), Korea (n = 1), Lebanon (n = 1), Netherlands (n = 1), Nigeria (n = 1), and Spain (n = 1).
Some studies reported multiple findings for one outcome due to differing clinical settings (e.g., ICU and hospital), subgroups (e.g., two treatments), and variations over time. As a result, the total number of findings for certain outcomes may exceed the number of studies reporting on that outcome.
Dashboard impact on hospital mortality
Sixteen studies24,25,28,29,35,38,55,68,70,73,77,81,83–85,90 reported on patient mortality with 20 total findings (Tables S2 and S7). Of these, five findings reported a decrease in mortality (four results were statistically significant, one did not report statistical testing).25,55,73,77,85 No findings reported an increase in mortality. The majority of findings showed no statistically significant changes in mortality (n = 15),24,25,28,29,35,38,68,70,81,83,84,90 with three papers noting their study design was underpowered to detect changes.24,29,84 The findings reporting a decrease in mortality saw reductions varying from a minimum 19.4% reduction in risk-adjusted mortality25 to a 73% reduction for 30-day mortality rate.55
Several factors were identified as contributing to these reductions: improved data transparency enabling a surgerical department to better evaluate quality improvement efforts;25 the integration of an information technology bundle that allowed ICU specialists to provide 24/7 coverage using remote off-hours coverage;85 and facilitation of early clinical interventions through dashboard-usage which modified the progression of COVID-19-induced disease.73 In two studies (Birdas et al. and Staib et al.) the dashboard was implemented as one element of broader organizational change (implementing a new council of clinical operations and new chiefs of surgery) so outcomes could not be solely attributed to the dashboard.
Dashboard impact on hospital length of stay
A total of 31 included studies reported on length of stay (LOS) with 43 total findings (Table S3).24,25,27,28,30,34–36,39–42,44–46,48,50,54,61,66,68,70,77,78,81,83–85,87,90,93 Nine of these studies did not conduct statistical analyses.27,30,39,45,46,54,66,77,78 A reduction in LOS was reported in 28 findings24,25,27,28,30,34,39–41,45,46,48,50,54,66,68,70,77,78,81,83,84,90 (16 findings were statistically significant and 11 did not report statistical significance). An increase in LOS was reported in five28,35,46,61,68 findings (with four statistically significant findings and one that did not report statistical significance). No significant change was reported in ten findings.24,25,36,40,42,44,83,85,87,93
Findings reporting a reduction in LOS ranged from a minimum of 0.28 days34 in average LOS to a maximum of 18.8 days.84 Reasons given for positive outcomes included dashboards allowing palliative care to be delivered sooner resulting in a shorter LOS,28 improved time to antibiotic administration for patients exhibiting signs of sepsis,84 and improved quality of care (including a reduction in medical errors and improved protocol compliance).83
The findings reporting an increase in LOS varied from a minimum of 0.1 days61 to a maximum of 8.5 days28 increase in median LOS. One study by Faber et al. reported negative outcomes due to an outlier patient with a 41-day LOS.46 In another study by Schnock et al. there was a correlation between high-dashboard-usage groups and longer LOS.35 However, the authors noted that patients with longer LOS had more opportunity to use the portal, hence these findings may not indicate a direct causal relationship between dashboard usage and longer LOS.
Harms associated with dashboard use
A total of 16 included studies reported on harms with 21 total findings (Table S4).25,26,29,32,33,44,48,58,59,63,64,67,71,74,77,89 Statistical analysis was not performed or reported on for seven of these studies.48,58,63,64,71,74,77 An increase in harms was reported in six findings33,58,63,67,74,89 (three findings were statistically significant and three did not report statistical significance). A decrease was reported in four findings25,33,44,67,71 (three findings were statistically significant, and one did not report statistical significance). No change in harms was reported in 11 findings26,29,32,48,59,64,77,89 (three findings did not report statistical significance).
In the interventions with decreased harms, benefits included a 9.4% reduction in surgery complication rate,25 a 29% fall in adverse events,44 and a decrease in central line-associated bloodstream infection (CLABSI) rates from 2.6% to 0.7%.33 Harms reported with dashboards included an increase in inappropriate continuation of antibiotics (Vancomycin) from 0% to 5%,89 a decreased rate of hand hygiene adherence amongst physicians from 34.2% to 8.6%,67 and mild hypoglycaemia in 20 patients (11.2% of patients).74
Economic impacts of dashboard use
A total of 31 included studies reported on costs with 34 total findings (Table S5).25,27,37,40,41,43,47–49,52,53,55–63,65,72,74,75,79–82,86,88,92 No statistical analysis was performed or reported for 16 of these studies.27,41,47,49,52,56,58,60,62,65,72,75,80,86,88,92 A reduction of costs was reported in the majority of findings (n = 29)25,27,37,40,41,43,47–49,52,55,56,58–63,65,72,75,79–82,86,88,92 (13 findings were statistically significant, 16 did not report statistical significance). A statistically significant increase in costs was reported in one finding,40 and no significant change in three findings.53,57,74
Studies reporting cost reductions showed annual hospital savings ranging from a minimum of US$160 000 to a maximum of US$10.7 million.62 In the latter study, use of the dashboard workflow allowed a perioperative leadership team, surgeons, and supply chain personnel to standardize procedures and eliminate unnecessary items adding to costs, and reduced wastage in surgical or medical supplies such as red blood cells. The study by Niday et al. conducted at Johnson City Medical Centre used a financial dashboard as part of a multifaceted strategy to eliminate high-cost contract nursing, allowing the department to save $7 million annually.58 Studies with positive outcomes also reported savings in staff time, ranging from 132-198 hours of work saved per year80 to 11,200 hours saved per year.41
Dashboard impact on patient and carer satisfaction
A total of eight included studies reported on patient and caregiver satisfaction with care, with eight total findings (Table S6).31,44,51,53,58,69,76,91 No statistical analysis was performed for five of these studies.31,51,58,76,91 The majority of findings (n = 6) reported an increase in parent and carer satisfaction after dashboard implementation (three findings were statistically significant results, and three did not report statistical significance).44,51,53,69,76,91 No findings reported a decrease in satisfaction, and two findings reported no change (both did not test or report statistical significance).31,58
Reasons given for positive outcomes included clinicians being able to see information such as patient wait times more easily76 and web-based checklists allowing patient preferences and concerns to be more systematically addressed.44 The study by Hartzler et al. reported no change in satisfaction and the authors speculated that a lack of improvement in patient satisfaction may have resulted from a “ceiling effect,” as scores were near maximum both before and after the dashboard intervention.31
Discussion
A review of the 70 included studies indicated that digital dashboards are widely used across diverse hospital settings with the intention of improving the process of care delivery and patient outcomes. This review demonstrates clear potential for beneficial impacts of dashboards across process and patient outcomes:
Of the 20 total findings (in 16 studies) reporting on mortality, five reported a decrease in mortality, and the remaining 15 findings found no significant change. Observed mortality reductions could be substantial. In a surgical setting, separate studies identified a 19.4% reduction in risk-adjusted mortality25 and a 73% reduction for 30-day mortality rate.55
Patient length of stay in hospital, a proxy for service quality and effectiveness, was reduced in the majority of findings reporting this outcome (n = 28), with ten reporting no change, and an increase in five. LOS reductions from a minimum of 0.28 days34 in average LOS for a maternity dashboard, up to a maximum of 18.8 days for a bedside sepsis intervention.84
A similar number of findings reported an increase in patient harms (n = 6) and a decrease (n = 4), with no change in 11 findings.
A reduction in costs was reported in 29 of the studies undertaking an economic analysis, with an increase in costs one study, and no change in four others. Cost reductions ranged from US$160 000 (FY2014) in annual hospital operating room expenditure for gastric bypass surgeries47 to US$10.7 million (FY2014) in the cost of total knee arthroplasty in another hospital using a peri-operative dashboard.62
Eight findings reported on patient and carer satisfaction with hospital care, with the majority (n = 6) demonstrating increased satisfaction, and two studies reported no change.
Strengths and weaknesses of the study
This review focuses on core clinical process and economic outcomes of digital dashboards across a wide variety of settings and tasks. The volume of literature reviewed is substantial and prior reviews7–16 have been smaller in size and have not examined this broad set of important outcomes.
Although we identified and analysed 70 studies and the majority had some form of control (including “before/after” studies), they were of variable quality, and some were at high risk of bias, for example because they were single arm. Many were conducted as quality improvement studies, where local impact is assessed and generalizability to other settings is less clear. Further, quality improvement studies might indicate that hospitals have more mature quality improvement processes and resources compared to sites which do not undertake such activities. There is a risk of publication bias in the results presented, where negative outcomes are either not reported or are harder to publish, although we do identify reports of harm in 16 of the included studies. Consequently, whilst we can report clear overall patterns of impact, generalizing these patterns to new hospital settings will need to account for local factors such as dashboard use, case mix, workflows, technology environments, and study designs.
Implications
This review provides good evidence that significant and positive outcome improvements are achievable in principle with digital dashboards in hospitals. It cannot however provide clear evidence for what might be achieved when a digital dashboard is implemented in a new setting. Further, only six of the studies were randomized control trials, and the bulk of the remainder were before/after studies. While this allows us to have confidence in the associational effects reported, it would require more experimental bench tests under controlled conditions, along with real world RCTs, to be undertaken before we unpack the causal chain between dashboard use and dashboard impact.
As is the case with all digital interventions in clinical settings, without capturing and assessing these local confounding factors, we cannot provide a full explanation for any outcome achieved. For example, poor workflow integration may lead to a digital dashboard being inconvenient to use, resulting in low uptake by clinicians. Furthermore, a study that focuses only on downstream outcomes of dashboard use might detect no endpoint changes (e.g., mortality rates) but this does not provide evidence for lack of dashboard effectiveness in general and may only reflect the local workflow.
This study does help tease apart which clinical hospital departmental settings have demonstrated improvements and which have not. Unpacking these differences further will be an important focus for future research. New tools such as the IMPISCO framework provide a mechanism for comparing studies to assist in assessing how replicable results are from one study to another.94 Discovering and comparing variations in impact of similar interventions in different settings should also be instructive in terms of dashboard design and implementation, by identifying those contextual factors most associated with improved outcomes.
Conceiving of outcome measures for digital interventions along a value chain starting with user interactions with the technology and ending with clinical outcomes can allow a richer interpretation of cause and effect (Figure S2).94 Future studies should, therefore, conduct more ecosystemic analyses, by reporting on key process measures that reflect the intervention in use, alongside final outcomes like mortality, cost-effectiveness, or length of stay.
Conclusions
Digital dashboards are widely used across a variety of hospitals settings and tasks, and this comprehensive systematic review provides evidence that, when an intervention is implemented well, significant improvements in critical clinical, process, and financial outcomes are possible. The existence of multiple confounding factors related to a specific hospital service and the fit between dashboard design and implementation, and clinical work, mean that local outcome improvements are likely to always be contingent on these local circumstances.
Supplementary Material
Acknowledgment
Additional Information: Catalin Tufanaru passed away before the completion of this work and his co-workers would like to acknowledge his pivotal contribution to this study.
Contributor Information
Enrico Coiera, Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia.
Anastasia Chan, Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia.
Kalissa Brooke-Cowden, Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia.
Hania Rahimi-Ardabili, Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia.
Nicole Halim, Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia; Sydney Health Literacy Lab, University of Sydney, Sydney, NSW 2006, Australia.
Catalin Tufanaru, Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney, NSW 2109, Australia.
Author contributions
Enrico Coiera (Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Writing—original draft, Writing—review & editing), Anastasia Chan (Data curation, Investigation, Writing—review & editing), Kalissa Brooke-Cowden (Investigation, Validation), Hania Rahimi-Ardabili (Investigation, Validation), Nicole Halim (Investigation, Validation), and Catalin Tufanaru (Conceptualization, Investigation, Methodology, Writing—original draft)
Supplementary material
Supplementary material is available at JAMIA Open online.
Funding
This work was supported by NHMRC Partnership Centre for Health Systems Sustainability and NHMRC Centre for Research Excellence in Digital Health.
Conflicts of interest
None declared.
Data availability
Template data collection forms, data extracted from included studies, and data used for all analyses are available upon request from the authors.
References
- 1. Bergeron BP. Performance Management in Healthcare: From Key Performance Indicators to Balanced Scorecard. Productivity Press; 2017. [Google Scholar]
- 2. Olden PC, Erwin CO. Management of Healthcare Organizations: An Introduction. 4th ed. Health Administration Press; 2023. [Google Scholar]
- 3. Kovner AR, D'Aunno TA. Evidence-Based Management in Healthcare: Principles, Cases, and Perspectives. 2nd ed. Health Administration Press; 2017. [Google Scholar]
- 4. Kimberly JR, Minvielle E. The Quality Imperative: Measurement and Management of Quality in Healthcare. Imperial College Press; 2000. [Google Scholar]
- 5. Walston SL. Strategic Healthcare Management: Planning and Execution . 3rd ed. AUPHA/HAP Book; 2023. [Google Scholar]
- 6. Kroch E, Vaughn T, Koepke M, et al. Hospital boards and quality dashboards. J Patient Saf. 2006;2:10-19. [Google Scholar]
- 7. Wilbanks BA, Langford PA. A review of dashboards for data analytics in nursing. Comput Inform Nurs. 2014;32:545-549. [DOI] [PubMed] [Google Scholar]
- 8. Young L, Vogelsmeier A. Quality dashboards in hospital settings: a systematic review with implications for nurses. J Nurs Care Qual. 2024;39:188-194. [DOI] [PubMed] [Google Scholar]
- 9. Dowding D, Randell R, Gardner P, et al. Dashboards for improving patient care: review of the literature. Int J Med Inform. 2015;84:87-100. [DOI] [PubMed] [Google Scholar]
- 10. Buttigieg SC, Pace A, Rathert C. Hospital performance dashboards: a literature review. J Health Organ Manag. 2017;31:385-406. [DOI] [PubMed] [Google Scholar]
- 11. Khairat SS, Dukkipati A, Lauria HA, Bice T, Travers D, Carson SS. The impact of visualization dashboards on quality of care and clinician satisfaction: integrative literature review. JMIR Hum Factors. 2018;5:e9328. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Salehi F, Moradi G, Setodefar M, Habibi MRM. Investigating the role of clinical dashboards in improving nursing care: a systematic review. Front Health Inform. 2021;10:87. [Google Scholar]
- 13. Waller RG, Wright MC, Segall N, et al. Novel displays of patient information in critical care settings: a systematic review. J Am Med Inform Assoc. 2019;26:479-489. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Almasi S, Rabiei R, Moghaddasi H, Vahidi-Asl M. Emergency department quality dashboard; a systematic review of performance indicators, functionalities, and challenges. Arch Acad Emerg Med. 2021;9:e47. 10.22037/aaem.v9i1.1230 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Etemadi S, Moulaei K, Hedayatipour M. Investigating the role of electronic management dashboard in quality improvement of services provided in operating rooms: a systematic review. J Health Biomed Inform. 2021;8:234-242. [Google Scholar]
- 16. Murphy DR, Savoy A, Satterly T, Sittig DF, Singh H. Dashboards for visual display of patient safety data: a systematic review. BMJ Health Care Inform. 2021;28:e100437. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Coiera E. Assessing technology success and failure using information value chain theory. In: Applied Interdisciplinary Theory in Health Informatics. IOS Press; 2019:35-48. [DOI] [PubMed] [Google Scholar]
- 18. Coiera E. Putting the technical back into socio-technical systems research. Int J Med Inform. 2007;76:S98-S103. [DOI] [PubMed] [Google Scholar]
- 19. Arya S, Kaji AH, Boermeester MA. PRISMA reporting guidelines for meta-analyses and systematic reviews. JAMA Surg. 2021;156:789-790. [DOI] [PubMed] [Google Scholar]
- 20. Tufanaru C, Magrabi F, Coiera E. The benefits and harms of electronic dashboards in hospital healthcare: a protocol for a systematic review. PROSPERO 2018 CRD42018106583. https://www.crd.york.ac.uk/prospero/display_record.php? ID=CRD42018106583
- 21. Tianjing Li JPH, Deeks JJ. Chapter 5: collecting data In: Julian Higgins JT, Chandler J, Cumpston M, Tianjing Li M, Welch V, eds. Cochrane Handbook for Systematic Reviews of Interventions Version 65. Cochrane; 2024. www.training.cochrane.org/handbook [Google Scholar]
- 22. Sterne JA, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Sterne JA, Savović J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019;366:l4898. [DOI] [PubMed] [Google Scholar]
- 24. Anderson BJ, Do D, Chivers C, et al. Clinical impact of an electronic dashboard and alert system for sedation minimization and ventilator liberation: a before-after study. Crit Care Explor. 2019;1:e0057. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Birdas TJ, Rozycki GF, Dunnington GL, Stevens L, Liali V, Schmidt CM. “Show me the data”: a recipe for quality improvement success in an academic surgical department. J Am Coll Surg. 2019;228:368-373. [DOI] [PubMed] [Google Scholar]
- 26. Boord JB, Sharifi M, Greevy RA, et al. Computer-based insulin infusion protocol improves glycemia control over manual protocol. J Am Med Inform Assoc. 2007;14:278-287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Clark KW, Moller S, O'Brien L. Electronic patient journey boards a vital piece of the puzzle in patient flow. Aust Health Rev. 2014;38:259-264. [DOI] [PubMed] [Google Scholar]
- 28. Cox CE, Jones DM, Reagan W, et al. Palliative care planner: a pilot study to evaluate acceptability and usability of an electronic health records system-integrated, needs-targeted app platform. Ann Am Thorac Soc. 2018;15:59-68. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Fletcher GS, Aaronson BA, White AA, Julka R. Effect of a real-time electronic dashboard on a rapid response system. J Med Syst. 2017;42:5-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Gnanasekaran G, Gravenstein S, Idemoto B, Singh M, Liu C. Preventing readmissions and incident delirium in elderly (PRIDE) program. Innov Aging. 2017;1:259. [Google Scholar]
- 31. Hartzler AL, Izard JP, Dalkin BL, Mikles SP, Gore JL. Design and feasibility of integrating personalized PRO dashboards into prostate cancer care. J Am Med Inform Assoc. 2016;23:38-47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. McCoy AB. Achieving Medication Safety during Acute Kidney Injury: The Impact of Clinical Decision Support and Real-Time Pharmacy Surveillance. Dissertation. Vanderbilt University; 2010.
- 33. Pageler NM, Longhurst CA, Wood M, et al. Use of electronic medical record–enhanced checklist and electronic dashboard to decrease CLABSIs. Pediatrics. 2014;133:e738-e746. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Patel MS, Rathi B, Tashfeen K, Yarubi MA. Development and implementation of maternity dashboard in regional hospital for quality improvement at ground level: a pilot study. Oman Med J. 2019;34:194-199. 10.5001/omj.2019.38 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Schnock K, Roulier S, Butler J, et al. Engaging patients in the use of real-time electronic clinical data to improve the safety and reliability of their own care. J Patient Saf. 2022;18:e407-e413. [DOI] [PubMed] [Google Scholar]
- 36. Soh JY, Lee SU, Lee I, et al. A mobile phone-based self-monitoring tool for perioperative gastric cancer patients with incentive spirometer: randomized controlled trial. JMIR Mhealth Uhealth. 2019;7:e12204. 10.2196/12204 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Stadler JG, Donlon K, Siewert JD, Franken T, Lewis NE. Improving the efficiency and ease of healthcare analysis through use of data visualization dashboards. Big Data. 2016;4:129-135. [DOI] [PubMed] [Google Scholar]
- 38. Verma A, Fonarow GC, Hsu JJ, et al. DASH-HF study: a pragmatic quality improvement randomized implementation trial for patients with heart failure with reduced ejection fraction. Circ Heart Fail. 2023;16:e010278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Hansen T, Merhar J, Kimm G, Perez Y, Deleon R, Martin M. Implementation of a Stroke Visual Dashboard to Improve Quality of Stroke Care. Sage Publications; 2023:357-357. [Google Scholar]
- 40. Hester G, Lang T, Madsen L, Tambyraja R, Zenker P. Timely data for targeted quality improvement interventions: use of a visual analytics dashboard for bronchiolitis. Appl Clin Inform. 2019;10:168-174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Kai-Hsuan Y, Kao W-F, Yen-Kuang L, et al. Reducing length of stay and improving quality of care by implementation of informatics system and care bundle in the intensive care unit. Rev Invest Clin. 2020;72:25-31. [DOI] [PubMed] [Google Scholar]
- 42. Leikin S, Mohamed A, Bassily-Marcus A, Oropello J, Manasia A, Kohli-Seth R. Utilization of electronic health record to improve mobility in a surgical ICU. Chest. 2019;156:A1065. [Google Scholar]
- 43. Sexton P, Whiteman K, George EL, Fanning M, Stephens K. Improving PACU throughput using an electronic dashboard: a quality improvement initiative. J Perianesth Nurs. 2022;37:613-619. [DOI] [PubMed] [Google Scholar]
- 44. Dykes PC, Rozenblum R, Dalal A, et al. Prospective evaluation of a multifaceted intervention to improve outcomes in intensive care: the promoting respect and ongoing safety through patient engagement communication and technology study. Crit Care Med. 2017;45:e806-e813. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Becker B, Nagavally S, Wagner N, Walker R, Segon Y, Segon A. Creating a culture of quality: our experience with providing feedback to frontline hospitalists. BMJ Open Qual. 2021;10:e001141. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Faber B, Rajkarnikar A. Designing hospital metrics: visual analytics and process improvement. In: SIGDOC '12: Proceedings of the 30th ACM International Conference on Design of Communication. Association for Computing Machinery; 2012:219-226.
- 47. Gunaratne K, Cleghorn MC, Jackson TD. The surgeon cost report card: a novel cost-performance feedback tool. JAMA Surg. 2016;151:79-80. [DOI] [PubMed] [Google Scholar]
- 48. Javier-DesLoges* J, Abello A, Kenney P. PD05-06 creation of EPIC-Based dashboard to track and report perioperative outcomes and surgeon performance. J Urol. 2020;203:e86. [Google Scholar]
- 49. Lo Y-S, Lee W-S, Chen G-B, Liu C-T. Improving the work efficiency of healthcare-associated infection surveillance using electronic medical records. Comput Methods Programs Biomed. 2014;117:351-359. [DOI] [PubMed] [Google Scholar]
- 50. Spektor M, Ramsay C, Sommer B, Likourezos A, Davidson S. 144: electronic dashboard and a multidisciplinary hospital-wide team decrease patient throughput intervals and reduce number of admitted patients held in the emergency department. Ann Emerg Med. 2008;52:S87. [Google Scholar]
- 51. Thompson C. Safe passage: a nurse-led multidisciplinary team approach to improving transitions and reducing readmissions for heart failure patients. Heart Lung. 2014;43:386. [Google Scholar]
- 52. Varghese S, Amaram-Davila JS, George MC. Prior authorization process improvement for pain medications in an oncology unit: timely initiation of test claim request form. J Clin Oncol. 2020;38:7050. [Google Scholar]
- 53. Wang J-C, Haung W-H, Yang T-S, Chen P-H, Guo S. CGH ERAS app as a complementary health care system to integrate efficacy and efficiency of ERAS care bundles.-ERAS implementation experience from a single medical center of Taiwan. Clin Nutr ESPEN. 2019;31:131-132. [Google Scholar]
- 54. Weiner J, Balijepally V, Tanniru M. Integrating strategic and operational decision making using data-driven dashboards: the case of St Joseph Mercy Oakland hospital. J Healthc Manag. 2015;60:319-330. [PubMed] [Google Scholar]
- 55. Zygourakis CC, Valencia V, Moriates C, et al. Association between surgeon scorecard use and operating room costs. JAMA Surg. 2017;152:284-291. [DOI] [PubMed] [Google Scholar]
- 56. Frosini F, Miniati R, Avezzano P, et al. Development of a web based monitoring system for safety and activity analysis in operating theatres. Technol Health Care. 2016;24:99-109. [DOI] [PubMed] [Google Scholar]
- 57. Kingeter A, Parmley C, Shotwell M, Buntin M, Pandharipande P. 1172: physician awareness of ICU charge environment and effects on cost of care: the ICU price study. Crit Care Med. 2018;46:570.29303798 [Google Scholar]
- 58. Niday P, Smithgall L, Hilton S, Grindstaff S, McInturff D. Redesigning nurse staffing plans for acute care hospitals: at Johnson city medical center in Tennessee, a team approach to better managing nurse staffing not only saved $7 million annually in contract labor costs, but also led to increased nursing satisfaction. Healthc Financ Manage. 2012;66:112-117. [PubMed] [Google Scholar]
- 59. Offodile AC II, Sen AP, Holtsmith S, et al. Harnessing behavioral economics principles to promote better surgeon accountability for operating room cost: a prospective study. J Am Coll Surg. 2020;230:585-593. [DOI] [PubMed] [Google Scholar]
- 60. Pizzini M-A, Gofman G, Kasbekar N, Shah P, Vernick W. How a dashboard and an 8-step process helped a hospital slash drug costs. Healthc Financ Manage Assoc. 2019;1. https://www.hfma.org/topics/hfm/2019/july/how-a-dashboard-and-an-8-step-process-helped-a-hospital-slash-dr.html [Google Scholar]
- 61. Robinson JR, Carter NH, Gibson C, et al. Improving the value of care for appendectomy through an individual surgeon-specific approach. J Pediatr Surg. 2018;53:1181-1186. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62. Rocchio BJ. Achieving cost reduction through data analytics. AORN J. 2016;104:320-325. [DOI] [PubMed] [Google Scholar]
- 63. Smith G, Gopal-Patel J, Joseph J, Hobson A, Clarkei K. Audit and review for evidence-based red cell wastage reduction measures. Br J Biomed Sci. 2015;72:185-190. [DOI] [PubMed] [Google Scholar]
- 64. Ayad M, Patil S, Kaushal S, Gopal K, Patel B. The impact of improving VTE prophylaxis compliance rates on the development of heparin-induced thrombocytopenia. Chest. 2017;152:A573. [Google Scholar]
- 65. Ducatman AM, Tacker DH, Ducatman BS, et al. Quality improvement intervention for reduction of redundant testing. Acad Pathol. 2017;4:2374289517707506. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66. Hechenbleikner EM, Majumdar MC, Gillingham T, et al. S136-operationalizing an enhanced recovery protocol after bariatric surgery: single institutional pilot experience forging data-driven standard work. Surg Endosc. 2023;37:1449-1457. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67. Lenglet A, van Deursen B, Viana R, et al. Inclusion of real-time hand hygiene observation and feedback in a multimodal hand hygiene improvement strategy in low-resource settings. JAMA Netw Open. 2019;2:e199118. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68. Miller RS, Norris PR, Jenkins JM, et al. Systems initiatives reduce healthcare-associated infections: a study of 22,928 device days in a single trauma unit. J Trauma. 2010;68:23-31. [DOI] [PubMed] [Google Scholar]
- 69. Nash M, Pestrue J, Geier P, Sharp K, Helder A, McAlearney AS. Leveraging information technology to drive improvement in patient satisfaction. J Healthc Qual. 2010;32:30-40. [DOI] [PubMed] [Google Scholar]
- 70. Shaw SJ, Jacobs B, Stockwell DC, Futterman C, Spaeder MC. Effect of a real-time pediatric ICU safety bundle dashboard on quality improvement measures. Jt Comm J Qual Patient Saf. 2015;41:414-420. [DOI] [PubMed] [Google Scholar]
- 71. Simpao AF, Ahumada LM, Desai BR, et al. Optimization of drug–drug interaction alert rules in a pediatric hospital’s electronic health record system using a visual analytics dashboard. J Am Med Inform Assoc. 2015;22:361-369. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 72. Staples S, Salisbury RA, King AJ, et al. How do we use electronic clinical decision support and feedback to promote good transfusion practice. Transfusion. 2020;60:1658-1665. [DOI] [PubMed] [Google Scholar]
- 73. Vizcaychipi MP, Shovlin CL, McCarthy A, et al. Increase in COVID-19 inpatient survival following detection of thromboembolic and cytokine storm risk from the point of admission to hospital by a near real time traffic-light system (TraCe-Tic). Braz J Infect Dis. 2020;24:412-421. 10.1016/j.bjid.2020.07.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74. Vogelzang M, Zijlstra F, Nijsten MW. Design and implementation of GRIP: a computerized glucose control system at a surgical intensive care unit. BMC Med Inform Decis Mak. 2005;5:38-10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75. Batley NJ, Osman HO, Kazzi AA, Musallam KM. Implementation of an emergency department computer system: design features that users value. J Emerg Med. 2011;41:693-700. [DOI] [PubMed] [Google Scholar]
- 76. Boger E. Electronic tracking board reduces ED patient length of stay at Indiana hospital. J Emerg Nurs. 2003;29:39-43. [DOI] [PubMed] [Google Scholar]
- 77. Staib A, Sullivan C, Jones M, Griffin B, Bell A, Scott I. The ED‐inpatient dashboard: uniting emergency and inpatient clinicians to improve the efficiency and quality of care for patients requiring emergency admission to hospital. Emerg Med Australas. 2017;29:363-366. [DOI] [PubMed] [Google Scholar]
- 78. Stone-Griffith S, Englebright JD, Cheung D, Korwek KM, Perlin JB. Data-driven process and operational improvement in the emergency department: the ED dashboard and reporting application. J Healthc Manag. 2012;57:167-181. [PubMed] [Google Scholar]
- 79. Lai C-H, Li K-W, Hu F-W, et al. Integration of an intensive care unit visualization dashboard (i-dashboard) as a platform to facilitate multidisciplinary rounds: cluster-randomized controlled trial. J Med Internet Res. 2022;24:e35981. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80. Mayfield J, Wood H, Russo AJ, McMullen KM, Mayfield J. Facility level dashboard utilized to decrease infection preventionists time disseminating data. Am J Infect Control. 2013;41:S54. [Google Scholar]
- 81. Olchanski N, Dziadzko MA, Tiong IC, et al. Can a novel ICU data display positively affect patient outcomes and save lives? J Med Syst. 2017;41:171-178. [DOI] [PubMed] [Google Scholar]
- 82. Pickering BW, Dong Y, Ahmed A, et al. The implementation of clinician designed, human-centered electronic medical record viewer in the intensive care unit: a pilot step-wedge cluster randomized trial. Int J Med Inform. 2015;84:299-307. [DOI] [PubMed] [Google Scholar]
- 83. Levesque E, Hoti E, Azoulay D, Ichai P, Samuel D, Saliba F. The implementation of an intensive care information system allows shortening the ICU length of stay. J Clin Monit Comput. 2015;29:263-269. [DOI] [PubMed] [Google Scholar]
- 84. Jung AD, Baker J, Droege CA, et al. Sooner is better: use of a real-time automated bedside dashboard improves sepsis care. J Surg Res. 2018;231:373-379. [DOI] [PubMed] [Google Scholar]
- 85. McCambridge M, Jones K, Paxton H, Baker K, Sussman EJ, Etchason J. Association of health information technology and teleintensivist coverage with decreased mortality and ventilator use in critically ill patients. Arch Intern Med. 2010;170:648-653. [DOI] [PubMed] [Google Scholar]
- 86. Carmona-Cejudo JM, Hortas ML, Baena-García M, et al. DB4US: a decision support system for laboratory information management. Interact J Med Res. 2012;1:e2126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87. Meidani Z, Nabovati E, Zare S, et al. Effectiveness of an automated feedback with dashboard on use of laboratory tests by neurology residents. Inform Med Unlocked. 2021;26:100767. [Google Scholar]
- 88. Woo JS, Suslow P, Thorsen R, et al. Development and implementation of real-time web-based dashboards in a multisite transfusion service. J Pathol Inform. 2019;10:3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89. Graber CJ, Jones MM, Glassman PA, et al. Taking an antibiotic time-out: utilization and usability of a self-stewardship time-out program for renewal of vancomycin and piperacillin-tazobactam. Hosp Pharm. 2015;50:1011-1024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90. Pettit NN, Bhagat P, Nguyen CT, et al. 1039. Forty-eight-hour antibiotic time-out: impact on antibiotic duration and clinical outcomes. Open Forum Infect Dis. 2019;6:S365-S366. [Google Scholar]
- 91. Rachmat FD, Anggarani AM, Fitriana DF, Aurani S. ISQUA17-2732 advancing bed management dashboard system to improve inpatient paitent experience in 509 beds hospital in Indonesia. International J Qual Health Care. 2017;29:44-45. 10.1093/intqhc/mzx125.71 [DOI] [Google Scholar]
- 92. Rosow E, Adam J, Coulombe K, Race K, Anderson R. Virtual instrumentation and real-time executive dashboards: solutions for health care systems. Nurs Adm Q. 2003;27:58-76. [DOI] [PubMed] [Google Scholar]
- 93. Schnock KO, Snyder JE, Fuller TE, et al. Acute care patient portal intervention: portal use and patient activation. J Med Internet Res. 2019;21:e13336. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94. Coiera E, Tong HL. Replication studies in the clinical decision support literature–frequency, fidelity, and impact. J Am Med Inform Assoc. 2021;28:1815-1825. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
Template data collection forms, data extracted from included studies, and data used for all analyses are available upon request from the authors.
