Table. Metrics and Outcomes Used to Evaluate the Impact of Data Integration and Visualization Technologies on Clinician Performancea.
| Study Name | Task Completion or Decision Time | Task Completion Rate | Time and Accuracy | NASA Task Load Index | Accuracy | Quantity of Information on Screen | Self-reported Usability, Satisfaction, or Preference | No. of Usability Issues | Looking or Accessing Display | System Usability Scale Questionnaire |
|---|---|---|---|---|---|---|---|---|---|---|
| Ahmed et al,26 2011 | Positive | NA | NA | Positive | Positive | Positive | NA | NA | NA | NA |
| Anders et al,27 2012 | NA | NA | NA | Not significant | Positive | NA | Positive | NA | NA | NA |
| Drews and Doig,19 2014 | Positive | NA | NA | Not significant | Positive | NA | Positive | NA | Negative | NA |
| Dziadzko et al,28 2016 | NA | NA | NA | NA | NA | NA | Comparison | NA | NA | NA |
| Effken,29 2006 | Not significant | NA | Not significant | NA | NA | NA | NA | NA | NA | NA |
| Effken et al,30 2008 | Not significant | NA | Not significant | Not significant | NA | NA | Positive | NA | NA | NA |
| Ellsworth et al,31 2014 | NA | NA | NA | NA | NA | NA | Comparison | NA | NA | NA |
| Forsman et al,18 2013 | Comparison | Comparison | NA | NA | NA | NA | Comparison | NA | Comparison | Positive |
| Görges et al,32 2011 | Positive | NA | NA | Not significant | Positive | NA | Positive | NA | NA | NA |
| Görges et al,16 2012 | Positive | NA | NA | Positive | Positive | NA | Positive | NA | NA | NA |
| Koch et al,33 2013 | Positive | NA | NA | NA | Positive | NA | NA | NA | NA | NA |
| Law et al,34 2005 | Not significant | NA | NA | NA | Negative | NA | Positive | NA | NA | NA |
| Liu and Osvalder,35 2004 | Negative | NA | NA | NA | Negative | NA | Positive | NA | NA | NA |
| Miller et al,36 2009 | NA | NA | NA | NA | Positive | NA | NA | NA | NA | NA |
| Peute et al,37 2011 | Positive | Positive | NA | NA | NA | NA | NA | Comparison | NA | NA |
| Pickering et al,38 2010 | Positive | NA | NA | Positive | Positive | NA | NA | NA | NA | NA |
| Pickering et al,39 2013 | NA | NA | NA | NA | NA | Comparison | Comparison | NA | NA | NA |
| Pickering et al,40 2015 | Positive | NA | NA | NA | NA | NA | Positive | NA | NA | NA |
| van der Meulen et al,17 2010 | Not significant | Not significant | NA | NA | Negative | NA | NA | NA | NA | NA |
| Wachter et al,41 2005 | NA | NA | NA | NA | NA | NA | Negative | NA | Positive | NA |
Abbreviations: NA, not applicable; NASA-TLX, National Aeronautics and Space Administration Task Load Index.
Each cell indicates the direction of the result of the tested data integration and visualization technology with a comparator. Positive indicates that the data integration and visualization technology had significantly positive results compared with comparator. Negative indicates that the data integration and visualization technology had negative results compared with a comparator. Not significant indicates that the data integration and visualization technology had no significant results compared with comparator. Comparison indicates that no definitive direction was detected in the results, but that the results associated with each clinician group studied are itemized.