Skip to main content
Proceedings of the AMIA Annual Fall Symposium logoLink to Proceedings of the AMIA Annual Fall Symposium
. 1997:218–222.

Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces.

A W Kushniruk 1, V L Patel 1, J J Cimino 1
PMCID: PMC2233486  PMID: 9357620

Abstract

This paper describes an approach to the evaluation of health care information technologies based on usability engineering and a methodological framework from the study of medical cognition. The approach involves collection of a rich set of data including video recording of health care workers as they interact with systems, such as computerized patient records and decision support tools. The methodology can be applied in the laboratory setting, typically involving subjects "thinking aloud" as they interact with a system. A similar approach to data collection and analysis can also be extended to study of computer systems in the "live" environment of hospital clinics. Our approach is also influenced from work in the area of cognitive task analysis, which aims to characterize the decision making and reasoning of subjects of varied levels of expertise as they interact with information technology in carrying out representative tasks. The stages involved in conducting cognitively-based usability analyses are detailed and the application of such analysis in the iterative process of system and interface development is discussed.

Full text

PDF
218

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Kushniruk A. W., Kaufman D. R., Patel V. L., Lévesque Y., Lottin P. Assessment of a computerized patient record system: a cognitive approach to evaluating medical technology. MD Comput. 1996 Sep-Oct;13(5):406–415. [PubMed] [Google Scholar]
  2. Kushniruk A. W., Patel V. L. Cognitive computer-based video analysis: its application in assessing the usability of medical systems. Medinfo. 1995;8(Pt 2):1566–1569. [PubMed] [Google Scholar]
  3. Kushniruk A., Patel V., Cimino J. J., Barrows R. A. Cognitive evaluation of the user interface and vocabulary of an outpatient information system. Proc AMIA Annu Fall Symp. 1996:22–26. [PMC free article] [PubMed] [Google Scholar]
  4. Mackenzie C. F., Jefferies N. J., Hunter W. A., Bernhard W. N., Xiao Y. Comparison of self-reporting of deficiencies in airway management with video analyses of actual performance. LOTAS Group. Level One Trauma Anesthesia Simulation. Hum Factors. 1996 Dec;38(4):623–635. doi: 10.1518/001872096778827297. [DOI] [PubMed] [Google Scholar]

Articles from Proceedings of the AMIA Annual Fall Symposium are provided here courtesy of American Medical Informatics Association

RESOURCES