Skip to main content
Journal of the American Medical Informatics Association : JAMIA logoLink to Journal of the American Medical Informatics Association : JAMIA
. 1996 Sep-Oct;3(5):340–348. doi: 10.1136/jamia.1996.97035025

A randomized controlled trial of a computer-based physician workstation in an outpatient setting: implementation barriers to outcome evaluation.

B L Rotman 1, A N Sullivan 1, T W McDonald 1, B W Brown 1, P DeSmedt 1, D Goodnature 1, M C Higgins 1, H J Suermondt 1, C Young 1, D K Owens 1
PMCID: PMC116318  PMID: 8880681

Abstract

OBJECTIVE: A research prototype Physician Workstation (PWS) incorporating a graphical user interface and a drug ordering module was compared with the existing hospital information system in an academic Veterans Administration General Medical Clinic. Physicians in the intervention group received recommendations for drug substitutions to reduce costs and were alerted to potential drug interactions. The objective was to evaluate the effect of the PWS on user satisfaction, on health-related outcomes, and on costs. DESIGN: A one-year, two-period, randomized controlled trial with 37 subjects. MEASUREMENTS: Differences in the reliance on noncomputer sources of information, in user satisfaction, in the cost of prescribed medications, and in the rate of clinically relevant drug interactions were assessed. RESULTS: The study subjects logged onto the workstation an average of 6.53 times per provider and used it to generate 2.8% of prescriptions during the intervention period. On a five-point scale (5 = very satisfied, 1 = very dissatisfied), user satisfaction declined in the PWS group (3.44 to 2.98 p = 0.008), and increased in the control group (3.23 to 3.72, p < 0.0001). CONCLUSION: The intervention physicians did not use the PWS frequently enough to influence information-seeking behavior, health outcomes, or cost. The study design did not determine whether the poor usage resulted from satisfaction with the control system, problems using the PWS intervention, or the functions provided by the PWS intervention. Evaluative studies should include provisions to improve the chance of successful implementation as well as to yield maximum information if a negative study occurs.

Full Text

The Full Text of this article is available as a PDF (998.8 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Brown B. W., Jr The crossover experiment for clinical trials. Biometrics. 1980 Mar;36(1):69–79. [PubMed] [Google Scholar]
  2. Johnston M. E., Langton K. B., Haynes R. B., Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med. 1994 Jan 15;120(2):135–142. doi: 10.7326/0003-4819-120-2-199401150-00007. [DOI] [PubMed] [Google Scholar]
  3. Massaro T. A. Introducing physician order entry at a major academic medical center: I. Impact on organizational culture and behavior. Acad Med. 1993 Jan;68(1):20–25. doi: 10.1097/00001888-199301000-00003. [DOI] [PubMed] [Google Scholar]
  4. McDonald C. J., Hui S. L., Tierney W. M. Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. MD Comput. 1992 Sep-Oct;9(5):304–312. [PubMed] [Google Scholar]
  5. Tang P. C., Annevelink J., Suermondt H. J., Young C. Y. Semantic integration of information in a physician's workstation. Int J Biomed Comput. 1994 Feb;35(1):47–60. doi: 10.1016/0020-7101(94)90048-5. [DOI] [PubMed] [Google Scholar]
  6. Tape T. G., Campbell J. R. Computerized medical records and preventive health care: success depends on many factors. Am J Med. 1993 Jun;94(6):619–625. doi: 10.1016/0002-9343(93)90214-a. [DOI] [PubMed] [Google Scholar]
  7. Tierney W. M., Miller M. E., McDonald C. J. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990 May 24;322(21):1499–1504. doi: 10.1056/NEJM199005243222105. [DOI] [PubMed] [Google Scholar]
  8. Tierney W. M., Miller M. E., Overhage J. M., McDonald C. J. Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. JAMA. 1993 Jan 20;269(3):379–383. [PubMed] [Google Scholar]
  9. Tierney W. M., Overhage J. M., McDonald C. J. A plea for controlled trials in medical informatics. J Am Med Inform Assoc. 1994 Jul-Aug;1(4):353–355. doi: 10.1136/jamia.1994.95236170. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Journal of the American Medical Informatics Association are provided here courtesy of Oxford University Press

RESOURCES