Skip to main content
Journal of the American Medical Informatics Association : JAMIA logoLink to Journal of the American Medical Informatics Association : JAMIA
. 1996 Nov-Dec;3(6):399–409. doi: 10.1136/jamia.1996.97084513

A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting.

S Shea 1, W DuMouchel 1, L Bahamonde 1
PMCID: PMC116324  PMID: 8930856

Abstract

OBJECTIVE: Computer-based reminder systems have the potential to change physician and patient behaviors and to improve patient outcomes. We performed a meta-analysis of published randomized controlled trials to assess the overall effectiveness of computer-based reminder systems in ambulatory settings directed at preventive care. DESIGN: Meta-analysis. SEARCH STRATEGY: Searches of the Medline (1966-1994), Nursing and Allied Health (1982-1994), and Health Planning and Administration (1975-1994) databases identified 16 randomized, controlled trials of computer-based reminder systems in ambulatory settings. STATISTICAL METHODS: A weighted mixed effects model regression analysis was used to estimate intervention effects for computer and manual reminder systems for six classes of preventive practices. MAIN OUTCOME MEASURE: Adjusted odds ratio for preventive practices. RESULTS: Computer reminders improved preventive practices compared with the control condition for vaccinations (adjusted odds ratio [OR] 3.09; 95% confidence interval [CI] 2.39-4.00), breast cancer screening (OR 1.88; 95% CI 1.44-2.45), colorectal cancer screening (OR 2.25; 95% CI 1.74-2.91), and cardiovascular risk reduction (OR 2.01; 95% CI 1.55-2.61) but not cervical cancer screening (OR 1.15; 95% CI 0.89-1.49) or other preventive care (OR 1.02; 95% CI 0.79-1.32). For all six classes of preventive practices combined the adjusted OR was 1.77 (95% CI 1.38-2.27). CONCLUSION: Evidence from randomized controlled studies supports the effectiveness of data-driven computer-based reminder systems to improve prevention services in the ambulatory care setting.

Full Text

The Full Text of this article is available as a PDF (1.1 MB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Barnett G. O., Winickoff R. N., Morgan M. M., Zielstorff R. D. A computer-based monitoring system for follow-up of elevated blood pressure. Med Care. 1983 Apr;21(4):400–409. doi: 10.1097/00005650-198304000-00003. [DOI] [PubMed] [Google Scholar]
  2. Becker D. M., Gomez E. B., Kaiser D. L., Yoshihasi A., Hodge R. H., Jr Improving preventive care at a medical clinic: how can the patient help? Am J Prev Med. 1989 Nov-Dec;5(6):353–359. [PubMed] [Google Scholar]
  3. Brook R. H. Implementing medical guidelines. Lancet. 1995 Jul 15;346(8968):132–132. doi: 10.1016/s0140-6736(95)91202-9. [DOI] [PubMed] [Google Scholar]
  4. Burack R. C., Gimotty P. A., George J., Stengle W., Warbasse L., Moncrease A. Promoting screening mammography in inner-city settings: a randomized controlled trial of computerized reminders as a component of a program to facilitate mammography. Med Care. 1994 Jun;32(6):609–624. doi: 10.1097/00005650-199406000-00006. [DOI] [PubMed] [Google Scholar]
  5. Chambers C. V., Balaban D. J., Carlson B. L., Ungemack J. A., Grasberger D. M. Microcomputer-generated reminders. Improving the compliance of primary care physicians with mammography screening guidelines. J Fam Pract. 1989 Sep;29(3):273–280. [PubMed] [Google Scholar]
  6. Clayton P. D., Anderson R. K., Hill C., McCormack M. An initial assessment of the cost and utilization of the Integrated Academic Information System (IAIMS) at Columbia Presbyterian Medical Center. Proc Annu Symp Comput Appl Med Care. 1991:109–113. [PMC free article] [PubMed] [Google Scholar]
  7. Colditz G. A., Burdick E., Mosteller F. Heterogeneity in meta-analysis of data from epidemiologic studies: a commentary. Am J Epidemiol. 1995 Aug 15;142(4):371–382. doi: 10.1093/oxfordjournals.aje.a117644. [DOI] [PubMed] [Google Scholar]
  8. Doskocil M., Med M., Vimmer T. Musculus rectus femoris--zacátecní slacha, její funkcní význam. Acta Chir Orthop Traumatol Cech. 1987 Apr;54(2):99–107. [PubMed] [Google Scholar]
  9. Fordham D., McPhee S. J., Bird J. A., Rodnick J. E., Detmer W. M. The Cancer Prevention Reminder System. MD Comput. 1990 Sep-Oct;7(5):289–295. [PubMed] [Google Scholar]
  10. Frame P. S., Zimmer J. G., Werth P. L., Hall W. J., Eberly S. W. Computer-based vs manual health maintenance tracking. A controlled trial. Arch Fam Med. 1994 Jul;3(7):581–588. doi: 10.1001/archfami.3.7.581. [DOI] [PubMed] [Google Scholar]
  11. Heathfield H. A., Wyatt J. Philosophies for the design and development of clinical decision-support systems. Methods Inf Med. 1993 Feb;32(1):1–17. [PubMed] [Google Scholar]
  12. Jenders R. A., Morgan M., Barnett G. O. Use of open standards to implement health maintenance guidelines in a clinical workstation. Comput Biol Med. 1994 Sep;24(5):385–390. doi: 10.1016/0010-4825(94)90006-x. [DOI] [PubMed] [Google Scholar]
  13. Johnston M. E., Langton K. B., Haynes R. B., Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med. 1994 Jan 15;120(2):135–142. doi: 10.7326/0003-4819-120-2-199401150-00007. [DOI] [PubMed] [Google Scholar]
  14. Landis S. E., Hulkower S. D., Pierson S. Enhancing adherence with mammography through patient letters and physician prompts. A pilot study. N C Med J. 1992 Nov;53(11):575–578. [PubMed] [Google Scholar]
  15. Leaper D. J., Horrocks J. C., Staniland J. R., De Dombal F. T. Computer-assisted diagnosis of abdominal pain using "estimates" provided by clinicians. Br Med J. 1972 Nov 11;4(5836):350–354. doi: 10.1136/bmj.4.5836.350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Litzelman D. K., Dittus R. S., Miller M. E., Tierney W. M. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J Gen Intern Med. 1993 Jun;8(6):311–317. doi: 10.1007/BF02600144. [DOI] [PubMed] [Google Scholar]
  17. McDonald C. J., Hui S. L., Smith D. M., Tierney W. M., Cohen S. J., Weinberger M., McCabe G. P. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med. 1984 Jan;100(1):130–138. doi: 10.7326/0003-4819-100-1-130. [DOI] [PubMed] [Google Scholar]
  18. McDonald C. J., Hui S. L., Tierney W. M. Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. MD Comput. 1992 Sep-Oct;9(5):304–312. [PubMed] [Google Scholar]
  19. McDonald C. J. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976 Dec 9;295(24):1351–1355. doi: 10.1056/NEJM197612092952405. [DOI] [PubMed] [Google Scholar]
  20. McDowell I., Newell C., Rosser W. A randomized trial of computerized reminders for blood pressure screening in primary care. Med Care. 1989 Mar;27(3):297–305. doi: 10.1097/00005650-198903000-00008. [DOI] [PubMed] [Google Scholar]
  21. McDowell I., Newell C., Rosser W. Comparison of three methods of recalling patients for influenza vaccination. CMAJ. 1986 Nov 1;135(9):991–997. [PMC free article] [PubMed] [Google Scholar]
  22. McDowell I., Newell C., Rosser W. Computerized reminders to encourage cervical screening in family practice. J Fam Pract. 1989 Apr;28(4):420–424. [PubMed] [Google Scholar]
  23. McPhee S. J., Bird J. A., Fordham D., Rodnick J. E., Osborn E. H. Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. JAMA. 1991 Jul 24;266(4):538–544. [PubMed] [Google Scholar]
  24. McPhee S. J., Bird J. A., Jenkins C. N., Fordham D. Promoting cancer screening. A randomized, controlled trial of three interventions. Arch Intern Med. 1989 Aug;149(8):1866–1872. doi: 10.1001/archinte.149.8.1866. [DOI] [PubMed] [Google Scholar]
  25. Miller R. A., Pople H. E., Jr, Myers J. D. Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982 Aug 19;307(8):468–476. doi: 10.1056/NEJM198208193070803. [DOI] [PubMed] [Google Scholar]
  26. Moran W. P., Nelson K., Wofford J. L., Velez R. Computer-generated mailed reminders for influenza immunization: a clinical trial. J Gen Intern Med. 1992 Sep-Oct;7(5):535–537. doi: 10.1007/BF02599460. [DOI] [PubMed] [Google Scholar]
  27. Ornstein S. M., Garr D. R., Jenkins R. G., Rust P. F., Arnon A. Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services. J Fam Pract. 1991 Jan;32(1):82–90. [PubMed] [Google Scholar]
  28. Pestotnik S. L., Classen D. C., Evans R. S., Burke J. P. Implementing antibiotic practice guidelines through computer-assisted decision support: clinical and financial outcomes. Ann Intern Med. 1996 May 15;124(10):884–890. doi: 10.7326/0003-4819-124-10-199605150-00004. [DOI] [PubMed] [Google Scholar]
  29. Pryor T. A., Gardner R. M., Clayton P. D., Warner H. R. The HELP system. J Med Syst. 1983 Apr;7(2):87–102. doi: 10.1007/BF00995116. [DOI] [PubMed] [Google Scholar]
  30. Rosser W. W., Hutchison B. G., McDowell I., Newell C. Use of reminders to increase compliance with tetanus booster vaccination. CMAJ. 1992 Mar 15;146(6):911–917. [PMC free article] [PubMed] [Google Scholar]
  31. Rosser W. W., McDowell I., Newell C. Use of reminders for preventive procedures in family medicine. CMAJ. 1991 Oct 1;145(7):807–814. [PMC free article] [PubMed] [Google Scholar]
  32. Safran C., Rind D. M., Davis R. B., Ives D., Sands D. Z., Currier J., Slack W. V., Makadon H. J., Cotton D. J. Guidelines for management of HIV infection with computer-based patient's record. Lancet. 1995 Aug 5;346(8971):341–346. doi: 10.1016/s0140-6736(95)92226-1. [DOI] [PubMed] [Google Scholar]
  33. Shea S., Sideli R. V., DuMouchel W., Pulver G., Arons R. R., Clayton P. D. Computer-generated informational messages directed to physicians: effect on length of hospital stay. J Am Med Inform Assoc. 1995 Jan-Feb;2(1):58–64. doi: 10.1136/jamia.1995.95202549. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Sox H. C., Jr Preventive health services in adults. N Engl J Med. 1994 Jun 2;330(22):1589–1595. doi: 10.1056/NEJM199406023302208. [DOI] [PubMed] [Google Scholar]
  35. Sullivan F., Mitchell E. Has general practitioner computing made a difference to patient care? A systematic review of published reports. BMJ. 1995 Sep 30;311(7009):848–852. doi: 10.1136/bmj.311.7009.848. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Szilagyi P. G., Rodewald L. E., Savageau J., Yoos L., Doane C. Improving influenza vaccination rates in children with asthma: a test of a computerized reminder system and an analysis of factors predicting vaccination compliance. Pediatrics. 1992 Dec;90(6):871–875. [PubMed] [Google Scholar]
  37. Tierney W. M., Hui S. L., McDonald C. J. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Med Care. 1986 Aug;24(8):659–666. doi: 10.1097/00005650-198608000-00001. [DOI] [PubMed] [Google Scholar]
  38. Tierney W. M., McDonald C. J., Hui S. L., Martin D. K. Computer predictions of abnormal test results. Effects on outpatient testing. JAMA. 1988 Feb 26;259(8):1194–1198. [PubMed] [Google Scholar]
  39. Tierney W. M., McDonald C. J., Martin D. K., Rogers M. P. Computerized display of past test results. Effect on outpatient testing. Ann Intern Med. 1987 Oct;107(4):569–574. doi: 10.7326/0003-4819-107-4-569. [DOI] [PubMed] [Google Scholar]
  40. Tierney W. M., Miller M. E., McDonald C. J. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990 May 24;322(21):1499–1504. doi: 10.1056/NEJM199005243222105. [DOI] [PubMed] [Google Scholar]
  41. Tierney W. M., Miller M. E., Overhage J. M., McDonald C. J. Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. JAMA. 1993 Jan 20;269(3):379–383. [PubMed] [Google Scholar]
  42. Tunis S. R., Hayward R. S., Wilson M. C., Rubin H. R., Bass E. B., Johnston M., Steinberg E. P. Internists' attitudes about clinical practice guidelines. Ann Intern Med. 1994 Jun 1;120(11):956–963. doi: 10.7326/0003-4819-120-11-199406010-00008. [DOI] [PubMed] [Google Scholar]
  43. Turner B. J., Day S. C., Borenstein B. A controlled trial to improve delivery of preventive care: physician or patient reminders? J Gen Intern Med. 1989 Sep-Oct;4(5):403–409. doi: 10.1007/BF02599691. [DOI] [PubMed] [Google Scholar]

Articles from Journal of the American Medical Informatics Association are provided here courtesy of Oxford University Press

RESOURCES