Skip to main content
PMC home page
Health Services Research logoLink to Health Services Research
. 2000 Mar;34(7):1519–1534.

A controlled time-series trial of clinical reminders: using computerized firm systems to make quality improvement research a routine part of mainstream practice.

H I Goldberg 1, W E Neighbor 1, A D Cheadle 1, S D Ramsey 1, P Diehr 1, E Gore 1
PMCID: PMC1975658  PMID: 10737451

Abstract

OBJECTIVE: To explore the feasibility of conducting unobtrusive interventional research in community practice settings by integrating firm-system techniques with time-series analysis of relational-repository data. STUDY SETTING: A satellite teaching clinic divided into two similar, but geographically separated, primary care group practices called firms. One firm was selected by chance to receive the study intervention. Forty-two providers and 2,655 patients participated. STUDY DESIGN: A nonrandomized controlled trial of computer-generated preventive reminders. Net effects were determined by quantitatively combining population-level data from parallel experimental and control interrupted time series extending over two-month baseline and intervention periods. DATA COLLECTION: Mean rates at which mammography, colorectal cancer screening, and cholesterol testing were performed on patients due to receive each maneuver at clinic visits were the trial's outcome measures. PRINCIPAL FINDINGS: Mammography performance increased on the experimental firm by 154 percent (0.24 versus 0.61, p = .03). No effect on fecal occult blood testing was observed. Cholesterol ordering decreased on both the experimental (0.18 versus 0.1 1, p = .02) and control firms (0.13 versus 0.07, p = .03) coincident with national guidelines retreating from recommending screening for young adults. A traditional uncontrolled interrupted time-series design would have incorrectly attributed the experimental-firm decrease to the introduction of reminders. The combined analysis properly indicated that no net prompting effect had occurred, as the difference between firms in cholesterol testing remained stochastically stable over time (0.05 versus 0.04, p = .75). A logistic-regression analysis applied to individual-level data produced equivalent findings. The trial incurred no supplementary data collection costs. CONCLUSIONS: The apparent validity and practicability of our reminder implementation study should encourage others to develop computerized firm systems capable of conducting controlled time-series trials.

Full text

PDF
1520

Images in this article

1525Fig. 1
on p.1525

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Barr D. A. The effects of organizational structure on primary care outcomes under managed care. Ann Intern Med. 1995 Mar 1;122(5):353–359. doi: 10.7326/0003-4819-122-5-199503010-00006. [DOI] [PubMed] [Google Scholar]
  2. Dietrich A. J., Carney P. A., Winchell C. W., Sox C. H., Reed S. C. An office systems approach to cancer prevention in primary care. Cancer Pract. 1997 Nov-Dec;5(6):375–381. [PubMed] [Google Scholar]
  3. Donner A., Klar N. Methods for comparing event rates in intervention studies when the unit of allocation is a cluster. Am J Epidemiol. 1994 Aug 1;140(3):279–301. doi: 10.1093/oxfordjournals.aje.a117247. [DOI] [PubMed] [Google Scholar]
  4. Frame P. S., Berg A. O., Woolf S. U.S. Preventive Services Task Force: highlights of the 1996 report. Am Fam Physician. 1997 Feb 1;55(2):567-76, 581-2. [PubMed] [Google Scholar]
  5. Goldberg H. I., Tarczy-Hornoch P., Stephens K., Larson E. B., LoGerfo J. P. Internet access to patients' records. Lancet. 1998 Jun 13;351(9118):1811–1811. doi: 10.1016/s0140-6736(05)78772-9. [DOI] [PubMed] [Google Scholar]
  6. Landefeld C. S., Aucott J. Improving primary care in academic medical centers. The role of firm systems. Med Care. 1995 Mar;33(3):311–314. doi: 10.1097/00005650-199503000-00009. [DOI] [PubMed] [Google Scholar]
  7. O'Connor G. T., Plume S. K., Olmstead E. M., Morton J. R., Maloney C. T., Nugent W. C., Hernandez F., Jr, Clough R., Leavitt B. J., Coffin L. H. A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. JAMA. 1996 Mar 20;275(11):841–846. [PubMed] [Google Scholar]
  8. Ornstein S. M. Electronic medical records in family practice: the time is now. J Fam Pract. 1997 Jan;44(1):45–48. [PubMed] [Google Scholar]
  9. Rodgers G. B. The safety effects of child-resistant packaging for oral prescription drugs. Two decades of experience. JAMA. 1996 Jun 5;275(21):1661–1665. [PubMed] [Google Scholar]
  10. Shea S., DuMouchel W., Bahamonde L. A meta-analysis of 16 randomized controlled trials to evaluate computer-based clinical reminder systems for preventive care in the ambulatory setting. J Am Med Inform Assoc. 1996 Nov-Dec;3(6):399–409. doi: 10.1136/jamia.1996.97084513. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Tomford J. W., Hershey C. O., McLaren C. E., Porter D. K., Cohen D. I. Intravenous therapy team and peripheral venous catheter-associated complications. A prospective controlled study. Arch Intern Med. 1984 Jun;144(6):1191–1194. [PubMed] [Google Scholar]

Articles from Health Services Research are provided here courtesy of Health Research & Educational Trust

RESOURCES