Abstract
OBJECTIVE: To develop a system for clinical performance improvement through rule-based analysis of medical practice patterns and individualized distribution of published scientific evidence. METHODS: The Quality Feedback Expert System (QFES) was developed by applying a Level-5 expert system shell to generate clinical direct reports for performance improvement. The system comprises three data and knowledge bases: 1) a knowledge base of measurable clinical practice parameters; 2) a practice pattern database of provider-specific numbers of patients and clinical activities; and 3) a management rule base comprising "redline rules" that identify providers whose practice styles vary significantly. Clinical direct reports consist of a table of practice data highlighting individual utilization vs recommendation and selected pertinent statements from medical literature. RESULTS: The QFES supports integration of recommendations from several guidelines into a comprehensive and measurable quality improvement plan, analysis of actual practice patterns and comparison with accepted recommendations, and generation of a confidential individualized direct report to those who significantly deviate from clinical recommendations. The feasibility of the practice pattern analysis by the QFES was demonstrated in a sample of 182 urinary tract infection cases from a primary care clinic. In a set of clinical activities, four questions/procedures were associated with significant (p < 0.001) and unexplained variation. CONCLUSION: The QFES provides a flexible tool for the implementation of clinical practice guidelines in diverse and changing clinical areas without the need for special program development. Preliminary studies indicate utility in the analysis of clinical practice variation and deviations. Using data obtained through a retrospective chart audit, the QFES was able to detect overutilization, and to identify nonrandom differences in practice patterns.
Full Text
The Full Text of this article is available as a PDF (984.5 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Buchsbaum D. G., Buchanan R. G., Lawton M. J., Elswick R. K., Jr, Schnoll S. H. A program of screening and prompting improves short-term physician counseling of dependent and nondependent harmful drinkers. Arch Intern Med. 1993 Jul 12;153(13):1573–1577. [PubMed] [Google Scholar]
- Haines A., Jones R. Implementing findings of research. BMJ. 1994 Jun 4;308(6942):1488–1492. doi: 10.1136/bmj.308.6942.1488. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacoby I., Clark S. M. Direct mailing as a means of disseminating NIH consensus statements. A comparison with current techniques. JAMA. 1986 Mar 14;255(10):1328–1330. [PubMed] [Google Scholar]
- Lassen L. C., Kristensen F. B. Peer comparison feedback to achieve rational and economical drug therapy in general practice: a controlled intervention study. Scand J Prim Health Care. 1992 Mar;10(1):76–80. doi: 10.3109/02813439209014040. [DOI] [PubMed] [Google Scholar]
- Leape L. L. Practice guidelines and standards: an overview. QRB Qual Rev Bull. 1990 Feb;16(2):42–49. doi: 10.1016/s0097-5990(16)30335-9. [DOI] [PubMed] [Google Scholar]
- Litzelman D. K., Dittus R. S., Miller M. E., Tierney W. M. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. J Gen Intern Med. 1993 Jun;8(6):311–317. doi: 10.1007/BF02600144. [DOI] [PubMed] [Google Scholar]
- Lobach D. F., Hammond W. E. Development and evaluation of a Computer-Assisted Management Protocol (CAMP): improved compliance with care guidelines for diabetes mellitus. Proc Annu Symp Comput Appl Med Care. 1994:787–791. [PMC free article] [PubMed] [Google Scholar]
- McPhee S. J., Bird J. A., Fordham D., Rodnick J. E., Osborn E. H. Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. JAMA. 1991 Jul 24;266(4):538–544. [PubMed] [Google Scholar]
- Patton J. P., Nash D. B., Abrutyn E. Urinary tract infection: economic considerations. Med Clin North Am. 1991 Mar;75(2):495–513. doi: 10.1016/s0025-7125(16)30466-7. [DOI] [PubMed] [Google Scholar]
- Ramsey S. D., Hillman A. L., Renshaw L. R., Kimberly J. R., Pauly M. V., Schwartz J. S. How important is the scientific literature in guiding clinical decisions? The case of magnetic resonance imaging. Int J Technol Assess Health Care. 1993 Spring;9(2):253–262. doi: 10.1017/s0266462300004475. [DOI] [PubMed] [Google Scholar]
- Sadowsky D., Kunzel C. The use of direct mail to increase clinician knowledge: an intervention study. Am J Public Health. 1991 Jul;81(7):923–925. doi: 10.2105/ajph.81.7.923. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Soumerai S. B., McLaughlin T. J., Avorn J. Improving drug prescribing in primary care: a critical analysis of the experimental literature. Milbank Q. 1989;67(2):268–317. [PubMed] [Google Scholar]
- Stamm W. E., Hooton T. M. Management of urinary tract infections in adults. N Engl J Med. 1993 Oct 28;329(18):1328–1334. doi: 10.1056/NEJM199310283291808. [DOI] [PubMed] [Google Scholar]
- Tierney W. M., Hui S. L., McDonald C. J. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Med Care. 1986 Aug;24(8):659–666. doi: 10.1097/00005650-198608000-00001. [DOI] [PubMed] [Google Scholar]
- Weingarten S. R., Riedinger M. S., Conner L., Lee T. H., Hoffman I., Johnson B., Ellrodt A. G. Practice guidelines and reminders to reduce duration of hospital stay for patients with chest pain. An interventional trial. Ann Intern Med. 1994 Feb 15;120(4):257–263. doi: 10.7326/0003-4819-120-4-199402150-00001. [DOI] [PubMed] [Google Scholar]
- Winickoff R. N., Coltin K. L., Morgan M. M., Buxbaum R. C., Barnett G. O. Improving physician performance through peer comparison feedback. Med Care. 1984 Jun;22(6):527–534. doi: 10.1097/00005650-198406000-00003. [DOI] [PubMed] [Google Scholar]