Skip to main content
NCBI home page
Journal of Epidemiology and Community Health logoLink to Journal of Epidemiology and Community Health
. 1994 Oct;48(5):435–440. doi: 10.1136/jech.48.5.435

Evaluation of medical audit.

M B Robinson 1
PMCID: PMC1060004  PMID: 7964351

Abstract

OBJECTIVE--To review current knowledge of the effectiveness of medical audit programmes as a whole and of specific interventions within these programmes, as a means of changing clinical behaviour. CRITERIA FOR INCLUSION AND EXCLUSION OF PUBLISHED REPORTS--Articles listed on Medline from 1985-92 with key words "quality assurance" or "medical audit", and "evaluation" and relevant references from these articles, and from recently published reviews and reports on medical audit, were included. Excluded were simple descriptions of audit activity, replications of previous work, and publication in a language other than English. RESULTS--Evaluation of entire programmes of medical audit is unusual. Most reports concern specific interventions and focus particularly on the scientific and technical aspects of quality. These interventions may be classified by the means through which they attempt to achieve desired changes: patient characteristics; physician characteristics; administrative and organisational structures; and financial incentives. CONCLUSIONS--Knowledge about effective methods of bringing about specific changes in clinical behaviour is rudimentary. Impact is highly dependent on local factors, so generalisation of results to other settings is difficult. More qualitative research is needed to define the local factors which influence results.

Full text

PDF
435

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Abrahamson S. Evaluation of continuing education in the health professions. The state of the art. Eval Health Prof. 1984 Mar;7(1):3–23. doi: 10.1177/016327878400700101. [DOI] [PubMed] [Google Scholar]
  2. Anderson C. M., Chambers S., Clamp M., Dunn I. A., McGhee M. F., Sumner K. R., Wood A. M. Can audit improve patient care? Effects of studying use of digoxin in general practice. BMJ. 1988 Jul 9;297(6641):113–114. doi: 10.1136/bmj.297.6641.113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Ball J. R. Practice guidelines and their role in quality assurance and cost effectiveness. Qual Assur Health Care. 1990;2(1):31–36. doi: 10.1093/intqhc/2.1.31. [DOI] [PubMed] [Google Scholar]
  4. Barrable B. A survey of medical quality assurance programs in Ontario hospitals. CMAJ. 1992 Jan 15;146(2):153–160. [PMC free article] [PubMed] [Google Scholar]
  5. Bell D., Layton A. J., Gabbay J. Use of a guideline based questionnaire to audit hospital care of acute asthma. BMJ. 1991 Jun 15;302(6790):1440–1443. doi: 10.1136/bmj.302.6790.1440. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Berg J. K., Kelly J. T. Evaluation of psychosocial health care in quality assurance activities. Med Care. 1981 Jan;19(1):24–29. doi: 10.1097/00005650-198101000-00004. [DOI] [PubMed] [Google Scholar]
  7. Bliersbach C. M. Quality assurance in health care: current challenges and future directions. QRB Qual Rev Bull. 1988 Oct;14(10):315–319. doi: 10.1016/s0097-5990(16)30240-8. [DOI] [PubMed] [Google Scholar]
  8. Briceland L. L., Nightingale C. H., Quintiliani R., Cooper B. W., Smith K. S. Antibiotic streamlining from combination therapy to monotherapy utilizing an interdisciplinary approach. Arch Intern Med. 1988 Sep;148(9):2019–2022. [PubMed] [Google Scholar]
  9. Carey T. S., Levis D., Pickard C. G., Bernstein J. Development of a model quality-of-care assessment program for adult preventive care in rural medical practices. QRB Qual Rev Bull. 1991 Feb;17(2):54–59. doi: 10.1016/s0097-5990(16)30425-0. [DOI] [PubMed] [Google Scholar]
  10. Casanova J. E. Status of quality assurance programs in American hospitals. Med Care. 1990 Nov;28(11):1104–1109. doi: 10.1097/00005650-199011000-00010. [DOI] [PubMed] [Google Scholar]
  11. Casparie A. F. Guidelines to shape clinical practice. The role of medical societies: the Dutch experience in comparison with recent developments in the American approach. Health Policy. 1991 Aug;18(3):251–259. doi: 10.1016/0168-8510(91)90026-t. [DOI] [PubMed] [Google Scholar]
  12. Chassin M. R. Practice guidelines: best hope for quality improvement in the 1990s. J Occup Med. 1990 Dec;32(12):1199–1206. doi: 10.1097/00043764-199012000-00015. [DOI] [PubMed] [Google Scholar]
  13. Deuschle J. M., Alvarez B., Logsdon D. N., Stahl W. M., Smith H., Jr Physician performance in a prepaid health plan: results of the peer review program of the Health Insurance Plan of Greater New York. Med Care. 1982 Feb;20(2):127–142. [PubMed] [Google Scholar]
  14. Dixon A. S. The evolution of clinical policies. Med Care. 1990 Mar;28(3):201–220. doi: 10.1097/00005650-199003000-00002. [DOI] [PubMed] [Google Scholar]
  15. Domenighetti G., Luraschi P., Casabianca A., Gutzwiller F., Spinelli A., Pedrinis E., Repetto F. Effect of information campaign by the mass media on hysterectomy rates. Lancet. 1988 Dec 24;2(8626-8627):1470–1473. doi: 10.1016/s0140-6736(88)90943-9. [DOI] [PubMed] [Google Scholar]
  16. Eckerlund I., Jonsson E., Rydén L., Råstam L., Berglund G., Isacsson S. O. Economic evaluation of a Swedish medical care program for hypertension. Health Policy. 1985;5(4):299–306. doi: 10.1016/0168-8510(85)90047-8. [DOI] [PubMed] [Google Scholar]
  17. Ermann D. Hospital utilization review: past experience, future directions. J Health Polit Policy Law. 1988 Winter;13(4):683–704. doi: 10.1215/03616878-13-4-683. [DOI] [PubMed] [Google Scholar]
  18. Everett G. D., deBlois C. S., Chang P. F., Holets T. Effect of cost education, cost audits, and faculty chart review on the use of laboratory services. Arch Intern Med. 1983 May;143(5):942–944. [PubMed] [Google Scholar]
  19. Finn A. F., Jr, Valenstein P. N., Burke M. D. Alteration of physicians' orders by nonphysicians. JAMA. 1988 May 6;259(17):2549–2552. [PubMed] [Google Scholar]
  20. Fisher R. B., Dearden C. H. Improving the care of patients with major trauma in the accident and emergency department. BMJ. 1990 Jun 16;300(6739):1560–1563. doi: 10.1136/bmj.300.6739.1560. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Fowkes F. G., Davies E. R., Evans K. T., Green G., Hartley G., Hugh A. E., Nolan D. J., Power A. L., Roberts C. J., Roylance J. Multicentre trial of four strategies to reduce use of a radiological test. Lancet. 1986 Feb 15;1(8477):367–370. doi: 10.1016/s0140-6736(86)92327-5. [DOI] [PubMed] [Google Scholar]
  22. Fowkes F. G., Roberts C. J. Introducing guidelines into clinical practice. Eff Health Care. 1984 Apr;1(6):313–323. [PubMed] [Google Scholar]
  23. Friis H., Bro F., Mabeck C. E., Vejlsgaard R. Changes in prescription of antibiotics in general practice in relation to different strategies for drug information. Dan Med Bull. 1991 Aug;38(4):380–382. [PubMed] [Google Scholar]
  24. Gabbay J., Layton A. J. Evaluation of audit of medical inpatient records in a district general hospital. Qual Health Care. 1992 Mar;1(1):43–47. doi: 10.1136/qshc.1.1.43. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Gabbay J., McNicol M. C., Spiby J., Davies S. C., Layton A. J. What did audit achieve? Lessons from preliminary evaluation of a year's medical audit. BMJ. 1990 Sep 15;301(6751):526–529. doi: 10.1136/bmj.301.6751.526. [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Geertsma R. H., Parker R. C., Jr, Whitbourne S. K. How physicians view the process of change in their practice behavior. J Med Educ. 1982 Oct;57(10 Pt 1):752–761. doi: 10.1097/00001888-198210000-00003. [DOI] [PubMed] [Google Scholar]
  27. Grant G. B., Gregory D. A., van Zwanenberg T. D. Development of a limited formulary for general practice. Lancet. 1985 May 4;1(8436):1030–1032. doi: 10.1016/s0140-6736(85)91625-3. [DOI] [PubMed] [Google Scholar]
  28. Greco P. J., Eisenberg J. M. Changing physicians' practices. N Engl J Med. 1993 Oct 21;329(17):1271–1273. doi: 10.1056/NEJM199310213291714. [DOI] [PubMed] [Google Scholar]
  29. Greer A. L. The state of the art versus the state of the science. The diffusion of new medical technologies into practice. Int J Technol Assess Health Care. 1988;4(1):5–26. doi: 10.1017/s0266462300003202. [DOI] [PubMed] [Google Scholar]
  30. Grilli R., Apolone G., Marsoni S., Nicolucci A., Zola P., Liberati A. The impact of patient management guidelines on the care of breast, colorectal, and ovarian cancer patients in Italy. Med Care. 1991 Jan;29(1):50–63. doi: 10.1097/00005650-199101000-00005. [DOI] [PubMed] [Google Scholar]
  31. Grossman R. M. A review of physician cost-containment strategies for laboratory testing. Med Care. 1983 Aug;21(8):783–802. doi: 10.1097/00005650-198308000-00003. [DOI] [PubMed] [Google Scholar]
  32. Grumet G. W. Health care rationing through inconvenience. The third party's secret weapon. N Engl J Med. 1989 Aug 31;321(9):607–611. doi: 10.1056/NEJM198908313210909. [DOI] [PubMed] [Google Scholar]
  33. Harris C. M., Fry J., Jarman B., Woodman E. Prescribing--a case for prolonged treatment. J R Coll Gen Pract. 1985 Jun;35(275):284–287. [PMC free article] [PubMed] [Google Scholar]
  34. Hart S. K., Dubbs W., Gil A., Myers-Judy M. The effects of therapist-evaluation of orders and interaction with physicians on the appropriateness of respiratory care. Respir Care. 1989 Mar;34(3):185–190. [PubMed] [Google Scholar]
  35. Haynes R. B., Walker C. J. Computer-aided quality assurance. A critical appraisal. Arch Intern Med. 1987 Jul;147(7):1297–1301. [PubMed] [Google Scholar]
  36. Heath D. A. Random review of hospital patient records. BMJ. 1990 Mar 10;300(6725):651–652. doi: 10.1136/bmj.300.6725.651. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Hendra T. J., Marshall A. J. Increased prescription of thrombolytic treatment to elderly patients with suspected acute myocardial infarction associated with audit. BMJ. 1992 Feb 15;304(6824):423–425. doi: 10.1136/bmj.304.6824.423. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Hendryx M. S. A review of the literature on quality assurance programs. Reported outcomes and intervention types. Qual Assur Util Rev. 1991 Winter;6(4):123–126. doi: 10.1177/0885713x9100600404. [DOI] [PubMed] [Google Scholar]
  39. Keller R. B., Chapin A. M., Soule D. N. Informed inquiry into practice variations: the Maine Medical Assessment Foundation. Qual Assur Health Care. 1990;2(1):69–75. doi: 10.1093/intqhc/2.1.69. [DOI] [PubMed] [Google Scholar]
  40. Kelly J. T., Swartwout J. E. Development of practice parameters by physician organizations. QRB Qual Rev Bull. 1990 Feb;16(2):54–57. doi: 10.1016/s0097-5990(16)30337-2. [DOI] [PubMed] [Google Scholar]
  41. Kokkola K., Sintonen H. Introducing guidelines for medical care: experiences in Finland. Hosp Health Serv Rev. 1985 Nov;81(6):261–265. [PubMed] [Google Scholar]
  42. Krasnik A., Groenewegen P. P., Pedersen P. A., von Scholten P., Mooney G., Gottschau A., Flierman H. A., Damsgaard M. T. Changing remuneration systems: effects on activity in general practice. BMJ. 1990 Jun 30;300(6741):1698–1701. doi: 10.1136/bmj.300.6741.1698. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Kroenke K., Pinholt E. M. Reducing polypharmacy in the elderly. A controlled trial of physician feedback. J Am Geriatr Soc. 1990 Jan;38(1):31–36. doi: 10.1111/j.1532-5415.1990.tb01593.x. [DOI] [PubMed] [Google Scholar]
  44. Linn B. S. Continuing medical education. Impact on emergency room burn care. JAMA. 1980 Aug 8;244(6):565–570. doi: 10.1001/jama.244.6.565. [DOI] [PubMed] [Google Scholar]
  45. Lohr K. N., Schroeder S. A. A strategy for quality assurance in Medicare. N Engl J Med. 1990 Mar 8;322(10):707–712. doi: 10.1056/nejm199003083221031. [DOI] [PubMed] [Google Scholar]
  46. Lomas J., Anderson G. M., Domnick-Pierre K., Vayda E., Enkin M. W., Hannah W. J. Do practice guidelines guide practice? The effect of a consensus statement on the practice of physicians. N Engl J Med. 1989 Nov 9;321(19):1306–1311. doi: 10.1056/NEJM198911093211906. [DOI] [PubMed] [Google Scholar]
  47. Lomas J., Enkin M., Anderson G. M., Hannah W. J., Vayda E., Singer J. Opinion leaders vs audit and feedback to implement practice guidelines. Delivery after previous cesarean section. JAMA. 1991 May 1;265(17):2202–2207. [PubMed] [Google Scholar]
  48. Lomas J., Haynes R. B. A taxonomy and critical review of tested strategies for the application of clinical practice recommendations: from "official" to "individual" clinical policy. Am J Prev Med. 1988;4(4 Suppl):77–97. [PubMed] [Google Scholar]
  49. Lomas J. Words without action? The production, dissemination, and impact of consensus recommendations. Annu Rev Public Health. 1991;12:41–65. doi: 10.1146/annurev.pu.12.050191.000353. [DOI] [PubMed] [Google Scholar]
  50. MYERS R. S., SLEE V. N., HOFFMANN R. G. The medical audit protects the patient, helps the physician, and serves the hospital. Mod Hosp. 1955 Sep;85(3):77–83. [PubMed] [Google Scholar]
  51. Mahoney M. E., Schiller M. R., Johns M. L. The effects of positive incentive programs on physician chart completion. Top Health Rec Manage. 1990 Sep;11(1):40–53. [PubMed] [Google Scholar]
  52. Martin A. R., Wolf M. A., Thibodeau L. A., Dzau V., Braunwald E. A trial of two strategies to modify the test-ordering behavior of medical residents. N Engl J Med. 1980 Dec 4;303(23):1330–1336. doi: 10.1056/NEJM198012043032304. [DOI] [PubMed] [Google Scholar]
  53. McDonald C. J. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976 Dec 9;295(24):1351–1355. doi: 10.1056/NEJM197612092952405. [DOI] [PubMed] [Google Scholar]
  54. Mooney G., Ryan M. Rethinking medical audit: the goal is efficiency. J Epidemiol Community Health. 1992 Jun;46(3):180–183. doi: 10.1136/jech.46.3.180. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Mozes B., Lubin D., Modan B., Ben-Bassat I., Gitel S. N., Halkin H. Evaluation of an intervention aimed at reducing inappropriate use of preoperative blood coagulation tests. Arch Intern Med. 1989 Aug;149(8):1836–1838. [PubMed] [Google Scholar]
  56. Mugford M., Banfield P., O'Hanlon M. Effects of feedback of information on clinical practice: a review. BMJ. 1991 Aug 17;303(6799):398–402. doi: 10.1136/bmj.303.6799.398. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Palmer R. H., Louis T. A., Hsu L. N., Peterson H. F., Rothrock J. K., Strain R., Thompson M. S., Wright E. A. A randomized controlled trial of quality assurance in sixteen ambulatory care practices. Med Care. 1985 Jun;23(6):751–770. doi: 10.1097/00005650-198506000-00001. [DOI] [PubMed] [Google Scholar]
  58. Rice T. H. The impact of changing medicare reimbursement rates on physician-induced demand. Med Care. 1983 Aug;21(8):803–815. doi: 10.1097/00005650-198308000-00004. [DOI] [PubMed] [Google Scholar]
  59. Sanazaro P. J., Worth R. M. Concurrent quality assurance in hospital care. Report of a study by Private Initiative in PSRO. N Engl J Med. 1978 May 25;298(21):1171–1177. doi: 10.1056/NEJM197805252982104. [DOI] [PubMed] [Google Scholar]
  60. Schaffner W., Ray W. A., Federspiel C. F., Miller W. O. Improving antibiotic prescribing in office practice. A controlled trial of three educational methods. JAMA. 1983 Oct 7;250(13):1728–1732. [PubMed] [Google Scholar]
  61. Scheffler R. M., Sullivan S. D., Ko T. H. The impact of Blue Cross and Blue Shield Plan utilization management programs, 1980-1988. Inquiry. 1991 Fall;28(3):263–275. [PubMed] [Google Scholar]
  62. Schroeder S. A. Strategies for reducing medical costs by changing physicians' behavior: efficacy and impact on quality of care. Int J Technol Assess Health Care. 1987;3(1):39–50. doi: 10.1017/s0266462300011727. [DOI] [PubMed] [Google Scholar]
  63. Snyder J. D. Use and misuse of oral therapy for diarrhea: comparison of US practices with American Academy of Pediatrics recommendations. Pediatrics. 1991 Jan;87(1):28–33. [PubMed] [Google Scholar]
  64. Soumerai S. B., Avorn J. Efficacy and cost-containment in hospital pharmacotherapy: state of the art and future directions. Milbank Mem Fund Q Health Soc. 1984 Summer;62(3):447–474. [PubMed] [Google Scholar]
  65. Soumerai S. B., McLaughlin T. J., Avorn J. Improving drug prescribing in primary care: a critical analysis of the experimental literature. Milbank Q. 1989;67(2):268–317. [PubMed] [Google Scholar]
  66. Stankier L. Diseases of the skin. Psoriasis. Br Med J. 1974 Jan 5;1(5896):27–29. doi: 10.1136/bmj.1.5896.27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Walshe K., Coles J. Medical audit: in need of evaluation. Qual Health Care. 1993 Sep;2(3):189–190. doi: 10.1136/qshc.2.3.189. [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Wennberg J. E., Blowers L., Parker R., Gittelsohn A. M. Changes in tonsillectomy rates associated with feedback and review. Pediatrics. 1977 Jun;59(6):821–826. [PubMed] [Google Scholar]
  69. Whiteside M. E., Lefkowitz S., Justiniani F. R., Ratzan K. Changing prescribing patterns: a program of physician education. Hosp Formul. 1987 Jun;22(6):561-3, 566, 568. [PubMed] [Google Scholar]
  70. Wickizer T. M., Wheeler J. R., Feldstein P. J. Does utilization review reduce unnecessary hospital care and contain costs? Med Care. 1989 Jun;27(6):632–647. doi: 10.1097/00005650-198906000-00006. [DOI] [PubMed] [Google Scholar]
  71. Wiener C. L., Kayser-Jones J. Defensive work in nursing homes: accountability gone amok. Soc Sci Med. 1989;28(1):37–44. doi: 10.1016/0277-9536(89)90304-3. [DOI] [PubMed] [Google Scholar]

Articles from Journal of Epidemiology and Community Health are provided here courtesy of BMJ Publishing Group

RESOURCES