Skip to main content
NCBI home page
The BMJ logoLink to The BMJ
. 1991 Aug 17;303(6799):398–402. doi: 10.1136/bmj.303.6799.398

Effects of feedback of information on clinical practice: a review.

M Mugford 1, P Banfield 1, M O'Hanlon 1
PMCID: PMC1670701  PMID: 1912809

Abstract

OBJECTIVE--To establish what is known about the role of feedback of statistical information in changing clinical practice. DESIGN--Review of 36 studies of interventions entailing the use of statistical information for audit or practice review, which used a formal research design. SUBJECTS--Papers identified from computer searches of medical and health service management publications, of which 36 describing studies of interventions designed to influence clinical care and including information feedback from clinical or administrative data systems were reviewed. MAIN OUTCOME MEASURES--Evidence for effect of information feedback on change in clinical practice. RESULTS--Information feedback was most likely to influence clinical practice if it was part of strategy to target decision makers who had already agreed to review their practice. A more direct effect was discernable if the information was presented close to the time of decision making. The questions of the optimum layout and quantity of information were not addressed; the 36 papers were insufficient for defining good formats for information to be used for audit or quality assurance. CONCLUSIONS--Given the cost of information processing and the current emphasis on closing the audit loop in the health services, it is important that the use of information in the audit process should be critically evaluated.

Full text

PDF
398

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Anderson C. M., Chambers S., Clamp M., Dunn I. A., McGhee M. F., Sumner K. R., Wood A. M. Can audit improve patient care? Effects of studying use of digoxin in general practice. BMJ. 1988 Jul 9;297(6641):113–114. doi: 10.1136/bmj.297.6641.113. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Barr A. Measuring hospital performance: proposed limited experiment. Hosp Health Serv Rev. 1986 Mar;82(2):70–71. [PubMed] [Google Scholar]
  3. Braham R. L., Ruchlin H. S. Physician practice profiles: a case study of the use of audit and feedback in an ambulatory care group practice. Health Care Manage Rev. 1987 Summer;12(3):11–16. doi: 10.1097/00004010-198701230-00005. [DOI] [PubMed] [Google Scholar]
  4. Chassin M. R., McCue S. M. A randomized trial of medical quality assurance. Improving physicians' use of pelvimetry. JAMA. 1986 Aug 22;256(8):1012–1016. [PubMed] [Google Scholar]
  5. Cohen D. I., Jones P., Littenberg B., Neuhauser D. Does cost information availability reduce physician test usage? A randomized clinical trial with unexpected findings. Med Care. 1982 Mar;20(3):286–292. doi: 10.1097/00005650-198203000-00005. [DOI] [PubMed] [Google Scholar]
  6. Cohen S. J., Weinberger M., Hui S. L., Tierney W. M., McDonald C. J. The impact of reading on physicians' nonadherence to recommended standards of medical care. Soc Sci Med. 1985;21(8):909–914. doi: 10.1016/0277-9536(85)90147-9. [DOI] [PubMed] [Google Scholar]
  7. Cummings K. M., Frisof K. B., Long M. J., Hrynkiewich G. The effects of price information on physicians' test-ordering behavior. Ordering of diagnostic tests. Med Care. 1982 Mar;20(3):293–301. doi: 10.1097/00005650-198203000-00006. [DOI] [PubMed] [Google Scholar]
  8. Domenighetti G., Luraschi P., Casabianca A., Gutzwiller F., Spinelli A., Pedrinis E., Repetto F. Effect of information campaign by the mass media on hysterectomy rates. Lancet. 1988 Dec 24;2(8626-8627):1470–1473. doi: 10.1016/s0140-6736(88)90943-9. [DOI] [PubMed] [Google Scholar]
  9. Dyck F. J., Murphy F. A., Murphy J. K., Road D. A., Boyd M. S., Osborne E., De Vlieger D., Korchinski B., Ripley C., Bromley A. T. Effect of surveillance on the number of hysterectomies in the province of Saskatchewan. N Engl J Med. 1977 Jun 9;296(23):1326–1328. doi: 10.1056/NEJM197706092962306. [DOI] [PubMed] [Google Scholar]
  10. Eisenberg J. M. Physician utilization. The state of research about physicians' practice patterns. Med Care. 1985 May;23(5):461–483. [PubMed] [Google Scholar]
  11. Evans C. E., Haynes R. B., Birkett N. J., Gilbert J. R., Taylor D. W., Sackett D. L., Johnston M. E., Hewson S. A. Does a mailed continuing education program improve physician performance? Results of a randomized trial in antihypertensive care. JAMA. 1986 Jan 24;255(4):501–504. [PubMed] [Google Scholar]
  12. Everett G. D., deBlois C. S., Chang P. F., Holets T. Effect of cost education, cost audits, and faculty chart review on the use of laboratory services. Arch Intern Med. 1983 May;143(5):942–944. [PubMed] [Google Scholar]
  13. Finn A. F., Jr, Valenstein P. N., Burke M. D. Alteration of physicians' orders by nonphysicians. JAMA. 1988 May 6;259(17):2549–2552. [PubMed] [Google Scholar]
  14. Gleicher N. Cesarean section rates in the United States. The short-term failure of the National Consensus Development Conference in 1980. JAMA. 1984 Dec 21;252(23):3273–3276. [PubMed] [Google Scholar]
  15. Grant G. B., Gregory D. A., van Zwanenberg T. D. Development of a limited formulary for general practice. Lancet. 1985 May 4;1(8436):1030–1032. doi: 10.1016/s0140-6736(85)91625-3. [DOI] [PubMed] [Google Scholar]
  16. Grossman R. M. A review of physician cost-containment strategies for laboratory testing. Med Care. 1983 Aug;21(8):783–802. doi: 10.1097/00005650-198308000-00003. [DOI] [PubMed] [Google Scholar]
  17. Hemminki E. Factors influencing drug prescribing--inquiry into research strategy. Drug Intell Clin Pharm. 1976 Jun;10(6):321–329. doi: 10.1177/106002807601000603. [DOI] [PubMed] [Google Scholar]
  18. Horder J., Bosanquet N., Stocking B. Ways of influencing the behaviour of general practitioners. J R Coll Gen Pract. 1986 Nov;36(292):517–521. [PMC free article] [PubMed] [Google Scholar]
  19. Linn B. S. Continuing medical education. Impact on emergency room burn care. JAMA. 1980 Aug 8;244(6):565–570. doi: 10.1001/jama.244.6.565. [DOI] [PubMed] [Google Scholar]
  20. Lomas J., Anderson G. M., Domnick-Pierre K., Vayda E., Enkin M. W., Hannah W. J. Do practice guidelines guide practice? The effect of a consensus statement on the practice of physicians. N Engl J Med. 1989 Nov 9;321(19):1306–1311. doi: 10.1056/NEJM198911093211906. [DOI] [PubMed] [Google Scholar]
  21. Long M. J., Cummings K. M., Frisof K. B. The role of perceived price in physicians' demand for diagnostic tests. Med Care. 1983 Feb;21(2):243–250. doi: 10.1097/00005650-198302000-00011. [DOI] [PubMed] [Google Scholar]
  22. Lowe J. W., Wells M. Autopsy: a further suggestion for its revival. N Engl J Med. 1982 Jan 7;306(1):51–51. doi: 10.1056/NEJM198201073060117. [DOI] [PubMed] [Google Scholar]
  23. Martin A. R., Wolf M. A., Thibodeau L. A., Dzau V., Braunwald E. A trial of two strategies to modify the test-ordering behavior of medical residents. N Engl J Med. 1980 Dec 4;303(23):1330–1336. doi: 10.1056/NEJM198012043032304. [DOI] [PubMed] [Google Scholar]
  24. McPhee S. J., Bird J. A., Jenkins C. N., Fordham D. Promoting cancer screening. A randomized, controlled trial of three interventions. Arch Intern Med. 1989 Aug;149(8):1866–1872. doi: 10.1001/archinte.149.8.1866. [DOI] [PubMed] [Google Scholar]
  25. Mitchell M. W., Fowkes F. G. Audit reviewed: does feedback on performance change clinical behaviour? J R Coll Physicians Lond. 1985 Oct;19(4):251–254. [PMC free article] [PubMed] [Google Scholar]
  26. Morgan M., Studney D. R., Barnett G. O., Winickoff R. N. Computerized concurrent review of prenatal care. QRB Qual Rev Bull. 1978 Sep;4(9):33–36. [PubMed] [Google Scholar]
  27. Myers S. A., Gleicher N. A successful program to lower cesarean-section rates. N Engl J Med. 1988 Dec 8;319(23):1511–1516. doi: 10.1056/NEJM198812083192304. [DOI] [PubMed] [Google Scholar]
  28. Nelson A. R. Orphan data and the unclosed loop: a dilemma in PSRO and medical audit. N Engl J Med. 1976 Sep 9;295(11):617–619. doi: 10.1056/NEJM197609092951111. [DOI] [PubMed] [Google Scholar]
  29. Norton P. G., Dempsey L. J. Self-audit: its effect on quality of care. J Fam Pract. 1985 Oct;21(4):289–291. [PubMed] [Google Scholar]
  30. Parrino T. A. The nonvalue of retrospective peer comparison feedback in containing hospital antibiotic costs. Am J Med. 1989 Apr;86(4):442–448. doi: 10.1016/0002-9343(89)90343-4. [DOI] [PubMed] [Google Scholar]
  31. Pop P., Winkens R. A. A diagnostic centre for general practitioners: results of individual feedback on diagnostic actions. J R Coll Gen Pract. 1989 Dec;39(329):507–508. [PMC free article] [PubMed] [Google Scholar]
  32. Schaffner W., Ray W. A., Federspiel C. F., Miller W. O. Improving antibiotic prescribing in office practice. A controlled trial of three educational methods. JAMA. 1983 Oct 7;250(13):1728–1732. [PubMed] [Google Scholar]
  33. Schlager D. D. A comprehensive patient care system for the family practice. J Med Syst. 1983 Apr;7(2):137–145. doi: 10.1007/BF00995120. [DOI] [PubMed] [Google Scholar]
  34. Schroeder S. A., Myers L. P., McPhee S. J., Showstack J. A., Simborg D. W., Chapman S. A., Leong J. K. The failure of physician education as a cost containment strategy. Report of a prospective controlled trial at a university hospital. JAMA. 1984 Jul 13;252(2):225–230. [PubMed] [Google Scholar]
  35. Shaw C. D. Aspects of audit. 1. The background. Br Med J. 1980 May 24;280(6226):1256–1258. doi: 10.1136/bmj.280.6226.1256. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Shaw C. D. Aspects of audit. 3: Audit in British general practice. Br Med J. 1980 Jun 7;280(6228):1361–1363. doi: 10.1136/bmj.280.6228.1361. [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Shaw C. D. Aspects of audit. 4: Acceptability of audit. Br Med J. 1980 Jun 14;280(6229):1443–1446. doi: 10.1136/bmj.280.6229.1443. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. Shaw C. D. Aspects of audit. 5: Looking forward to audit. Br Med J. 1980 Jun 21;280(6230):1509–1511. doi: 10.1136/bmj.280.6230.1509. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Swor R. A., Hoelzer M. A computer-assisted quality assurance audit in a multiprovider EMS system. Ann Emerg Med. 1990 Mar;19(3):286–290. doi: 10.1016/s0196-0644(05)82048-7. [DOI] [PubMed] [Google Scholar]
  40. Tierney W. M., Miller M. E., McDonald C. J. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990 May 24;322(21):1499–1504. doi: 10.1056/NEJM199005243222105. [DOI] [PubMed] [Google Scholar]
  41. Weingarten M. A., Bazel D., Shannon H. S. Computerized protocol for preventive medicine: a controlled self-audit in family practice. Fam Pract. 1989 Jun;6(2):120–124. doi: 10.1093/fampra/6.2.120. [DOI] [PubMed] [Google Scholar]
  42. Wennberg J. E., Blowers L., Parker R., Gittelsohn A. M. Changes in tonsillectomy rates associated with feedback and review. Pediatrics. 1977 Jun;59(6):821–826. [PubMed] [Google Scholar]
  43. Wennberg J. E. Dealing with medical practice variations: a proposal for action. Health Aff (Millwood) 1984 Summer;3(2):6–32. doi: 10.1377/hlthaff.3.2.6. [DOI] [PubMed] [Google Scholar]
  44. Whiteside M. E., Lefkowitz S., Justiniani F. R., Ratzan K. Changing prescribing patterns: a program of physician education. Hosp Formul. 1987 Jun;22(6):561-3, 566, 568. [PubMed] [Google Scholar]
  45. Whiting-O'Keefe Q. E., Henke C., Simborg D. W. Choosing the correct unit of analysis in Medical Care experiments. Med Care. 1984 Dec;22(12):1101–1114. doi: 10.1097/00005650-198412000-00005. [DOI] [PubMed] [Google Scholar]
  46. Williams R. L., Chen P. M. Controlling the rise in cesarean section rates by the dissemination of information from vital records. Am J Public Health. 1983 Aug;73(8):863–867. doi: 10.2105/ajph.73.8.863. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Wones R. G. Failure of low-cost audits with feedback to reduce laboratory test utilization. Med Care. 1987 Jan;25(1):78–82. doi: 10.1097/00005650-198701000-00009. [DOI] [PubMed] [Google Scholar]
  48. Wynick D., Jessop J. H. A survey of cost awareness among hospital medical staff. Health Trends. 1985 Feb;17(1):24–24. [PubMed] [Google Scholar]

Articles from BMJ : British Medical Journal are provided here courtesy of BMJ Publishing Group

RESOURCES