Skip to main content
NCBI home page
Quality & Safety in Health Care logoLink to Quality & Safety in Health Care
. 2005 Apr;14(2):99–106. doi: 10.1136/qshc.2004.011049

Pursuing integration of performance measures into electronic medical records: beta-adrenergic receptor antagonist medications

M Weiner 1, T Stump 1, C Callahan 1, J Lewis 1, C McDonald 1
PMCID: PMC1743979  PMID: 15805454

Abstract

Objective: Electronic medical records seldom integrate performance indicators into daily operations. Assessing quality indicators traditionally requires resource intensive chart reviews of small samples. We sought to use an electronic medical record to assess use of ß-adrenergic antagonist medications (ß-blockers) following myocardial infarction, to compare a standardized manual assessment with assessment using electronic medical records, and to discuss potential for future integration of performance indicators into electronic records.

Design: Cross-sectional data analysis.

Setting: An urban academic medical center.

Participants: US Medicare beneficiaries 65 years of age or older, admitted to hospital with myocardial infarction between 1995 and 1999.

Measurements and main results: Manual chart review was compared with a computer driven assessment of electronic records. Administration of ß-blockers and cases excluded from use of ß-blockers were measured, based on Medicare criteria. Among 4490 older adults, 391 (4%) of 9018 hospital admissions contained codes for myocardial infarction. In 323 (83%) of the 391 hospital admissions, criteria for excluding ß-blockers were met; 235 (60%) were excluded due to heart failure. Of 68 hospital admissions for myocardial infarction that did not meet exclusion criteria, physicians prescribed ß-blockers in 49 (72%) on admission and 42 (62%) at discharge. Compared with manual chart review, electronic review had a sensitivity of 83–100% and led to fewer false negative findings.

Conclusions: An electronic medical records system can be used instead of chart review to measure use of ß-blockers after myocardial infarction. This should lead to integration of real time automated performance measurement into electronic medical records.

Full Text

The Full Text of this article is available as a PDF (137.9 KB).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Avezum A., Tsuyuki R. T., Pogue J., Yusuf S. Beta-blocker therapy for congestive heart failure: a systemic overview and critical appraisal of the published trials. Can J Cardiol. 1998 Aug;14(8):1045–1053. [PubMed] [Google Scholar]
  2. Bates D. W., Cohen M., Leape L. L., Overhage J. M., Shabot M. M., Sheridan T. Reducing the frequency of errors in medicine using information technology. J Am Med Inform Assoc. 2001 Jul-Aug;8(4):299–308. doi: 10.1136/jamia.2001.0080299. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Bates D. W., Teich J. M., Lee J., Seger D., Kuperman G. J., Ma'Luf N., Boyle D., Leape L. The impact of computerized physician order entry on medication error prevention. J Am Med Inform Assoc. 1999 Jul-Aug;6(4):313–321. doi: 10.1136/jamia.1999.00660313. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Berwick D. M. Developing and testing changes in delivery of care. Ann Intern Med. 1998 Apr 15;128(8):651–656. doi: 10.7326/0003-4819-128-8-199804150-00009. [DOI] [PubMed] [Google Scholar]
  5. Brophy J. M., Joseph L., Rouleau J. L. Beta-blockers in congestive heart failure. A Bayesian meta-analysis. Ann Intern Med. 2001 Apr 3;134(7):550–560. doi: 10.7326/0003-4819-134-7-200104030-00008. [DOI] [PubMed] [Google Scholar]
  6. Brotons Carlos, Permanyer Gaietà, Pacheco Valeria, Moral Irene, Ribera Aida, Cascant Purificación, Pinar Josep, PREMISE study group Prophylactic treatment after myocardial infarction in primary care: how far can we go? Fam Pract. 2003 Feb;20(1):32–35. doi: 10.1093/fampra/20.1.32. [DOI] [PubMed] [Google Scholar]
  7. Chen J., Radford M. J., Wang Y., Marciniak T. A., Krumholz H. M. Are beta-blockers effective in elderly patients who undergo coronary revascularization after acute myocardial infarction? Arch Intern Med. 2000 Apr 10;160(7):947–952. doi: 10.1001/archinte.160.7.947. [DOI] [PubMed] [Google Scholar]
  8. Chen J., Radford M. J., Wang Y., Marciniak T. A., Krumholz H. M. Effectiveness of beta-blocker therapy after acute myocardial infarction in elderly patients with chronic obstructive pulmonary disease or asthma. J Am Coll Cardiol. 2001 Jun 1;37(7):1950–1956. doi: 10.1016/s0735-1097(01)01225-6. [DOI] [PubMed] [Google Scholar]
  9. Dexter P. R., Perkins S., Overhage J. M., Maharry K., Kohler R. B., McDonald C. J. A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med. 2001 Sep 27;345(13):965–970. doi: 10.1056/NEJMsa010181. [DOI] [PubMed] [Google Scholar]
  10. Dexter P. R., Wolinsky F. D., Gramelspacher G. P., Zhou X. H., Eckert G. J., Waisburd M., Tierney W. M. Effectiveness of computer-generated reminders for increasing discussions about advance directives and completion of advance directive forms. A randomized, controlled trial. Ann Intern Med. 1998 Jan 15;128(2):102–110. doi: 10.7326/0003-4819-128-2-199801150-00005. [DOI] [PubMed] [Google Scholar]
  11. DiSalvo T. G., Normand S. L., Hauptman P. J., Guadagnoli E., Palmer R. H., McNeil B. J. Pitfalls in assessing the quality of care for patients with cardiovascular disease. Am J Med. 2001 Sep;111(4):297–303. doi: 10.1016/s0002-9343(01)00842-7. [DOI] [PubMed] [Google Scholar]
  12. Ellerbeck E. F., Jencks S. F., Radford M. J., Kresowik T. F., Craig A. S., Gold J. A., Krumholz H. M., Vogel R. A. Quality of care for Medicare patients with acute myocardial infarction. A four-state pilot study from the Cooperative Cardiovascular Project. JAMA. 1995 May 17;273(19):1509–1514. [PubMed] [Google Scholar]
  13. Epstein Arnold M., Lee Thomas H., Hamel Mary Beth. Paying physicians for high-quality care. N Engl J Med. 2004 Jan 22;350(4):406–410. doi: 10.1056/NEJMsb035374. [DOI] [PubMed] [Google Scholar]
  14. Farrell Michael H., Foody JoAnne Micale, Krumholz Harlan M. beta-Blockers in heart failure: clinical applications. JAMA. 2002 Feb 20;287(7):890–897. doi: 10.1001/jama.287.7.890. [DOI] [PubMed] [Google Scholar]
  15. Fehrenbach S. N., Budnitz D. S., Gazmararian J. A., Krumholz H. M. Physician characteristics and the initiation of beta-adrenergic blocking agent therapy after acute myocardial infarction in a managed care population. Am J Manag Care. 2001 Jul;7(7):717–723. [PubMed] [Google Scholar]
  16. Foody JoAnne Micale, Farrell Michael H., Krumholz Harlan M. beta-Blocker therapy in heart failure: scientific review. JAMA. 2002 Feb 20;287(7):883–889. doi: 10.1001/jama.287.7.883. [DOI] [PubMed] [Google Scholar]
  17. Goldstein Sidney. Benefits of beta-blocker therapy for heart failure: weighing the evidence. Arch Intern Med. 2002 Mar 25;162(6):641–648. doi: 10.1001/archinte.162.6.641. [DOI] [PubMed] [Google Scholar]
  18. Gottlieb S. S., McCarter R. J., Vogel R. A. Effect of beta-blockade on mortality among high-risk and low-risk patients after myocardial infarction. N Engl J Med. 1998 Aug 20;339(8):489–497. doi: 10.1056/NEJM199808203390801. [DOI] [PubMed] [Google Scholar]
  19. Holmboe E. S., Meehan T. P., Radford M. J., Wang Y., Marciniak T. A., Krumholz H. M. Use of critical pathways to improve the care of patients with acute myocardial infarction. Am J Med. 1999 Oct;107(4):324–331. doi: 10.1016/s0002-9343(99)00239-9. [DOI] [PubMed] [Google Scholar]
  20. Howard P. A., Ellerbeck E. F. Optimizing beta-blocker use after myocardial infarction. Am Fam Physician. 2000 Oct 15;62(8):1853-60, 1865-6. [PubMed] [Google Scholar]
  21. Hussey Peter S., Anderson Gerard F., Osborn Robin, Feek Colin, McLaughlin Vivienne, Millar John, Epstein Arnold. How does the quality of care compare in five countries? Health Aff (Millwood) 2004 May-Jun;23(3):89–99. doi: 10.1377/hlthaff.23.3.89. [DOI] [PubMed] [Google Scholar]
  22. Iezzoni L. I., Burnside S., Sickles L., Moskowitz M. A., Sawitz E., Levine P. A. Coding of acute myocardial infarction. Clinical and policy implications. Ann Intern Med. 1988 Nov 1;109(9):745–751. doi: 10.7326/0003-4819-109-9-745. [DOI] [PubMed] [Google Scholar]
  23. Iezzoni L. I. Using administrative diagnostic data to assess the quality of hospital care. Pitfalls and potential of ICD-9-CM. Int J Technol Assess Health Care. 1990;6(2):272–281. doi: 10.1017/s0266462300000799. [DOI] [PubMed] [Google Scholar]
  24. Jencks S. F., Cuerdon T., Burwen D. R., Fleming B., Houck P. M., Kussmaul A. E., Nilasena D. S., Ordin D. L., Arday D. R. Quality of medical care delivered to Medicare beneficiaries: A profile at state and national levels. JAMA. 2000 Oct 4;284(13):1670–1676. doi: 10.1001/jama.284.13.1670. [DOI] [PubMed] [Google Scholar]
  25. Krumholz H. M. Key challenges in measuring quality of care: what needs to be done? Am J Med. 2001 Sep;111(4):324–325. doi: 10.1016/s0002-9343(01)00890-7. [DOI] [PubMed] [Google Scholar]
  26. Krumholz H. M., Radford M. J., Wang Y., Chen J., Heiat A., Marciniak T. A. National use and effectiveness of beta-blockers for the treatment of elderly patients after acute myocardial infarction: National Cooperative Cardiovascular Project. JAMA. 1998 Aug 19;280(7):623–629. doi: 10.1001/jama.280.7.623. [DOI] [PubMed] [Google Scholar]
  27. Krumholz H. M., Radford M. J., Wang Y., Chen J., Marciniak T. A. Early beta-blocker therapy for acute myocardial infarction in elderly patients. Ann Intern Med. 1999 Nov 2;131(9):648–654. doi: 10.7326/0003-4819-131-9-199911020-00003. [DOI] [PubMed] [Google Scholar]
  28. Leatherman Sheila, Berwick Donald, Iles Debra, Lewin Lawrence S., Davidoff Frank, Nolan Thomas, Bisognano Maureen. The business case for quality: case studies and an analysis. Health Aff (Millwood) 2003 Mar-Apr;22(2):17–30. doi: 10.1377/hlthaff.22.2.17. [DOI] [PubMed] [Google Scholar]
  29. Marshall M., Smith P. Rewarding results: using financial incentives to improve quality. Qual Saf Health Care. 2003 Dec;12(6):397–398. doi: 10.1136/qhc.12.6.397. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. McDonald C. J., Blevins L., Tierney W. M., Martin D. K. The Regenstrief medical records. MD Comput. 1988 Sep-Oct;5(5):34–47. [PubMed] [Google Scholar]
  31. McDonald C. J., Hui S. L., Smith D. M., Tierney W. M., Cohen S. J., Weinberger M., McCabe G. P. Reminders to physicians from an introspective computer medical record. A two-year randomized trial. Ann Intern Med. 1984 Jan;100(1):130–138. doi: 10.7326/0003-4819-100-1-130. [DOI] [PubMed] [Google Scholar]
  32. McDonald C. J., Overhage J. M., Tierney W. M., Dexter P. R., Martin D. K., Suico J. G., Zafar A., Schadow G., Blevins L., Glazener T. The Regenstrief Medical Record System: a quarter century experience. Int J Med Inform. 1999 Jun;54(3):225–253. doi: 10.1016/s1386-5056(99)00009-x. [DOI] [PubMed] [Google Scholar]
  33. McDonald C. J. Protocol-based computer reminders, the quality of care and the non-perfectability of man. N Engl J Med. 1976 Dec 9;295(24):1351–1355. doi: 10.1056/NEJM197612092952405. [DOI] [PubMed] [Google Scholar]
  34. Mehta Rajendra H., Montoye Cecelia K., Gallogly Meg, Baker Patricia, Blount Angela, Faul Jessica, Roychoudhury Canopy, Borzak Steven, Fox Susan, Franklin Mary. Improving quality of care for acute myocardial infarction: The Guidelines Applied in Practice (GAP) Initiative. JAMA. 2002 Mar 13;287(10):1269–1276. doi: 10.1001/jama.287.10.1269. [DOI] [PubMed] [Google Scholar]
  35. Overhage J. M., Tierney W. M., Zhou X. H., McDonald C. J. A randomized trial of "corollary orders" to prevent errors of omission. J Am Med Inform Assoc. 1997 Sep-Oct;4(5):364–375. doi: 10.1136/jamia.1997.0040364. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Phillips K. A., Shlipak M. G., Coxson P., Heidenreich P. A., Hunink M. G., Goldman P. A., Williams L. W., Weinstein M. C., Goldman L. Health and economic benefits of increased beta-blocker use following myocardial infarction. JAMA. 2000 Dec 6;284(21):2748–2754. doi: 10.1001/jama.284.21.2748. [DOI] [PubMed] [Google Scholar]
  37. Pladevall M., Goff D. C., Nichaman M. Z., Chan F., Ramsey D., Ortíz C., Labarthe D. R. An assessment of the validity of ICD Code 410 to identify hospital admissions for myocardial infarction: The Corpus Christi Heart Project. Int J Epidemiol. 1996 Oct;25(5):948–952. doi: 10.1093/ije/25.5.948. [DOI] [PubMed] [Google Scholar]
  38. Radford M. J., Krumholz H. M. Beta-blockers after myocardial infarction--for few patients, or many? N Engl J Med. 1998 Aug 20;339(8):551–553. doi: 10.1056/NEJM199808203390809. [DOI] [PubMed] [Google Scholar]
  39. Rathore S. S., Berger A. K., Weinfurt K. P., Feinleib M., Oetgen W. J., Gersh B. J., Schulman K. A. Race, sex, poverty, and the medical treatment of acute myocardial infarction in the elderly. Circulation. 2000 Aug 8;102(6):642–648. doi: 10.1161/01.cir.102.6.642. [DOI] [PubMed] [Google Scholar]
  40. Rubin H. R., Rogers W. H., Kahn K. L., Rubenstein L. V., Brook R. H. Watching the doctor-watchers. How well do peer review organization methods detect hospital care quality problems? JAMA. 1992 May 6;267(17):2349–2354. doi: 10.1001/jama.267.17.2349. [DOI] [PubMed] [Google Scholar]
  41. Ryan T. J., Anderson J. L., Antman E. M., Braniff B. A., Brooks N. H., Califf R. M., Hillis L. D., Hiratzka L. F., Rapaport E., Riegel B. J. ACC/AHA guidelines for the management of patients with acute myocardial infarction. A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee on Management of Acute Myocardial Infarction). J Am Coll Cardiol. 1996 Nov 1;28(5):1328–1428. doi: 10.1016/s0735-1097(96)00392-0. [DOI] [PubMed] [Google Scholar]
  42. Sheikh K., Bullock C. Urban-rural differences in the quality of care for medicare patients with acute myocardial infarction. Arch Intern Med. 2001 Mar 12;161(5):737–743. doi: 10.1001/archinte.161.5.737. [DOI] [PubMed] [Google Scholar]
  43. Sial S. H., Malone M., Freeman J. L., Battiola R., Nachodsky J., Goodwin J. S. Beta blocker use in the treatment of community hospital patients discharged after myocardial infarction. J Gen Intern Med. 1994 Nov;9(11):599–605. doi: 10.1007/BF02600301. [DOI] [PubMed] [Google Scholar]
  44. Tierney W. M., Hui S. L., McDonald C. J. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Med Care. 1986 Aug;24(8):659–666. doi: 10.1097/00005650-198608000-00001. [DOI] [PubMed] [Google Scholar]
  45. Tierney W. M., McDonald C. J., Martin D. K., Rogers M. P. Computerized display of past test results. Effect on outpatient testing. Ann Intern Med. 1987 Oct;107(4):569–574. doi: 10.7326/0003-4819-107-4-569. [DOI] [PubMed] [Google Scholar]
  46. Underwood P., Beck P. Secondary prevention following myocardial infarction: evidence from an audit in South Wales that the National Service Framework for coronary heart disease does not address all the issues. Qual Saf Health Care. 2002 Sep;11(3):230–232. doi: 10.1136/qhc.11.3.230. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Weiner Michael, Callahan Christopher M., Tierney William M., Overhage J. Marc, Mamlin Burke, Dexter Paul R., McDonald Clement J. Using information technology to improve the health care of older adults. Ann Intern Med. 2003 Sep 2;139(5 Pt 2):430–436. doi: 10.7326/0003-4819-139-5_part_2-200309021-00010. [DOI] [PubMed] [Google Scholar]

Articles from Quality & safety in health care are provided here courtesy of BMJ Publishing Group

RESOURCES