Abstract
Research is producing increasing amounts of important new evidence for health care, but there is a large gap between what this evidence shows can be done and the care that most patients actually receive. An important reason for this gap is the extensive processing that evidence requires before application. This article discusses a three-step model for bridging research evidence to management of clinical problems: getting the evidence straight, formulating evidence-based clinical policies, and applying evidence-based clinical policies at the right place and time. This model is purposely broad in scope and provides a framework for coordinating efforts to support evidence-based medical care. The authors' purpose is to represent the roles of health informatics in the context of the roles of all the key players, including health care researchers and practitioners, health care organizations, and the public. Health informatics has already made important contributions to bridging evidence to practice, including improving evidence retrieval, evaluation, and synthesis; new evidence-based information products; and computerized aids for facilitating the use of these products during clinical decision making. However, much more innovation and coordination are needed. The authors call for health informaticians to pay balanced attention to 1) the quality of evidence embodied in information innovations, 2) the performance of technologies and systems that retrieve, prepare, disseminate, and apply evidence, and 3) the fit of information tools to the specific clinical circumstances in which evidence is to be applied. Effective interdisciplinary teams that include health services researchers and other evidence experts, clinical practitioners, informaticians, and health care managers are needed to achieve success. Informaticians can make increasingly important contributions to the transfer of health care research by joining such teams.
Full Text
The Full Text of this article is available as a PDF (1.0 MB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Anderson F. A., Jr, Wheeler H. B., Goldberg R. J., Hosmer D. W., Forcier A., Patwardhan N. A. Physician practices in the prevention of venous thromboembolism. Ann Intern Med. 1991 Oct 15;115(8):591–595. doi: 10.7326/0003-4819-591. [DOI] [PubMed] [Google Scholar]
- Anderson G. Implementing practice guidelines. CMAJ. 1993 Mar 1;148(5):753–755. [PMC free article] [PubMed] [Google Scholar]
- Antman E. M., Lau J., Kupelnick B., Mosteller F., Chalmers T. C. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992 Jul 8;268(2):240–248. [PubMed] [Google Scholar]
- Battista R. N., Hodge M. J. Clinical practice guidelines: between science and art. CMAJ. 1993 Feb 1;148(3):385–389. [PMC free article] [PubMed] [Google Scholar]
- Blumenthal D. Total quality management and physicians' clinical decisions. JAMA. 1993 Jun 2;269(21):2775–2778. [PubMed] [Google Scholar]
- Browman G. P., Levine M. N., Mohide E. A., Hayward R. S., Pritchard K. I., Gafni A., Laupacis A. The practice guidelines development cycle: a conceptual tool for practice guidelines development and implementation. J Clin Oncol. 1995 Feb;13(2):502–512. doi: 10.1200/JCO.1995.13.2.502. [DOI] [PubMed] [Google Scholar]
- Cairns J. A., Fuster V., Kennedy J. W. Coronary thrombolysis. Chest. 1992 Oct;102(4 Suppl):482S–507S. doi: 10.1378/chest.102.4_supplement.482s. [DOI] [PubMed] [Google Scholar]
- Chalmers I., Dickersin K., Chalmers T. C. Getting to grips with Archie Cochrane's agenda. BMJ. 1992 Oct 3;305(6857):786–788. doi: 10.1136/bmj.305.6857.786. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cook D. J., Guyatt G. H., Laupacis A., Sackett D. L. Rules of evidence and clinical recommendations on the use of antithrombotic agents. Chest. 1992 Oct;102(4 Suppl):305S–311S. [PubMed] [Google Scholar]
- Covell D. G., Uman G. C., Manning P. R. Information needs in office practice: are they being met? Ann Intern Med. 1985 Oct;103(4):596–599. doi: 10.7326/0003-4819-103-4-596. [DOI] [PubMed] [Google Scholar]
- Dalen J. E., Hirsh J. Antithrombotic therapy. Introduction. Chest. 1992 Oct;102(4 Suppl):303S–304S. [PubMed] [Google Scholar]
- Davidoff F., Case K., Fried P. W. Evidence-based medicine: why all the fuss? Ann Intern Med. 1995 May 1;122(9):727–727. doi: 10.7326/0003-4819-122-9-199505010-00012. [DOI] [PubMed] [Google Scholar]
- Davis D. A., Thomson M. A., Oxman A. D., Haynes R. B. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995 Sep 6;274(9):700–705. doi: 10.1001/jama.274.9.700. [DOI] [PubMed] [Google Scholar]
- Detsky A. S., Redelmeier D., Abrams H. B. What's wrong with decision analysis? Can the left brain influence the right? J Chronic Dis. 1987;40(9):831–838. doi: 10.1016/0021-9681(87)90181-0. [DOI] [PubMed] [Google Scholar]
- Doorey A. J., Michelson E. L., Topol E. J. Thrombolytic therapy of acute myocardial infarction. Keeping the unfulfilled promises. JAMA. 1992 Dec 2;268(21):3108–3114. [PubMed] [Google Scholar]
- East T. D., Böhm S. H., Wallace C. J., Clemmer T. P., Weaver L. K., Orme J. F., Jr, Morris A. H. A successful computerized protocol for clinical management of pressure control inverse ratio ventilation in ARDS patients. Chest. 1992 Mar;101(3):697–710. doi: 10.1378/chest.101.3.697. [DOI] [PubMed] [Google Scholar]
- Eraker S. A., Eeckhoudt L. R., Vanbutsele R. J., Lebrun T. C., Sailly J. C. To test or not to test--to treat or not to treat: the decision-threshold approach to patient management. J Gen Intern Med. 1986 May-Jun;1(3):177–182. doi: 10.1007/BF02602334. [DOI] [PubMed] [Google Scholar]
- Evans C. E., Haynes R. B., Birkett N. J., Gilbert J. R., Taylor D. W., Sackett D. L., Johnston M. E., Hewson S. A. Does a mailed continuing education program improve physician performance? Results of a randomized trial in antihypertensive care. JAMA. 1986 Jan 24;255(4):501–504. [PubMed] [Google Scholar]
- Evans C. E., Haynes R. B., Gilbert J. R., Taylor D. W., Sackett D. L., Johnston M. Educational package on hypertension for primary care physicians. Can Med Assoc J. 1984 Mar 15;130(6):719–722. [PMC free article] [PubMed] [Google Scholar]
- Fletcher R. H., Fletcher S. W. Clinical practice guidelines. Ann Intern Med. 1990 Nov 1;113(9):645–646. doi: 10.7326/0003-4819-113-9-645. [DOI] [PubMed] [Google Scholar]
- Gonzalez E. R., Vanderheyden B. A., Ornato J. P., Comstock T. G. Computer-assisted optimization of aminophylline therapy in the emergency department. Am J Emerg Med. 1989 Jul;7(4):395–401. doi: 10.1016/0735-6757(89)90046-6. [DOI] [PubMed] [Google Scholar]
- Gray D., Keating N. A., Murdock J., Skene A. M., Hampton J. R. Impact of hospital thrombolysis policy on out-of-hospital response to suspected myocardial infarction. Lancet. 1993 Mar 13;341(8846):654–657. doi: 10.1016/0140-6736(93)90420-l. [DOI] [PubMed] [Google Scholar]
- Guyatt G. H., Rennie D. Users' guides to the medical literature. JAMA. 1993 Nov 3;270(17):2096–2097. [PubMed] [Google Scholar]
- Guyatt G. H., Sackett D. L., Cook D. J. Users' guides to the medical literature. II. How to use an article about therapy or prevention. A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 1993 Dec 1;270(21):2598–2601. doi: 10.1001/jama.270.21.2598. [DOI] [PubMed] [Google Scholar]
- Guyatt G. H., Sackett D. L., Cook D. J. Users' guides to the medical literature. II. How to use an article about therapy or prevention. B. What were the results and will they help me in caring for my patients? Evidence-Based Medicine Working Group. JAMA. 1994 Jan 5;271(1):59–63. doi: 10.1001/jama.271.1.59. [DOI] [PubMed] [Google Scholar]
- Haynes R. B. Loose connections between peer-reviewed clinical journals and clinical practice. Ann Intern Med. 1990 Nov 1;113(9):724–728. doi: 10.7326/0003-4819-113-9-724. [DOI] [PubMed] [Google Scholar]
- Haynes R. B., McKibbon K. A., Walker C. J., Ryan N., Fitzgerald D., Ramsden M. F. Online access to MEDLINE in clinical settings. A study of use and usefulness. Ann Intern Med. 1990 Jan 1;112(1):78–84. doi: 10.7326/0003-4819-112-1-78. [DOI] [PubMed] [Google Scholar]
- Haynes R. B., Mulrow C. D., Huth E. J., Altman D. G., Gardner M. J. More informative abstracts revisited. Ann Intern Med. 1990 Jul 1;113(1):69–76. doi: 10.7326/0003-4819-113-1-69. [DOI] [PubMed] [Google Scholar]
- Haynes R. B., Ramsden M. F., McKibbon K. A., Walker C. J. Online access to MEDLINE in clinical settings: impact of user fees. Bull Med Libr Assoc. 1991 Oct;79(4):377–381. [PMC free article] [PubMed] [Google Scholar]
- Haynes R. B. Some problems in applying evidence in clinical practice. Ann N Y Acad Sci. 1993 Dec 31;703:210–225. doi: 10.1111/j.1749-6632.1993.tb26350.x. [DOI] [PubMed] [Google Scholar]
- Haynes R. B., Walker C. J., McKibbon K. A., Johnston M. E., Willan A. R. Performances of 27 MEDLINE systems tested by searches with clinical questions. J Am Med Inform Assoc. 1994 May-Jun;1(3):285–295. doi: 10.1136/jamia.1994.95236159. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Haynes R. B., Wilczynski N., McKibbon K. A., Walker C. J., Sinclair J. C. Developing optimal search strategies for detecting clinically sound studies in MEDLINE. J Am Med Inform Assoc. 1994 Nov-Dec;1(6):447–458. doi: 10.1136/jamia.1994.95153434. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hayward R. S., Laupacis A. Initiating, conducting and maintaining guidelines development programs. CMAJ. 1993 Feb 15;148(4):507–512. [PMC free article] [PubMed] [Google Scholar]
- Jaeschke R., Guyatt G. H., Sackett D. L. Users' guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. JAMA. 1994 Mar 2;271(9):703–707. doi: 10.1001/jama.271.9.703. [DOI] [PubMed] [Google Scholar]
- Johnston M. E., Langton K. B., Haynes R. B., Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome. A critical appraisal of research. Ann Intern Med. 1994 Jan 15;120(2):135–142. doi: 10.7326/0003-4819-120-2-199401150-00007. [DOI] [PubMed] [Google Scholar]
- Jutras D. Clinical practice guidelines as legal norms. CMAJ. 1993 Mar 15;148(6):905–908. [PMC free article] [PubMed] [Google Scholar]
- Kassirer J. P., Moskowitz A. J., Lau J., Pauker S. G. Decision analysis: a progress report. Ann Intern Med. 1987 Feb;106(2):275–291. doi: 10.7326/0003-4819-106-2-275. [DOI] [PubMed] [Google Scholar]
- Krahn M., Naylor C. D., Basinski A. S., Detsky A. S. Comparison of an aggressive (U.S.) and a less aggressive (Canadian) policy for cholesterol screening and treatment. Ann Intern Med. 1991 Aug 15;115(4):248–255. doi: 10.7326/0003-4819-115-4-248. [DOI] [PubMed] [Google Scholar]
- Lau J., Antman E. M., Jimenez-Silva J., Kupelnick B., Mosteller F., Chalmers T. C. Cumulative meta-analysis of therapeutic trials for myocardial infarction. N Engl J Med. 1992 Jul 23;327(4):248–254. doi: 10.1056/NEJM199207233270406. [DOI] [PubMed] [Google Scholar]
- Laupacis A., Wells G., Richardson W. S., Tugwell P. Users' guides to the medical literature. V. How to use an article about prognosis. Evidence-Based Medicine Working Group. JAMA. 1994 Jul 20;272(3):234–237. doi: 10.1001/jama.272.3.234. [DOI] [PubMed] [Google Scholar]
- Levine M., Walter S., Lee H., Haines T., Holbrook A., Moyer V. Users' guides to the medical literature. IV. How to use an article about harm. Evidence-Based Medicine Working Group. JAMA. 1994 May 25;271(20):1615–1619. doi: 10.1001/jama.271.20.1615. [DOI] [PubMed] [Google Scholar]
- Lomas J. Making clinical policy explicit. Legislative policy making and lessons for developing practice guidelines. Int J Technol Assess Health Care. 1993 Winter;9(1):11–25. doi: 10.1017/s0266462300002993. [DOI] [PubMed] [Google Scholar]
- Lomas J. Retailing research: increasing the role of evidence in clinical services for childbirth. Milbank Q. 1993;71(3):439–475. [PubMed] [Google Scholar]
- McDonald C. J., Overhage J. M. Guidelines you can follow and can trust. An ideal and an example. JAMA. 1994 Mar 16;271(11):872–873. [PubMed] [Google Scholar]
- McDowell I., Newell C., Rosser W. Comparison of three methods of recalling patients for influenza vaccination. CMAJ. 1986 Nov 1;135(9):991–997. [PMC free article] [PubMed] [Google Scholar]
- McDowell I., Newell C., Rosser W. Computerized reminders to encourage cervical screening in family practice. J Fam Pract. 1989 Apr;28(4):420–424. [PubMed] [Google Scholar]
- Moher D., Dulberg C. S., Wells G. A. Statistical power, sample size, and their reporting in randomized controlled trials. JAMA. 1994 Jul 13;272(2):122–124. [PubMed] [Google Scholar]
- Mosteller F. The prospect of data-based medicine in the light of ECPC. Milbank Q. 1993;71(3):523–532. [PubMed] [Google Scholar]
- Osheroff J. A., Forsythe D. E., Buchanan B. G., Bankowitz R. A., Blumenfeld B. H., Miller R. A. Physicians' information needs: analysis of questions posed during clinical teaching. Ann Intern Med. 1991 Apr 1;114(7):576–581. doi: 10.7326/0003-4819-114-7-576. [DOI] [PubMed] [Google Scholar]
- Oxman A. D., Cook D. J., Guyatt G. H. Users' guides to the medical literature. VI. How to use an overview. Evidence-Based Medicine Working Group. JAMA. 1994 Nov 2;272(17):1367–1371. doi: 10.1001/jama.272.17.1367. [DOI] [PubMed] [Google Scholar]
- Oxman A. D. Coordination of guidelines development. CMAJ. 1993 Apr 15;148(8):1285–1288. [PMC free article] [PubMed] [Google Scholar]
- Oxman A. D., Guyatt G. H. A consumer's guide to subgroup analyses. Ann Intern Med. 1992 Jan 1;116(1):78–84. doi: 10.7326/0003-4819-116-1-78. [DOI] [PubMed] [Google Scholar]
- Oxman A. D., Guyatt G. H. Guidelines for reading literature reviews. CMAJ. 1988 Apr 15;138(8):697–703. [PMC free article] [PubMed] [Google Scholar]
- Oxman A. D., Sackett D. L., Guyatt G. H. Users' guides to the medical literature. I. How to get started. The Evidence-Based Medicine Working Group. JAMA. 1993 Nov 3;270(17):2093–2095. [PubMed] [Google Scholar]
- Ramsey P. G., Carline J. D., Inui T. S., Larson E. B., LoGerfo J. P., Norcini J. J., Wenrich M. D. Changes over time in the knowledge base of practicing internists. JAMA. 1991 Aug 28;266(8):1103–1107. [PubMed] [Google Scholar]
- Rodman J. H., Jelliffe R. W., Kolb E., Tuey D. B., de Guzman M. F., Wagers P. W., Haywood L. J. Clinical studies with computer-assisted initial lidocaine therapy. Arch Intern Med. 1984 Apr;144(4):703–709. [PubMed] [Google Scholar]
- Shin J. H., Haynes R. B., Johnston M. E. Effect of problem-based, self-directed undergraduate education on life-long learning. CMAJ. 1993 Mar 15;148(6):969–976. [PMC free article] [PubMed] [Google Scholar]
- Somerville M. A. Ethics and clinical practice guidelines. CMAJ. 1993 Apr 1;148(7):1133–1137. [PMC free article] [PubMed] [Google Scholar]
- Stiell I. G., Greenberg G. H., McKnight R. D., Nair R. C., McDowell I., Reardon M., Stewart J. P., Maloney J. Decision rules for the use of radiography in acute ankle injuries. Refinement and prospective validation. JAMA. 1993 Mar 3;269(9):1127–1132. doi: 10.1001/jama.269.9.1127. [DOI] [PubMed] [Google Scholar]
- Stiell I. G., McKnight R. D., Greenberg G. H., McDowell I., Nair R. C., Wells G. A., Johns C., Worthington J. R. Implementation of the Ottawa ankle rules. JAMA. 1994 Mar 16;271(11):827–832. [PubMed] [Google Scholar]
- Tierney W. M., Miller M. E., Overhage J. M., McDonald C. J. Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. JAMA. 1993 Jan 20;269(3):379–383. [PubMed] [Google Scholar]
- Wallingford K. T., Humphreys B. L., Selinger N. E., Siegel E. R. Bibliographic retrieval: a survey of individual users of MEDLINE. MD Comput. 1990 May-Jun;7(3):166–171. [PubMed] [Google Scholar]
- Wilczynski N. L., Walker C. J., McKibbon K. A., Haynes R. B. Assessment of methodologic search filters in MEDLINE. Proc Annu Symp Comput Appl Med Care. 1993:601–605. [PMC free article] [PubMed] [Google Scholar]
- Wilczynski N. L., Walker C. J., McKibbon K. A., Haynes R. B. Quantitative comparison of pre-explosions and subheadings with methodologic search terms in MEDLINE. Proc Annu Symp Comput Appl Med Care. 1994:905–909. [PMC free article] [PubMed] [Google Scholar]
- Woo B., Woo B., Cook E. F., Weisberg M., Goldman L. Screening procedures in the asymptomatic adult. Comparison of physicians' recommendations, patients' desires, published guidelines, and actual practice. JAMA. 1985 Sep 20;254(11):1480–1484. doi: 10.1001/jama.254.11.1480. [DOI] [PubMed] [Google Scholar]
- Yusuf S., Collins R., Peto R. Why do we need some large, simple randomized trials? Stat Med. 1984 Oct-Dec;3(4):409–422. doi: 10.1002/sim.4780030421. [DOI] [PubMed] [Google Scholar]