Introduction
As the current debates throughout the US attest, there are wide disagreements about the shape of future US health care delivery. Nevertheless, a general consensus has emerged about the need for more efficient interventions that are based on reliable scientific evidence. This need has been filled by evidence-based medicine (EBM), which employs meta-analyses and randomized controlled trials (RCTs) to examine the effectiveness of interventions on large populations. These findings are reviewed by the Cochrane Collaboration, a group of volunteers from around the globe who publish their findings quarterly in the Cochrane Database of Systematic Reviews.1,2
Although it seems difficult to deny the efficacy of statistically robust research, medical practitioners, especially those involved in primary care, are often skeptical about EBM, fearing that the physician–patient encounter will be undermined, and with it, the most appropriate mechanism to determine a diagnosis and treatment.3,4 These physicians are sometimes portrayed as representing an older, more traditional segment of the profession, but their hesitancy also represents more than fear of change. Increasingly sensitive to this resistance, advocates continue to reassure practitioners that EBM will not subvert the physician–patient encounter but instead will integrate “the values and preferences of the informed patient.”5 Certainly before EBM becomes legislated by agencies and insurance companies alike, it deserves the same careful examination that it claims to have made of specific conditions. Although the RCT gold standard requires prospective studies, EBM is best evaluated through retrospective analysis—that is, in historical perspective.
I argue that EBM must be closely evaluated and critically appraised because it is subject to its own set of defects. Such a revised EBM would be best implemented in a context that maintains sensitivity to individuality and to physician–patient interactions.
Background
The ascendency of EBM in North America and the United Kingdom has its roots in the exponential growth of medical scientific research in the post–World War II years.6 By the third quarter of the 20th century, medical research had become a scientific enterprise, whereas much of medical care remained an art. The goal of EBM was to transform the art of medical care into a science.7 However, as Kathryn Montgomery has recently argued so eloquently, despite its reliance on scientific knowledge and its use of technology, medicine is not a science. Rather, it is a science-using practice whose goals are to prevent illness and care for the sick.8,9 The issue remains of whether EBM enables physicians to more fully practice their craft or whether instead, as a number of authors whose works are discussed here indicate, EBM has created an additional barrier to doing so.10
EBM was envisioned as a division of labor in which scientific evidence would be generated by researchers at prestigious research and medical institutions and implementation would take place in practitioners' clinics. In reality, many clinical trials are done in the private offices of specialist physicians who derive a significant amount of income from the pharmaceutical industry. Nevertheless, such a system, whether intended or not, has produced a growing schism between academic medicine and clinical practice that often finds expression in concerns over the impact of EBM on the integrity of the physician–patient relationship.3,4 This tension has its roots in the 1970s, when academic medicine, emphasizing its connection to research, began to distinguish itself from normal clinical practice. By the 1980s, it became clear that medical research was not easily translated into practice. Thus, research-based medicine was augmented by the establishment of professional clinical practice guidelines based on evidence gleaned from retrospective reviews of published RCTs. Practitioners, however, did not apply the guidelines consistently, if at all. (Kaiser Permanente [KP] established the Care Management Institute in 1997 to summarize and disseminate “best practices” and to assist “in the care of KP members by synthesizing knowledge about superior clinical approaches including the creation, implementation and evaluation of effective care management practices.”11) If clinical medicine were to become a science, statistically significant research findings would have to be translated in a user-friendly fashion for everyday practice.
The Evidence-Based Manifesto
This was the context for the EBM manifesto of the clinical epidemiology program at McMaster University in Canada published in the Journal of the American Medical Association (JAMA) in 1992.12 The manifesto called for the replacement of clinical decision making that was based on anecdotal and idiosyncratic physician experiences with scientifically informed and statistically significant findings from population-based studies.13 The most frequently cited definition of EBM is reliance on the “conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients,” which is based on an integration of “individual clinical expertise with the best available external clinical evidence from systematic research.”13 Evidence-based practices have been launched in general medicine and specialized fields.14,15 In 2001, the prestigious Institute of Medicine's Committee on Quality of Health Care in America endorsed “evidence-based, patient-centered, health care delivery” as essential to the quality of health care.16
Initially, EBM rejected medical practices that were based on anecdotal and idiosyncratic physician experiences in favor of statistically significant findings from population-based studies. Interventions based on individual cases or small cohorts were portrayed as suspect and quaint. Instead, practitioners were urged to apply findings from population-based studies to their own clinical practice. Not surprisingly, this stance resulted in more than a little resistance and much criticism from a number of practitioners. In response, advocates of EBM increasingly have attempted to portray it as complementary to clinical experience, and there have been calls for a more integrated approach.17
Nevertheless, as it has developed since 1992, EBM relies on the elaborate system of publication and peer review of medical research. It requires that clinicians keep themselves updated on new research findings, become skilled literature researchers and methodologists, learn how to apply and interpret sophisticated statistical analyses, and translate all these findings into everyday clinical practice.5,12 The challenge is to find time to do so, including interpreting and translating the findings as presented.6,18 Although practical concerns have been raised about physicians relying on electronic databases, their ability to determine the validity of the data that constitute EBM is more problematic.19 Moreover, as Timmermans and Mauck observed, in practice EBM “is loosely used and can refer to anything from conducting a statistical meta-analysis of accumulated research to promoting randomized clinical trials, to supporting uniform reporting styles for research, to a personal orientation toward critical self-evaluation.”20
Evidence-Based Authority
Although there is no formal single EBM information authority in the US or Canada, in Britain the National Institute of Clinical Excellence (NICE) was established by the government in 1999 and expanded in 2005. NICE serves as an independent health authority responsible for producing evidence-based public health and clinical guidance for the National Health Service. Recently there have been calls for a similar body in the US.5,21
Tied as it is to external funding, EBM has been enthusiastically supported by medical school administrators, who judge and reward faculty by the number and dollar amount of their external grant funding. EBM has also gained much impetus from the pharmaceutical industry, which provides substantial funding for clinical trials.
EBM has transformed the transmission of medical knowledge. The disease mysteries and insights of the medical detectives that once populated medical journals have been relegated to the back pages. The patient increasingly has been replaced by the statistic. Patient narratives have become suspect and devalued as merely anecdotal. Moreover, human subject protection and ethics require that published cases be sufficiently altered so that the identity of a patient is not revealed.22 Thus published patient narratives are, of necessity, fictions. Such narratives now provide material for books, op-ed columns, films, and television programming, but not for EBM.
The Critics
EBM is not without its critics, who warn that the art of medical practice is in danger of being overwhelmed by disinterested science, on the one hand, and cost-cutting corporate bureaucrats, on the other.10,19 These concerns have grown over the years, including those of David L Sackett, one of the authors of the McMaster manifesto. Sackett questioned the direction that EBM was taking and expressed frustration over what he considered the harmful effects of expert claims.23 Other critics have characterized reliance on data from population studies and clinical trials as Galenic scholasticism, in which the skills associated with close readings of texts have replaced the actual physician–patient encounter.24 In contrast, the physician's familiarity with a patient's life history is portrayed as local knowledge that enables the clinician to tailor contextualized diagnoses, treatments, and advice that mesh with individual needs. Patient narratives serve as exemplars of what allegedly has been lost. These narratives are also literary devices that at once reveal the clinician's diagnostic and interpersonal skills, while exposing the danger of a mechanistic application of population studies. Case histories are presented as mirrors of the best of medical education in which individual cases are interrogated and, in the process, reveal why some patients fared well and others poorly when placed on similar regimens. What is at stake, these stories suggest, is nothing less than the clinical encounter itself.25,26
Ghaemi reminds us that there is no such thing as “non-evidence-based” medicine, rather there are many levels of evidence, ranging from case series to doubleblind RCTs. “In my reading of EBM,” writes Ghaemi, “the basic idea is that we need to understand what kinds of evidence we use, and we need to use the best kinds we can.”27 But how robust is the evidence produced even by gold-standard RCTs? Not very, according to a recent study published in the Annals of Internal Medicine. The investigation, conducted by the Ottawa Health Research Institute, found that 15% of “best evidence” recommendations were reversed in two years; in three years, 23% were reversed; and in five and half years, 50%.28 Commenting on the study, Groopman and Hartzband noted that “Americans have witnessed these reversals firsthand as firm ‘expert’ recommendations about the benefits of estrogen replacement therapy for postmenopausal women, low-fat diets for obesity, and tight control of blood sugar were overturned.”29 Who wants their care predicated on recommendations half of which are proven wrong within five years?
If clinical practice demands sensitivity, EBM, in contrast, requires specificity (reliability); each piece of data must be (as much as possible) identical to another. Thus, patients' complaints are evaluated in the context of the findings of population studies. However, according to Groopman, specificity can be misleading because patients present for treatment with combinations of conditions that do not match the evidence. For Groopman, EBM interferes with evaluating individual patient complaints because the physician is drawn toward statistical findings that seduce practitioners to cease listening even as their patients continue talking. Thus, EBM leads physicians to fail to incorporate the most important source of evidence, sensitivity to what their patients can reveal about their conditions.30 Paying attention to a patient's narrative is crucial, argue EBM critics, because patients with similar signs and symptoms, even with the same diagnosis, often require different treatment.9 Added to this is Michael Balint's observation31 that “doctors see patients because of disease. Patients see doctors because of anxiety. Therein lies the problem between the two.”
Evidence-Based Medicine and the Art of Medical Practice
“There is one aspect of medicine that will surely survive, the need for a compassionate, competent person to help another confront the suffering of illness,” wrote Jerry Avorn of Boston's Brigham and Women's Hospital and author of Powerful Medicines: The Benefits, Risks, and Costs of Prescription Drugs.26 Whereas such sentiments reflect the Oslerian ideal of the medical encounter,32 one may reasonably wonder the extent to which these ideals reflect actual medical practices or nostalgia for a mythic golden age of physician–patient collaboration.
Some scholars, such as Australian medical ethicist Malcolm Parker, believe that there is no substantive reason for EBM to undercut the art of medical practice. Parker argues that such claims are based on “false dichotomies” because there is no necessary contradiction between medical science and medical art; that, in fact “EBM is a necessary condition for clinical freedom.”33 However, citing data from the NICE guidelines, Parker concedes that EBM has a number of structural weaknesses, not least of all that “rather than starting with health care priorities and setting the research agenda on that basis, the system tends to be inverted by EBM, with research often being performed as much for commercial as for scientific and health reasons.” Of course, here Parker is alluding to the influence of the pharmaceutical industry in shaping the research agenda of EBM in the United Kingdom. As he notes, this agenda has a direct impact on patient care because “there appears to be little systematic inquiry into what areas are poorly researched, how research priorities are identified, and who runs research.”
… “there appears to be little systematic inquiry into what areas are poorly researched, how research priorities are identified, and who runs research.”
Evidence-Based Medicine and the Pharmaceutical Industry
Despite the idealized claim that EBM would be the product of objective research conducted by disinterested medical researchers, pharmaceutical industry–sponsored clinical trials can have a corrosive impact both on physicians who derive substantial income from their participation and, in turn, on evidence claims themselves. Moreover, not all clinical trial results are published, especially those whose results fail to demonstrate the benefits of an agent in a pharmaceutical-sponsored trial.34
This situation has attracted the attention of a number of respected North American and British medical academics. They argue that pharmaceutical companies have infiltrated the medical research enterprise, hijacking the peer-review process into a vehicle for drug marketing. These critics believe the validity and veracity of peer-reviewed research is being undermined, subverting the foundation of EBM.35,36
According to Harvard University internist John Abramson, the pharmaceutical industry has inserted itself into every aspect of medical practice, from medical education to basic research and clinical care, endangering the integrity of the American health care delivery system and subverting the trust between patient and practitioner.24 Marcia Angell, former editor-in-chief of the New England Journal of Medicine, links the near collapse of health care in the US directly to the corrupting practices of the pharmaceutical industry.37 In Selling Sickness: How the World's Biggest Pharmaceutical Companies Are Turning Us All into Patients (2005), British Columbia medical researchers Ray Moynihan and Alan Cassels argue that unfavorable research results are eliminated from or camouflaged in the texts of industry-influenced studies and that data often are remolded in ways that present favorable results when a more transparent analysis might reveal substantial risk for patients taking the “hyped” medications.38 British psychiatrist David Healy has written eloquently about the influence of the pharmaceutical industry in silencing and marginalizing even its most balanced critics.39
Building on these concerns, a special communication published in January 2006 in JAMA by a consortium of distinguished researchers, practitioners, and ethicists from eight of North America's leading medical schools urged adoption of a series of measures aimed at insulating practitioners and academic medical researchers from what they believed to be the pharmaceutical industry's corrosive effect on medical research and practice.40 These recommendations reveal the growing anxiety, at least among some highly regarded and influential medical faculty, that the pharmaceutical industry has placed the practice of medicine, especially EBM, at dire risk.
Thus, despite the logic of Parker's analysis, the context of the current debate, framed as it is by the pharmaceutical industry's influence over EBM, exacerbates practitioners' suspicions. It is difficult, though perhaps not impossible, to imagine that an independent EBM could strengthen the physician–patient collaboration. However, EBM has not been liberated from pharmaceutical industry influence. Until it is, EBM, as practiced rather than as imagined, may continue to interfere with, rather than enable, the type of physician–patient collaborations that critics wish to nurture. Once—and if—industry influence is contained, the knowledge claims of an unfettered EBM may be reintegrated with the art of practice. Even then, physicians should be vigilant against the inappropriate reliance on population health studies for treatment of individual patients.
Valuable Tool versus All-Encompassing Panacea
Since the late 20th century, physicians and public-health researchers have understood the value of identifying risk factors as a prophylactic against a number of chronic conditions, including lung cancer, heart disease, and diabetes. As a number of recent studies have warned, however, risks can often be exaggerated in self-serving studies, presenting greater health hazards than the ones they putatively protect against.41–43 A similar danger is found with EBM. It can serve as a valuable tool when properly understood, but we should not regard it as the all-encompassing panacea for the future of medicine. As with the promiscuous and often exaggerated labeling of a variety of relatively benign behaviors and conditions as risk factors, uncritical reliance on EBM can result in serious side effects.
Disclosure Statement
The author(s) have no conflicts of interest to disclose.
Acknowledgments
I thank Vincent Felitti, MD, for his comments and suggestions and Carol Kushner for editorial assistance.
Katharine O'Moore-Klopf, ELS, of KOK Edit provided editorial assistance.
Soul of the healer
Lester DR Thompson, MD, is a Pathologist at the Woodland Hills Medical Center in Woodland Hills, CA. As a Pathologist, he looks through a microscope all day to try to separate colors and shapes into meaningful diagnoses. He finds that working with stained glass is a similar, though more creative, process.
Dr Thompson collaborated with his wife, Pamela, to create this piece to honor the 25th wedding anniversary of his sister-in-law and brother, Glynn M Thompson, MD, a physician in the Kaiser Permanente Mid-Atlantic Region.
References
- 1.Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of CareReview Group. BMJ. 1998 Aug 15;317(7156):465–8. doi: 10.1136/bmj.317.7156.465. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Thomson R. Evidence based implementation of complex interventions. BMJ 2009 Aug. 12;339:b3505. doi: 10.1136/bmj.b3124. [DOI] [PubMed] [Google Scholar]
- 3.Pope C. Resisting evidence: the study of evidence-based medicine as a contemporary social movement. Health. 2003;7(3):267–82. [Google Scholar]
- 4.Porta M. Is there life after evidence-based medicine? J Eval Clin Practice. 2004 May;10(2):147–52. doi: 10.1111/j.1365-2753.2003.00473.x. [DOI] [PubMed] [Google Scholar]
- 5.Montori VM, Guyatt GH. Progress in evidence-based medicine. JAMA. 2008 Oct 15;300(15):1814–6. doi: 10.1001/jama.300.15.1814. [DOI] [PubMed] [Google Scholar]
- 6.Upshur RE. Looking for rules in a world of exceptions: reflections on evidence-based practice. Perspect Biol Med. 2005 Autumn;48(4):477–89. doi: 10.1353/pbm.2005.0098. [DOI] [PubMed] [Google Scholar]
- 7.Goldenberg MJ, Borgerson K, Bluhm R. The nature of evidence in evidence-based medicine: guest editors’ introduction. Perspect Biol Med. 2009;52(2):164–7. doi: 10.1353/pbm.0.0077. [DOI] [PubMed] [Google Scholar]
- 8.Felitti VJ. How doctors think: clinical judgment and the practice of medicine [review] Perm J. 2007 Summer;11(3):93. [Google Scholar]
- 9.Montgomery K. How doctors think: clinical judgment and the practice of medicine. New York: Oxford University Press; 2006. p. viii. [Google Scholar]
- 10.Goldenberg MJ. Iconoclast or creed?. Objectivism, pragmatism, and the hierarchy of evidence. Perspect Biol Med. 2009 Spring;52(2):168–87. doi: 10.1353/pbm.0.0080. [DOI] [PubMed] [Google Scholar]
- 11.Care Management Institute. [Web page on the Internet]. Oakland, CA: Kaiser Permanente. 2009. [cited 2010 Jan 27]. Available from: www.kpcmi.org/about/.
- 12.Evidence-Based Medicine Working Group. Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992 Nov 4;268(17):2420–5. doi: 10.1001/jama.1992.03490170092032. [DOI] [PubMed] [Google Scholar]
- 13.Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't. BMJ. 1996 Jan 13;312(7023):71–2. doi: 10.1136/bmj.312.7023.71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Davidoff F, Haynes B, Sackett D, Smith R. Evidence based medicine. BMJ. 1995 Apr 29;310(6987):1085–6. doi: 10.1136/bmj.310.6987.1085. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Grahame-Smith D. Evidence based medicine: Socratic dissent. BMJ. 1995 Apr 29;310(6987):1126–7. doi: 10.1136/bmj.310.6987.1126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the quality chasm: a new health system for the 21st century. Washington, DC: National Academy Press; 2001. [PubMed] [Google Scholar]
- 17.Eddy DM. Evidence-based medicine: a unified approach. Health Aff (Millwood) 2005 Jan-Feb;24(1):9–17. doi: 10.1377/hlthaff.24.1.9. [DOI] [PubMed] [Google Scholar]
- 18.Guyatt GH, Meade MD, Jaeschke RZ, Cook DJ, Haynes RB. Practitioners of evidence based care. Not all clinicians need to appraise evidence from scratch but all need some skills. BMJ. 2000 Apr 8;320(7240):954–5. doi: 10.1136/bmj.320.7240.954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Upshur R. Making the grade: assuring trustworthiness in evidence. Perspect Biol Med. 2009;52(2):264–75. doi: 10.1353/pbm.0.0079. [DOI] [PubMed] [Google Scholar]
- 20.Timmermans S, Mauck A. The promises and pitfalls of evidence-based medicine. Health Aff (Millwood) 2005 Jan-Feb;24(1):18–28. doi: 10.1377/hlthaff.24.1.18. [DOI] [PubMed] [Google Scholar]
- 21.Kendall T, McGoey L, Jackson E. If NICE was in the USA. Lancet. 2009 Jul 25;374(9686):272–3. doi: 10.1016/S0140-6736(09)60781-9. [DOI] [PubMed] [Google Scholar]
- 22.Weisse AB. I was a mole in an IRB. Perspect Biol Med. 2009 Summer;52(3):435–41. doi: 10.1353/pbm.0.0100. [DOI] [PubMed] [Google Scholar]
- 23.Sackett DL. The sins of expertness and a proposal for redemption. BMJ. 2000 May 6;320(7244):1283. [PMC free article] [PubMed] [Google Scholar]
- 24.Giacomini M. Theory-based medicine and the role of evidence: why the emperor needs new clothes, again. Perspect Biol Med. 2009;52(2):234–51. doi: 10.1353/pbm.0.0088. [DOI] [PubMed] [Google Scholar]
- 25.Abramson J. Overdosed America: the broken promise of American medicine. New York: HarperCollins; 2004. [Google Scholar]
- 26.Avorn J. Powerful medicines: the benefits, risks, and costs of prescription drugs. New York: Knopf; 2004. [Google Scholar]
- 27.Ghaemi SN. A clinician's guide to statistics and epidemiology in mental health: measuring truth and uncertainty. New York: Cambridge University Press; 2009. [Google Scholar]
- 28.Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date?. A survival analysis. Ann Intern Med. 2007 Aug 21;147(4):224–33. doi: 10.7326/0003-4819-147-4-200708210-00179. [DOI] [PubMed] [Google Scholar]
- 29.Groopman J, Hartzband P. Sorting fact from fiction on health care [monograph on the Internet]. New York: Wall Street Journal. 2009 Aug 31. [cited 2010 Jan 27]. Available from: http://online.wsj.com/article/SB10001424052970203 706604574378542143891778.html.
- 30.Groopman J. How doctors think. New York: Houghton Mifflin; 2007. [Google Scholar]
- 31.Balint M. The doctor, his patient, and the illness. Revised ed. New York: International Universities Press; 1973. p. 54. [Google Scholar]
- 32.Osler W. The principles and practice of medicine: designed for the use of practitioners and students of medicine. Edinburgh & London: Young J Pentland; 1892. p. xvi. [Google Scholar]
- 33.Parker M. False dichotomies: EBM, clinical freedom, and the art of medicine. Med Humanit. 2005 Jun;31(1):23–30. doi: 10.1136/jmh.2004.000195. [DOI] [PubMed] [Google Scholar]
- 34.Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008 Jan 17;358(3):252–60. doi: 10.1056/NEJMsa065779. [DOI] [PubMed] [Google Scholar]
- 35.Kushner HI. The other war on drugs: the pharmaceutical industry, evidence-based medicine, and clinical practice. Journal of Policy History. 2007;19(1):49–70. [Google Scholar]
- 36.McGoey L. Sequestered evidence and the distortion of clinical practice guidelines. Perspect Biol Med. 2009 Spring;52(2):203–17. doi: 10.1353/pbm.0.0084. [DOI] [PubMed] [Google Scholar]
- 37.Angell M. The truth about the drug companies: how they deceive us and what to do about it. 1st ed. New York: Random House; 2004. p. xx. [Google Scholar]
- 38.Moynihan R, Cassels A. Selling sickness: how the world's biggest pharmaceutical companies are turning us all into patients. New York: Nation Books; 2005. [Google Scholar]
- 39.Healy D. Let them eat Prozac: the unhealthy relationship between the pharmaceutical industry and depression, medicine, culture, and history. New York: New York UniversityPress; 2004. p. xvi. [Google Scholar]
- 40.Brennan TA, Rothman DJ, Blank L, et al. Health industry practices that create conflicts of interest: a policy proposal for academic medical centers. JAMA. 2006 Jan25;295(4):429–33. doi: 10.1001/jama.295.4.429. [DOI] [PubMed] [Google Scholar]
- 41.Greene JA. Prescribing by numbers: drugs and the definition of disease. Baltimore, MD: Johns Hopkins University Press; 2007. p. xv. [Google Scholar]
- 42.Grob G. Risk factors: how well do they explain disease etiology. MD Advisor; 2008 Spring. pp. 22–7. [PubMed] [Google Scholar]
- 43.Rothstein WG. Public health and the risk factor: a history of an uneven medical revolution. (Rochester studies in medical history.) Rochester, NY: University of Rochester Press; 2003. p. xiii. [Google Scholar]