Abstract
OBJECTIVE: To examine the evidence that the teaching of critical appraisal (evidence-based medicine) skills to undergraduate medical students or residents will result in significant gains in knowledge and increased use of the literature in clinical decision-making. DATA SOURCES: Articles published from 1966 to 1995, retrieved through a MEDLINE search supplemented by manual searches; review of bibliographies maintained by individuals involved in teaching critical appraisal skills; and a previous methodological review. STUDY SELECTION: Articles were selected if the study involved some form of control group, although strict randomization was not required, and a measure of performance followed the intervention. Articles were excluded if they simply reported the process of teaching critical appraisal skills or used some form of "happiness index." DATA SYNTHESIS: There were 10 studies of the impact of teaching critical appraisal skills, 6 involving medical students and 4 involving residents. Results from 3 of the studies were nearly uninterpretable and thus were excluded; the remaining 7 were methodologically acceptable. Analysis showed that interventions implemented in undergraduate programs resulted in significant gains in knowledge, as assessed by a written test (mean gain 17.0%; standard deviation [SD] 4.0%). Conversely, studies at the residency level consistently showed a small change in knowledge (mean gain 1.3%; SD 1.7%). Two studies that examined residents' use of the literature were unable to demonstrate any positive changes. CONCLUSIONS: Studies of the effect of teaching critical appraisal skills on gains in knowledge at the undergraduate level showed consistent improvement. By contrast, changes in knowledge at the residency level were small. Several suggestions from the educational literature are offered to increase effectiveness of critical appraisal interventions.
Full Text
The Full Text of this article is available as a PDF (103.8 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Audet N., Gagnon R., Ladouceur R., Marcil M. L'enseignement de l'analyse critique des publications scientifiques médicales est-il efficace? Révision des études et de leur qualité méthodologique. CMAJ. 1993 Mar 15;148(6):945–952. [PMC free article] [PubMed] [Google Scholar]
- Bennett K. J., Sackett D. L., Haynes R. B., Neufeld V. R., Tugwell P., Roberts R. A controlled trial of teaching critical appraisal of the clinical literature to medical students. JAMA. 1987 May 8;257(18):2451–2454. [PubMed] [Google Scholar]
- Cuddy P. G., Elenbaas J. K., Coit K. J. The effectiveness of a slide-tape program on literature evaluation. J Biocommun. 1984 Aug;11(3):2–4. [PubMed] [Google Scholar]
- Frasca M. A., Dorsch J. L., Aldag J. C., Christiansen R. G. A multidisciplinary approach to information management and critical appraisal instruction: a controlled study. Bull Med Libr Assoc. 1992 Jan;80(1):23–28. [PMC free article] [PubMed] [Google Scholar]
- Gehlbach S. H., Bobula J. A., Dickinson J. C. Teaching residents to read the medical literature. J Med Educ. 1980 Apr;55(4):362–365. doi: 10.1097/00001888-198004000-00007. [DOI] [PubMed] [Google Scholar]
- Heller R. F., Peach H. Evaluation of a new course to teach the principles and clinical applications of epidemiology to medical students. Int J Epidemiol. 1984 Dec;13(4):533–537. doi: 10.1093/ije/13.4.533. [DOI] [PubMed] [Google Scholar]
- Landry F. J., Pangaro L., Kroenke K., Lucey C., Herbers J. A controlled trial of a seminar to improve medical student attitudes toward, knowledge about, and use of the medical literature. J Gen Intern Med. 1994 Aug;9(8):436–439. doi: 10.1007/BF02599058. [DOI] [PubMed] [Google Scholar]
- Linzer M., Brown J. T., Frazier L. M., DeLong E. R., Siegel W. C. Impact of a medical journal club on house-staff reading habits, knowledge, and critical appraisal skills. A randomized control trial. JAMA. 1988 Nov 4;260(17):2537–2541. [PubMed] [Google Scholar]
- Linzer M., DeLong E. R., Hupart K. H. A comparison of two formats for teaching critical reading skills in a medical journal club. J Med Educ. 1987 Aug;62(8):690–692. doi: 10.1097/00001888-198708000-00014. [DOI] [PubMed] [Google Scholar]
- Radack K. L., Valanis B. Teaching critical appraisal and application of medical literature to clinical problem-solving. J Med Educ. 1986 Apr;61(4):329–331. doi: 10.1097/00001888-198604000-00011. [DOI] [PubMed] [Google Scholar]
- Riegelman R. K. Effects of teaching first-year medical students skills to read medical literature. J Med Educ. 1986 Jun;61(6):454–460. doi: 10.1097/00001888-198606000-00003. [DOI] [PubMed] [Google Scholar]
- Romm F. J., Dignan M., Herman J. M. Teaching clinical epidemiology: a controlled trial of two methods. Am J Prev Med. 1989 Jan-Feb;5(1):50–51. [PubMed] [Google Scholar]
- Sackett D. L., Rosenberg W. M., Gray J. A., Haynes R. B., Richardson W. S. Evidence based medicine: what it is and what it isn't. BMJ. 1996 Jan 13;312(7023):71–72. doi: 10.1136/bmj.312.7023.71. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sackett D. L., Rosenberg W. M. On the need for evidence-based medicine. J Public Health Med. 1995 Sep;17(3):330–334. [PubMed] [Google Scholar]
- Sackett D. L., Rosenberg W. M. On the need for evidence-based medicine. Health Econ. 1995 Jul-Aug;4(4):249–254. doi: 10.1002/hec.4730040401. [DOI] [PubMed] [Google Scholar]
- Sackett D. L., Rosenberg W. M. The need for evidence-based medicine. J R Soc Med. 1995 Nov;88(11):620–624. doi: 10.1177/014107689508801105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shin J. H., Haynes R. B., Johnston M. E. Effect of problem-based, self-directed undergraduate education on life-long learning. CMAJ. 1993 Mar 15;148(6):969–976. [PMC free article] [PubMed] [Google Scholar]