Skip to main content
CMAJ : Canadian Medical Association Journal logoLink to CMAJ : Canadian Medical Association Journal
. 1993 Mar 15;148(6):945–952.

L'enseignement de l'analyse critique des publications scientifiques médicales est-il efficace? Révision des études et de leur qualité méthodologique.

How effective is the teaching of critical analysis of scientific publications? Review of studies and their methodological quality

N Audet 1, R Gagnon 1, R Ladouceur 1, M Marcil 1
PMCID: PMC1490748  PMID: 8448709

Abstract

OBJECTIVE: To evaluate studies assessing the effectiveness of teaching critical appraisal of the literature to medical students. DATA SOURCES: French and English articles published between 1980 and 1990 indexed on MEDLINE or FAMLI as well as articles identified from the bibliographies. STUDY SELECTION: Studies were evaluated if the subjects were undergraduate or postgraduate medical students and if the teaching intervention was aimed at improving one or more of the following areas: knowledge in clinical epidemiology and biostatistics, reading habits and ability to critically appraise a scientific article. DATA EXTRACTION: The methodologic quality of the articles was assessed by three evaluators, who used a modified version of Poynard's checklist to assign a score. Articles with a score of 60% or more were considered satisfactory. The reliability of the checklist was evaluated by means of the kappa (kappa) coefficient and a coefficient of intraclass correlation. DATA SYNTHESIS: For the three evaluators the mean kappa coefficient was 0.33 and the coefficient of intraclass correlation 0.70. Five of the 10 studies had an overall score of 60% or higher. The quality of the individual sections of the articles varied: purpose of the study 85%, description of the population 58%, methods 44%, analysis of results 50%, and conclusions 90%. CONCLUSIONS: The effectiveness of teaching critical appraisal of the literature remains uncertain. More rigorous methods are needed in research in this area.

Full text

PDF
945

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Bartko J. J., Carpenter W. T., Jr On the methods and theory of reliability. J Nerv Ment Dis. 1976 Nov;163(5):307–317. doi: 10.1097/00005053-197611000-00003. [DOI] [PubMed] [Google Scholar]
  2. Bennett K. J., Sackett D. L., Haynes R. B., Neufeld V. R., Tugwell P., Roberts R. A controlled trial of teaching critical appraisal of the clinical literature to medical students. JAMA. 1987 May 8;257(18):2451–2454. [PubMed] [Google Scholar]
  3. Cuddy P. G., Elenbaas J. K., Coit K. J. The effectiveness of a slide-tape program on literature evaluation. J Biocommun. 1984 Aug;11(3):2–4. [PubMed] [Google Scholar]
  4. Curry L., Putnam R. W. Continuing medical education in Maritime Canada: the methods physicians use, would prefer and find most effective. Can Med Assoc J. 1981 Mar 1;124(5):563–566. [PMC free article] [PubMed] [Google Scholar]
  5. Gardner M. J., Bond J. An exploratory study of statistical assessment of papers published in the British Medical Journal. JAMA. 1990 Mar 9;263(10):1355–1357. [PubMed] [Google Scholar]
  6. Gehlbach S. H., Bobula J. A., Dickinson J. C. Teaching residents to read the medical literature. J Med Educ. 1980 Apr;55(4):362–365. doi: 10.1097/00001888-198004000-00007. [DOI] [PubMed] [Google Scholar]
  7. Kitchens J. M., Pfeifer M. P. Teaching residents to read the medical literature: a controlled trial of a curriculum in critical appraisal/clinical epidemiology. J Gen Intern Med. 1989 Sep-Oct;4(5):384–387. doi: 10.1007/BF02599686. [DOI] [PubMed] [Google Scholar]
  8. Krogh C. L. A checklist system for critical review of medical literature. Med Educ. 1985 Sep;19(5):392–395. doi: 10.1111/j.1365-2923.1985.tb01343.x. [DOI] [PubMed] [Google Scholar]
  9. Linzer M., Brown J. T., Frazier L. M., DeLong E. R., Siegel W. C. Impact of a medical journal club on house-staff reading habits, knowledge, and critical appraisal skills. A randomized control trial. JAMA. 1988 Nov 4;260(17):2537–2541. [PubMed] [Google Scholar]
  10. Linzer M. Critical appraisal: more work to be done. J Gen Intern Med. 1989 Sep-Oct;4(5):457–459. doi: 10.1007/BF02599700. [DOI] [PubMed] [Google Scholar]
  11. Linzer M., DeLong E. R., Hupart K. H. A comparison of two formats for teaching critical reading skills in a medical journal club. J Med Educ. 1987 Aug;62(8):690–692. doi: 10.1097/00001888-198708000-00014. [DOI] [PubMed] [Google Scholar]
  12. Poynard T. Evaluation de la qualité méthodologique des essais thérapeutiques randomisés. Presse Med. 1988 Feb 27;17(7):315–318. [PubMed] [Google Scholar]
  13. Riegelman R. K. Effects of teaching first-year medical students skills to read medical literature. J Med Educ. 1986 Jun;61(6):454–460. doi: 10.1097/00001888-198606000-00003. [DOI] [PubMed] [Google Scholar]
  14. Riegelman R. K., Povar G. J., Ott J. E. Medical students' skills, attitudes, and behavior needed for literature reading. J Med Educ. 1983 May;58(5):411–417. doi: 10.1097/00001888-198305000-00007. [DOI] [PubMed] [Google Scholar]
  15. Romm F. J., Dignan M., Herman J. M. Teaching clinical epidemiology: a controlled trial of two methods. Am J Prev Med. 1989 Jan-Feb;5(1):50–51. [PubMed] [Google Scholar]
  16. Stinson E. R., Mueller D. A. Survey of health professionals' information habits and needs. Conducted through personal interviews. JAMA. 1980 Jan 11;243(2):140–143. [PubMed] [Google Scholar]

Articles from CMAJ: Canadian Medical Association Journal are provided here courtesy of Canadian Medical Association

RESOURCES