Skip to main content
NCBI home page
Canadian Family Physician logoLink to Canadian Family Physician
. 1995 Aug;41:1356–1360.

Comprehensiveness and bias in reporting clinical trials. Study of reviews of pneumococcal vaccine effectiveness.

B G Hutchison 1, A D Oxman 1, S Lloyd 1
PMCID: PMC2146347  PMID: 7580384

Abstract

PURPOSE: To assess the extent to which relevant controlled clinical trials are cited and summarized in review articles, and to determine whether citation of relevant clinical trails is biased as to study results. DATA SOURCES: Articles were identified by searching MEDLINE and EMBASE databases. STUDY SELECTION: Review articles published between 1986 and 1988 on the clinical effectiveness of pneumococcal vaccine. DATA EXTRACTION: Proportion of relevant clinical trials cited and whether citation is biased by study results. DATA SYNTHESIS: The proportion of relevant primary studies cited per review article ranged from 0% to 36% (mean 9%). The number of trials cited per review ranged from zero to six (mean 1.2). In nine of 17 reviews, no clinical trials were cited. Study populations and outcome(s) were specified and results presented quantitatively for 0 to 27% of relevant trials per review (mean 6%). Unsupportive trials were almost twice as likely to be cited as supportive trials. CONCLUSIONS: Reporting of the results of relevant clinical trials in reviews of pneumococcal vaccine effectiveness is incomplete. Our findings suggest a need for greater scientific rigour in preparing, reviewing, and editing review articles.

Full text

PDF
1356

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Antman E. M., Lau J., Kupelnick B., Mosteller F., Chalmers T. C. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992 Jul 8;268(2):240–248. [PubMed] [Google Scholar]
  2. Austrian R. Pneumococcal pneumonia. Diagnostic, epidemiologic, therapeutic and prophylactic considerations. Chest. 1986 Nov;90(5):738–743. doi: 10.1378/chest.90.5.738. [DOI] [PubMed] [Google Scholar]
  3. Bentley D. W. Immunizations in the elderly. Bull N Y Acad Med. 1987 Jul-Aug;63(6):533–551. [PMC free article] [PubMed] [Google Scholar]
  4. Broome C. V. Use of bacterial vaccines for prevention of pneumococcal and meningococcal disease in the day care setting. Rev Infect Dis. 1986 Jul-Aug;8(4):584–588. doi: 10.1093/clinids/8.4.584. [DOI] [PubMed] [Google Scholar]
  5. Davies A. J., Kumaratne D. S. The continuing problem of pneumococcal infection. J Antimicrob Chemother. 1988 Apr;21(4):387–391. doi: 10.1093/jac/21.4.387. [DOI] [PubMed] [Google Scholar]
  6. Fedson D. S. Adult immunization: protocols and problems. Hosp Pract (Off Ed) 1986 Jul 15;21(7):143–158. [PubMed] [Google Scholar]
  7. Fedson D. S. Influenza and pneumococcal immunization strategies for physicians. Chest. 1987 Mar;91(3):436–443. doi: 10.1378/chest.91.3.436. [DOI] [PubMed] [Google Scholar]
  8. Gøtzsche P. C. Reference bias in reports of drug trials. Br Med J (Clin Res Ed) 1987 Sep 12;295(6599):654–656. [PMC free article] [PubMed] [Google Scholar]
  9. Kafidi K. T., Rotschafer J. C. Bacterial vaccines for splenectomized patients. Drug Intell Clin Pharm. 1988 Mar;22(3):192–197. doi: 10.1177/106002808802200302. [DOI] [PubMed] [Google Scholar]
  10. Kramer M. R., Rudensky B., Hadas-Halperin I., Isacsohn M., Melzer E. Pneumococcal bacteremia--no change in mortality in 30 years: analysis of 104 cases and review of the literature. Isr J Med Sci. 1987 Mar;23(3):174–180. [PubMed] [Google Scholar]
  11. LaForce F. M. Pneumonia--1987: new developments. Eur J Clin Microbiol. 1987 Dec;6(6):613–617. doi: 10.1007/BF02013054. [DOI] [PubMed] [Google Scholar]
  12. Mulrow C. D. The medical review article: state of the science. Ann Intern Med. 1987 Mar;106(3):485–488. doi: 10.7326/0003-4819-106-3-485. [DOI] [PubMed] [Google Scholar]
  13. Niederman M. S. Strategies for the prevention of pneumonia. Clin Chest Med. 1987 Sep;8(3):543–556. [PubMed] [Google Scholar]
  14. Oxman A. D., Guyatt G. H. Guidelines for reading literature reviews. CMAJ. 1988 Apr 15;138(8):697–703. [PMC free article] [PubMed] [Google Scholar]
  15. Ravnskov U. Cholesterol lowering trials in coronary heart disease: frequency of citation and outcome. BMJ. 1992 Jul 4;305(6844):15–19. doi: 10.1136/bmj.305.6844.15. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Robbins F. C., Robbins J. B. Current status and prospects for some improved and new bacterial vaccines. Annu Rev Public Health. 1986;7:105–125. doi: 10.1146/annurev.pu.07.050186.000541. [DOI] [PubMed] [Google Scholar]
  17. Sacks H. S., Berrier J., Reitman D., Ancona-Berk V. A., Chalmers T. C. Meta-analyses of randomized controlled trials. N Engl J Med. 1987 Feb 19;316(8):450–455. doi: 10.1056/NEJM198702193160806. [DOI] [PubMed] [Google Scholar]
  18. Silagy C. A. An analysis of review articles published in primary care journals. Fam Pract. 1993 Sep;10(3):337–341. doi: 10.1093/fampra/10.3.337. [DOI] [PubMed] [Google Scholar]
  19. Stansfield S. K. Acute respiratory infections in the developing world: strategies for prevention, treatment and control. Pediatr Infect Dis J. 1987 Jul;6(7):622–629. doi: 10.1097/00006454-198707000-00002. [DOI] [PubMed] [Google Scholar]
  20. Williams W. W., Hickson M. A., Kane M. A., Kendal A. P., Spika J. S., Hinman A. R. Immunization policies and vaccine coverage among adults. The risk for missed opportunities. Ann Intern Med. 1988 Apr;108(4):616–625. doi: 10.7326/0003-4819-108-4-616. [DOI] [PubMed] [Google Scholar]

Articles from Canadian Family Physician are provided here courtesy of College of Family Physicians of Canada

RESOURCES