Skip to main content
PMC home page
CMAJ : Canadian Medical Association Journal logoLink to CMAJ : Canadian Medical Association Journal
. 1994 Jul 1;151(1):47–54.

Methodologic quality and relevance of references in pharmaceutical advertisements in a Canadian medical journal.

J Lexchin 1, A Holbrook 1
PMCID: PMC1336849  PMID: 8004560

Abstract

OBJECTIVE: To evaluate the methodologic quality and relevance of references in pharmaceutical advertisements in the Canadian Medical Association Journal (CMAJ). DESIGN: Analytic study. DATA SOURCE: All 114 references cited in the first 22 distinct pharmaceutical advertisements in volume 146 of CMAJ. MAIN OUTCOME MEASURES: Mean methodologic quality score (modified from the 6-point scale used to assess articles in the American College of Physicians' Journal Club) and mean relevance score (based on a new 5-point scale) for all references in each advertisement. MAIN RESULTS: Twenty of the 22 companies responded, sending 78 (90%) of the 87 references requested. The mean methodologic quality score was 58% (95% confidence limits [CL] 51% and 65%) and the mean relevance score 76% (95% CL 72% and 80%). The two mean scores were statistically lower than the acceptable score of 80% (p < 0.05), and the methodologic quality score was outside the preset clinically significant difference of 15%. The poor rating for methodologic quality was primarily because of the citation of references to low-quality review articles and "other" sources (i.e., other than reports of clinical trials). Half of the advertisements had a methodologic quality score of less than 65%, but only five had a relevance score of less than 65%. CONCLUSIONS: Although the relevance of most of the references was within minimal acceptable limits, the methodologic quality was often unacceptable. Because advertisements are an important part of pharmaceutical marketing and education, we suggest that companies develop written standards for their advertisements and monitor their advertisements for adherence to these standards. We also suggest that the Pharmaceutical Advertising Advisory Board develop more stringent guidelines for advertising and that it enforce these guidelines in a consistent, rigorous fashion.

Full text

PDF
49

Selected References

These references are in PubMed. This may not be the complete list of references from this article.

  1. Avorn J., Chen M., Hartley R. Scientific versus commercial sources of influence on the prescribing behavior of physicians. Am J Med. 1982 Jul;73(1):4–8. doi: 10.1016/0002-9343(82)90911-1. [DOI] [PubMed] [Google Scholar]
  2. Bero L. A., Galbraith A., Rennie D. The publication of sponsored symposiums in medical journals. N Engl J Med. 1992 Oct 15;327(16):1135–1140. doi: 10.1056/NEJM199210153271606. [DOI] [PubMed] [Google Scholar]
  3. Christensen D. B., Wertheimer A. I. Sources of information and influence on new drug prescribing among physicians in an HMO. Soc Sci Med. 1979 May;13A(3):313–322. [PubMed] [Google Scholar]
  4. Eichorn P., Yankauer A. Do authors check their references? A survey of accuracy of references in three public health journals. Am J Public Health. 1987 Aug;77(8):1011–1012. doi: 10.2105/ajph.77.8.1011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Evans J. T., Nadjari H. I., Burchell S. A. Quotational and reference accuracy in surgical journals. A continuing peer review problem. JAMA. 1990 Mar 9;263(10):1353–1354. [PubMed] [Google Scholar]
  6. Fletcher R. H., Fletcher S. W. Pharmaceutical advertisements in medical journals. Ann Intern Med. 1992 Jun 1;116(11):951–952. doi: 10.7326/0003-4819-116-11-951. [DOI] [PubMed] [Google Scholar]
  7. Harvey K. Pharmaceutical promotion. Med J Aust. 1990 Jan 15;152(2):57–58. [PubMed] [Google Scholar]
  8. Herxheimer A., Collier J. Promotion by the British pharmaceutical industry, 1983-8: a critical analysis of self regulation. BMJ. 1990 Feb 3;300(6720):307–311. doi: 10.1136/bmj.300.6720.307. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Herxheimer A., Lundborg C. S., Westerholm B. Advertisements for medicines in leading medical journals in 18 countries: a 12-month survey of information content and standards. Int J Health Serv. 1993;23(1):161–172. doi: 10.2190/1AK2-X8CX-QQ9E-F6ED. [DOI] [PubMed] [Google Scholar]
  10. Krupka L. R., Vener A. M. Prescription drug advertising: trends and implications. Soc Sci Med. 1985;20(3):191–197. doi: 10.1016/0277-9536(85)90231-x. [DOI] [PubMed] [Google Scholar]
  11. Larson L. N., Smith M. C., Sharpe T. R., Hy R., Garner D. D. Government regulation and the believability of prescription drug advertising. An application of attribution theory and test of symbolic impact. Drug Intell Clin Pharm. 1977 Jun;11(6):338–343. doi: 10.1177/106002807701100602. [DOI] [PubMed] [Google Scholar]
  12. MAHON W. A., DANIEL E. E. A METHOD FOR THE ASSESSMENT OF REPORTS OF DRUG TRIALS. Can Med Assoc J. 1964 Feb 29;90:565–569. [PMC free article] [PubMed] [Google Scholar]
  13. Manning P. R., Denson T. A. How internists learned about cimetidine. Ann Intern Med. 1980 May;92(5):690–692. doi: 10.7326/0003-4819-92-5-690. [DOI] [PubMed] [Google Scholar]
  14. McCue J. D., Hansen C. J., Gal P. Physicians' opinions of the accuracy, accessibility, and frequency of use of ten sources of new drug information. South Med J. 1986 Apr;79(4):441–443. doi: 10.1097/00007611-198604000-00013. [DOI] [PubMed] [Google Scholar]
  15. Peay M. Y., Peay E. R. Differences among practitioners in patterns of preference for information sources in the adoption of new drugs. Soc Sci Med. 1984;18(12):1019–1025. doi: 10.1016/0277-9536(84)90160-6. [DOI] [PubMed] [Google Scholar]
  16. Peay M. Y., Peay E. R. Patterns of preference for information sources in the adoption of new drugs by specialists. Soc Sci Med. 1990;31(4):467–476. doi: 10.1016/0277-9536(90)90042-q. [DOI] [PubMed] [Google Scholar]
  17. Stimson G. V. The use of references in drug advertisements. J R Coll Gen Pract. 1976;26 (Suppl 1):76–80. [PMC free article] [PubMed] [Google Scholar]
  18. Strickland-Hodge B., Jeqson M. H. Usage of information sources by general practitioners. J R Soc Med. 1980 Dec;73(12):857–862. doi: 10.1177/014107688007301208. [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Wilkes M. S., Doblin B. H., Shapiro M. F. Pharmaceutical advertisements in leading medical journals: experts' assessments. Ann Intern Med. 1992 Jun 1;116(11):912–919. doi: 10.7326/0003-4819-116-11-912. [DOI] [PubMed] [Google Scholar]
  20. de Lacey G., Record C., Wade J. How accurate are quotations and references in medical journals? Br Med J (Clin Res Ed) 1985 Sep 28;291(6499):884–886. doi: 10.1136/bmj.291.6499.884. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from CMAJ: Canadian Medical Association Journal are provided here courtesy of Canadian Medical Association

RESOURCES