Skip to main content
The BMJ logoLink to The BMJ
letter
. 2005 Jan 15;330(7483):145. doi: 10.1136/bmj.330.7483.145

Users' guide to detecting misleading claims in research

Misleading claims may be symptom of even more serious flaws

James Penston 1
PMCID: PMC544438  PMID: 15649934

Editor—Montori et al justifiably draw attention to misleading claims in published clinical trials.1 This is a serious and common problem.2,3 However, I object to their radical proposal that only the methods and results sections should be read, while the remainder of the paper should be ignored.

The proposal is inconsistent with the title of their paper, “Users' guide to detecting misleading claims in clinical research reports.”1 How are these misleading claims to be identified if the sections containing them are omitted? Furthermore, anyone capable of critically appraising a trial solely on the basis of the methods and results is unlikely to be fooled by misleading claims in the discussion.

But, more importantly, the proposal would deprive the discerning reader of witnessing the conflict between the results and the unwarranted conclusions. If researchers are willing to disseminate misleading claims then their integrity is brought into question. But if so, then all aspects of the trial—including the methods and results sections—are also brought into question. Misleading claims should be identified and broadcast loudly for they signal doubts about the entire study.

Large scale randomised trials create the ideal conditions for data manipulation. Yet this is merely one of a multitude of problems stemming from a flawed method.3 The remedy? When reading a study, ignore everything except the number of patients recruited. If this is large proceed no further as there is little prospect of encountering any data of genuine benefit to patients.

Competing interests: None declared.

References

  • 1.Montori VM, Jaeschke R, Schünemann HJ, Bhandari M, Brozek JA, Deveraux PJ, et al. User's guide to detecting misleading claims in clinical research reports. BMJ 2004;329: 1093-6. (6 November.) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Wennberg R, Zimmermann C. The PROGRESS trial three years later: time for a balanced report of effectiveness. BMJ 2004;329: 968-70. (23 October.) [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Penston J. Fiction and fantasy in medical research: the large-scale randomised trial. London: London Press, 2003.

Articles from BMJ : British Medical Journal are provided here courtesy of BMJ Publishing Group

RESOURCES