Skip to main content
The BMJ logoLink to The BMJ
letter
. 2003 Sep 27;327(7417):752. doi: 10.1136/bmj.327.7417.752-b

Interpretation of randomised trials is indeed open to debate

Philipp Conradi 1,2, David Taylor 1,2
PMCID: PMC200843  PMID: 14512497

Editor—McCormack and Greenhalgh once argued that the interpretation of randomised controlled trials is open to debate.1 A recent BMJ news item featuring an overly favourable comment on the diabetes subtrial of the heart protection study illustrates this perfectly.2-4 We question the study's relevance to general practice on four points.

Generalisibility—The diabetes subtrial is part of the main study published in 2002. The researchers in the original trial excluded more than two thirds of the original 63 603 patients. Most of them opted out or were deemed not to be reliably compliant for the trial.

Bias—Analysis of the study's design raises the possibility of a non-match between treatment and control group5; there is a potentially important difference in the dropout rate.

Merging the boundaries—Both studies look at patients with and without preexisting cardiovascular disease. This is misleading as patients with established disease have a higher chance of benefit from lipid lowering treatment. We disagree with the impression in the BMJ news item that the case for using statins in diabetic patients without cardiovascular disease who have low density lipoprotein cholesterol, < 3.0 mmol/l, is made; the 3.1% absolute difference between treatment and placebo group is only marginally significant (P = 0.05%).

Presentation of results—Relative risk reduction and composite end points as seen in both studies exaggerate the potential benefit of a proposed treatment and should not be used in serious medical journals.

Competing interests: The authors are interested in real evidence based medicine.

References

  • 1.McCormack J, Greenhalgh T. Seeing what you want to see in randomised controlled trials: versions and perversions of UKPDS data. BMJ 2000;320: 1720-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Mayor S. Statins cut cardiovascular events by a quarter in people with diabetes. BMJ 2003:326: 1348. (21 June.)12816803 [Google Scholar]
  • 3.Heart Protection Study Collaborative Group. MRC/BHF heart protection study of cholesterol lowering with simvastatin in 5,963 people with diabetes: a randomised placebo controlled trial. Lancet 2003;361: 2005-16.12814710 [Google Scholar]
  • 4.Heart Protection Study Collaborative Group. MRC/BHF heart protection study of cholesterol lowering with simvastatin in 20,536 high risk individuals: a randomised placebo controlled trial. Lancet 2002;360: 7-22.12114036 [Google Scholar]
  • 5.MRC/BHF Heart Protection Study Collaborative Group. Heart protection study of cholesterol lowering therapy and antioxidant vitamin supplementation in a wide range of patients at increased risk of coronary heart disease death: early safety and efficacy experience. Eur Heart J 1999;20: 7254-741. [DOI] [PubMed] [Google Scholar]

Articles from BMJ : British Medical Journal are provided here courtesy of BMJ Publishing Group

RESOURCES