Skip to main content
Canadian Journal of Surgery logoLink to Canadian Journal of Surgery
. 2010 Feb;53(1):67–68.

Introduction to the series

Forough Farrokhyar *,†,, Mohit Bhandari †,
PMCID: PMC2810024  PMID: 20100417

In the hierarchy of evidence, randomized controlled trials (RCT) are considered the highest-quality design for evaluating an intervention. They are most valuable when conducted with precision and the results are reported with adequate and sufficient information. Since the term “evidence-based medicine” was coined in the 1990s,1 there has been regular debate about the perceived deficiencies of the evidence-based practice model in surgical specialties. Until recently, trials of surgical interventions have been uncommon, and much of the surgical decision-making has been based primarily on experience gained from poorly designed and low-quality studies such as case series. Several review articles have concluded that RCTs are not commonly reported in the surgical literature25 and that the quality of surgical trials are inferior compared with trials of medical interventions.3,57

As the number of published RCTs in the field of surgery increases, surgeons can use more high-quality evidence in their daily decision-making. With this increased focus on RCTs, we are realizing the spectrum of possible trials in surgery, including the comparison of new surgical procedures versus conventional procedures (type I), the comparison of surgical techniques to laparoscopic methods or to medical treatments (type II) and the evaluation of medical treatments (or drug trials) involving surgical patients (type III).8

One major difference between drug trials and surgical trials is that surgical trials require skills and training to administer the surgical procedure. Even for a fully trained surgeon, there is a learning process to become an expert at a new procedure. As well, there is inherent variation in the quality of performance of one procedure by different surgeons. Drug trials do not require any additional skills to administer an active medication (versus a placebo medication) to patients; however, surgical trials are prone to differential “expertise” bias. Along with a number of other challenges in surgical trials, including randomization, concealment, blinding, patient recruitment and differential expertise biases, improvements in both the quality of reporting and the conduct of surgical research are needed.

To complement the Canadian Journal of Surgery’s focus on evidence-based practice, this new series of short papers will provide “Practical Tips for Surgical Research.” Our goals are simple: to highlight the concepts of evidence-based surgery, discuss the methodological problems of conducting high-quality research in surgery and the potential biases introduced because of these problems and to provide surgeons and surgical researchers with the practical tips to avoid or minimize these biases. We will cover a broad range of concepts and methods that will be useful for producing high-quality evidence. We based our decision about the choice of topics to be covered in this series on a review of the literature, an evaluation of the reporting quality of published literature in different areas of surgery, highlighting the weaknesses of these reports and their impact on the quality of published evidence, as well as the group’s experiences in conducting research involving surgical patients.6,814 We hope that surgical communities will find this evidence-based series informative, and we, in turn, are interested in receiving feedback from readers about how these tips might further be improved or modified for surgical research settings.

Footnotes

Contributors: Drs. Farrokhyar and Bhandari initiated and cochaired this series of articles. They edited all manuscripts for accuracy and consistency of the concepts, content and format, as well as advised on all aspects of the project’s development. They approved this article for publication.

Competing interests: No funding was received for the preparation of this paper. Dr. Bhandari is funded, in part, by a Canada Research Chair at McMaster University.

References

  • 1.Oxman AD, Sackett DL, Guyatt GH The Evidence-Based Medicine Working Group. Users’ guides to the medical literature. I. How to get started. JAMA. 1993;270:2093–5. [PubMed] [Google Scholar]
  • 2.Solomon MJ, McLeod RS. Surgery and the randomised controlled trial: past, present and future. Med J Aust. 1998;169:380–3. doi: 10.5694/j.1326-5377.1998.tb126809.x. [DOI] [PubMed] [Google Scholar]
  • 3.Solomon MJ, Laxamana A, Devore L, et al. Randomized controlled trials in surgery. Surgery. 1994;115:707–12. [PubMed] [Google Scholar]
  • 4.Solomon MJ, McLeod RS. Should we be performing more randomized controlled trials evaluating surgical operations. Surgery. 1995;118:459–67. doi: 10.1016/s0039-6060(05)80359-9. [DOI] [PubMed] [Google Scholar]
  • 5.Panesar SS, Thakrar R, Athanasiou T, et al. Comparison of reports of randomized controlled trials and systematic reviews in surgical journals: literature review. J R Soc Med. 2006;99:470–2. doi: 10.1258/jrsm.99.9.470. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Farrokhyar F, Chu R, Whitlock R, et al. A systematic review of the quality of publications reporting coronary artery bypass grafting trials. Can J Surg. 2007;50:266–77. [PMC free article] [PubMed] [Google Scholar]
  • 7.Jacquier I, Boutron I, Moher D, et al. The reporting of randomized clinical trials using a surgical intervention is in need of immediate improvement: a systematic review. Ann Surg. 2006;244:677–83. doi: 10.1097/01.sla.0000242707.44007.80. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.McCulloch P, Taylor I, Sasako M, et al. Randomised trials in surgery: problems and possible solutions. BMJ. 2002;324:1448–51. doi: 10.1136/bmj.324.7351.1448. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Poolman RW, Sierevelt IN, Farrokhyar F, et al. Perceptions and competence in evidence-based medicine: Are surgeons getting better? A questionnaire survey of members of the Dutch Orthopaedic Association. J Bone Joint Surg Am. 2007;89:206–15. doi: 10.2106/JBJS.F.00633. [DOI] [PubMed] [Google Scholar]
  • 10.Poolman RW, Abouali JA, Conter HJ, et al. Overlapping systematic reviews of anterior cruciate ligament reconstruction comparing hamstring autograft with bone-patellar tendon-bone autograft: Why are they different. J Bone Joint Surg Am. 2007;89:1542–52. doi: 10.2106/JBJS.F.01292. [DOI] [PubMed] [Google Scholar]
  • 11.Poolman RW, Struijs PA, Krips R, et al. Reporting of outcomes in orthopaedic randomized trials: Does blinding of outcome assessors matter. J Bone Joint Surg Am. 2007;89:550–8. doi: 10.2106/JBJS.F.00683. [DOI] [PubMed] [Google Scholar]
  • 12.Zlowodzki M, Jonsson A, Bhandari M. Common pitfalls in the conduct of clinical research. Med Princ Pract. 2006;15:1–8. doi: 10.1159/000089379. [DOI] [PubMed] [Google Scholar]
  • 13.Thoma A. Challenges in creating a good randomized controlled trial in hand surgery. Clin Plast Surg. 2005;32:563–73. vii. doi: 10.1016/j.cps.2005.05.002. [DOI] [PubMed] [Google Scholar]
  • 14.Thoma A, Farrokhyar F, Bhandari M, et al. Users’ guide to the surgical literature. How to assess a randomized controlled trial in surgery. Can J Surg. 2004;47:200–8. [PMC free article] [PubMed] [Google Scholar]

Articles from Canadian Journal of Surgery are provided here courtesy of Canadian Medical Association

RESOURCES