Randomized clinical trials (RCTs) represent the best study design for minimizing bias when investigating the effectiveness of a form of treatment. RCTs also are the building blocks of systematic reviews and meta-analyses, which allow more generalizable conclusions to be drawn about therapeutic efficacy [1], provided that the trials themselves are well-designed and implemented, and provided that all of the data are available for such analyses.
Unfortunately, meta-analyses can only include those data that the authors can find. Many prospective trials are started but never finished, and many more are completed but never published [2–5]. The RCTs that are published therefore only represent a proportion of those that are undertaken, and there is compelling evidence that if a study has a positive outcome it is more likely to be published [6].
Selective publication of this sort, sometimes called publication bias or positive-outcome bias, is harmful for at least two reasons. First, if two studies—one showing positive results and one showing no difference between interventions—have been performed, and the study with the positive outcome is more likely to be published and therefore available for meta-analysis, meta-analyses will tend to inflate the apparent benefits of a treatment and de-emphasize its harms [7, 8]. This may lead to the inappropriate adoption of new interventions that are less effective than they seem and that almost always are more expensive. Second, when studies that record no difference between interventions are performed but not published, a wasteful duplication of resources is likely to ensue when clinicians subsequently conduct trials that unbeknownst to them have already been carried out.
A solution to this problem has existed for some time. RCTs should be registered in one of the numerous publicly available, free, searchable, well-maintained repositories of clinical trials before the first patient is enrolled [9–11]. In addition to mitigating positive-outcome bias and reducing the likelihood that expensive, time-consuming trials will needlessly and unknowingly be repeated, prospective registration helps journals to minimize data dredging by allowing verification that the end points reported were the end points initially proposed by the researchers [12]. Prospective registration also allows patients to identify trials in which they may wish to enroll, and it can help institutional review boards find research germane to the studies that they evaluate [13].
For several years, The Journal of Bone and Joint Surgery, The Bone & Joint Journal, and Clinical Orthopaedics and Related Research ® have either required or encouraged trials to be registered but permitted it to be done retrospectively (that is, after the study had been completed). We now all concur that this is not sufficient. Retrospective registration merely to allow a paper to be considered for publication by a journal does not allow the identification of no-difference findings, minimize data dredging, help patients find care, or support ethics panels in their important work. The International Committee of Medical Journal Editors (ICMJE) has required that its member journals insist on prospective registration for more than a decade now [14]. It is time for the leading journals of orthopaedic surgery to do likewise.
With that in mind, as of now, The Journal of Bone and Joint Surgery, The Bone & Joint Journal, and CORR ® require registration in a publicly searchable clinical trials registry prior to the publication of RCTs, and the registry number of the trial will be published in the electronic and print versions of these papers. Until the end of 2017, which we consider a transition period, this registration may take place either prospectively or retrospectively; but as of January 1, 2018, authors of all RCTs that began after the publication of this editorial must demonstrate proof of prospective registration to be considered for review by any of our three journals.
We understand that there will be rare situations in which prospective registration is not possible or not appropriate, and we will be receptive to such claims. In these situations, the authors will be expected to explain in the limitations section of the paper the reasons for non-registration, and the editors will add a note to the title page of such a paper explaining why the exception was permitted. However, simple omission of prospective registration will not be considered a suitable excuse; the principles at stake here are too important.
We encourage all orthopaedic journals to join us in setting and maintaining this important principle underlying the reporting of research in our specialty.
Acknowledgment
The authors would like to acknowledge for their contributions to this important policy and the editorial that articulated it the Senior Editors of Clinical Orthopaedics and Related Research (Matthew B. Dobbs MD; Mark C. Gebhardt MD; Terence J. Gioe MD; Paul A. Manner MD, FRCSC; Raphaël Porcher PhD; Clare M. Rimnac PhD; and Montri D. Wongworawat MD) as well as its Managing Director (Lee Beadling BA); the Editorial Board of The Journal of Bone and Joint Surgery (Jean-Noël A. Argenson MD, PhD; Thomas W. Bauer MD, PhD; Thomas D. Brown PhD; Charles R. Clark MD; Charles M. Court-Brown MD, FRCSCEd[Orth]; Lars Engebretsen MD, PhD; Andrew Green MD; Anil K. Jain MS, FAMS, FRCS; Michelle A. James MD; Bernhard Jost MD; Jeffrey N. Katz MD, MSc; Eng Hin Lee MD, FRCSC; Elena Losina PhD; Stephen Lyman PhD; Konstantinos N. Malizos MD, PhD; Robert G. Marx MD, MSc, FRCSC; Sanjeev Sabharwal MD, MPH; Bruce Sangeorzan MD; Christoph J. Siepe MD; Paul D. Sponseller MD; Stephen R. Thompson MD, MEd, FRCSC; Daisuke Togawa MD, PhD; and James P. Waddell MD, FRCSC) and its Editors Emeritus (Vernon T. Tolo MD, and James D. Heckman MD); and the Editorial Board of The Bone & Joint Journal (Matthew Costa PhD, FRCS[Tr&Orth]; Richard Carey Smith BSc[Hons], MB, BS, MRCS, FRCS[Orth], FAOrthA; Melina Dritsaki BSc, MSc, PhD; Xavier Griffin FRCS[Tr&Orth], PhD; Nicholas Parsons BSc, MSc, PhD; Daniel Perry FRCS[Orth], PhD; and Dirk Stengel MD, PhD, MSc).
Footnotes
All the authors certify that neither they nor any members of their immediate families have any funding or commercial associations (eg, consultancies, stock ownership, equity interest, patent/licensing arrangements, etc) that might pose a conflict of interest in connection with the submitted article.
All ICMJE Disclosure of Potential Conflicts of Interest forms for Clinical Orthopaedics and Related Research ® Editors are on file with the publication and can be viewed on request; the Editors’ disclosure statements also appear online at http://www.clinorthop.org/editorial-board and each month in print on the masthead of Clinical Orthopaedics and Related Research ®. The ICMJE Disclosure form for the Editor of JBJS is provided with the JBJS online version of this article, and the ICMJE Disclosure form for the Editor of The Bone & Joint Journal is available with the BJJ online version of this article.
The authors of this editorial are the Editors-in-Chief of Clinical Orthopaedics and Related Research ® , The Journal of Bone and Joint Surgery, and The Bone & Joint Journal, respectively; in the interest of setting a common standard among leading general interest orthopaedic journals, this editorial is being published concurrently in all three of those journals.
This is an open access article distributed under the Creative Commons Attribution License 4.0 (CCBY), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
References
- 1.Howick J, Chalmers I, Glasziou P, Greenhalgh T, Heneghan C, Liberati A, Moschetti I, Phillips B, Thornton H. The 2011 Oxford CEBM levels of evidence: Introductory document. Available at: http://www.cebm.net/wp-content/uploads/2014/06/CEBM-Levels-of-Evidence-Introduction-2.1.pdf. Accessed 2016 June 21.
- 2.Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003;289:454–465. doi: 10.1001/jama.289.4.454. [DOI] [PubMed] [Google Scholar]
- 3.Emerson GB, Warme WJ, Wolf FM, Heckman JD, Brand RA, Leopold SS. Testing for the presence of positive-outcome bias in peer review: A randomized controlled trial. Arch Intern Med. 2010;170:1934–1939. doi: 10.1001/archinternmed.2010.406. [DOI] [PubMed] [Google Scholar]
- 4.Lièvre M, Ménard J, Bruckert E, Cogneau J, Delahaye F, Giral P, Leitersdorf E, Luc G, Masana L, Moulin P, Passa P, Pouchain D, Siest G. Premature discontinuation of clinical trial for reasons not related to efficacy, safety, or feasibility. BMJ. 2001;322:603–605. doi: 10.1136/bmj.322.7286.603. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Rosenthal R. The ‘‘file drawer problem’’ and tolerance for null results. Psychol Bull. 1979;86:638–641. doi: 10.1037/0033-2909.86.3.638. [DOI] [Google Scholar]
- 6.Cochrane Methods Bias. Reporting biases. Available at; http://methods.cochrane.org/bias/reporting-biases. Accessed 2016 June 21.
- 7.Higgins JPT, Green S. Cochrane Handbook for systematic reviews of interventions, version 5.1.0: including unpublished studies in systematic reviews. Available at: http://handbook.cochrane.org/chapter_10/10_3_2_including_unpublished_studies_in_systematic_reviews.htm. Accessed 2016 June 23.
- 8.Hopewell S, McDonald S, Clarke M, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007;2:MR000010. [DOI] [PMC free article] [PubMed]
- 9.ClinicalTrials.gov. Available at: https://clinicaltrials.gov. Accessed 2016 June 21.
- 10.World Health Organization. International Clinical Trials Registry Platform (ICTRP): Primary registries. Available at: http://www.who.int/ictrp/network/primary/en/. Accessed 2016 June 21.
- 11.BioMed Central. ISRCTN registry. Available at: http://www.isrctn.com. Accessed 2016 September 13.
- 12.Rifai N, Bossuyt PM, Ioannidis JP, Bray KR, McShane LM, Golub RM, Hooft L. Registering diagnostic and prognostic trials of tests: Is it the right thing to do? Clin Chem. 2014;60:1146–1152. doi: 10.1373/clinchem.2014.226100. [DOI] [PubMed] [Google Scholar]
- 13.International Committee of Medical Journal Editors. Clinical trial registration. Available at: http://www.icmje.org/recommendations/browse/publishing-and-editorial-issues/clinical-trial-registration.html. Accessed 2016 June 21.
- 14.De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB, International Committee of Medical Journal Editors. Clinical trial registration: A statement from the International Committee of Medical Journal Editors. N Engl J Med. 2004;351:1250–1251. [DOI] [PubMed]