Abstract
The UK Medical Research Council (MRC) randomized trial of gastric surgery, ST01, compared conventional (D1) with radical (D2) surgery. Sample size estimation was based upon the consensus opinion of the surgical members of the design team, which suggested that a change in 5-year survival from 20% (D1) to 34% (D2) could be realistic and medically important. On the basis of these survival rates, the sample size for the trial was 400 patients. However, this trial was exceptional in the way that a survey of surgeons' opinions was made at the start of the trial, in 1986, and again before results were analysed but after termination of the trial in 1994. At the initial survey, the three surgeons from the trial steering committee and 23 other surgeons experienced in treating gastric carcinoma were given detailed questionnaires. They were asked about the expected survival rate in the D1 group, anticipated difference in survival from D2 surgery, and what difference would be medically important and influence future treatment of patients. The consensus opinion of those surveyed was that there might be a survival improvement of 9.4%. In 1994, prior to closure of the trial, and before any survival information was disclosed, the survey was repeated with 21 of the original 26 surgeons. At this second survey, the opinion of the trial steering committee was that 9.5% difference was more realistic. This was in accord with the opinion of the larger group, which remained little changed since 1986. The baseline 5-year D1 survival was thought likely to be about 32%, which corresponded closely to the actual survival of recruited patients. Revised sample size calculations suggested that, on the basis of these more recent opinions, between 800 and 1200 patients would have been required. Both surveys assessed the level of treatment benefit that was deemed to be sufficient for causing surgeons to change their practice. This showed that the 13% difference in survival used as the study target was clinically relevant, but also indicated that many clinicians would remain unwilling to change their practice if the difference is only 9.5%. The experience of this carefully designed trial illustrates the problems of designing long-term, randomized trials. It raises interesting questions about the common practice of basing sample size estimates upon the beliefs of a trial design committee that may include a number of enthusiasts for the trial treatment. If their opinion of anticipated effect sizes drives the design of the trial, rather than the opinion of a larger community of experts that includes sceptics as well as enthusiasts, there is likely to be a serious miscalculation of sample size requirements. © 2000 Cancer Research Campaign
Keywords: sample size, prior beliefs, clinicians', opinions, clinical trial
Full Text
The Full Text of this article is available as a PDF (114.0 KB).
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Cuschieri A., Fayers P., Fielding J., Craven J., Bancewicz J., Joypaul V., Cook P. Postoperative morbidity and mortality after D1 and D2 resections for gastric cancer: preliminary results of the MRC randomised controlled surgical trial. The Surgical Cooperative Group. Lancet. 1996 Apr 13;347(9007):995–999. doi: 10.1016/s0140-6736(96)90144-0. [DOI] [PubMed] [Google Scholar]
- Cuschieri A., Weeden S., Fielding J., Bancewicz J., Craven J., Joypaul V., Sydes M., Fayers P. Patient survival after D1 and D2 resections for gastric cancer: long-term results of the MRC randomized surgical trial. Surgical Co-operative Group. Br J Cancer. 1999 Mar;79(9-10):1522–1530. doi: 10.1038/sj.bjc.6690243. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Fayers P. M., Ashby D., Parmar M. K. Tutorial in biostatistics Bayesian data monitoring in clinical trials. Stat Med. 1997 Jun 30;16(12):1413–1430. doi: 10.1002/(sici)1097-0258(19970630)16:12<1413::aid-sim578>3.0.co;2-u. [DOI] [PubMed] [Google Scholar]
- Fayers P. M., Machin D. Sample size: how many patients are necessary? Br J Cancer. 1995 Jul;72(1):1–9. doi: 10.1038/bjc.1995.268. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maruyama K., Okabayashi K., Kinoshita T. Progress in gastric cancer surgery in Japan and its limits of radicality. World J Surg. 1987 Aug;11(4):418–425. doi: 10.1007/BF01655804. [DOI] [PubMed] [Google Scholar]
- Parmar M. K., Spiegelhalter D. J., Freedman L. S. The CHART trials: Bayesian design and monitoring in practice. CHART Steering Committee. Stat Med. 1994 Jul 15;13(13-14):1297–1312. doi: 10.1002/sim.4780131304. [DOI] [PubMed] [Google Scholar]
- Spiegelhalter D. J., Freedman L. S. A predictive approach to selecting the size of a clinical trial, based on subjective clinical opinion. Stat Med. 1986 Jan-Feb;5(1):1–13. doi: 10.1002/sim.4780050103. [DOI] [PubMed] [Google Scholar]