Skip to main content
PMC home page
BMC Surgery logoLink to BMC Surgery
. 2008 Feb 15;8:4. doi: 10.1186/1471-2482-8-4

The Quality Initiative in Rectal Cancer (QIRC) trial: study protocol of a cluster randomized controlled trial in surgery

Marko Simunovic 1,2,3,✉, Charles Goldsmith 2,4, Lehana Thabane 2,4, Robin McLeod 5, Franco DeNardi 6, Timothy J Whelan 2,3,7, Mark N Levine 2,3,7
PMCID: PMC2262058  PMID: 18279521

Abstract

Background

Two unfortunate outcomes for patients treated surgically for rectal cancer are placement of a permanent colostomy and local tumor recurrence. Total mesorectal excision is a new technique for rectal cancer surgery that can lead to improved patient outcomes. We describe a cluster randomized controlled trial that is testing if the above patient outcomes can be improved through a knowledge translation strategy called the Quality Initiative in Rectal Cancer (QIRC) strategy. The strategy is designed to optimize the use of total mesorectal excision techniques.

Methods and Design

Hospitals were randomized to the QIRC strategy (experimental group) versus normal practice environment (control group). Participating hospitals, and the respective surgeon group operating in them, are from Ontario, Canada and have an annual procedure volume for major rectal cancer resections of 15 or greater. Patients were eligible if they underwent major rectal surgery for a diagnosis of primary rectal cancer. The surgeon-directed QIRC interventions included a workshop, use of opinion leaders, operative demonstrations, a post-operative questionnaire, and, audit and feedback. For an operative demonstration participating surgeons invited a study team surgeon to assist them with a case of rectal cancer surgery. The intent was to demonstrate total mesorectal excision techniques. Control arm surgeons received no intervention. Sample size calculations were two-sided, considered the clustering of data at the hospital level, and were driven by requirements for the outcome local recurrence. To detect an improvement in local recurrence from 20% to 8% with confidence we required 16 hospitals and 672 patients – 8 hospitals and 336 patients in each arm. Outcomes data are collected via chart review for at least 30 months after surgery. Analyses will use an intention-to-treat principle and will consider the clustering of data. Data collection will be complete by the end of 2007.

Discussion

Lower rates of permanent colostomy and local tumour recurrence in the intervention arm would suggest the QIRC strategy is efficacious. The strategy may act as a template for efforts to improve surgical quality in other areas and will contribute to knowledge on influencing surgeon practice.

Trial registration

Current Controlled Trials ISRCTN78363167

Background

Surgical resection of rectal cancer is the cornerstone of curative therapy. Typically during rectal cancer surgery the tumour and a contiguous segment of normal bowel are removed and the bowel tract reestablished. For surgically treated patients two unfortunate outcomes are permanent colostomy and local tumor recurrence. For various reasons the operating surgeon may deem it necessary to remove the rectum and anus rendering the patient dependent on a permanent colostomy. Local tumor recurrence is defined as tumour that recurs in the pelvis near the previous operative site [1-3]. It is especially feared since this outcome is usually inoperable and patients, as a result, can suffer a slow, painful death. This study is testing if these two important outcomes, rates of permanent colostomy and local tumour recurrence, can be improved at the hospital level using the surgeon-directed Quality Initiative in Rectal Cancer (QIRC) strategy.

Studies on rectal cancer surgery outcomes usually show that rates of permanent colostomy, local tumour recurrence, and even patient survival vary markedly at the surgeon, hospital, or region level. For example, among the regions of Ontario, Canada researchers showed that rates of permanent colostomy following rectal surgery varied from 31% to 41% [4]. A study examining local tumour recurrence among surgeons operating in five hospitals in Edmonton, Alberta showed that rates varied from 10% to 45% based on surgeon specialty training and procedure volume [5]. These Canadian results are similar to studies in Europe [6-8]. The presence of important outcome variations suggests variation in the quality of delivered surgery.

Total mesorectal excision is a refinement of traditional surgical techniques that stresses sharp dissection of the mesorectum – the lymph node-bearing portion of the rectum – with careful autonomic nerve preservation [9-11]. There are a growing number of single institution series describing improvements in outcomes with the introduction of total mesorectal excision- in particular local tumour recurrence rates as low as 5% and permanent colostomy rates of 10–15% [12-18]. Population based studies from Europe also detail positive changes when surgeons in large areas adopt total mesorectal excision principles [19,20].

Knowledge translation research has identified interventions that may encourage physician behaviour change such as continuing medical education (e.g., workshops), use of opinion leaders, and audit and feedback [21-28]. It is also suggested that multiple interventions are more effective than single interventions. As well, behaviour change may be enhanced by using quality improvement principles such as a participatory and supportive approach that focuses on the system, not individuals; breaking processes down into definable steps that are more readily targeted for improvement; and, decreasing variation in process steps resulting in improved overall quality [29-32]. The QIRC strategy integrated such knowledge translation interventions and quality improvement concepts in an attempt to ensure that hospitals (i.e., the surgeons in the respective hospital) delivered optimal total mesorectal excision-type surgery to patients.

The purpose of this paper is to describe the methodology of our cluster randomized controlled QIRC trial, which is testing if the surgeon-directed QIRC strategy can improve patient outcomes at the hospital (i.e., cluster) level. We used a cluster design to minimize the chances of contamination at the patient and surgeon level. We surmised that patient-level randomization would not work since surgeons exposed to new information or techniques, such as those promoted through the QIRC strategy, would accept or reject such information or techniques for all of their subsequent patients. We surmised that surgeon-level randomization would not work since surgeons in a given hospital often share operative experiences through discussion or direct observation, and thus new information or techniques would likely be shared among surgeons in a given hospital. Since surgeons in Ontario rarely perform rectal cancer surgery at more than one hospital, we were confident that hospital-level cluster randomization would minimize the chances of contamination between the two arms of the QIRC trial.

Methods and Design

Study design

This study is a cluster randomized controlled trial with hospitals being the clusters. Hospitals were randomized to the QIRC strategy (intervention group) versus normal practice environment (control group). The QIRC strategy is directed at surgeons in hospitals randomized to the intervention group using a 1:1 allocation ratio.

Participants

Hospitals

To avoid targeting sites with minimal procedure volumes, we stated that participating hospitals in Ontario, and the respective surgeon group operating in them, must have an annual procedure volume for major rectal cancer resections of 15 or greater. We identified 33 such hospitals using administrative data for the period April 1, 2000 to March 31, 2001. Hospitals were then excluded if they had participated in the QIRC pilot study [33] (3 sites), if the majority of rectal surgery was performed using laparoscopic techniques (2 sites), or if surgeons at the site were involved in the QIRC trial as rectal surgery experts (4 sites). These two latter criteria were needed since a key intervention of the QIRC strategy was operative demonstrations delivered by rectal surgery experts using open versus laparoscopic techniques (See Interventions below). Nine hospitals were excluded leaving 24 potential sites. Hospitals were then eligible if 60% or more of surgeons at the respective site consented to participate and if the respective research ethics board approved the study. Sample size calculations indicated the need for 16 sites. For the first 18 hospitals approached, nearly every surgeon consented to participate and 16 hospital ethics boards approved the study protocol. (Figure 1)

Figure 1.

Figure 1

Open in a new tab

QIRC trial schema.

Patients

Patients were eligible if they underwent major rectal cancer surgery (i.e., partial or complete segmental resection of rectum with or without an anastamosis) for a diagnosis of primary rectal cancer. Thus patients who received local excisions were not eligible. We defined a rectal versus colon cancer as a tumour located within 15 cm of the anal verge by rigid sigmoidoscopy, or, a tumour at or below the level of the sacral promontory as seen at the time of surgery. These anatomic landmarks ensured the inclusion of patients that would potentially benefit from total mesorectal excision -type surgery. Tumour stage was not used as an exclusion criterion since issues of permanent colostomy and local recurrence are relevant to all patients undergoing surgery.

Intervention

The QIRC strategy is a set of interventions directed at surgeons working in a given hospital. The interventions include: a workshop, use of opinion leaders, operative demonstrations, a post-operative questionnaire, as well as audit and feedback.

Workshops

These were used to introduce to participating surgeons all aspects of the study and new information. For the latter, topics included rectal cancer surgery outcomes in Ontario and elsewhere, total mesorectal excision, and, knowledge translation and quality improvement. The intent of the workshop was to promote thought in three areas: 1) There is a need to improve population level rectal cancer surgery outcomes in most jurisdictions. 2) The QIRC strategy may help surgeons improve these outcomes. 3) The pursuit of surgical excellence is an active and continuous process.

Opinion leaders

At each workshop, participating surgeons selected an opinion leader for their hospital using a validated approach [34]. In summary, the selection was based on the opinion leader having three attributes including a high level of clinical expertise, a willingness to share knowledge, and being educationally influential. The opinion leader acted as a local resource person on issues pertinent to the study. For example, the opinion leader encouraged their colleagues to participate in operative demonstrations.

Operative demonstration

Participating surgeons invited a study team surgeon to assist them with a case of rectal cancer surgery. The main intent was to demonstrate total mesorectal excision techniques. Surgeons were encouraged to participate in a minimum of two operative demonstrations. The participating surgeon retained full control over all peri-operative and operative decision-making.

Operative questionnaire

This questionnaire was completed after each rectal cancer surgery. The questions were designed to prompt surgeons to re-examine key total mesorectal excision operative steps [see Additional file 1].

Audit and feedback

Data (e.g., rates of permanent colostomy) were provided to individual surgeons and in a group forum for overall hospital results. The intent of feedback was to encourage individual surgeons to constantly self-examine surgical decision-making.

Control arm

Hospitals in the control group represented the normal environment where the onus is on the individual surgeon to obtain new knowledge or skills for any aspect of the care they provide. Efforts to improve the quality of rectal cancer care among control arm surgeons were not facilitated by the study team.

Objectives

Primary objective

We wish to test the efficacy of the QIRC strategy to improve hospital rates of permanent colostomy and local tumour recurrence among patients surgically treated for rectal cancer. We hypothesize that hospitals exposed to the QIRC strategy (intervention) will have better outcomes – lower rates of permanent colostomy and local tumour recurrence – compared to hospitals in the normal practice environment (control).

Secondary objective

We wish to test if the QIRC strategy can lead to improved quality of life, and improved bladder, bowel, and sexual function among patients surgically treated for rectal cancer. We hypothesize that patients treated in hospitals exposed to the QIRC strategy (intervention) will have higher scores on quality of life measures, and bowel, bladder and sexual function questionnaires compared to patients treated in control arm hospitals.

Outcome measures

Primary outcomes

Since the hospital is our unit of analysis it is imperative that consecutive patients be included to prevent surgeon selection bias (e.g., excluding patients with difficult tumours perceived as high-risk for negative outcomes). Three methods of patient accrual were used to ensure consecutive patient accrual for primary outcomes – regular (weekly) phone calls to surgeons' offices, review of operating room booking logs, and hospital health records queries. Patient consent was not obtained for primary outcomes since data were collected via retrospective chart review and involved no patient contact. Primary outcomes included:

Hospital rate of permanent colostomy

It is usually known at the time of rectal cancer surgery if a person has received a permanent colostomy. However, in cases where a patient receives a temporary stoma 18 months will be allowed for temporary stoma closure, after which time the patient will be designated as having a permanent colostomy. An anastomosis of the rectum must also be functioning for at least three months to be considered a non-permanent colostomy. This will prevent a positive outcome being marked for a patient who subsequently receives a colostomy for problems such as an anastomotic leak or severe incontinence.

Hospital rate of local recurrence

Local tumor recurrence is usually defined as tumour that recurs in the pelvis near the previous operative site [1-3]. Most, though not all, local recurrences manifest within two years of surgery. In this study local recurrence in the pelvis will be defined in three ways:

1. Definite recurrence – positive histology.

2. Probable recurrence – a postoperative mass in the area of previous pelvic surgery with any of the following patient signs (hydronephrosis, invasion of pelvic structures, or bleeding rectal mass) or symptoms (deteriorating sexual function, deteriorating bladder function, deteriorating bowel function, or persistent and worsening lower back, perineal or sciatic pain).

3. Possible recurrence – based strictly on a patient developing any of the symptoms mentioned above (deteriorating sexual function, deteriorating bladder function, deteriorating bowel function, or persistent and worsening lower back, perineal or sciatic pain).

Secondary outcomes

Surgeons determined which of their respective patients may be candidates to participate in secondary outcomes data collection. Surgeons introduced this part of the study to appropriate patients and if the individual was agreeable, the study team approached the respective patient to obtain written informed consent. Patients were not approached if they were too ill, frail or psychologically vulnerable, as determined by the participating surgeon. Patients required sufficient command of the English language and capacity to give informed consent. Secondary outcomes included:

Quality of life

To assess overall impact of disease and treatment on patient quality of life we used the following: the European Organization for Research and Treatment of Cancer (EORTC) QLQ-C30 [35], an instrument to assess quality of life in cancer patients; the supplemental EORTC QLQ-CR38 [36], a colorectal cancer-specific quality of life questionnaire module; and, the 36-Item Short Form Health Survey, Version 2 (SF-36) [37].

Bowel, bladder and sexual function

At the time of trial initiation we felt there was no validated instrument(s) that adequately addressed these three important domains. To this end a brief set of questions were developed [see Additional file 2].

Sample size

We calculated the intracluster correlation coefficient using the a priori variation in permanent colostomy rates among hospitals in Ontario with a rectal cancer procedure volume of at least 15 per year for years 1997 to 1999 (Intracluster correlation = 0.4) [38,39]. We used a conservative spectrum of values for local recurrence intraclass correlation coefficients. Alpha and beta were set at 0.05 and 0.2, respectively. Tests were two-sided and assumed that a clinically important change would consist of decrease in the baseline rate of permanent colostomy from 30% to 15%. Using permanent colostomy as the outcome, the study required 8 hospitals and 311 patients in each arm. For local recurrence we extrapolated from the literature, and assumed that local recurrence rates are a conservative 20% and can be brought down to 8% in the intervention arm. To detect this difference with confidence we required 16 hospitals and 672 patients – 8 hospitals and 336 patients in each arm. Thus, the sample size required for the outcome local recurrence determined our final sample size requirements. We randomized 16 hospitals and anticipated an accrual period of 24 months.

Randomization

The study statistician generated and administered a blocked 1:1 allocation randomization arrangement for the 16 study hospitals. We did not stratify hospitals by procedure-volume or teaching status since previous research in Ontario indicates that such hospital characteristics do not differentiate patient outcomes following colorectal cancer surgery [40,41]. Following the randomization of an intervention arm site, no further hospital was randomized until that site participated in a workshop (the first component of the QIRC strategy). This was done since patients were immediately accrued following site randomization, despite the typical requirement of 2–4 weeks to arrange a workshop with all or at least a majority of the surgeons at the respective site.

Data gathering

Data are being collected for patients in the intervention and control groups in identical ways. Primary outcomes data are collected via chart review for at least 30 months, and thus follow-up will be greater for all but the final patients enrolled in the trial. This follow-up period will allow identification of local recurrence events, since local recurrence typically occurs within two years of surgery [1-3]. Hospital charts are reviewed within two weeks of surgery and every three months thereafter. Regional Cancer Centre charts are also reviewed to optimize the collection of data on potential patient treatments (e.g., radiation therapy) and outcomes (e.g., local recurrence). In Ontario, all radiation therapy is delivered at a small number of such Cancer Centres. Quality of life and bowel, bladder, and sexual function were measured at four times: baseline (pre-operatively or within 4 weeks of surgery) and at 6, 12 and 18 months post-surgery. Trained assessors obtained data for secondary outcomes during telephone interviews. All data will be handled with strict confidentiality, and study reports or presentations will maintain patient, surgeon, and hospital anonymity. Data collection will be complete by the end of 2007.

Analysis

We will use the intention-to-treat principle to analyse data. We will use multiple imputation to handle missing data [42]. Treatment arms will be compared with respect to potential covariates using continuous and categorical univariable analyses. This will include patient (age, sex, comorbidities, weight and height), treatment (adjuvant therapies), tumour (stage, node counts, margin status, other histology measures), and hospital (teaching status, procedure volume) level variables. Methods of analysis, including adjustment for covariates, will use the cluster randomization trial design [38,39]. Specifically, the primary outcomes of colostomy rate and local recurrence rate will be assessed using a nested (cluster) analysis model that will consider the correlation of outcomes within each hospital, and the influence of covariables. Adjustments for adjuvant therapies are especially important since it is likely these treatments will not be delivered among centers using a standard regimen. The major design factor will be arm of study (experimental or control). No adjustment will be made for multiple comparisons of primary outcomes since each is of interest on its own. Secondary analyses will be conducted on bowel, bladder and sexual function, and quality of life using nested analysis of variance. We will conduct analyses using the latest versions of SAS, SPlus and StatXact software as needed. The trial will be reported according to the CONSORT standards for reporting cluster-randomized trials [43]. The results will be expressed as odds ratio [OR] (for binary outcomes), hazard ratio [HR] (for time-to-event outcomes) or mean difference (for continuous outcomes), with corresponding standard errors, 95% confidence intervals and associated p-values. P-values will be reported to three decimal places with p-values less than 0.001 reported as p < 0.001. For all tests, we will use alpha = 0.05 level of significance. We will examine residuals to assess goodness-of-fit and model assumptions for all analyses as appropriate.

Nested studies

Surgeon survey

At the completion of accrual surgeons were mailed a survey. Intervention arm surgeons were asked to comment on their involvement in the trial, to evaluate the individual QIRC strategy interventions and the overall strategy, and to provide insights on issues that may be relevant to the uptake of a new innovation such as the QIRC strategy. A similar survey was sent to control arm surgeons, however, they were not asked to evaluate the individual QIRC strategy interventions. Participation in the survey was voluntary. Surgeons who agreed to participate were given the option to identify themselves or remain anonymous.

Qualitative interviews

Qualitative telephone interviews were conducted with opinion leaders in the intervention arm hospitals. At least one other surgeon from each of the intervention arm hospitals was also interviewed. Participation in the interviews was voluntary. The interviews will assist in assessing the role of the local opinion leader and the overall QIRC strategy

Ethics

The study is being conducted according to the established guidelines of proper conduct of medical research involving human subjects set by the Tri-council Policy Statement and the GCP guidelines [44-48]. The Research Ethics Board (REB) of the Hamilton Health Sciences/McMaster University approved this protocol (REB project number 01-202). Each participating hospital also provided local ethics approval prior to enrollment. Ethics approval from Ontario Regional Cancer Centres was also necessary for the examination of study patients' charts. Individual surgeons provided written consent, as did all patients who participated in the collection of secondary outcomes data (i.e., quality of life scores, and questionnaires on bowel, bladder and sexual function).

Discussion

The QIRC trial will assess if the QIRC strategy, which is designed to positively influence surgeon practice at a given hospital, can lead to improved patient outcomes of rectal cancer surgery. Lower permanent colostomy and local tumour recurrence rates in the intervention arm would suggest that the QIRC strategy is efficacious. The strategy may also act as a template for efforts to improve surgical quality in other cancer sites.

Participants in a clinical trial may alter – improve – their behaviour in response to being observed rather than as a result of a study intervention [49,50]. This phenomenon is known as the Hawthorne effect and it is important to consider in trials designed to influence physician behaviour and action. Surgeons in both arms of the QIRC trial may be subject to a potential Hawthorne effect. Surgeons in the control arm will consent to randomization and be cognizant of ongoing data abstraction. In addition to these maneuvers, surgeons in the experimental arm will receive the QIRC strategy. Thus, all surgeons in the study will be aware their actions are being observed. Any improvement in patient outcomes in the experimental arm must be above and beyond the Hawthorne effect, and would be attributed to the intervention.

We are aware of one other trial that tested if knowledge translation or quality improvement methods could influence (i.e., improve) surgeon practice [51]. This trial used continuing medical education and opinion leaders to improve (i.e., lower) rates of cesarean section. The relatively small number of randomized trials that involve surgeons usually compare the delivery of contrasting treatments (e.g., surgical versus medical therapy for patients with carotid stenosis, or, different methods of surgically treating patients with breast cancer). Thus, regardless of our results, successful engagement of surgeon participation in this cluster-randomized trial will be an important observation in and of itself. This trial does not compare total mesorectal excision-type surgery versus standard surgery, rather it is comparing a strategy designed to influence surgeon practice versus the normal environment. Thus, the trial will contribute greatly to knowledge on optimizing surgeon practice.

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

The study was initiated by MS and ML. MS, CG, LT, RM, TW and ML are grant holders. All authors participated in the study concept and design. CG, LT and ML provided expertise in cluster randomized controlled trials. CG and LT provided statistical expertise. MS, RM and FD provided expertise in the surgical and pathologic treatment of rectal cancer. All authors reviewed and approved the final version of this manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2482/8/4/prepub

Supplementary Material

Additional file 1

Operative Questionnaire. Surgeons in the experimental arm completed this questionnaire after each rectal cancer surgery. The questions were designed to prompt surgeons to re-examine key total mesorectal excision operative steps.

Click here for file (148KB, doc)
Additional file 2

Bowel, Bladder and Sexual Function Questions. Questions developed for the QIRC trial to address bowel, bladder and sexual function following rectal cancer surgery.

Click here for file (36KB, doc)

Acknowledgments

Acknowledgements

Funding: This trial is funded by the Canadian Institutes of Health Research (study number MCT 50013).

Contributor Information

Marko Simunovic, Email: marko.simunovic@hrcc.on.ca.

Charles Goldsmith, Email: goldsmit@mcmaster.ca.ca.

Lehana Thabane, Email: thabanl@mcmaster.ca.

Robin McLeod, Email: mcleod@mtsinai.on.ca.

Franco DeNardi, Email: denarfra@hhsc.ca.

Timothy J Whelan, Email: tim.whelan@hrcc.on.ca.

Mark N Levine, Email: mlevine@mcmaster.ca.

References

  1. Soreide O, Norstein J. Local recurrence after operative treatment of rectal carcinoma: a strategy for change. J Am Coll Surg. 1997;184:84–92. [PubMed] [Google Scholar]
  2. Hoffman JP, Riley L, Carp NZ, Litwin S. Isolated locally recurrent rectal cancer: a review of incidence, presentation, and management. Semin Oncol. 1993;20:506–519. [PubMed] [Google Scholar]
  3. McCall JL, Wattchow DA. Failure after curative surgery. In: Soreide O, Norstein J, editor. Rectal Cancer Surgery Optimisation, standardisation, documentation. New York: Springer-Verlag; 1997. pp. 29–40. [Google Scholar]
  4. Paszat LF, Brundage M, Groome P, Schulze K, Mackillop WJ. A population-based study of rectal cancer: permanent colostomy as an outcome. Int J Radiat Oncol Biol Phys. 1999;45:1185–1191. doi: 10.1016/S0360-3016(99)00327-2. [DOI] [PubMed] [Google Scholar]
  5. Porter GA, Soskoine CL, Yakimets WW, Newman SC. Surgeon-related factors and outcome in rectal cancer. Ann Surg. 1998;227:157–167. doi: 10.1097/00000658-199802000-00001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. McArdle CS, Hole D. Impact of variability among surgeons on postoperative morbidity and mortality and ultimate survival. B Med J. 1991;302:1501–1505. doi: 10.1136/bmj.302.6791.1501. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Phillips RK, Hittinger R, Blesovsky L, Fry JS, Fielding LP. Local recurrence following 'curative' surgery for large bowel cancer: I. The overall picture. Br J Surg. 1984;71:12–16. doi: 10.1002/bjs.1800710104. [DOI] [PubMed] [Google Scholar]
  8. Hermanek P, Wiebelt H, Staimmer D, Riedl S, The German Study Group Colo-Rectal Carcinoma (SGCRC) Prognostic factors of rectum carcinoma – experience of the German Multicentre Study SGCRC. Tumori. 1995;81:60–64. [PubMed] [Google Scholar]
  9. Bissett IP, Chau KY, Hill GL. Extrafascial excision of the rectum. Dis Colon Rectum. 2000;43:903–910. doi: 10.1007/BF02237349. [DOI] [PubMed] [Google Scholar]
  10. Havenga K, Enker WE, DeRuiter MC, Welvaart K. Anatomical basis of total mesorectal excision and preservation of the pelvic autonomic nerves. In: Soreide O, Norstein J, editor. Rectal Cancer Surgery Optimisation, standardisation, documentation. New York: Springer-Verlag; 1997. pp. 134–142. [Google Scholar]
  11. Enker WE, Thaler HT, Cranor ML, Polyak T. Total mesorectal excision in the operative treatment of carcinoma of the rectum. J Am Coll Surg. 1995;181:335–346. [PubMed] [Google Scholar]
  12. Bernstein MA, Amarnath B, Weiss EG, Nogueras JJ, Wexner SD. Total mesorectal excision without adjuvant therapy for local control of rectal cancer: a North American experience. Tech Coloproctol. 1998;2:11–15. [Google Scholar]
  13. Arenas RB, Fichera A, Mhoon D, Michelassi F. Total mesenteric excision in the surgical treatment of rectal cancer: a prospective study. Arch Surg. 1998;133:608–612. doi: 10.1001/archsurg.133.6.608. [DOI] [PubMed] [Google Scholar]
  14. Aitken RJ. Mesorectal excision for rectal cancer. Br J Surg. 1996;83:214–216. doi: 10.1002/bjs.1800830218. [DOI] [PubMed] [Google Scholar]
  15. Kockerling F, Reymond MA, Altendorf-Hofmann A, Dworak O, Hohenberger W. Influence of surgery on metachronous distant metastases and survival in rectal cancer. J Clin Oncol. 1998;16:324–329. doi: 10.1200/JCO.1998.16.1.324. [DOI] [PubMed] [Google Scholar]
  16. MacFarlane JK, Ryall R, Heald RJ. Mesorectal excision for rectal cancer. Lancet. 1993;341:457–460. doi: 10.1016/0140-6736(93)90207-W. [DOI] [PubMed] [Google Scholar]
  17. Heald RJ, Moran BJ, Ryall RDH, Sexton R, MacFarlane JK. The Basingstoke experience of total mesorectal excision. Arch Surg. 1998;133:894–899. doi: 10.1001/archsurg.133.8.894. [DOI] [PubMed] [Google Scholar]
  18. Arbman G, Nilsson E, Halbook O, Sjodahl R. Local recurrence following total mesorectal excision for rectal cancer. Br J Surg. 1995;83:375–379. doi: 10.1002/bjs.1800830326. [DOI] [PubMed] [Google Scholar]
  19. Wiig JN, Carlsen E, Soreide O. Mesorectal excision for rectal cancer: a view from Europe. Semin Surg Oncol. 1998;15:78–86. doi: 10.1002/(SICI)1098-2388(199809)15:2&#x0003c;78::AID-SSU4&#x0003e;3.0.CO;2-2. [DOI] [PubMed] [Google Scholar]
  20. Martling AL, Holm T, Rutqvist LE, Moran BJ, Heald RJ, Cedermark B. Effect of a surgical training programme on outcome of rectal cancer in the County of Stockholm. Stockholm Colorectal Cancer Study Group, Basingstoke Bowel Cancer Research Project. Lancet. 2000;356:93–96. doi: 10.1016/S0140-6736(00)02469-7. [DOI] [PubMed] [Google Scholar]
  21. Lomas J. Diffusion, dissemination and implementation: Who should do what? Ann NY Acad Sciences. 1993;703:226–235. doi: 10.1111/j.1749-6632.1993.tb26351.x. [DOI] [PubMed] [Google Scholar]
  22. Oxman AD, Thomson MA, David D, Haynes RB. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. CMAJ. 1995:1423–1431. [PMC free article] [PubMed] [Google Scholar]
  23. Browman GP, Newman TE, Mohide EA, Graham ID, Levine MN, Pritchard KI, et al. Progress of clinical oncology guidelines development using the Practice Guidelines Development Cycle: the role of practitioner feedback. J Clin Oncol. 1998;16:1226–1231. doi: 10.1200/JCO.1998.16.3.1226. [DOI] [PubMed] [Google Scholar]
  24. Grimshaw JM, Freemantle N, Wallace S, Russell IT, Hurwitz B, Watt I, et al. Developing and implementing clinical practice guidelines. Qual Health Care. 1995;4:55–64. doi: 10.1136/qshc.4.1.55. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Davis DA, Taylor-Vaisey A. Translating guidelines into practice. A systematic review of theoretic concepts, practical experiences and research evidence in the adoption of clinical practice guidelines. CMAJ. 1997;157:408–416. [PMC free article] [PubMed] [Google Scholar]
  26. Jamtvedt G, Young JM, Kristoffersen DT, Thomson O'Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2003:CD000259. doi: 10.1002/14651858.CD000259. Review. [DOI] [PubMed] [Google Scholar]
  27. Thomson O'Brien MA, Oxman AD, Haynes RB, Davis DA, Freemantle N, Harvey EL. Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000:CD000125. doi: 10.1002/14651858.CD000125. Review. [DOI] [PubMed] [Google Scholar]
  28. Thomson O'Brien MA, Freemantle N, Oxman AD, Wolf F, Davis DA, Herrin J. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2001:CD003030. doi: 10.1002/14651858.CD003030. Review. [DOI] [PubMed] [Google Scholar]
  29. Berwick DM. Controlling variation in health care: a consultation from Walter Shewhart. Med Care. 1991;29:1212–1225. doi: 10.1097/00005650-199112000-00004. [DOI] [PubMed] [Google Scholar]
  30. Berwick D, Godfrey A, Roessner J. Curing health care – new strategies for quality improvement. San Francisco, Jossey-Bass Publishers; 1990. [Google Scholar]
  31. Kritchevsky SB, Simmons BP. Continuous quality improvement. Concepts and applications for physician care. JAMA. 1991;266:1817–1823. doi: 10.1001/jama.266.13.1817. [DOI] [PubMed] [Google Scholar]
  32. Reynolds JL. Reducing the frequency of episiotomies through a continuous quality improvement program. CMAJ. 1995;153:275–282. [PMC free article] [PubMed] [Google Scholar]
  33. Simunovic M, Paterson CA, Coates AJ, Wright JR, Levine MN. Pilot Study of the Quality Initiative in Rectal Cancer Strategy. Dis Colon Rectum. 2004;47:1594–1598. doi: 10.1007/s10350-004-0658-0. [DOI] [PubMed] [Google Scholar]
  34. Hiss RG, MacDonald R, Davis WK. Identification of physician educational influentials (EI's) in small community hospitals. Res Med Educ. 1978;17:283–288. [Google Scholar]
  35. Aaronson K, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, for the European Organization for Research and Treatment of Cancer Study Group on Quality of Life et al. The EORTC QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85:365–376. doi: 10.1093/jnci/85.5.365. [DOI] [PubMed] [Google Scholar]
  36. Sprangers MAG, Te Velde A, Aaronson NK, on behalf of the European Organisation for Research and Treatment of Cancer Study Group on Quality of Life The construction and testing of the EORTC colorectal cancer-specific quality of life questionnaire module (QLQ-CR38) Eur J Cancer. 1999;35:238–247. doi: 10.1016/S0959-8049(98)00357-8. [DOI] [PubMed] [Google Scholar]
  37. Ware JE, Jr, Sherbourne CD. The MOS 36-Item Short-Form Health Status (SF-36). 1. Conceptual framework and item selection. Med Care. 1992;30:473–483. doi: 10.1097/00005650-199206000-00002. [DOI] [PubMed] [Google Scholar]
  38. Donner A, Klar N. Cluster randomization in epidemiology: Theory and application. J Stat Plan Inference. 1994;42:37–56. doi: 10.1016/0378-3758(94)90188-0. [DOI] [Google Scholar]
  39. Donner A, Klar N. Methods for comparing event rates in intervention studies when the unit of allocation is a cluster. Am J Epid. 1994;140:279–289. doi: 10.1093/oxfordjournals.aje.a117247. [DOI] [PubMed] [Google Scholar]
  40. Simunovic M, To T, Baxter N, Balshem A, Ross E, Cohen Z, McLeod R, Engstrom P, Sigurdson E. Hospital procedure volume and teaching status do not influence treatment and outcome measures of rectal cancer surgery in a large general population. J Gastrointest Surg. 2000;4:324–330. doi: 10.1016/S1091-255X(00)80083-9. [DOI] [PubMed] [Google Scholar]
  41. Simunovic M, Rempel E, Theriault M-E, Coates A, Whelan T, Holowaty E, Langer B, Levine MN. Influence of hospital characteristics on patient operative mortality and survival following major cancer surgery in Ontario. Can J Surg. 2006;49:251–258. [PMC free article] [PubMed] [Google Scholar]
  42. Barnard J, Meng X. Application of multiple imputation in medical studies: from AIDS to NHANES. Stat Methods Med Res. 1999;8:12–36. doi: 10.1191/096228099666230705. [DOI] [PubMed] [Google Scholar]
  43. Campbell MK, Elbourne DR, Altman DG, CONSORT group CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328:702–708. doi: 10.1136/bmj.328.7441.702. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, Social Sciences and Humanities Research Council of Canada, Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans http://pre.ethics.gc.ca/english/pdf/TCPS%20October%202005_E.pdf
  45. World Medical Association. World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects http://www.wma.net/e/policy/b3.htm [DOI] [PubMed]
  46. Canadian Standards Association. Privacy Code http://www.csa.ca/standards/privacy/code/Default.asp?language=English
  47. Canadian Institutes of Health Research. Guidelines for Protecting Privacy and Confidentiality in the Design, Conduct, and Evaluation of Health Research http://www.cihr-irsc.gc.ca/e/pdf_22427.htm
  48. Personal Health Information Protection Act http://www.e-laws.gov.on.ca/DBLaws/Statutes/English/04p03_e.htm
  49. De Amici D, Kersy C, Ramajoli F, Brustia L, Politi P. Impact of the Hawthorne effect in a longitudinal clinical study. Control Clin Trials. 2000;21:103–114. doi: 10.1016/S0197-2456(99)00054-9. [DOI] [PubMed] [Google Scholar]
  50. Grufferman S. Complexity and the Hawthorne effect in community trials. Epidemiology. 1999;10:209–210. doi: 10.1097/00001648-199905000-00002. [DOI] [PubMed] [Google Scholar]
  51. Lomas J, Enkin M, Anderson GM, Hannah WJ, Vayda E, Singer J. Opinion leaders versus audit and feedback to implement practice guidelines. JAMA. 1991;265:2202–2207. doi: 10.1001/jama.265.17.2202. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1

Operative Questionnaire. Surgeons in the experimental arm completed this questionnaire after each rectal cancer surgery. The questions were designed to prompt surgeons to re-examine key total mesorectal excision operative steps.

Click here for file (148KB, doc)
Additional file 2

Bowel, Bladder and Sexual Function Questions. Questions developed for the QIRC trial to address bowel, bladder and sexual function following rectal cancer surgery.

Click here for file (36KB, doc)

Articles from BMC Surgery are provided here courtesy of BMC

RESOURCES