Skip to main content
PMC home page
BMC Health Services Research logoLink to BMC Health Services Research
. 2006 Jan 16;6:4. doi: 10.1186/1472-6963-6-4

A blended knowledge translation initiative to improve colorectal cancer staging [ISRCTN56824239]

Frances C Wright 1,✉, Calvin HL Law 1, Linda D Last 1, Neil Klar 2, David P Ryan 1, Andrew J Smith 1
PMCID: PMC1395360  PMID: 16412251

Abstract

Background

A significant gap has been documented between best practice and the actual practice of surgery. Our group identified that colorectal cancer staging in Ontario was suboptimal and subsequently developed a knowledge translation strategy using the principles of social marketing and the influence of expert and local opinion leaders for colorectal cancer.

Methods/Design

Opinion leaders were identified using the Hiss methodology. Hospitals in Ontario were cluster-randomized to one of two intervention arms. Both groups were exposed to a formal continuing medical education session given by the expert opinion leader for colorectal cancer. In the treatment group the local Opinion Leader for colorectal cancer was detailed by the expert opinion leader for colorectal cancer and received a toolkit. Forty-two centres agreed to have the expert opinion leader for colorectal cancer come and give a formal continuing medical education session that lasted between 50 minutes and 4 hours. No centres refused the intervention. These sessions were generally well attended by most surgeons, pathologists and other health care professionals at each centre. In addition all but one of the local opinion leaders for colorectal cancer met with the expert opinion leader for colorectal cancer for the academic detailing session that lasted between 15 and 30 minutes.

Discussion

We have enacted a unique study that has attempted to induce practice change among surgeons and pathologists using an adapted social marketing model that utilized the influence of both expert and local opinion leaders for colorectal cancer in a large geographic area with diverse practice settings.

Background

A significant difference exists between what is known to represent best practice and the actual practice of medicine [1]. Such gaps have been repeatedly documented in surgical practice [2-9]. Unfortunately, traditional continuing professional development (CPD) has not been able to bridge the gap between research and evidence-based guidelines and clinical practice [10-13] and consequently, many have advocated for an improved approach [14,15]. Davis has advocated for 'knowledge translation', as a way of closing the gap between evidence and practice [1]. Such an approach focuses on situated learning within the actual practice of healthcare, includes all participants involved in healthcare practices and attempts to identify and overcome local barriers that prevent practice change [1].

Our group has focused on identifying and closing a gap in colorectal cancer (CRC) staging in Ontario. Accurate staging of CRC is critical when determining appropriate treatment for patients and when it is poorly done it has a negative impact on patient survival [16,17]. Optimal CRC staging involves clinician knowledge of the minimum number of lymph nodes (LN) to be assessed, requires that a surgeon perform an appropriate mesenteric resection and a pathologist identify and assess the LNs adequately [18]. In Ontario, where 73% of patients with Stage II CRC were shown to be inadequately staged [7], the challenge of influencing the practice of over 1000 surgeons and pathologists in multiple institutions is significant. We examined the effectiveness of a multi-pronged strategy attempting to improve CRC staging in this large geographic area.

We embarked upon a knowledge translation study in which we adapted the principles of social marketing to influence physician behaviour in the context of a practice element that has both knowledge and technical aspects [19]. In contrast, Soumerai initially described social marketing in the context of changing physician prescribing practices [19]. The elements of the social marketing approach include defining clear educational objectives, focusing programs on specific categories of physicians and opinion leaders, establishing 'messenger' credibility, stimulating physician participation in educational interactions, using concise educational materials and providing positive reinforcement when trying to change physician behaviour. A recent Cochrane Review has suggested that social marketing can change physician behaviour [20].

Embedded in the social marketing model we adapted, was the identification (using Hiss methodology) and utilization of both local and expert opinion leaders' (OL) influence [21]. According to the Hiss construct, local OLs are physicians who 1) encourage learning and enjoy sharing their knowledge; 2) are clinical experts and always seem up-to-date and 3) treat others as equals [21,22]. Opinion leaders who are influential in inciting change at their local health care institution are considered local to peer Ols [23]. OLs who are considered influential on a provincial or national level are considered 'expert' OLs and their support for evidence is sufficient endorsement to consider adoption [24]. Such expert OLs are often consultants or work out of academic centres [25]. Among surgeons, Young has identified that the concept of the OL, especially on a provincial or national level, is supported and that OLs, are considered influential [26].

Little has been written about how large-scale social marketing that utilizes the influence of local and expert opinion leaders has been performed among specialist physicians. The Cochrane Collaboration suggests that further research is required to determine in what context social marketing and OLs are most likely to influence the practice of their peers [20,27]. In this paper we describe a knowledge translation intervention that used the principles of social marketing and that utilized the influence of local and expert Ols [19,28].

Methods

Study design and study population

This trial compared formal CME alone and formal CME plus the influence of a local opinion leader plus a toolkit on changing surgeon and pathologist behaviour in the context of LN assessment in CRC staging. It was a cluster-randomized trial with the hospital as the unit of random assignment [29]. The particular design was utilized to minimize the contamination of education materials between intervention arms and enabled measurement of the rate of change in each region (Fig. 1) [29]. Most randomized trials do not have outcome data for non-participants. This limits their ability to generalize study results or to determine the impact of Hawthorne effects [30,31]. A strength of our study is that the number of LN's assessed will be available for all patients in Ontario diagnosed with CRC. Consequently we will also be comparing LN assessment of patients from the study hospitals to those of patients whose LN's were assessed at hospitals which did not participate in our trial.

Figure 1.

Figure 1

Open in a new tab

Randomization Algorithm for Ontario Hospitals

Sample size and power calculation

Between 1997 and 2000, 27% of patients had an appropriate number of LNs (minimum 12) examined in their surgical specimens in Ontario [7]. As part of this initiative we enrolled 42 hospitals in Ontario. Twenty-one hospitals were randomized to a formal continuing medical education lecture and the other 21 were randomized to the lecture/OL influence/toolkit arm. The remaining hospitals that did not identify an OL did not participate in the study. This sample size is predicted to have 80% power to detect a difference between the two randomized treatment arms of 27% for CME alone and 54% for CME plus the influence of a local opinion leaders plus toolkit in the proportion of patients having at least 12 nodes examined assuming an average of 3 patients per hospital at the six month assessment and using a two-tailed 5% type I error rate and an intracluster correlation coefficient of 0.1. Note that the assumption that 27% of patients seen at CME alone hospitals will have at least 12 nodes assessed is equivalent to what was seen, overall, by Wright et al. as was the degree of intracluster correlation [7]. A two fold difference between the randomized arms was selected as being clinically relevant and equivalent to the difference found between academic and nonacademic hospitals by Wright et al [7]. The sample size was determined using the approach described by Donner and Klar [29]. Greater power is anticipated to be achieved as the primary analysis is based on the number of nodes examined per patient using the generalized estimating equations extension of Poisson regression to account for between hospital variation in node counts [29].

Opinion leader identification

A two-page survey instrument was created based on the OL identification methodology developed by Hiss (Additional file: 1) [32]. The wording that was used to describe the three OL characteristics (knowledgeable practitioners, educators, and caring professionals who exhibit a high level of humanist concern) was minimally changed from the original Hiss survey instrument [33]. We then identified OLs with special expertise in CRC using a technique utilized by other investigators who also identified OLs with special expertise [34-39]. Importantly, in Soumerai's, Gifford's, Lomas' and Guadagnoli's study [34], the OLs (with special expertise) were part of a multi-modal approach that resulted in an improvement in patient care.

Sample

The OL survey was mailed to 1243 general surgeons and pathologists in Ontario with a stamped addressed envelope (SAE) for their reply. Physicians were identified using the Canadian Medical Directory™ (2001) using the criteria "General Surgeons and Pathologists with and without hospital affiliation". The second mail contact included the survey, SAE and an incentive to complete the survey (draw for a Sony Clie©™). An electronic mail reminder to fill in the survey, including incentive information, was sent out to 366 physicians (e-mail addresses from the Canadian Medical Directory™). A subset of physicians who had not replied after two mailings had their offices contacted by telephone and if they agreed, a survey was faxed to their office or completed over the phone. The third mail contact again included a SAE, survey, and the same incentive. The final mail contact included the survey, SAE, the same incentive and a flyer with the TNM Staging for colorectal cancer. All forms of contact were coded so that it could be identified which contact had initiated the survey response.

Physicians were excluded if their practice did not include any colorectal cancer surgery and if they were practicing in another surgical sub-specialty i.e. cardiac, thoracic, vascular surgery or if they were not currently practicing in Ontario, retired or deceased. Physicians whose surveys were returned with an incorrect address were also excluded. Efforts were made to find the correct address including using the College of Physicians and Surgeons of Ontario (CPSO) website and the Royal College of Physicians and Surgeons of Canada (RCPSC) website. "Refusals" were defined as physicians who sent back the surveys not completed or partially completed.

Hospital amalgamation

In 1997–2000, we identified 99 hospitals that performed CRC surgery in Ontario. By the time we identified OL in Ontario, a number of hospitals had been amalgamated at the request of the provincial government. Hence at the time of our study, 81 hospitals were performing CRC surgery.

Identifying an opinion leader for colorectal cancer

In our study, physicians were defined as an OL for CRC if they were recognized at least once in all three OL categories and additionally were identified as a person whose advice was valued on CRC using this algorithm. Forty-two hospitals identified an OL for CRC and 39 centres did not, one of which was an academic centre [22]. The 42 hospitals that identified an OL participated in the education intervention and the 39 that did not were not exposed to an intervention. Importantly, our lack of OL identification in a number of centres is not unique, Young (2003) did not identify local surgical OLs at each hospital in her study of Australian surgeons [26].

Identifying the characteristics of an "Expert OL for CRC"

The expert OL was a highly regarded surgeon who was identified (multiple times) as an OL for CRC, worked at an academic centre, is recognized in the surgical community as having expertise in CRC on the basis of multiple formal Continuing Medical Education presentations and publications regarding CRC and for treating a high volume of patients with CRC.

Randomization

Hospitals that identified OL's were cluster-randomized to one of two arms. The intervention arm included a Formal CME (continuing medical education) lecture plus the influence of the Opinion Leader plus a Toolkit. The control arm was the Formal CME session alone. The cluster randomization design was utilized to minimize the contamination of education materials between intervention arms and enabled measurement of the rate of change in each region (Fig. 1) [29]. In addition, hospitals were stratified, prior to random assignment, based on two characteristics, their academic status and their yearly volume of CRC cases (low < 20, high ≥ 20). Our previous work demonstrated that a hospital's designation as an academic or non-academic institution was an important predictor of the number of LNs assessed in CRC [7]. We defined academic centers as those hospitals in which both pathology and surgery residents have regular rotations. The remaining hospitals that did not identify OL for CRC and did not participate in the education sessions constituted the control arm (see Fig 1).

Intervention

All randomized hospitals (n = 42) participated in the formal educational sessions led by the same expert OL for CRC. The sessions emphasized the importance of adequate LN assessment in CRC and consisted of a standardized PowerPoint® lecture which had previously been tested in a single institution study and an interactive question and answer session [18]. The presentation also included a 'scatter gram' of the median LN counts collected for patients with Stage II CRC (1997–2000) for each hospital in the province. If requested by the institution or an individual surgeon/pathologist, the median LN count for that particular institution was revealed at a later date. Participants in the study were not made aware that they were part of a randomized controlled trial and that CRC LN counts would be reassessed after the formal education sessions and academic detailing had been completed.

Opinion leader arm

The expert OL for CRC met with all but one of the locally identified OL and discussed the importance of adequate LN assessment, local barriers toward improving LN assessment and possible solutions were discussed (academic detailing). A toolkit was provided at the time of the detailing for the OL which consisted of a binder that had a cover letter, a print-out of the PowerPoint® slide presentation, a pathology template for CRC, guidelines for what should be included in a pathology report for CRC, 3 copies of a poster with a picture of a colon with a number '12' watermarked over it and 3 pocket cards that reminded the OL what an optimal pathology report for CRC would look like, the AJCC staging and a reminder of the minimum number of LN to assess in a CRC specimen. Further printed information was given to some OLs either during the sessions or after if requested. E-mail and telephone follow-up also occurred with some OLs.

Follow-up

A follow-up package was sent 6 months following the presentation (regular mail) to the CME plus OL plus toolkit site only. The package included a cover letter from the expert OL for CRC thanking the local OL for their participation in the process and opening the door to further discussion if requested, a peer-reviewed paper on LNs clearing solution and more of the same pocket cards [40].

Ethical Review was obtained from the Sunnybrook and Women's College Health Sciences Centre Research Ethics Review Board to complete this trial.

Preliminary results

Participation

All centres (n = 42) agreed to have the expert OL for CRC come and give the formal CME session. Although the hospitals were enthusiastic about hosting the sessions, the arrangements to coordinate the sessions were time consuming. Ninety-percent (38/42) of these sessions took place over a four-month time period beginning in January 5th 2004 and all of the sessions were completed by June 17th 2004 (5.5 months). Twenty-four of the sessions were given in the context of hospital rounds and 18 were formal dinners at local restaurants. In general, the dinner presentations were organized for smaller community hospitals. The sessions varied in length between 50 minutes to 4 hours. Food was paid for by the research group in 20/42 centres. Attendance was generally good with most surgeons, pathologists, and pathology assistants (if the position existed at the hospital) attending at each centre. In addition, medical oncologists, family physicians, residents, fellows and nurses also attended some of the sessions. All but one of the opinion leaders in the academic detailing arm agreed to meet personally with the expert OL for CRC (96%) on an individual basis. These sessions lasted between 15–30 minutes. The local OL who did not meet personally with the expert OL for CRC communicated with the expert OL on the telephone and via electronic mail.

Feedback

Hospitals and OLs relayed their enthusiasm for the project in a number of different ways. Two centres performed audits on the local LN counts prior to the CME session by the expert OL for CRC. After the session was completed, five centres sent correspondence relaying the positive experience of the session, four centres indicated that they were planning to initiate a multi-disciplinary gastro-intestinal tumour conference and four centres requested further information (particularly with regards to their own LNs counts). Interestingly, two centres that were not visited as part of the study also contacted our group requesting information on how to improve their LN counts in CRC.

Discussion

This study is unique in attempting to incite practice change amongst surgeons and pathologists by using an adapted social marketing model. The intervention utilized the influence of Hiss-criteria OLs for CRC in a large geographic area with diverse practice settings (Table 1) [21,38,39,41-43]. Importantly, surgeons have indicated in a number of studies that OLs could be influential on their practice patterns especially at a national level [22,26] (Simunovic, personal communication 2004). Social marketing has been successfully used to change physician behaviour primarily with respect to physician prescribing practices [44-46]. Our study is unique in that we have adopted this model to change aspects of physician behaviour that are related to a process that has both knowledge and technical elements.

Table 1.

A social marketing approach to changing physician behaviour [19]

Steps in the social marketing approach Description of intervention
1. Conducting interviews to investigate baseline knowledge A needs assessment was previously completed to assess how many LNs were being assessed in colorectal cancer staging [7]
2. Focusing programs on specific categories of physicians as well as on their opinion leaders General Surgeons and Pathologists were targeted. Opinion leaders were identified and recruited [22]
3. Defining clear educational and behavioural objectives LNs staging was emphasized during the discussion, including the target number of nodes to assess (12)
4. Establishing credibility through respected organizational identity, referencing authoritative literature and presenting controversies The expert OL came from a respected organization. The formal CME discussion presented an overview of the literature
5. Stimulating physician participation A question and answer session occurred after the formal CME session. This session often lasted long than the 'official' talk.
6. Using concise educational materials The pocket cards and posters emphasized the importance of 12 LNs being assessed
7. Highlighting and repeating essential messages The concept of 12 LNs was repeated in the talk, in the educational materials and in the reminder materials sent to the opinion leaders
8. Providing positive reinforcement of the improved practices in follow-up visits Ongoing process. Reinforcement will be sent by mail.
Open in a new tab

We have utilized both the influence of an expert OL for CRC and a local or peer OL for CRC both of whom have different roles during a change intervention. Locock suggests that expert OLs are important in the initial stages of an education intervention when evidence needs to be endorsed and translated into a form that is acceptable to local practitioners [47]. The expert OL is considered to be a "higher authority" who is able to explain and evaluate the evidence [48]. In contrast, local or peer OLs are important in the later phases of implementation during which time they role model new behaviour and give colleagues confidence to initiate change [49].

In the present intervention, the expert OL for CRC personally went to each of the hospitals (n = 42) to present the CME session (endorse the evidence) and detail the local OLs. We feel that the presentation by the expert OL for CRC at each local site was an important aspect of the intervention. It has been demonstrated that when physicians consider adopting an innovation that the meaning of the new information has to be discussed among the local physicians (social construction of knowledge) before it can be enacted [50, 51, 52, 53, 54]. We postulate the presence of the expert OL for CRC when endorsing the new information initiated this discussion for each group and the local OL and will facilitate the process of behaviour change.

This multi-pronged intervention required a substantial time and financial commitment to enact. One full-time research assistant was employed to co-ordinate the formal CME sessions, academic detailing and follow-up packages. The expert OL for CRC also dedicated 25% of his clinical time for four months to complete the intervention. Clearly this sort of intervention is resource intense and if it is to become a standard approach to changing physician behaviour then substantial support would be required.

There are a number of reasons why this study may not be successful in achieving its endpoint of improved CRC staging. First, during our OL identification process we may not have included a number of new general surgery graduates in our survey mail out and hence, some OL for CRC may not have been identified. Second, our intervention predominantly addressed a knowledge deficit and although we attempted to incite discussion and start the process of the social construction of knowledge, if local barriers were too great (i.e. pathology resource issues) then improving CRC staging may be an insurmountable barrier [55].

However, if the intervention is successful then we may not be able to clearly determine if our intervention alone was the catalyst. A number of other continuing medical education events have occurred in the province (including our own oncology rounds) that focused on accurate staging in CRC. In addition, the provincial Cancer Care Organization has also been recently focusing on improving the care of patients with cancer [56]. To address this issue, we will be collecting LN counts for a number of years (2002, 2003) before the intervention was initiated in 2004 as well as after the intervention was started. Our timeline involves data collection between September and December 2005, and analysis is to start in January 2006. In addition, we plan on conducting qualitative interviews with participants to determine whether our intervention incited any physician behaviour change.

Davis has suggested that further research is required to understand how to best facilitate the rapid uptake of evidenced-based knowledge [1]. We have described a knowledge translation initiative that we have implemented across Ontario with the aim of improving colorectal cancer staging. We have used a social marketing approach that included the influence of both peer and expert opinion leaders in an attempt to locally construct knowledge to enable physician behaviour change [19].

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

FCW helped develop the study design, assisted with statistical analysis and drafted the manuscript. CHLL helped develop the study design, performed statistical analysis and helped draft the manuscript. LDL helped develop the study design, collected and collated the data and helped draft the manuscript. NK helped develop the study design and formulated the randomization and helped draft the manuscript. DPR helped develop the study design and helped draft the manuscript. AJS conceived and helped develop the study design, was the investigator who actually contacted and detailed the Opinion Leaders, helped draft the manuscript and helped with statistical analysis. All authors read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6963/6/4/prepub

Supplementary Material

Additional file 1

.

Click here for file (43.9KB, pdf)

Contributor Information

Frances C Wright, Email: frances.wright@sw.ca.

Calvin HL Law, Email: calvin.law@sw.ca.

Linda D Last, Email: linda.last@sw.ca.

Neil Klar, Email: Neil.Klar@schulich.uwo.ca.

David P Ryan, Email: david.ryan@sw.ca.

Andrew J Smith, Email: andy.smith@sw.ca.

References

  1. Davis D, Evans M, Jadad A, et al. The case for knowledge translation: shortening the journey from evidence to effect. BMJ. 2003;327:33–35. doi: 10.1136/bmj.327.7405.33. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Mendis D, El Shanawany T, Mathur A, Redington AE. Management of spontaneous pneumothorax: are British Thoracic Society guidelines being followed? Postgrad Med J. 2002;78:80–84. doi: 10.1136/pmj.78.916.80. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Sargen K, Kingsnorth AN. Management of gallstone pancreatitis: effects of deviation from clinical guidelines. JOP. 2001;2:317–322. [PubMed] [Google Scholar]
  4. Barnard J, Siriwardena AK. Variations in implementation of current national guidelines for the treatment of acute pancreatitis: implications for acute surgical service provision. Ann R Coll Surg Engl. 2002;84:79–81. [PMC free article] [PubMed] [Google Scholar]
  5. Akalin HE. Surgical prophylaxis: the evolution of guidelines in an era of cost containment. J Hosp Infect. 2002;50:S3–S7. doi: 10.1053/jhin.2001.1121. [DOI] [PubMed] [Google Scholar]
  6. Ramachandra J, Bond A, Ranaboldo C, Cullis J. An audit of post-splenectomy prophylaxis – are we following the guidelines? Ann R Coll Surg Engl. 2003;85:252–255. doi: 10.1308/003588403766274962. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Wright FC, Law CH, Last L, et al. Lymph node retrieval and assessment in stage II colorectal cancer: a population-based study. Ann Surg Oncol. 2003;10:903–909. doi: 10.1245/ASO.2003.01.012. [DOI] [PubMed] [Google Scholar]
  8. White J, Morrow M, Moughan J, et al. Compliance with breast-conservation standards for patients with early-stage breast carcinoma. Cancer. 2003;97:893–904. doi: 10.1002/cncr.11141. [DOI] [PubMed] [Google Scholar]
  9. Distante V, Mano MP, Ponti A, et al. Monitoring surgical treatment of screen-detected breast lesions in Italy. Eur J Cancer. 2004;40:1006–1012. doi: 10.1016/j.ejca.2004.01.015. [DOI] [PubMed] [Google Scholar]
  10. Davis D, O'Brien MA, Freemantle N, et al. Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA. 1999;282:867–874. doi: 10.1001/jama.282.9.867. [DOI] [PubMed] [Google Scholar]
  11. Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. JAMA. 1992;268:1111–1117. doi: 10.1001/jama.268.9.1111. [DOI] [PubMed] [Google Scholar]
  12. Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA. 1995;274:700–705. doi: 10.1001/jama.274.9.700. [DOI] [PubMed] [Google Scholar]
  13. Grimshaw JM, Eccles MP. Is evidence-based implementation of evidence-based care possible? Med J Aust. 2004;180:S50–S51. doi: 10.5694/j.1326-5377.2004.tb05945.x. [DOI] [PubMed] [Google Scholar]
  14. Ebell MH, Shaughnessy A. Information mastery: integrating continuing medical education with the information needs of clinicians. J Contin Educ Health Prof. 2003;23:S53–S62. doi: 10.1002/chp.1340230409. [DOI] [PubMed] [Google Scholar]
  15. Manning PR, DeBakey L. Continuing medical education: the paradigm is changing. J Contin Educ Health Prof. 2001;21:46–54. doi: 10.1002/chp.1340210108. [DOI] [PubMed] [Google Scholar]
  16. Law CH, Wright FC, Rapanos T, et al. Impact of lymph node retrieval and pathological ultra-staging on the prognosis of stage II colon cancer. J Surg Oncol. 2003;84:120–126. doi: 10.1002/jso.10309. [DOI] [PubMed] [Google Scholar]
  17. Caplin S, Cerottini JP, Bosman FT, et al. For patients with Dukes' B (TNM Stage II) colorectal carcinoma, examination of six or fewer lymph nodes is related to poor prognosis. Cancer. 1998;83:666–672. doi: 10.1002/(SICI)1097-0142(19980815)83:4&#x0003c;666::AID-CNCR6&#x0003e;3.0.CO;2-I. [DOI] [PubMed] [Google Scholar]
  18. Smith AJ, Law CH, Khalifa MA, et al. Multimodal CME for surgeons and pathologists improves colon cancer staging. J Cancer Educ. 2003;18:81–86. doi: 10.1207/S15430154JCE1802_09. [DOI] [PubMed] [Google Scholar]
  19. Soumerai SB, Avorn J. Principles of educational outreach ('academic detailing') to improve clinical decision making. JAMA. 1990;263:549–556. doi: 10.1001/jama.263.4.549. [DOI] [PubMed] [Google Scholar]
  20. Thomson O'Brien MA, Oxman AD, Haynes RB, et al. Local opinion leaders: effects on professional practice and health care outcomes. Vol. 4. The Cochrane Library Oxford; 2001. Ref Type: Report. [DOI] [PubMed] [Google Scholar]
  21. Hiss RG, MacDonald R, Davis WK. Proceedings of the seventeenth annual conference on research in medical education. Washington, DC; 1978. Identification of physician educational influentials (EI's) in small community hospitals; pp. 283–288. Ref Type: Conference Proceeding. [Google Scholar]
  22. Wright FC, Ryan DP, Dodge JE, et al. Identifying educationally influential specialists: issues arising from the use of "classic" criteria. J Contin Educ Health Prof. 2004;24:213–226. doi: 10.1002/chp.1340240405. [DOI] [PubMed] [Google Scholar]
  23. Lococ L, Dopson S, Chambers D, Gabbay J. Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med. 2001;53:745–757. doi: 10.1016/S0277-9536(00)00387-7. [DOI] [PubMed] [Google Scholar]
  24. Lococ L, Dopson S, Chambers D, Gabbay J. Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med. 2001;53:745–757. doi: 10.1016/S0277-9536(00)00387-7. [DOI] [PubMed] [Google Scholar]
  25. Lococ L, Dopson S, Chambers D, Gabbay J. Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med. 2001;53:745–757. doi: 10.1016/S0277-9536(00)00387-7. [DOI] [PubMed] [Google Scholar]
  26. Young JM, Hollands MJ, Ward J, Holman CD. Role for opinion leaders in promoting evidence-based surgery. Arch Surg. 2003;138:785–791. doi: 10.1001/archsurg.138.7.785. [DOI] [PubMed] [Google Scholar]
  27. Thomson O'Brien MA, Oxman AD, Davis DA, et al. Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 1997. CD000409.DOI:10.1002/14651858.CD000409[4]. Ref Type: Report. [DOI] [PubMed]
  28. Lococ L, Dopson S, Chambers D, Gabbay J. Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med. 2001;53:745–757. doi: 10.1016/S0277-9536(00)00387-7. [DOI] [PubMed] [Google Scholar]
  29. Donner A, Klar N. "Design and Analysis of Cluster Randomization Trials in Health Research.". London: Arnold; 2000. [Google Scholar]
  30. Peppercorn JM, Weeks JC, Cook EF, Joffe S. Comparison of outcomes in cancer patients treated within and outside clinical trials: conceptual framework and structured review. Lancet. 2004;363:263–270. doi: 10.1016/S0140-6736(03)15383-4. [DOI] [PubMed] [Google Scholar]
  31. Buck C, Donner A. The design of controlled experiments in the evaluation of non-therapeutic interventions. J Chronic Dis. 1982;35:531–538. doi: 10.1016/0021-9681(82)90072-8. [DOI] [PubMed] [Google Scholar]
  32. Livingstone DW. Exploring the icebergs of adult learning: Findings of the first Canadian survey of informal learning practices. Can J for the Study of Adult Edu. 1999;13:49–72. [Google Scholar]
  33. Livingstone DW. Expanding notions of work and learning: Profiles of latent power. New Directions for Adult and Cont Educ. 2001;92:19–30. doi: 10.1002/ace.37. [DOI] [Google Scholar]
  34. Soumerai SB, McLaughlin TJ, Gurwitz JH, et al. Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a randomized controlled trial. JAMA. 1998;279:1358–1363. doi: 10.1001/jama.279.17.1358. [DOI] [PubMed] [Google Scholar]
  35. Kaufman DM, Ryan K, Hodder I. A Study of the Educationally Influential Physician. J Contin Educ Health Prof. 1999;19:152–162. doi: 10.1002/chp.1340190304. [DOI] [Google Scholar]
  36. Grzybowski S, Lirenman D, White MI. Identifying educational influentials for formal and informal continuing medical education in the province of British Columbia. J Contin Educ Health Prof. 2000;20:85–90. doi: 10.1002/chp.1340200204. [DOI] [PubMed] [Google Scholar]
  37. Gifford DR, Holloway RG, Frankel MR, et al. Improving adherence to dementia guidelines through education and opinion leaders. A randomized, controlled trial. Ann Intern Med. 1999;131:237–246. doi: 10.7326/0003-4819-131-4-199908170-00002. [DOI] [PubMed] [Google Scholar]
  38. Guadagnoli E, Soumerai SB, Gurwitz JH, et al. Improving discussion of surgical treatment options for patients with breast cancer: local medical opinion leaders versus audit and performance feedback. Breast Cancer Res Treat. 2000;61:171–175. doi: 10.1023/A:1006475012861. [DOI] [PubMed] [Google Scholar]
  39. Lomas J, Enkin M, Anderson GM, et al. Opinion leaders vs audit and feedback to implement practice guidelines. Delivery after previous cesarean section. JAMA. 1991;265:2202–2207. doi: 10.1001/jama.265.17.2202. [DOI] [PubMed] [Google Scholar]
  40. Newell KJ, Sawka BW, Rudrick BF, Driman DK. GEWF solution. Arch Pathol Lab Med. 2001;125:642–645. doi: 10.5858/2001-125-0642-GS. [DOI] [PubMed] [Google Scholar]
  41. Taylor VM, Goldberg HI, et al. Modifying community practice style: The back pain outcome assessment team information dissemination effort. J Contin Educ Health Prof. 2004;16:203–214. [Google Scholar]
  42. Kravitz RL, Krackhardt D, Melnikow J, et al. Networked for change? Identifying obstetric opinion leaders and assessing their opinions on caesarean delivery. Soc Sci Med. 2003;57:2423–2434. doi: 10.1016/S0277-9536(03)00137-0. [DOI] [PubMed] [Google Scholar]
  43. Bhandari M, Devereaux PJ, Swiontkowski MF, et al. A randomized trial of opinion leader endorsement in a survey of orthopaedic surgeons: effect on primary response rates. Int J Epidemiol. 2003;32:634–636. doi: 10.1093/ije/dyg112. [DOI] [PubMed] [Google Scholar]
  44. Avorn J, Soumerai SB. Improving drug-therapy decisions through educational outreach. A randomized controlled trial of academically based "detailing". N Engl J Med. 1983;308:1457–1463. doi: 10.1056/NEJM198306163082406. [DOI] [PubMed] [Google Scholar]
  45. Avorn J, Soumerai SB, Everitt DE, et al. A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. N Engl J Med. 1992;327:168–173. doi: 10.1056/NEJM199207163270306. [DOI] [PubMed] [Google Scholar]
  46. Ross-Degnan D, Soumerai SB, Goel PK, et al. The impact of face-to-face educational outreach on diarrhoea treatment in pharmacies. Health Policy Plan. 1996;11:308–318. doi: 10.1093/heapol/11.3.308. [DOI] [PubMed] [Google Scholar]
  47. Lococ L, Dopson S, Chambers D, Gabbay J. Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med. 2001;53:745–757. doi: 10.1016/S0277-9536(00)00387-7. [DOI] [PubMed] [Google Scholar]
  48. Dopson S, FitzGerald L, Ferlie E, et al. No magic targets! Changing clinical practice to become more evidence based. Health Care Manage Rev. 2002;27:35–47. doi: 10.1097/00004010-200207000-00005. [DOI] [PubMed] [Google Scholar]
  49. Lococ L, Dopson S, Chambers D, Gabbay J. Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med. 2001;53:745–757. doi: 10.1016/S0277-9536(00)00387-7. [DOI] [PubMed] [Google Scholar]
  50. Smith J. Modeling the social construction of knowledge in ELT teacher education. ELT Journal. 2001;55:221–227. doi: 10.1093/elt/55.3.221. [DOI] [Google Scholar]
  51. Coleman JS, Katz E, Menzel H. "Medical innovation: A diffusion study.". New York: Bobbs-Merrill Company Inc; 1996. [Google Scholar]
  52. Rogers EM. Lessons for guidelines from the diffusion of innovations. Comm J Qual Improv. 1995;21:324–328. doi: 10.1016/s1070-3241(16)30155-9. [DOI] [PubMed] [Google Scholar]
  53. Greer AL. The state of the art versus the state of the science. The diffusion of new medical technologies into practice. Int J Technol Assess Health Care. 1988;4:5–26. doi: 10.1017/s0266462300003202. [DOI] [PubMed] [Google Scholar]
  54. Greer AL. Scientific knowledge and social consensus. Control Clin Trials. 1994;15:431–436. doi: 10.1016/0197-2456(94)90001-9. [DOI] [PubMed] [Google Scholar]
  55. Wright FC, Law CHL, Last LD, et al. Barriers to optimal assessment of lymph nodes in colorectal cancer specimens. Am J Clin Path. 2004;121:663–670. doi: 10.1309/17VK-M33B-FXF9-T8WD. [DOI] [PubMed] [Google Scholar]
  56. Talaga Tanya Hospitals put on care alert. Toronto Star Newspaper March 07, 2005 . Ref Type: Newspaper.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1

.

Click here for file (43.9KB, pdf)

Articles from BMC Health Services Research are provided here courtesy of BMC

RESOURCES