Abstract
Background
The rise of free open‐access medical education (FOAM) has led to a wide range of online resources in emergency medicine. Canadian physicians have been active contributors to FOAM.
Objectives
We aimed to create a virtual community of practice that would serve as a national platform for collaboration, learning, and knowledge dissemination.
Methods
CanadiEM was formed in 2016 from the merger of two Canadian websites and a podcast. Using a community‐of‐practice model, we introduced two training programs to support junior community members in becoming core editorial team members and employed asynchronous Web technologies to facilitate collaboration. We also introduced a coached peer review process and formed strategic alliances that aim to ensure a high quality of publication.
Results
CanadiEM has become a portal for readers to access a broad range of FOAM content. The website has published 782 articles. Of these, 71 have undergone a coached peer review process. The website has received over 2.5 million page views from 217 countries, and the associated CRACKCast podcast has been downloaded over 750,000 times.
Conclusions
CanadiEM has succeeded in building a national multi‐interface dissemination network that fosters collaboration and knowledge sharing in emergency medicine while fostering junior digital scholars. The construction of a community of practice has been facilitated by quality assurance, training programs, and the use of asynchronous Web technologies. Ongoing challenges in sustainability include a volunteer workforce with high turnover.
Need for Innovation
Free open‐access medical education (FOAM)1 has fostered the development of virtual communities of practice around the use of social media and online educational resources.2 Facilitated by critical clinicians, translational teachers, and interactive investigators,3 these communities disseminate educational and knowledge translation resources among geographically disparate health care practitioners.2, 4, 5 FOAM is particularly adept at raising awareness and contextualizing knowledge—key steps in the knowledge translation process6, 7, 8—through the dissemination of accessible resources.
However, a digital divide exists between trainees and teachers in terms of preference for the resources created by the FOAM movement (e.g., podcasts, blog posts).9 Moreover, the ubiquity of these resources10 has raised suspicion about their quality, especially when they are produced by trainees. In response, early adopters have sought ways to assure quality, but often lack senior mentors with experience in this area. This innovation explores the development of a virtual community of practice to support the education and growth of the next generation of digital scholars through the coproduction of a FOAM website.11, 12
Background
Groups from around the world including Australia (Life in the Fast Lane), the United States (Academic Life in Emergency Medicine), and the United Kingdom (St. Emlyn's) have established national FOAM platforms which have gained international recognition and galvanized communities of practice within these countries.13 As of 2015, the Canadian FOAM community comprised approximately 10 unique websites with no comprehensive national platform or consistent engagement with geographically disparate collaborators. These websites were challenged by reliance on a small, junior volunteer workforce14 and found it difficult to quickly produce quality content.15, 16
To address these concerns, we developed a national website to foster a virtual community of practice that facilitates sustainability, collaboration, and education scholarship while developing junior digital scholars. We have been successful in disseminating high‐quality content widely using strategies that could be adopted to other contexts and specialties.
Development Process
Conceptual Framework
Our organizational chart is based on Lave and Wenger's Community of Practice (Figure 1).17 A community of practice establishes a social context based on shared interest that allows participants to learn together and from each other, resulting in versatile and dynamic knowledge exchange.18, 19 Within the community, progression of roles and responsibilities is based on member engagement. CanadiEM was founded by several nationally acclaimed medical educators who functioned as senior editors for the website. The rest of the initial editorial board consisted of their digital mentees. These members formed the nexus around which a community of practice arose.
Our community of practice is based primarily in online communication technologies, and our online audience comprises our peripheral membership.2 CanadiEM accepts article submissions openly through a publicly available e‐mail address, allowing peripheral members to contribute and further the goals of the community, a process termed legitimate peripheral participation.17
Those interested in becoming core members have two opportunities for apprenticeship: first, the CanadiEM Junior Editor program trains junior learners in operational and leadership roles. Responsibilities include uploading and copyediting posts, liaising between authors and expert reviewers, graphic creation, promoting posts through social media, and optimizing content for search engines. These tasks transition junior editors from consumers of online educational resources to distributors and creators. They are supervised by faculty members, ensuring that high‐quality content is developed and delivered.
Second, the CanadiEM Digital Scholars program provides Canadian junior faculty members and senior emergency medicine residents subspecialty expertise in digital medical education scholarship.20 Its competency‐based curriculum consists of five modules (podcasting, blogging, digital identity, patient communication, translational teaching) is customized for each scholar and focuses on applying core medical education theory to online educational resources. Supervisors facilitate access to international leaders in medical education.
Implementation Phase
In 2016, CanadiEM was formed through the merger of the BoringEM and FrontDoor2Healthcare websites, two independent Canadian FOAM platforms. The CRACKCast podcast joined shortly thereafter. It is unlikely that analogous online entities will come together in the future, but pressures like those that drove these groups together are commonplace in the FOAM community. Once amalgamated, CanadiEM's five primary content sections were divided into interdependent teams (medical concepts, podcasts, academics, opinion & arts) and subsections (Data Supplement S1, Appendix A, available as supporting information in the online version of this paper, which is available at http://onlinelibrary.wiley.com/doi/10.1002/aet2.10199/full) and aimed to transition from disruptive to sustaining innovation.21
The CanadiEM Editorial Board consists of two editors‐in‐chief (both experienced, graduate‐trained clinician educators), who oversee 16 senior editors and 40 junior editors. To ensure robust communication among nationally distributed contributors, we use online technologies to empower asynchronous collaboration and mutual engagement among members (Data Supplement S1, Appendix B). As quality assurance was still a concern,15, 16 content experts were sought to legitimize the community as a place for sharing and creating knowledge19 through two programs:
First, CanadiEM introduced a coached peer review process.22 This modified peer review process connects trainee authors with nonblinded content experts via e‐mail. Content experts work with authors to improve article quality through multiple revisions in MS Word documents with tracked changes and correspond among themselves and the editor managing the piece. A core principle is that any submitted article has enough inherent value to become publishable. The timeline for the coaching process can range from 1 to 2 days to multiple months. Coached peer review is designed to be a positive collaborative experience for authors and experts, with the goal of encouraging future involvement in FOAM and other academic publications. Content experts also provide brief commentary that is published with the article. A complete description of this innovation has been published.22
Second, we created strategic alliances with nationally recognized organizations, including the Canadian Journal of Emergency Medicine (CJEM), the Canadian Association of Emergency Physicians (CAEP), and Translating Emergency Knowledge for Kids (TREKK). These organizations provide educational resources for dissemination via our online platform. The alliances take the form of a unique memorandum of understanding between each group and our website that is customized to the needs of each partner. Broadly speaking, the organizations provide content that we customize for our blog's style and disseminate via our social media platforms.
Outcomes
Website Content and Audience
To date, we have published 782 articles on the CanadiEM platform, including 288 imported from BoringEM and Frontdoor2Healthcare. Seventy‐one articles have been vetted through coached peer review while strategic alliances have yielded 71 articles (TREKK n = 6, CAEP n = 48, and CJEM n = 17). In total, 141 contributors have written a median of one article (interquartile range = 1–2) and represent nine of the 10 Canadian provinces (Data Supplement S1, Appendix C). Excluding editors, the maximum number of submissions from an author is eight.
From the website launch (January 1, 2016) through September 23, 2018, CanadiEM received > 2.5 million page views (now averaging > 120,000 page views/month) while CRACKCast podcasts were downloaded > 750,000 times (>35,000 downloads/month). Website viewers hailed from 217 countries, with approximately 35% from Canada, 30% from the United States, and 35% from the rest of the world. CanadiEM currently ranks ninth out of 148 in the June 2018 Social Media Index, which measures the impact23 and quality24 of emergency medicine and critical care websites.
Education Scholarship
At CanadiEM, the facilitated interactions between team members in our community of practice have developed an identity that values national collaboration on high‐quality scholarship. Our community has produced more than a half‐dozen nationally presented posters and presentations and four traditional academic publications.22, 25, 26, 27 As CanadiEM has become an established leader in FOAM, we have begun to spearhead the online recruitment efforts of study participants4 and to support research on FOAM projects.26
Reflective Discussion
Despite the many benefits of the CanadiEM model, we acknowledge a major limitation related to human resources. Training of new members has required a mix of informal training and on‐the‐job learning, which has occasionally led to delays and technical glitches. CanadiEM continues to rely on volunteer medical students, residents, and staff physicians, who are subject to work and life stressors that affect their commitment to CanadiEM.
We have mitigated the effects of the above limitations by building a close‐knit culture with constant online communication. In 2016, editors began holding annual meetings at the Canadian Association of Emergency Physicians Annual Conference and coordinating group events. We have rewarded our volunteer learners with networking benefits from being part of a community of practice; for example, digital mentorship, academic coaching, and letters of reference. All members benefit from skill development in leadership, teamwork, writing, and editing.
CanadiEM remains in the early stages of development. Future directions include curricular mapping of content, as some topic areas may be overemphasized.28 We continue to pursue strategies to reward participation within our community of practice, especially for our core editorial team. Some institutions have started to credit online educational resources toward academic promotion,29 which may reduce the opportunity cost of pursuing these projects. This strategy could also be adopted by residency training programs.30 A variety of funding models could improve sustainability and further exploration will be necessary to determine whether these models cost publication autonomy and independence.
CanadiEM has succeeded in building a national platform for collaboration and knowledge dissemination in emergency medicine while supporting the development of junior digital scholars. The construction of a community of practice has been facilitated by quality assurance, training programs, and the use of asynchronous Web technologies. Ongoing challenges in sustainability include costs and a volunteer workforce with high turnover.
The authors acknowledge the FOAM community and audience and specifically their mentors including Drs. Mike Cadogan, Michelle Lin, Anton Helman, Rob Woods, and Jonathan Sherbino.
Supporting information
AEM Education and Training 2019;3:86–91
The authors acknowledge a collective ownership of CanadiEM.org but earn no money from their involvement with the website.
The authors have no relevant financial information or potential conflicts to disclose.
Author Contributions: DKT, BT, and TMC conceived and designed the study; DKT, BT, AT, SS, and MB acquired the data presented; DKT, BT, and TMC analyzed and interpreted the data and drafted the manuscript; and all authors revised the manuscript for important intellectual content.
References
- 1. Nickson CP, Cadogan MD. Free Open Access Medical education (FOAM) for the emergency physician. Emerg Med Australas 2014;26:76–83. [DOI] [PubMed] [Google Scholar]
- 2. Thoma B, Brazil V, Spurr J, et al. Establishing a virtual community of practice in simulation: the value of social media. Simul Healthc 2018;13:124–30. [DOI] [PubMed] [Google Scholar]
- 3. Chan T, Trueger NS, Roland D, Thoma B. Evidence‐based medicine in the era of social media: scholarly engagement through participation and online interaction. CJEM 2018;20:3–8. [DOI] [PubMed] [Google Scholar]
- 4. Thoma B, Paddock M, Purdy E, et al. Leveraging a virtual community of practice to participate in a survey‐based study: a description of the METRIQ study methodology. Acad Emerg Med Educ Train 2017;1:110–3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Roland D, Spurr J, Cabrera D. Preliminary evidence for the emergence of a health care online community of practice: using a netnographic framework for Twitter hashtag analytics. J Med Internet Res 2017;19:e252. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Diner BM, Carpenter CR, O'Connell T, et al. Graduate medical education and knowledge translation: role models, information pipelines, and practice change thresholds. Acad Emerg Med 2007;14:1008–14. [DOI] [PubMed] [Google Scholar]
- 7. Pathman DE, Konrad TR, Freed GL, Freeman VA, Koch GG. The awareness‐to‐adherence model of the steps to clinical guideline compliance. The case of pediatric vaccine recommendations. Med Care 1996;34:873–89. [DOI] [PubMed] [Google Scholar]
- 8. Canadian Institutes of Health Research Knowledge Translation [KT] within the Research Cycle Chart. Ottawa, CA: Canadian Institutes of Health Research, 2007. [Google Scholar]
- 9. Purdy E, Thoma B, Bednarczyk J, Migneault D, Sherbino J. The use of free online educational resources by Canadian emergency medicine residents and program directors. CJEM 2015;17:101–6. [DOI] [PubMed] [Google Scholar]
- 10. Cadogan M, Thoma B, Chan TM, Lin M. Free Open Access Meducation (FOAM): the rise of emergency medicine and critical care blogs and podcasts (2002–2013). Emerg Med J 2014;31:e76–7. [DOI] [PubMed] [Google Scholar]
- 11. Chan TM, Stukus D, Leppink J, et al. Social media and the 21st‐century scholar: how you can harness social media to amplify your career. J Am Coll Radiol 2018;15:142–8. [DOI] [PubMed] [Google Scholar]
- 12. Lo A, Shappell E, Rosenberg H, et al. Four strategies to find, evaluate, and engage with online resources in emergency medicine. CJEM 2017:1–7. [DOI] [PubMed] [Google Scholar]
- 13. Carley S, Beardsell I, May N, et al. Social‐media‐enabled learning in emergency medicine: a case study of the growth, engagement and impact of a free open access medical education blog. Postgrad Med J 2018;94:92–6. [DOI] [PubMed] [Google Scholar]
- 14. Thoma B. Personal reflections on exploring social media in medicine. Int Rev Psychiatry 2015;27:161–6. [DOI] [PubMed] [Google Scholar]
- 15. Thoma B, Sebok‐Syer SS, Krishnan K, et al. Individual gestalt is unreliable for the evaluation of quality in medical education blogs: a METRIQ study. Ann Emerg Med 2017;70:394–401. [DOI] [PubMed] [Google Scholar]
- 16. Thoma B, Sebok‐Syer SS, Colmers‐Gray I, et al. Quality evaluation scores are no more reliable than gestalt in evaluating the quality of emergency medicine blogs: a METRIQ study. Teach Learn Med 2018;30:294–302. [DOI] [PubMed] [Google Scholar]
- 17. Lave J, Wenger E. Situated Learning: Legitimate Peripheral Participation. Cambridge, UK: Cambridge University Press, 1991. [Google Scholar]
- 18. Wenger E, McDermott R, Snyder WM. Cultivating Communities of Practice. Boston, MA: Harvard Business School Press, 2002. [Google Scholar]
- 19. Wenger E. Communities of Practice: Learning as a Social System. Syst Thinker. 1998. Available at: https://thesystemsthinker.com/communities-of-practice-learning-as-a-social-system/. Accessed Oct 15, 2018. [Google Scholar]
- 20. Zaver F, Thomas A, Shahbaz S, et al. The CanadiEM Digital Scholars program: an innovative international digital collaboration curriculum. CJEM 2017;19:S32. [Google Scholar]
- 21. Christenson C, Raynor ME. The Innovation Solution: Creating and Sustaining Successful Growth. Boston, MA: Harvard Buisness School Press, 2003. [Google Scholar]
- 22. Sidalak D, Purdy E, Luckett‐Gatopoulos S, Murray H, Thoma B, Chan TM. Coached peer review: developing the next generation of authors. Acad Med 2017;92:201–4. [DOI] [PubMed] [Google Scholar]
- 23. Thoma B, Sanders JL, Lin M, Paterson QS, Steeg J, Chan TM. The social media index: measuring the impact of emergency medicine and critical care websites. West J Emerg Med 2015;16:242–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Thoma B, Chan TM, Kapur P, et al. The social media index as an indicator of quality for emergency medicine blogs: a METRIQ study. Ann Emerg Med 2018. [Epub ahead of print]. [DOI] [PubMed] [Google Scholar]
- 25. Thoma B, Murray H, Huang SY, et al. The impact of social media promotion with infographics and podcasts on research dissemination and readership. CJEM 2018;20:300–6. [DOI] [PubMed] [Google Scholar]
- 26. Chan TM, Jo D, Shih AW, et al. The Massive Online Needs Assessment (MONA) to inform the development of an emergency haematology educational blog series. Perspect Med Educ 2018;7:219–23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Huang S, Martin LJ, Yeh CH, et al. The effect of infographic promotion on research dissemination and readership: a randomized control trial. CJEM 2018. [Epub ahead of print]. [DOI] [PubMed] [Google Scholar]
- 28. Stuntz R, Clontz R. An evaluation of emergency medicine core content covered by free open access medical education resources. Ann Emerg Med 2016;67:649–53 e2. [DOI] [PubMed] [Google Scholar]
- 29. Cabrera D, Vartabedian BS, Spinner RJ, Jordan BL, Aase LA, Timimi FK. More than likes and tweets: creating social media portfolios for academic promotion and tenure. J Grad Med Educ 2017;9:421–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Ting DK, Bigham BL, Mehta S, Stiell I. Adding value to scholarship in residency: Supporting and inspiring future emergency medicine research in Canada. CJEM 2018;20:318–20. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.