Abstract
Background
As many countries fear and even experience the emergence of a second wave of COVID-19, reminding health care workers (HCWs) and other hospital employees of the critical role they play in preventing SARS-CoV-2 transmission is more important than ever. Building and strengthening the intrinsic motivation of HCWs to apply infection prevention and control (IPC) guidelines to avoid contaminating their colleagues, patients, friends, and relatives is a goal that must be energetically pursued. A high rate of nosocomial infections during the first COVID-19 wave was detected by IPC specialists and further cemented their belief in the need for an engaging intervention that could improve compliance with COVID-19 safe behaviors.
Objective
Our aim was to develop a serious game that would promote IPC practices with a specific focus on COVID-19 among HCWs and other hospital employees.
Methods
The first 3 stages of the SERES framework were used to develop this serious game. A brainswarming session between developers and IPC specialists was used to identify the target audience and acquisition objectives. Nicholson’s RECIPE mnemonic (reflection, engagement, choice, information, play, exposition) for meaningful gamification was used to guide the general design. A common and simple terminology was used to suit the broad target audience. The game was tested on various platforms (smartphones, tablets, laptops, desktop computers) by different users during each development loop and before its final release.
Results
The game was designed to target all hospital staff who could be in direct contact with patients within the Geneva University Hospitals. In total, 10 acquisition objectives were defined by IPC specialists and implemented into the game according to the principles of meaningful gamification. A simple storyboard was first created using Microsoft PowerPoint and was progressively refined through multiple iteration loops. Articulate Storyline was then used to create two successive versions of the actual game. In the final version, a unique graphic atmosphere was created with help from a professional graphic designer. Feedback mechanisms were used extensively throughout the game to strengthen key IPC messages.
Conclusions
The SERES framework was successfully used to create “Escape COVID-19,” a serious game designed to promote safe IPC practices among HCWs and other hospital employees during the COVID-19 pandemic. This game can be obtained free of charge for research and educational purposes. A SCORM (shareable content object reference model) package is available to facilitate results and completion tracking on most current learning management systems.
Keywords: COVID-19, transmission, serious games, infection prevention, health care workers, SARS-COV-2, infectious disease, safety, behavior, hospital
Introduction
Background and Importance
As the COVID-19 death toll continues to rise [1] and many countries fear or are experiencing the emergence of a second wave [2-4], avoiding disease transmission is becoming increasingly important. Health care workers (HCWs) and other hospital employees, including medical, nursing, and administrative and support staff, are at high risk of contamination [5-7]. The actual rate of COVID-19 infection among HCWs is unknown and may vary significantly from one country to another. Recent studies have shown that as many as 20% of asymptomatic HCWs had serological evidence of having been exposed to SARS-CoV-2, the virus responsible for COVID-19 [8]. Inadequate application of infection prevention and control (IPC) procedures by HCWs and other hospital employees can lead to the contamination of their colleagues, patients, and even visitors [9]. Improper handling of personal protective equipment (PPE) can also lead to self-contamination [10,11].
As the pandemic draws out, lassitude and conspiracy theories can lead to a slackening of safety measures [12,13], including among HCWs. Moreover, some HCWs seem to lack critical knowledge regarding the modes of transmission of SARS-CoV-2 [14]. In addition, the frequent and sometimes conflicting updates pertaining to COVID-19 guidelines have led many HCWs to question their applicability and protective value [15]. This can lead to a lack of commitment, one of the barriers that negatively impacts the implementation of measures necessary to prevent SARS-CoV-2 transmission [16]. Regular channels used to spread IPC messages might therefore fail in the current context.
Nevertheless, building and strengthening the intrinsic motivation of HCWs to rigorously apply IPC guidelines and to do their very best to avoid contaminating their patients, colleagues, friends, and relatives is a goal that must be energetically pursued [17]. Apart from the significant morbidity and mortality associated with COVID-19 infection [18], the economic burden is also worth considering. Indeed, the median costs incurred for a single case exceed $3000 according to a recent evaluation [19].
The high rate of nosocomial infections detected during the first COVID-19 wave and the need to train a large number of people while respecting the need for physical distance require the creation of original and inspirational material to promote IPC guidelines. Serious games possess motivational properties that can enhance learner engagement and satisfaction while still delivering important messages [20].
Objective
Our aim was to develop a serious game to promote the dissemination of COVID-19 IPC practices among HCWs and other hospital employees. By raising awareness about situations that could potentially lead to COVID-19 contamination in this key population, such a game could help decrease SARS-CoV-2 transmission between HCWs and from HCWs to patients.
Methods
General Design
The first 3 stages of the SERES framework were used to develop this serious game [21]. This framework has already been used successfully for the development of serious games [22] and gamified e-learning (electronic learning) modules [23]. Briefly, this framework was created to help developers design theory-driven, evidence-based serious games for health. The first stage, scientific foundations, is designed to ensure that the game is both evidence-based and theoretically driven. The target audience is identified at this stage. The second stage, design foundations, focuses on the translation of these foundations into design elements. Game development takes place in the third stage of this framework.
Scientific Foundations
Target Audience
The target audience was identified through a brainswarming session [24] between the lead developer (MS) and IPC specialists (GC, TRN, VS, MP, SH, and MA). The game was developed at the request of these specialists, who were therefore included in the development process from the start.
Acquisition Objectives
Field observations by specialists from the Geneva University Hospitals infection control program were used to identify the acquisition objectives. We decided to use the term “acquisition objectives” rather than “learning objectives” as the main purpose of this serious game was to promote and stimulate desirable behaviors in HCWs rather than to teach them new procedures.
Theoretical Basis
The theoretical bases relevant to the creation of gamified content in the context of the COVID-19 pandemic were already identified in the course of a previously published project [23]. Therefore, we decided to use these bases and to reassess the relevant references. Briefly, we had searched the medical literature via PubMed (using Medical Subject Headings [MeSH] and Boolean operators) and retrieved articles based on their titles and abstracts. References from the most relevant articles were also searched manually to identify sources that could have been missed. A total of 12 articles was included through this procedure. Further details are available in our previous publication [23].
We also performed a search for articles reporting information related to SARS-CoV-2 transmission. The MeSH keywords “covid-19,” “sars-cov-2,” and “transmission” were used in combination with the Boolean operators “AND” and “OR” to retrieve potentially relevant references from MEDLINE using the PubMed engine. To avoid inducing doubts or even mistrust in HCWs [25-27], the results retrieved through this search were anaylzed to determine whether they were in line with our institutional [28] and federal [29] guidelines. Whenever conflicting information was identified, a consensus was reached with the IPC specialists to determine and use the most accurate and least confusing messages.
Content Validation
The scientific grounds on which this serious game relies were decided during brainswarming sessions between the developers and IPC specialists from the Geneva University Hospitals. Each iteration of the serious game was reviewed by at least 2 such specialists to ensure that the intended message was correctly and adequately conveyed by the serious game.
Design Foundations
General Design and Meaningful Gamification
The scientific foundations reviewed or established during the previous stage were used to create the general design of the serious game. We used Nicholson’s RECIPE mnemonic (reflection, engagement, choice, information, play, and exposition) for meaningful gamification to guide the development of the game mechanics [30].
Arnab et al’s [31] model of transforming learning mechanics into game mechanics was adapted to suit the development of this serious game. The original model states that learning mechanics should be decided according to learning objectives and that these learning mechanics should then be translated into game mechanics. As we had decided to use the term “acquisition objectives” rather than “learning objectives,” we adapted Arnab et al’s [31] model to develop a very similar “acquisition mechanics – game mechanics” model.
Design Requirements
Design decisions were tailored to the target population and the COVID-19 context. Ease of access to the serious game was considered to be of paramount importance, as was the ability to rapidly capture the player’s attention and interest. True to the SERES framework, we decided to use an iterative approach to build the game. We therefore sought regular feedback from the IPC specialists as well as from potential end users and implemented the required adaptations accordingly.
Game Development
All the data gathered through the scientific foundation and design foundation stages were used to choose a development platform and to proceed with the development of the serious game. Acquisition objectives were reassessed, and theoretical bases were used to decide upon acquisition mechanics and game mechanics.
Tool Evaluation
In line with the theoretical bases, the game was tested on various platforms (smartphones, tablets, laptops, desktop computers) by different users at the end of each development loop and before its final release.
Results
Scientific Foundations
Target Audience
Early on in the development process, developers and IPC specialists agreed that the target audience should be composed of all the professionals who could be in direct contact with patients within the Geneva University Hospitals. The game was therefore designed to target many different kinds of health care professionals including physicians, nurses, physiotherapists, assistants, technicians, and therapists but also non–health care professionals. Indeed, some of these employees have close and regular contact with patients (stretcher-bearers, housekeepers, etc) and might therefore be exposed to patients or play a role in SARS-CoV-2 transmission.
Theoretical Basis
We used previously identified resources to establish the theoretical background [20,31-37]. These resources were extracted from Verschueren et al [22], which described the development of a serious game designed to reduce perioperative anxiety in children, and from our recent study describing the development of a gamified e-learning module that was used to teach the adequate use of PPE to prehospital personnel in the context of the COVID-19 pandemic [23]. Moreover, we sought to include all 6 elements of Nicholson’s meaningful gamification [30]. These elements are listed below and follow Nicholson’s RECIPE mnemonic:
The “reflection” element seeks to connect the game to events that happen or might happen to the player in real life. This element was therefore quite straightforward to embed into the game as it was linked to its core concept. We decided to make the player virtually experience scenes that could occur on a normal day to let them make choices that could influence SARS-CoV-2 transmission. We decided to split the game into 4 levels, each related to a specific part of the day (Figures 1 and 2): at home, on the way to work, in communal areas, and in the ward. Including the reflection element has been shown to enhance mental well-being [17] and could thus increase the player’s willingness to adopt desirable behaviors.
There are two components to the “engagement” element. Social engagement such as that found in multiplayer games is the component that has gained the most popularity in recent history. While such games have shown many positive features, they are also controversial and have been accused of drawing some players away from reality [38]. Given the limited time frame and the goal of our serious game, the inclusion of multiplayer capabilities was not considered relevant. We nevertheless decided to include a social engagement component in the game and to confront the player with the impact some of their choices would have on others. This component was also instrumental in strengthening the reflection element and in keeping the player connected to the real world. The second component of the engagement element is related to the creation of an engaging learning experience and to the concept of “flow” [39]. To avoid boredom and to increase engagement, the challenges should become more difficult as the game progresses. Therefore, simple questions (Figures 3-5) were first asked at the initial level (“at home”), while more complex challenges, such as rebuilding a donning sequence (Figure 6) or choosing the kind of face mask to wear (Figure 7) awaited the player in the last level (“ward”). The main drawback of creating more complex challenges is the risk of generating anxiety and frustration. To avoid these negative effects, feedback mechanisms were used extensively [32].
The “choice” element relates to the autonomy the player has within the game. Giving the player the ability to make meaningful choices reinforces the player’s autonomy and the feeling of being responsible for their actions. We therefore decided to let players make choices that IPC specialists would disapprove, and to experience (at least virtually) the consequences such potentially harmful choices might have.
“Information” means providing the player with key concepts to help them understand the reasons behind the serious game, rather than just providing them with points or rewards, which could prove ineffective or even harmful in the long run [40]. Giving players accurate and reliable information ultimately leads to the appropriation of key concepts and generates a positive mental image by generating a feeling of “mastery” regarding these concepts [17]. We therefore included the most recent and evidence-based elements regarding SARS-CoV-2 symptoms and transmission within the game [41-46].
The “play” element is perhaps the hardest to define, and there are many and sometimes conflicting definitions of this element. We have elected to use Nicholson’s approach [30] in which play is defined as “the freedom to explore and fail within boundaries.” We therefore decided to let players have a certain degree of freedom and to make choices, which may ultimately result in a “game over” situation. The player would then be given the opportunity either to restart the level or to trade tokens to resume the game.
Exposition means creating a meaningful narrative in the serious game. Engaging the player into the serious game requires capturing their interest and curiosity while still permitting them to make their own choices. To create such a narrative, we decided that the player would virtually go through the steps they usually undertake on a daily basis, and to make choices that may lead to the contamination of patients or of fellow HCWs.
Audio elements were not considered necessary as many hospital employees will play the serious game on institutional computers and will not be able to activate the sound. Attractive graphics adapted to the target population were however deemed essential to increase engagement [47,48].
Acquisition Objectives
The IPC specialists defined 10 acquisition objectives according to their field observations. Table 1 summarizes these objectives, the RECIPE element to which they are linked, and gives implementation examples.
Table 1.
Acquisition objective | RECIPE elements | Implementation |
Avoid going to work when potentially infectious | R, EN, C, P, EX | Figures 5,8, 9 |
Recognize COVID-19 symptoms | I | Figure 10 |
Recognize that HCWsa have a higher probability of being contaminated by a colleague than by a patient | R, EN, I, EX | Figure 11 |
Recognize that even asymptomatic carriers can be contagious | EN, I, EX | Figure 12 |
Recall safety measures in the working environment | R, I, EX | Figures 13 and 14 |
Recall the correct way of using a face mask | R, I, EX | Figure 15 |
Recall the correct donning sequence | R, EN, I, EX | Figure 6 |
Identify when an N95 mask should be worn | R, C, I, EX | Figure 7 |
Identify when eye protection should be worn | R, C, I, EX | Figure 16 |
Identify when gloves should be worn and changed | R, C, I, EX | Figure 17 |
aHCW: health care worker.
To keep track of the player’s choices and to strengthen IPC messages, a virus counter was created. Whenever the player selects an answer that can lead to a possible contamination, a red virus image appears, and the virus count rises incrementally. Conversely, every time the player selects an answer that matches a desirable behavior, a positive token in the form of a “thumbs-up” image is awarded. If the player reaches a total of 5 viruses, a “game over” screen (Figure 18) appears. The user can then choose to decrease the virus count by exchanging “thumbs-up” tokens against viruses or to restart the level. We decided that the players should only restart the level, and not the entire game, in order to provide a more positive feedback and to avoid generating frustration. Moreover, a positive message is displayed at the end of each of the 4 levels. These messages are designed to strengthen the player’s motivation to comply with IPC guidelines and are not influenced by the virus count.
Feedback mechanisms were used extensively and systematically in this serious game [32]. After a simple-choice interaction, the expected answer is immediately provided to the player along with an explanatory message (Figures 8 and 9). When multiple choice interactions are involved, players are allowed to adapt their answer if they were initially wrong. To help them find the correct answers, the number of wrong answers is provided along with the number of correct answers missing from their initial choice (Figure 14).
Game Development and Iterations
We first created a storyboard using PowerPoint 16 (Microsoft Corp). This storyboard, split into 4 game levels, was refined through multiple iterations until we deemed it advanced enough to begin the actual game development. A common and simple terminology was used to suit the broad target audience. We chose to develop the actual game under Articulate Storyline 3 (Articulate Global). This software is easy to use, embeds many elements that are essential for creating interactive content and serious games, and allows developers to export their creations to many different platforms using HTML5.
The first version of the game was developed using stick figures created by PresenterMedia (Eclipse Digital Imaging Inc). Figure 1 shows the welcome screen of this first version, and Figure 3 gives an example of a simple-choice interaction.
Although developers and IPC specialists found this first version to be both adequate and usable after having been refined through multiple iterations, they felt that it resembled a gamified e-learning module rather than a serious game. We therefore hired a well-known Swiss graphic designer to help us enhance the graphical aspects of the game and create a unique atmosphere. First, sketches in line with the multiple iterations concept of the SERES framework were produced by the graphic designer. These sketches were revised, adapted, and finally validated. They were then transformed into actual images that were embedded in the serious game. Figure 2 shows the updated (and final) version of the welcome screen, and Figure 4 displays the updated version a simple-choice interaction.
Game Validation
Each iteration of the game was tested by at least 3 authors whose feedback was systematically assessed and, when relevant and feasible, integrated into the next iteration of the game. The final version was validated by all the authors and by IPC specialists, some of whom act as consultants for the World Health Organization. Apart from the authors, all of whom are part of the medical or nursing staff, the game was tested by nonclinical staff from the Geneva University Hospitals training center before its release. These testing sessions showed that the game takes 15 minutes to complete on average.
The heuristic evaluation procedure described by Davids et al [49] was used to screen for usability issues. This led to the addition of blinking images in the welcome screen to facilitate identification of interactive elements.
Game Availability
This serious game can be freely accessed on the internet [50]. The corresponding author can be contacted to obtain a SCORM (shareable content object reference model) package of the game. We decided to make this package available to facilitate results and completion tracking on most current learning management system. This will allow for the tracking of completion and, on recent platforms, to gather detailed results down to the level of individual questions.
Discussion
Principal Findings
The first 3 stages of the SERES framework were successfully used to create the “Escape COVID-19” serious game. The content created meets the definition given by Gentry et al [20] in a recent systematic review (ie, a game created “for the serious purpose of providing health professions education via a digital device”). The boundaries separating serious games from other gamified educational tools are not easy to define [51]. Using the definition Payne et al [52] published in 2015, “Escape COVID-19” qualifies as a serious game as it primarily intends to educate rather than entertain, contains a specific narrative, and includes the possibility of failure. In the context of the COVID-19 pandemic, new HCWs are being quickly recruited to face increasing health care demand [53]. Providing them regular face to face training in IPC is particularly challenging in terms of resources. Distance learning through serious games and other e-learning modalities offers an innovative and cost-effective alternative that can reach a large target population while avoiding the logistical challenges associated with face to face training.
Since HCWs perceive a higher likelihood of contracting COVID-19 than the general population [54] and as fatality rates have been shown to be substantial in this population [55,56], the impact of this serious game could be significant. Distance learning mechanisms have indeed been shown to be of particular value in the context of the current pandemic [57,58]. Still, there are many different e-learning modalities [59,60], and selecting the adequate modality to achieve the intended goal can be challenging. Our gamified e-learning module, which was intended to teach the adequate use of PPE to prehospital personnel, was found to be both useful and satisfactory by paramedics. It however failed to yield significant improvements regarding knowledge acquisition in this population [61]. Conversely, this e-learning modality significantly improved knowledge acquisition in student paramedics who were actively working in an ambulance service at the time of the study [62]. In both populations, however, this gamified module failed to enhance the acquisition of complicated procedures such as PPE donning or doffing [61,62]. Nevertheless, as the goal of this serious game is to promote and strengthen safe behaviors rather than to teach new content to HCWs, it might still prove effective in improving the application of IPC guidelines.
Though we chose to use Nicholson’s RECIPE mnemonic for meaningful gamification [30], we were unable to apply it to its fullest extent. Indeed, the play element was only used in connection with one out of 10 acquisition objectives. Given the goal and design of this serious game, letting the player freely roam in a virtual environment was not an option. Moreover, we elected to force the player to follow a predetermined path, starting at home and ending in the ward. We made this choice to comply with the “flow” component of the engagement element [39]. When designing a serious game, using this component means that challenges should get harder as the player progresses. In the first level (at home), the challenges were relatively easy and the choice element was central. Conversely, in the last level, the player was asked to rebuild a complicated donning sequence and to make difficult choices regarding the kind of PPE that should be worn in specific situations. Therefore, forcing the player to follow a chronological order was relevant in this regard.
Limitations
The main limitation of this study is the current lack of evidence to support the use of this serious game. A longitudinal trial assessing the evolution of the rate of SARS-CoV-2 contamination in HCWs and in other hospital employees should be carried out to help assess the impact of this serious game. Assessing the added value of specific elements might however prove difficult, and multiple confounding factors (progressive dissemination of new guidelines, natural and unforeseeable evolution of the pandemic, etc) will make this more difficult.
Since knowledge regarding SARS-CoV-2 transmission mechanisms is evolving quickly, this serious game could be obsolete in a matter of months or less. This limitation is however relative as the platform used to develop this serious game is quite flexible and should allow us to rapidly update the game.
Finally, even though most screenshots are displayed in English, the original game was developed in French and the English translation has not been completed yet. It should however be completed by the end of 2020.
Future Work
While the creation of this serious game was considered successful, we cannot be certain of its actual impact on IPC practices and behavior. The SCORM package is available to any researcher or institution willing to deploy it on a learning management system, whether for research purposes or simply to make it available as an additional educational tool.
Following the release of version 2.08, the Geneva University Hospitals have deployed Escape COVID-19 and made it available to their 13,000 employees, including medical, nursing, and administrative and support staff. In the wake of this deployment, the Geneva Directorate of Health requested us to make this serious game available to nursing home employees. Indeed, long-term care facilities have been severely hit by the COVID-19 pandemic [46,63-65] and motivating their employees to enhance their IPC practices could be of significant benefit [66]. We naturally agreed and took this opportunity to initiate a web-based, triple-blinded randomized controlled trial [67]. The aim of this study is to determine whether Escape COVID-19 can enhance the intention to change IPC practices in nursing home employees.
Conclusion
The SERES framework was successfully used to create “Escape COVID-19,” a serious game designed to promote safe behaviors among HCWs and other hospital employees during the COVID-19 pandemic. The impact of this game should now be assessed through a longitudinal trial.
Acknowledgments
The authors would like to warmly thank Eric Buche, who designed all the magnificent graphical elements used in this serious game. We also thank Alistair Dumps for his inputs at the initial stages of the project, and Paul Tairraz and Lolita Loureiro from the Geneva University Hospitals training center for their tests and inputs.
Abbreviations
- e-learning
electronic learning
- HCW
health care worker
- IPC
infection prevention and control
- MeSH
Medical Subject Headings
- PPE
personal protective equipment
- RECIPE
reflection, engagement, choice, information, play, exposition
- SCORM
shareable content object reference model
Footnotes
Conflicts of Interest: None declared.
References
- 1.Coronavirus Resource Center. Johns Hopkins University & Medicine. 2020. [2020-10-11]. https://coronavirus.jhu.edu/
- 2.Iacobucci G. Covid-19: GPs need extra support to withstand second wave, BMA warns. BMJ. 2020 Oct 01;371:m3806. doi: 10.1136/bmj.m3806. [DOI] [PubMed] [Google Scholar]
- 3.Kaxiras E, Neofotistos G. Multiple Epidemic Wave Model of the COVID-19 Pandemic: Modeling Study. J Med Internet Res. 2020 Jul 30;22(7):e20912. doi: 10.2196/20912. https://www.jmir.org/2020/7/e20912/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Xu S, Li Y. Beware of the second wave of COVID-19. The Lancet. 2020 Apr;395(10233):1321–1322. doi: 10.1016/s0140-6736(20)30845-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Xiao J, Fang M, Chen Q, He B. SARS, MERS and COVID-19 among healthcare workers: A narrative review. J Infect Public Health. 2020 Jun;13(6):843–848. doi: 10.1016/j.jiph.2020.05.019. https://linkinghub.elsevier.com/retrieve/pii/S1876-0341(20)30485-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Zheng C, Hafezi-Bakhtiari N, Cooper V, Davidson H, Habibi M, Riley P, Breathnach A. Characteristics and transmission dynamics of COVID-19 in healthcare workers at a London teaching hospital. J Hosp Infect. 2020 Oct;106(2):325–329. doi: 10.1016/j.jhin.2020.07.025. http://europepmc.org/abstract/MED/32730771. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Chou R, Dana T, Buckley DI, Selph S, Fu R, Totten AM. Epidemiology of and Risk Factors for Coronavirus Infection in Health Care Workers. Annals of Internal Medicine. 2020 Jul 21;173(2):120–136. doi: 10.7326/m20-1632. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Stock AD, Bader ER, Cezayirli P, Inocencio J, Chalmers SA, Yassari R, Yanamadala V, Eskandar E. COVID-19 Infection Among Healthcare Workers: Serological Findings Supporting Routine Testing. Front Med (Lausanne) 2020 Aug 21;7:471. doi: 10.3389/fmed.2020.00471. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Zhang Z, Liu S, Xiang M, Li S, Zhao D, Huang C, Chen S. Protecting healthcare personnel from 2019-nCoV infection risks: lessons and suggestions. Front Med. 2020 Apr;14(2):229–231. doi: 10.1007/s11684-020-0765-x. http://europepmc.org/abstract/MED/32212058. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Casanova L, Alfano-Sobsey E, Rutala WA, Weber DJ, Sobsey M. Virus transfer from personal protective equipment to healthcare employees' skin and clothing. Emerg Infect Dis. 2008 Aug;14(8):1291–3. doi: 10.3201/eid1408.080085. doi: 10.3201/eid1408.080085. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Barycka K, Torlinski T, Filipiak KJ, Jaguszewski M, Nadolny K, Szarpak L. Risk of self-contamination among healthcare workers in the COVID-19 pandemic. Am J Emerg Med. 2020 Sep 28; doi: 10.1016/j.ajem.2020.09.055. http://europepmc.org/abstract/MED/33008700. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Freeman D, Waite F, Rosebrock L, Petit A, Causier C, East A, Jenner L, Teale A, Carr L, Mulhall S, Bold E, Lambe S. Coronavirus conspiracy beliefs, mistrust, and compliance with government guidelines in England. Psychol. Med. 2020 May 21;:1–13. doi: 10.1017/s0033291720001890. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ahmed W, López Seguí Francesc, Vidal-Alaball J, Katz MS. COVID-19 and the "Film Your Hospital" Conspiracy Theory: Social Network Analysis of Twitter Data. J Med Internet Res. 2020 Oct 05;22(10):e22374. doi: 10.2196/22374. https://www.jmir.org/2020/10/e22374/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Bhagavathula AS, Aldhaleei WA, Rahmani J, Mahabadi MA, Bandari DK. Knowledge and Perceptions of COVID-19 Among Health Care Workers: Cross-Sectional Study. JMIR Public Health Surveill. 2020 Apr 30;6(2):e19160. doi: 10.2196/19160. https://publichealth.jmir.org/2020/2/e19160/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Gesser-Edelsburg A, Cohen R, Shahbari NAE, Hijazi R. A mixed-methods sequential explanatory design comparison between COVID-19 infection control guidelines' applicability and their protective value as perceived by Israeli healthcare workers, and healthcare executives' response. Antimicrob Resist Infect Control. 2020 Sep 04;9(1):148. doi: 10.1186/s13756-020-00812-8. https://aricjournal.biomedcentral.com/articles/10.1186/s13756-020-00812-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Maqbool A, Khan NZ. Analyzing barriers for implementation of public health and social measures to prevent the transmission of COVID-19 disease using DEMATEL method. Diabetes Metab Syndr. 2020 Sep;14(5):887–892. doi: 10.1016/j.dsx.2020.06.024. http://europepmc.org/abstract/MED/32563940. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Deci E, Ryan R. Handbook of Self-Determination Research. Rochester, NY: University of Rochester Press; 2002. [Google Scholar]
- 18.Tian W, Jiang W, Yao J, Nicholson CJ, Li RH, Sigurslid HH, Wooster L, Rotter JI, Guo X, Malhotra R. Predictors of mortality in hospitalized COVID-19 patients: A systematic review and meta-analysis. J Med Virol. 2020 May 22;92(10):1875–1883. doi: 10.1002/jmv.26050. http://europepmc.org/abstract/MED/32441789. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Bartsch SM, Ferguson MC, McKinnell JA, O'Shea Kelly J, Wedlock PT, Siegmund SS, Lee BY. The Potential Health Care Costs And Resource Use Associated With COVID-19 In The United States. Health Aff (Millwood) 2020 Jun 23;39(6):927–935. doi: 10.1377/hlthaff.2020.00426. https://owa16.cuny.edu/owa/#_ftnref7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gentry SV, Gauthier A, L'Estrade Ehrstrom B, Wortley D, Lilienthal A, Tudor Car L, Dauwels-Okutsu S, Nikolaou CK, Zary N, Campbell J, Car J. Serious Gaming and Gamification Education in Health Professions: Systematic Review. J Med Internet Res. 2019 Mar 28;21(3):e12994. doi: 10.2196/12994. https://www.jmir.org/2019/3/e12994/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Verschueren S, Buffel C, Vander Stichele G. Developing Theory-Driven, Evidence-Based Serious Games for Health: Framework Based on Research Community Insights. JMIR Serious Games. 2019 May 02;7(2):e11565. doi: 10.2196/11565. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Verschueren S, van Aalst June, Bangels A, Toelen J, Allegaert K, Buffel C, Vander Stichele Geert. Development of CliniPup, a Serious Game Aimed at Reducing Perioperative Anxiety and Pain in Children: Mixed Methods Study. JMIR Serious Games. 2019 Jun 01;7(2):e12429. doi: 10.2196/12429. https://games.jmir.org/2019/2/e12429/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Suppan M, Gartner B, Golay E, Stuby L, White M, Cottet P, Abbas M, Iten A, Harbarth S, Suppan L. Teaching Adequate Prehospital Use of Personal Protective Equipment During the COVID-19 Pandemic: Development of a Gamified e-Learning Module. JMIR Serious Games. 2020 Jun 12;8(2):e20173. doi: 10.2196/20173. https://games.jmir.org/2020/2/e20173/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.McCaffrey T. BrainSwarming: Because Brainstorming Doesn’t Work. Harvard Business Review. 2014. [2020-11-30]. https://hbr.org/2014/06/brainswarming-because-brainstorming-doesnt-work.
- 25.Houghton C, Meskell P, Delaney H, Smalle M, Glenton C, Booth A, Chan XHS, Devane D, Biesty LM. Barriers and facilitators to healthcare workers' adherence with infection prevention and control (IPC) guidelines for respiratory infectious diseases: a rapid qualitative evidence synthesis. Cochrane Database Syst Rev. 2020 Apr 21;4:CD013582. doi: 10.1002/14651858.CD013582. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Godlee F. Protect our healthcare workers. BMJ. 2020 Apr 02;:m1324. doi: 10.1136/bmj.m1324. [DOI] [Google Scholar]
- 27.Rhee C, Baker MA, Klompas M. The COVID-19 infection control arms race. Infect Control Hosp Epidemiol. 2020 Nov 08;41(11):1323–1325. doi: 10.1017/ice.2020.211. http://europepmc.org/abstract/MED/32381140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Coronavirus - Recommandations pour les professionnels de la santé. Hôpitaux Universitaires de Genève. 2020. [2020-10-11]. https://www.hug.ch/coronavirus/recommandations-pour-professionnels-sante.
- 29.Nouveau Coronavirus: Informations pour les professionnels de la santé. Federal Office of Public Health. 2020. [2020-10-11]. https://www.bag.admin.ch/bag/fr/home/krankheiten/ausbrueche-epidemien-pandemien/aktuelle-ausbrueche-epidemien/novel-cov/information-fuer-die-aerzteschaft.html.
- 30.Nicholson S. A RECIPE for Meaningful Gamification. In: Reiners T, Wood L, editors. Gamification in Education and Business. Cham: Springer; 2014. pp. 1–20. [Google Scholar]
- 31.Arnab S, Lim T, Carvalho MB, Bellotti F, de Freitas S, Louchart S, Suttie N, Berta R, De Gloria A. Mapping learning and game mechanics for serious games analysis. Br J Educ Technol. 2014 Jan 05;46(2):391–411. doi: 10.1111/bjet.12113. [DOI] [Google Scholar]
- 32.Kopp V, Stark R, Fischer M. Fostering diagnostic knowledge through computer-supported, case-based worked examples: effects of erroneous examples and feedback. Med Educ. 2008 Aug;42(8):823–9. doi: 10.1111/j.1365-2923.2008.03122.x. [DOI] [PubMed] [Google Scholar]
- 33.Latimier A, Riegert A, Peyre H, Ly ST, Casati R, Ramus F. Does pre-testing promote better retention than post-testing? NPJ Sci Learn. 2019 Sep 24;4(1):15. doi: 10.1038/s41539-019-0053-1. doi: 10.1038/s41539-019-0053-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Raina S, Bernard L, Taylor B, Kaza S. Using eye-tracking to investigate content skipping: A study on learning modules in cybersecurity. 2016 IEEE Conference on Intelligence and Security Informatics (ISI); Sept 28-30, 2016; Tucson, AZ, USA. 2016. [DOI] [Google Scholar]
- 35.Fouh E, Breakiron DA, Hamouda S, Farghally MF, Shaffer CA. Exploring students learning behavior with an interactive etextbook in computer science courses. Computers in Human Behavior. 2014 Dec;41:478–485. doi: 10.1016/j.chb.2014.09.061. [DOI] [Google Scholar]
- 36.Koka A, Suppan L, Cottet P, Carrera E, Stuby L, Suppan M. Teaching the National Institutes of Health Stroke Scale to Paramedics (E-Learning vs Video): Randomized Controlled Trial. J Med Internet Res. 2020 Jun 09;22(6):e18358. doi: 10.2196/18358. https://www.jmir.org/2020/6/e18358/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Drummond D, Hadchouel A, Tesnière Antoine. Serious games for health: three steps forwards. Adv Simul (Lond) 2017 Feb 4;2(1):3. doi: 10.1186/s41077-017-0036-3. https://advancesinsimulation.biomedcentral.com/articles/10.1186/s41077-017-0036-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Snodgrass JG, Lacy MG, Francois Dengah HJ, Fagan J, Most DE. Magical flight and monstrous stress: technologies of absorption and mental wellness in Azeroth. Cult Med Psychiatry. 2011 Mar 17;35(1):26–62. doi: 10.1007/s11013-010-9197-4. [DOI] [PubMed] [Google Scholar]
- 39.Csikszentmihalyi M. Finding Flow: The Psychology of Engagement With Everyday Life. New York: Basic Books; 1997. [Google Scholar]
- 40.Kohn A. Punished by Rewards: The Trouble with Gold Stars, Incentive Plans, A's, Praise, and Other Bribes. Boston: Houghton Mifflin Harcourt; 1993. [Google Scholar]
- 41.Yin G, Jin H. Comparison of Transmissibility of Coronavirus Between Symptomatic and Asymptomatic Patients: Reanalysis of the Ningbo COVID-19 Data. JMIR Public Health Surveill. 2020 May 28;6(2):e19464. doi: 10.2196/19464. https://publichealth.jmir.org/2020/2/e19464/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Sommerstein R, Fux CA, Vuichard-Gysin D, Abbas M, Marschall J, Balmelli C, Troillet N, Harbarth S, Schlegel M, Widmer A, Swissnoso Risk of SARS-CoV-2 transmission by aerosols, the rational use of masks, and protection of healthcare workers from COVID-19. Antimicrob Resist Infect Control. 2020 Jul 06;9(1):100. doi: 10.1186/s13756-020-00763-0. https://aricjournal.biomedcentral.com/articles/10.1186/s13756-020-00763-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Sharma S, Mishra M, Mudgal S. Efficacy of cloth face mask in prevention of novel coronavirus infection transmission: A systematic review and meta-analysis. J Educ Health Promot. 2020;9(1):192. doi: 10.4103/jehp.jehp_533_20. http://europepmc.org/abstract/MED/33015206. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Noorimotlagh Z, Mirzaee SA, Jaafarzadeh N, Maleki M, Kalvandi G, Karami C. A systematic review of emerging human coronavirus (SARS-CoV-2) outbreak: focus on disinfection methods, environmental survival, and control and prevention strategies. Environ Sci Pollut Res Int. 2020 Oct 02; doi: 10.1007/s11356-020-11060-z. http://europepmc.org/abstract/MED/33009614. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Li X, Sridhar S, Chan Jasper Fuk-Woo. The Coronavirus Disease 2019 pandemic: how does it spread and how do we stop it? Curr Opin HIV AIDS. 2020 Nov;15(6):328–335. doi: 10.1097/COH.0000000000000650. [DOI] [PubMed] [Google Scholar]
- 46.Roxby AC, Greninger AL, Hatfield KM, Lynch JB, Dellit TH, James A, Taylor J, Page LC, Kimball A, Arons M, Munanga A, Stone N, Jernigan JA, Reddy SC, Lewis J, Cohen SA, Jerome KR, Duchin JS, Neme S. Outbreak Investigation of COVID-19 Among Residents and Staff of an Independent and Assisted Living Community for Older Adults in Seattle, Washington. JAMA Intern Med. 2020 Aug 01;180(8):1101–1105. doi: 10.1001/jamainternmed.2020.2233. http://europepmc.org/abstract/MED/32437547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Caserman P, Hoffmann K, Müller Philipp, Schaub M, Straßburg Katharina, Wiemeyer J, Bruder R, Göbel Stefan. Quality Criteria for Serious Games: Serious Part, Game Part, and Balance. JMIR Serious Games. 2020 Jul 24;8(3):e19037. doi: 10.2196/19037. https://games.jmir.org/2020/3/e19037/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Ravyse WS, Seugnet Blignaut A, Leendertz V, Woolner A. Success factors for serious games to enhance learning: a systematic review. Virtual Reality. 2016 Sep 20;21(1):31–58. doi: 10.1007/s10055-016-0298-4. [DOI] [Google Scholar]
- 49.Davids M, Chikte U, Halperin M. An efficient approach to improve the usability of e-learning resources: the role of heuristic evaluation. Adv Physiol Educ. 2013 Sep;37(3):242–8. doi: 10.1152/advan.00043.2013. https://journals.physiology.org/doi/10.1152/advan.00043.2013?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub%3dpubmed. [DOI] [PubMed] [Google Scholar]
- 50.Escape COVID-19 Serious Game. 2020. [2020-11-30]. https://coronavirus.anesth.ch/serious-game.
- 51.Tan JW, Zary N. Diagnostic Markers of User Experience, Play, and Learning for Digital Serious Games: A Conceptual Framework Study. JMIR Serious Games. 2019 Jul 16;7(3):e14620. doi: 10.2196/14620. https://games.jmir.org/2019/3/e14620/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Payne HE, Moxley VB, MacDonald E. Health Behavior Theory in Physical Activity Game Apps: A Content Analysis. JMIR Serious Games. 2015 Jul 13;3(2):e4. doi: 10.2196/games.4187. https://games.jmir.org/2015/2/e4/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Fagan JJ, Cairncross L, Biccard B, Fieggen G, Maswime S. COVID-19 exposes health worker shortages in the USA and UK, but nationalism and self-interest must not exploit medical workforces from low- and middle-income countries. S Afr Med J. 2020 Apr 08;110(5):335. doi: 10.7196/samj.2020.v110i5.14774. [DOI] [PubMed] [Google Scholar]
- 54.Ali K, Whitebridge S, Jamal M, Alsafy M, Atkin S. Perceptions, Knowledge, and Behaviors Related to COVID-19 Among Social Media Users: Cross-Sectional Study. J Med Internet Res. 2020 Sep 08;22(9):e19913. doi: 10.2196/19913. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Lapolla P, Mingoli A, Lee R. Deaths from COVID-19 in healthcare workers in Italy-What can we learn? Infect Control Hosp Epidemiol. 2020 May 15;:1–2. doi: 10.1017/ice.2020.241. http://europepmc.org/abstract/MED/32408922. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Hassanian-Moghaddam H, Zamani N, Kolahi A. COVID-19 pandemic, healthcare providers' contamination and death: an international view. Crit Care. 2020 May 08;24(1):208. doi: 10.1186/s13054-020-02938-y. https://ccforum.biomedcentral.com/articles/10.1186/s13054-020-02938-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Chen CH, Mullen AJ. COVID-19 Can Catalyze the Modernization of Medical Education. JMIR Med Educ. 2020 Jun 12;6(1):e19725. doi: 10.2196/19725. https://mededu.jmir.org/2020/1/e19725/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Remtulla R. The Present and Future Applications of Technology in Adapting Medical Education Amidst the COVID-19 Pandemic. JMIR Med Educ. 2020 Jul 17;6(2):e20190. doi: 10.2196/20190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Wheeler S. e-Learning and Digital Learning. In: Seel NM, editor. Encyclopedia of the Sciences of Learning. Boston, MA: Springer; 2012. [Google Scholar]
- 60.Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Instructional Design Variations in Internet-Based Learning for Health Professions Education: A Systematic Review and Meta-Analysis. Academic Medicine. 2010 May;85(5):909–922. doi: 10.1097/ACM.0b013e3181d6c319. [DOI] [PubMed] [Google Scholar]
- 61.Suppan L, Abbas M, Stuby L, Cottet P, Larribau R, Golay E, Iten A, Harbarth S, Gartner B, Suppan M. Effect of an E-Learning Module on Personal Protective Equipment Proficiency Among Prehospital Personnel: Web-Based Randomized Controlled Trial. J Med Internet Res. 2020 Aug 21;22(8):e21265. doi: 10.2196/21265. https://www.jmir.org/2020/8/e21265/ [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Suppan L, Stuby L, Gartner B, Larribau R, Iten A, Abbas M, Harbarth S, Suppan M. Impact of an e-learning module on personal protective equipment knowledge in student paramedics: a randomized controlled trial. Antimicrob Resist Infect Control. 2020 Nov 10;9(1):185. doi: 10.1186/s13756-020-00849-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Arons MM, Hatfield KM, Reddy SC, Kimball A, James A, Jacobs JR, Taylor J, Spicer K, Bardossy AC, Oakley LP, Tanwar S, Dyal JW, Harney J, Chisty Z, Bell JM, Methner M, Paul P, Carlson CM, McLaughlin HP, Thornburg N, Tong S, Tamin A, Tao Y, Uehara A, Harcourt J, Clark S, Brostrom-Smith C, Page LC, Kay M, Lewis J, Montgomery P, Stone ND, Clark TA, Honein MA, Duchin JS, Jernigan JA. Presymptomatic SARS-CoV-2 Infections and Transmission in a Skilled Nursing Facility. N Engl J Med. 2020 May 28;382(22):2081–2090. doi: 10.1056/nejmoa2008457. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.McMichael TM, Currie DW, Clark S, Pogosjans S, Kay M, Schwartz NG, Lewis J, Baer A, Kawakami V, Lukoff MD, Ferro J, Brostrom-Smith C, Rea TD, Sayre MR, Riedo FX, Russell D, Hiatt B, Montgomery P, Rao AK, Chow EJ, Tobolowsky F, Hughes MJ, Bardossy AC, Oakley LP, Jacobs JR, Stone ND, Reddy SC, Jernigan JA, Honein MA, Clark TA, Duchin JS, Public Health–SeattleKing County‚ EvergreenHealth‚CDC COVID-19 Investigation Team Epidemiology of Covid-19 in a Long-Term Care Facility in King County, Washington. N Engl J Med. 2020 May 21;382(21):2005–2011. doi: 10.1056/NEJMoa2005412. http://europepmc.org/abstract/MED/32220208. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.ECDC Public Health Emergency Team. Danis Kostas, Fonteneau Laure, Georges Scarlett, Daniau Côme, Bernard-Stoecklin Sibylle, Domegan Lisa, O'Donnell Joan, Hauge Siri Helene, Dequeker Sara, Vandael Eline, Van der Heyden Johan, Renard Françoise, Sierra Natalia Bustos, Ricchizzi Enrico, Schweickert Birgitta, Schmidt Nicole, Abu Sin Muna, Eckmanns Tim, Paiva José-Artur, Schneider Elke. High impact of COVID-19 in long-term care facilities, suggestion for monitoring in the EU/EEA, May 2020. Euro Surveill. 2020 Jun;25(22) doi: 10.2807/1560-7917.ES.2020.25.22.2000956. http://www.eurosurveillance.org/content/10.2807/1560-7917.ES.2020.25.22.2000956. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Szczerbińska K. Could we have done better with COVID-19 in nursing homes? Eur Geriatr Med. 2020 Aug 16;11(4):639–643. doi: 10.1007/s41999-020-00362-7. http://europepmc.org/abstract/MED/32676866. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Suppan L, Abbas M, Catho G, Stuby L, Regard S, Harbarth S, Achab S, Suppan M. Impact of a Serious Game on the Intention to Change Infection Prevention and Control Practices in Nursing Homes during the COVID-19 Pandemic: Protocol for a Web-Based, Randomized Controlled Trial. JMIR Preprints. Preprint posted online November 2020. 2020 doi: 10.2196/preprints.25595. https://preprints.jmir.org/preprint/25595. [DOI] [PMC free article] [PubMed] [Google Scholar]