Abstract
Background
Performing high-level surgeries with endoscopy is challenging, and hence, an efficient surgical training method or system is required. Serious game–based simulators can provide a trainee-centered educational environment unlike traditional teacher-centered education environments since serious games provide a high level of interaction (feedback that induces learning).
Objective
This study aimed to propose an epiduroscopy simulator, EpiduroSIM, based on a serious game for spatial cognitive training.
Methods
EpiduroSIM was designed based on a serious game. For spatial cognitive training, the virtual environment of EpiduroSIM was modeled based on a cognitive map.
Results
EpiduroSIM was developed considering user accessibility to provide various functions. The experiment for the validation of EpiduroSIM focused on psychological fidelity and repetitive training effects. The experiments were conducted by dividing 16 specialists into 2 groups of 8 surgeons. The group was divided into beginner and expert based on their epiduroscopy experience. The psychological fidelity of EpiduroSIM was confirmed through the training results of the expert group rather than the beginner group. In addition, the repetitive training effect of EpiduroSIM was confirmed by improving the training results in the beginner group.
Conclusions
EpiduroSIM may be useful for training beginner surgeons in epiduroscopy.
Keywords: medical education, endoscopy, surgery, catheters
Introduction
Background
An epiduroscopy is a highly effective minimally invasive surgery (MIS) used for chronic lumbago and lumbar disc herniation [1]. In an MIS, a subminiature endoscope (1-mm diameter) and a laser are inserted into a cavity; the endoscope is maneuvered by viewing a 2-dimensional (2D) computed tomography image. Performing high-level surgeries with endoscopy is challenging, and hence, an efficient surgical training method or system is required [2].
Conventional surgical training is performed using surgery observations, animals, cadavers, and plastic models. Surgery observation is achieved by assisting expert surgeons in the operation room. Such surgical training has limited training opportunities, and the interaction between surgical instruments and human organs is difficult to train [3]. Surgical training using animals and cadavers is costly [4], and surgical training using plastic models cannot provide realistic visual and tactile feedback [5].
Recently, surgical training has been performed using a simulator. The simulator provides an opportunity for the trainee to repeatedly attempt various actions, including mistakes, in a virtual environment [6]. In addition, the simulator allows the objective evaluation of the trainee’s training level and can teach rare and dangerous complications at a low cost [4]. As the popularity of video games has increased, serious game technology has been applied to surgical training using a simulator [7]. As serious game provides a high level of interaction (feedback that induces learning) [8], serious game–based simulators can provide a trainee-centered educational environment unlike the traditional teacher-centered education environments [9].
Objectives
In this study, we proposed an epiduroscopy simulator (EpiduroSIM) based on a serious game for spatial cognitive training. EpiduroSIM aims to provide a trainee-centered educational environment for teaching the insertion paths of the surgical instrument (catheter).
Methods
Study Design
In this study, we focused on EpiduroSIM based on a serious game and the cognitive map for self-directed learning of the beginner. Herein, the beginner means a surgeon who has no experience or has low understanding of epiduroscopy. Design of EpiduroSIM and modeling of the virtual environment were achieved through consultation with neurosurgeons.
Analysis and Design
EpiduroSIM was designed based on the game elements of the serious game, as shown in Figure 1. The objective of the designed EpiduroSIM was to teach the insertion paths of the surgical instrument for epiduroscopy, and the content is the insertion scenario of the surgical instrument for spatial cognition training. The feedback and interaction of the designed EpiduroSIM is an alert on the collision between the surgical instrument and the primary organs in vivo. As surgery is generally evaluated based on the operation time (completion time) and mistakes (number of collisions) in surgery [10], the designed EpiduroSIM provides the number of collisions and the completion time as the training results.
Figure 1.
The design of EpiduroSIM based on the game elements of the serious game.
Humans form a cognitive map through a series of processes that recognize the space or environment that they experience. In general, the cognitive map consists of an important point called a landmark and a surrounding area connecting these points [11]. This is because it is more effective in human information processing to hierarchically memorize the regions around the important points than to memorize the entire region [12].
The cognitive map is divided into the route map and survey map based on the form and characteristics [13]. The route map means a linear path connecting the primary landmarks between the starting point and destination. The route map is obtained through limited experience with the surrounding environment (if only 1 path is used). People with only the linear path information (route map) are more likely to get lost if they leave the proficient path [14]. The survey map means a map in which the geographical information between the starting point and the destination is configured in a network. The survey map is obtained through various experiences in the surrounding areas and data (maps and aerial photographs) that can illustrate the entire area. People with the survey map are more likely to search for an alternate path if they leave the proficient path. As the experience of the region increases, the route map generally changes to the survey map [15].
The virtual environment of EpiduroSIM is modeled based on the cognitive map as shown in Figure 2. The modeled virtual environment is divided into a 3-dimensional (3D) virtual environment for the route map and a 2D virtual environment for the survey map. The 3D virtual environment for the route map consists of bones, a dura mater, and discs that serve as landmarks. Through these objects serving as landmarks, the trainee can learn the catheter insertion paths. The 2D virtual environment for the survey map consists of a projected image (fluoroscopy). This allows the trainee to learn the perspective knowledge of all areas of the catheter insertion paths.
Figure 2.
The modeled virtual environments (2D and 3D) based on the cognitive map.
Hierarchical spatial cognition [16] does not determine a detailed path (A→S4→S3→B→S2→S1→C in scenario 1 of Figure 3) from the beginning when a person selects a path but selects a primary landmark (A→B→C in scenario 1 of Figure 3) first and subsequently selects a detailed path (A→S4→S3→B→S2→S1→C in scenario 1 of Figure 3). In this path selection process, landmarks with different levels of importance act as partial regions that constitute the whole space. Therefore, hierarchical spatial cognition can be thought as the divide-and-conquer method that resolves a significant problem.
Figure 3.
The hierarchical spatial cognitive process in the various catheter insertion scenarios.
EpiduroSIM provides various catheter insertion scenarios for spatial cognitive training. Figure 3 shows the hierarchical spatial cognitive process in various catheter insertion scenarios. In catheter insertion scenarios in Figure 3, the primary landmark is important for the catheter insertion procedures. In catheter insertion scenarios in Figure 3, the primary landmark A is the starting point where the catheter insertion paths are split into the dorsal side and ventral side in the sacral hiatus. In scenario 1 and scenario 2, the primary landmark B is the point where the catheter insertion paths detour from the dorsal side to the ventral side. In scenario 3 and scenario 4, the primary landmark B is absent because the catheter insertion paths in scenarios 3 and 4 enter the ventral side from the sacral hiatus to reach the lesion disc located on the ventral side without a detour. In catheter insertion scenarios, the primary landmark C is the destination, which is the lesion disc. In catheter insertion scenarios, the secondary landmark is the sacral nerves (S1-4), which is used as a reference point for the trainee to select the detailed paths.
Results
Development
EpiduroSIM consists of the input part, processing part, and output part, as shown in Figure 4. The input part transmits the position and rotation data received from the keyboard or mouse, gamepad [17], and master device [18] to the processing part. The processing part controls the surgical instrument in the virtual environment according to the received position and rotation data. When the surgical instrument collides, it stores the crash record and provides the trainee with visual feedback. Furthermore, the force data calculated at the time of the collision are transmitted to the master device, and the feedback is provided to the trainee. The output part provides visually the virtual environments (Figure 2) and training results in the Database.
Figure 4.
The structure of the proposed EpiduroSIM.
EpiduroSIM was developed using Unity3D (Unity technologies Corp), a commercial game engine. The developed EpiduroSIM provides an easy operation method and various functions considering user accessibility, as shown in Figure 5. The functions provided by the developed EpiduroSIM are the fluoroscopic view, the catheter insertion path, the recording, and the miscellaneous menu. The fluoroscopic view function (① in Figure 5) provides a screen similar to the C-arm view used in actual surgery, and the catheter insertion path function (② in Figure 5) provides 4 training scenarios (Figure 3). The recording function (③ in Figure 5) measures and records the training results (number of collisions and completion time) in real time, and the miscellaneous menu function (④ in Figure 5) includes virtual fixture visualization, catheter movement speed control (1x/2x), and position correction at the catheter deviation.
Figure 5.
The developed EpiduroSIM considering user accessibility.
The catheter insertion training in the developed EpiduroSIM proceeds in the following order: (1) select a training scenario, (2) begin training, (3) move the catheter tooltip to the destination (lesion), and (4) validate the training results. If the trainee selects a training scenario other than the free scenario, a virtual fixture in the form of a tube is created, as shown in Figure 6. A virtual fixture is a technique that restricts the motion of a control object to a specified path [19]. The trainee learns the catheter insertion paths along the virtual fixture to the destination. During the training, the catheter tooltip will collide with the virtual fixture if the catheter is out of the insertion path owing to the intentions or mistakes of the trainee. When the catheter tooltip collides, the developed EpiduroSIM records the number of collisions in the training results and provides visual feedback by changing the color (from white to red) of the catheter tooltip, as shown in Figure 7. The trainee can learn the catheter insertion paths in the desired field of view by selecting the external view, as shown in Figure 8, or the endoscopic view, as shown in Figure 9, while moving the catheter tooltip. At the end of the training, the developed EpiduroSIM provides the user with the cumulative number of collisions and completion time.
Figure 6.
The catheter insertion training without collision.
Figure 7.
The catheter insertion training with collision.
Figure 8.
The external view.
Figure 9.
The endoscopic view.
Evaluation
The experiments were designed to focus on the fidelity and repetitive training effects. Fidelity represents the degree to which the simulator matches the real environment and skills [20,21]. Fidelity can be divided into physical fidelity and psychological fidelity [22]. Physical fidelity refers to the degree of similarity between a real environment and virtual environment [21,22]. Psychological fidelity refers to the degree to which the skills of real tasks are reflected in the simulator [22]. EpiduroSIM is designed based on a serious game, focusing on psychological fidelity rather than physical fidelity. Therefore, we examined the psychological fidelity of EpiduroSIM in the experiments.
The training result in the simulator based on iterations generally appears as learning curves. This means that the training result is improved as the training using the simulator is repeated. This improvement in the training result does not necessarily imply that the trainee is acquiring actual skills. However, improved training results in simulators that train basic skills such as hand and tool movement can lead to the acquisition of actual skills [23]. This type of verification has been used in many studies as a simulator evaluation tool [24,25]. Therefore, we examined the repetitive training effects of EpiduroSIM in the experiments.
The experiments were conducted by dividing 16 specialists into 2 groups of 8 surgeons. The group was divided into beginner and expert based on their epiduroscopy experience. The sample size (n=16) of the subject was calculated with a .05 significance level, 0.9 power, and 0.3 effect size using G*Power 3 (Heinrich Heine University Düsseldorf) [26].
The experimental environment consists of EpiduroSIM and gamepad as shown in Figure 10. A gamepad is an input device with higher precision and user preference than a mechanical master device and joystick [27]. In addition, considering a serious game and user accessibility, the gamepad is suitable as the input device of EpiduroSIM. The experiment was conducted through repetitive training (20 times) in the free scenario (an environment without a virtual fixture) of EpiduroSIM. To ensure the reliability of the experimental results, we set the number of repetitions to be higher than the conventional studies [28,29] on the surgical training simulator. The experimental results of repetitive training were analyzed using the repeated-measures analysis of variance. These analyses were performed using SPSS 21 (IBM Corp). A 2-sided significance level of P<.05 was set.
Figure 10.
The experimental environment.
The results of comparison between the 2 groups (beginner and expert) are shown in Figure 11. The mean number of collisions for the beginner group and expert group was 4.91 and 3.56, respectively. The mean completion time of the beginner group and expert group was 84.14 seconds and 83.40 seconds, respectively. The expert group had fewer collisions than the beginner group, and the completion time was faster. This implies that the understanding of actual surgery is well reflected (high psychological fidelity) in EpiduroSIM.
Figure 11.
The comparison results (number of collisions and completion time) between the two groups (beginner and expert).
Figure 12 shows the experimental results of repetitive training. As the training was repeated, the beginner group showed a decrease in the number of collisions as a whole and the expert group did not show any significant variation. As the training was repeated, the beginner group had a shorter completion time and the expert group did not show any significant change. From the experimental results, we confirmed that the beginner group exhibited the repetitive training effects, in contrast to the expert group.
Figure 12.
The experimental results (number variation of collision and completion time variation) of repetitive training.
Discussion
Principal Findings
In this study, we proposed an epiduroscopy simulator (EpiduroSIM) based on a serious game for spatial cognitive training. EpiduroSIM was designed based on a game element of a serious game. The objective of EpiduroSIM was to help beginners learn the insertion path of the catheter inside the human body. Therefore, EpiduroSIM provides various scenarios of catheter insertion to the trainee as content in the virtual environment modeled by the cognitive map. The interaction between EpiduroSIM and the trainee was achieved through visual feedback based on the virtual fixture. Through this interaction, the trainee learns a correct insertion path. Finally, the EpiduroSIM provides the training results of the insertion completion time of the catheter and the mistakes (number of collisions) that occurred during the insertion process to improve the motivation and self-confidence of the trainee.
The experiment for the validation of EpiduroSIM focused on the psychological fidelity and repetitive training effects. On the basis of a comparative result between the expert and beginner groups, it can be concluded that the expert group completed catheter insertion faster with fewer collisions than the beginner group. The result indicates that the understanding of actual surgery is well applied (high psychological fidelity) in EpiduroSIM. From the repeated training results for each group, the beginner group showed a decrease in the number of collisions and completion time. Generally, surgery is evaluated based on the surgical time (completion time) and mistakes (number of collisions) that occur during the surgery. Therefore, the decrease in the completion time and the number of collisions in the beginner group means that the understanding of the surgery has increased. However, there was no repeated training effect in the expert group. The reason could be that experts have a higher understanding of the surgery before training by actual surgical experience compared with the beginners.
Comparison With Past Work
Cognition is a general term used to describe mental activities related to thinking, learning, and memory [30]. Cognitive training is applied in the form of mental imagery without actual physical movements [31]. Cognitive training has been used in sports and has become an important tool used by athletes at the elite level [32]. In addition, cognitive training has been applied in the form of simulators in the aeronautical field to improve flight performance through pilot training [33].
Owing to the proven efficacy in the sport and aviation sectors, studies have been conducted on using cognitive training for surgical training. In a study on the relationship between surgical proficiency and cognitive processes, surgical competence reportedly combined the intellectual movements of decision making with the ability to perform mechanical tasks [34]. In a study involving 58 expert surgeons, 70% agreed that cognitive skill was one of the best traits required by the trainee surgeons [35].
Owing to MIS, the ability to perform mechanical tasks has become important but the importance of cognitive skills has not diminished. As laparoscopic surgeries and robotic surgeries require significant levels of cognitive and decision-making abilities [24], a few simulators have been studied to provide cognitive training to surgeons [7,23,36]. In these studies, a variety of virtual reality tasks were designed to improve specific cognitive skills such as movement planning, working memory, and preparatory attention. In other studies, error recognition and the cognitive simulator feedback were evaluated [37,38]. Although these cognitive simulators have been developed focusing on surgical procedures, spatial cognitive training for learning the insertion paths of surgical instruments in the human body was not considered.
We herein proposed EpiduroSIM based on a serious game for spatial cognitive training. To learn the catheter insertion paths in the human body, EpiduroSIM was designed based on the game elements of the serious educational game. For spatial cognitive training, the virtual environment of EpiduroSIM was modeled based on a cognitive map. EpiduroSIM was developed to provide various functions considering user accessibility. The experiment for the validation of EpiduroSIM focused on the psychological fidelity and repetitive training effects. The psychological fidelity of EpiduroSIM was confirmed through the training results of the expert group rather than the beginner group. In addition, the repetitive training effect of EpiduroSIM was confirmed by improving the training results in the beginner group.
Limitations
Serious games based on the game elements for entertainment are differentiated from simulators for reflecting reality [39]. A serious game with game elements such as competition, self-confidence, environment, objectives, and rules has the advantage of improving the self-direction, personality, and persistence of learning compared with the simulator [40]. Despite the advantages of a serious game, the following 7 areas of study are required for the effective development of a serious game for medical education [41]: (1) disposition to engage in learning, (2) impact of realism and fidelity on learning, (3) threshold for learning, (4) process of cognitive development during knowledge gain, (5) stability of knowledge gain (retention), (6) capacity for knowledge transfer to related problems, and (7) disposition toward sensible action within clinical settings. Among these areas, our study focused on the process of cognitive development during knowledge gain.
Therefore, EpiduroSIM provides high-level accessibility to beginners for self-directed learning without past knowledge of the simulator, but it has a limitation that it does not provide the same experience as actual surgery such as the kinesthetic sense.
Conclusions
Serious games have begun to be applied to various applications, including medical education. However, further studies are still required to popularize serious games. We herein applied the cognitive map to the insertion paths training of a surgical instrument to study the cognitive development process during knowledge gain. In the future, we expect the importance of cognitive training in surgical education to increase, and we hope that the results of this study will be used in cognitive training studies.
Acknowledgments
This research was financially supported by the Global Collaborative R&D Program through the Ministry of Trade, Industry & Energy and Korea Institute for Advancement of Technology.
Abbreviations
- 2D
2-dimensional
- 3D
3-dimensional
- MIS
minimally invasive surgery
Footnotes
Conflicts of Interest: None declared.
References
- 1.Roberts KE, Bell RL, Duffy AJ. Evolution of surgical skills training. World J Gastroenterol. 2006 May;12(20):3219–24. doi: 10.3748/wjg.v12.i20.3219. http://www.wjgnet.com/1007-9327/full/v12/i20/3219.htm. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Pan JJ, Chang J, Yang X, Liang H, Zhang JJ, Qureshi T, Howell R, Hickish T. Virtual reality training and assessment in laparoscopic rectum surgery. Int J Med Robot. 2015 Jun;11(2):194–209. doi: 10.1002/rcs.1582. [DOI] [PubMed] [Google Scholar]
- 3.Moulton CA, Dubrowski A, Macrae H, Graham B, Grober E, Reznick R. Teaching surgical skills: what kind of practice makes perfect?: a randomized, controlled trial. Ann Surg. 2006 Jul;244(3):400–9. doi: 10.1097/01.sla.0000234808.85789.6a. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Muchinsky PM. Psychology Applied to Work. Summerfield, NC, USA: Hypergraphic Press; 2012. [Google Scholar]
- 5.Heng P, Cheng C, Wong T, Xu Y, Chui Y, Chan K, Tso S. A virtual-reality training system for knee arthroscopic surgery. IEEE Trans Inf Technol Biomed. 2004 Jun;8(2):217–27. doi: 10.1109/titb.2004.826720. [DOI] [PubMed] [Google Scholar]
- 6.Ziv A, Ben-David S, Ziv M. Simulation based medical education: an opportunity to learn from errors. Med Teach. 2005 May;27(3):193–9. doi: 10.1080/01421590500126718. https://www.tandfonline.com/doi/abs/10.1080/01421590500126718. [DOI] [PubMed] [Google Scholar]
- 7.Cowan B, Sabri H, Kapralos B, Cristancho S, Moussa F, Dubrowski A. SCETF: Serious game surgical cognitive education and training framework. 2011 IEEE International Games Innovation Conference (IGIC); November 2-3, 2011; Orange, CA, USA. IEEE; 2011. Nov, p. 5117. https://ieeexplore.ieee.org/abstract/document/6115117. [DOI] [Google Scholar]
- 8.Susi T, Johannesson M, Backlund P. DiVA. Sweden: University of Skövde School of Humanities and Informatics; 2007. Feb, [2019-08-08]. Serious games-an overview http://www.diva-portal.org/smash/record.jsf?pid=diva2%3A2416&dswid=6821. [Google Scholar]
- 9.Stapleton AJ. Serious Games: Serious Opportunities. Australian Game Developers’ Conference, Academic Summit; 2-4 December; Melbourne, Victoria, Australia. 2004. Jan, http://www.agdc.com.au/04presentations/acad_andrew_stapleton2.pdf. [Google Scholar]
- 10.Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A. An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg. 2006 Aug;244(2):310–14. doi: 10.1097/01.sla.0000218094.92650.44. https://insights.ovid.com/crossref?an=00000658-200608000-00020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Couclelis H, Golledge RG, Gale N, Tobler W. Exploring the anchor-point hypothesis of spatial cognition. J Environ Psychol. 1987 Jun;7(2):99–122. doi: 10.1016/S0272-4944(87)80020-8. https://www.sciencedirect.com/science/article/abs/pii/S0272494487800208. [DOI] [Google Scholar]
- 12.Wiener JH, Mallot HA. 'Fine-to-Coarse' route planning and navigation in regionalized environments. Spat Cogn Comput. 2003 Dec;3(4):331–358. doi: 10.1207/s15427633scc0304_5. https://www.tandfonline.com/doi/abs/10.1207/s15427633scc0304_5. [DOI] [Google Scholar]
- 13.Shemaykin F. US Office of technical Reports. Arlington, VA, USA: Psychological Science in the USSR; 1962. [2019-08-08]. General problems of orientation in space and space representations https://tinyurl.com/y4k323qv. [Google Scholar]
- 14.Prestopnik J, Roskos–Ewoldsen B. The relations among wayfinding strategy use, sense of direction, sex, familiarity, and wayfinding ability. J Environ Psychol. 2000 Jun;20(2):177–91. doi: 10.1006/jevp.1999.0160. https://www.sciencedirect.com/science/article/pii/S0272494499901603?via%3Dihub. [DOI] [Google Scholar]
- 15.Appleyard D. Styles and methods of structuring a city. Environ Behav. 2016 Jul;2(1):100–17. doi: 10.1177/001391657000200106. https://journals.sagepub.com/doi/10.1177/001391657000200106. [DOI] [Google Scholar]
- 16.Chown E, Kaplan S, Kortenkamp D. Prototypes, location, and associative networks (PLAN): towards a unified theory of cognitive mapping. Cogn Sci. 1995 Jan;19(1):1–51. doi: 10.1016/0364-0213(95)90003-9. https://www.sciencedirect.com/science/article/abs/pii/0364021395900039. [DOI] [Google Scholar]
- 17.Jang S, Ko J, Choi Y, Kim Y. A development of an epiduroscopy training simulator based on spatial cognition learning. J Vibroeng. 2017 Oct 21;14:250–5. doi: 10.21595/vp.2017.19166. https://www.jvejournals.com/article/19166. [DOI] [Google Scholar]
- 18.Ko J, Jang S, Kim Y. Development of epiduroscopy training simulator using haptic master device. International Conference on Ubiquitous Robots and Ambient Intelligence (URAI); June 28-July 1; Jeju, South Korea. 2017. Jun, pp. 542–3. https://ieeexplore.ieee.org/document/7992664. [DOI] [Google Scholar]
- 19.Kim J, Jang J, Jung G, Kim J, Jang S. Epiduroscopic laser disc and neural decompression. J Neurosurg Rev. 2011;1(S1):14–19. https://northamericanspine.com/wp-content/uploads/2017/03/epiduroscopic-laser-disc-and-neural-decompression.pdf. [Google Scholar]
- 20.Farmer E, Rooij J, Riemersma J, Moraal J, Jorna P. Handbook of Simulator-Based Training. London: Routledge; 1999. [Google Scholar]
- 21.Hays RT, Singer MJ. Simulation Fidelity In Training System Design: Bridging The Gap Between Reality And Training (recent Research In Psychology) New York, USA: Springer-Verlag; 1988. [Google Scholar]
- 22.Ker J, Bradley P. Understanding Medical Education: Evidence, Theory And Practice. London, UK: Wiley-Blackwell; 2010. Simulation in medical education; pp. 164–180. [Google Scholar]
- 23.Kahol K, Vankipuram M, Smith M. Cognitive simulators for medical education and training. J Biomed Inform. 2009 Aug;42(4):593–604. doi: 10.1016/j.jbi.2009.02.008. https://linkinghub.elsevier.com/retrieve/pii/S1532-0464(09)00028-8. [DOI] [PubMed] [Google Scholar]
- 24.Kohls-Gatzoulis J, Regehr G, Hutchison C. Teaching cognitive skills improves learning in surgical skills courses: a blinded, prospective, randomized study. Can J Surg. 2004 Aug;47(4):277–83. http://www.canjsurg.ca/vol47-issue4/47-4-277/ [PMC free article] [PubMed] [Google Scholar]
- 25.Gallagher A, Richie K, McClure N, McGuigan J. Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg. 2001 Nov;25(11):1478–83. doi: 10.1007/s00268-001-0133-1. [DOI] [PubMed] [Google Scholar]
- 26.Faul F, Erdfelder E, Lang A, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007 May;39(2):175–191. doi: 10.3758/BF03193146. https://link.springer.com/article/10.3758/BF03193146. [DOI] [PubMed] [Google Scholar]
- 27.Marcia K, Gupta A. Passive and active assistance for human performance of a simulated underactuated dynamic task. Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems; March 22-23; Los Angeles, CA, USA. IEEE; 2003. Apr, p. 348. https://ieeexplore.ieee.org/abstract/document/1191308. [DOI] [Google Scholar]
- 28.Andersen SA, Konge L, Cayé-Thomasen P, Sørensen MS. Learning curves of virtual mastoidectomy in distributed and massed practice. JAMA Otolaryngol Head Neck Surg. 2015 Oct;141(10):913–8. doi: 10.1001/jamaoto.2015.1563. [DOI] [PubMed] [Google Scholar]
- 29.Connor E, Raker C, Wohlrab K. Effects of repetition and inactivity on laparoscopic skills training. J Minim Invasive Gynecol. 2016 Feb;23(2):194–7. doi: 10.1016/j.jmig.2015.09.008. https://www.jmig.org/article/S1553-4650(15)01549-6/fulltext. [DOI] [PubMed] [Google Scholar]
- 30.Coren S, Ward L, Enns J. Handbook of psychology. New York, USA: John Wiley & Sons; 2003. Apr, Sensation and perception. [Google Scholar]
- 31.Munzert J, Lorey B, Zentgraf K. Cognitive motor processes: the role of motor imagery in the study of motor representations. Brain Res Rev. 2009 May;60(2):306–26. doi: 10.1016/j.brainresrev.2008.12.024. https://www.sciencedirect.com/science/article/pii/S0165017309000022?via%3Dihub. [DOI] [PubMed] [Google Scholar]
- 32.Sevdalis N, Moran A, Arora S. Multisensory Imagery. New York, USA: Springer; 2014. May, Mental imagery and mental practice applications in surgery: state of the art and future directions; pp. 343–63. [Google Scholar]
- 33.Gopher D, Weil M, Siegel D. Practice under changing priorities: an approach to the training of complex skills. Acta Psychologica. 1989 Aug;71(1-3):147–77. doi: 10.1016/0001-6918(89)90007-3. https://www.sciencedirect.com/science/article/pii/0001691889900073?via%3Dihub. [DOI] [Google Scholar]
- 34.Hall J, Ellis C, Hamdorf J. Surgeons and cognitive processes. Br J Surg. 2003 Jan;90(1):10–6. doi: 10.1002/bjs.4020. [DOI] [PubMed] [Google Scholar]
- 35.Cuschieri A, Francis N, Crosby J, Hanna G. What do master surgeons think of surgical competence and revalidation? Am J Surg. 2001 Aug;182(2):110–6. doi: 10.1016/s0002-9610(01)00667-5. [DOI] [PubMed] [Google Scholar]
- 36.Kahol K, Deka M, Mayes S, Smith M, Ferrara JJ, Panchanathan S. The effect of fatigue on cognitive and psychomotor skills of surgical residents. 3rd International Conference on Foundations of Augmented Cognition; Jul 22-27; Beijing, China. 2007. p. 304. [DOI] [Google Scholar]
- 37.Loveday B, Oosthuizen G, Diener B, Windsor J. A randomized trial evaluating a cognitive simulator for laparoscopic appendectomy. ANZ J Surg. 2010 Sep;80(9):588–94. doi: 10.1111/j.1445-2197.2010.05349.x. https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1445-2197.2010.05349.x. [DOI] [PubMed] [Google Scholar]
- 38.Palter V, Grantcharov TP. Development and validation of a comprehensive curriculum to teach an advanced minimally invasive procedure: a randomized controlled trial. Ann Surg. 2012 Jul;256(1):25–32. doi: 10.1097/SLA.0b013e318258f5aa. https://insights.ovid.com/pubmed?pmid=22664557. [DOI] [PubMed] [Google Scholar]
- 39.Greitzer F, Kuchar O, Huston K. Cognitive science implications for enhancing training effectiveness in a serious gaming context. J Educ Resour Comput. 2007 Nov;7(3):-. doi: 10.1145/1281320.1281322. https://dl.acm.org/citation.cfm?doid=1281320.1281322. [DOI] [Google Scholar]
- 40.Chan W, Qin J, Chui Y, Heng P. A serious game for learning ultrasound-guided needle placement skills. IEEE Trans Inf Technol Biomed. 2012 Nov;16(6):1032–42. doi: 10.1109/TITB.2012.2204406. https://ieeexplore.ieee.org/document/6216416. [DOI] [PubMed] [Google Scholar]
- 41.Tashiro J, Dunlap D. The impact of realism on learning engagement in educational games. Proceedings of the 2007 conference on Future Play; Future Play '07; November 14-17; Toronto, Canada. 2007. Nov, pp. 113–20. https://dl.acm.org/citation.cfm?doid=1328202.1328223. [DOI] [Google Scholar]
