Abstract
Purpose of review:
This review outlines recent innovations in simulation technology as it applies to urology. It is essential for the next generation of urologists to attain a solid foundation of technical and non-technical skills, and simulation technology provides a variety of safe, controlled environments to acquire this baseline knowledge.
Recent findings:
With a focus on urology, this review first outlines the evidence to support surgical simulation, then discusses the strides being made in the development of 3D-printed models for surgical skill training and pre-operative planning, virtual reality models for different urologic procedures, surgical skill assessment for simulation, and integration of simulation into urology residency curricula.
Summary:
Simulation continues to be an integral part of the journey towards the mastery of skills necessary for becoming an expert urologist. Clinicians and researchers should consider how to further incorporate simulation technology into residency training and help future generations of urologists throughout their career.
Keywords: surgical simulation, surgical training, assessment, curriculum, urology, 3D-printing, augmented reality, virtual reality
Introduction
Simulation can be defined as “the technique of imitating behavior of some situation or process by means of a suitably analogous situation or apparatus.”1 In other words, simulation can be thought of as a close representation of a system capable of serving as a tool on which to practice a task before performing the real thing. The medical field is at the absolute forefront of the development of simulations of all kinds: emergency preparedness drills, surgical training simulators, medical imaging phantoms, and technology-equipped mannequins are just a few examples. Simulation training is an integral part of modern surgical training as residents work to build a foundation of technical and non-technical skills before they perform procedures in the clinic or in the operating room.2 Furthermore, acquisition of a high degree of surgical expertise is directly correlated with better patient outcomes which reinforces the need for high fidelity practice in safe, controlled settings.3 In this review, we evaluate the recent advancements in simulation technology as it applies to the field of urology. We explore new evidence to support simulation training, new technology such as 3D printing and telestration, innovation in urologic procedural simulation, surgical skill assessment, integration of simulation into urology residency curricula, and the future of simulation in urology. We included publications from July, 2022 to July, 2023 to outline the true cutting edge of simulation technology. Literature was accumulated via a PubMed search using terms “training,” “simulation,” “curriculum,” and “urology,” and screened by two authors.
New Evidence for Surgical Simulation
Transitioning from Halstead’s traditional apprenticeship model to a contemporary, more standardized surgical training approach, it’s logical to believe that simulations would enhance the training of surgical residents, akin to their role in pilot training.4 Yet, it is only recently that robust evidence has emerged to validate the efficacy of simulations in surgical training. Key concerns have centered on the realism of simulations, the transfer of skills to live surgery, and the adaptability of simulation to individual patient variation. Several recent, comprehensive studies have now addressed these questions.
In endourology, Aydin et al. conducted an international, multi-center, randomized-controlled trial, SIMULATE (Simulation in Urological Training and Education), using ureteroscopy as a benchmark to assess whether standardized simulation training enables residents to attain proficiency sooner with better patient outcomes.5 The simulation curriculum consists of didactic lectures andpractices on the URO-Mentor virtual reality (VR) simulator, dry-laboratory models, and fresh frozen cadavers.5 The study found that while the number of procedures required to reach proficiency was similar for simulation and control groups, the simulation group achieved higher proficiency scores overall and had fewer total complications (15 vs 37; p = 0.003) and ureteric injuries (3 vs 9; p < 0.001).5
In the realm of robotic surgery, Chu et al. conducted a multicenter study involving 46 surgeons performing VR suturing exercises.6 They found that VR suturing skills differed between novices, intermediate, and advanced-level experts, and the VR performance correlated with live robotic surgical performance. Most importantly, there was a correlation between VR performance and live surgical outcomes (i.e., 3-month continence recovery after robotic radical prostatectomy).
Ghazi et al. took consideration of patient-specific variations in simulation.7 They found significant improvements in surgical and patient outcomes when preoperative high-fidelity patient-specific percutaneous nephrolithotomy (PCNL) hydrogel simulations were used. The rehearsal group had significantly reduced fluoroscopy time, percutaneous needle access attempts, complications, and additional procedures. The stone-free rate was higher in the rehearsal group, and a significant remaining stone burden requiring additional procedures was recorded less frequently in the rehearsal group.
These above studies indicate that the role of simulation in urology training is important - it can assess surgical skills, accelerate technique acquisition, be tailored by patient-specific features, and predict post-operative outcomes. Yet the incorporation of simulation in urology training is still in its infancy. Getting high-quality evidence to support the role of simulation is only the start; the subsequent focus should be on refining the design of simulation curricula and seamlessly embedding them into resident training.
New Technology - 3D Printing
3D-printing is one of the most active and innovative areas of urologic simulation with researchers producing both surgical and procedural training models as well as patient-specific models for surgical preparation. Within the last year, physical 3D-printed models have been developed for urologic procedures including cystoscopy/ureteroscopy with kidney stone removal, trans-anal prostate biopsy, anatomical endoscopic enucleation of the prostate, and percutaneous kidney puncture.8–15 In addition, 3D-printed models have also been produced for more invasive procedures such as robot-assisted kidney transplant and renal cell carcinoma resection.16 In particular, Ghazi et al. and Kho et al. utilized printing materials which closely mimic mechanical properties of urogenital tissues, to approximate the experience of operating on a live person.10,11 On the pre-operative planning front, Melnyk et al. have rendered and 3D-printed patient-specific models from CT scans for robot-assisted partial nephrectomy (RAPN) and percutaneous nephrolithotomy (PCNL). RAPN models were within 2.5 mm of original patient anatomical geometry and within 5 mm of original patient anatomical alignment; PCNL models were within 2.5 mm of the anatomical pelvicalyceal system and original stone placement and within 15 mm of original alignment.17 McCabe et al. also developed perfusable 3D-printed models for rehearsal operations of robot-assisted transplant nephrectomy.18 Additionally, assessment tools for pre-surgical planning have been developed to evaluate the utility and applicability of 3D-printed models.19 Innovations in 3D-printing continue to be crucial to developing the next generation of urologists and improving patient outcomes.
New Technology – Telestration
Telestration in surgery is the real-time delivery of verbal and visual feedback overlaid on a training surgeon’s field of view by a simulated visual mechanism.20 This has brought an exciting application in the field of urologic surgery, particularly in minimally-invasive training environments. Felinska et al. explores the impact of a telestration system with augmented reality on surgical performance and gaze behavior during minimally invasive surgery (MIS) training.21 The system displayed hand gestures in real-time on the laparoscopic screen to provide visual expert guidance. The study found that telestration significantly improved gaze latency, gaze convergence, and collaborative gaze convergence, resulting in fewer errors in tasks and higher performance scores for laparoscopic cholecystectomy. Similarly, Müller et al. developed a neural network capable of segmenting the training surgeon’s hand gestures and displaying them on the trainee’s console screen with the hope of providing real-time visual feedback via augmented reality while in the operating room.22 Piana et al. have expanded the idea of telestration to be any form of computer assisted surgery. They have developed an augmented reality model capable of identifying atherosclerotic plaques in the iliac vessels and proposing a vessel clamping strategy for robot-assisted kidney transplant which was successfully used for intraoperative planning in the OR.23
Innovation in Simulation for Urologic Procedures
The broadest arm of simulation application in urology is the teaching of procedures and surgical techniques to training urologists with the ultimate goal of building a robust set of baseline skills before performing complex tasks on live patients. Modern surgical training necessitates the use of simulation tasks for both technical and non-technical skills acquisition, particularly in the age of robotic surgery where a whole new teaching style and skill set need to be learned.2,24 Previously, we discussed innovations in 3D-printed models for procedural training, but these models are often costly and are not reusable long-term. We will now focus on innovations across other simulation platforms such as virtual reality, serious gaming, and animal models for surgical tasks.
Virtual reality (VR) is the use of computers and video screens to simulate specific situations, and there are a wide variety of innovations in VR simulation in the field of urology.25 Recent innovations have specifically integrated urologic instruments with a virtual reality interface. For instance, Cepek et al developed a VR-based endoscopic simulator for urogenital tract procedure training such as bladder scans, bladder tumor ablation, kidney stone ablation, and kidney stone capture and removal.26 Moore et al produced a similar VR simulator for trans-urethral resection of bladder tumor.27 Lampotang et al. introduced a VR simulator for trans-anal prostate biopsy which simulates ultrasound-guided needle placement as well as providing 3D rendering of needle placements. Novice trainees decreased needle deviations from 13.4 ± 8.9 mm to 8.7 ± 6.6 mm (P<0.001).28 As an extension of VR, van der Leun et al. demonstrated that video review of trainee and expert VR simulation in the middle of a VR training exercise significantly reduced tissue injury in the simulation.29 Finally, Covicau et al. presented a VR simulator for training of docking and undocking of the surgical robot, skills necessary for correct position before surgery or undocking during an intraoperative emergency.30
Other studies have explored the application of serious games–or games that are specifically targeted to increase skill acquisition–to performance of VR surgical simulators. Multiple groups have shown that playing serious games and spending time in surgical simulation labs, both under the supervision of expert surgeons or using portable training devices, ultimately improves performance on surgical VR simulation tasks.31–34 However, even with demonstrated high performance on VR simulation tasks, trainees report that the bar to entry in the operating room remains the lack of opportunities to apply their skills in vivo and their relationships with training physicians.35
There have also been recent innovations in animal models in urology. While not as technologically involved as 3D-printing, animal tissues are still the most readily available surrogate for real tissue simulation. Liakos et al. recently developed an animal model using the esophagus-crop junction of a chicken to simulate a stenotic left ureteropelvic junction with novice surgeons reporting high similarity to in vivo pyeloplasty.36 Focusing on non-technical skills, Lusty et al. presented a porcine model for simulating a progressive hemorrhage during laparoscopic partial nephrectomy. Trainees could practice rapid correction of hemorrhage as well as understand the decision making process for opening the abdomen for rapid bleeding control.37
Trends in Assessment for Simulation
One crucial component of high-quality simulation is objective assessment and structured feedback. Numerous assessment tools, both general and procedure-specific, have been crafted.38–40 Traditionally, the use of these tools necessitates the examination of surgical videos by experts, a process that is labor-intensive and restricts their widespread application in training programs. Research has been conducted outlining more scalable alternative methods for surgical assessment. Through surgical videos, several studies have leveraged machine learning models to accurately assess technical skills..41,42 Kinematic data has also been used to assess surgical performance, majorly to represent efficiency.43,44 Besides directly recording kinematics from surgical instruments, kinematics can also be extracted from surgical videos.45 However, there is doubt that kinematics alone is enough to appreciate fine skills required for surgery. Verhoeven et al. found that the kinematics of the instruments appear to overlook crucial elements that experts deem valuable in their evaluations, which underscores the significance of surgical video data and the associated understanding of surgical knowledge in conducting comprehensive surgical assessments.46 A study by Trinh et al. used both technical skill assessment and instrument kinematics to predict continence recovery after robotic-assisted radical prostatectomy (RARP), and found that technical skills produced better accuracy than the kinematic data when predicting the outcome.47 Combining both together, the model achieved the optimal performance, which indicates each dataset contains unique information.
Another emerging method for surgical assessment is by decoding a surgeon’s movement to its most basic units - surgical gestures. Ma et al. discovered that by analyzing the surgical gesture sequence during the nerve-sparing phase of RARP and inputting this sequence into an AI model, patients’ one-year erectile function recovery could be predicted with approximately 75% accuracy.48 Another study found that the proportion of gesture usage was correlated with technical skill scores assessed by expert surgeons, which laid the foundation for establishing a bridge to automated objective surgical skill evaluation.49
Finally, several papers explored how to best provide feedback based on assessment methods in a simulated environment. Ma et al. conducted a study to provide tailored feedback based on both the most important technical skill domains and kinematic metrics of participants, to accelerate their learning of robotic suturing skills.50 The tailored feedback group showed faster improvement in most performance metrics compared to the control group. One limitation of the study is that the feedback was provided one week after the exercise due to logistic reasons. Laca et al. explored the effect of real-time feedback in simulated dissection tasks.51 Triggers to provide feedback included risky behaviors and actually surgical errors. Feedback was provided through a standardized audio. Eventually, the feedback group had significantly lower error rates and higher technical skill scores in their test round.51 Future direction includes to automate the trigger to feedback system and provide stratified and more comprehensive feedback to participants.
Simulation in Bootcamps and Urology Curricula
Increasingly, programs are integrating simulation into their bootcamp or regular curriculum, encompassing technical skills, non-technical abilities, and emergency handling.52–57 Young et al. did a systematic review of surgical simulation bootcamp and identified five pillar principles, include: 1) delivery at the time of transition (eg, 1st to 2nd year urology resident); 2) covering the accepted syllabus; 3) simulation-based modality of delivery; 4) deliberate practice with formative feedback; and 5) 1:1:1 training (1 model: 1 trainee: 1 trainer).58 Another emerging way is gamification of simulation curriculum. Moran et al. gamified robotic surgical simulation by dividing volunteer residents into 4 groups and doing head-to-head simulation contest for a total of six rounds.59 The team with the best win-loss record was crowned champion. By the end of the league, residents improved their surgical skills significantly. Gamification makes the simulation training less burdensome when surgical residents have overwhelming clinical and extra-clinical responsibilities to balance.59
On an association level, the European Association of Urology (EAU) Robotic Urology Section (ERUS) proposed the ‘Robotic Curriculum’ as a comprehensive training framework that addresses all aspects of a robust training program, based on the concept of proficiency-based progression.60 ERUS has developed and validated various curriculum for various procedures, with their most recent being the Robot-assisted Radical Cystectomy with Intracorporeal Ileal Conduit.61
Future Directions and Conclusion
Simulation in urology training and practice is a rapidly-expanding field with the goal of improving the technical and non-technical skills of urology trainees as well as improving patient outcomes. Recent advances in 3D-printing technology and virtual reality have provided high quality, safe, and effective methods to establish a solid foundation of skills to prepare for practice with patients in the clinic. There has also been innovation in the development of assessment tools in simulated environments that can help trainees understand what they are doing wrong and provide them with feedback outlining how to best correct their mistakes. All combined, advances in simulation and assessment are being actively integrated into urology training curricula with the goal of producing highly skilled urologists in the future. We hope to see further advancement of simulation in urology training and the continued adoption of simulation into medical school and residency training programs moving forward.
Key points:
Simulation technology for urologic surgical training is advancing rapidly with recent innovations in 3D-printed physical models, virtual reality procedural models, augmented reality for surgical feedback, and non-technical skills assessment through situational simulation.
New assessment tools integrated into simulation environments provide paths for self assessment of skills acquisition as well as opportunities for tailored feedback to be delivered to trainees in real time.
Urology residency programs and medical schools across the globe continue to see the value in training simulation with a push to further integrate simulation into training curricula.
Funding Source:
This publication was supported by the National Cancer Institute of the National Institutes of Health under Award Number R01CA251579 and R01CA273031. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Footnotes
Disclosures: Andrew J. Hung has financial disclosures with Intuitive Surgical, Inc.
References
- 1.simulation, n. meanings, etymology and more | Oxford English Dictionary. Accessed August 9, 2023. https://www.oed.com/dictionary/simulation_n?tab=meaning_and_use
- 2.Aggarwal R, Darzi A. Technical-Skills Training in the 21st Century. N Engl J Med. 2006;355(25):2695–2696. doi: 10.1056/NEJMe068179 [DOI] [PubMed] [Google Scholar]
- 3.Birkmeyer JD, Finks JF, O’Reilly A, et al. Surgical Skill and Complication Rates after Bariatric Surgery. N Engl J Med. 2013;369(15):1434–1442. doi: 10.1056/NEJMsa1300625 [DOI] [PubMed] [Google Scholar]
- 4.Ma R, Reddy S, Vanstrum EB, Hung AJ. Innovations in Urologic Surgical Training. Curr Urol Rep. 2021;22(4):26. doi: 10.1007/s11934-021-01043-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. **. Aydın A, Ahmed K, Abe T, et al. Effect of Simulation-based Training on Surgical Proficiency and Patient Outcomes: A Randomised Controlled Clinical and Educational Trial. Eur Urol. 2022;81(4):385–393. doi: 10.1016/j.eururo.2021.10.030 Prospective, randomized-controlled trial to support the role of simulation training in the skill acquisition in endourology. Though results may not be as ideal as hypothesized, the reduction of complication rates in live surgery shows benifits of simulation training.
- 6. *. Chu TN, Wong EY, Ma R, et al. A Multi-institution Study on the Association of Virtual Reality Skills with Continence Recovery after Robot-assisted Radical Prostatectomy. Eur Urol Focus. Published online June 3, 2023:S2405–4569(23)00122–0. doi: 10.1016/j.euf.2023.05.011 Multicenter study to support the role of simulation in robotic suturing skill assessment and skill transferability to live surgery. It harbors the potential to refine simulation assessment by live surgery data as well.
- 7. **. Ghazi A, Melnyk R, Farooq S, et al. Validity of a patient-specific percutaneous nephrolithotomy (PCNL) simulated surgical rehearsal platform: impact on patient and surgical outcomes. World J Urol. 2022;40(3):627–637. doi: 10.1007/s00345-021-03766-7 This paper presents strong evidence for the creation of patient-specific kidney models for planning percutaneous nephrolithotomy. Not only does it demonstrate a robust method for 3D rendering and manufacturing of an abdominopelvic model which includes multiple vessels and tissue densities, it also validates planning processes by pairing the percutaneous model with a surgical case series.
- 8.Boulenger de Hauteclocque A, Michiels C, Sarrazin J, et al. Three Dimensional Printing Technology Used to Create a High-Fidelity Ureteroscopy Simulator: Development and Validity Assessment (Rein-3D-Print-UroCCR-39). Urology. 2023;176:36–41. doi: 10.1016/j.urology.2023.02.039 [DOI] [PubMed] [Google Scholar]
- 9.Llorente-Ortega M, Polo R, Chiva S, et al. The development and validation of a new simulator for endourology. Actas Urol Esp. 2023;47(4):236–243. doi: 10.1016/j.acuroe.2023.01.004 [DOI] [PubMed] [Google Scholar]
- 10.Ghazi A A Call for Change. Can 3D Printing Replace Cadavers for Surgical Training? Urol Clin North Am. 2022;49(1):39–56. doi: 10.1016/j.ucl.2021.08.001 [DOI] [PubMed] [Google Scholar]
- 11. *. Kho Y, Yoon HS, Park DH, et al. Effectiveness of a newly-developed training module using 3D printing for the navigation during retrograde intrarenal surgery. Investig Clin Urol. 2022;63(5):554–562. doi: 10.4111/icu.20220205 This paper presents a portable and anatomically accurate kidney phantom for urogenital tract endoscopy training. It can be adapted to improve ureteroscopy skills as well as kidney stone removal and is printed using materials which closely mimic mechanical properties of human urogenital tract tissues.
- 12.Deyirmendjian C, Nguyen DD, Andonian S, et al. Simulation-based prostate enucleation training: Initial experience using 3D-printed organ phantoms. Can Urol Assoc J J Assoc Urol Can. 2022;16(12):409–416. doi: 10.5489/cuaj.7838 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Trelles Guzmán CR, Mainez Rodríguez JA, Aguado-Maestro I, et al. 3D printed model for flexible ureteroscopy training, a low-cost option for surgical training. Actas Urol Esp. 2022;46(1):16–21. doi: 10.1016/j.acuroe.2021.07.009 [DOI] [PubMed] [Google Scholar]
- 14.Guliev B, Talyshinskii A. Impact of High-fidelity Nonbiological Kidney Puncture Trainer on Residents’ Skills During 30-Day Practical Course. Urology. 2022;168:59–63. doi: 10.1016/j.urology.2022.05.010 [DOI] [PubMed] [Google Scholar]
- 15.Randhawa H, Wang Y, Hoogenes J, et al. Development and initial validation of a cost-effective, re-usable, ultrasound-compatible suprapubic catheter insertion training simulator. Can Urol Assoc J J Assoc Urol Can. 2022;16(2):63–69. doi: 10.5489/cuaj.7373 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Campi R, Pecoraro A, Vignolini G, et al. The First Entirely 3D-Printed Training Model for Robot-assisted Kidney Transplantation: The RAKT Box. Eur Urol Open Sci. 2023;53:98–105. doi: 10.1016/j.euros.2023.05.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Melnyk R, Oppenheimer D, Ghazi AE. How specific are patient-specific simulations? Analyzing the accuracy of 3D-printing and modeling to create patient-specific rehearsals for complex urological procedures. World J Urol. 2022;40(3):621–626. doi: 10.1007/s00345-021-03797-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.McCabe M, Osinski T, Kashyap R, et al. Robotic Assisted Transplant Nephrectomy: Case Series and Training Model for Improving Adoption. JSLS. 2023;27(1). doi: 10.4293/JSLS.2022.00079 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Schlegel L, Ho M, Fields JM, et al. Standardizing evaluation of patient-specific 3D printed models in surgical planning: development of a cross-disciplinary survey tool for physician and trainee feedback. BMC Med Educ. 2022;22(1):614. doi: 10.1186/s12909-022-03581-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Nickel F, Cizmic A, Chand M. Telestration and Augmented Reality in Minimally Invasive Surgery: An Invaluable Tool in the Age of COVID-19 for Remote Proctoring and Telementoring. JAMA Surg. 2022;157(2):169–170. doi: 10.1001/jamasurg.2021.3604 [DOI] [PubMed] [Google Scholar]
- 21.Felinska EA, Fuchs TE, Kogkas A, et al. Telestration with augmented reality improves surgical performance through gaze guidance. Surg Endosc. 2023;37(5):3557–3566. doi: 10.1007/s00464-022-09859-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Müller LR, Petersen J, Yamlahi A, et al. Robust hand tracking for surgical telestration. Int J Comput Assist Radiol Surg. 2022;17(8):1477–1486. doi: 10.1007/s11548-022-02637-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. *. Piana A, Gallioli A, Amparore D, et al. Three-dimensional Augmented Reality-guided Robotic-assisted Kidney Transplantation: Breaking the Limit of Atheromatic Plaques. Eur Urol. 2022;82(4):419–426. doi: 10.1016/j.eururo.2022.07.003 This is the first paper to expand telestration to include surgical augmentation for real-time surgical planning and decision-making using 3D modeling to understand anatomical variability. This can be considered one of the first instances of real-time intraoperative planning using computer-aided visualization.
- 24.Green CA, Chu SN, Huang E, et al. Teaching in the robotic environment: Use of alternative approaches to guide operative instruction. Am J Surg. 2020;219(1):191–196. doi: 10.1016/j.amjsurg.2019.06.003 [DOI] [PubMed] [Google Scholar]
- 25.Raison N, Harrison P, Abe T, et al. Procedural virtual reality simulation training for robotic surgery: a randomised controlled trial. Surg Endosc. 2021;35(12):6897–6902. doi: 10.1007/s00464-020-08197-w [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Cepek J, Wilson C, Denstedt J, et al. Portable Endoscopic Simulator for Urologic Training: A Face/Content and Construct Validity Study. J Endourol. 2022;36(11):1495–1501. doi: 10.1089/end.2022.0180 [DOI] [PubMed] [Google Scholar]
- 27.Moore J, Whalen S, Rowe N, et al. A high-fidelity, virtual-reality, transurethral resection of bladder tumor simulator: Validation as a tool for training. Can Urol Assoc J J Assoc Urol Can. 2022;16(4):E205–E211. doi: 10.5489/cuaj.7285 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. **. Lampotang S, Lizdas DE, Johnson WT, et al. Development and Validation of a Mixed-Reality Simulator for Reducing Biopsy Core Deviation During Simulated Freehand Systematic Prostate Biopsy. Simul Healthc J Soc Simul Healthc. Published online March 16, 2023. doi: 10.1097/SIH.0000000000000723 The mixed-reality nature of this model is very innovative, especially with the data outputs given to trainees. 3D renderings of the biopsied cores can help trainees understand how to navigate in 3-space and translate between 2D ultrasound images to the 3D architecture of the rectum/prostate.
- 29. *. van der Leun JA, Siem G, Meijer RP, Brinkman WM. Improving Robotic Skills by Video Review. J Endourol. 2022;36(8):1126–1135. doi: 10.1089/end.2021.0740 This is a strong example of the connection between VR simulation and surgical feedback. This paper proves that feedback delivered in a simulated environment can improve outcomes during assessment, meaning that it is important to give trainees feedback even in simulated environments.
- 30.Covaciu F, Crisan N, Vaida C, et al. Integration of Virtual Reality in the Control System of an Innovative Medical Robot for Single-Incision Laparoscopic Surgery. Sensors. 2023;23(12). doi: 10.3390/s23125400 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Kılınçarslan Ö, Türk Y, Vargör A, et al. Video gaming improves robotic surgery simulator success: a multi-clinic study on robotic skills. J Robot Surg. Published online February 8, 2023. doi: 10.1007/s11701-023-01540-y [DOI] [PubMed] [Google Scholar]
- 32.Lang F, Willuth E, Haney CM, et al. Serious gaming and virtual reality in the multimodal training of laparoscopic inguinal hernia repair: a randomized crossover study. Surg Endosc. 2023;37(3):2050–2061. doi: 10.1007/s00464-022-09733-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Pedersen H, Ståhl D, Ekelund M, et al. Visuospatial ability is associated to 2D laparoscopic simulator performance amongst surgical residents. Surg Open Sci. 2023;11:56–61. doi: 10.1016/j.sopen.2022.11.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Sloth SB, Jensen RD, Seyer-Hansen M, et al. Remote training in laparoscopy: a randomized trial comparing home-based self-regulated training to centralized instructor-regulated training. Surg Endosc. 2022;36(2):1444–1455. doi: 10.1007/s00464-021-08429-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Sloth SB, Jensen RD, Seyer-Hansen M, et al. Ticket to perform: an explorative study of trainees’ engagement in and transfer of surgical training. BMC Med Educ. 2023;23(1):64. doi: 10.1186/s12909-023-04048-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Liakos N, Moritz R, Leyh-Bannurah SR, et al. Chicken RAPS: Chicken Robot-assisted Pyeloplasty Simulation. Validation Study of a Novel Chicken Model for Wet Laboratory Training in Robot-assisted Pyeloplasty. Eur Urol Open Sci. 2022;46:82–87. doi: 10.1016/j.euros.2022.10.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. *. Lusty AJ, Bleackley J, Roberts M, et al. Hemorrhaging laparoscopic partial nephrectomy - feasibility of a novel simulation model. Can Urol Assoc J J Assoc Urol Can. 2022;16(4):119–124. doi: 10.5489/cuaj.7324 This is a great example of thinking about simulation beyond technical skills. It demonstrates the value in preparing for disaster scenarios in a safe and controlled environment to be ready should something similar happen in real life.
- 38. *. Conroy LM, Slovacek H, Blum KA, et al. Current Landscape of Surgical Assessment Models in Urology Residency Training. J Urol. 2023;209(3):474–484. doi: 10.1097/JU.0000000000003079 A comprehensive review of established assessment tool in surgical assessment.
- 39.Haque TF, Hui A, You J, et al. An Assessment Tool to Provide Targeted Feedback to Robotic Surgical Trainees: Development and Validation of the End-To-End Assessment of Suturing Expertise (EASE). Urol Pract. 2022;9(6):532–539. doi: 10.1097/upj.0000000000000344 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Vanstrum EB, Ma R, Maya -Silva Jacqueline, et al. Development and Validation of an Objective Scoring Tool to Evaluate Surgical Dissection: Dissection Assessment for Robotic Technique (DART). Urol Pract 2021;8(5):596–604. doi: 10.1097/UPJ.0000000000000246 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. **. Kiyasseh D, Ma R, Haque TF, et al. A vision transformer for decoding surgeon activity from surgical videos. Nat Biomed Eng. 2023;7(6):780–796. doi: 10.1038/s41551-023-01010-8 A unified AI system to achieve surgical video segmentation and assessment, which exemplifies what AI can do in the future.
- 42.Hung AJ, Bao R, Sunmola IO, et al. Capturing fine-grained details for video-based automation of suturing skills assessment. Int J Comput Assist Radiol Surg. 2023;18(3):545–552. doi: 10.1007/s11548-022-02778-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Valovska MT, Gomez G, Fineman R, et al. Analysis of Flexible Ureteroscopic Motion and Kinematic Efficiency: A Simulation-Based Pilot Study. J Endourol. 2022;36(6):855–861. doi: 10.1089/end.2021.0726 [DOI] [PubMed] [Google Scholar]
- 44.Kim DY, Tan X, Jeong M, et al. A High-Fidelity Artificial Urological System for the Quantitative Assessment of Endoscopic Skills. J Funct Biomater. 2022;13(4). doi: 10.3390/jfb13040301 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Valovska MT, Yang J, Chen N, et al. Development of an Automated Composite Ureteroscopic Efficiency Score Through Simulated Ureteroscopic Skills Assessment. J Endourol. Published online June 29, 2023. doi: 10.1089/end.2022.0820 [DOI] [PubMed] [Google Scholar]
- 46.Verhoeven DJ, Hillemans V, Leijte E, et al. Assessment of Minimally Invasive Suturing Skills: Is Instrument Tracking an Accurate Prediction? J Laparoendosc Adv Surg Tech A. 2023;33(2):137–145. doi: 10.1089/lap.2022.0313 [DOI] [PubMed] [Google Scholar]
- 47.Trinh L, Mingo S, Vanstrum EB, et al. Survival Analysis Using Surgeon Skill Metrics and Patient Factors to Predict Urinary Continence Recovery After Robot-assisted Radical Prostatectomy. Eur Urol Focus. 2022;8(2):623–630. doi: 10.1016/j.euf.2021.04.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. *. Ma R, Ramaswamy A, Xu J, et al. Surgical gestures as a method to quantify surgical performance and predict patient outcomes. NPJ Digit Med. 2022;5(1):187. doi: 10.1038/s41746-022-00738-y The study shows surgical gestures as a novel method of understanding and assessing surgery, with potential to be used in surgical education, outcome prediction, and (semi)-autonomous surgery.
- 49.Chen Z, An J, Wu S, et al. Surgesture: a novel instrument based on surgical actions for objective skill assessment. Surg Endosc. 2022;36(8):6113–6121. doi: 10.1007/s00464-022-09108-x [DOI] [PubMed] [Google Scholar]
- 50.Ma R, Lee RS, Nguyen JH, et al. Tailored Feedback Based on Clinically Relevant Performance Metrics Expedites the Acquisition of Robotic Suturing Skills-An Unblinded Pilot Randomized Controlled Trial. J Urol. 2022;208(2):414–424. doi: 10.1097/JU.0000000000002691 [DOI] [PubMed] [Google Scholar]
- 51.Laca JA, Kocielnik R, Nguyen JH, et al. Using Real-time Feedback To Improve Surgical Performance on a Robotic Tissue Dissection Task. Eur Urol Open Sci. 2022;46:15–21. doi: 10.1016/j.euros.2022.09.015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. *. Rahimi AO, Ho K, Chang M, et al. A systematic review of robotic surgery curricula using a contemporary educational framework. Surg Endosc. 2023;37(4):2833–2841. doi: 10.1007/s00464-022-09788-5 Comprehensively reviewed current published surgery curricula in urology programs, and examined the quality of every one by a contemporary framework.
- 53.Please H, Biyani CS. How to Implement a Simulation-Based Education Programme: Lessons from the UK Urology Simulation Boot Camp. Indian J Surg. 2022;84(Suppl 1):18–26. doi: 10.1007/s12262-021-03016-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Stout M, Ballinger J, Posid T, et al. Advanced Urology Boot Camp: A Simulation-based Curriculum to Enhance Fourth-year Medical Student Procedural Competency. Urol Pract. 2023;10(2):196–200. doi: 10.1097/UPJ.0000000000000379 [DOI] [PubMed] [Google Scholar]
- 55.Stout M, Posid T, Ballinger J, et al. Urology Boot Camp: A Pilot Medical Student Curriculum for Common Bedside Urologic Procedures. Urology. 2022;169:35–40. doi: 10.1016/j.urology.2022.06.050 [DOI] [PubMed] [Google Scholar]
- 56.Waldbillig F, von Rohr L, Nientiedt M, et al. Prospective, Randomized Comparative Evaluation of a Novel Hands-On Endourology Training Curriculum. Urol Int. 2023;107(2):179–185. doi: 10.1159/000527746 [DOI] [PubMed] [Google Scholar]
- 57.Melnyk R, Saba P, Holler T, et al. Design and Implementation of an Emergency Undocking Curriculum for Robotic Surgery. Simul Healthc J Soc Simul Healthc. 2022;17(2):78–87. doi: 10.1097/SIH.0000000000000596 [DOI] [PubMed] [Google Scholar]
- 58. **. Young M, Lewis C, Kailavasan M, et al. A systematic review of methodological principles and delivery of surgical simulation bootcamps. Am J Surg. 2022;223(6):1079–1087. doi: 10.1016/j.amjsurg.2021.10.044 Painting a vivid portrait of contemporary simulation bootcamps, this review is the essential guide for anyone looking to establish a simulation bootcamp from the ground up.
- 59.Moran GW, Margolin EJ, Wang CN, DeCastro GJ. Using gamification to increase resident engagement in surgical training: Our experience with a robotic surgery simulation league. Am J Surg. 2022;224(1 Pt B):321–322. doi: 10.1016/j.amjsurg.2022.01.020 [DOI] [PubMed] [Google Scholar]
- 60.Sinha A, West A, Vasdev N, et al. Current practises and the future of robotic surgical training. Surg J R Coll Surg Edinb Irel. Published online March 15, 2023:S1479–666X(23)00034–3. doi: 10.1016/j.surge.2023.02.006 [DOI] [PubMed] [Google Scholar]
- 61. *. Dell’Oglio P, Turri F, Larcher A, et al. Definition of a Structured Training Curriculum for Robot-assisted Radical Cystectomy with Intracorporeal Ileal Conduit in Male Patients: A Delphi Consensus Study Led by the ERUS Educational Board. Eur Urol Focus. 2022;8(1):160–164. doi: 10.1016/j.euf.2020.12.015 The most recent example of how ERUS develops robotic training curriculum rigorously.