Virtual reality simulation of neuroendovascular intervention improves procedure speed in a cohort of trainees

Abstract

Background:

Realistic virtual reality (VR) simulators have greatly expanded the tools available for training surgeons and interventionalists. While this technology is effective in improving performance in many fields, it has never been evaluated for neuroendovascular procedures. This study aims to determine whether VR is an effective tool for improving neuroendovascular skill among trainees.

Methods:

Trainees performed two VR revascularizations of a right-sided middle cerebral artery (MCA) thrombosis and their times to procedural benchmarks (time to enter internal carotid artery [ICA], traverse clot, and complete procedure) were compared. To determine whether the improvement was case specific, trainees with less procedural exposure were timed during VR left-sided ICA (LICA) aneurysm coiling before or after performing MCA thrombectomy simulations. To determine the value of observing simulations, medical students were timed during the right MCA revascularization simulations after watching other VR procedures.

Results:

Trainees significantly improved their time to every procedural benchmark during their second MCA revascularization (mean decrease = 1.08, 1.57, and 2.24 min; P = 0.0072, 0.0466, and 0.0230). In addition, time required to access the LICA during aneurysm coiling was shortened by 0.77 min for each previous VR right MCA revascularization performed (P = 0.0176; r² = 0.71). Finally, medical students’ MCA revascularization simulation times improved by 0.87 min for each prior simulation viewed (P < 0.0221; r² = 0.96).

Conclusion:

Both performance and viewing of simulated procedures produced significant decreases in time to reach neuroendovascular procedural benchmarks. These data show that VR simulation is a valuable tool for improving trainee skill in neuroendovascular procedures.

INTRODUCTION

The development of numerous practice models and virtual reality (VR) technologies has provided surgeons and interventionalists with unique opportunities to improve technical skill outside of real-life procedures. In particular, VR modalities that recreate real-world scenarios have proven efficacious for endovascular training in other procedural settings,[8-10] improving both confidence and performance in the real world. The addition of haptics, or physical connections between real-life tools and a simulated environment, makes this training, especially lifelike.[1,11] These technologies are effective because they put participants in the central procedural role. They also allow trainees to view multiple scenarios in condensed periods of time. Despite these benefits, there are still no studies looking at the direct effects of VR endovascular simulation on neuroendovascular procedural skills.

This study aims to quantify that affects by exposing trainees with different levels of experience to a VR system that uses haptics and hands-on equipment. Their performance over multiple simulated thrombectomy was measured for improvement. In addition, trainees coiled a VR aneurysm either with or without performing VR thrombectomies beforehand. The effects of the previous thrombectomy on different procedural milestones were calculated. Finally, medical students with no procedural experience attempted VR thrombectomies after watching previous cases and the effect of exposure alone on procedural milestones was determined.

METHODS

VR system

The VR system used was a Simbionix ANGIO Mentor Flex [Figure 1a].

Figure 1:

Simbionix ANGIO Mentor Suite from 3D systems (a) featuring left internal carotid artery aneurysm coiling from the cerebral intervention module (b).

VR scenarios and benchmarks

Two virtual scenarios were used in this study. The first was a thrombotic occlusion of the right middle cerebral artery (MCA). For this scenario, times were recorded for when trainees accessed the right internal carotid artery (ICA), traversed the clot, and finished the procedure. The second scenario was an aneurysm coiling of the left- sided ICA (LICA) bifurcation [Figure 1b]. Times were recorded for when trainees accessed the LICA, entered the aneurysm, coiled the aneurysm, and completed the procedure.

Trainee selection

Medical students and neurosurgery and neuroradiology residents at a large academic medical center were informed that there would be two neuroendovascular training seminars over the course of 1 week. During those seminars, trainees were educated on different endovascular devices and invited to participate in simulated cases. Trainees were not told that their times were being recorded to look at improvement for different procedural benchmarks. Participation was voluntary. To be included in the analysis for improvement in revascularization, participants had to perform more than one thrombectomy simulation. Eighteen trainees performed simulated procedures in total. Of those, 7 performed multiple right ICA thrombectomies and 11 performed LICA coiling procedures.

Statistical analysis

All statistical analyses were performed using GraphPad Prism v7. Statistics on procedural benchmarks in thrombectomies was calculated using paired t-tests, but confidence intervals were conservatively calculated using unpaired statistics. Statistics comparing LICA treatment times between groups with less than or greater than 25 previous procedural exposures was done using a Student’s t-test. The relationship between previous thrombectomy simulations and LICA access was calculated using linear regression analysis. The relationship between observed virtual thrombectomies and time to complete the procedure was also calculated using linear regression analysis.

RESULTS

Speed of the right MCA revascularization improves in the second attempt

Seven trainees performed two separate thrombectomies over the course of the week. During each procedure, an expert sat next to the trainee and helped guide them. Regardless of the number of previous neuroendovascular procedures that trainees had participated in 0, 1–25, or >25, the time to each procedural landmark decreased during the second simulation [Table 1]. On average, the time to enter the right ICA, traverse the clot, and complete the procedure decreased by 1.08, 1.57, and 2.24 min, respectively (P = 0.0072, 0.0466, and 0.0230).

Table 1:

Change in time to each procedural benchmark across two virtual reality thrombectomy procedures.

Performance of the right MCA revascularization improves procedural time point in the left-sided aneurysm coiling

Trainees were invited to perform a LICA coiling regardless of whether they had participated in previous simulation procedures during the seminars. For trainees who had not performed a previous simulated thrombectomy, there was a significant difference (mean_<25 = 3.64 min; mean_>25 = 1.88 min; P = 0.007; data not shown) between times of trainees who had participated in <25 and those that had participated in >25 procedures. Of trainees who had participated in <25 procedures, three had had not performed a previous VR simulation, one had performed a prior VR MCA revascularization, and three had performed two previous VR MCA revascularizations. In this group, prior VR thrombectomies during the seminars correlated strongly with improved time to accessing the LICA, a technique which required the formation of a Simmons-2 catheter [mean decrease = 0.77 min/prior simulation; P = 0.0176; r2 = 0.71; Figure 2a]. The times to access the aneurysm, coil, and complete the procedure did not correlate with previous MCA revascularizations.

Figure 2:

Previous simulated thrombectomy experiences correlate with decreased time to procedural benchmarks in virtual reality (VR) cases. (a) Seven trainees who had participated in fewer than 25 previous neurovascular procedures performed simulated left internal carotid artery (LICA) coiling. For each prior VR thrombectomies done during the seminars, there was a significant decrease in the time required to access the LICA (P = 0.0176, r² = 0.71). (b) Four medical students with no prior neurovascular training viewed other trainees perform VR thrombectomies. For each prior VR thrombectomy viewed, there was a significant decrease in the time it took students to complete their own VR thrombectomy (P = 0.0221; r² = 0.96). Statistics was done using linear regression analysis.

Number of observed virtual thrombectomies improves time to complete procedure

Medical students who had never actively participated in previous endovascular procedures were invited to observe other trainees as they performed simulated MCA thrombectomies. When these medical students performed their own MCA thrombectomy simulations, the number of simulations previously viewed correlated significantly with decreased time to treat the clot [mean decrease = 0.87 min/view; P < 0.0221; r² = 0.96; Figure 2b].

DISCUSSION

Stroke is the fifth leading cause of death in the United States and costs over 30 billion dollars annually in health-care expenses and lost productivity.[4] Despite this, interventional procedures to treat and prevent thrombotic events have only recently been developed and proven efficacious. The previous standard of care was to administer tissue plasminogen activators (TPAs) within 4.5 h of the ischemic incident. In 2015, a large randomized controlled trial compared TPA to endovascular thrombectomy and showed that the latter led to improved clinical outcomes (decreased disability and mortality) at 90 days posttreatment.[2] Since this trial, demand for endovascular thrombectomies has expanded while the pool of qualified providers has struggled to catch up. Training physicians to perform endovascular neurological interventions have become a top priority in stroke care and education.

One barrier to training that this field shares with other procedural specialties is to provide sufficient procedural experience to practice technical skills. To address this problem, numerous practice models and VR technologies have been developed and used to train physicians.[6,8-10] These technologies range from immersive team-based exercises to individual VR experiences.[3,8] The efficacy of VR training in improving technical benchmarks in a number of nonneuroendovascular procedures has been demonstrated.[8-10] However, while the use of VR training for endovascular stroke treatment has been proposed, its efficacy in improving technical skills has not been quantitatively validated.[5,7]

CONCLUSION

This study validates that VR neuroendovascular procedures are effective learning tools for trainees at all levels and provides the first quantitative evidence that they improve technical skills. Performing VR thrombectomies with realistic haptics improved trainee speed in homologous procedures and, for trainees with less interventional experience, these effects carried over to the performance of a heterologous procedure – the coiling of a left-sided interior carotid artery aneurysm. In addition, viewing other trainees perform that simulations had a separate positive effect on performance. Together, our results show that VR simulation of endovascular stroke cases is a highly beneficial educational modality that other groups can use to help train incoming professionals. Further studies are needed to see if these results correlate with increased quality of procedure and translate to improvements in real- life procedural outcomes.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.