Abstract
Background
Lumbar puncture (LP) is a commonly performed medical procedure in a wide range of indications. Virtual reality (VR) provides a stimulating, safe and efficient learning environment. We report the design and the evaluation of a three dimensions (3D) video for LP training.
Methods
We recorded a stereoscopic 180-degrees 3D video from two LPs performed in clinical settings in Fernand Widal Lariboisière University Hospital, Paris, France. The video was administered to third-year medical students as well as to a residents and attendings group during LP simulation-based training sessions.
Results
On 168 participants (108 novice third-year medical students, and 60 residents and attendings with prior LP experience), satisfaction after video exposure was high (rated 4.7 ± 0.6 on a 5-point scale). No significant discomfort was reported (comfort score graded 4.5 ± 0.8 on 5). LP-naive students displayed higher satisfaction and perceived benefit than users with prior LP experience (overall, P < 0.05). Trainees evaluated favorably the 3D feature and supported the development of similar tutorials for other medical procedures (respectively, 3.9 ± 1.1 and 4.4 ± 0.9 on 5).
Conclusion
We report our experience with a 3D video for LP training. VR support could increase knowledge retention and skill acquisition in association to LP simulation training.
Supplementary Information
The online version contains supplementary material available at 10.1186/s12909-022-03317-7.
Keywords: Medical education, Education technology, Virtual reality, 3D video, Lumbar puncture, Clinical skills
Background
Lumbar puncture (LP) is an important diagnostic and therapeutic procedure performed in various clinical settings [1–3]. LP is classically performed with the palpation method, where the operator palpates the anatomic landmarks around lumbar spines to identify the needle insertion site (usually L3/L4 or L4/L5 intervertebral disc spaces). This can be challenging in certain patients (e.g. overweight, pregnant patients, back deformation, prior spine surgery) and can potentially cause side effects fostered by suboptimal practice [4–6]. Until recently, training usually involved the learning model of ‘see one, do one, teach one’ where a trainee’s first LP attempt occurs in real life in a high-stakes environment. Novice operators stress levels were found to be high before and during the performance of LP compared to subjects with prior LP experience [7]. The stress of the operator was significantly related to patient confidence in the care provider and risk of postdural puncture headache.
Simulation technology using LP simulators has shown efficiency in improving teaching and operator experience in technical gestures and has been developed in LP [8–11]. It was reported to improve students theoretical knowledge and confidence levels in performing LP, and improved the success rate and the autonomy of the students [8]. However, while simulation is becoming central to healthcare education, it requires significantly more resources than traditional education.
Virtual reality (VR) is emerging as a new method of delivering simulation [12–15]. VR requires the use of hardware (virtual reality headset) to create an immersive simulated environment where the participant is provided with first-person learning experience [16, 17]. Among VR technology, 180- or 360-degree videos allow the exploration of a real or artificial three dimensions (3D) environment [18–20]. They were shown to promote increased engagement over standard two dimensions (2D) videos among medical students [20]. 3D videos can provide learners with a close-to-reality experience that promotes learning. In surgery, it could be used to recreate the environment of an operating room and recording procedures through the eyes of the surgeon could provide students with an optimal learning view [18, 21]. 180- or 360-degree videos constitute an accessible form of VR as they require little material to produce and to deliver to the user. Consequently, they are becoming a more common mode of communicating knowledge and information. Nevertheless, there is a limited evidence on the objective educational benefits of the technology, compared to other teaching techniques [22, 23].
We report the design and development of a prototype stereoscopic 180-degree video of LP in clinical settings and its evaluation in a pilot cohort.
Methods
Participants
The study was conducted in Université de Paris, Paris, France, from October 2020 to June 2021. We included participants during LP simulation-based training sessions. The first cohort included residents and attendings, who had already performed LP at the time of training. The second cohort included third-year medical students undergoing LP training session in their regular curriculum, with no prior LP experience. Each participant was provided a detailed overview of the study and informed consent was obtained.
Development of the video
Two LPs performed in clinical settings in the Cognitive Neurology Centre, Lariboisière Fernand Widal Hospital, using atraumatic needle (pencil-point needle) were recorded (Fig. 1). Patients filmed for the video purpose underwent LP in the context of diagnosis work up for neurological symptoms. Procedures recorded included all the steps of the LP procedure: installation of the patients, disinfection steps and sterile conditions setting, placement of the needle, collection of the liquid and end of the procedure. The camera angle gurney attempted to capture the operator view. The video was first recorded in 360 degrees, but the backward view was evaluated as of moderate interest. The video was secondarily recorded in 180 degrees allowing for a stereoscopic video (with distinct right and left eye view): two objectives facing in the same direction each recorded a 180-degree half-sphere image, one for each eye. The camera model used was Insta360 EVO (Arashi Vision Inc., China). The camera was disposed on a swivel arm for optimal filming (Manfrotto, Italy).
Fig. 1.
Acquisition of the Video. A Lateral view of video acquisition. B Operator view of video acquisition
Software used for video treatment was: Insta 360 Studio 2019, Insta360 PR plug-in for Première Pro, Adobe Première Pro 2019 and 2020 for editing and Adobe Medias Encoder 2019 and 2020 for encoding and export. No stitching of the images was needed. Captions with explanation on each step of the procedure were added with the text placed in the operator view at zero degree (appendices, Video Script).
The final video lasted 5 min after editing and was administered through Gizmo VR Video Player, Gizmolite®, Cyprus (Fig. 2). The VR headset used was Oculus Go (Oculus, Microsoft, USA). The video is available on the YouTube platform at the following URL: https://youtu.be/EqtrQUfKO9U.
Fig. 2.
Administration to students of the VR Video. A Sample of the stereotaxic view of the video. B Two students watching the video with Oculus Go VR headsets
Administration of the video
The video was administered once to included subjects during a live 2-h simulation-based training session. Simulation training protocol was previously published [8]. In brief, the course consisted of a rapid evidence-based presentation, reviewing anatomy, indications, complications, and techniques for performing LPs in a regular video format. It was followed by the procedure demonstration and hands-on practice of LPs on simulators (patients lower torso mannequin) with direct feedback by instructors. The video was uploaded on YouTube to allow for repeated viewing, with the option of watching it as a standard video or a 180-degree VR video.
Evaluation methods
We performed a survey to evaluate comfort during viewing and satisfaction after the administration of the video (Appendices, Survey). Participants were given a questionnaire directly after the LP training session, to assess comfort during viewing, occurrence of any adverse symptoms and perceived benefit and interest of the video. Participants were finally asked to grade their overall satisfaction. Users were also encouraged to provide verbal constructive feedback.
Statistical analysis
Analysis was performed using GraphPad Prism version 9.00 (GraphPad Software, California USA). Continuous variables were described as mean and standard deviation, median and interquartile range, with indication of data distribution using mode and kurtosis. Categorical variables were described as number of subjects and percentage. Differences between the first cohort (medical student group) and the second cohort (attendings & residents group) were studied using Mann-Whiney test for continuous variables with Z test and Chi-squared test for categorical variables. A p-value < 0.05 was considered significant with a confidence interval of 95% (CI = 95%).
Data availability
The datasets analyzed during the current study are available from the corresponding author on a reasonable request.
Results
One hundred sixty-eight subjects were administered the video and completed the survey during simulation training sessions carried out at Université de Paris, on October 26 and 27, 2020 and June the 8, 9 and 11, 2021 (Table 1). The first cohort consisted of 108 third-year medical students. Forty-four percent of participants had already experienced a 360-degree video in VR. Thirteen percent possessed a personal VR headset. The second cohort included sixty subjects, including residents and attendings with prior LP experience. Video could be administered to 20 subjects by training session of 2 h, using two VR headsets and one dedicated technical engineer. Sanitization of the device and of the administration area was performed between each and every participant.
Table 1.
Trainees characteristics
| n = 168 | COHORT 1 Medical students (n = 108) |
COHORT 2 Attendings and residents (n = 60) |
|---|---|---|
| Age, years, mean (SD) | 21.5 (1.7) | 27.8 (4.0) |
| Age, years, median (IQR) | 21 (20–22) | 26 (25–29) |
| Men, n (%) | 30 (28%) | 24 (40%) |
| Prior exposure to VR, n (%) | 48 (44%) | 24 (40%) |
| Possession of VR headset, n (%) | 14 (13%) | 4 (7%) |
Data is presented as mean (SD), median (IQR) or number of subjects (%)
Abbreviations: IQR Interquartile range, n Number of subjects, LP Lumbar puncture, SD Standard deviation, VR Virtual reality
Comfort of viewing and cybersickness
Comfort score during video exposure was overall high, rated M = 4.5 ± 0.8 on 5 (Table 2). Scores of dizziness, headache and eye discomfort remained low (respectively: M = 0.5 ± 0.9, 0.3 ± 0.8 and 0.3 ± 0.7). Cybersickness was experienced by 5% of subjects. No user had to interrupt the viewing due to adverse symptoms.
Table 2.
Tolerance of the video
| Comfort scale | All subjects (n = 168) |
|---|---|
| Global comfort score (rated 0 to 5) |
M = 4.5 (SD = 0.8) Med = 5 (IQR = 4–5) |
| Dizziness (rated 0 to 5) |
M = 0.5 (SD = 0.9) Med = 0 (IQR = 0–0) |
| Nausea, n (%) | 9 (5%) |
| Headaches (rated 0 to 5) |
M = 0.3 (SD = 0.8) Med = 0 (IQR = 0–0) |
| Eye pain (rated 0 to 5) |
M = 0.3 (SD = 0.7) Med = 0 (IQR = 0–0) |
Data is presented as mean M (SD), median Med (IQR) or or number of subjects (%). Parameters were assessed on a 5-point scale (0, no interest, utility or satisfaction to 5, high interest, utility or satisfaction)
Abbreviations: IQR Interquartile range, LP Lumbar puncture, M Mean, Med Median, n Number of subjects, SD Standard deviation, VR Virtual reality
Evaluation and interest of the training
The overall level of satisfaction of the included subjects was high: M = 4.7 ± 0.6 rated on a 5-point scale (Table 2). Satisfaction was higher in the medical student group than in the second cohort of subjects with prior LP experience (U [Nmedical students group = 108, NAttendings and residents = 60] =2598, z = − 2.336, p = 0.0037). Analysis of the data showed that the distribution did not differ between groups (medical student group: skewness − 2.94, kurtosis 10.1; attendings and residents group: skewness, − 2.4, kurtosis 10.4).
The interest of the video in addition of simulation training was perceived positively in the overall cohort (M = 4.1 ± 1.0 on a 5-point scale, Table 3). This perceived interest was higher in the first cohort (M = 4.2 ± 0.9) compared to the attendings and residents cohort (3.9 ± 0.9, U [Nmedical students group = 108, NAttendings and residents = 60] =2641, z = − 1.971, p = 0.0338). Analysis of the data revealed that the distribution was negatively skewed and with excessive kurtosis in the medical student group (skewness − 1.16, kurtosis 0;77) whereas the attendings and residents group sample was negatively skewed with negative curtosis (skewness − 0.64; kurtosis − 0.40).
Table 3.
Evaluation of the video
| All subjects (n = 168) | COHORT 1 Medical students (n = 108) |
COHORT 2 Residents and attendings (n = 60) |
Mann Withney U |
Two samples Z-test |
P-value* | |
|---|---|---|---|---|---|---|
| Satisfaction level (rated 0 to 5) |
M = 4.7 (SD ± 0.6) Med = 5.0 (IQR = 5–5) Mode = 5 |
M = 4.8 (SD ± 0.5) Med = 5.0 (IQR = 5–5) Mode = 5 |
M = 4.5 (SD ± 0.7) Med = 5.0 (IQR = 4–5) Mode = 5 |
2598 | −2.336 | 0.0037 |
| Rated interest of VR in addition to simulation (rated 0 to 5) |
M = 4.1 (SD ± 1.0) Med = 4.0 (IQR = 4–5) Mode = 5 |
M = 4.2 (SD ± 0.9) Med = 4.5 (IQR = 4–5) Mode = 4 |
M = 3.9 (SD = 0.9) Med = 4.0 (IQR = 3–5) Mode = 5 |
2641 | −1.971 | 0.0338 |
| Rated interest of VR to 2D video (rated 0 to 5) |
M = 3.9 (SD ± 1.1) Med = 4.0 (IQR = 3–4) Mode = 4 |
M = 4.0 (SD ± 1.0) Med = 4.0 (IQR = 4–5) Mode = 4 |
M = 3.7 (SD ± 1.2) Med = 4.0 (IQR = 3–5) Mode = 4 |
2727 | −1.952 | 0.0733 |
| Rated interest of extension of VR for other procedures (rated 0 to 5) |
M = 4.4 (SD = 0.9) Med = 5.0 (IQR = 4–5) Mode = 5 |
M = 4.5 (SD ± 0.9) Med = 5.0 (IQR = 4–5) Mode = 5 |
M = 4.4 (SD ± 0.9) Med = 5.0 (IQR = 4–5) Mode = 5 |
3066 | −0.437 | 0.4956 |
| Interested in having the video in open-access, n (%) | 122 (73%) | 91 (84%) | 33 (55%) | ─ | ─ | < 0.0001# |
Data is presented as mean M (±SD), median Med (IQR) and mode, or n, number of subjects (%). All parameters were assessed on a 5-point scale (0, no interest, utility or satisfaction to 5, high interest, utility or satisfaction)
* LP-naïve medical students versus attending and residents group with prior LP experience, using Mann-Whitney test and Z-test
#Proportions of participants interested in having the video in open-access were compared using chi-squared
Abbreviations: IQR Interquartile range, LP Lumbar puncture, M Mean, Med Median, n Number of subjects, SD Standard deviation, VR Virtual reality
The added value of the 3D 180-degree characteristic of video compared to a 2D video was quoted to M = 3.9 ± 1.1 on a 5-point scale and did not differ between groups (U [N medical students group = 108, N attendings and residents = 60] =2727, z = − 1.952, p = 0.0733). In both groups, the distribution was negatively skewed and with excessive kurtosis (medical student group: skewness − 1.17, kurtosis 1.29; attendings and residents group: skewness - 1.23, kurtosis 1.50).
Participants believed that the extension of VR to other medical procedures would be of high interest with a mean score of 4.4 ± 0.9, with no difference between groups (U [N medical students group = 108, N attendings and residents = 60] =3066, z = − 0.437, p = 0.4956). Distribution was negatively skewed and with excessive kurtosis in both sample (medical student group: skewness − 2.29, kurtosis 6.00; attendings and residents group: skewness − 1.21, kurtosis 0.35).
In addition, 73% of total participants were interested in being able to have the video in open access for repeated viewing. This interest was higher in the medical students cohort (84% versus 55%, chi-squared test, P < 0.0001).
Discussion
In this study, we report the development of a 180-degree stereoscopic LP video in clinical settings. The evaluation of this video in a pilot study on 168 subjects, including 108 LP naive – trainees, showed a good tolerance and feasibility and high satisfaction among the students. Third-year medical students rated higher the perceived benefits and interests of the experience than subjects with prior LP experience, suggesting a real added value of the video. Overall, it was found that implementing 180-degree VR video into LP training could provide a beneficial learning experience.
Previous studies have highlighted the promise of VR video in medical education [14, 17, 24, 25]. Interactive media and online materials provide engaging experience and can help in conceptualizing intricate 3D data (in surgery or anatomy) or integrating the sequences of technical medical procedures [12, 13, 20]. In a survey by Sultan et al., 93% of 169 undergraduate medical students were willing to engage in VR support for medical education [26]. Moreover, knowledge retention and skill acquisition scores were higher after a 360-degree video training compared to a classical lecture in a basic sciences module session. A meta-analysis on 21 studies reported higher accuracy in medical practice by people trained through VR for laparoscopic surgery training in 87% of cases compared to conventional training [27].
LP is an essential tool in daily clinical practice and despite being a relatively safe procedure performed at the patient bedside, a negative attitude appears to persist both in general population and in medical students [4, 28]. In several studies, medical trainees associated LP with a high level of difficulty and a low level of confidence compared to other similar bedside procedures [29, 30]. The development of simulation-based training has allowed practice in a safe environment and significantly increased confidence and real life procedural skills [8, 10].
Our aim was to develop a 180-degree video that would constitute an educational precursor to simulation session. Preliminary feedback received on this new teaching tool was positive. Our preliminary assessment showed that overall satisfaction score was high. We evaluated adverse symptoms including blurred vision, nausea and headache: they were seldom experienced by our participants. Those symptoms, known as cybersickness, are a constellation of symptoms of discomfort and malaise produced by VR exposure, which can limit the use of the medium [31]. Cybersickness has been reported to be frequent in head-mounted display and we believe that the choice of a fixed camera close to the operator view was beneficial regarding tolerance [32]. The video was evaluated as an interesting enhancement to the simulation training by both groups. In the student group, no participant refused the training. Moreover, we had a 100% rate of questionnaire response in students in favor of high engagement in the training. The short length of the video likely allowed participants to maintain their focus and participated to the high satisfaction, as previously reported [19]. However, it is not clear how this high interest would evolve in time if the participants were to increase their familiarity with VR as the majority of participants had no prior 360° video or VR experience. Interestingly, the medical student cohort had a significantly higher satisfaction, perceived a higher interest in the video and were keener to have the video in open access for repeated use than the cohort of attendings and residents with prior LP experience. This suggests that the video provided them with additional content, probably on real-life setting conditions (patient and operator installation during the gesture, communication with the patient during the procedure) that was not given by the mannequin training and that was not perceived by subjects that had already performed LP. A randomized study on 34 medical students showed that training in a simulated setting on endoscopy improved communication skills compared to students who underwent classical theoretical learning [33]. We believe that our tutorial provided insights on interaction and communication with the patient undergoing the LP, thus supporting the learning of medical-related social skills. The 3D characteristic of the video was seen as an addition of moderate interest compared to conventional 2-dimension video. It is known that the perceived interest of 3D increases with the interaction level, lower in a passive video, which could account for this lower rating [14].
Ros et al. developed a 3D LP that increased success in performing LP procedure on a simulator compared to a regular lecture [34]. Students trained with VR displayed reduced latency and made fewer technical errors when performing the LP on the mannequin. Conversely, they performed worse on an oral examination, stressing that the benefit were in precisely and accurately transferring the generalized skill set of the LP on the mannequin. Thus, the immersive tutorial had a specific positive effect on procedural learning, adding evidence on the potential of 3D video. It had also been reported that using a learner’s (first person) perspective in a video better promotes learning of an assembly task, compared to presenting video examples from a third-person perspective [35]. Further elaborating on the concept of Immersive VR Application in the First Person point of view (IVRA-FPV), Ros et al. results on LP training confirm that using first-person point of view improves medical students’ retention of their practical knowledge [34, 36].
Thus, the innovative association of a 3D video providing education about patients installation and full conduct of the procedure in ‘real life’ and of a simulators training allowing for technical skills acquisition that we propose could be an optimal teaching method.
VR 180 – or 360-degree video presents with several advantages. On a technical level, the material requirement is low: a connected screen device (VR headset, computer or mobile device) on which the video has been charged is the only required material. Each group can perform the activity in any environment being provided with the VR headset. A large number of trainees can use this tool simultaneously and its viewing can be repeated as needed. There is no need for continuous supervision. On a practical level, it was easy to produce, compared to immersive VR where the production is time consuming and often requires a large production team. The video could be recorded and edited within a few days. The low cost is also a significant aspect when considering applying it into education especially for low-income settings. Finally, the video modality allows for remote teaching, which is very valuable in the current Covid pandemic context and the associated need to restrict physical contact [36, 37].
We made the choice of a VR 180-degree video [38]. Evolving in a 180-degree space, viewers focus could be guided in a stereoscopic first-person point of view. The video did not provide a full immersion as in 360 degrees or the ability to look in any direction, but in our cases, it was not needed as the patient’s back and the hands of the operator were the points of interest. It has been shown that the use of images recorded from each eye allows for better immersion, characterized by a real sense of ‘presence’ [39]. The 180-degree format also eliminated resolution and bandwidth issues that can be observed with a 360-VR video format.
Our study has several limitations. VR is a relatively new pedagogical technique, so there is no high-quality evidence on the effectiveness of VR – based teaching. Evaluation of the effect of the video training on the performance of LP for the first time on a patient will be the next step of assessment, as it was done for evaluation of simulation training [8]. A better perception of benefit could also be achieved by involving students from several academic levels. Recording different clinical situations (LP procedure on an obese subject or in lateral decubitus) would also allow students to confront themselves to the different situations a physician can encounter in clinical practice [40]. Some of the users encountered cybersickness, a phenomenon that is well described in the literature [41]. Nevertheless as the camera in our video was stationary and contents was of low speed, virtual reality-induced sickness was minimized. All in all, we think our results open a door for future studies to further investigate the development of a VR-based LP training system by demonstrating the feasibility of the administration of the video and encouraging data regarding students’ interest.
Conclusion
We could develop an innovative VR 180-degree video for LP training. We provide to the community a sample of lumbar puncture VR video that can be freely used for future teaching. In a pilot cohort, the video could be efficiently implemented and its perceived interest and added value to the simulation training was evaluated as high by medical students. A future study will be needed to confirm that our VR video adds value to already established LP simulation training and establish whether it is a valuable tool to improve student learning and LP performance in real-life.
Supplementary Information
Acknowledgements
The authors would like to thank the patients and the physicians that took part in the video; the simulation training platform iLumens Paris Nord, Université de Paris, Paris France; MédiTICE UFR de Médecine.
Abbreviations
- 3D
Three dimensions
- LP
Lumbar puncture
- VR
Virtual reality
- SD
Standard deviation
Authors’ contributions
JD and CP have designed the study, written the protocol and submitted ethics. LGM, PFC, PP and ED have allowed for technical platform access, designed and engineered the 180-degree video and organized VR headset deployment. CP, JD, AV and LGM have performed the administration and evaluation of the video. AV, LGM, PFC, PP, ED, CP and JD have analyzed the data and written the article. All authors have read and approved the manuscript.
Funding
This work has been supported by the pedagogic innovation department of the Denis Diderot University, Paris under Grant IN2019.
Availability of data and materials
Data is available from the corresponding author upon reasonable request.
Declarations
Ethics approval and consent to participate
This project has received approval from the local Ethic committee University Hospital Lariboisère Fernand Widal (CE). The study conforms with World Medical Association Declaration of Helsinki. Informed consent was obtained from all subjects. Patients filmed for the video gave written and oral consents to diffuse the video to students and for academic publication in an online open-access publication. Faces were blurred during video processing to prevent identification. Students participating in the study gave informed consent and additional consent was obtained for the picture displaying the video administration for publication in an online open-access publication.
Consent for publication
Informed consent from all subjects and/or their legal guardian(s) for publication of identifying information/images in an online open-access publication has been obtained.
Competing interests
The authors do not report any disclosure regarding this work.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Shaw LM, Arias J, Blennow K, Galasko D, Molinuevo JL, Salloway S, et al. Appropriate use criteria for lumbar puncture and cerebrospinal fluid testing in the diagnosis of Alzheimer’s disease. Alzheimers Dement. 2018;14:1505–1521. doi: 10.1016/j.jalz.2018.07.220. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Wright BLC, Lai JTF, Sinclair AJ. Cerebrospinal fluid and lumbar puncture: a practical review. J Neurol. 2012;259:1530–1545. doi: 10.1007/s00415-012-6413-x. [DOI] [PubMed] [Google Scholar]
- 3.Costerus JM, Brouwer MC, van de Beek D. Technological advances and changing indications for lumbar puncture in neurological disorders. Lancet Neurol. 2018;17:268–278. doi: 10.1016/S1474-4422(18)30033-4. [DOI] [PubMed] [Google Scholar]
- 4.Duits FH, Martinez-Lage P, Paquet C, Engelborghs S, Lleó A, Hausner L, et al. Performance and complications of lumbar puncture in memory clinics: results of the multicenter lumbar puncture feasibility study. Alzheimers Dement. 2016;12:154–163. doi: 10.1016/j.jalz.2015.08.003. [DOI] [PubMed] [Google Scholar]
- 5.Engelborghs S, Niemantsverdriet E, Struyfs H, Blennow K, Brouns R, Comabella M, et al. Consensus guidelines for lumbar puncture in patients with neurological diseases. Alzheimers Dement (Amst) 2017;8:111–126. doi: 10.1016/j.dadm.2017.04.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Paquet C, Latour F, Saulnier I, Hanon O. Multicenter study on lumbar puncture indication, clinical practice and feasibility. Rev Neurol (Paris) 2012;168:28–32. doi: 10.1016/j.neurol.2011.08.012. [DOI] [PubMed] [Google Scholar]
- 7.Henriksen MJV, Wienecke T, Kristiansen J, Park YS, Ringsted C, Konge L. Opinion and special articles: stress when performing the first lumbar puncture may compromise patient safety. Neurology. 2018;90:981–987. doi: 10.1212/WNL.0000000000005556. [DOI] [PubMed] [Google Scholar]
- 8.Gaubert S, Blet A, Dib F, Ceccaldi P-F, Brock T, Calixte M, et al. Positive effects of lumbar puncture simulation training for medical students in clinical practice. BMC Med Educ. 2021;21:18. doi: 10.1186/s12909-020-02452-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Lydon S, Reid McDermott B, Ryan E, O’Connor P, Dempsey S, Walsh C, et al. Can simulation-based education and precision teaching improve paediatric trainees’ behavioural fluency in performing lumbar puncture? A pilot study. BMC Med Educ. 2019;19. [DOI] [PMC free article] [PubMed]
- 10.Barsuk JH, Cohen ER, Caprio T, McGaghie WC, Simuni T, Wayne DB. Simulation-based education with mastery learning improves residents’ lumbar puncture skills. Neurology. 2012;79:132–137. doi: 10.1212/WNL.0b013e31825dd39d. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Akaishi Y, Okada Y, Lee-Jayaram J, Seo JS, Yamada T, Berg BW. Validity evidence of a task trainer for normal and difficult lumbar puncture: a cross-sectional study. Medicine (Baltimore) 2020;99:e22622. doi: 10.1097/MD.0000000000022622. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Zhao J, Xu X, Jiang H, Ding Y. The effectiveness of virtual reality-based technology on anatomy teaching: a meta-analysis of randomized controlled studies. BMC Med Educ. 2020;20:127. doi: 10.1186/s12909-020-1994-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Sattler LA, Schuety C, Nau M, Foster DV, Hunninghake J, Sjulin T, et al. Simulation-based medical education improves procedural confidence in Core invasive procedures for military internal medicine residents. Cureus. 2020;12:e11998. doi: 10.7759/cureus.11998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Pottle J. Virtual reality and the transformation of medical education. Future Healthc J. 2019;6:181–185. doi: 10.7861/fhj.2019-0036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Mansoory MS, Khazaei MR, Azizi SM, Niromand E. Comparison of the effectiveness of lecture instruction and virtual reality-based serious gaming instruction on the medical students’ learning outcome about approach to coma. BMC Med Educ. 2021;21:347. doi: 10.1186/s12909-021-02771-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Bailenson J. Experience on demand: what virtual reality is, how it works, and what it can do. New York: W W Norton & Company; 2018.
- 17.Hu AE, Lee JJ. Virtual reality in education: a tool for learning in the experience age. IJIIE. 2017;4:215. doi: 10.1504/IJIIE.2017.10012691. [DOI] [Google Scholar]
- 18.Ros M, Trives J-V, Lonjon N. From stereoscopic recording to virtual reality headsets: designing a new way to learn surgery. Neurochirurgie. 2017;63:1–5. doi: 10.1016/j.neuchi.2016.08.004. [DOI] [PubMed] [Google Scholar]
- 19.Harrington CM, Kavanagh DO, Wright Ballester G, Wright Ballester A, Dicker P, Traynor O, et al. 360° operative videos: a randomised cross-over study evaluating attentiveness and information retention. J Surg Educ. 2018;75:993–1000. doi: 10.1016/j.jsurg.2017.10.010. [DOI] [PubMed] [Google Scholar]
- 20.Chan V, Larson ND, Moody DA, Moyer DG, Shah NL. Impact of 360° vs 2D videos on engagement in anatomy education. Cureus. 2021;13:e14260. doi: 10.7759/cureus.14260. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Ros M, Debien B, Cyteval C, Molinari N, Gatto F, Lonjon N. Applying an immersive tutorial in virtual reality to learning a new technique. Neurochirurgie. 2020;66:212–218. doi: 10.1016/j.neuchi.2020.05.006. [DOI] [PubMed] [Google Scholar]
- 22.Zulkiewicz BA, Boudewyns V, Gupta C, Kirschenbaum A, Lewis MA. Using 360-degree video as a research stimulus in digital health studies: lessons learned. JMIR Serious Games. 2020;8:e15422. doi: 10.2196/15422. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Arents V, de Groot PCM, Struben VMD, van Stralen KJ. Use of 360° virtual reality video in medical obstetrical education: a quasi-experimental design. BMC Med Educ. 2021;21:202. doi: 10.1186/s12909-021-02628-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Lohre R, Wang JC, Lewandrowski K-U, Goel DP. Virtual reality in spinal endoscopy: a paradigm shift in education to support spine surgeons. J Spine Surg. 2020;6(Suppl 1):S208–S223. doi: 10.21037/jss.2019.11.16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Taubert M, Webber L, Hamilton T, Carr M, Harvey M. Virtual reality videos used in undergraduate palliative and oncology medical teaching: results of a pilot study. BMJ Support Palliat Care. 2019;9:281–285. doi: 10.1136/bmjspcare-2018-001720. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Sultan L, Abuznadah W, Al-Jifree H, Khan MA, Alsaywid B, Ashour F. An experimental study on usefulness of virtual reality 360° in undergraduate medical education. Adv Med Educ Pract. 2019;10:907–916. doi: 10.2147/AMEP.S219344. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Samadbeik M, Yaaghobi D, Bastani P, Abhari S, Rezaee R, Garavand A. The applications of virtual reality Technology in Medical Groups Teaching. J Adv Med Educ Prof. 2018;6:123–129. [PMC free article] [PubMed] [Google Scholar]
- 28.Tsvetkova DZ, Bergquist SH, Parker MW, Jarrett TL, Howell JC, Watts KD, et al. Fear and uncertainty do not influence reported willingness to undergo lumbar punctures in a U.S. Multi-cultural cohort. Front Aging Neurosci. 2017;9:22. doi: 10.3389/fnagi.2017.00022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.von Cranach M, Backhaus T, Brich J. Medical students’ attitudes toward lumbar puncture-and how to change. Brain Behav. 2019;9:e01310. doi: 10.1002/brb3.1310. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Dehmer JJ, Amos KD, Farrell TM, Meyer AA, Newton WP, Meyers MO. Competence and confidence with basic procedural skills: the experience and opinions of fourth-year medical students at a single institution. Acad Med. 2013;88:682–687. doi: 10.1097/ACM.0b013e31828b0007. [DOI] [PubMed] [Google Scholar]
- 31.Stanney KM, Kennedy RS, Drexler JM. Cybersickness is not simulator sickness. Proc Hum Factors ErgonSoc Annu Meet. 1997;41:1138–1142. doi: 10.1177/107118139704100292. [DOI] [Google Scholar]
- 32.Stanney K, Kennedy R, Harm D, Compton D, Lanham D, Drexler J. Con.Gural scoring of simulator sickness, Cybersickness and space adaptation syndrome: similarities and differences. In: Hettinger L, Haas M, editors. Virtual and Adaptive Environments. CRC Press; 2003. pp. 247–278. [Google Scholar]
- 33.Grover SC, Garg A, Scaffidi MA, Yu JJ, Plener IS, Yong E, et al. Impact of a simulation training curriculum on technical and nontechnical skills in colonoscopy: a randomized trial. Gastrointest Endosc. 2015;82:1072–1079. doi: 10.1016/j.gie.2015.04.008. [DOI] [PubMed] [Google Scholar]
- 34.Ros M, Neuwirth LS, Ng S, Debien B, Molinari N, Gatto F, et al. The effects of an immersive virtual reality application in first person point-of-view (IVRA-FPV) on the learning and generalized performance of a lumbar puncture medical procedure. Educ Tech Res Dev. 2021;69:1529–1556. doi: 10.1007/s11423-021-10003-w. [DOI] [Google Scholar]
- 35.Fiorella L, van Gog T, Hoogerheide V, Mayer RE. It’s all a matter of perspective: viewing first-person video modeling examples promotes learning of an assembly task. J Educ Psychol. 2017;109:653–665. doi: 10.1037/edu0000161. [DOI] [Google Scholar]
- 36.Ros M, Neuwirth LS. Increasing global awareness of timely COVID-19 healthcare guidelines through FPV training tutorials: portable public health crises teaching method. Nurse Educ Today. 2020;91:104479. doi: 10.1016/j.nedt.2020.104479. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Sandrone S, Albert DVF, Dunham SR, Kraker J, Noviawaty I, Palm M, et al. Training in neurology: how lessons learned on teaching, well-being, and telemedicine during the COVID-19 pandemic can shape the future of neurology education. Neurology. 2021;96:e3007–e3010. doi: 10.1212/WNL.0000000000012010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Stefaniak J, editor. Cases on instructional design and performance outcomes in Medical Education. IGI Global; 2020. [Google Scholar]
- 39.Mikropoulos TA, Strouboulis V. Factors that influence presence in educational virtual environments. CyberPsychol Behav. 2004;7:582–591. doi: 10.1089/cpb.2004.7.582. [DOI] [PubMed] [Google Scholar]
- 40.Edwards C, Leira EC, Gonzalez-Alegre P. Residency training: a failed lumbar puncture is more about obesity than lack of ability. Neurology. 2015;84:e69–e72. doi: 10.1212/WNL.0000000000001335. [DOI] [PubMed] [Google Scholar]
- 41.Kim YY, Kim HJ, Kim EN, Ko HD, Kim HT. Characteristic changes in the physiological components of cybersickness. Psychophysiology. 2005;42:616–625. doi: 10.1111/j.1469-8986.2005.00349.x. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The datasets analyzed during the current study are available from the corresponding author on a reasonable request.
Data is available from the corresponding author upon reasonable request.