Skip to main content
Sensors (Basel, Switzerland) logoLink to Sensors (Basel, Switzerland)
. 2022 Jan 11;22(2):522. doi: 10.3390/s22020522

Feasibility and Accuracy of Thoracolumbar Pedicle Screw Placement Using an Augmented Reality Head Mounted Device

Henrik Frisk 1,2,*, Eliza Lindqvist 3, Oscar Persson 1,2, Juliane Weinzierl 3, Linda K Bruetzel 3, Paulina Cewe 2,4, Gustav Burström 1,2, Erik Edström 1,2, Adrian Elmi-Terander 1,2
Editor: James F Rusling
PMCID: PMC8779462  PMID: 35062483

Abstract

Background: To investigate the accuracy of augmented reality (AR) navigation using the Magic Leap head mounted device (HMD), pedicle screws were minimally invasively placed in four spine phantoms. Methods: AR navigation provided by a combination of a conventional navigation system integrated with the Magic Leap head mounted device (AR-HMD) was used. Forty-eight screws were planned and inserted into Th11-L4 of the phantoms using the AR-HMD and navigated instruments. Postprocedural CT scans were used to grade the technical (deviation from the plan) and clinical (Gertzbein grade) accuracy of the screws. The time for each screw placement was recorded. Results: The mean deviation between navigation plan and screw position was 1.9 ± 0.7 mm (1.9 [0.3–4.1] mm) at the entry point and 1.4 ± 0.8 mm (1.2 [0.1–3.9] mm) at the screw tip. The angular deviation was 3.0 ± 1.4° (2.7 [0.4–6.2]°) and the mean time for screw placement was 130 ± 55 s (108 [58–437] s). The clinical accuracy was 94% according to the Gertzbein grading scale. Conclusion: The combination of an AR-HMD with a conventional navigation system for accurate minimally invasive screw placement is feasible and can exploit the benefits of AR in the perspective of the surgeon with the reliability of a conventional navigation system.

Keywords: surgical navigation, minimally invasive surgery, spine surgery, augmented reality, pedicle screw, phantom

1. Introduction

An increasing number of pedicle screws are placed using minimally invasive techniques [1]. This has the benefit of fewer surgical site infections, less blood loss and shortened hospital stay [2,3,4,5]. The correct placement of pedicle screws is important to prevent vascular and neurological injuries during surgical procedures. While the reported accuracies of freehand pedicle screw placement in the thoracic and lumbar spine are highly variable, the benefits of improved accuracy, especially in minimally invasive surgery, are evident [6,7].

The traditional image guidance method for pedicle screw placement has been intraoperative fluoroscopy, providing two-dimensional information. The continuous development of three-dimensional imaging technologies for intraoperative use has paved the way for surgical navigation in spine surgery. Navigation improves accuracy and reduces the need for revision surgery [7,8]. In addition, it eliminates the need for intraoperative fluoroscopy and consequently the radiation exposure in the OR [9,10,11]. However, surgical navigation carries features that may limit its use. Intraoperative 3D-imaging requires dedicated equipment, and the navigational information must be presented and understood effectively. The latest development in navigated spine surgery is the use of augmented reality (AR) to make navigational information more intuitive by superimposing it on the real world in real-time. AR technology has been shown to provide a meaningful addition in terms of accuracy and usability for navigated pedicle screw placement in the thoracic and lumbar spine [12,13].

An important feature for all navigation systems is the interface used to present the navigational data. While conventional surgical navigation systems typically use screens to provide information in the standardized perspectives common for radiology, AR-solutions are inherently different and lend themselves to presenting information from the perspective of the surgeon [14,15,16,17]. To date, four different interfaces for AR-navigation have been presented [13,18]. Projector based AR was first described in the early 2000s and the first system for spinal navigation was presented in 2020 [19,20,21]. Monitor-based-AR, where a separate monitor displays a video feed of the surgical field combined with AR overlay, has been described in several publications [13]. Microscope-based AR, where the AR image is superimposed on the microscope view as a head up display, has been successfully used in different spinal applications. However, this method is best suited for intra- and extradural tumor surgery and not optimized for pedicle screw placement [22]. Since their introduction, Head-mounted-AR devices have gained attention due to their ability to present information without interrupting the surgeon’s line of sight and causing undue attention shifts [18,23]. Consequently, several head-mounted devices (HMD) using augmented reality navigation are available on the market today. Placing the navigation device on the surgeon’s head allows the augmented reality to be directly projected onto the physical patient and eliminates the need to switch focus between the navigational information and the surgical field. The HoloLens (Microsoft) and XVision (Augmedix) have both been used in studies on pedicle screws placement [24,25,26,27,28,29,30]. A third head mounted device, the Magic Leap, has so far been used in two studies of functional neurosurgery and open spine surgery [31,32].

In this study, we investigate the technical and clinical accuracy of minimally invasive thoracolumbar pedicle screw placement with AR navigation using the Magic Leap head mounted device in combination with a conventional surgical navigation system.

2. Materials and Methods

2.1. OR Setup, Navigation System and HMD

The study was conducted in a hybrid OR. The hybrid OR was equipped with a motorized ceiling-mounted C-arm system (AlluraClarity Flexmove, Philips Healthcare, Best, The Netherlands) for intraoperative Cone beam CT (CBCT) imaging.

A software prototype designed for AR-navigation using the Magic Leap HMD (Magic Leap 1, Plantation, Magic Leap, FL, USA) was installed on the Curve® 1.0 navigation platform (Brainlab AG, Munich, Germany), and used for all experiments.

2.2. Workflow

2.2.1. Co-Registration

Four commercially available spine phantoms for minimally invasive surgery training (Th10-Sacrum) were used (Misstrainer spine surgery: Creaplast, Verton, France). The phantoms consisted of X-ray dense bone substitute, elastic foam soft tissue and silicone skin. For each phantom, a high-resolution CT scan was performed preoperatively (IQon Spectral CT, Philips, Best, The Netherlands). At the beginning of each surgery, the phantom was placed on the OR table and a radiolucent reference clamp with a 4-sphere array was attached to the spinous process of Th10 via a small incision. The universal AIR matrix (Brainlab AG, Munich, Germany) was placed on the phantom and an intraoperative CBCT scan was performed to allow automatic co-registration. The preoperative CT images were fused with the CBCT images for optimal image quality and used by the software to render a 3D-model of the spine. Due to the properties of the phantom, manufactured with the spine in a prone position and with dense foam resisting intervertebral movement, rigid image fusion was adequate to align pre- and intraoperative images.

2.2.2. HDM Calibration and Alignment to Navigation

Each surgeon was fitted with an HMD, which was individually eye calibrated. To align the coordinate systems of the HMD and the navigation system, a custom disposable hybrid marker (Brainlab AG, Munich, Germany) was placed in the field of view of both systems. After alignment, the 3D-model was accurately augmented onto the phantom without the need for additional adjustments. Accuracy was checked using the navigational pointer to touch anatomical landmarks which were accessible at the attachment site of the reference. The accuracy of the overlay of the AR image and the dynamic reference frame was confirmed visually: the reflective spheres of the reference frame were overlayed with green circles when correctly aligned (Figure 1).

Figure 1.

Figure 1

Surgeon’s view through the HMD presenting 2D and 3D information. The 3D overlay contains the planned 3D screws with protruding trajectory lines to assist instrument alignment. The lower 3D model is augmented onto the spine of the phantom while the 2D and 3D-representations seen floating above the phantom provide additional information and can be positioned freely in the virtual space and switched on and off. Additionally, note the colocalization of the green circles with the reflective spheres of the dynamic reference frame indicating accurate alignment.

2.2.3. Planning and Placing the Screws

Screw planning was performed as part of the intraoperative workflow. A navigated pointer was used to indicate the desired entry and path for each screw on the augmented 3D model (Figure 1).

Each screw placement was assessed and fine-tuned on the touchscreen of the navigation system (Figure 2).

Figure 2.

Figure 2

The screens of the navigation system present information corresponding to the surgeon’s view in the HMD.

The surgeon incised the skin of the phantom with a scalpel and dissected the foam tissue to reach the pedicle entry point, using a minimally invasive, technique. A navigated drill guide and screwdriver (Expedium, DePuy Synthes, Raynham, MA, USA) were calibrated to the navigation system and for each screw placement positioned along the planned trajectory. The pedicle was drilled with a 4.5 mm diameter drill bit. The navigated screwdriver was then used to place a 5 mm diameter screw in the pedicle (Supplementary Video S1). The time (skin to skin) for every screw placement was recorded. Two surgeons planned and placed a total of 48 pedicle screws. In each phantom, 12 screws were placed bilaterally in Th11-L4. Each surgeon planned and placed 24 screws. The outermost (Th10 and L5) levels were excluded. The reason was to avoid dislodging the reference frame attached at Th10 and extreme pedicle angles at L5. When all screws were placed, a new CT scan was performed for measurements of screw placement accuracy.

2.2.4. Technical and Clinical Accuracy Evaluation

To assess technical accuracy, the deviation of each placed screw from its planned path was measured at bone entry and at the tip of the screw. Measurements were performed in 3D by fusing the intraoperative scan, including planned screw paths, with the postoperative scan of the placed screws. The angular deviation was calculated based on these data (Figure 3).

Figure 3.

Figure 3

Overview of measurement model for technical accuracy.

Three independent reviewers assessed the clinical accuracy according to the Gertzbein grading scale; grade 0 (screw within pedicle), grade 1 (breach < 2 mm), grade 2 (breach 2 to < 4 mm), and grade 3 (breach > 4 mm) [33]. Gertzbein grades, 0 and 1 were considered clinically accurate. If there was no consensus between reviewers when grading a screw, the median was used.

2.3. Statistical Analysis

Accuracy measurements and screw placement times are expressed as mean ± standard deviation and as medians [min-max]. Pearson’s product-moment correlation was performed for calculating r. Statistical analysis was performed using RStudio (RStudio Team (2016). RStudio: Integrated Development for R. RStudio, Inc., Boston, MA, USA) and a p-value less than 0.05 was considered as significant.

3. Results

3.1. Technical Accuracy

A total of 48 pedicle screws were placed. The accuracy was 1.9 ± 0.7 mm (1.9 [0.3–4.1] mm) and 1.4 ± 0.8 mm (1.2 [0.1–3.9] mm) at the entry point (Figure 4) and at the tip of the screw, respectively (Figure 5). The angular deviation was 3.0 ± 1.4° (2.7 [0.4–6.2]°) (Figure 6). The mean pedicle width was 8.5 ± 2.0 mm and the depth from skin to bone entry was 63.9 ± 10.1 mm.

Figure 4.

Figure 4

Overall distribution of technical accuracy of placed pedicle screws (n = 48) at bone entry point. Corresponding box plot with median and interquartile range are included below the histogram.

Figure 5.

Figure 5

Overall distribution of technical accuracy of placed pedicle screws (n = 48) at screw tip. Corresponding box plot with median, interquartile range and outliers are included below the histogram.

Figure 6.

Figure 6

Distribution of angular deviations between planned trajectories and placed screws (n = 48) with corresponding box plot indicating median and interquartile range.

3.2. Time

The mean time for implanting a screw was 130 ± 55 s (108 [58–437] s). The full range of implanting times is shown in Figure 7. There was no correlation between accuracy and time to place the instrument (r = 0.226, p = 0.12).

Figure 7.

Figure 7

Distribution of screw implantation times (n = 48) with corresponding box plots indicating median, interquartile range, and outliers from the distribution.

3.3. Clinical Accuracy

Of the 48 pedicle screws placed, 45 were rated to be clinically accurate. The grading of the screws is shown in Table 1. Three screws were Gertzbein grade 2 and thus considered inaccurate (Figure 8). The absolute interrater agreement for judging screws as accurate or inaccurate was 92%.

Table 1.

Technical accuracy of implanted screws.

Gertzbein
Grade 0
Gertzbein
Grade 1
Gertzbein
Grade 2
Gertzbein
Grade 3
Clinically
Accurate
Clinically
Inaccurate
Accuracy
Number of screws 35 10 3 0 45 3 94%

Figure 8.

Figure 8

The postoperative scans including the surgical plan for the 3 screws graded 2 on the Gertzbein scale, presented in coronal, axial and sagittal views.

4. Discussion

Compared to the conventional free-hand technique, computer-assisted surgery, including AR and robotic applications, has been shown to improve pedicle screw placement accuracy. Projector based AR has been used to reach high clinical accuracy in a cadaveric model [21]. Monitor-based-AR has gradually been improved with increasing clinical accuracy from 85% in the first preclinical study to 94% in challenging clinical deformity cases [14,15], while the technical accuracy of the system has improved from 2.2 ± 1.3 mm using only instrument tracking to 0.94 ± 0.59 when combined with robotic assistance [34,35]. Microscope-based -AR has been used for spinal tumor surgery reaching a target registration error of 0.87 ± 0.28 mm [22]. HMD-AR devices are the latest addition to the AR-navigation arsenal. Studies on non-medical devices (HoloLens, Magic Leap) and FDA-approved medical devices (X-vision) are very promising. The latter has been used in clinical open lumbar surgeries achieving a clinical accuracy of 97.8% [23]. However, the main advantage of AR devices in general, and HMDs in particular, is in assisting in minimally invasive spine surgery.

This is the first study using an augmented reality head mounted device (AR-HMD) in conjunction with an established conventional navigation system for minimally invasive spinal pedicle screw placement. The AR-HMD device gives visual guidance for identifying the bone entry point and directing the instruments during minimally invasive procedures. Locating the bone entry point is a key step. The 3D AR model allows for visualization of the instrument position in respect to the deep bony anatomy, simplifying adherence to the planned path.

The conventional navigation system provides, according to the manufacturer, an overall accuracy of ≤2.0 mm/2° (mean) and ≤3.00 mm/3° (95th percentile). In this prototypic design, the HMD is aligned to the conventional system. The AR-perspective allows the identification of misalignment, which can be managed with a realignment procedure (Figure 9). The AR-HMD device in this study demonstrates a clinical accuracy of 94% and a technical accuracy of 1.9 ± 0.7 mm, which is an excellent performance in light of the inbound error of the system and in line with previously reported data by other AR navigation systems [12,13,15,27,36]. Three screws were graded as Gertzbein grade 2. The preoperative plan and postoperative scans for these three screws are presented in Figure 6, it is evident that all three screws deviate slightly lateral, but they are clinically acceptable and would not require revision or replacement. A screw placed with the “in-out-in” technique although clinically safe, strictly following the Gertzbein scale is considered as inaccurately placed.

Figure 9.

Figure 9

The surgeon calibrating the HMD to the navigation system using a hybrid marker.

Liebmann et al. performed a study where they used the HoloLens to place pedicle screws in an open lumbar spine model and reported 2.77 ± 1.46 mm mean deviation from the planned path at the entry point and an angular deviation of 3.38°± 1.73° [25]. When Molina et al. used Augmedics’ XVision to place thoracolumbar pedicle screws in cadaveric torsos, in open surgery, they achieved a clinical accuracy of 94.6% according to the Gertzbein scale [24]. Yanni et al., used the same AR-HMD in combination with conventional navigation to place pedicle screws in a 3D printed, fully visible, open saw bone model and reached 98.4% accuracy according to the Gertzbein scale without reporting on technical accuracy [32]. In a minimally invasive set-up Liu et al., achieved an accuracy of 94% using Hololens [28].

Accuracy in this study is limited by the intrinsic properties of the HMD-system. In contrast to the solutions studied by Liebmann and Molina, the system evaluated in this study is a combination of outside-in tracking afforded by the underlying conventional reference frame-based navigation system and inside out tracking from the HMD. This combination allows realignment of the AR-view to the conventional tracking when necessary. Of importance, both the technical and clinical accuracy reported in this study reflect the compounded errors of the navigational system and the surgeon’s adherence to the plan. As mentioned above, the target registration error reported for conventional navigation systems is within 1–2 mm. The use of robotic arms may reduce errors related to the surgeon’s ability to maintain the correct position and angle of approach on the bone entry point, thereby increasing the technical accuracy [35].

4.1. Attention Shift

The use of an AR-HMD has the benefit of placing the navigation information directly in the surgeon’s field of view. Both 2D and 3D models of the spine are visible with the 3D model being aligned with the phantom’s anatomy. Having the same navigation information directly in the surgical field minimizes the risk of attention shift. Attention shift occurs when surgeons must change their focus repeatedly between the surgical field and the screen of the navigation system to follow the navigational cues. This shift of attention has shown negative effects on motor and cognitive tasks during surgery and could be a source of instrumentation error in spinal surgery [37].

However, the use of HMD limits the information to those wearing them. Thus, a screen in the OR with a live navigation feed is beneficial for the rest of the surgical team, especially the OR nurse. In this study, the navigation screen simplified intraoperative communication, giving the OR nurse information about the surgical procedure. This may reduce surgical flow disruption. Lack of communication in the OR has been reported as a major cause of disruption resulting in prolonged operating time [38,39].

4.2. Radiation

Fluoroscopy is traditionally used for intraoperative guidance when placing screws in minimally invasive procedures. Fluoroscopy assisted screw insertion accuracy is reported to range from 83.9% to 100% but is associated with exposing the surgical team to varying amounts of radiation [40,41,42]. Using modern imaging techniques and computer assisted navigation can eliminate the need for intraoperative fluoroscopy and decrease the radiation exposure to the surgical team [43]. No lead aprons were worn during the procedures in this study. Instead, distancing and protective lead shields were used to ensure radiation safety during the initial and final CBCT-scans [44].

4.3. Limitations

Limitations of this study include the small sample size and the fact that plastic torso phantoms were used. There were three screws deemed inaccurate in our study. Analysis of the pre-procedural plan and post-procedural images shows that all three screws were correctly planned but deviated slightly laterally. However, these screws would not necessarily have breached if placed in real bone. The plastic used in our model lacked differentiation between cancellous and cortical bone, meaning the typical resistance offered by cortical bone was absent. Moreover, navigation systems based on dynamic reference frames have been shown to lose accuracy with distance from the reference [45]. This is explained by the mobility of the spine, where undetected movements can occur between the vertebra to which the reference is attached, and the vertebra being manipulated surgically. However, no such effect could be seen in this study. A possible explanation for this lies in the properties of the phantom used, where the foam could withstand manipulations of the contained spine model.

These are problems inherent to the study design and future studies on cadavers or animal models, and eventually, clinical trials will allow a better understanding of the efficacy of the system.

5. Conclusions

The combination of an HMD with a conventional navigation system for accurate minimally invasive pedicle screw placement is feasible and can exploit the benefits of AR from the perspective of the surgeon with the reliability of a conventional navigation system.

Supplementary Materials

The following are available online at https://www.mdpi.com/article/10.3390/s22020522/s1, Video S1: Surgeon’s view through the AR-HMD during pedicle screw placement.

Author Contributions

Conceptualization: H.F., G.B., E.E. and A.E.-T.; Data interpretation: H.F., G.B., O.P., P.C., E.E. and A.E.-T.; Statistical analysis: H.F. and G.B.; Data curation: E.L., J.W. and L.K.B.; Writing—original draft preparation: H.F.; Writing—review and editing: H.F., G.B., E.E., E.L., J.W., L.K.B. and A.E.-T.; Supervision: A.E.-T.; All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data is available from the corresponding author upon reasonable request.

Conflicts of Interest

None of the authors who are affiliated with clinical institutions (H.F., G.B., O.P., P.C., E.E. and A.E.-T.) have financial interests in the subject matter, materials, or equipment or with any competing materials and did not receive any payments from Brainlab. A.E.-T. is a consultant for Brainlab. The other authors affiliated with Brainlab (E.L., J.W. and L.B.) have financial interests in the subject matter, materials, and equipment, in the sense that they are employees of Brainlab. The extent of influence on the data, manuscript structure and manuscript conclusions by these authors and/or Brainlab was limited to technical knowledge and support for the experiments as well as performing technical analysis of image data. Authors without conflicts of interest had full control of all data labelling, data analysis and information submitted for publication and over all conclusions drawn in the manuscript. The prototype system described in this article is currently a research prototype and is not for commercial use.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Phillips F.M., Cheng I., Rampersaud Y.R., Akbarnia B.A., Pimenta L., Rodgers W.B., Uribe J.S., Khanna N., Smith W.D., Youssef J.A., et al. Breaking Through the “Glass Ceiling” of Minimally Invasive Spine Surgery. Spine. 2016;41:S39–S43. doi: 10.1097/BRS.0000000000001482. [DOI] [PubMed] [Google Scholar]
  • 2.Vazan M., Gempt J., Meyer B., Buchmann N., Ryang Y.-M. Minimally invasive transforaminal lumbar interbody fusion versus open transforaminal lumbar interbody fusion: A technical description and review of the literature. Acta Neurochir. 2017;159:1137–1146. doi: 10.1007/s00701-017-3078-3. [DOI] [PubMed] [Google Scholar]
  • 3.Goldstein C.L., Macwan K., Sundararajan K., Rampersaud Y.R. Perioperative outcomes and adverse events of minimally invasive versus open posterior lumbar fusion: Meta-analysis and systematic review. J. Neurosurg. Spine. 2016;24:416–427. doi: 10.3171/2015.2.SPINE14973. [DOI] [PubMed] [Google Scholar]
  • 4.Lu V.M., Kerezoudis P., Gilder H.E., McCutcheon B.A., Phan K., Bydon M. Minimally Invasive Surgery versus Open Surgery Spinal Fusion for Spondylolisthesis: A Systematic Review and Meta-analysis. Spine. 2017;42:E177–E185. doi: 10.1097/BRS.0000000000001731. [DOI] [PubMed] [Google Scholar]
  • 5.Wu M.-H., Dubey N.K., Li Y.-Y., Lee C.-Y., Cheng C.-C., Shi C.-S., Huang T.-J. Comparison of minimally invasive spine surgery using intraoperative computed tomography integrated navigation, fluoroscopy, and conventional open surgery for lumbar spondylolisthesis: A prospective registry-based cohort study. Spine J. 2017;17:1082–1090. doi: 10.1016/j.spinee.2017.04.002. [DOI] [PubMed] [Google Scholar]
  • 6.Kosmopoulos V., Schizas C. Pedicle Screw Placement Accuracy: A meta-analysis. Spine. 2007;32:E111–E120. doi: 10.1097/01.brs.0000254048.79024.8b. [DOI] [PubMed] [Google Scholar]
  • 7.Perdomo-Pantoja A., Ishida W., Zygourakis C., Holmes C., Iyer R.R., Cottrill E., Theodore N., Witham T.F., Lo S.-F.L. Accuracy of Current Techniques for Placement of Pedicle Screws in the Spine: A Comprehensive Systematic Review and Meta-Analysis of 51,161 Screws. World Neurosurg. 2019;126:664–678.e3. doi: 10.1016/j.wneu.2019.02.217. [DOI] [PubMed] [Google Scholar]
  • 8.Elmi-Terander A., Burström G., Nachabé R., Fagerlund M., Ståhl F., Charalampidis A., Edström E., Gerdhem P. Augmented reality navigation with intraoperative 3D imaging vs. fluoroscopy-assisted free-hand surgery for spine fixation surgery: A matched-control study comparing accuracy. Sci. Rep. 2020;10:707. doi: 10.1038/s41598-020-57693-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Bourgeois A.C., Faulkner A.R., Bradley Y.C., Pasciak A.S., Barlow P., Gash J.R., Reid W.S. Improved Accuracy of Minimally Invasive Transpedicular Screw Placement in the Lumbar Spine with 3-Dimensional Stereotactic Image Guidance. J. Spinal Disord. Tech. 2015;28:324–329. doi: 10.1097/BSD.0000000000000152. [DOI] [PubMed] [Google Scholar]
  • 10.Fomekong E., Safi S.E., Raftopoulos C. Spine Navigation Based on 3-Dimensional Robotic Fluoroscopy for Accurate Percutaneous Pedicle Screw Placement: A Prospective Study of 66 Consecutive Cases. World Neurosurg. 2017;108:76–83. doi: 10.1016/j.wneu.2017.08.149. [DOI] [PubMed] [Google Scholar]
  • 11.Innocenzi G., Bistazzoni S., D’Ercole M., Cardarelli G., Ricciardi F. Does Navigation Improve Pedicle Screw Placement Accuracy? Comparison between Navigated and Non-navigated Percutaneous and Open Fixations. Trends Reconstr. Neurosurg. 2017;124:289–295. doi: 10.1007/978-3-319-39546-3_42. [DOI] [PubMed] [Google Scholar]
  • 12.Burström G., Nachabe R., Persson O., Edström E., Terander A.E. Augmented and Virtual Reality Instrument Tracking for Minimally Invasive Spine Surgery: A Feasibility and Accuracy Study. Spine. 2019;44:1097–1104. doi: 10.1097/BRS.0000000000003006. [DOI] [PubMed] [Google Scholar]
  • 13.Burström G., Persson O., Edström E., Elmi-Terander A. Augmented reality navigation in spine surgery: A systematic review. Acta Neurochir. 2021;163:843–852. doi: 10.1007/s00701-021-04708-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Elmi-Terander A., Burström G., Nachabe R., Skulason H., Pedersen K., Fagerlund M., Ståhl F., Charalampidis A., Söderman M., Holmin S., et al. Pedicle Screw Placement Using Augmented Reality Surgical Navigation with Intraoperative 3D Imaging: A First In-Human Prospective Cohort Study. Spine. 2019;44:517–525. doi: 10.1097/BRS.0000000000002876. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Elmi-Terander A., Skulason H., Söderman M., Racadio J., Homan R., Babic D., van der Vaart N., Nachabe R. Surgical Navigation Technology Based on Augmented Reality and Integrated 3D Intraoperative Imaging: A Spine Cadaveric Feasibility and Accuracy Study. Spine. 2016;41:E1303–E1311. doi: 10.1097/BRS.0000000000001830. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Auloge P., Cazzato R.L., Ramamurthy N., DE Marini P., Rousseau C., Garnon J., Charles Y.P., Steib J.-P., Gangi A. Augmented reality and artificial intelligence-based navigation during percutaneous vertebroplasty: A pilot randomised clinical trial. Eur. Spine J. 2019;29:1580–1589. doi: 10.1007/s00586-019-06054-6. [DOI] [PubMed] [Google Scholar]
  • 17.Peh S., Chatterjea A., Pfarr J., Schäfer J.P., Weuster M., Klüter T., Seekamp A., Lippross S. Accuracy of augmented reality surgical navigation for minimally invasive pedicle screw insertion in the thoracic and lumbar spine with a new tracking device. Spine J. 2019;20:629–637. doi: 10.1016/j.spinee.2019.12.009. [DOI] [PubMed] [Google Scholar]
  • 18.Uddin S.-A., Hanna G., Ross L., Molina C., Urakov T., Johnson P., Kim T., Drazin D. Augmented Reality in Spinal Surgery: Highlights from Augmented Reality Lectures at the Emerging Technologies Annual Meetings. Cureus. 2021;13 doi: 10.7759/cureus.19165. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Hoppe H.D.S., Raczkowsky J., Wörn H., Moctezuma J.L. Intraoperative Visualization of Surgical Planning Data Using Video Projectors. Stud. Health Technol. Inform. 2001;81:206–208. [PubMed] [Google Scholar]
  • 20.Hoppe H.D.S., Kübler C., Raczkowsky J., Wörn H. A New, Accurate and Easy to Implement Camera and Video Projector Model. Stud. Health Technol. Inform. 2002;85:204–206. [PubMed] [Google Scholar]
  • 21.Siemionow K.B., Katchko K.M., Lewicki P., Luciano C.J. Augmented reality and artificial intelligence-assisted surgical navigation: Technique and cadaveric feasibility study. J. Craniovertebral Junction Spine. 2020;11:81–85. doi: 10.4103/jcvjs.JCVJS_48_20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Carl B., Bopp M., Saß B., Pojskic M., Voellger B., Nimsky C. Spine Surgery Supported by Augmented Reality. Glob. Spine J. 2020;10:41S–55S. doi: 10.1177/2192568219868217. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Liu A., Jin Y., Cottrill E., Khan M., Westbroek E., Ehresman J., Pennington Z., Lo S.-F.L., Sciubba D.M., Molina C.A., et al. Clinical accuracy and initial experience with augmented reality-assisted pedicle screw placement: The first 205 screws. J. Neurosurg. Spine. 2021;1:1–7. doi: 10.3171/2021.2.SPINE202097. [DOI] [PubMed] [Google Scholar]
  • 24.Molina C.A., Theodore N., Ahmed A.K., Westbroek E.M., Mirovsky Y., Harel R., Orru’ E., Khan M., Witham T., Sciubba D.M. Augmented reality–assisted pedicle screw insertion: A cadaveric proof-of-concept study. J. Neurosurg. Spine. 2019;31:139–146. doi: 10.3171/2018.12.SPINE181142. [DOI] [PubMed] [Google Scholar]
  • 25.Liebmann F., Roner S., Von Atzigen M., Scaramuzza D., Sutter R., Snedeker J., Farshad M., Fürnstahl P. Pedicle screw navigation using surface digitization on the Microsoft HoloLens. Int. J. Comput. Assist. Radiol. Surg. 2019;14:1157–1165. doi: 10.1007/s11548-019-01973-7. [DOI] [PubMed] [Google Scholar]
  • 26.Gibby J.T., Swenson S.A., Cvetko S., Rao R., Javan R. Head-mounted display augmented reality to guide pedicle screw placement utilizing computed tomography. Int. J. Comput. Assist. Radiol. Surg. 2018;14:525–535. doi: 10.1007/s11548-018-1814-7. [DOI] [PubMed] [Google Scholar]
  • 27.Müller F., Roner S., Liebmann F., Spirig J.M., Fürnstahl P., Farshad M. Augmented reality navigation for spinal pedicle screw instrumentation using intraoperative 3D imaging. Spine J. 2020;20:621–628. doi: 10.1016/j.spinee.2019.10.012. [DOI] [PubMed] [Google Scholar]
  • 28.Liu H., Wu J., Tang Y., Li H., Wang W., Li C., Zhou Y. Percutaneous placement of lumbar pedicle screws via intraoperative CT image-based augmented reality-guided technology. J. Neurosurg. Spine. 2020;32:542–547. doi: 10.3171/2019.10.SPINE19969. [DOI] [PubMed] [Google Scholar]
  • 29.Spirig J.M., Roner S., Liebmann F., Fürnstahl P., Farshad M. Augmented reality-navigated pedicle screw placement: A cadaveric pilot study. Eur. Spine J. 2021;30:3731–3737. doi: 10.1007/s00586-021-06950-w. [DOI] [PubMed] [Google Scholar]
  • 30.Yahanda A.T., Moore E., Ray W.Z., Pennicooke B., Jennings J.W., Molina C.A. First in-human report of the clinical accuracy of thoracolumbar percutaneous pedicle screw placement using augmented reality guidance. Neurosurg. Focus. 2021;51:E10. doi: 10.3171/2021.5.FOCUS21217. [DOI] [PubMed] [Google Scholar]
  • 31.Rau A., Roelz R., Urbach H., Coenen V.A., Demerath T., Reinacher P.C. Application of Augmented Reality in Percutaneous Procedures—Rhizotomy of the Gasserian Ganglion. Oper. Neurosurg. 2021;21:160–164. doi: 10.1093/ons/opab155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Yanni D.S., Ozgur B.M., Louis R.G., Shekhtman Y., Iyer R.R., Boddapati V., Iyer A., Patel P.D., Jani R., Cummock M., et al. Real-time navigation guidance with intraoperative CT imaging for pedicle screw placement using an augmented reality head-mounted display: A proof-of-concept study. Neurosurg. Focus. 2021;51:E11. doi: 10.3171/2021.5.FOCUS21209. [DOI] [PubMed] [Google Scholar]
  • 33.Gertzbein S.D., Robbins S.E. Accuracy of Pedicular Screw Placement In Vivo. Spine. 1990;15:11–14. doi: 10.1097/00007632-199001000-00004. [DOI] [PubMed] [Google Scholar]
  • 34.Elmi-Terander A., Nachabe R., Skulason H., Pedersen K., Söderman M., Racadio J., Babic D., Gerdhem P., Edström E. Feasibility and Accuracy of Thoracolumbar Minimally Invasive Pedicle Screw Placement with Augmented Reality Navigation Technology. Spine. 2018;43:1018–1023. doi: 10.1097/BRS.0000000000002502. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Burström G., Balicki M., Patriciu A., Kyne S., Popovic A., Holthuizen R., Homan R., Skulason H., Persson O., Edström E., et al. Feasibility and accuracy of a robotic guidance system for navigated spine surgery in a hybrid operating room: A cadaver study. Sci. Rep. 2020;10:7522. doi: 10.1038/s41598-020-64462-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Molina C.A., Phillips F.M., Colman M.W., Ray W.Z., Khan M., Orru’ E., Poelstra K., Khoo L. A cadaveric precision and accuracy analysis of augmented reality-mediated percutaneous pedicle implant insertion. J. Neurosurg. Spine. 2021;34:316–324. doi: 10.3171/2020.6.SPINE20370. [DOI] [PubMed] [Google Scholar]
  • 37.Léger É., Drouin S., Collins D.L., Popa T., Kersten-Oertel M. Quantifying attention shifts in augmented reality image-guided neurosurgery. Health Technol. Lett. 2017;4:188–192. doi: 10.1049/htl.2017.0062. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Silver D., Kaye A.D., Slakey D. Surgical Flow Disruptions, a Pilot Survey with Significant Clinical Outcome Implications. Curr. Pain Headache Rep. 2020;24:60. doi: 10.1007/s11916-020-00896-2. [DOI] [PubMed] [Google Scholar]
  • 39.Gillespie B., Chaboyer W., Fairweather N. Interruptions and Miscommunications in Surgery: An Observational Study. AORN J. 2012;95:576–590. doi: 10.1016/j.aorn.2012.02.012. [DOI] [PubMed] [Google Scholar]
  • 40.Park D.K., Thomas A.O., Clair S.S., Bawa M. Percutaneous Lumbar and Thoracic Pedicle Screws. J. Spinal Disord. Tech. 2014;27:154–161. doi: 10.1097/BSD.0b013e318250ec75. [DOI] [PubMed] [Google Scholar]
  • 41.Zhang L., Zhou X., Cai X., Zhang H., Fu Q., He S. Reduction in radiation during percutaneous lumbar pedicle screw placement using a new device. Minim. Invasive Ther. Allied Technol. 2013;23:173–178. doi: 10.3109/13645706.2013.870914. [DOI] [PubMed] [Google Scholar]
  • 42.Ohba T., Ebata S., Fujita K., Sato H., Haro H. Percutaneous pedicle screw placements: Accuracy and rates of cranial facet joint violation using conventional fluoroscopy compared with intraoperative three-dimensional computed tomography computer navigation. Eur. Spine J. 2016;25:1775–1780. doi: 10.1007/s00586-016-4489-1. [DOI] [PubMed] [Google Scholar]
  • 43.Yu E., Khan S.N. Does Less Invasive Spine Surgery Result in Increased Radiation Exposure? A Systematic Review. Clin. Orthop. Relat. Res. 2014;472:1738–1748. doi: 10.1007/s11999-014-3503-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Cewe P., Vorbau R., Omar A., Elmi-Terander A., Edström E. Radiation distribution in a hybrid operating room, utilizing different X-ray imaging systems: Investigations to minimize occupational exposure. J. NeuroInterv. Surg. 2021 doi: 10.1136/neurintsurg-2021-018220. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Burström G., Nachabe R., Homan R., Hoppenbrouwers J., Holthuizen R., Persson O., Edström E., Elmi-Terander A. Frameless Patient Tracking with Adhesive Optical Skin Markers for Augmented Reality Surgical Navigation in Spine Surgery. Spine. 2020;45 doi: 10.1097/BRS.0000000000003628. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Data Availability Statement

Data is available from the corresponding author upon reasonable request.


Articles from Sensors (Basel, Switzerland) are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES