Overlaid planned trajectory (yellow line) and the estimated tool's orientation (purple line)
a Mixed reality scene, which overlays the reconstructed surface, DRR, and live point clouds
b Planned trajectory in yellow added on top of (a). User can then use the live point cloud feedback for 3D localisation
c Integrated the tracked surgical tool and extended orientation line in purple onto (a). With the planned trajectory, the user can now intuitively align the extended orientation with the planned trajectory as illustrated in (d)