Abstract
Visual guidance at the cellular level during neurosurgical procedures is essential for complete tumour resection. We present a compact reflectance confocal microscope with a 20 mm working distance that provided <1.2 µm spatial resolution over a 600 µm × 600 µm field of view in the near-infrared region. A physical footprint of 200 mm × 550 mm was achieved using only standard off-the-shelf components. Theoretical performance of the optical design was first evaluated via commercial Zemax software. Then three specimens from rodents: fixed brain, frozen calvaria and live hippocampal slices, were used to experimentally assess system capability and robustness. Results show great potential for the proposed system to be translated into use as a next generation label-free and contactless neurosurgical microscope.
1. Introduction
The primary aim in the treatment of brain cancer is maximal tumour resection with minimal damage to adjacent brain tissue. Numerous technologies have been developed to provide real-time intraoperative guidance in order to achieve this goal. In particular, specialised optical microscopes have shown to provide valuable morphological information during surgery [1–3]. However, most of these systems were not optimised to enable visualisation of individual cells. Low numerical aperture (NA) was used, normally below 0.07, to offer a working distance (WD) over 200 mm [4], and thus allow space for surgical manipulations.
To overcome the limitation in spatial resolution, endoscopic probes have emerged and proven effective in delineating the tumour margin with higher spatial precision [5–8]. In addition to improving the discrimination between diseased and normal cells, endoscopic probes are more compact than most specialised surgical microscopes, making them convenient for deployment in operating rooms. However, some practical complications have also been encountered during their use in clinical applications [2,5]. One major drawback is that endoscopic devices require direct contact with tissue. They are therefore susceptible to erythrocyte contamination, and frequent cleaning of the probe tip is unavoidable [5]. Another caveat originates from the difficulty to stabilise and apply uniform pressure on the probe when held by hand [2].
In sum, it would be ideal to combine the highly desirable features of both endoscopes and specialised surgical microscopes into a single, compact system such that cellular level resolution can be achieved while eliminating the need for direct contact between instrument and tissue. This configuration would further allow for manipulation of surgical tools below the microscope objective using both hands as in conventional surgical microscopes.
Apart from system configuration, the employed contrast mechanism also affects the feasibility of adopting an imaging method for intraoperative use. Fluorescence guided surgery, as one of the most commonly exploited techniques, has provided useful information on the cellular and molecular scale for brain tumour resection [2,9–11]. However, the use of fluorescent dyes in the human brain is limited by many factors, such as tumour selectivity, fluorophore uptake due to the blood-brain-barrier, fluorophore brightness and toxicity, photobleaching, injection timings, dose constraints [12–14]. Consequently, only three markers have been approved for neurosurgical procedures in humans [13]. Therefore, novel label-free intraoperative devices are in high demand.
Reflectance confocal microscopy (RCM) has for long been of special clinical interest due to its favourable optical sectioning abilities and label-free nature [15–18]. The implementation of a pinhole in both the illumination and detection paths helps to eliminate out-of-focus light adjacent to the focal plane. Without being constrained by the excitation spectrum of a specific fluorophore, the choice of illumination wavelength is primarily dependent on optical properties of the tissue itself, with additional considerations for spatial resolution. Furthermore, compared to fluorescence microscopy, the signal level for RCM is usually much higher for a given incident power. Less light is required at the tissue, reducing potential possibilities of photodamage; while stringent requirements imposed on the detection sensitivity of fluorescence imaging can be loosened as well [11]. Most importantly, owing to a contrast mechanism based on differential refractive indices, RCM has recently been found to provide information on cellularity, architecture, and morphological features simultaneously for tumour discrimination in ex vivo studies [18], showing great potential for surgical translation.
Another label-free technique based on interference, optical coherence tomography (OCT), has been applied to brain imaging and allowed in vitro and in vivo visualisation of individual myelinated fibres [19,20] and myelinated fibre bundles [21] in the rodent nervous system, as well as in vivo and ex vivo volumetric imaging of the cytoarchitecture and myeloarchitecture [22,23] within rodent brain. In particular, full-field OCT, a high resolution and large field of view (FOV) variation, has differentiated features in normal and tumorous human brain tissue with 1 µm resolution using a 0.3 NA water immersion objective, which is comparable to RCM in the lateral direction, and higher in the axial direction as determined by the coherence length of the broadband light source [24]. However, depth penetration of this technique is highly sensitive to the refractive index mismatch between the immersion medium and tissue, which is limited to 120 µm in fixed brain with a 0.8 NA water immersion objective if without real-time defocus compensation [19]. The performance with an air immersion objective for live brain OCT, however, is yet to be explored.
In this paper, we present a novel compact reflectance confocal microscope with a 20 mm WD that operates in the near-infrared and provides <1.2 µm spatial resolution over a 600 µm × 600 µm FOV. We first introduce our design concepts before presenting the microscope setup in detail. Then, the performance of the optical design is evaluated using commercial Zemax software. System capability and robustness is systematically assessed in three biological specimens. First, 60-µm thick fixed mouse brain is used to validate spatial resolution and imaging fidelity in biological tissue. Optical sectioning abilities are then demonstrated through axial-stack imaging and three-dimensional (3D) reconstruction of frozen mouse calvaria. Live tissue imaging capability is verified through maximum intensity projections of 100-µm deep axial-stacks in the rat organotypic hippocampus. Finally, novelties as well as space for future development of the system is discussed in view of the practical needs for next generation neurosurgical microscopes.
2. Materials and methods
2.1. Design concept
The design of our confocal reflectance microscope aims to overcome limitations of currently available neurosurgical systems, while considering the ease of translation from bench-top to clinic. First, a system WD sufficient for preventing direct contact with tissue and permitting insertion of surgical tools was a main priority. Another major goal was to provide a spatial resolution of 1 µm across the whole FOV such that cellular level examination could be accomplished. Furthermore, system compactness was given special consideration to enable easy manoeuvring of the microscope in the operating theatre. Finally, to make this system affordable and reproducible, off-the-shelf rather than custom-designed lenses were used.
2.2. System setup
The main microscope design is illustrated in Fig. 1(a). For reduced scattering and minimal blood absorption, a near-infrared (NIR) wavelength of 830 nm was chosen [25,26]. A low coherence superluminescent diode (SLD, SLD830S-A20, Thorlabs) was used to suppress speckle noise without increasing pinhole size [27]. Light was coupled into the system via a single mode fibre and power after the objective was set to 5 mW for all experiments. To minimise detection of backscattered light from components along the optical path, a quarter-wave plate (QWP) was implemented in combination with a linear polariser (LP) and a polarising beam-splitter (PBS). The LP generated horizontally-polarised illumination light, which transmitted through the PBS, before passing the QWP whose fast-axis was oriented relative to the polarisation direction. The PBS then reflected vertically-polarised signal light into the detection path while any spurious horizontally-polarised light would be eliminated. A compact gimbal-less dual-axis MEMS scan mirror (S31155, Mirrorcle Technologies) with a clear aperture of 2 mm was integrated for system miniaturisation, providing a maximum mechanical scan angle (MSA) of in both the horizontal and vertical directions. The mirror was conjugated using four lenses (L1, 30120, effective focal length (EFL) = 25.4 mm, Edmund Optics; L2, 49363, EFL = 175 mm, Edmund Optics; L3, 49361, EFL = 125 mm, Edmund Optics; L4, 49360, EFL = 100 mm, Edmund Optics) to the back aperture of a 20× magnification, 0.42 NA, 20 mm WD, air immersion plan-apochromat objective (LWDO, MY20X-804, Mitutoyo). In the detection path, backscattered signal light was coupled into an adjustable aspheric fibre collimator (FC2, CFC-11X-B, Thorlabs) with a focal length of 10 mm. A single mode fibre with a core size of 5 µm, equivalent to 0.7 Airy unit (AU), was used as a confocal pinhole to couple signal light into a silicon avalanche photodetector (APD, APD430A/M, Thorlabs). Components within the main microscope body were separately mounted on a 200 mm × 250 mm breadboard (MB2025/M, Thorlabs) and further enclosed in a protective casing. L4 and the QWP were mounted into lens tubes that extended from the microscope body and could be easily unscrewed for portable transit. A fibre-in fibre-out (FIFO) configuration was implemented for miniaturisation. The system footprint was kept to 200 mm × 550 mm and the physical layout of the system with a magnified view indicating the insertion of a scalpel between the microscope and sample is depicted in Fig. 1(b).
Scanning control and image acquisition were performed using custom-developed Python software via a standard laptop (XPS 15 7590, Dell) and FPGA (USB-7855R, National Instruments). Analog triangle wave scan signals were sent to the MEMS mirror controller and the analog detection signal from the APD was used for image construction. Distortion due to the non-linear velocity of the scan mirror was corrected using a pre-calibrated look-up table. Images were displayed on a custom GUI interface and later processed using ImageJ software.
2.3. Zemax evaluation of system aberrations
A compact optical system exclusively using commercial lenses is prone to aberrations, especially when large scan angles are required such that oblique beams enter short focal length lenses at peripheral positions. In order to determine a lens combination that causes minimal accumulation of system-induced aberrations, we modelled and evaluated the design using commercial Zemax software 18.9. As the objective lens model was not available, it was considered as an ideal lens, and imaging performance was analysed at the objective back focal plane in afocal mode.
Ideally, diffraction-limited performance (DLP) is highly desirable in microscopic systems. However, depending on the application, this is not always necessary. For our purpose, cellular level resolution is easily achievable within a 1 µm regime. Substantial beam expansions were also required to fill the objective back aperture. Therefore, rather than aiming for DLP that was likely to be achieved within only a narrow region about the optical axis, we slightly relaxed the criterion to obtain more uniform image quality across the whole FOV. A Strehl ratio of was sustained for an equivalent FOV of approximately 600 µm × 600 µm. Assuming a linear relationship between MSA and FOV using small angle approximation, system performance was evaluated at a series of MSAs across the full scan range with increments equivalent to 100 µm at the sample. The Strehl ratio, diffraction encircled energy, and Huygens point spread function (PSF) were individually assessed.
2.3.1. Strehl ratio
The Strehl ratio (SR) is commonly used as a performance criterion for high resolution imaging systems. The theoretical SR variations with different MSAs across both the x- and y-directions are shown in Fig. 2(a), where the x- and y-axis are horizontal and vertical to the base plate, respectively. The Maréchal criterion of SR = 0.8 is used as reference for DLP. It can be seen that at all scan angles along both the x- and y-axis, the SR is kept well within . A symmetrical variation can be noticed across the FOV in both scan directions, most likely to have originated from the balancing of field flatness distortion at different lateral positions when optimising for the highest uniform SR. Comparison between the x-scan and y-scan curves indicate similar degrees of system-induced aberration such that the same SR is achieved for a certain scan angle.
2.3.2. Diffraction encircled energy
Variations in the illumination PSF’s size and energy distribution is examined by plotting the diffraction encircled energy diagram, as demonstrated in Fig. 2(b). Each curve refers to the gain of cumulative energy with radius for a different MSA, and that for DLP is highlighted in black as reference. Only results for negative scan angles are plotted due to the symmetry witnessed in Fig. 2(a). It can be found that all scan angles follow a similar steep accumulation trend of energy comparable to that of DLP. To assess the degree of deterioration in PSF size brought by relaxation of the SR, we calculate the PSF’s full width at half maximum (FWHM) at different MSAs by first taking the width of the PSF, within which of total beam power is contained, and further considering a conversion factor of . The radius values in milliradians at which the diffraction encircled energy curves reach of the total energy for DLP and all other MSAs are highlighted in the magnified plot of Fig. 2(b). Considering a focal length of mm for L4, and a demagnification introduced by the objective lens, as well as assuming a similar intensity PSF (IPSF) for both the illumination and detection paths in a confocal system, the effective system IPSF width and FWHM are calculated and given in Table 1.
Table 1. Theoretical width and FWHM of effective IPSF for DLP and different MSAs in the proposed confocal system.
DLP | ||||||||
---|---|---|---|---|---|---|---|---|
width (µm) | 1.16 | 1.32 | 1.30 | 1.25 | 1.20 | 1.17 | 1.22 | 1.33 |
FWHM (µm) | 0.68 | 0.77 | 0.76 | 0.74 | 0.71 | 0.69 | 0.72 | 0.78 |
Results show that despite system optimisation resulting in an SR of 0.7, the illumination IPSF FWHM across the whole 600 µm 600 µm FOV is successfully kept within a 1 µm regime, and the largest deviation relative to DLP is 250 nm, a negligible amount for cellular level imaging.
2.3.3. Huygens PSF
Finally, to understand the main aberration components in the system, the Huygens PSF, which is the diffraction-limited PSF using direct integration of the Huygens wavelets method, was assessed for half of the FOV along both x- and y-scan directions. It can be observed in Fig. 2(c) that for both cases, the shape of the PSF starts to deviate from an ideal circular spot for larger angles between and and becomes elongated in one direction, showing moderate astigmatism. Defocus and spherical aberrations are the main on-axis aberration components, as can be seen from the annular structures surrounding the bright central region. However, no significant variations in PSF profile are noticed in either directions, indicating a reasonably uniform image quality for the entire 600 µm 600 µm FOV.
2.4. Reflectance imaging
Spatial resolution was calibrated using a stage micrometer with 1 µm line width (AGL4202, Agar Scientific) placed at the central FOV. Profile plot of the line showed a FWHM of 1.10 µm. Effective image intensity in a reflectance confocal microscope is given by , where and denote the illumination and detection amplitude PSFs (APSF) and represents the object reflectance profile [28]. For simplicity, we use a Gaussian approximation for , and , and assume similar distribution of the illumination and detection APSF such that . Further considering the relation of between effective system IPSF and single path APSF in a confocal system, the FWHM of was calculated to be 0.84 µm. We compare this experimentally derived effective IPSF with the result in Table 1 for FWHM at MSA. It can be seen that the built confocal system provided an effective IPSF consistent with that of the theoretical system, only larger in size. Additionally, a spatial resolution of <1.2 µm could be resolved in the reflectance images.
During experiments, a manual translation stage (PT3A/M, Thorlabs) was used for 3D translation of specimens. Imaging took place with the microscope mounted both horizontally and vertically on a mechanical arm. No visible difference in image quality was noticed, indicating the microscope’s ability to perform reliably in all orientations. In the results below, the pixel spacing was decreased to 1.17 µm to image a 600 µm × 600 µm FOV with 512 × 512 pixels. In this case, the resolution, limited by the spatial sampling, was uniform across the FOV. A <1.2 µm optical resolution was obtained when scanning over a smaller FOV with a smaller pixel pitch.
2.5. Sample preparation
System capability and robustness were systematically validated using three biological specimens: 1) 60-µm thick fixed brain slice from a Thy1-GFP mouse; 2) excised mouse calvaria; 3) 350-µm thick organotypic hippocampal slice from a male Wistar rat. All animal work was carried out in accordance with the Animals (Scientific Procedures) Act, 1986 (UK).
Thy1-GFP mice were overdosed with pentobarbital before transcardial perfusion with phosphate buffered saline and 4 paraformaldehyde (PFA). Subsequently, the fixed brain was extracted and immersed in PFA for 24 hours. Finally, the fixed brain was cut into 60-µm thick coronal slices and mounted between a microscope slide and a 170-µm coverslip for imaging.
Calvaria was extracted from frozen mouse cadavers using scissors. The left portion of the calvarial bone between the frontal and coronal suture was then cut and glued onto a microscope slide for imaging. Imaging was performed in air.
Organotypic hippocampal slices (350-µm) were prepared from male Wistar rats (P7) and cultured on Millicell CM membranes (Millipore). Slices were maintained in culture media (Life Technologies/Sigma Aldrich), at C for 7-14 days prior to use. Culture media was replaced every 2-3 days. Cultured slices were transferred to a petri dish, fixed with vacuum grease and kept in physiological Tyrode’s solution for imaging (in mM: 120 NaCl, 2.5 KCl, 30 glucose, 2 , 1 , and 20 HEPES; Sigma Aldrich; pH = 7.2-7.4; n = 1.33).
3. Experimental results
3.1. Ex vivo imaging of fixed mouse brain
Taking advantage of the well-known anatomy and morphology of the mouse brain, fixed slices were imaged to characterise system spatial resolution and imaging fidelity in biological tissue.
The longitudinal fissure, separating the left and right hemispheres, was located at the top-most border of the cerebral cortex (Fig. 3(a)). Figure 3(b) shows prominent dark neurons within the upper cortical region. Adjacent regions above and below featured much sparser distributions of scattered cells. The corpus callosum (CC) was recognised as a clearly discernable fibre tract in the lower cortical region (Fig. 3(c)), separating the outer cortex from the hippocampus. Just before reaching the CC, sparsely distributed neurons of varying sizes were witnessed. Figure 3(d) shows the CA1 field of the hippocampus. As expected, a neatly defined hypo-reflective cell body layer (CBL) was formed by CA1 pyramidal cells; while adjacent neuronal processes (NPs) were distinguished as distinct dark grooves projecting from the CA1 neurons in a parallel configuration, as well as regions with high reflective signal.
The results above suggested high spatial resolution and imaging fidelity of the microscope within biological tissue. The 170-µm coverslip is liable to introduce spherical aberration when used with an air immersion objective without coverslip correction. Although this effect is more detrimental with high NA objectives, especially in the presence of sample tilt [29], slight blurring effects are still likely to be present during imaging. Also, we notice a slight pixel shift between consecutive lines which may have been a residual artefact from the MEMS scanning after distortion compensation. Nevertheless, we have demonstrated that the proposed system utilising RCM, has the potential of imaging morphological features of the mouse cortex and hippocampus without any form of labelling [30,31].
3.2. Ex vivo imaging of frozen mouse calvaria
The mouse calvaria is known to be highly scattering, and its significant surface curvature causes further deterioration of the light field for optical microscopy [32]. Here we show that our RCM system maintained sufficient optical sectioning, even when severe optical distortions were present, to achieve 3D imaging at the cellular level. Two different locations were imaged: the first where the bone surface was approximately normal to the optical axis, and the second where it was tilted by several degrees. Distinct features in hard bone and bone marrow demonstrated the axial sectioning ability when volumetric data was acquired with 5-µm axial steps (Fig. 4).
At the first location, the hard bone matrix covered the entirety of the FOV (Fig. 4(a)). A magnified view of osteocytes is given in the inset, visualised by negative contrast with the strongly reflective collagen bone matrix [33]. The transition between hard bone and bone marrow was clearly discernable as a sharp and curved interface (Fig. 4(b); dotted line), confirming the microscope’s optical sectioning ability, and suggesting an axial resolution of about 5 µm within highly scattering biological tissue, which is in the region of the theoretical axial resolution of 6.5 µm. The bone marrow cavity appeared to be less reflective than hard bone, likely as a consequence of the freezing process (Fig. 4(c)), while scattered bright cells were nonetheless clearly identifiable. Nine 5-µm thick stack images were taken before reaching the transition zone, indicating a hard bone thickness of approximately 45 µm.
At the second location, nine consecutive axial-stack images were taken (Fig. 4(d-l)) and due to surface tilt, only a distinct cross-section of the hard bone matrix was visible within the focal plane at each incrementing depth, showing a diagonal progression pattern from the top left corner to bottom right. After performing 3D reconstruction of the consecutive stack images, the surface of the hard bone matrix could be visualised (Fig. 4(m)), showing smooth transition and featuring the same osteocyte pattern indicated within boxes in Fig. 4(d-f). Note how the osteocytes gradually come into focus from Fig. 4(d) to Fig. 4(f).
The above results provided validation of the microscope penetration through optically dense and highly scattering media, as well as its optical sectioning capability across the whole FOV.
3.3. Live tissue imaging of the rat hippocampus
In the final experiment, to verify the live tissue imaging capability of the microscope, we chose a 350-µm thick organotypic hippocampal slice and left a thick layer of Tyrode’s solution between air and tissue to mimic an aqueous physiological interface.
Figure 5(a) illustrates the rat hippocampus highlighting three biologically significant regions, namely the dentate gyrus (DG), CA3 field, and CA1 field. A 100-µm deep axial-stack with 5-µm intervals was taken for each region and a maximum intensity projection (MIP) was performed to build the 100-µm thick volume. Demonstration of the maximum projected hippocampal slice is given with rotational views at , , and relative to the normal projection (Figs. 5(b) - (d)). An image from a single location 100 µm deep in the sample is also shown.
We started at the DG (Fig. 5(b)) which is acutely bent in shape. A dark granular cell layer was visible in the central region of interest. Adjacent regions of NPs showed high reflectivity and dense fibrillarity, forming strong contrast against the neuronal cell bodies. MIP of the CA3 field revealed a narrower layer of NPs towards the edge of the hippocampus, surrounding a region of dark pyramidal cells (Fig. 5(c)). Visible reflective signal contrast was also seen between the cell bodies and NPs in the CA1 field, though lower than its CA3 counterpart (Fig. 5(d)).
Successful imaging of the live hippocampus up to 100 µm in depth validated the capability of the proposed microscope for live tissue imaging before translation to pre-clinical experiments. It should be mentioned that although RCM has been previously reported for live tissue and in vivo imaging of the mouse brain [34,35], as well as imaging of the fresh human cadaver [36], rather than using a high NA objective lens for deep brain imaging, we have adopted a low NA (0.42) air immersion objective. In addition, compared with results obtained in Section 3.1, it can be found that due to the fixation method for ex vivo imaging, as well as a loss of aqueous tissue contents, different characteristics were observed between fixed and live brain tissue. This took the form of a highly reflective background with individual dark cells seen in the fixed brain slice, as opposed to the dark background, bright fibrous filaments, and dark band of cells in the live hippocampus.
4. Discussion
Many factors influence the effectiveness of a device for image-guided brain surgery, which can be briefly split into two categories. The first incorporates intrinsic functionality features of the instrument, such as resolution, field of view (FOV), imaging depth, frame rate, contrast mechanism, etc. The second, however, is equally important but much easier to neglect, which is the fact that instrumentation should be designed in such a way that its full functional advantage could be exerted with minimum effort in real life scenarios.
The reflectance confocal microscope presented in this work fills a substantial gap in surgical practice. Specifically, key features of conventional surgical microscopes and endoscopic probes were combined such that cellular level resolution was achieved, while enough space was left between device and tissue to prevent direct contact and frequent probe cleaning, as well as allow for insertion of surgical tools. A minimal number of off-the-shelf components was used with considerations for compactness, affordability and reproducibility. Sufficient resolution was provided both laterally and axially to discern fibrillar structures as well as delineate the border of tissue layers, and imaging was achieved at least 100 µm within live tissue, suggesting the system’s competence for clinical translation. Comparison between images of fixed and live brain tissue revealed instructive information on how variations in cell and tissue morphology could possibly change the refractive index to give different textures under the proposed microscope. This has interesting clinical implications and agrees with findings described in [15,17,18].
In addition, the concept entails some practical advantages. A combination of NIR illumination with fibre-based detection reduces the system’s susceptibility to room light interference, which is normally in the visible light spectrum [37], implying that surgical procedures could be performed under normal lighting conditions [11]. Longer wavelengths would further decrease interference of ambient light as well as increase the imaging depth [25,35,38], but at the expense of a reduced spatial resolution. In addition, benefiting from a label-free and contactless concept, imaging requires no additional labelling of the tissue or excessive sterilization processes of endoscopic probes, enabling simplification of pre-surgical procedures.
Further system development should mainly address the following aspects: imaging speed and depth. First of all, the current frame rate is limited by the analog sampling rate to 1 Hz. The implementation of a scanning module with position feedback would enable operation in resonant mode and thus substantially increase the frame rate to around 6 Hz [39]. To achieve this, a high-speed digitiser could be used to increase capture speed, through which images of higher diagnostic quality could be displayed with pixel resolutions higher than 512 × 512. In the current system, for the maximum imaging FOV of 600 µm × 600 µm, resolution is limited by pixel count rather than optical restrictions. A faster scan mirror could further enhance imaging speed, but current integrated MEMS technology would require using mirrors with smaller clear apertures, thus needing larger beam expansions, ultimately introducing stronger system aberrations.
Second, the implementation of a wavefront shaping device, such as a deformable mirror (DM), would be extremely beneficial for performing simultaneous adaptive optics (AO) and remote focusing [40,41]. Correction of both sample- and system-induced aberrations would allow a tighter focal spot to arrive at the specimen and more signal to be delivered through the detection pinhole so as to improve signal-to-noise ratio and permit deeper imaging into the highly heterogeneous brain tissue [42,43]. The combination of a deeper imaging depth and a more accurate refocusing unit together with the optical sectioning abilities of the confocal microscope would be especially useful for finding the three-dimensional tumour margin.
Some variations of OCT, such as spectral/Fourier domain optical coherence microscopy, can potentially provide a deeper tissue penetration depth of over 1 mm [20,22,23]. However, system complexity is higher, and a high NA water immersion objective is required to obtain a comparable lateral resolution of 1 µm. In addition, the corresponding FOV of a single image is approximately 620 µm [21,22], which is similar to the proposed system, though mosaic imaging can be implemented for expansion of the FOV [21]. The use of mosaic imaging would be a promising direction to explore for this application as well.
5. Conclusion
We have developed a compact microscope using off-the-shelf components for guidance during neurosurgery. The system achieved a spatial resolution of <1.2 µm while leaving a 20 mm working distance between the device and tissue to prevent direct contact and enable easy manipulation of surgical tools. Taking advantage of reflectance confocal microscopy, the proposed system is label-free and possesses three-dimensional imaging capabilities. The potential for pre-clinical translation is experimentally validated in distinct biological specimens: fixed mouse brain, frozen mouse calvaria, and organotypic hippocampal slice. This study provides initial ground for future development towards next generation neurosurgical microscopes while also leaving space for prospects in other areas of surgical imaging.
Acknowledgments
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
Funding
European Research Council10.13039/501100000781 (695140, 812998).
Disclosures
The authors declare no conflicts of interest.
References
- 1.Cha J., Broch A., Mudge S., Kim K., Namgoong J.-M., Oh E., Kim P., “Real-time, label-free, intraoperative visualization of peripheral nerves and micro-vasculatures using multimodal optical imaging techniques,” Biomed. Opt. Express 9(3), 1097–1110 (2018). 10.1364/BOE.9.001097 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Charalampaki P., Nakamura M., Athanasopoulos D., Heimann A., “Confocal-assisted multispectral fluorescent microscopy for brain tumor surgery,” Front. Oncol. 9, 583 (2019). 10.3389/fonc.2019.00583 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Alfonso-Garcia A., Bec J., Weaver S. S., Hartl B., Unger J., Bobinski M., Lechpammer M., Girgis F., Boggan J., Marcu L., “Real-time augmented reality for delineation of surgical margins during neurosurgery using autofluorescence lifetime contrast,” J. Biophotonics 13(1), 108 (2020). 10.1002/jbio.201900108 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Reichert D., Erkkilä M. T., Holst G., Hecker-Denschlag N., Wilzbach M., Hauger C., Drexler W., Gesperger J., Kiesel B., Roetzer T., Unterhuber A., Widhalm G., Leitgeb R. A., Andreana M., “Towards real-time wide-field fluorescence lifetime imaging of 5-ALA labeled brain tumors with multi-tap CMOS cameras,” Biomed. Opt. Express 11(3), 1598–1616 (2020). 10.1364/BOE.382817 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Sankar T., Delaney P. M., Ryan R. W., Eschbacher J., Abdelwahab M., Nakaji P., Coons S. W., Scheck A. C., Smith K. A., Spetzler R. F., Preul M. C., “Miniaturized handheld confocal microscopy for neurosurgery results in an experimental glioblastoma model,” Neurosurg. 66(2), 410–418 (2010). 10.1227/01.NEU.0000365772.66324.6F [DOI] [PubMed] [Google Scholar]
- 6.Martirosyan N. L., Eschbacher J. M., Kalani M. Y. S., Turner J. D., Belykh E., Spetzler R. F., Nakaji P., Preul M. C., “Prospective evaluation of the utility of intraoperative confocal laser endomicroscopy in patients with brain neoplasms using fluorescein sodium: experience with 74 cases,” Neurosurg. Focus. 40(3), E11 (2016). 10.3171/2016.1.FOCUS15559 [DOI] [PubMed] [Google Scholar]
- 7.Belykh E., Patel A. A., Miller E. J., Bozkurt B., Yaǧmurlu K., Woolf E. C., Scheck A. C., Eschbacher J. M., Nakaji P., Preul M. C., “Probe-based three-dimensional confocal laser endomicroscopy of brain tumors: technical note,” Cancer Manage. Res. 10, 3109–3123 (2018). 10.2147/CMAR.S165980 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Lakomkin N., Hadjipanayis C. G., “The use of spectroscopy handheld tools in brain tumor surgery: Current evidence and techniques,” Front. Surg. 6, 30 (2019). 10.3389/fsurg.2019.00030 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Stummer W., Pichlmeier U., Meinel T., Wiestler O. D., Zanella F., Reulen H.-J., “Fluorescence-guided surgery with 5-aminolevulinic acid for resection of malignant glioma: a randomised controlled multicentre phase III trial,” The Lancet Oncol. 7(5), 392–401 (2006). 10.1016/S1470-2045(06)70665-9 [DOI] [PubMed] [Google Scholar]
- 10.Erkmen K., Bekelis K., Simmons N. E., Valdes P. A., Roberts D. W., Paulsen K. D., Leblond F., Harris B. T., Kim A., Wilson B. C., “5-aminolevulinic acid-induced protoporphyrin IX fluorescence in meningioma: Qualitative and quantitative measurements in vivo,” Oper. Neurosurg. 10(1), 74–83 (2014). 10.1227/NEU.0000000000000117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Stepp H., Stummer W., “5-ALA in the management of malignant glioma,” Lasers Surg. Med. 50(5), 399–419 (2018). 10.1002/lsm.22933 [DOI] [PubMed] [Google Scholar]
- 12.Tonn J.-C., Stummer W., “Fluorescence-guided resection of malignant gliomas using 5-aminolevulinic acid: practical use, risks, and pitfalls,” Clin. Neurosurg. 55, 20–26 (2008). [PubMed] [Google Scholar]
- 13.Belykh E., Martirosyan N. L., Yagmurlu K., Miller E. J., Eschbacher J. M., Izadyyazdanabadi M., Bardonova L. A., Byvaltsev V. A., Nakaji P., Preul M. C., “Intraoperative fluorescence imaging for personalized brain tumor resection: Current state and future directions,” Front. Surg. 3, 55 (2016). 10.3389/fsurg.2016.00055 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Zhang D. Y., Singhal S., Lee J. Y. K., “Optical principles of fluorescence-guided brain tumor surgery: A practical primer for the neurosurgeon,” Neurosurg. 85(3), 312–324 (2019). 10.1093/neuros/nyy315 [DOI] [PubMed] [Google Scholar]
- 15.Snuderl M., Wirth D., Sheth S. A., Bourne S. K., Kwon C.-S., Ancukiewicz M., Curry W. T., Frosch M. P., Yaroslavsky A. N., “Dye-enhanced multimodal confocal imaging as a novel approach to intraoperative diagnosis of brain tumors,” Brain Pathol. 23(1), 73–81 (2013). 10.1111/j.1750-3639.2012.00626.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Schain A. J., Hill R. A., Grutzendler J., “Label-free in vivo imaging of myelinated axons in health and disease with spectral confocal reflectance microscopy,” Nat. Med. 20(4), 443–449 (2014). 10.1038/nm.3495 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Forest F., Cinotti E., Yvorel V., Habougit C., Vassal F., Nuti C., Perrot J.-L., Labeille B., Péoc’h M., “Ex vivo confocal microscopy imaging to identify tumor tissue on freshly removed brain sample,” J. Neuro-Oncol. 124(2), 157–164 (2015). 10.1007/s11060-015-1832-z [DOI] [PubMed] [Google Scholar]
- 18.Eschbacher J. M., Georges J. F., Belykh E., Yazdanabadi M. I., Martirosyan N. L., Szeto E., Seiler C. Y., Mooney M. A., Daniels J. K., Goehring K. Y., Van Keuren-Jensen K. R., Preul M. C., Coons S. W., Mehta S., Nakaji P., “Immediate label-free ex vivo evaluation of human brain tumor biopsies with confocal reflectance microscopy,” J. Neuropathol. & Exp. Neurol. 76(12), 1008–1022 (2017). 10.1093/jnen/nlx089 [DOI] [PubMed] [Google Scholar]
- 19.Ben Arous J., Binding J., Leger J.-F., Casado M., Topilko P., Bourdieu L., Gigan S., Boccara A. C., “Single myelin fiber imaging in living rodents without labeling by deep optical coherence microscopy,” J. Biomed. Opt. 16(11), 116012 (2011). 10.1117/1.3650770 [DOI] [PubMed] [Google Scholar]
- 20.Merkle C. W., Chong S. P., Kho A. M., Zhu J., Dubra A., Srinivasan V. J., “Visible light optical coherence microscopy of the brain with isotropic femtoliter resolution in vivo,” Opt. Lett. 43(2), 198–201 (2018). 10.1364/OL.43.000198 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Min E., Lee J., Vavilin A., Jung S., Shin S., Kim J., Jung W., “Wide-field optical coherence microscopy of the mouse brain slice,” Opt. Lett. 40(19), 4420–4423 (2015). 10.1364/OL.40.004420 [DOI] [PubMed] [Google Scholar]
- 22.Srinivasan V. J., Radhakrishnan H., Jiang J. Y., Barry S., Cable A. E., “Optical coherence microscopy for deep tissue imaging of the cerebral cortex with intrinsic contrast,” Opt. Express 20(3), 2220–2239 (2012). 10.1364/OE.20.002220 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Leahy C., Radhakrishnan H., Srinivasan V. J., “Volumetric imaging and quantification of cytoarchitecture and myeloarchitecture with intrinsic scattering contrast,” Biomed. Opt. Express 4(10), 1978–1990 (2013). 10.1364/BOE.4.001978 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Assayag O., Grieve K., Devaux B., Harms F., Pallud J., Chretien F., Boccara C., Varlet P., “Imaging of non-tumorous and tumorous human brain tissues with full-field optical coherence tomography,” NeuroImage: Clin. 2, 549–557 (2013). 10.1016/j.nicl.2013.04.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Steven L. J., “Optical properties of biological tissues: a review,” Phys. Med. Biol. 58(11), R37–R61 (2013). 10.1088/0031-9155/58/11/R37 [DOI] [PubMed] [Google Scholar]
- 26.Vahrmeijer A. L., Hutteman M., van der Vorst J. R., van de Velde C. J. H., Frangioni J. V., “Image-guided cancer surgery using near-infrared fluorescence,” Nat. Rev. Clin. Oncol. 10(9), 507–518 (2013). 10.1038/nrclinonc.2013.123 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Glazowski C., Rajadhyaksha M., “Optimal detection pinhole for lowering speckle noise while maintaining adequate optical sectioning in confocal reflectance microscopes,” J. Biomed. Opt. 17(8), 085001 (2012). 10.1117/1.JBO.17.8.085001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Gu M., Principles of Three-dimensional Imaging in Confocal Microscopes (World Scientific, 1996). [Google Scholar]
- 29.Turcotte R., Liang Y., Ji N., “Adaptive optical versus spherical aberration corrections for in vivo brain imaging,” Biomed. Opt. Express 8(8), 3891–3902 (2017). 10.1364/BOE.8.003891 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Grosche A., Grosche J., Tackenberg M., Scheller D., Gerstner G., Gumprecht A., Pannicke T., Hirrlinger P. G., Wilhelmsson U., Hüttmann K., “Versatile and simple approach to determine astrocyte territories in mouse neocortex and hippocampus,” PLoS One 8(7), e69143 (2013). 10.1371/journal.pone.0069143 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Benavides-Piccione R., Regalado-Reyes M., Fernaud-Espinosa I., Kastanauskaite A., Tapia-González S., León-Espinosa G., Rojo C., Insausti R., Segev I., DeFelipe J., “Differential structure of hippocampal CA1 pyramidal neurons in the human and mouse,” Cereb. Cortex 30(2), 730–752 (2019). 10.1093/cercor/bhz122 [DOI] [PubMed] [Google Scholar]
- 32.Turcotte R., Alt C., Mortensen L. J., Lin C. P., “Characterization of multiphoton microscopy in the bone marrow following intravital laser osteotomy,” Biomed. Opt. Express 5(10), 3578–3588 (2014). 10.1364/BOE.5.003578 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Suto K., Urabe K., Naruse K., Uchida K., Matsuura T., Mikuni-Takagaki Y., Suto M., Nemoto N., Kamiya K., Itoman M., “Repeated freeze-thaw cycles reduce the survival rate of osteocytes in bone-tendon constructs without affecting the mechanical properties of tendons,” Cell Tissue Banking 13(1), 71–80 (2012). 10.1007/s10561-010-9234-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Allegra Mascaro A. L., Costantini I., Margoni E., Iannello G., Bria A., Sacconi L., Pavone F. S., “Label-free near-infrared reflectance microscopy as a complimentary tool for two-photon fluorescence brain imaging,” Biomed. Opt. Express 6(11), 4483–4492 (2015). 10.1364/BOE.6.004483 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Xia F., Wu C., Sinefeld D., Li B., Qin Y., Xu C., “In vivo label-free confocal imaging of the deep mouse brain with long-wavelength illumination,” Biomed. Opt. Express 9(12), 6545–6555 (2018). 10.1364/BOE.9.006545 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Cheyuo C., Grand W., Balos L. L., “Near-infrared confocal laser reflectance cytoarchitectural imaging of the substantia nigra and cerebellum in the fresh human cadaver,” World Neurosurg. 97, 465–470 (2017). 10.1016/j.wneu.2016.10.043 [DOI] [PubMed] [Google Scholar]
- 37.Ohno Y., “Spectral design considerations for white LED color rendering,” Opt. Eng. 44(11), 111302 (2005). 10.1117/1.2130694 [DOI] [Google Scholar]
- 38.Zhu J., Chong S. P., Zhou W., Srinivasan V. J., “Noninvasive, in vivo rodent brain optical coherence tomography at 2.1 microns,” Opt. Lett. 44(17), 4147–4150 (2019). 10.1364/OL.44.004147 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.DuBose T., Nankivil D., LaRocca F., Waterman G., Hagan K., Polans J., Keller B., Tran-Viet D., Vajzovic L., Kuo A. N., Toth C. A., Izatt J. A., Farsiu S., “Handheld adaptive optics scanning laser ophthalmoscope,” Optica 5(9), 1027–1036 (2018). 10.1364/OPTICA.5.001027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Žurauskas M., Barnstedt O., Frade-Rodriguez M., Waddell S., Booth M. J., “Rapid adaptive remote focusing microscope for sensing of volumetric neural activity,” Biomed. Opt. Express 8(10), 4369–4379 (2017). 10.1364/BOE.8.004369 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Tao X., Lam T., Zhu B., Li Q., Reinig M. R., Kubby J., “Three-dimensional focusing through scattering media using conjugate adaptive optics with remote focusing (CAORF),” Opt. Express 25(9), 10368–10383 (2017). 10.1364/OE.25.010368 [DOI] [PubMed] [Google Scholar]
- 42.Booth Martin J., “Adaptive optics in microscopy,” Philos. Trans. R. Soc., A 365(1861), 2829–2843 (2007). 10.1098/rsta.2007.0013 [DOI] [PubMed] [Google Scholar]
- 43.Ji N., “Adaptive optical fluorescence microscopy,” Nat. Methods 14(4), 374–380 (2017). 10.1038/nmeth.4218 [DOI] [PubMed] [Google Scholar]