Abstract
Introduction
The intrinsic autofluorescence of biological tissues interferes with the detection of fluorophores administered for fluorescence guidance, an emerging auxiliary technique in oncological surgery. Yet, autofluorescence of the human brain and its neoplasia is sparsely examined. This study aims to assess autofluorescence of the brain and its neoplasia on a microscopic level by stimulated Raman histology (SRH) combined with two-photon fluorescence.
Methods
With this experimentally established label-free microscopy technique unprocessed tissue can be imaged and analyzed within minutes and the process is easily incorporated in the surgical workflow. In a prospective observational study, we analyzed 397 SRH and corresponding autofluorescence images of 162 samples from 81 consecutive patients that underwent brain tumor surgery. Small tissue samples were squashed on a slide for imaging. SRH and fluorescence images were acquired with a dual wavelength laser (790 nm and 1020 nm) for excitation. In these images tumor and non-tumor regions were identified by a convolutional neural network that reliably differentiates between tumor, healthy brain tissue and low quality SRH images. The identified areas were used to define regions.of- interests (ROIs) and the mean fluorescence intensity was measured.
Results
In healthy brain tissue, we found an increased mean autofluorescence signal in the gray (11.86, SD 2.61, n=29) compared to the white matter (5.99, SD 5.14, n=11, p<0.01) and in the cerebrum (11.83, SD 3.29, n=33) versus the cerebellum (2.82, SD 0.93, n=7, p<0.001), respectively. The signal of carcinoma metastases, meningiomas, gliomas and pituitary adenomas was significantly lower (each p<0.05) compared to the autofluorescence in the cerebrum and dura, and significantly higher (each p<0.05) compared to the cerebellum. Melanoma metastases were found to have a higher fluorescent signal (p<0.01) compared to cerebrum and cerebellum.
Discussion
In conclusion we found that autofluorescence in the brain varies depending on the tissue type and localization and differs significantly among various brain tumors. This needs to be considered for interpreting photon signal during fluorescence-guided brain tumor surgery.
Keywords: brain tumor, autofluorescence, artificial intelligence, stimulated Raman histology, fluorescence-guided surgery (FGS)
Introduction
Fluorescent labeling of tumor cells for guiding tumor removal is an emerging technique applied in various oncological surgeries. The visual contrast enabling surgical guidance is determined by the signal-to-noise ratio, the relation of light emission by the fluorescent label itself, and the background fluorescence, the autofluorescence of the tissue. A high level of tissue autofluorescence may reduce sensitivity and specificity of the fluorescent probe. In addition, the varying extent of autofluorescence interferes with the signal interpretation (1–3). Autofluorescence describes the natural emission of light by biological tissues subsequent to the absorbance of light. All tissues have fluorescent components that differ in their optical properties due to their chemical structures.
Most of the endogenous fluorophores such as flavin and/or pyridine nucleotides are involved in cellular energy metabolism or lipopigments usually originate as by-products of lipid oxidation (4, 5). The extracellular matrix substantially contributes to autofluorescence due to the relatively high quantum yield of collagen and elastin. By monitoring biochemical processes, the autofluorescence itself already provides diagnostic information in multiple pathologies (e.g., retinal degeneration or atherosclerosis) (6–9). The potential different metabolism in tumor cells and healthy stroma may lead to different accumulation of endogenous fluorophores that cause differences in autofluorescence. Autofluorescence in tumors shows a wide range from increased autofluorescence signal [e.g., melanoma compared with skin (10, 11)] to reduced signal [e.g., gastrointestinal malignancies or soft tissue carcinomas (12–14)] in the respective organs of origin. Data regarding the autofluorescence of the brain and its neoplasia are scarce (15) despite the use of 5-aminolevulinic acid (5-ALA) for fluorescence-guided high-grade glioma surgery as the current state of the art.
Further knowledge of the autofluorescence phenomena of the brain and its tumors is needed to better understand the influence of potential endogenous fluorophores in fluorescence-guided surgery (FGS). This study aims to assemble and characterize autofluorescence of the brain and its various neoplasia by using an intraoperative label-free fiber-laser-based microscope to enable stimulated Raman histology (SRH) (16–23) combined with two-photon fluorescence. By combining the two well-known optical events of Raman scattering and excitation by absorption of light, this workflow creates virtual hematoxylin-and-eosin-stained-like images with corresponding fluorescence images out of unprocessed tissue specimen within a few minutes during surgery. Using this technique, we provide a descriptive and semiquantitative analysis of autofluorescence patterns on a microscopic level that may interfere with the signal from exogenous fluorophores applied in neurooncological surgery.
Materials and methods
In a prospective single-center observational study design, patients were recruited in 2021 after an interdisciplinary neuro-oncological tumor board indicated resective surgery or stereotactic biopsy as approved by the local ethics committee (Nr. 21-1238). All patients gave their written informed consent for the scientific use of their data according to the European law.
Inclusion criteria were as follows: [1] suspected tumorous lesions of the central nervous system, [2] age over 18 years, and [3] the patient is willing and able to give informed consent for participation. Exclusion criteria were as follows: [1] Patient does not agree to participate in the study or [2] is unable to or unwilling to give informed consent. Specimen samples were excluded if the collected specimen was inadequate, for example, broken slide or specimen sample size under 1.7-mm diameter for SRH imaging. Tumor samples from patients who preoperatively received 5-ALA were excluded as well. All specimen samples obtained were imaged timely after collection by the intraoperative label-free fiber-laser-based stimulated Raman scattering (SRS) microscope and evaluated by the convolutional neural network (CNN) (18) as the output class [1] tumor, [2] non-tumor, or [3] low quality. A senior board-certified neuropathologist experienced in analyzing SRH images reviewed all samples, confirmed the non-tumor tissue as healthy tissue, and identified white and gray matter regions in the SRH images.
Specimen collection, intraoperative stimulated Raman histology and fluorescence imaging method
Tissue specimens were intraoperatively sampled from the tumor lesion itself or from the approach area in open surgery. For virtual imaging of fresh specimens, a small unprocessed specimen sample (1–3 mm³ in size) was squashed onto a glass slide with the help of the coverglass and imaged by a fiber-laser-based SRS microscope (Invenio Imaging Inc, Santa Clara, CA, USA) ( Figure 1A ). The microscope consists of four main components: [1] a fiber-coupled microscope, [2] a dual-wavelength (790 and 1020 nm) fiber-laser module, [3] a laser and microscope control module, and [4] a computer for data displaying, processing, and application of a convolutional neuronal network. Depending on the composition of proteins and lipids, the tissues show differences in the Raman scattering spectrums that lead to the contrast in the images. Here, two Raman shift wave numbers, 2845 cm−1 (CH2/lipid channel) and 2940 cm−1 (CH3/protein and ribonucleic acids) were used for image acquisition. The third channel combines the two Raman shift wave numbers to produce an SRH image. By acquiring a mosaic out of 400 × 400 μm SRH field of views at a speed of 2 s per frame and subsequent image calculation, a virtual H&E like image in the size of 3.06 mm2 was created (17–25). The two-photon fluorescence signal is detected in reflection of the sample ( Figure 1B ). During the pre-processing for the CNN algorithm, each pixel is divided by the average brightness of the entire patch to calibrate the intensity. As such, absolute intensity is removed as a variable and the algorithm functions based on relative changes within the patch. The power in focus is approximately 120 and 160 mW for the 790 and 1020 nm beam, respectively. The emission is separated from the dual-wavelength excitation beams using a 700-nm long-pass dichroic mirror (Edmund Optics 69-903), filtered with a high optical density (OD) short-pass filter (Thorlabs FESH0700), and detected with a dual-channel photo-multiplier tube (PMT) detector (Hamamatsu H10723-20). The detection channels are band-pass filtered with a 590-nm filter (570–613 nm, Edmund Optics 67-020) and 640-nm filter (603–678 nm, Edmund Optics 67-022) and displayed in pseudo-color in the green and red image channel of the resulting RGB (red, green, and blue color model) image, respectively. The emission detection range of 570 nm up to 678 nm was chosen in our setup, allowing to detect potential endogenous contributors in the common emission range of protoporphyrin IX (PPIX) and fluorescein applied in clinical FGS routine ( Figure 2 ). For fluorescence detection, both beams of the dual-wavelength laser systems (790 and 1020 nm) were enabled but the time-delay was detuned by ~10 ps to avoid generation of coherent anti-Stokes Raman scattering (CARS) signal, which would be detectable in the 640-nm channel and can overwhelm the autofluorescence signal.
Generating tumor heatmaps by a convolutional neural network
To distinguish between tumor, non-tumor, and low-quality SRH image, an already established and validated CNN was applied as previously described in detail (18). In brief, the CNN was trained on an annotated dataset of 570 whole-slide SRH images, representing the full spectrum of neurooncological surgery. The training was stopped after the preliminary validation accuracy exceeded 95% and the loss was lower than 0.10. The CNN was re-trained a second and a third time with different random seeds on the same external dataset for reliability and ROC analysis. The final probability heatmap of the presence of tumor (red), non-tumor (green), and low-quality (blue) is coded on top of the SRH image as a semi-transparent overlay ( Figure 1C ). Low-quality regions in SRH images were defined as areas that cannot be identified as tumor or non-tumor by the CNN. This can be caused, for example, by detritus, tissue disruptions due to squeezing, scan artifacts, photon absorbance of blood, and even fluid areas without any tissue. Areas that had low quality as first class in the CNN were excluded from the analysis of the final whole-slide prediction. As such, only “high quality” area probabilities were averaged over the whole image for final prediction. A quality control of the tumor heatmap was done by the observers.
Creating region of interests to measure fluorescence
Outlined by the tumor heatmap, we were able to distinguish between tumor, non-tumor, and low-quality SRH Image. Image postprocessing ROI was created based on the heatmap (ImageJ, open source) and then transferred to the corresponding fluorescence image to measure the mean fluorescence intensity per ROI in counts ( Figure 1D ).
Statistical analysis
Statistical analysis was performed using OriginLab (Northampton, Massachusetts, USA). Continuous values are stated in mean and with standard deviation for descriptive statistics. For p-value calculation, the Mann-Whitney U test was used for not normally distributed data. P-values below 0.05 were considered statistically significant.
Results
Demographics and baseline characteristics
We were able to include 81 patients who underwent brain tumor surgery in 07-08/2021 at our center; 37 patients (45.6%) were male. Sixty-four patients underwent open surgery (79%), whereas 17 patients were stereotactically biopsied (21%).
The final histopathological diagnoses were various carcinoma and melanoma metastases in 26 patients (32%), benign to atypic meningioma in 13 patients (16%), glial tumor in 15 patients (18.5%), pituitary adenoma including apoplectiform ones in six (7.4%), lymphoma in six (7.4%), and craniopharyngioma in two (2.4%) patients. Other mixed entities were, for example, Rathke cleft cyst, hemangioblastoma, lipoma, and epidermoid cyst in eight patients (9.8%). Tumors from five patients (6.1%) were excluded due to 5-ALA application, but the normal brain samples of the tumor approach were included for analysis ( Table 1 ).
Table 1.
Tumor Entity | Patients | images |
---|---|---|
Meningioma | 13 | 64 |
CNS WHO 1 | 11 | 56 |
Atypical CNS WHO 2 | 2 | 8 |
Brain Metastasis | 26 | 151 |
Colorectal Adenocarcinoma | 1 | 6 |
Gastroesophageal Adenocarcinoma | 1 | 4 |
Cervix Carcinoma | 2 | 15 |
Kidney Cell Carcinoma | 1 | 3 |
Mammary Carcinoma | 1 | 5 |
Multiple Myeloma | 1 | 6 |
Pulmonary Adenocarcinoma | 7 | 49 |
Large Cell Neuroendocrine Tumor | 1 | 6 |
Small Cell Lung Carcinoma | 1 | 3 |
Squamous Epithelial Carcinoma | 2 | 15 |
Salivary Duct Carcinoma | 1 | 4 |
Sarcoma | 1 | 4 |
Melanoma | 3 | 11 |
Dedifferentiated Cancer of unknown primary (CUP) | 3 | 20 |
Glial tumors | 15 | 47 |
IDH mutant Astrocytoma CNS WHO 2-4 | 2 | 5 |
Glioblastoma | 4 | 11 |
Oligodendroglioma CNS WHO 3 | 1 | 2 |
Gliosis and Glioma Infiltration | 2 | 2 |
Pilocytic Astrocytoma CNS WHO 1 | 2 | 3 |
Ependymoma CNS WHO 2 | 2 | 14 |
Medulloblastoma | 2 | 10 |
Pituitary adenoma | 6 | 30 |
Apoplectiform | 1 | 6 |
Rest | 5 | 24 |
Nerve Fiber Tumors | 2 | 11 |
Schwannoma | 1 | 6 |
Ganglioneurinoma Craniopharyngeoma | 1 | 5 |
Craniopharyngeoma | 2 | 9 |
Papillary | 1 | 6 |
Adamantinomatous | 1 | 3 |
Others | ||
Epidermoid cyst | 1 | 4 |
Lymphoma | 6 | 14 |
Hemangioblastoma | 1 | 8 |
Lipom | 1 | 2 |
Mixed Tumor Skin | 1 | 4 |
Multiple Sclerosis Rathke cleft cyst |
1 1 |
1 2 |
Normal Brain | 5 | 13 |
In total, 162 specimens were collected and 397 SRH and consecutive fluorescence images were acquired using the intraoperative laser imaging system. Specimens have been scanned in multiple random areas, in an average three areas per slide. Forty fluorescence images of normal brain tissue derived from 18 patients were included in our study, which were collected from the surgical access route to malignant intraaxial tumors.
Evaluation of the fluorescence data
Focusing on the non-tumorous brain tissue, a significantly higher mean autofluorescence signal was noticed in the cerebrum with 11.83 counts (SD = 3.29, n = 33) compared with the cerebellum with 2.82 counts (SD = 0.93, n = 7, p < 0.001). Most of the autofluorescence signal was detected in the neuronal bodies especially compared with the axons; therefore, the mean autofluorescence signal was significantly higher in the gray matter (mean = 11.86, SD = 2.61, n = 29) compared with the white matter (mean = 5.99, SD = 5.14, n = 11, p < 0.01) ( Figure 3A ).
In carcinoma metastases (excluding melanoma metastases), the mean autofluorescence intensity was 7.58 counts (SD = 4.75, n = 140) and was significantly lower compared with the signal in the cerebrum and higher compared with the cerebellum (both p < 0.001). This leads to a negative contrast between the tumor tissue and the healthy tissue in the tumor margins within the cerebrum ( Figures 4A, B ). The melanoma metastases showed a mean autofluorescence intensity of 24.21 counts (SD = 16.88, n = 11) and were significantly brighter in comparison with both the cerebrum (p < 0.05) and the cerebellum (p < 0.01). Striking fluorescence was observed from the melanin pigments in yellow that were produced by some melanomas, whereas low or not pigmented melanomas presented autofluorescence comparable with carcinoma metastases ( Figure 3B ).
In gliomas, we observed a mean autofluorescence of 10.08 counts (SD = 4.16, n = 25) that was still less fluorescent than the signal in the cerebrum (p < 0.05) but again more fluorescent than the autofluorescence of the cerebellum (p < 0.001). Regarding the malignancy, it seems like glioblastoma show a higher mean autofluorescence (mean = 11.4 counts, SD = 3.58, n = 11) compared with anaplastic IDH mutant astrocytomas (mean = 5.82 counts, SD = 2.4, n = 5) or oligodendrogliomas (mean = 5.06 counts, SD = 0.14, n = 2) in our small cohort (p < 0.01). Interestingly, depending on the localization, some label-free glioma cases derived from stereotactic biopsy and, thus, not receiving 5-ALA prior to surgery presented a strong red autofluorescence ( Figure 4C ).
Due to the different histopathological and stromal features, meningiomas showed a broad range of autofluorescence intensity. On average, the autofluorescence was 9.42 counts (SD = 15.27, n = 64) and therefore significantly less fluorescent than the cerebrum (p < 0.001). We observed psammoma bodies and fibrous material causing a high autofluorescence signal, whereas most of the meningiomas showed low autofluorescence (see Supplemental Figure S1 ). From the surgical guidance point of view, the autofluorescent contrast between meningioma and the dura is more valuable than to the surrounding brain tissue, at least in most meningioma resection cases. The dura itself shows a homogenous and high autofluorescence signal in mean 55.22 counts (SD = 17.07, n = 8) and is significantly more fluorescent than meningiomas (p < 0.001), leading to a negative contrast of the tumor to the non-tumorous dura ( Figure 3C ).
Non-apoplectiform pituitary adenomas show a mean autofluorescence signal of 5.52 counts (SD = 4.46, n = 24) that is significantly lower than the mean autofluorescence signal to the cerebrum (p < 0.001) and significantly higher compared with the cerebellum (p < 0.01). Probably due the hemorrhages in apoplectiform pituitary adenomas, there is an increase in the mean autofluorescence signal up to 15.03 counts (SD = 2.49, n = 6) ( Figure 4D ).
Focusing on the differences in autofluorescence levels across single specimen, we observed a mean standard deviation of 1.29 counts per specimen (median = 0.62 counts, range: 0.01–10 counts, n = 148) with an average of 2.7 scans per specimen. The intra-patient variability was relatively low with a mean standard deviation of 1.72 counts per patient (median = 0.85 counts, range: 0.1–11.75 counts; n = 84) with an average of 4.58 scans per patient taking the sampling (healthy brain, infiltration zone, and tumor) into account. In healthy brain, the mean standard deviation with 0.7 counts (median = 0.34 counts, range: 0.25–1.75 counts, n = 10) was even lower.
Discussion
This study provides a new understanding of the autofluorescence of the brain and its tumors on a microscopic level in the range of 570–678 nm, the spectral range that is most often applied for fluorescence guidance in neurooncological surgery. Autofluorescence can lead to a reduced signal-to-background ratio and impede the detection of fluorophores in fluorescent-guided surgery in the region of the tumor margins in particular.
Endogenous fluorophores and the impact on fluorescence-guided surgery
We observed the autofluorescence of the non-tumorous brain to vary depending on the localization and showing a significant difference between the cerebellum and the cerebrum. The higher degree of autofluorescence that was present in the neuronal bodies may explain the higher autofluorescence in the gray matter compared with the neuronal axons in the white matter. If there is a physiological difference in the autofluorescence in the various lobes and basal ganglia, this cannot be answered by our limited cohort and needs to be further investigated.
Endogen fluorophores emission spectra that may interfere with the exogenous fluorophores in neurooncological surgery such as fluorescein and PPIX are summarized in Figure 2 from the literature (26–32) and put in relation to the filters applied in clinical routine and our imaging setup, which show a clear overlap. Of note, emission spectra depicted here are based on one-photon excitation between 330 nm up to 405 nm and 480 nm for fluorescein, respectively. As we applied two-photon fluorescence with 790 and 1020 nm, we expect comparable emission spectra for the intrinsic and extrinsic fluorophores (PPIX and Fluorescein) in our settings. However, potentially altered emission spectra of endogenous fluorophores excited by one-photon 510 nm and two-photon 1020 nm excitation remains subject to further studies. As the emission range of FGS is wider than the range in our setup, an even higher impact of autofluorescence needs to be considered. A translation of the exact same currently available intraoperative fluorescence settings, in which white light is often used for excitation, is not reasonable on a microscopic level. The excitation spectrum is broad, and the necessary excitation power could lead to tissue burn of small samples. Our SRH and two-photon fluorescence microscope allows to mimic the FGS settings and track down the fluorescence on a cellular level. The descriptive and semiquantitative study on the characterization of autofluorescence phenomena in healthy brain and brain tumor tissue is limited in providing data about its direct impact on the extent and pattern of fluorescence detected in exogenous labeled tissue in FGS. Further studies comparing the extent and pattern of fluorescence in label-free and fluorophore-labeled tissues are needed.
In our cohort, most of the brain tumors showed a reduced autofluorescence signal compared with the healthy brain. These findings are in line with already published data on tumors outside and inside the central nervous system (12–14, 27, 36). An explanation regarding the reduced autofluorescence signal of malignancies is that typical endogenous fluorophores are often a product of cell aging. In tumor cells, the high rates of cell division and proliferation lead to an accumulation of relatively young cells. One example is lipofuscin or lipofuscin like lipopigments that are ascribed to physiological aging by oxidative stress and are intracellularly accumulated. Typically, they show fluorescence in the yellow to reddish spectrum, with variable intensity ( Figure 2 ). The exact spectral profile depends on their heterogeneous composition including lipids, protein and retinoids, the degree of oxidation, and cross-linkage (37). It is likely that lipofuscin and other lipopigments are the origin of the autofluorescence in the gray matter of the brain (38). Moreover, the autofluorescence decrease that we observed in tumor tissues can be ascribed to the reduction of NADH amount in tumor cells due to the Warburg effect (39). By highly increased metabolization of glucose and lactate under aerobic conditions in cancerous tissue compared with healthy brain tissue the NADH concentration can be lowered. Furthermore, a decrease of FAD and an increase of the optical redox ratio (NADH/FADH) has also been observed in gliomas compared with healthy brain tissue as an indicator for the altered metabolic activity (27, 40). Some studies have shown an increased concentration of NADH and FAD, for example, in breast cancer cells (41) probably caused by mitochondrial dysfunction (42). So far, the concentration of NADH and FAD in various tumors is still a matter of debate as it is strongly connected to the current metabolism state.
We observed a high autofluorescence by fibrous tissues like the dura or stromal tumors with a higher proportion of extracellular matrix (e.g., some meningioma and some squamous cell carcinoma, or mixed skin tumors). Most likely, it is caused by elastin and collagen whose autofluorescence depends on their composition and steric organisation ( Figure 2 ). For example, pyridinoline groups can be associated with collagen fibers and their degree of polymerization of monomeric chains and cross-links depend on age (43, 44). Because of its repetitive structural organization and anisotropic properties, the observed signal from structures with collagens such as the dura mater may possibly be caused by second harmonic generation (45). This is an inelastic scattering resulting in photons with twice the energy and half the wavelength of incident light (46). Due to the filter combination in our setup the detection of photons with twice the energy of the excitation laser with 790 nm and 1020 nm is not possible and by detuning the time delay sum-frequency generation cannot ensue. Therefore, the detected emission from the extracellular matrix we observed are caused by fluorescence phenomena.
A high autofluorescence was also observed in melanoma metastases, probably caused by the melanin pigments, whose fluorescence has already been examined to be in the yellow spectrum ( Figure 2 ) matching our results (47). The low or not pigmented melanoma metastases presented autofluorescence is comparable to carcinoma metastases and this difference in melanomas explains the wide standard deviation we found.
Strikingly, in some malignant gliomas, we noticed varying extent of autofluorescence even without preoperative administration of 5-ALA before stereotactic biopsy. Porphyrin derivates such as PPIX, the metabolism product of 5-ALA, fluoresce in the red region at well-defined spectral positions ( Figure 2 ) (48). Other than PPIX after 5-ALA administration, porphyrins involved in the heme metabolic could lead to a porphyrin associated fluorescence and a false positive signal in fluorescence-guided oncological neurosurgery ( Figure 2 ). For example, in apoplectiform pituitary adenomas, we observed orange to reddish autofluorescence, possibly due to hemorrhages and an increased deposition of heme/hemoglobin. However, these are assumptions and this phenomenon needs to be further studied.
Due to the fact that we observed intense autofluorescence overlapping the spectrum of the currently available fluorophores for oncological neurosurgery ( Figure 2 ), the imaging spectrum for FGS needs to be interpreted with caution and in highly autofluorescent entities, subtypes, and localizations; it should be re-considered. The near infrared (NIR) spectrum I from 700 to 1000 nm and NIR II or shortwave infrared (SWIR) from 1000 to 1700 nm in that regard is known to provide signal-to-noise advantages with less autofluorescence interference (3, 49–51). Due to less scattering, the penetration depth increases, and studies observed a substantial decrease in autofluorescence for NIR excitation and emission wavelength when compared with different ranges within the visible spectrum (3, 49, 50). The development of suitable NIR I or SWIR probes would potentially improve the signal-to-background ratio and could enable a higher sensitivity of FGS.
Our data suggest that autofluorescence may even enable label-free autofluorescence-guided surgery in the future by the endogenous fluorescence contrast between healthy and pathological tissue. These findings are in line with the results of different studies focusing on label free methods for tumor imaging that underline the potential of autofluorescence for future tumor guidance. For example, increased autofluorescence of pigmented skin and its lesions have already been successfully used for diagnosis and observation of melanomas in a small clinical cohort (11, 52). Furthermore, the negative contrast from reduced autofluorescence intensity in tumors was already observed in different intracranial tumors (27) and soft tissue sarcomas (14). Another study showed a combination of endogen (NADH) and exogen (PPIX) fluorophores to provide a new promising and sensitive tool to visualize brain tumor tissue not detectable with conventional 5-ALA (PPIX) fluorescence (53). Due to the heterogeneity of the autofluorescence signal, we also observed, in our small cohort, further studies on assessing and characterizing autofluorescence of the brain and its various tumors are needed.
Data acquisition and analysis
The applied CNN previously showed an overall inter-rater agreement with the neuropathologist of 89.6% and an excellent internal consistency of 90.2% enabling a quick and efficient differentiation of tumor or non-tumor and non-diagnostic patches (18) well in alignment with previous studies showing excellent concordance between SRH and standard H&E-based techniques for diagnosis prediction (16, 20, 22). However, using the CNN-based tumor heatmaps as ground truth for the ROIs can lead to imperfect accuracy regarding the diagnosis of tumor or non-tumor tissue compared with the potential neuropathologists’ accuracy and has to be acknowledged as a limitation of the study.
Our data showed low intra-sample and intra-patient variability underlining the stability of the fluorescence measurements. At the same time, these data suggest that the observed differences in the fluorescence levels are likely attributed to the different tumor entities.
Technical opportunities and limitations
Regarding technical limitations of the dual-modality setup presented here, the study was limited to provide data on specific exposure time requirements to enable sufficient contrast for the various tissue types as the exposure time was fixed in this setup. In comparison with exogenous contrast probes, the relatively low autofluorescence signal may require long exposure times that may limit its application for autofluorescence guidance in real time. Due to the simultaneous construction of two-photon fluorescence and SRH fluorescence signal may be lost by the photon split and cannot optimally be induced by the fixed light exposure times. In addition, reduced fluorescence signal as a result of bleaching effects needs to be considered due to the preceding simultaneous SRH acquisition. The color coding of the fluorescence images was performed computationally during the image processing. A detailed spectral analysis of the fluorescence signal may enable a more accurate spectral analysis of the endogen fluorophores.
Nevertheless, the advantages of the dual-modality image acquisition with a corresponding histopathological reference by SRH enabling the microscopic correlate to the fluorescence pattern in the same sample within minutes outweighs the limitations of the fluorescence detection setup. Using two-photon fluorescence microscopy perioperatively can restrict excitation to a tiny focal volume in thick samples. In that way out of focus excitation and photobleaching is reduced. Another benefit of two-photon fluorescence are the infrared lasers, which lead to less scattering in biological tissues compared with light of the visible spectrum and increase of the penetration depth (54).
In addition, the combined acquisition of autofluorescence and SRH images under controlled conditions may improve the accuracy of deep neuronal networks diagnostic predictions incorporating dual modal derived image information. This may potentially improve the accuracy in imaging-derived tissue diagnostics. Currently, sampling of tissue is still needed for the ex situ diagnostic imaging setup but future technical developments may enable in situ applications of the technique. One of the first experimental approaches in microscopic real time in vivo imaging is confocal endomicroscopy with visualization of tissue at high magnification without the need of tissue extraction (55–57).
Conclusion
In conclusion, the intraoperative combination of two-photon fluorescence and SRH provides the opportunity to examine and interpret autofluorescence with high resolution on a microscopic level within a few minutes. The characterization of autofluorescence phenomena of the brain and its various tumors at the cellular level may contribute to a better understanding of the potentials and limitations of labeled fluorescence guidance in neurosurgery and may support the emerging research efforts in paving the way towards label-free autofluorescence guidance in neurooncological surgery the future.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Ethics Committee of the Medical Faculty of the University of Cologne (Nr. 21-1238). The patients/participants provided their written informed consent to participate in this study.
Author contributions
Conceptualization: VN, GF. Data acquisition: A-KM, NS, DRe, VN, DRu, GF. Design and evaluation of optical configuration: GF, CF, AC, OB, VN. Data analyses: GF, VN. Review of literature: GF, VN. Writing - original draft preparation: GF, VN. Writing - review, and editing: all authors. Tables and Figures: GF, VN. Supervision: VN. All authors contributed to the article and approved the submitted version.
Funding Statement
We acknowledge open access publishing funding support from the DFG (German Research Foundation, grant no. 491454339), the Joachim Herz fellowship for interdisciplinary life science and the German Head and Neck Tumor Research Foundation. We also acknowledge funding from the Helmholtz Zentrum München, the National Center for Tumor Diseases Dresden (NCT/UCC Dresden), from the CZI Deep Tissue Imaging (DTI-0000000248) and BMBF (BetterView) to OB. The research received no other external funding.
Conflict of interest
CF, AI-M and FK are employees of Invenio Imaging Inc, the manufacturer of the SRH imaging system. CF, AI-M and FK did not take part in any data analysis or influenced the report or interpretation of the results.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2023.1146031/full#supplementary-material
References
- 1. Villa I, Vedda A, Cantarelli IX, Pedroni M, Piccinelli F, Bettinelli M, et al. 1.3 μm emitting SrF2:Nd3+ nanoparticles for high contrast in vivo imaging in the second biological window. Nano Res (2015) 8(2):649–65. doi: 10.1007/s12274-014-0549-1 [DOI] [Google Scholar]
- 2. Del Rosal B, Benayas A. Strategies to overcome autofluorescence in nanoprobe-driven in vivo fluorescence imaging. Small Methods (2018) 2(9). doi: 10.1002/smtd.201800075 [DOI] [Google Scholar]
- 3. del Rosal B, Thomas G, Mahadevan-Jansen A, Stoddart PR. NIR autofluorescence: molecular origins and emerging clinical applications. In: Near infrared-emitting nanoparticles for biomedical applications (Weinheim: WILEY-VCH Verlag GmbH & Co. KGaA; ) (2020). p. 21–47 p. [Google Scholar]
- 4. Huang S, Heikal AA, Webb WW. Two-photon fluorescence spectroscopy and microscopy of NAD(P)H and flavoprotein. Biophys J (2002) 82(5):2811–25. doi: 10.1016/S0006-3495(02)75621-X [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Quinn KP, Sridharan GV, Hayden RS, Kaplan DL, Lee K, Georgakoudi I. Quantitative metabolic imaging using endogenous fluorescence to detect stem cell differentiation. Sci Rep (2013) 3. doi: 10.1038/srep03432 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Patková J, Vojtíšek M, Tůma J, Vožeh F, Knotková J, Šantorová P, et al. Evaluation of lipofuscin-like pigments as an index of lead-induced oxidative damage in the brain. Exp Toxicol Pathol (2012) 64(1–2):51–56. doi: 10.1016/j.etp.2010.06.005 [DOI] [PubMed] [Google Scholar]
- 7. Verbunt RJAM, Fitzmaurice MA, Kramer JR, Ratliff NB, Kittrell C, Taroni P, et al. Characterization of ultraviolet laser-induced autofluorescence of ceroid deposits and other structures in atherosclerotic plaques as a potential diagnostic for laser angiosurgery. Am Heart J (1992) 123(1):208–16. doi: 10.1016/0002-8703(92)90767-P [DOI] [PubMed] [Google Scholar]
- 8. Nandakumar N, Buzney S, Weiter JJ. Lipofuscin and the principles of fundus autofluorescence: a review. Semin Ophthalmol (2012) 27:197–201. doi: 10.3109/08820538.2012.711415 [DOI] [PubMed] [Google Scholar]
- 9. Richards-Kortum R, Sevick-Muraca E. Quantitative optical spectroscopy for tissue diagnosis. Annu Rev Phys Chem (1996) 47:555–606. doi: 10.1146/annurev.physchem.47.1.555 [DOI] [PubMed] [Google Scholar]
- 10. Han X, Lui H, McLean DI, Zeng H. Near-infrared autofluorescence imaging of cutaneous melanins and human skin in vivo. J BioMed Opt. (2009) 14(2):024017. doi: 10.1117/1.3103310 [DOI] [PubMed] [Google Scholar]
- 11. Wang S, Zhao J, Lui H, He Q, Zeng H. In vivo near-infrared autofluorescence imaging of pigmented skin lesions: methods, technical improvements and preliminary clinical results. Ski Res Technol (2013) 19(1):1800075. doi: 10.1111/j.1600-0846.2012.00632.x [DOI] [PubMed] [Google Scholar]
- 12. Shao X, Zheng W, Huang Z. Near-infrared autofluorescence spectroscopy for in vivo identification of hyperplastic and adenomatous polyps in the colon. Biosens Bioelectron. (2011) 30(1):118–22. doi: 10.1016/j.bios.2011.08.040 [DOI] [PubMed] [Google Scholar]
- 13. Shao X, Zheng W, Huang Z. In vivo diagnosis of colonic precancer and cancer using near-infrared autofluorescence spectroscopy and biochemical modeling. J BioMed Opt. (2011) 16(6):067005. doi: 10.1117/1.3589099 [DOI] [PubMed] [Google Scholar]
- 14. Nguyen JQ, Gowani Z, O’Connor M, Pence I, Nguyen T-Q, Holt G, et al. Near-infrared autofluorescence spectroscopy of in vivo soft tissue sarcomas. Opt Lett (2015) 40(23):5498–501. doi: 10.1364/OL.40.005498 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Lifante J, del Rosal B, Chaves-Coira I, Fernández N, Jaque D, Ximendes E. The near-infrared autofluorescence fingerprint of the brain. J Biophotonics. (2020) 13(11). doi: 10.1002/jbio.202000154 [DOI] [PubMed] [Google Scholar]
- 16. Orringer DA, Pandian B, Niknafs YS, Hollon TC, Boyle J, Lewis S, et al. Rapid intraoperative histology of unprocessed surgical specimens via fibre-laser-based stimulated raman scattering microscopy. Nat BioMed Eng (2017) 1(2). doi: 10.1038/s41551-016-0027 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Freudiger CW, Min W, Saar BG, Lu S, Holtom GR, He C, et al. Label-free biomedical imaging with high sensitivity by stimulated raman scattering microscopy. Science (2008) 322(5909):1857–61. doi: 10.1126/science.1165758 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Reinecke D, von Spreckelsen N, Mawrin C, Ion-Margineanu A, Fürtjes G, Jünger ST, et al. Novel rapid intraoperative qualitative tumor detection by a residual convolutional neural network using label-free stimulated raman scattering microscopy. Acta Neuropathol Commun (2022) 10(1):1–13. doi: 10.1186/s40478-022-01411-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Neidert N, Straehle J, Erny D, Sacalean V, El Rahal A, Steybe D, et al. Stimulated raman histology in the neurosurgical workflow of a major European neurosurgical center {{/amp]]mdash; part a. Neurosurg Rev (2022) 45(2):1731–9. doi: 10.1007/s10143-021-01712-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Hollon TC, Pandian B, Adapa AR, Urias E, Save AV, Khalsa SSS, et al. Near real-time intraoperative brain tumor diagnosis using stimulated raman histology and deep neural networks. Nat Med (2020) 26(1):52–8. doi: 10.1038/s41591-019-0715-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Eichberg DG, Shah AH, Di L, Semonche AM, Jimsheleishvili G, Luther EM, et al. Stimulated raman histology for rapid and accurate intraoperative diagnosis of CNS tumors: prospective blinded study. J Neurosurg (2019) 134(1):1–7. doi: 10.3171/2019.9.JNS192075 [DOI] [PubMed] [Google Scholar]
- 22. Wadiura LI, Kiesel B, Roetzer-Pejrimovsky T, Mischkulnig M, Vogel C, Hainfellner J, et al. Towards digital histopathological assessment in surgery of central nervous system tumors using stimulated raman histology. Neurosurg Focus (2022) 53(6):E12. doi: 10.3171/2022.9.FOCUS22429 [DOI] [PubMed] [Google Scholar]
- 23. Straehle J, Erny D, Neidert N, Heiland DH, El Rahal A, Sacalean V, et al. Neuropathological interpretation of stimulated raman histology images of brain and spine tumors: part b. Neurosurg Rev (2022) 45(2):1721–9. doi: 10.1007/s10143-021-01711-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Orringer DA, Pandian B, Niknafs YS, Hollon TC, Boyle J, Lewis S, et al. Microscopy. Nat Biomed Eng (2017), 1–25. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Hollon T, Jiang C, Chowdury A, Nasir-Moin M, Kondepudi A, Aabedi A, et al. Artificial-intelligence-based molecular classification of diffuse gliomas using rapid, label-free optical imaging. Nat Med (2023) 29(1):52–8. doi: 10.1038/s41591-023-02252-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Haidar DA, Leh B, Zanello M, Siebert R. Spectral and lifetime domain measurements of rat brain tumors. BioMed Opt Express. (2015) 6(4):1219. doi: 10.1364/BOE.6.001219 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Zanello M, Poulon F, Pallud J, Varlet P, Hamzeh H, Abi Lahoud G, et al. Multimodal optical analysis discriminates freshly extracted human sample of gliomas, metastases and meningiomas from their appropriate controls. Sci Rep (2017) 7:1–11. doi: 10.1038/srep41724 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Croce AC, Bottiroli G. Autofluorescence spectroscopy and imaging: a tool for biomedical research and diagnosis. Eur J Histochem (2014) 58(4):320–37. doi: 10.4081/ejh.2014.2461 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Bergmann T, Beer S, Maeder U, Burg JM, Schlupp P, Schmidts T, et al. Development of a skin phantom of the epidermis and evaluation by using fluorescence techniques. Proceedings (2011) 7906:79060T. doi: 10.1117/12.874676 [DOI] [Google Scholar]
- 30. Pu Y, Wang W, Tang G, Alfano RR. Changes of collagen and nicotinamide adenine dinucleotide in human cancerous and normal prostate tissues studied using native fluorescence spectroscopy with selective excitation wavelength. J BioMed Opt. (2010) 15(4):047008. doi: 10.1364/BOE.6.001219 [DOI] [PubMed] [Google Scholar]
- 31. Shou CC, Hsiao TCR, Lin JK, Wang CY, Huihua KC. Comparison of the performance of linear multivariate analysis methods for normal and dyplasia tissues differentiation using autofluorescence spectroscopy. IEEE Trans BioMed Eng. (2006) 53(11):2265–73. doi: 10.1109/TBME.2006.883643 [DOI] [PubMed] [Google Scholar]
- 32. Carver GE, Locknar SA, Weaver DL, Stein JL, Stein GS. Real-time detection of breast cancer at the cellular level. J Cell Physiol (2019) 234(5):5413–9. doi: 10.1002/jcp.27451 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Molina ES, Ewelt C, Warneke N, Schwake M, Müther M, Schipmann S, et al. Dual labeling with 5-aminolevulinic acid and fluorescein in high-grade glioma surgery with a prototype filter system built into a neurosurgical microscope: technical note. J Neurosurg (2020) 132(6):1724–30. doi: 10.3171/2018.12.JNS182422 [DOI] [PubMed] [Google Scholar]
- 34. Suero Molina E, Stögbauer L, Jeibmann A, Warneke N, Stummer W. Validating a new generation filter system for visualizing 5-ALA-induced PpIX fluorescence in malignant glioma surgery: a proof of principle study. Acta Neurochir (2020) 162(4):785–93. doi: 10.1007/s00701-020-04227-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Ehrhardt A, Leonhard M, Reulen HJ, Stummer W, Stepp H, Mo G. Technical principles for protoporphyrin-IX-Fluorescence guided microsurgical resection of malignant glioma tissue. Acta Neurochir (1998) 140:995–1000. doi: 10.1007/s007010050206 [DOI] [PubMed] [Google Scholar]
- 36. Bergholt MS, Zheng W, Lin K, Ho KY, Teh M, Yeoh KG, et al. Combining near-infrared-excited autofluorescence and raman spectroscopy improves in vivo diagnosis of gastric cancer. Biosens Bioelectron (2011) 26(10):4104–10. doi: 10.1016/j.bios.2011.04.005 [DOI] [PubMed] [Google Scholar]
- 37. Wolman M. Lipid pigments (chromolipids): their origin, nature, and significance. Pathobiology Annu (1980) 10:253–67. [PubMed] [Google Scholar]
- 38. Armstrong D, Wilhelm J, Smid F, Elleder M. Chromatography and spectrofluorometry of brain fluorophores in neuronal ceroid lipofuscinosis (NCL). Mech Ageing Dev (1992) 64(3);293–302. doi: 10.1016/0047-6374(92)90085-R [DOI] [PubMed] [Google Scholar]
- 39. Koppenol WH, Bounds PL, Dang CV. Otto Warburg’s contributions to current concepts of cancer metabolism. Nat Rev Cancer (2011) 11(5):325–37. doi: 10.1038/nrc3038 [DOI] [PubMed] [Google Scholar]
- 40. Fang N, Wu Z, Wang X, Lin Y, Li L, Huang Z, et al. Quantitative assessment of microenvironment characteristics and metabolic activity in glioma via multiphoton microscopy. J Biophotonics. (2019) 12(10):1–11. doi: 10.1002/jbio.201900136 [DOI] [PubMed] [Google Scholar]
- 41. Xu HN, Tchou J, Feng M, Zhao H, Li LZ. Optical redox imaging indices discriminate human breast cancer from normal tissues. J BioMed Opt. (2016) 21(10):114003. doi: 10.1117/1.JBO.21.11.114003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Gogvadze V, Orrenius S, Zhivotovsky B. Mitochondria in cancer cells: what is so special about them? Trends Cell Biol (2008) 18(4):165–73. doi: 10.1016/j.tcb.2008.01.006 [DOI] [PubMed] [Google Scholar]
- 43. Marcu L, Cohen D, Maarek J-MI, Grundfest WS. Characterization of type I, II, III, IV, and V collagens by time-resolved laser-induced fluorescence spectroscopy. In: Optical biopsy III (2000), 93–101. doi: 10.1117/12.382720 [DOI] [Google Scholar]
- 44. Jayyosi C, Fargier G, Coret M, Bruyère-Garnier K. Photobleaching as a tool to measure the local strain field in fibrous membranes of connective tissues. Acta Biomater. (2014) 10(6):2591–601. doi: 10.1117/12.382720 [DOI] [PubMed] [Google Scholar]
- 45. Cicchi R, Vogler N, Kapsokalyvas D, Dietzek B, Popp J, Pavone FS. From molecular structure to tissue architecture: collagen organization probed by SHG microscopy. J Biophotonics. (2013) 6(2):129–42. doi: 10.1002/jbio.201200092 [DOI] [PubMed] [Google Scholar]
- 46. Zipfel WR, Williams RM, Christiet R, Nikitin AY, Hyman BT, Webb WW. Live tissue intrinsic emission microscopy using multiphoton-excited native fluorescence and second harmonic generation. Proc Natl Acad Sci U S A. (2003) 100(12):7075–80. doi: 10.1073/pnas.0832308100 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Docchio F, Boulton M, Cubeddu R, Ramponi R, Barker PD. Age-related changes in the fluorescence of melanin and lipofuscin granules of the retinal pigment epithelium: a time-resolved fluorescence spectroscopy study. Photochem Photobiol (1991) 54(2):247–53. doi: 10.1111/j.1751-1097.1991.tb02013.x [DOI] [PubMed] [Google Scholar]
- 48. Bottiroli G, Ramponi R, Croce AC. Quantitative analysis of intracellular behaviour of porphyrins. Photochem Photobiol (1987) 46(5):663–7. doi: 10.1111/j.1751-1097.1987.tb04829.x [DOI] [PubMed] [Google Scholar]
- 49. Frangioni JV. In vivo near-infrared fluorescence imaging. Curr Opin Chem Biol (2003) 7:626–34. doi: 10.1016/j.cbpa.2003.08.007 [DOI] [PubMed] [Google Scholar]
- 50. Carr JA, Franke D, Caram JR, Perkinson CF, Saif M, Askoxylakis V, et al. Shortwave infrared fluorescence imaging with the clinically approved near-infrared dye indocyanine green. Proc Natl Acad Sci U.S.A. (2018) 115(17):4465–70. doi: 10.1073/pnas.1718917115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Bruns OT, Bischof TS, Harris DK, Franke D, Shi Y, Riedemann L, et al. Next-generation in vivo optical imaging with short-wave infrared quantum dots. Nat BioMed Eng. (2017) 1(4). doi: 10.1038/s41551-017-0056 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Vicente JR, Durkin A, Shrestha K, Balu M. In vivo imaging with a fast large-area multiphoton exoscope (FLAME) captures the melanin distribution heterogeneity in human skin. Sci Rep. (2022) 12(1):1–10. doi: 10.1038/s41598-022-12317-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Erkkilä MT, Reichert D, Gesperger J, Kiesel B, Roetzer T, Mercea PA, et al. Macroscopic fluorescence-lifetime imaging of NADH and protoporphyrin IX improves the detection and grading of 5-aminolevulinic acid-stained brain tumors. Sci Rep (2020) 10(1):1–15. doi: 10.1038/s41598-020-77268-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54. Mulligan S, Macvicar B. Two-photon fluorescence microscopy: basic principles, advantages and risks. Mod Res Educ Top Microsc (2007) 2:881–99. [Google Scholar]
- 55. Sanai N, Eschbacher J, Hattendorf G, Coons SW, Preul MC, Smith KA, et al. Intraoperative confocal microscopy for brain tumors: a feasibility analysis in humans. Neurosurgery (2011) 68(SUPPL. 2):282–9. doi: 10.1227/NEU.0b013e318212464e [DOI] [PubMed] [Google Scholar]
- 56. Eschbacher J, Martirosyan NL, Nakaji P, Sanai N, Preul MC, Smith KA, et al. In vivo intraoperative confocal microscopy for real-time histopathological imaging of brain tumors: clinical article. J Neurosurg (2012) 116(4):854–60. doi: 10.3171/2011.12.JNS11696 [DOI] [PubMed] [Google Scholar]
- 57. Martirosyan NL, Eschbacher JM, Yashar M, Turner JD, Belykh E, Spetzler RF, et al. Prospective evaluation of the utility of intraoperative confocal laser endomicroscopy in patients with brain neoplasms using fluorescein sodium: experience with 74 cases. Neurosurg Focus. (2016) 40(3):1–8. doi: 10.3171/2016.1.FOCUS15559 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.