Abstract
Oral cancer patients undergo diagnostic surgeries to detect occult lymph node metastases missed by preoperative structural imaging techniques. Reducing these invasive procedures that are associated with considerable morbidity, requires better preoperative detection. Multispectral optoacoustic tomography (MSOT) is a rapidly evolving imaging technique that may improve preoperative detection of (early-stage) lymph node metastases, enabling the identification of molecular changes that often precede structural changes in tumorigenesis. Here, we characterize the optoacoustic properties of cetuximab-800CW, a tumor-specific fluorescent tracer showing several photophysical properties that benefit optoacoustic signal generation. In this first clinical proof-of-concept study, we explore its use as optoacoustic to differentiate between malignant and benign lymph nodes. We characterize the appearance of malignant lymph nodes and show differences in the distribution of intrinsic chromophores compared to benign lymph nodes. In addition, we suggest several approaches to improve the efficiency of follow-up studies.
1. Introduction
In oral cancer patients, the presence of lymph node (LN) metastases is one of the most important predictors of poor prognosis, with a reported decrease of survival by as much as 50% [1], [2]. Clinical and radiological staging (i.e., magnetic resonance imaging (MRI) or computed tomography (CT)) of the neck is performed to determine the most appropriate surgical strategy. However, in 20–30% of the patients with a clinically negative neck (cN0), occult LN (micro-)metastases are present at the time of surgery, demonstrating that current preoperative imaging methods lack the necessary sensitivity for detection of LN metastasis. When the probability of occult metastasis is > 20%, an elective neck dissection or sentinel node biopsy is warranted for a better oncological outcome [3], [4], [5]. Yet, many of these patients do not have metastatic LNs on definitive histopathological analysis (i.e., 70–80% of early-stage oral cancer patients with cN0), which implies significant overtreatment that is associated with morbidity, such as pain, shoulder dysfunction, and impaired quality of life [6], [7], [8].
The drive towards a patient-specific and less invasive surgery in oral cancer patients requires improved preoperative detection of LN metastases. Current imaging methods mainly rely on the LN size, the presence of central necrosis, the appearance of extranodal extension and the contrast enhancement on CT or MRI [9]. Often, small LNs are not detected, while these are the ones that harbor occult metastases. Since biochemical changes occur before morphological changes in disease, molecular imaging approaches may have a diagnostic advantage and higher sensitivity to detect LN metastases in an early stage.
Multispectral optoacoustic tomography (MSOT) is an emerging non-invasive imaging method exploiting the optoacoustic effect, where ultrasound waves are produced in tissue in response to the absorption of short laser pulses [10]. MSOT enables visualization of both intrinsic tissue chromophores and administered contrast agents at imaging depths of several centimeters in tissue [11], [12]. The potential of MSOT has been shown for multiple clinical indications, such as sentinel lymph node mapping [13] and assessment of inflammatory bowel disease [14], Duchenne muscular dystrophy [15], cardiovascular disease [16], [17], [18], [19], thyroid disease [20], [21] and breast cancer [22], [23], [24]. Specifically, oxy- (HbO2) and deoxy-hemoglobin (HbR) absorption properties allow visualization of tumor-related angiogenesis and hypoxia [25], [26], [27], [28], [29]. Preclinical studies suggest that the presence of angiogenesis, the distortion of peripheral LN vasculature, and the decreased oxygen saturation resulting from tumor hypoxia can be possible indicators for LN malignancy [30], [31]. To improve the specificity of MSOT, near-infrared tumor-specific fluorescent tracers are considered as they exhibit a reasonable molar extinction coefficient and low fluorescence quantum yield, benefitting the optoacoustic signal generation [32], [33]. For example, peritumoral administration of indocyanine green allowed for the identification of sentinel LNs with MSOT, however, non-invasive evaluation of the LN metastatic status remains an open problem [13], [34]. MSOT could potentially detect malignant LNs when combined with tumor-specific contrast agents. Multiple studies have shown the use of Epidermal Growth Factor Receptor (EGFR)-targeted fluorescent tracers (e.g., panitumumab-800CW and cetuximab-800CW) to detect malignant LNs ex vivo in oral cancer patients using fluorescence molecular imaging [35], [36]. A recent study by Nishio et al. demonstrated the capability of MSOT to visualize panitumumab-800CW and thus differentiate benign from malignant LNs in an ex vivo setting [37].
Here, we are the first to demonstrate the use of MSOT for in vivo imaging of neck LNs in oral cancer patients. We characterize the optoacoustic properties of the tumor-specific fluorescent tracer cetuximab-800CW in a tissue-mimicking phantom and determine an estimated minimal detectable concentration in vitro. Next, we image the LNs in vivo before and after cetuximab-800CW administration in patients and identify limitations that prevent a successful detection of the tracer. Furthermore, we analyze the features of the imaged LNs provided by resolving the intrinsic chromophores, HbO2 and HbR. Although the small sample size prevents a large-scale evaluation, we observe increased variance of HbR distribution in malignant LNs and demonstrate that clinically significant features of LNs can be observed with handheld MSOT, providing the rationale and need for a larger clinical trial to substantiate these findings.
2. Methods
2.1. Study design
This single center, proof-of-concept study was performed at the University Medical Center Groningen, Groningen, the Netherlands. Approval was obtained at the Institutional Review Board of the hospital and the Central Committee on Research Involving Human Subjects. All patients provided written informed consent prior to any study-related procedure. The study was performed in compliance with the Dutch Act on Medical Research involving Medical Subjects and the Declaration of Helsinki (adapted version 2013, Fortaleza, Brazil). The trial was registered at clinicaltrials.gov (NCT03757507).
2.2. Participants
Patients ≥ 18 years eligible for inclusion in this study had histology-confirmed oral cancer and were already included in the clinical trial of our group on fluorescence-guided surgery for margin assessment (ICON-study, NCT03134846). Exclusion criteria are described earlier and are provided in supplemental materials [38]. Two days prior to surgery, patients were administered with 15 mg cetuximab-800CW preceded by 75 mg unlabeled cetuximab to prevent rapid plasma clearance and to occupy off-target receptors, previously determined as the optimal dosing strategy for primary tumor imaging [38]. Subjects that underwent a surgical procedure of the neck with concurrent primary tumor surgery were included in this study, as histopathology was the reference standard of in vivo MSOT. Clinical and pathological TNM staging was performed according to the 8th edition of the American Joint Committee on Cancer (AJCC) criteria.
2.3. Production and characterization of cetuximab-800CW
Cetuximab-800CW was manufactured in the University Medical Center Groningen according to good manufacturing-practice guidelines, as previously described [39]. Briefly, cetuximab (Erbitux®) and IRDye800CW NHS Ester (LI-COR Biosciences, Lincoln, NE, USA) were conjugated under regulated conditions with a dye/antibody ratio of 1:2. Cetuximab-800CW was formulated in a sodium phosphate solution at a concentration of 1 mg/mL.
Prior to the clinical study, the optoacoustic spectra of cetuximab-800CW and IRDye800CW were determined with a hybrid ultrasound-MSOT system (see subsection 2.4). A tissue-mimicking phantom was fabricated using 300 mL deionized water, 2% agarose and 6% intralipid to mimic the optical properties of biological tissue. At 1 cm depth, polyethylene tubes with a diameter of 3 mm were inserted. These were filled with cetuximab-800CW 1 mg/mL and IRDye800CW with an optical density of 2 as a reference. The phantom was placed in a water bath to ensure optimal coupling between the transducer and the phantom and imaging was performed at 660–900 nm with 5 nm step size. The tubes were manually segmented in the reconstructed optoacoustic images and the spectra of cetuximab-800CW and IRDye800CW were determined as the mean absorption in the segmented regions. Supplemental Fig. S1 shows an overview of the experiment and example US and MSOT images.
To verify the linear relationship between the cetuximab-800CW concentration and the optoacoustic signal strength, and estimate the minimal detectable concentration, a two-fold dilution series down to 1.6 μM was imaged in the phantom. Six wavelengths were used here (700, 730, 760, 780, 800 and 850 nm), to match the in vivo imaging procedure. Non-negative least squares linear spectral unmixing using spectra of HbR, HbO2, and cetuximab-800CW was applied to compute the cetuximab-800CW concentrations in the optoacoustic images (see subsection 2.5). Again, the mean of the unmixing coefficients in the region of interest (ROI) was computed to estimate the concentration measured by MSOT.
2.4. In vivo imaging protocol
All imaging procedures were performed with a hybrid ultrasound-MSOT system (MSOT Acuity Echo prototype; iThera Medical GmbH, Munich, Germany). This system comprises a fast-tunable Nd:YAG laser (25 Hz pulse repetition rate, 4–7 ns pulse duration) and a 256-element 125° arc-shaped ultrasound transducer array (3.4 MHz central frequency). The maximum output energy of this system is in accordance with the American National Standards Institute safety limit for laser exposure [40].
All patients were imaged in a supine position with the neck in hyperextension and turned away from the imaging area. The neck was explored for LNs using the inbuilt ultrasound guidance of the system. Of all identified LNs, a video was obtained of ~10 s. The anatomical location of each identified LN within the various levels of the neck was mapped. MSOT images were acquired at six wavelengths (700, 730, 760, 780, 800 and 850 nm) selected to reflect the characteristics of the absorption spectra of HbR, HbO2, and IRDye800CW. Imaging was performed in a dedicated MSOT-imaging room following all safety regulations for safe use of class IV lasers (e.g., laser interlock system, safety goggles). Patients were asked for any symptoms present during or after imaging, and their skin was visually inspected.
2.5. In vivo imaging analysis
The MSOT images were reconstructed from the filtered acoustic signals (Butterworth filter, 0.5–12 MHz) with a model-based approach using a LSQR algorithm with a non-negativity constraint and Shearlet L1-regularization [41], [42], [43]. The regularization parameter was tuned to be 0.01 using an L-curve. The model accounted for the acoustic and electrical properties of the probe summarized as total impulse response correction [44], [45]. To improve the signal-to-noise ratio, three consecutive MSOT frames were reconstructed and averaged [24]. The LNs were manually segmented on the ultrasound images generated by the scanner along with MSOT to specify ROIs for further analysis. Fig. 1.
A depth-gain correction procedure (Fig. 2) was applied to avoid depth-effects biasing our quantitative analysis. Given an original MSOT image (Fig. 2a) , where denotes the set of image pixels and the set of acquired wavelengths, a depth correction factor is computed, as a function of depth (Fig. 2b) and wavelength , to be the median (Fig. 2c) of all pixels in the same depth which are not inside the LN ROI :
Here, represents the depth of a pixel . Then, the corrected image (Fig. 2e) is defined as
where is a correction term to ensure numerical stability in the regions of the image with near-zero values. In our analysis, was set to 1. Map of correction factors is shown in Fig. 2d. Furthermore, to limit the artifacts of discretization of the depth map, the function was smoothened with a Gaussian kernel with = 0.3 mm.
The concentrations of chromophores (HbR, HbO2, lipids, and cetuximab-800CW) were estimated using non-negative linear spectral unmixing. Specifically, we obtained the vector of concentrations for each pixel with spectrum by solving the non-negative least squares problem , where is a matrix with the absorption spectra of the four chromophores as columns [46].
The distributions of HbR and HbO2 concentrations in each LN were characterized using their variance relative to 3 mm margins around the LNs (Fig. 2a) as , where and are the sets of HbR unmixing coefficients for all pixels in the respective ROIs, and a corresponding formula is applied to HbO2 as well. This approach has twofold benefit for the robustness of our analysis. First, the use of relative variance eliminates any subject-dependent linear effects (i.e., constant offset and multiplicative bias) on the results that might be caused e.g., by varying melanin content between the subjects [47]. Second, normalizing by variance of neighborhood, whose size is proportional to the size of the LN, minimizes the possibility that an increased value is observed solely due to increased size of a LN.
2.6. Ex vivo analysis of surgical specimen
Directly after the surgical excision, the nodal specimen was fixed in formalin at the Department of Pathology for at least 24 h. According to the standard of care, the nodal specimen was divided in anatomic neck LN levels, and for each level single LNs were identified by visual and tactile inspection. The location of each identified LN was annotated on a white-light image of the complete nodal specimen to allow for correlation between in vivo imaging and pathology. LNs were bisected when large enough and subsequently collected in cassettes. All LNs were imaged in a closed-field fluorescence imaging system (Pearl Trilogy®, LI-COR BioSciences) to ensure control of imaging parameters. The protocol for fluorescence imaging of LNs has been described previously [36], [48].
Fluorescence images of the formalin-fixed LNs were used to draw ROIs to delineate the LNs and calculate the mean fluorescence intensity, defined as total counts per ROI pixel area (signal/pixel). Subsequently, LNs were embedded in paraffin and 4 µm sections were cut for hematoxylin and eosin (H&E) staining. According to the standard of care, a head and neck pathologist microscopically examined all tissue sections to determine the number of resected LNs and their metastatic state.
2.7. Statistical analysis
Statistical analyses were conducted using Graphpad Prism version 8. Due to the limited sample size of this study, all data was considered non-normally distributed. The Mann-Whitney U test was used to analyze distributions of HbO2 and HbR. A p-value < 0.05 was considered statistically significant.
3. Results
3.1. Optoacoustic characterization of cetuximab-800CW in a phantom
First, we characterized the spectrum of cetuximab-800CW in MSOT and we verified a linear relationship between the contrast agent concentration and the unmixing coefficients computed from MSOT images. Fig. 3a displays the spectra of cetuximab-800CW and unconjugated IRDye800CW as recorded by MSOT in vitro using a tissue-mimicking phantom. The spectrum of cetuximab-800CW has peaks at 780 nm and 700 nm, the former mirroring a peak of IRDye800CW and the latter related to the forming of H-aggregates [37], [49], [50]. Fig. 3b shows that the MSOT unmixing coefficients of cetuximab-800CW increase linearly with its concentration in the phantom (R2 =0.9896) and can be reliably distinguished from the background signals at concentrations above 400 μM. At concentrations below 400 μM, the linear relationship does not hold (R2 <0).
3.2. Participants
Seven patients participated in this clinical study. Table 1 summarizes patient demographics and clinical characteristics. All patients received the study drugs and completed the imaging protocol. No adverse events or complaints were reported related to the MSOT procedure. Four patients presented with a clinically negative neck, and three patients with a clinically positive neck. Four patients underwent an elective neck dissection, of which one was extended to a modified radical neck dissection as a malignant LN was intraoperatively identified through frozen section biopsy. Three patients underwent a modified radical neck dissection, of which one also received an elective neck dissection on the contralateral side. The study was ended prematurely as the primary endpoint could be assessed earlier.
Table 1.
Patient | Sex | Ethnicity | Age | Tumor location | cTN | pTN | No. of metastases |
---|---|---|---|---|---|---|---|
1 | Female | White | 65 | Tongue | cT2N0 | pT2N1 | 1 |
2 | Female | White | 78 | Mandible | cT4N0 | pT4N0 | NA |
3 | Female | White | 63 | Maxilla | cT3/4N0 | pT2N0 | NA |
4 | Female | White | 66 | Mandible | cT3–4aN1 | pT4aN2a | 1 |
5 | Male | White | 29 | Tongue | cT1N0 | pT1N0 | NA |
6 | Female | White | 65 | Tongue | cT4aN2b | pT4aN3b | 7 |
7 | Female | White | 47 | Mandible | cT4aN0 | pT4aN0 | NA |
Summary of patient, imaging and LN characteristics. Abbreviations: cTN, clinical tumor and nodal stage; pTN, pathological tumor and nodal stage; NA, not applicable.
3.3. In vivo MSOT of lymph nodes in patients with oral cancer
Due to the nature of the surgical procedure, exact tracking of all imaged LNs between in vivo imaging and histopathology was not possible. Only a subset of LNs where the metastatic status could be assigned with certainty was included in the in vivo image analysis. Specifically, we included only LNs of patients showing no malignancies at all at the histopathology, classified as benign (n = 11), and malignant LNs that were either palpable or close to anatomical landmarks and thus could be tracked until histopathology (n = 3). Five benign LNs that allowed correlation with histopathology were excluded from the analysis due to image quality issues: in one case the LN was obscured by skin reflection artifacts and four cases had surface contact issues causing strong artifacts while also having the view on the LN obscured by the sternocleidomastoid muscle. One malignant case (M1) was also partially affected by the skin reflection artifact but could still be used for the analysis after excluding the affected pixels. Supplemental Fig. S2 demonstrates these problems in detail. Supplemental Fig. S3 summarizes the data exclusions. An overview of the LNs analyzed with MSOT is provided in Table 2.
Table 2.
Lymph node | Patient | Status | Depth (mm) | Diameter (US; mm) | Diameter (histology; mm) |
---|---|---|---|---|---|
M1 | 4 | Malignant | 4.1 | 12.9 | 13.8 × 8.4 |
M2 | 6 | Malignant | 3.7 | 11.3 | 10.4 × 9.5 |
M3 | 6 | Malignant | 2.9 | 8.1 | 11.4 × 9.3 |
B1 | 1a | Benign | 12.0 | 18.7 | N/A |
B2 | 1a | Benign | 5.7 | 8.3 | N/A |
B3 | 7 | Benign | 10.4 | 7.7 | N/A |
B4 | 7 | Benign | 5.0 | 6.0 | N/A |
B5 | 1a | Benign | 11.6 | 20.2 | N/A |
B6 | 2 | Benign | 7.1 | 16.6 | N/A |
this patient presented with one solitary metastasis in the contralateral side of the neck.
Analyzing the in vivo images, we observed that cetuximab-800CW could not be reliably detected in our setup. Fig. 3c shows the distributions of cetuximab-800CW unmixing coefficients in three malignant LNs pre- and post-injection. Comparing the tails of the cetuximab-800CW unmixing coefficient distributions, where a localized increase of coefficients would be apparent, we observed that the LN M3 exhibited an increase, LN M2 showed a decrease and LN M1 remained unchanged. We obtained the same result also when comparing the 95th percentiles or considering the means of the upper top 10% of the coefficient values, as reported in the earlier ex vivo study [37]. Fig. 3d shows visualizations of the cetuximab-800CW signal as a green overlay on the grayscale ultrasound images. The post-injection scan of the LN M3 clearly shows patches of increased signal, albeit a discrepancy exists between imaging angles pre- and post-injection, preventing us from conclusively proving the possibility to detect cetuximab-800CW in vivo.
On the other hand, using MSOT we could visualize intrinsic chromophores and related features in lymph nodes in vivo. Fig. 4a shows the absorption spectra of the main tissue chromophores in the wavelength range of MSOT. Dashed lines denote the wavelengths acquired during this study, allowing distinguishing HbR and HbO2. Fig. 4b shows images of malignant LNs (M1 and M3) and benign LNs (B1 and B4) with distinct features, such as vasculature (peripheral, feeding, and internodal; marked by arrowheads) and enhancement of HbR and HbO2 signals in the LN borders (small arrows), although we could not establish apparent differences between malignant and benign LNs. Separate HbR and HbO2 images are provided in Supplemental Fig. S4. Fig. 4c shows US images with localization of adjacent anatomical structures to provide a better spatial context to the displayed MSOT images.
Quantitatively, malignant LNs exhibited larger variance of HbR coefficients than the benign ones. The distributions of the unmixing coefficients of HbR and HbO2 throughout the LN ROIs are shown in Fig. 4c. Fig. 4d shows the variances of HbR and HbO2 distributions of malignant and benign LNs relative to their margins. Malignant LNs exhibit significantly higher variance of HbR than benign ones (p = 0.047, n = 9). No significant difference in HbO2-variance was observed between malignant and benign LNs (p = 0.349, n = 9).
3.4. Ex vivo analysis of surgical specimens
Analyzing the fluorescence images of all formalin-fixed LNs that were surgically excised during this study (n = 149), we observed significantly increased cetuximab-800CW concentrations in the malignant cases. Fig. 5a shows the increased mean fluorescence intensity of 1.02 (IQR 0.61–1.73) x 10-2 observed in malignant LNs (n = 9) compared to 0.16 (IQR 0.11–0.26) x 10-2 in benign LNs (n = 140) (p < 0.0001). Furthermore, malignant LNs showed a maximum fluorescence intensity of 2.49 (IQR 1.72–3.89) x 10-2 compared to 0.50 (IQR 0.37–0.74) x 10-2 in benign LNs (p < 0.0001), as shown earlier [48]. Fig. 5b shows a fluorescence image of a malignant LN that was localized against the submandibular gland, which allowed for correlation of MSOT with fluorescence molecular imaging and histology. A benign LN is shown as a reference.
4. Discussion
This study demonstrated MSOT for in vivo imaging of LNs in oral cancer patients. We characterized the optoacoustic properties of cetuximab-800CW using a tissue-mimicking phantom. Furthermore, we provided the first clinical results of in vivo EGFR-targeted molecular imaging with MSOT. Although we validated the suitability of cetuximab-800CW as a tumor-specific contrast agent for MSOT through our phantom and ex vivo experiments, we identified a number of obstacles preventing its reliable detection in vivo. Next, we compiled a list of recommendations for future studies. As a secondary goal, we assessed the qualitative and quantitative optoacoustic features of LNs in oral cancer patients. MSOT was able to detect altered tissue metabolism in malignant LNs, showcased by an increase in deoxyhemoglobin variance.
Our phantom experiment demonstrated the ability of MSOT to detect the EGFR-targeted fluorescent probe, cetuximab-800CW, at concentrations above 400 μM. Furthermore, the analysis of the excised specimens verified the tumor-specific intake of the tracer in LNs, confirming observations from previous fluorescence molecular imaging studies [35], [36], [48]. Recently, Nishio et al. [37] reported that a IRDye800CW-labeled antibody could be used for ex vivo optoacoustic detection of LN metastases. We could not extend these results by observing the accumulation of cetuximab-800CW in MSOT scans of LNs in vivo. We observed an increase in cetuximab-800CW signal only in one out of three examined cases, but here also big discrepancy between the pre- and post-injection imaging angles was observed. On the contrary, the case with the best alignment between the pre- and post-injection images did not show any change. Multiple reasons could explain the differences between our results and the previously reported ex vivo study. First, the light scattering and absorption in the overlying tissue present during in vivo imaging cause spectral coloring and signal decay due to reduced light fluence, complicating the detection of optical contrast in the LNs compared to ex vivo imaging. Secondly, the maximum permissible light fluence exposure for in-human use [40] is well below the laser power used by Nishio et al., further limiting the MSOT signal strength in vivo. Overall, we surmise that the selected dose of cetuximab-800CW lies below the detection limit of MSOT in vivo at depth, under the selected image acquisition parameters.
A secondary aim of this study was to explore MSOT of intrinsic contrast, particularly HbO2 and HbR. The in vivo imaging of HbR and HbO2 allowed the visualization of multiple endogenous features within and around LNs, such as lymphoid vasculature which seemed more extensively present in malignant LNs [51], [52]. Furthermore, we observed a significant increase in HbR variance in malignant LNs. The increased HbR heterogeneity in malignant LNs may be explained by the fact that malignant LNs contain both healthy tissue, that typically exhibits lower oxygen metabolism, and tumor tissue that is characterized by regions of hypoxia due to decreased oxygen supply (from dysfunctional microvasculature) and increased oxygen demand (from the hypermetabolic state of tumor cells) [31], [53], [54]. The non-invasive detection of malignant LNs with MSOT can help to better stratify oral cancer patients for surgical treatment of the neck and avoid overtreatment resulting from the limited sensitivity of current imaging methods. Moreover, the use of intrinsic contrast disposes the need for exogenous contrast agents, allowing for seamless implementation into standard of care.
This first clinical proof-of-concept study revealed several limitations of the chosen methodology. First, the difficulties in linking in vivo imaging to the final histopathology aggravated the already quite low sample size, prohibiting significant results. Unlike in studies assessing the performance of established techniques (e.g., ultrasound), the novelty of MSOT LN imaging and the explorative nature of this study require meticulous correlation with histopathology before certain image characteristics can be attributed to the presence of tumor. Second, the mismatch of imaging positions between the pre- and post-injection scans complicates the comparison of chromophore quantities. Third, in this study we acquired images at six wavelengths matching the absorption spectrum characteristics of IRDye800CW. There are multiple other chromophores in the tissue and the spectral coloring increases the range of observable spectra even further, in which case six wavelengths do not facilitate reliable spectral unmixing. Finally, besides the challenges in the study procedure itself, the issue of detecting the contrast agent in vivo remains. We studied IRDye800CW as we could determine its potential noninvasively by including patients already administered with cetuximab-800CW as part of a fluorescence-guided surgery trial. However, better contrast agents could be considered to improve the tumor-specific signal generation for MSOT, such as gold nanoparticles [55]. The main criteria for optoacoustic contrast agents include strong and sharply peaked optical absorption in the near-infrared window, high optoacoustic efficiency, and optimal biocompatibility [56], [57]. Also, when evaluating novel optoacoustic contrast agents, it is helpful to realize that the accumulation of contrast agents involves complex pharmacokinetic processes, including both active binding of the target of interest (e.g., receptor) as well as nonspecific accumulation due to variety in lymph and blood physiological processes [58], [59]. To better quantify target expression one could use a paired-imaging approach, where a non-targeted tracer with a different absorption spectrum is administered simultaneously and used to correct for nonspecific accumulation [60], [61].
Based on the limitations that we identified during our study, we compiled the following recommendations for future studies: 1) ensure node-by-node comparison by establishing specific study designs [62] or including only patients of which the LNs identified with preoperative imaging can tracked until final histopathology (e.g. preoperative lymphoscintigraphy and intraoperative Geiger meter-detection in the sentinel node procedure) [63], [64]; 2) when multiple sentinel LNs are identified, the endpoints should comprise the number of LNs identified, the metastatic state of the sentinel LN specimen and the number of malignant LNs; 3) a baseline MSOT could be performed to study pre- and post-injection scans; if a good match between pre- and post-injection scans cannot be established, multiple angles should be scanned and their results averaged; 4) additional wavelengths should be included in the image acquisition to increase the accuracy of spectral unmixing (i.e., at 25 wavelengths, the image acquisition takes 1 s and motion is thus not a problem, but the redundancy in the spectral dimension makes spectral unmixing more robust to noise and light fluence effects); 5) blind spectral unmixing (e.g., non-negative matrix factorization) may be preferred to simple linear spectral unmixing when recording sufficient number wavelengths, as it can better adapt to observed spectral variations; 6) MSOT and, if the quantum yield of the of the contrast agent allows, fluorescence imaging of the excised and grossed LNs can be performed to validate in vivo imaging results. Here, MSOT of the excised LNs would require scanning in a water bath to improve acoustic coupling; 7) all sentinel lymph nodes should be examined through histopathology to determine their metastatic status. Finally, when suspicious features are determined based on MSOT, subsequent studies can correlate the number of identified LNs with final histopathology as in studies with ultrasound.
In conclusion, we identified possible reasons which prevent achieving the primary goal of detecting cetuximab-800 CW in vivo. Furthermore, we demonstrated that in vivo MSOT can observe clinically important features in LNs, specifically using hemoglobin parameters. In particular, increased variance of the deoxyhemoglobin distribution inside the LNs could serve as an optoacoustic marker of LN metastases. Additionally, we suggested several approaches to improve the efficiency of follow-up MSOT studies on LN imaging, such as a confined study population that allows correlation with histopathology, using more wavelengths during the image acquisition and the use of advanced spectral unmixing algorithms. Following our suggestions, future studies may better evaluate the clinical benefit of optoacoustic contrast agents as well as the intrinsic LN features observed with MSOT, facilitating improved preoperative detection of LN metastases.
Declaration of Competing Interest
The authors declare the following financial interests/personal relationships which may be considered as potential competing interests, . JK, MB, DJ, and VN received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme under grant agreement No 694968 (PREMSOT) and by the Deutsche Forschungsgemeinschaft (DFG), Sonderforschungsbereich-824 (SFB-824), subproject A1. VN is an equity owner and consultant at iThera Medical GmbH, member of the Scientific Advisory Board at SurgVision BV / Bracco Sp.A, owner at Spear UG, founder and consultant at I3, and founder of Sthesis. GMvD is CEO, founder and shareholder of TRACER Europe BV / AxelaRx.
Biographies
Jan Kukačka earned his B.Sc. degree from Theoretical Computer Science at Czech Technical University, where he focused on High Performance Computing with GPUs. He received his M.Sc. degree in Computer Science at Technical University Munich, where he specialized in Machine Learning, Computer Vision, and Medical Imaging. He is currently pursuing PhD at the Chair for Biological Imaging at the Technical University Munich, applying advanced algorithms for image processing and analysis to enable novel clinical applications of optoacoustic imaging.
Professor Vasilis Ntziachristos studied Electrical Engineering at Aristotle University in Thessaloniki, Greece and received his M.Sc. and Ph.D. from the Bioengineering Department of the University of Pennsylvania. He served as assistant professor and director of the Laboratory for Bio-Optics and Molecular Imaging at Harvard University and Massachusetts General Hospital. Currently, he is the Director of the Institute for Biological and Medical Imaging at the Helmholtz Zentrum in Munich, Germany, as well as a Professor of Electrical Engineering, Professor of Medicine and Chair for Biological Imaging at the Technical University Munich, Germany. His work focuses on novel innovative optical and optoacoustic imaging modalities for studying biological processes and diseases as well as the translation of these findings into the clinic.
Footnotes
Supplementary data associated with this article can be found in the online version at doi:10.1016/j.pacs.2022.100362.
Appendix A. Supplementary material
.
References
- 1.Cerezo L., Millán I., Torre A., Aragón G., Otero J. Prognostic factors for survival and tumor control in cervical lymph node metastases from head and neck cancer. A multivariate study of 492 cases. Cancer. 1992;69(5):1224–1234. doi: 10.1002/cncr.2820690526. [DOI] [PubMed] [Google Scholar]
- 2.Ho A.S., Kim S., Tighiouart M., Gudino C., Mita A., Scher K.S., et al. Metastatic lymph node burden and survival in oral cavity cancer. J. Clin. Oncol. 2017;35(31):3601–3609. doi: 10.1200/JCO.2016.71.1176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.de Bree R., Takes R.P., Shah J.P., Hamoir M., Kowalski L.P., Robbins K.T., et al. Elective neck dissection in oral squamous cell carcinoma: Past, present and future. Oral Oncol. 2019;90:87–93. doi: 10.1016/j.oraloncology.2019.01.016. [DOI] [PubMed] [Google Scholar]
- 4.Weiss M.H., Harrison L.B., Isaacs R.S. Use of decision analysis in planning a management strategy for the stage N0 neck. Arch. Otolaryngol. Head Neck Surg. 1994;120(7):699–702. doi: 10.1001/archotol.1994.01880310005001. [DOI] [PubMed] [Google Scholar]
- 5.D’Cruz A.K., Vaish R., Kapre N., Dandekar M., Gupta S., Hawaldar R., et al. Elective versus therapeutic neck dissection in node-negative oral cancer. N. Engl. J. Med. 2015;373(6):521–529. doi: 10.1056/NEJMoa1506007. [DOI] [PubMed] [Google Scholar]
- 6.Gane E.M., Michaleff Z.A., Cottrell M.A., McPhail S.M., Hatton A.L., Panizza B.J., et al. Prevalence, incidence, and risk factors for shoulder and neck dysfunction after neck dissection: a systematic review. Eur. J. Surg. Oncol. 2017;43(7):1199–1218. doi: 10.1016/j.ejso.2016.10.026. [DOI] [PubMed] [Google Scholar]
- 7.Rogers S.N., Ferlito A., Pellitteri P.K., Shaha A.R., Rinaldo A. Quality of life following neck dissections. Acta Otolaryngol. 2004;124(3):231–236. doi: 10.1080/00016480310015317. [DOI] [PubMed] [Google Scholar]
- 8.Schiefke F., Akdemir M., Weber A., Akdemir D., Singer S., Frerich B. Function, postoperative morbidity, and quality of life after cervical sentinel node biopsy and after selective neck dissection. Head Neck. 2009;31(4):503–512. doi: 10.1002/hed.21001. [DOI] [PubMed] [Google Scholar]
- 9.de Bondt R.B., Nelemans P.J., Hofman P.A., Casselman J.W., Kremer B., van Engelshoven J.M., et al. Detection of lymph node metastases in head and neck cancer: a meta-analysis comparing US, USgFNAC, CT and MR imaging. Eur. J. Radiol. 2007;64(2):266–272. doi: 10.1016/j.ejrad.2007.02.037. [DOI] [PubMed] [Google Scholar]
- 10.Ntziachristos V., Razansky D. Molecular imaging by means of multispectral optoacoustic tomography (MSOT) Chem. Rev. 2010 12;110(5):2783–2794. doi: 10.1021/cr9002566. [DOI] [PubMed] [Google Scholar]
- 11.Taruttis A., Ntziachristos V. Advances in real-time multispectral optoacoustic imaging and its applications. Nat. Photon. 2015;9:219. [Google Scholar]
- 12.Wang L.V., Hu S. Photoacoustic tomography: in vivo imaging from organelles to organs. Science. 2012;335(6075):1458–1462. doi: 10.1126/science.1216210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Stoffels I., Morscher S., Helfrich I., Hillen U., Leyh J., Burton N.C., et al. Metastatic status of sentinel lymph nodes in melanoma determined noninvasively with multispectral optoacoustic imaging. Sci. Transl. Med. 2015;7(317):317ra199. doi: 10.1126/scitranslmed.aad1278. [DOI] [PubMed] [Google Scholar]
- 14.Knieling F., Neufert C., Hartmann A., Claussen J., Urich A., Egger C., et al. Multispectral optoacoustic tomography for assessment of Crohn’s disease activity. N. Engl. J. Med. 2017;376(13):1292–1294. doi: 10.1056/NEJMc1612455. [DOI] [PubMed] [Google Scholar]
- 15.Regensburger A.P., Fonteyne L.M., Jüngert J., Wagner A.L., Gerhalter T., Nagel A.M., et al. Detection of collagens by multispectral optoacoustic tomography as an imaging biomarker for Duchenne muscular dystrophy. Nat. Med. 2019;25(12):1905–1915. doi: 10.1038/s41591-019-0669-y. [DOI] [PubMed] [Google Scholar]
- 16.Yang H., Jüstel D., Prakash J., Karlas A., Helfen A., Masthoff M., et al. Soft ultrasound priors in optoacoustic reconstruction: Improving clinical vascular imaging. Photoacoustics. 2020;19 doi: 10.1016/j.pacs.2020.100172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Masthoff M., Helfen A., Claussen J., Karlas A., Markwardt N.A., Ntziachristos V., et al. Use of multispectral optoacoustic tomography to diagnose vascular malformations. JAMA Dermatol. 2018;154(12):1457–1462. doi: 10.1001/jamadermatol.2018.3269. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Choi W., Park E.Y., Jeon S., Yang Y., Park B., Ahn J., et al. Three-dimensional multistructural quantitative photoacoustic and US imaging of human feet in vivo. Radiology. 2022 doi: 10.1148/radiol.211029. [DOI] [PubMed] [Google Scholar]
- 19.Taruttis A., Timmermans A.C., Wouters P.C., Kacprowicz M., van Dam G.M., Ntziachristos V. Optoacoustic imaging of human vasculature: feasibility by using a handheld probe. Radiology. 2016;281(1):256–263. doi: 10.1148/radiol.2016152160. [DOI] [PubMed] [Google Scholar]
- 20.Roll W., Markwardt N.A., Masthoff M., Helfen A., Claussen J., Eisenblätter M., et al. Multispectral optoacoustic tomography of benign and malignant thyroid disorders: a pilot study. J. Nucl. Med. 2019;60(10):1461–1466. doi: 10.2967/jnumed.118.222174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Kim J., Park B., Ha J., Steinberg I., Hooper S.M., Jeong C., et al. Multiparametric photoacoustic analysis of human thyroid cancers in vivo. Cancer Res. 2021;81(18):4849–4860. doi: 10.1158/0008-5472.CAN-20-3334. [DOI] [PubMed] [Google Scholar]
- 22.Neuschler E.I., Butler R., Young C.A., Barke L.D., Bertrand M.L., Böhm-Vélez M., et al. A pivotal study of optoacoustic imaging to diagnose benign and malignant breast masses: a new evaluation tool for radiologists. Radiology. 2018;287(2):398–412. doi: 10.1148/radiol.2017172228. [DOI] [PubMed] [Google Scholar]
- 23.Menezes G.L.G., Pijnappel R.M., Meeuwis C., Bisschops R., Veltman J., Lavin P.T., et al. Downgrading of breast masses suspicious for cancer by using optoacoustic breast imaging. Radiology. 2018;288(2):355–365. doi: 10.1148/radiol.2018170500. [DOI] [PubMed] [Google Scholar]
- 24.Kukačka J., Metz S., Dehner C., Muckenhuber A., Paul-Yuan K., Karlas A., et al. Image processing improvements afford second-generation handheld optoacoustic imaging of breast cancer patients. Photoacoustics. 2022;26 doi: 10.1016/j.pacs.2022.100343. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Ron A., Deán-Ben X.L., Gottschalk S., Razansky D. Volumetric optoacoustic imaging unveils high-resolution patterns of acute and cyclic hypoxia in a murine model of breast cancer. Cancer Res. 2019;79(18):4767–4775. doi: 10.1158/0008-5472.CAN-18-3769. [DOI] [PubMed] [Google Scholar]
- 26.Tomaszewski M.R., Gehrung M., Joseph J., Quiros-Gonzalez I., Disselhorst J.A., Bohndiek S.E. Oxygen-enhanced and dynamic contrast-enhanced optoacoustic tomography provide surrogate biomarkers of tumor vascular function, hypoxia, and necrosis. Cancer Res. 2018;78(20):5980–5991. doi: 10.1158/0008-5472.CAN-18-1033. [DOI] [PubMed] [Google Scholar]
- 27.Chekkoury A., Nunes A., Gateau J., Symvoulidis P., Feuchtinger A., Beziere N., et al. High-resolution multispectral optoacoustic tomography of the vascularization and constitutive hypoxemia of cancerous tumors. Neoplasia. 2016;18(8):459–467. doi: 10.1016/j.neo.2016.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Haedicke K., Agemy L., Omar M., Berezhnoi A., Roberts S., Longo-Machado C., et al. High-resolution optoacoustic imaging of tissue responses to vascular-targeted therapies. Nat. Biomed. Eng. 2020;4(3):286–297. doi: 10.1038/s41551-020-0527-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Wang X., Pang Y., Ku G., Xie X., Stoica G., Wang L.V. Noninvasive laser-induced photoacoustic tomography for structural and functional in vivo imaging of the brain. Nat. Biotechnol. 2003;21(7):803–806. doi: 10.1038/nbt839. [DOI] [PubMed] [Google Scholar]
- 30.Guggenheim J.A., Allen T.J., Plumb A., Zhang E.Z., Rodriguez-Justo M., Punwani S., et al. Photoacoustic imaging of human lymph nodes with endogenous lipid and hemoglobin contrast. J. Biomed. Opt. 2015;20(5):50504. doi: 10.1117/1.JBO.20.5.050504. [DOI] [PubMed] [Google Scholar]
- 31.Luke G.P., Emelianov S.Y. Label-free detection of lymph node metastases with US-guided functional photoacoustic imaging. Radiology. 2015;277(2):435–442. doi: 10.1148/radiol.2015141909. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Razansky D., Vinegoni C., Ntziachristos V. Multispectral photoacoustic imaging of fluorochromes in small animals. Opt. Lett. 2007;32(19):2891–2893. doi: 10.1364/ol.32.002891. [DOI] [PubMed] [Google Scholar]
- 33.Weber J., Beard P.C., Bohndiek S.E. Contrast agents for molecular photoacoustic imaging. Nat. Methods. 2016;13(8):639–650. doi: 10.1038/nmeth.3929. [DOI] [PubMed] [Google Scholar]
- 34.Stoffels I., Jansen P., Petri M., Goerdt L., Brinker T.J., Griewank K.G., et al. Assessment of nonradioactive multispectral optoacoustic tomographic imaging with conventional lymphoscintigraphic imaging for sentinel lymph node biopsy in melanoma. JAMA Netw. Open. 2019;2(8) doi: 10.1001/jamanetworkopen.2019.9020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Rosenthal E.L., Moore L.S., Tipirneni K., de Boer E., Stevens T.M., Hartman Y.E., et al. Sensitivity and specificity of cetuximab-irdye800cw to identify regional metastatic disease in head and neck cancer. Clin. Cancer Res. 2017;23(16):4744–4752. doi: 10.1158/1078-0432.CCR-16-2968. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Nishio N., van den Berg N.S., van Keulen S., Martin B.A., Fakurnejad S., Teraphongphom N., et al. Optical molecular imaging can differentiate metastatic from benign lymph nodes in head and neck cancer. Nat. Commun. 2019;10(1) doi: 10.1038/s41467-019-13076-7. 5044-019-13076-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Nishio N., van den Berg N.S., Martin B.A., van Keulen S., Fakurnejad S., Rosenthal E.L., et al. Photoacoustic molecular imaging for the identification of lymph node metastasis in head and neck cancer using an anti-EGFR antibody-dye conjugate. J. Nucl. Med. 2021;62(5):648–655. doi: 10.2967/jnumed.120.245241. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Voskuil F.J., de Jongh S.J., Hooghiemstra W.T.R., Linssen M.D., Steinkamp P.J., de Visscher S.A.H.J., et al. Fluorescence-guided imaging for resection margin evaluation in head and neck cancer patients using cetuximab-800CW: a quantitative dose-escalation study. Theranostics. 2020;10(9):3994–4005. doi: 10.7150/thno.43227. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Linssen M.D., Ter Weele E.J., Allersma D.P., Lub-de Hooge M.N., van Dam G.M., Jorritsma-Smit A., et al. Roadmap for the development and clinical translation of optical tracers cetuximab-800CW and trastuzumab-800CW. J. Nucl. Med. 2019;60(3):418–423. doi: 10.2967/jnumed.118.216556. [DOI] [PubMed] [Google Scholar]
- 40.American Laser Institute. American National Standards for the Safe Use of Lasers ANSI Z136. 1. 2000.
- 41.Wright S.J., Nowak R.D., Figueiredo M.A. Sparse reconstruction by separable approximation. IEEE Trans. Signal. Process. 2009;57(7):2479–2493. [Google Scholar]
- 42.Total-variation regularization with bound constraints. 2010 IEEE International Conference on Acoustics, Speech and Signal Processing: IEEE; 2010.
- 43.Kutyniok G., Lim W., Reisenhofer R. Shearlab 3D: faithful digital shearlet transforms based on compactly supported shearlets. ACM Trans. Math. Softw. 2016;42(1):1–42. [Google Scholar]
- 44.Chowdhury K.B., Prakash J., Karlas A., Justel D., Ntziachristos V. A synthetic total impulse response characterization method for correction of hand-held optoacoustic images. IEEE Trans. Med. Imaging. 2020;39(10):3218–3230. doi: 10.1109/TMI.2020.2989236. [DOI] [PubMed] [Google Scholar]
- 45.Chowdhury K.B., Bader M., Dehner C., Jüstel D., Ntziachristos V. Individual transducer impulse response characterization method to improve image quality of array-based handheld optoacoustic tomography. Opt. Lett. 2021;46(1):1–4. doi: 10.1364/OL.412661. [DOI] [PubMed] [Google Scholar]
- 46.Lawson C.L., Hanson R.J. SIAM; 1995. Solving Least Squares Problems. [Google Scholar]
- 47.Mantri Y., Jokerst J.V. Impact of skin tone on photoacoustic oximetry and tools to minimize bias. Biomed. Opt. Express. 2022;13(2):875–887. doi: 10.1364/BOE.450224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Vonk J., de Wit J.G., Voskuil F.J., Tang Y.H., Hooghiemstra W.T., Linssen M.D., et al. Epidermal growth factor receptor targeted fluorescence molecular imaging for postoperative lymph node assessment in patients with oral cancer. J. Nucl. Med. 2021 doi: 10.2967/jnumed.121.262530. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Fuenzalida Werner J.P., Huang Y., Mishra K., Janowski R., Vetschera P., Heichler C., et al. Challenging a preconception: optoacoustic spectrum differs from the optical absorption spectrum of proteins and dyes for molecular imaging. Anal. Chem. 2020;92(15):10717–10724. doi: 10.1021/acs.analchem.0c01902. [DOI] [PubMed] [Google Scholar]
- 50.Steinkamp PJ, Vonk J, Huisman LA, Meersma G, Diercks GFH, Hillebrands J, et al. VEGF-targeted multispectral optoacoustic tomography and fluorescence molecular imaging in human carotid atherosclerotic plaques. 2021. [DOI] [PMC free article] [PubMed]
- 51.Karaman S., Detmar M. Mechanisms of lymphatic metastasis. J. Clin. Invest. 2014;124(3):922–928. doi: 10.1172/JCI71606. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Zhang S., Zhang D., Yi S., Gong M., Lu C., Cai Y., et al. The relationship of lymphatic vessel density, lymphovascular invasion, and lymph node metastasis in breast cancer: a systematic review and meta-analysis. Oncotarget. 2017;8(2):2863–2873. doi: 10.18632/oncotarget.13752. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Singleton D.C., Macann A., Wilson W.R. Therapeutic targeting of the hypoxic tumour microenvironment. Nat. Rev. Clin. Oncol. 2021;18(12):751–772. doi: 10.1038/s41571-021-00539-4. [DOI] [PubMed] [Google Scholar]
- 54.Bhandari V., Hoey C., Liu L.Y., Lalonde E., Ray J., Livingstone J., et al. Molecular landmarks of tumor hypoxia across cancer types. Nat. Genet. 2019;51(2):308–318. doi: 10.1038/s41588-018-0318-2. [DOI] [PubMed] [Google Scholar]
- 55.Dumani D.S., Sun I.C., Emelianov S.Y. Ultrasound-guided immunofunctional photoacoustic imaging for diagnosis of lymph node metastases. Nanoscale. 2019;11(24):11649–11659. doi: 10.1039/c9nr02920f. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Weber J., Beard P.C., Bohndiek S.E. Contrast agents for molecular photoacoustic imaging. Nat. Methods. 2016;13(8):639–650. doi: 10.1038/nmeth.3929. [DOI] [PubMed] [Google Scholar]
- 57.Luke G.P., Yeager D., Emelianov S.Y. Biomedical applications of photoacoustic imaging with exogenous contrast agents. Ann. Biomed. Eng. 2012;40(2):422–437. doi: 10.1007/s10439-011-0449-4. [DOI] [PubMed] [Google Scholar]
- 58.Tichauer K.M., Wang Y., Pogue B.W., Liu J.T. Quantitative in vivo cell-surface receptor imaging in oncology: kinetic modeling and paired-agent principles from nuclear medicine and optical imaging. Phys. Med. Biol. 2015;60(14):R239–R269. doi: 10.1088/0031-9155/60/14/R239. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Sampath L., Wang W., Sevick-Muraca E.M. Near infrared fluorescent optical imaging for nodal staging. J. Biomed. Opt. 2008;13(4) doi: 10.1117/1.2953498. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Pressman D., Day E.D., Blau M. The use of paired labeling in the determination of tumor-localizing antibodies. Cancer Res. 1957;17(9):845–850. [PubMed] [Google Scholar]
- 61.Tichauer K.M., Samkoe K.S., Gunn J.R., Kanick S.C., Hoopes P.J., Barth R.J., et al. Microscopic lymph node tumor burden quantified by macroscopic dual-tracer molecular imaging. Nat. Med. 2014;20(11):1348–1353. doi: 10.1038/nm.3732. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Nishio N., Fujimoto Y., Hiramatsu M., Maruo T., Tsuzuki H., Mukoyama N., et al. Diagnosis of cervical lymph node metastases in head and neck cancer with ultrasonic measurement of lymph node volume. Auris Nasus Larynx. 2019;46(6):889–895. doi: 10.1016/j.anl.2019.02.003. [DOI] [PubMed] [Google Scholar]
- 63.Boeve K., Schepman K.P., Schuuring E., Roodenburg J.L.N., Halmos G.B., van Dijk B.A.C., et al. High sensitivity and negative predictive value of sentinel lymph node biopsy in a retrospective early stage oral cavity cancer cohort in the Northern Netherlands. Clin. Otolaryngol. 2018 doi: 10.1111/coa.13107. [DOI] [PubMed] [Google Scholar]
- 64.Stoeckli S.J., Steinert H., Pfaltz M., Schmid S. Sentinel lymph node evaluation in squamous cell carcinoma of the head and neck. Otolaryngol. Head Neck Surg. 2001;125(3):221–226. doi: 10.1067/mhn.2001.118074. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.