Abstract
Optical biomedical imaging in short wave infrared (SWIR) range within 0.9–1.7 μm is a rapidly developing technique. For this reason, there is an increasing interest in cost-effective and robust hardware for hyperspectral imaging data acquisition in this range. Tunable-filter-based solutions are of particular interest as they provide image processing flexibility and effectiveness in terms of collected data volume. Acousto-optical tunable filters (AOTFs) provide a unique set of features necessary for high-quality SWIR hyperspectral imaging. In this paper, we discuss a polarizer-free configuration of an imaging AOTF that provides a compact and easy-to-integrate design of the whole imager. We have carried out image quality analysis of this system, assembled it and validated its efficiency through multiple experiments. The developed system can be helpful in many hyperspectral applications including biomedical analyses.
Keywords: spectral imaging, hyperspectral imaging, acousto-optical tunable filter, Bragg diffraction, short wave infrared range
1. Introduction
Hyperspectral imaging (HSI), also known as imaging spectroscopy, is an increasingly powerful non-invasive method in biomedicine [1,2,3]. It has been proven effective in multiple applications for accurate localization of pathological tissues and quantitative characterization of their spectral properties. Biomedical applications of HSI include intraoperative brain tumor delineation [4], detection of arthritis [5], gastrointestinal tract inspection [6], diagnosis of colon cancer [7], etc. By integrating HSI with microscopy, endoscopy or other optical visualization methods, one can acquire a three-dimensional hyperspectral data cube with proper resolution and extract spatial, spectral, and texture characteristics of the inspected object.
HSI in the short wave infrared (SWIR) range is of particular interest due to lower autofluorescence and scattering of biological tissues. In this range, spectral imaging provides a higher signal-to-noise ratio and higher imaging depth in comparison to those in visible and near infrared ranges. In biomedicine, it is in use for head tissues analysis [8]; studying lymphatic and brain vasculature using fluorescent dye [9]; multiplexed photoluminescence visualization of nanoparticles [10]; some tasks related to lipids, water, or collagen analysis [11]; etc. Acquisition of a hyperspectral data cube may be implemented using different snapshot and scanning techniques [1,12,13,14]. For non-moving objects, spectral scanning by means of an imaging tunable filter seems to be an optimal solution. It provides arbitrary wavelength addressing as well as a good combination of spatial and spectral resolution, acquisition speed and data volume. Acousto-optical tunable filters (AOTFs) based on Bragg diffraction of light by ultrasonic waves seem to be the most promising components for spectral-scanning HSI devices. They provide high spectral (up to 0.1 nm) and spatial (up to 1000 × 1000 resolved elements) resolution, fast (less than 10 µs) and precise wavelength tuning, compactness, no-moving elements design and low power consumption, interactive control of transmission function shape, and programmability. Due to a well-developed technology, AOTFs may be compact and PC-controlled modules, ready for integration into many existing optical schemes. Modern AOTF design methods enable high-throughput and distortion-free imaging, since the methods of proper diffraction geometry choice, accurate AOTF design, and precise optical coupling are well-developed [15,16,17]. As a result, AOTF-based imagers nowadays have numerous applications, in particular for the SWIR range [18,19,20,21,22].
AOTF normally consists of an acousto-optical (AO) crystal located between two crossed polarizers, which are necessary to stop the non-diffracted beam. Polarizing elements increase dimensions, weight, and the cost of the optical system, and hamper the integration of off-the-shelf AOTFs into optical systems. In this regard, a polarizer-free AOTF design, previously demonstrated for non-imaging devices [23], seems especially attractive to be adapted for imaging applications. In this paper, we present an original biomedical SWIR imaging AOTF system, which minimizes aberrations. Such imagers are demanded in microscopy, endoscopy and other biomedical applications. We describe the aberrational analysis of the optical system, the design, and basic technical characteristics. In this article, starting from the physical principles and aberrational analysis, we develop the optimal scheme of the imager and demonstrate its capabilities.
2. Theoretical Background
For precise aberrational analysis, the physical principles of the proposed method should be considered. First, we need to determine an appropriate geometry of the Bragg diffraction, then we must define the optimal shape and parameters of the AO cell and, finally, we can estimate the characteristics of the entire optical system.
In non-collinear geometry, the diffracted wave is deflected, so it can be separated from the incident beam without polarizers. In polarizer-free configuration, non-polarized light entering the crystalline AO cell splits into orthogonally polarized ordinary (“o”) and extraordinary (“e”) modes. Both polarization components are selectively diffracted by the same acoustic wave, being deflected in opposite sides with up- and down-conversion of the frequency according to Bragg conditions:
kie + q − kdo ≡ Δkeo ≈ 0, | (1) |
kio − q − kde ≡ Δkoe ≈ 0. |
Here, Δk is wave-vector mismatch, which should be small enough for effective diffraction, kio, kie, kdo, kde—wave vectors of incident (i) and diffracted (d) light waves of ordinary (o) and extraordinary (e) polarization; q—wave vector of acoustic wave. In general case, these conditions are satisfied for optical components of different frequency (or wavelength), but for some angles of incidence θ, which depend on acoustic propagation angle γ, the same wavelength λ is selected for both polarization components (Figure 1). Based on this principle, dual-channel bi-polarization AOTFs can be designed [24,25], which are capable of simultaneous separation of two polarization components (“o” and “e”) of the same wavelength defined by the acoustic wave frequency.
For imaging applications, there is another important requirement: so-called wide-angle or wide-aperture geometry [26]. To achieve a rather large field of view, one needs to provide Bragg condition satisfaction in a wide range of incident angles that are equivalent to parallel tangent geometry. This condition imposes a link upon angles θ and γ for each mode of diffraction: e→o and o→e. As a result, for each incident angle there is an acoustic angle γ, called a crystal cut angle. For each γ, which is fixed for a given AO cell, there are two values of angle θ, which provide non-critical phase matching in some angle range (Figure 2a). The deflection angle (Figure 2b) is almost the same for both modes and depends on incident angle θ and wavelength λ:
(2) |
As can be seen from Figure 2, the dependences γ(θ) for two modes differ a little. There is a unique value of incident angle θ ≈ 35°, where the plots intersect [27], and with the corresponding cut angle γ ≈ 19.5° the dual-channel bi-polarization imaging AOTF can be designed. Unfortunately, this particular geometry is based on a rather large cut angle γ related to low figure-of-merit M2 and higher ultrasonic frequencies. That is why in practice, small angles (γ < 10°) are preferred. Thus, we developed a single-channel polarizer-free imaging AOTF, which selects only one linear polarization component, while the other is stopped with a diaphragm as well as a non-diffracted beam (Figure 3).
3. Optical System Design and Optimization
Here, we consider e→o geometry of diffraction, while the other mode o→e can be described in the same way with very similar results.
The principle condition is preventing overlapping of images formed by diffracted and non-diffracted beams. The angular distance between the chief rays of two beams is the out-of-crystal deflection angle σ, so the maximum acceptable angular size of the spectrally selected image ωAOTF should be the same to prevent overlapping:
(3) |
where we omit the subscripts of refraction index n and inner deflection angle δ, and also we neglect the small tilt of the back facet of the AO crystal cell [16]. The relation between apertures is determined by the focal length ratio:
(4) |
The key characteristic of the system is the number of resolvable image elements, which is limited by the value of the beam divergence ψ. This angle is determined by the size DAOTF of the beam inside the AOTF formed by entrance aperture (see Figure 3 below):
(5) |
According to Equations (2) and (5), we may conclude that N significantly depends on the incident angle θ as well as the wavelength λ (Figure 4). Since the acceptable resolution limit depends on the particular application, the calculated dependence N(θ,λ) can be used for a preliminary estimation of the applicability of the polarizer-free imaging AOTF. An aberration analysis of the optical system can be accomplished according to the procedure described in detail in our previous work [16].
4. Polarizer-Free AOTF Imager Schemes
The considered approach to system design is applicable both to collimating and confocal schemes [16]. In the collimating scheme, the input and output diaphragms are field stops, and the rays shown in Figure 3 are the chief rays. In the confocal scheme, these diaphragms are the entrance and the exit pupils, and the rays refer to the axial beam.
The confocal polarizer-free scheme of AOTF-based hyperspectral imaging system (Figure 5a) consists of an input optical unit I and the primary unit II containing AOTF, optical coupler, and camera. The input unit may vary with respect to imager application. For example, it may be implemented as an afocal system (Figure 5a) consisting of negative O1 and positive O2 lenses and providing magnification necessary for imaging infinite distant objects. Lens L1 focuses the image onto the acoustic grating inside the AOTF. The size of the intermediate image is close to DAOTF. Lenses L2 and L3 project the image onto sensor S with magnification m = f3/f2. To cover the sensor area completely, this magnification should be equal to m = S/DAOTF. The aperture stop of lens L3 also represents output diaphragm A2.
The input unit I for the polarizer-free collimating scheme (Figure 5b) contains lens O1, which forms an image in the plane of the input diaphragm. The input angular field is defined by the focal length fO1 of lens O1: . Lens L1 collimates light, and L2 focuses it on the sensor. In this scheme, the sensor S serves as the output diaphragm A2. In both schemes, the relationships between f1, f2, D1, and D2 are described by Equation (4).
Both considered schemes are applied in practice. But the optical aberrations introduced by the AOTF into the image are different in these schemes. For example, the main aberration in a confocal scheme is longitudinal chromatic focal shift. There is also a transverse chromatic image drift, but it can be almost completely compensated for by inclination of the AO cell output face versus the input face. In a collimating scheme, the primary aberration is transverse chromatic drift, and to eliminate it a quite different angle of inclination should be chosen. Thus, each scheme is preferable for particular tasks. Aberration analysis and optimization procedure are described in detail in our previous work [16].
5. Results and Discussion
To confirm the theoretical considerations, we assembled the experimental setup shown in Figure 6. The imaging AOTF (γ = 7°, DAOTF = 9 mm) for wide-aperture e→o diffraction with angle of incidence θ = 73.9° was designed and manufactured. The spectral range 0.9–1.7 μm was provided by acoustic frequency tuning in the range 30–60 MHz. The spectral bandwidth was 10 nm at λ = 1.06 μm. The deviation angle was δ = 1.8° and the angular aperture of the AOTF was ωAOTF = 4°. The maximum resolution in this case was N = 600 at λ = 0.9 μm and N = 350 at λ = 1.7 μm. The geometry of the AO crystal cell was optimized for minimization of the image chromatic shift in the confocal scheme shown in Figure 5a.
For the experiments, we assembled the system shown in Figure 6 with an InGaAs sensor (320 × 256 pixels, 30 × 30 μm2 pixel area). To provide optimal image magnification, the microscope objective lens O1 with a focal length 10 mm was used as the input optical unit I. The aperture diaphragm A1 located at the focal plane of the lens L1 provides a telecentric light propagation through the AOTF. Its diameter is D1 = 5 mm, which ensures the AOTF angular aperture . The focal lengths of the L1, L2 and L3 lenses are 75 mm, 50 mm and 95 mm, respectively. A magnification of the whole system is 14.25 which provides a field of view of 0.54 × 0.67 mm2. An intermediate image size inside the AO crystal is 4 × 5 mm2.
To verify the resolution, we recorded the images of the standard test chart (Figure 7). For comparison, we determined the resolution experimentally, both in the polarizer-free configuration () and in configuration with the polarizer (). The theoretical number of resolvable elements Nx × Ny along vertical (x) and horizontal (y) axes were calculated, taking into account the sensor resolution:
(6) |
where NAOx = NAOy = N is AOTF resolution calculated using Equation (5), NSx × NSy = 320 × 256 pixels is the sensor resolution.
Comparison reveals good agreement between experiment and theory (Table 1). The resolution in the polarizer configuration is slightly lower than in the polarizer-free scheme. Moreover, during measurements, it was necessary to increase the exposure time by 1.5 times to obtain the same image intensity as in the polarizer-free scheme.
Table 1.
λ, μm | |||
---|---|---|---|
1.0 | 180 × 210 | 170 × 200 | 160 × 200 |
1.2 | 170 × 200 | 170 × 200 | 150 × 200 |
1.4 | 160 × 180 | 150 × 180 | 140 × 160 |
1.6 | 150 × 170 | 140 × 160 | 120 × 140 |
To test the system for biomedical applications, we acquired a series of 22 spectral images of a human elbow pit illuminated by an incandescent lamp (Figure 8a–e). The reflectivity spectrum of the region of interest (ROI) was calculated as a ratio of the brightness of each spectral image, averaged over ROI for and normalizing upon the spectral brightness of a white sheet of paper illuminated by the lamp. The spectrum of the human arm measured by the developed system (Figure 8f) exhibits key features of a human skin spectrum demonstrated earlier [28].
6. Conclusions
In this paper, we have addressed a single-channel polarizer-free concept of an imaging AOTF. We analyzed the problem of polarizer-free AOTFs and stated the possibility, in principle, of dual-channel imaging AOTF implementation. For a single-channel polarizer-free imaging AOTF, we described the procedure of optical system development and specified its main image quality characteristic, which is the number of resolvable image elements and chromatic aberrations. We created the single-channel polarizer-free imaging system for SWIR biomedical applications, and demonstrated its capabilities experimentally for high-quality spectral image capturing and representation of spectral features.
Acknowledgments
This work was performed using the equipment of the Center for Collective Use of the Scientific and Technological Center of Unique Instrumentation of the Russian Academy of Sciences.
Author Contributions
Conceptualization, V.B. and A.M.; data curation, G.M. and M.S.; formal analysis, V.P. and S.B.; funding acquisition, S.B.; methodology, V.B.; resources, V.L. and A.V.; supervision, V.P. and S.B.; visualization, V.B. and G.M.; writing—original draft, V.B. and A.M.; writing—review and editing, G.M., V.P. and S.B. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the Russian Foundation for Basic Research, grant number 18-29-20095. The production of TeO2 crystal for AOTF was supported by Federal State Task Program of the Federal Scientific Research Center “Crystallography and Photonics”.
Conflicts of Interest
The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.
References
- 1.Lu G., Fei B. Medical hyperspectral imaging: A review. J. Biomed. Opt. 2014;19:010901. doi: 10.1117/1.JBO.19.1.010901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Gutiérrez-Gutiérrez J.A., Pardo A., Real E., López-Higuera J.M., Conde O.M. Custom Scanning Hyperspectral Imaging System for Biomedical Applications: Modeling, Benchmarking, and Specifications. Sensors. 2019;19:1692. doi: 10.3390/s19071692. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Halicek M., Fabelo H., Ortega S., Callico G.M., Fei B. In-Vivo and Ex-Vivo Tissue Analysis through Hyperspectral Imaging Techniques: Revealing the Invisible Features of Cancer. Cancers. 2019;11:756. doi: 10.3390/cancers11060756. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Fabelo H., Ortega S., Lazcano R., Madroñal D., M. Callicó G., Juárez E., Salvador R., Bulters D., Bulstrode H., Szolna A., et al. An Intraoperative Visualization System Using Hyperspectral Imaging to Aid in Brain Tumor Delineation. Sensors. 2018;18:430. doi: 10.3390/s18020430. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Milanic M., Paluchowski L.A., Randeberg L.L. Hyperspectral imaging for detection of arthritis: Feasibility and prospects. J. Biomed. Opt. 2015;20:096011. doi: 10.1117/1.JBO.20.9.096011. [DOI] [PubMed] [Google Scholar]
- 6.Yoon J., Joseph J., Waterhouse D.J., Luthman A.S., Gordon G.S.D., di Pietro M., Januszewicz W., Fitzgerald R.C., Bohndiek S.E. A clinically translatable hyperspectral endoscopy (HySE) system for imaging the gastrointestinal tract. Nat. Commun. 2019;10:1902. doi: 10.1038/s41467-019-09484-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Beaulieu R.J., Goldstein S.D., Singh J., Safar B., Banerjee A., Ahuja N. Automated diagnosis of colon cancer using hyperspectral sensing. Int. J. Med. Robot. Comput. Assist. Surg. 2018;14:e1897. doi: 10.1002/rcs.1897. [DOI] [PubMed] [Google Scholar]
- 8.Golovynskyi S., Golovynska I., Stepanova L.I., Datsenko O.I., Liu L., Qu J., Ohulchanskyy T.Y. Optical windows for head tissues in near-infrared and short-wave infrared regions: Approaching transcranial light applications. J. Biophotonics. 2018;11:e201800141. doi: 10.1002/jbio.201800141. [DOI] [PubMed] [Google Scholar]
- 9.Hong G., Antaris A.L., Dai H. Near-infrared fluorophores for biomedical imaging. Nat. Biomed. Eng. 2017;1:0010. doi: 10.1038/s41551-016-0010. [DOI] [Google Scholar]
- 10.Yakovliev A., Ziniuk R., Wang D., Xue B., Vretik L.O., Nikolaeva O.A., Tan M., Chen G., Slominskii Y.L., Qu J., et al. Hyperspectral Multiplexed Biological Imaging of Nanoprobes Emitting in the Short-Wave Infrared Region. Nanoscale Res. Lett. 2019;14:243. doi: 10.1186/s11671-019-3068-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Wilson R.H., Nadeau K.P., Jaworski F.B., Tromberg B.J., Durkin A.J. Review of short-wave infrared spectroscopy and imaging methods for biological tissue characterization. J. Biomed. Opt. 2015;20:030901. doi: 10.1117/1.JBO.20.3.030901. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Hagen N., Kudenov M.W. Review of snapshot spectral imaging technologies. Opt. Eng. 2013;52:090901. doi: 10.1117/1.OE.52.9.090901. [DOI] [Google Scholar]
- 13.Li Q., He X., Wang Y., Liu H., Xu D., Guo F. Review of spectral imaging technology in biomedical engineering: Achievements and challenges. J. Biomed. Opt. 2013;18:100901. doi: 10.1117/1.JBO.18.10.100901. [DOI] [PubMed] [Google Scholar]
- 14.Chang C.-I. Hyperspectral Imaging: Techniques for Spectral Detection and Classification. Springer; Berlin, Germany: 2003. [Google Scholar]
- 15.Suhre D.R., Denes L.J., Gupta N. Telecentric confocal optics for aberration correction of acousto-optic tunable filters. Appl. Opt. 2004;43:1255. doi: 10.1364/AO.43.001255. [DOI] [PubMed] [Google Scholar]
- 16.Machikhin A., Batshev V., Pozhar V. Aberration analysis of AOTF-based spectral imaging systems. J. Opt. Soc. Am. A. 2017;34:1109. doi: 10.1364/JOSAA.34.001109. [DOI] [PubMed] [Google Scholar]
- 17.Voloshinov V.B., Yushkov K.B., Linde B.B.J. Improvement in performance of a TeO2 acousto-optic imaging spectrometer. J. Opt. A: Pure Appl. Opt. 2007;9:341–347. doi: 10.1088/1464-4258/9/4/006. [DOI] [Google Scholar]
- 18.He Z., Shu R., Wang J. Imaging spectrometer based on AOTF and its prospects in deep-space exploration application. In: Zarnecki J.C., Nardell C.A., Shu R., Yang J., Zhang Y., editors. Proc. SPIE 8196, International Symposium on Photoelectronic Detection and Imaging 2011: Space Exploration Technologies and Applications. SPIE; Bellingham, WA, USA: 2011. [Google Scholar]
- 19.Gupta N. Proceedings of the Polarization: Measurement, Analysis, and Remote Sensing XI. SPIE; Bellingham, WA, USA: 2014. Development of spectropolarimetric imagers from 400 to 1700 nm. [Google Scholar]
- 20.Korablev O.I., Belyaev D.A., Dobrolenskiy Y.S., Trokhimovskiy A.Y., Kalinnikov Y.K. Acousto-optic tunable filter spectrometers in space missions [Invited] Appl. Opt. 2018;57:C103. doi: 10.1364/AO.57.00C103. [DOI] [PubMed] [Google Scholar]
- 21.Gao Z., Zeng L., Wu Q. AOTF-based near-infrared imaging spectrometer for rapid identification of camouflaged target. In: Rolland J.P., Yan C., Kim D.W., Ma W., Zheng L., editors. Proc. SPIE 9298, International Symposium on Optoelectronic Technology and Application 2014: Imaging Spectroscopy; and Telescopes and Large Optics. SPIE; Bellingham, WA, USA: 2014. p. 92980R. [Google Scholar]
- 22.Gupta N., Suhre D.R. Notch filtering using a multiple passband AOTF in the SWIR region. Appl. Opt. 2016;55:7855–7860. doi: 10.1364/AO.55.007855. [DOI] [PubMed] [Google Scholar]
- 23.Epikhin V.M., Vizen F.L., Magomedov Z.A., Pal’tsev L.L. Polarizer-Free Acousto-Optic Monochromators. Tech. Phys. 2018;63:1040–1043. doi: 10.1134/S1063784218070113. [DOI] [Google Scholar]
- 24.Voloshinov V.B., Molchanov V.Y., Babkina T.M. Acousto-optic filter of nonpolarized electromagnetic radiation. Tech. Phys. 2000;45:1186–1191. doi: 10.1134/1.1318107. [DOI] [Google Scholar]
- 25.Voloshinov V.B., Molchanov V.Y., Mosquera J.C. Spectral and polarization analysis of optical images by means of acousto-optics. Opt. Laser Technol. 1996;28:119–127. doi: 10.1016/0030-3992(95)00079-8. [DOI] [Google Scholar]
- 26.Chang I.C. Noncollinear acousto-optic filter with large angular aperture. Appl. Phys. Lett. 1974;25:370–372. doi: 10.1063/1.1655512. [DOI] [Google Scholar]
- 27.Pozhar V., Machihin A. Image aberrations caused by light diffraction via ultrasonic waves in uniaxial crystals. Appl. Opt. 2012;51:4513. doi: 10.1364/AO.51.004513. [DOI] [PubMed] [Google Scholar]
- 28.Randeberg L.L., Hernandez-Palacios J. Proceedings SPIE 8207, Photonic Therapeutics and Diagnostics VIII. Volume 8207. SPIE; Bellingham, WA, USA: 2012. Hyperspectral imaging of bruises in the SWIR spectral region; p. 82070N-9. [Google Scholar]