Abstract
Light scattering inhibits high-resolution optical imaging, manipulation and therapy deep inside biological tissue by preventing focusing. To form deep foci, wavefront shaping techniques that break the optical diffusion limit have been developed. For in vivo applications, such focusing must provide high gain, high speed, and a high focal peak-to-background ratio. However, none of the previous techniques meet these requirements simultaneously. Here, we overcome this challenge by rapidly measuring the perturbed optical field within a single camera exposure followed by adaptively time-reversing the phase-binarized perturbation. Consequently, a phase-conjugated wavefront is synthesized within a millisecond, two orders of magnitude shorter than the digitally achieved record. We demonstrated real-time focusing in dynamic scattering media, and extended laser speckle contrast imaging to new depths. The unprecedented combination of fast response, high gain, and high focusing contrast makes this work a major stride toward in vivo deep tissue optical imaging, manipulation, and therapy.
OCIS codes: (110.0180) Microscopy, (110.0113) Imaging through turbid media, (070.5040) Phase conjugation
1. INTRODUCTION
Visible and near-infrared photons occupy a unique portion of the electromagnetic spectrum: Through non-carcinogenic molecular interaction with biological tissue and exogenous agents, they provide rich structural and physiological information [1] and noninvasive solutions for manipulation [2], control [3], and therapy [4]. However, these photons undergo severe scattering in tissue, rendering traditional control over their propagation completely ineffective beyond the optical diffusion limit — about 1 mm in biological tissue [5,6]. Such scattering shuts the door to important diagnostic and therapeutic applications at depths.
In recent years, the optical diffusion limit has been conquered by two categories of wavefront shaping (WFS) techniques: iterative WFS and optical time reversal. In iterative WFS [7–13], a subset of the transmission matrix [14] of the scattering medium is measured iteratively. Subsequently, the phase of the light is controlled spatially to compensate for the inhomogeneous delays due to random scattering, generating a focus through constructive interference. In optical time reversal, the optical wavefront from a real [15–17] or virtual guide star [18–20] is detected, and its phase-conjugated copy is converged back to the origin. A feasible approach to achieving time reversal is through optical phase conjugation (OPC) [21–23].
Due to the highly dynamic and scattering nature of living tissue, it is important that the focusing be sufficiently fast (ideally with a response time of ~1 ms [24,25]) and have high quality (i.e., having a large number of independent control elements for high focal peak-to-background ratio (PBR) [14]). Consequently, an important figure of merit is the average mode time (i.e., the average operation time per spatial mode [7, 8, 14]), which should ideally approach 1 ps/mode (for a 1 ms response time with a billion modes).
However, the average mode times achieved by existing techniques are orders-of-magnitude greater than 1 ps/mode, preventing any practical applications in biological tissue. For example, iterative WFS achieved an average mode time of 145 μs/mode (37 ms for 256 spatial modes [12]) in the fastest implementation of this technique. Ultimately, when data transfer and processing times are assumed negligible, iterative WFS can achieve an average mode time of 18 μs/mode by employing a digital micromirror device (DMD) for wavefront control [8,12,13]. In contrast, because OPC measures the desired wavefront at once, it is potentially faster. Analog OPC [18,21,22,25] approaches based on nonlinear optical crystals have demonstrated a short average mode time (≈100 ps/mode, a 10 ms response time for 107 modes [25]), but suffered from an energy gain (defined as the ratio of the focal light energy in the reading phase to that in the probing phase) well below unity, which is a drawback detrimental to wide-spread applications. In comparison, digital OPC (DOPC) [15,19,20] provides inherently large gains and reasonably fast response, with 2 μs/mode being recently realized for focusing inside scattering media [26] (100 ms response time with 50,000 spatial modes). The lowest possible average mode time (≈ 60 ns/mode) for previous DOPC techniques is dictated by the phase modulation speed (assuming a 30 ms settling time and 5×105 spatial modes), and it is still four orders of magnitude longer than the goal of 1 ps/mode. To break through this limit, the slow phase modulation must be replaced by faster binary amplitude or phase modulation [27], which could potentially reach 36 ps/mode using a DMD (assuming an 18 μs settling time [13] and 5×105 spatial modes). To date, none of the existing DOPC technologies for focusing inside scattering media have been demonstrated using binary modulation.
Here we address this challenge by demonstrating light focusing inside scattering media using binary phase modulation. The technology, named binarized time-reversed adapted-perturbation optical focusing (b-TRAP), has achieved the shortest average mode time to date (≈ 300 ns/mode) among all methods developed for focusing inside scattering media with high energy gain. Compared with the binary-amplitude WFS technology [13] that finds and utilizes the same binary mask, our technology uses an adaptive mask, enhances the speed by 105 times, and doubles the focusing quality at no additional cost. More strikingly, we show that by using b-TRAP, the formation time of the binary mask is determined only by the laser pulse interval, which is highly tunable and can be less than 1 μs. These features not only facilitate fast light focusing, but also enable us to acquire detailed information about tissue dynamics (such as blood flow speed). The demonstrated capabilities pave the way toward in vivo deep tissue biophotonics.
2. METHODS
A. Basic principle
Time reversal by analysis of changing wavefronts from kinetic targets (TRACK) and time-reversed adapted-perturbation (TRAP) optical focusing [26,28] employ intrinsic tissue dynamics as guide stars for completely noninvasive and non-contact light focusing inside scattering media. In short, if the scattered fields at two instants are recorded in the presence of internal dynamic perturbations (e.g., absorption or refractive index changes), subtracting the two fields generates a differential field, whose conjugate copy enables focusing at the perturbed sites by cancelling the scattering contribution originating from the static portion of the medium.
The original TRAP focusing [28] relied on phase-shifting holography [29] to record the complex amplitude of the scattered electromagnetic fields, which took multiple intensity measurements to accomplish and was impractically slow for many applications. In comparison, b-TRAP measures each field indirectly within the time duration of a single laser pulse. As shown in Fig. 1(a), at instant t1, a short laser pulse probes the scattering medium in which the permittivity of the target (i.e., the guide star) is ε(t1). The exterior scattered light field, termed the “sample beam”, whose complex amplitude is expressed as Es(t1), is combined with a planar reference beam ER on an amplitude-only spatial light modulator (SLM). The SLM surface is imaged onto a scientific complementary metal oxide semiconductor camera (sCMOS) to generate a time-averaged intensity pattern
(1) |
As shown in Fig. 1(b), at a later instant t2, the above process is repeated, at which time the target permittivity has changed to ε(t2) either from naturally occurring event, such as movement, or from externally induced perturbation. The result is a different intensity pattern:
(2) |
Subtracting the two patterns (Eqs. (1) and (2)) generates multiple terms:
(3) |
where Δ|Es|2 = |Es(t2)|2 − |Es(t1)|2, and ΔEs = Es(t2) − Es(t1). The second term on the right-hand side of Eq. (3) encodes the TRAP field , which can be reconstructed upon reading an amplitude hologram ΔI with a conjugate reference (reading) beam (Fig. 1(c)). It should be noted that b-TRAP focusing dramatically simplifies the complicated task of complex amplitude measurement, and allows indirect, single laser-shot electric field recording. The advantages of the new technology will be discussed in detail in the next section.
The above focusing procedure can be implemented using the schematic shown in Fig. 1(d). The system employs a Mach-Zehnder interferometric structure where the scattering medium resides in one arm and the planar reference/reading beam is generated in the other. Intensity patterns I(t1) and I(t2) are recorded via an sCMOS camera. The SLM, along with the camera, forms a DOPC system [23]. Adjusting the driving frequencies (f1 and f2) of the two acousto-optic modulators (AOMs) allows the system to work under different operation modes, as detailed in the next section. For a more detailed description of the system setup, see Supplementary Method A of Supplement 1.
B. Operation modes
TRAP relies on embedded novelties [30] to guide light focusing, meaning that the target’s permittivity must be time-variant. Accordingly, the light field scattered by the target continuously decorrelates over time [31]. In real practice, the background medium (e.g., biological tissue) also generates time-variant scattering, resulting in a continuously decorrelating background field. The focusing quality sensitively hinges on the background field decorrelation during the entire time-reversal process [25,32]. Hence, TRAP focusing is valid only if the field from the target decorrelates faster than the field from the surrounding medium. The time interval between the field measurements must be properly chosen to allow for detectable target decorrelation yet a highly correlated background. The above condition is illustrated in Fig. 2(a)–(c). The curves drawn on the upper rows depict distinct correlation decays derived from the target’s and the background’s scattering. During the process, the difference between the two field measurements exposes the target decorrelation against a relatively stable background. For example, the correlation time of flowing blood is on the order of milliseconds, while that of the surrounding tissue varies, but is at least 10 times slower [22,25,33] with proper stabilization.
Note that the duration of each field measurement must be shorter than the target decorrelation time to avoid significant reduction of focal PBR. As shown in Fig. 2(a), the original TRAP focusing scheme relied on digital phase shifting holography, which required at least four laser shots synchronized with four camera exposures to complete a single field measurement. The speed of the method was primarily restricted by the camera frame-rate. For example, if the camera ran at 50 Hz, the minimum duration of four exposures was ~ 60 ms. Consequently, the target needed to be stable within 60 ms, which is impractically long for many applications. Moreover, the second field measurement had to be significantly delayed (e.g., to after 1 s) due to the slow target decorrelation, making the method applicable only to a nearly stable background.
To remove such limitations, the field measurement time must be shortened. As shown in Fig. 2(b), b-TRAP records each of the two fields with a single laser shot, which is accomplished on a time scale defined by the laser pulse width. By using a laser with 6 ns pulse width, the original constraint on the target correlation time is relaxed by 7 orders of magnitude (from 60 ms to 6 ns [28]). Such a fast field measurement makes b-TRAP applicable to almost any biological targets. The phase differences between the reference beam and the static portion of the sample beam are kept constant for the two measurements, and thus digitally subtracting the two intensity patterns directly generates the TRAP field (Eq. (3)). The response speed of the scheme is limited only by the camera frame rate and SLM refresh time. Because it requires two camera exposures, the scheme is named double-exposure b-TRAP focusing.
b-TRAP focusing has been made even more powerful by the single camera-exposure scheme described below (referred to as single-exposure b-TRAP hereafter), which can reduce the hologram formation time by two orders of magnitude in comparison to the state of the art [26]. As shown in Fig. 2(c), in this mode, one camera exposure records two consecutive laser shots, with a π phase shift introduced between the sample and reference beams in the second shot. The intensities of the first and second light pulses are and , respectively. In a single exposure, the two intensities are added automatically by the camera sensor, resulting in a total intensity of
(4) |
where Σ|Es|2 = |Es(t1)|2 + |Es(t2)|2, and the TRAP field is encoded in the third term. By reading the hologram using a planar reading beam, the TRAP field is reconstructed. In this focusing mode, the time interval between the two field measurements is determined by the laser repetition rate, making the procedure independent of the camera frame rate. Thus, a hologram can be formed within less than 1 μs for operation at a >1 MHz laser repetition rate (e.g., by using a mode-locked laser). The ultimate speed is determined only by the image transfer and SLM refresh rates.
The advantage of b-TRAP focusing is demonstrated by the simulation results shown in Fig. 2(d)–(f). In these simulations, a point target moves (downward) inside a dynamic scattering medium. The original TRAP scheme (Fig. 2(a)) fails to focus (Fig. 2(d)) due to its low speed. In vivid contrast, b-TRAP focusing successfully captures the target movement and focuses into the time-variant scattering media with double exposures (Fig. 2(e)) and a single exposure (Fig. 2(f)). However, single-exposure b-TRAP shows the strongest background suppression (Fig. 2(f)), thanks to its higher speed and greater tolerance to medium decorrelation: For TRAP to work, the medium should be stable when Es(t1) and Es(t2) are measured—a requirement most easily fulfilled by the single-exposure scheme. In the simulation, the single-exposure approach yields the highest PBR since the background decorrelates 10 times less than that in double-exposure b-TRAP, and 70 times less than that in traditional TRAP focusing. See Supplementary Method B of Supplement 1 for detailed simulation method.
In the experiment, for double-exposure b-TRAP focusing, the modulation frequencies of AOM1 and AOM2 are set to f1 = 50 MHz (50 MHz is the central frequency of the device) and f2 = −f1 + Δf. The frequency difference is Δf = Nfc, where fc is the frame-rate of the camera and N is a non-negative integer. The laser repetition rate is fL = Mfc, where M is a positive integer. In the single-exposure scheme, the sign of the beat between the sample and reference beams flips from shot to shot, requiring Δf = (N+1/2) fL, where N is a non-negative integer. Laser shots are synchronized with camera exposures, with fL = Mfc (M > 2) and 1/fL < texp < 2/fL, where texp is the camera exposure time.
C. Hologram binarization
Spatial light modulators with binary modulation, such as DMDs, provide much faster actuation in comparison to their continuous-modulation counterparts. As such, the intensity holograms shown in Eqs. (3) and (4) are binarized to facilitate the implementation of b-TRAP focusing on such devices. The binarization process is straightforward: The mean intensity of the hologram is used as a threshold. Pixel values exceeding the threshold are set to unity, otherwise they are set to zero. We used a zero-order block to double the focal PBR by converting binary amplitude to binary phase modulation [27].
The binarization process is subject to contamination from the speckle background (Δ|Es|2 in Eq. (3) and Σ|Es|2 in Eq. (4)), which causes error in the hologram and consequently reduces the focal PBR. In order for the binarization to work properly, the reference beam intensity should be sufficiently large, so that the TRAP term (ΔEs*ER in Eqs. (3) and (4)) dominates. A theoretical model is provided in Supplement 1 Section 2C to show the relationship between the beam ratio Is/IR and the focal PBR. Computer simulations were performed to verify the theory. Simulation and analytical results are co-plotted in Fig. 3 for both the double- and single-exposure sampling schemes. As is evident from the figure, the PBRs undergo continuous reduction when the beam ratio increases.
In b-TRAP focusing, we used an on-axis spatial sampling scheme. It is also possible to use off-axis sampling scheme for both double- and single-exposure TRAP hologram measurement [26]. The advantage of using an off-axis scheme is apparent: By using a sufficiently high carrier spatial-frequency, the TRAP term can be separated from the speckle background in the spatial frequency domain. However, this comes at the expense of reduced spatial bandwidth, resulting in 16 times fewer number of controls in the off-axis scheme compared to the on-axis scheme at the same spatial sampling capacity (i.e., camera pixel count; see Supplement 1 Section 2A for a detailed analysis). Equivalently, the focal PBR will be 16 times lower. According to Fig. 3, as long as the beam ratio is below 6% for single-exposure, and 10 for double-exposure schemes, the on-axis schemes yield higher PBR than their off-axis counterparts. Moreover, to calculate the binary hologram, the off-axis scheme has much higher computational complexity in comparison to the on-axis scheme (see, e.g., Ref. [32]), giving rise to much slower response. Considering all the above factors, we used on-axis sampling scheme, in conjunction with hologram binarization for the subsequent experiments.
3. RESULTS
A. Moving object tracking
Real-time tracking of moving objects has extensive applications [34,35], and TRAP (and TRACK) focusing is the only known optical method that tracks moving objects inside scattering media. A robust tracking system must meet two criteria. First, the time it spends on field measurement must be sufficiently short. Since there is no external control over the objects’ movement speeds, it is essential that the field measurement be accomplished sufficiently fast to accommodate potentially fast field decorrelations. Second, the entire focusing procedure, including measurement, calculation, and display of the hologram, must be finished within a short time span so as to minimize the spatial lag of the focus, and to robustly adapt to any potential host medium decorrelation.
In a demonstration of the original TRAP focusing, the target moved slowly, with an estimated decorrelation time of ~6 s. With the new b-TRAP focusing system, we shortened the field measurement time from 60 ms down to 6 ns, and reduced the repetition period from ~2 s to 140 ms. These speed improvements allowed us to optically track fast moving objects inside scattering media. A simplified experimental setting is depicted in Fig. 4(a), where a black human hair target (~50 μm in diameter), vertically positioned between two optical diffusers (DG10-600, Thorlabs, USA), was mounted onto a motorized stage. The target was moved back and forth in the x direction at a speed of 0.78 mm/s (with an estimated decorrelation time of <60 ms), while b-TRAP focusing was performed at a repetition rate of 7 Hz. A detailed explanation of the timing of the focusing procedure, including key steps and their execution times, are provided in Supplementary Method C of Supplement 1. The focal light intensity distribution was sampled using a beamsplitter onto the detection plane of a CMOS camera (Firefly MV, Point Grey, Canada) to monitor the focusing process in real time. The two-dimensional (2D) light intensity distribution was then averaged along y, condensed into a 1D intensity map, and stacked in time to form an intensity distribution time-trace, as shown in Fig. 4(b). The movement of the target was clearly revealed by the tracking focus. Most of the focusing patterns comprised two foci, typical of TRAP focusing patterns induced by a moving object [28]. As shown in the inset of Fig. 4(b), the twin foci were contributed by the old and the new target positions.
B. Tissue-mimicking phantom experiment
One unique feature of TRAP focusing is its ability to concentrate light onto endogenous contrast agents, such as moving red blood cells (RBCs). As RBCs are exclusively confined within blood vessels, TRAP focusing selectively deposits time-reversed photons onto the vasculature. This feature is potentially useful in applications such as photoacoustic tomography of blood vessels [36] and treatment of port-wine stains [37]. It is important to note that living tissue is associated with two distinct correlation times: A fast decorrelation due to blood flow, and a slow one from the relatively stationary background [25,32]. The TRAP focusing procedure must be able to capture the fast changing information, and to adapt to the slow background evolution.
We demonstrated the above capability in the tissue-mimicking phantom experiment shown in Fig. 5(a). The phantom was composed of two ground-glass diffusers (DG10-600, Thorlabs, USA) as scattering media with a tube (300 μm inner diameter, silicone) containing flowing blood placed vertically in between. The mimic blood vessel was completely invisible outside of the ground glass. To mimic tissue decorrelation with controlled correlation time, the scattering layers were mounted onto a motorized stage with adjustable movement speed. The speckle correlation time [25] of the scattered light was measured as a function of the media’s movement speed, and subsequently fitted according to
(5) |
as shown in Fig. 5(c). From Eq. (5), we were able to pre-set the tissue correlation time by controlling the media’s movement speed. During the focusing demonstration, diluted bovine blood (1 (blood):8 (PBS solution) by volume) was pumped through the silicone tube at a constant flow rate. The moving RBCs perturbed the scattered field, forming targets for time-reversed focusing of the entire vessel. While the focusing procedure was performed at a repetition rate of 7 Hz, the scattering media were translated at various speeds to set the background correlation time to +∞, 0.81 s, 0.41 s, and 0.28 s; the corresponding 2D focal light intensity distributions and 1D cross-sectional intensity profile along x are plotted in Fig. 5 (b) and (d) in subplots (i)–(iv), respectively. Despite an intensity drop, the focus was well preserved, even when the background medium decorrelated within as short as 0.28 s. Such demonstrated capabilities take a quantum leap from an earlier demonstration [28], where the slow response of the system forced us to temporarily stop the blood flow to facilitate field measurements, and required absolutely stationary background media.
C. Deep flow measurement
As shown in the preceding section, blood flow perturbs the scattered light field, which enables time-reversed focusing: The field decorrelation associated with the RBC movement is captured externally and converted to a differential field, the conjugate copy of which ultimately leads to the time-reversed focusing. Two consecutive laser pulses “see” two sets of spatially shifted RBC positions, as illustrated in Fig. 6(a). The displacement d = v × Δt, where v is the flow speed and Δt is the pulse interval. A larger displacement results in greater decorrelation (Fig. 6(d)), creating a stronger differential field (Fig. 6(b)) and a brighter focus (Fig. 6(c)). The focusing power (PTRAP) is a function of RBC displacement:
(6) |
where , D is the average diameter of the moving particle and Pmax is the maximum power, see Supplementary Method D of Supplement 1 for detailed analysis.
At fixed Δt, d was adjusted by varying v, giving rise to dramatically different focal PBR. Blood flow speed was controlled by a motorized syringe pump during the measurement. We used a hybrid scheme to generate the digital hologram for the best focal PBR. Two laser repetition rates were employed during the test: fL = 500 Hz and fL = 800 Hz. For fL = 500 Hz, fc = 12.5 Hz, Δf= 250 Hz, and texp= 3 ms. For fL = 800 Hz, fC = 12.5 Hz, Δf= 400 Hz, and texp = 2 ms. At a fixed flow speed, 51 single-exposure b-TRAP holograms were recorded, and the hybrid holograms were calculated using HH,i = HSE,i+1 − HSE,i (i = 1,…,50), where HH,i represents the i-th hybrid hologram, and HSE,i denotes the i-th single-exposure hologram. The focal PBR was then characterized using a CMOS camera (Firefly MV, Point Gray, Canada) by averaging over the 50 corresponding focal light patterns. Repeating the above procedure at various flow speeds produced the experimental results shown in Fig. 6(e). To finalize the characterization process, the results were then fitted using a nonlinear least-squares model to Eq. (6), with Pmax and D as unknown parameters. Experimental results are compared with theoretical ones for Δt = 2 ms (500 Hz laser repetition rate) and Δt = 1.25 ms (800 Hz laser repetition rate) in Fig. 6(e). The theoretical curves were plotted based on Eq. (6), with Pmax and D fitted to the experimental data. The effective RBC diameters were found to be 3.4 μm and 3.2 μm for Δt = 2 ms and 1.25 ms, respectively; the difference is attributed to measurement noise. For flow measurement, the laser repetition rate can be swept to scan d, and v is then readily obtained by fitting. The focal PBR and location can be acquired photoacoustically [38].
In the experiment, the interval between the two field measurements must be precisely adjustable and can be squeezed below the target decorrelation time. Among all technologies developed to date, only single-exposure b-TRAP focusing has this unique capability. It is important to note that in such working mode, the time to generate a hologram is entirely dependent on the laser pulse interval (as opposed to the camera frame-rate), which is short and highly adjustable. Consequently, the finely and broadly tunable Δt makes the method extremely appealing due to its large dynamic range: It can measure both slow [39] and fast [40] flow, and extends laser speckle contrast imaging of blood flow [31] into the diffusive regime.
4. DISCUSSION AND CONCLUSION
We discovered that the b-TRAP mask is equivalent to the hologram generated by the binary amplitude iterative WFS technique [13], but we doubled the PBR by employing a zero-order block for binary phase modulation [27] (see Supplementary Discussion C of Supplement 1 for details). Using a DMD, the binary amplitude iterative WFS technique took several minutes to find the mask with 3228 degrees of freedom (DOF; i.e., controlled number of spatial modes); the limited speed was attributed to the iterative algorithm and data transfer between a personal computer and the DMD. In comparison, b-TRAP focuses in 143 ms with a DOF of 5×105, equivalently 105 faster than the iterative WFS approach on a per mode basis.
In OPC, two types of systems were developed. The analog systems perform optical phase conjugation using nonlinear crystals. The response of such systems can be fast, ranging from milliseconds [25] to microseconds [41]. The DOF of the analog systems are large [25], and can exceed 107. Nevertheless, the gain of the systems is low. Despite a large power gain recently demonstrated using pulsed hologram readout [42], the achievable energy gain is still well below unity. Without large energy gains, many applications are still infeasible.
In digital systems, optical phase conjugation is accomplished by digital spatial light modulators, which can provide high gains [20]. However, the low camera frame rates significantly limit the field measurement times and the overall speeds. A single-shot off-axis holographic scheme has been employed to reduce the field measurement time and accelerate focusing [32]. However, the speed improvement compromises spatial resolution and reduces the total number of DOF significantly (see Supplementary Discussion A of Supplement 1). In contrast, b-TRAP focusing achieves a similar field measurement time (enabled by single-shot holographic recording) while preserving the number of DOF; thus, the technology has the shortest average mode time among all digital systems developed to date (We have demonstrated an average mode time of ~0.3 μs/mode, using a focusing repetition rate of 7 Hz and 5×105 spatial modes). Moreover, for double-exposure b-TRAP focusing, the computational load is significantly reduced compared to other digital approaches. It took ~30 ms on a computer with 3.6 GHz quad-core i7 CPU (Intel, USA) and 1600 MHz memory frequency for Matlab to generate a binary mask with 1920×1080 resolution. The single-exposure scheme further improves the focusing speed by automatically forming the TRAP hologram within one camera exposure, thereby decoupling the speed from the camera frame-rate and hologram computation time, leaving the ultimate speed defined by the rates of data transfer and SLM actuation. In deep flow measurements, we have achieved a hologram formation time of 1.25 ms, which is nearly two orders of magnitude shorter than that of the state-of-the-art technique [26]. By using a pulsed laser with >1 MHz repetition rate, the hologram formation time can be further reduced to below 1 μs, sufficiently fast for most biological applications. Moreover, this unique capability allows us to not only detect, but also quantify target decorrelation during time-reversal (which is the key to deep flow measurement).
The demonstrated binary modulation makes b-TRAP focusing implementable on DMDs with minimal system modification, which can potentially further improve light focusing speed and make in vivo applications possible. Currently, besides low speed, the number of DOF supported by the liquid-crystal-based SLM is insufficient for most real applications, since the resultant low focal PBR in deep tissue is unsuitable for applications such as imaging, therapy or control. On the other hand, the DMD has recently emerged as an attractive solution for optical time reversal thanks to its high speed [8,12,13,27,43–48], and its relatively low price makes the use of multiple devices in parallel affordable, which can potentially increase the total number of DOF dramatically. The method invented herein can be integrated with other time-reversal based approaches, such as ultrasonically encoded focusing (TRUE) [18–20], to improve their speeds and efficiencies.
Single-exposure b-TRAP focusing has a smaller diffraction efficiency than the double-exposure approach because the ratio of the TRAP component in the hologram is lower. As dictated by the nature of amplitude modulation, b-TRAP schemes have weaker diffraction compared to those focusing methods implementing phase modulations; the focusing efficiency is about 10 times lower (see Supplementary Discussion B of Supplement 1). It is important to note that lower diffraction efficiency does not necessarily lead to lower PBR (which determines the focusing quality). The light reflected as the zeroorder component can be effectively blocked by a spatial filter, leading to binary phase modulation with a focal PBR ~40% of that attainable using a phase-only approach (see Supplementary Discussion C of Supplement 1). To compensate for the lower reflectivity, stronger input light can be used as long as damage to the SLM is avoided. Multiple DMDs can work in parallel to further enhance the energy gain.
In sum, optical time reversal techniques promise to revolutionize biomedical optics by dramatically extending the depth of optical focusing inside tissue. However, several key factors, including gain, speed, and focal PBR, must be simultaneously improved to implement these techniques in vivo. b-TRAP focusing has shown great potential in fulfilling all these criteria and in bridging the gap between laboratory explorations and real-world applications of deep tissue biophotonics. The technology has anticipated applications in deep-tissue molecular imaging [49], flow measurement and cytometry [26], photodynamic therapy [50], optogenetics [51], micro-surgery [4], and more.
Supplementary Material
Acknowledgments
National Institutes of Health (DP1 EB016986, R01 CA186567).
We thank Song Hu for discussions about the flow measurement experiment, and James Ballard for editing the manuscript.
Footnotes
References
- 1.Wang LV, Wu H-i. Biomedical optics: principles and imaging. John Wiley & Sons; 2012. [Google Scholar]
- 2.Grier DG. A revolution in optical manipulation. Nature. 2003;424:810–816. doi: 10.1038/nature01935. [DOI] [PubMed] [Google Scholar]
- 3.Boyden ES, Zhang F, Bamberg E, Nagel G, Deisseroth K. Millisecond-timescale, genetically targeted optical control of neural activity. Nat Neurosci. 2005;8:1263–1268. doi: 10.1038/nn1525. [DOI] [PubMed] [Google Scholar]
- 4.Yanik MF, Cinar H, Cinar HN, Chisholm AD, Jin Y, Ben-Yakar A. Neurosurgery: functional regeneration after laser axotomy. Nature. 2004;432:822–822. doi: 10.1038/432822a. [DOI] [PubMed] [Google Scholar]
- 5.Ntziachristos V. Going deeper than microscopy: the optical imaging frontier in biology. Nat Methods. 2010;7:603–614. doi: 10.1038/nmeth.1483. [DOI] [PubMed] [Google Scholar]
- 6.Liu Y, Zhang C, Wang LV. Effects of light scattering on optical-resolution photoacoustic microscopy. J Biomed Opt. 2012;17:126014. doi: 10.1117/1.JBO.17.12.126014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Vellekoop IM, Mosk AP. Focusing coherent light through opaque strongly scattering media. Opt Lett. 2007;32:2309–2311. doi: 10.1364/ol.32.002309. [DOI] [PubMed] [Google Scholar]
- 8.Conkey DB, Caravaca-Aguirre AM, Piestun R. High-speed scattering medium characterization with application to focusing light through turbid media. Opt Express. 2012;20:1733–1740. doi: 10.1364/OE.20.001733. [DOI] [PubMed] [Google Scholar]
- 9.Chaigne T, Katz O, Boccara AC, Fink M, Bossy E, Gigan S. Controlling light in scattering media non-invasively using the photoacoustic transmission matrix. Nature Photon. 2014;8:58–64. [Google Scholar]
- 10.Tay JW, Lai P, Suzuki Y, Wang LV. Ultrasonically encoded wavefront shaping for focusing into random media. Sci Rep. 2014;4:3918. doi: 10.1038/srep03918. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Lai P, Wang L, Tay JW, Wang LV. Photoacoustically guided wavefront shaping for enhanced optical focusing in scattering media. Nature Photon. 2015;9:126–132. doi: 10.1038/nphoton.2014.322. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Caravaca-Aguirre AM, Niv E, Conkey DB, Piestun R. Real-time resilient focusing through a bending multimode fiber. Optics Express. 2013;21:12881–12887. doi: 10.1364/OE.21.012881. [DOI] [PubMed] [Google Scholar]
- 13.Akbulut D, Huisman TJ, van Putten EG, Vos WL, Mosk AP. Focusing light through random photonic media by binary amplitude modulation. Opt Express. 2011;19:4017–4029. doi: 10.1364/OE.19.004017. [DOI] [PubMed] [Google Scholar]
- 14.Mosk AP, Lagendijk A, Lerosey G, Fink M. Controlling waves in space and time for imaging and focusing in complex media. Nature Photon. 2012;6:283–292. [Google Scholar]
- 15.Hsieh C-L, Pu Y, Grange R, Psaltis D. Digital phase conjugation of second harmonic radiation emitted by nanoparticles in turbid media. Opt Express. 2010;18:12283–12290. doi: 10.1364/OE.18.012283. [DOI] [PubMed] [Google Scholar]
- 16.Vellekoop IM, Aegerter CM. Scattered light fluorescence microscopy: imaging through turbid layers. Opt Lett. 2010;35:1245–1247. doi: 10.1364/OL.35.001245. [DOI] [PubMed] [Google Scholar]
- 17.Vellekoop IM, Cui M, Yang C. Digital optical phase conjugation of fluorescence in turbid tissue. Appl Phys Lett. 2012;101:081108. doi: 10.1063/1.4745775. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Xu X, Liu H, Wang LV. Time-reversed ultrasonically encoded optical focusing into scattering media. Nature Photon. 2011;5:154–157. doi: 10.1038/nphoton.2010.306. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Si K, Fiolka R, Cui M. Fluorescence imaging beyond the ballistic regime by ultrasound-pulse-guided digital phase conjugation. Nature Photon. 2012;6:657–661. doi: 10.1038/nphoton.2012.205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Wang YM, Judkewitz B, DiMarzio CA, Yang C. Deep-tissue focal fluorescence imaging with digitally time-reversed ultrasound-encoded light. Nat Commun. 2012;3:928. doi: 10.1038/ncomms1925. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Yaqoob Z, Psaltis D, Feld MS, Yang C. Optical phase conjugation for turbidity suppression in biological samples. Nature Photon. 2008;2:110–115. doi: 10.1038/nphoton.2007.297. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Cui M, McDowell EJ, Yang C. An in vivo study of turbidity suppression by optical phase conjugation (TSOPC) on rabbit ear. Opt Express. 2010;18:25–30. doi: 10.1364/OE.18.000025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Cui M, Yang C. Implementation of a digital optical phase conjugation system and its application to study the robustness of turbidity suppression by phase conjugation. Opt Express. 2010;18:3444–3455. doi: 10.1364/OE.18.003444. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Gross M, Lesaffre M, Ramaz F, Delaye P, Roosen G, Boccara AC. Detection of the tagged or untagged photons in acousto-optic imaging of thick highly scattering media by photorefractive adaptive holography. Eur Phys J E. 2009;28:173–182. doi: 10.1140/epje/i2008-10408-2. [DOI] [PubMed] [Google Scholar]
- 25.Liu Y, Lai P, Ma C, Xu X, Grabar AA, Wang LV. Optical focusing deep inside dynamic scattering media with near-infrared time-reversed ultrasonically encoded (TRUE) light. Nat Commun. 2015;6:5904. doi: 10.1038/ncomms6904. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Zhou EH, Ruan H, Yang C, Judkewitz B. Focusing on moving targets through scattering samples. Optica. 2014;1:227–232. doi: 10.1364/OPTICA.1.000227. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Chandrasekaran SN, Ligtenberg H, Steenbergen W, Vellekoop IM. Using digital micromirror devices for focusing light through turbid media. Proc SPIE. 2014;8979:897905. [Google Scholar]
- 28.Ma C, Xu X, Liu Y, Wang LV. Time-reversed adapted-perturbation (TRAP) optical focusing onto dynamic objects inside scattering media. Nature Photon. 2014;8:931–936. doi: 10.1038/nphoton.2014.251. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Yamaguchi I, Zhang T. Phase-shifting digital holography. Opt Lett. 1997;22:1268–1270. doi: 10.1364/ol.22.001268. [DOI] [PubMed] [Google Scholar]
- 30.Anderson DZ, Feinberg J. Optical novelty filters. IEEE J Quant Electron. 1989;25:635–647. [Google Scholar]
- 31.Boas DA, Dunn AK. Laser speckle contrast imaging in biomedical optics. J Biomed Opt. 2010;15:011109. doi: 10.1117/1.3285504. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Jang M, Ruan H, Vellekoop IM, Judkewitz B, Chung E, Yang C. Relation between speckle decorrelation and optical phase conjugation (OPC)-based turbidity suppression through dynamic scattering media: a study on in vivo mouse skin. Biomed Opt Express. 2015;6:72–85. doi: 10.1364/BOE.6.000072. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ji N, Sato TR, Betzig E. Characterization and adaptive optical correction of aberrations during in vivo imaging in the mouse cortex. Proc Natl Acad Sci. 2012;109:22–27. doi: 10.1073/pnas.1109202108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Wang C-C, Thorpe C, Thrun S, Hebert M, Durrant-Whyte H. Simultaneous localization, mapping and moving object tracking. Int J Robot Res. 2007;26:889–916. [Google Scholar]
- 35.Cudney R, Pierce R, Feinberg J. The transient detection microscope. Nature. 1988;332:424–426. [Google Scholar]
- 36.Wang LV, Hu S. Photoacoustic tomography: in vivo imaging from organelles to organs. Science. 2012;335:1458–1462. doi: 10.1126/science.1216210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Dierickx CC, Casparian JM, Venugopalan V, Farinelli WA, Anderson RR. Thermal relaxation of port-wine stain vessels probed in vivo: the need for 1-10-millisecond laser pulse treatment. J Invest Dermatol. 1995;105:709–714. doi: 10.1111/1523-1747.ep12324514. [DOI] [PubMed] [Google Scholar]
- 38.Zhang HF, Maslov K, Stoica G, Wang LV. Functional photoacoustic microscopy for high-resolution and noninvasive in vivo imaging. Nat Biotechnol. 2006;24:848–851. doi: 10.1038/nbt1220. [DOI] [PubMed] [Google Scholar]
- 39.Wang L, Xia J, Yao J, Maslov KI, Wang LV. Ultrasonically encoded photoacoustic flowgraphy in biological tissue. Phys Rev Lett. 2013;111:204301. doi: 10.1103/PhysRevLett.111.204301. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Hatle L, Angelsen B. Doppler ultrasound in cardiology: physical principles and clinical applications. Lea & Febiger; 1985. [Google Scholar]
- 41.Jayet B, Huignard J-P, Ramaz F. Optical phase conjugation in Nd: YVO4 for acousto-optic detection in scattering media. Opt Lett. 2013;38:1256–1258. doi: 10.1364/OL.38.001256. [DOI] [PubMed] [Google Scholar]
- 42.Ma C, Xu X, Wang LV. Analog time-reversed ultrasonically encoded light focusing inside scattering media with a 33,000× optical power gain. Sci Rep. 2015;5:8896. doi: 10.1038/srep08896. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Tay JW, Liang J, Wang LV. Amplitude-masked photoacoustic wavefront shaping and application in flowmetry. Opt Lett. 2014;39:5499–5502. doi: 10.1364/OL.39.005499. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Drémeau A, Liutkus A, Martina D, Katz O, Schülke C, Krzakala F, Gigan S, Daudet L. Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques. Opt Express. 2015;23:11898–11911. doi: 10.1364/OE.23.011898. [DOI] [PubMed] [Google Scholar]
- 45.Kim D, Choi W, Kim M, Moon J, Seo K, Ju S, Choi W. Implementing transmission eigenchannels of disordered media by a binary-control digital micromirror device. Opt Commun. 2014;330:35–39. [Google Scholar]
- 46.Kim D, Moon J, Kim M, Yang TD, Kim J, Chung E, Choi W. Toward a miniature endomicroscope: pixelation-free and diffraction-limited imaging through a fiber bundle. Opt Lett. 2014;39:1921–1924. doi: 10.1364/OL.39.001921. [DOI] [PubMed] [Google Scholar]
- 47.Zhang X, Kner P. Binary wavefront optimization using a genetic algorithm. J Opt. 2014;16:125704. [Google Scholar]
- 48.Wang D, Zhou EH, Brake J, Ruan H, Jang M, Yang C. Focusing through dynamic tissue with millisecond digital optical phase conjugation. Optica. 2015;2:728–735. doi: 10.1364/OPTICA.2.000728. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Weissleder R, Pittet MJ. Imaging in the era of molecular oncology. Nature. 2008;452:580–589. doi: 10.1038/nature06917. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Dougherty TJ, Gomer CJ, Henderson BW, Jori G, Kessel D, Korbelik M, Moan J, Peng Q. Photodynamic therapy. J Natl Cancer Inst. 1998;90:889–905. doi: 10.1093/jnci/90.12.889. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Packer AM, Roska B, Häusser M. Targeting neurons and photons for optogenetics. Nat Neurosci. 2013;16:805–815. doi: 10.1038/nn.3427. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.