Focusing ultrashort laser pulses in time in tandem with single-pixel detection images at depth with no sample characterization.
Abstract
Optical approaches to fluorescent, spectroscopic, and morphological imaging have made exceptional advances in the last decade. Super-resolution imaging and wide-field multiphoton imaging are now underpinning major advances across the biomedical sciences. While the advances have been startling, the key unmet challenge to date in all forms of optical imaging is to penetrate deeper. A number of schemes implement aberration correction or the use of complex photonics to address this need. In contrast, we approach this challenge by implementing a scheme that requires no a priori information about the medium nor its properties. Exploiting temporal focusing and single-pixel detection in our innovative scheme, we obtain wide-field two-photon images through various turbid media including a scattering phantom and tissue reaching a depth of up to seven scattering mean free path lengths. Our results show that it competes favorably with standard point-scanning two-photon imaging, with up to a fivefold improvement in signal-to-background ratio while showing significantly lower photobleaching.
INTRODUCTION
A suite of powerful, disruptive optical imaging approaches across the physical and biomedical sciences has recently emerged. Super-resolution imaging led to new studies looking at nanometric features within cells that have revealed intricate aspects of subcellular processes (1–5). At the larger scale, methods such as optical coherence tomography (6) and light-sheet imaging (7) are taking hold in fields such as opthalmology, neuroscience, and developmental biology. In tandem with the requirement for a fast, wide-field visualization and super-resolved imaging across biomedicine, a grand challenge is to perform such imaging through highly scattering (turbid) media, namely, tissue. In particular, this is essential to move from superficial surface imaging to functional imaging at depth (8–11), which is crucial for biomedical areas including neuroscience. To address this area, aberration correction can be implemented (12). However, this does not readily take into account the properties of the medium, and actual retrieval of the emitted signal from depth in the medium can still be challenging. Key advances have emerged by a consideration of the propagation of light within a complex medium. In this field, a number of approaches use dynamic wavefront shaping for illumination of the sample with a calculated input complex wavefront (13–16), which can focus light upon an embedded guide star. In essence, one determines the transmission matrix of the sample in this process (11, 17, 18). While this is powerful, the requirement of a guide star restricts the approach. Furthermore, it requires determination of the properties of the medium at one or more individual points, making it very challenging to implement for wide-field imaging.
An important advance would be the realization of a fast, wide-field imaging approach that would deliver and retrieve light from any given plane within a sample, even in the presence of turbidity. This would be without the requirement to characterize or even actively correct the aberrating effect of the turbid medium. Our approach to achieving this goal exploits temporal focusing (TF) microscopy (19, 20). By using the temporal rather than spatial degree of freedom, scanning of the optical axis for image reconstruction is avoided. Consequently, TF may record wide-field multiphoton images (19, 21). In addition, a little-recognized facet of TF is its ability to deliver light through scattering media. This ability has been used to project optical patterns for applications such as optogenetics, providing photostimulation at remarkable depths (9, 22, 23). Although TF can deliver light through a scattering medium very efficiently, collecting the emitted fluorescent light back through the same medium (i.e., truly achieving imaging) has not been accomplished to date. Separately, there has been the emergence of single-pixel detection, sometimes termed computational ghost imaging (24). In this form of imaging, known patterns illuminate an object, a single-element photodetector records the light intensity that is either transmitted or backscattered by the object, and images are reconstructed with the appropriate algorithm (25, 26).
However, while these studies in TF microscopy and in single-pixel detection have shown promise, none of them has addressed the challenge of correction-free wide-field imaging through turbid media. The scheme that we present here, which we call TempoRAl Focusing microscopy with single-pIXel detection (TRAFIX), uses a judicious combination of TF illumination with single-pixel imaging to obtain wide-field images of fluorescent microscopic samples within or even beyond biological tissues, in the presence of multiple scattering, without aberration correction or characterization of the turbid medium.
RESULTS
Principle of the technique
TF is based on decomposing an incident ultrashort pulsed light field into its constituent wavelengths with a diffraction grating. Each wavelength propagates along an individual path in the optical system, and these wavelengths constructively recombine to regain the original pulse duration only at the plane conjugate to the grating, generating axially confined mutiphoton excitation. In TRAFIX, orthonormal light patterns (in a Hadamard basis) are temporally focused through a turbid medium to illuminate a fluorescent microscopic sample of interest. The use of TF for this projection ensures the retention of the integrity of these patterns at any given plane within the turbid media (Fig. 1A). This can be regarded as due to the fact that ballistic photons remain unperturbed all the way to the object plane and arrive at the same time, contributing to the reconstitution of the pulse. In addition, the superposition of wavelets of slightly different wavelengths at the focal plane results in nearly speckle-free propagation through long distances in scattering media, as recognized by Papagiakoumou et al. (9). We confirm these aspects here with a numerical simulation. The same principle has been previously used for reducing out-of-focus excitation in line-scanning multiphoton microscopy (20). A scattering medium may affect the spatial and temporal degrees of freedom of an input field differently. In the time domain, the temporal profile of femtosecond pulses is not significantly distorted at substantial imaging depths such as 1-mm-thick brain tissue (27). As a consequence, TF may induce much more efficient multiphoton excitation when compared to standard point-focusing where spatial speckle greatly reduces the photon density at the focal spot. Consequently, TF is more robust than conventional focusing, resulting in a more intense fluorescence signal generated at large depths (28), which is a major attribute for our approach.
The total intensity emitted by the fluorescent sample under each illumination pattern is collected by the same objective after passing a second time through the scattering material, in a configuration reminiscent of a single-pixel imaging. In this way, we remove the requirement for any spatial resolution on the imaging path, which, in turn, means that we can readily tolerate the scrambling of the emitted fluorescence through the scattering medium (Fig. 1B). We retain exact spatial information of where the sample is illuminated by virtue of using patterned illumination. This allows an original form of TF microscopy to be realized, enabling the use of the full penetration capabilities of TF beams for imaging at depth (29).
In the present experiments, an illumination laser with a central wavelength at 800 nm delivers 140-fs pulses (80-MHz repetition rate, average output power up to 4 W) onto the sample, and the emitted fluorescent photons are detected by an electron-multiplying charge-coupled device (EMCCD) camera, which is used as a single-pixel detector. The epifluorescence configuration of TRAFIX makes it readily suitable for a suite of biomedical applications. An additional microscope takes reference images of the fluorescent sample in a transmission geometry analogous to previous reports (9, 22). Reference images are taken with a CCD camera under uniform TF illumination across the field of view (FOV) (see Materials and Methods). We stress that this additional reference system is not required for imaging. Once all patterns have been sequentially projected and their intensity coefficients have been measured, images are reconstructed using an orthogonal matching pursuit (OMP) algorithm (30). The OMP algorithm determines which patterns contribute most effectively to the image reconstruction and sums them up to create an image (see the Supplementary Materials). The number of pixels in the retrieved image is determined by the size of the Hadamard basis used in the measurement. An n × n pixel image requires a Hadamard basis containing N = n2 patterns. Therefore, depending on the pixel resolution required, a different number of Hadamard patterns (typically 4096 or 1024) are encoded on an SLM. The acquisition time of the microscope is given by T = 2n2(texp + tSLM), where texp is the exposure time of the camera used as a single-pixel detector and tSLM is the time required to refresh the Hadamard patterns on the SLM (including data transmission).
As TRAFIX is based on patterned illumination, it lends itself to compressive sensing measurements (26, 31). One of the main advantages of compressive sensing is that sparse signals can be reconstructed with fewer samples than required by Nyquist sampling theory. In terms of microscopy, it means that one does not need to measure with the full set of Hadamard patterns to obtain a good-quality image. The compression ratio (CR) = N/M denotes how many patterns are used to reconstruct the image in relation to the total number of patterns in the Hadamard basis (26). Here, M is the number of patterns used in the reconstruction algorithm. For example, a 64-pixel by 64-pixel image requires a measurement with a Hadamard basis containing 4096 patterns. Consequently, a CR of 2 corresponds to using only half of the total patterns to reconstruct the image (i.e., 2048 patterns), a CR of 4 uses only 1024 patterns, and so on.
As we describe below, to demonstrate the performance of TRAFIX, we imaged various microscopic fluorescent samples making use of full Hadamard bases to obtain a high-quality image. Additional compressed images were obtained a posteriori to demonstrate that compressive sensing measurements are possible in this configuration (see the Supplementary Materials).
Imaging through scattering media
To begin with, 400-nm-diameter green fluorescent beads and fixed human embryonic kidney (HEK) 293T/17 cells labeled with green fluorescent protein (HEK293T/17-GFP) were imaged through scattering phantoms, designed to mimic the scattering properties of biological tissue, and through unfixed human colon tissue. A custom-made fluorescent microstructure was then imaged through fixed rat brain tissue. As scattering dominates over absorption in the range of wavelengths considered in our investigation (32, 33), we use scattering mean free path (ls) as a reference value to quantify imaging depth. The ls values for the scattering media used in the experiments presented here are approximately 140, 85, and 55 μm for the scattering phantom, colon tissue, and brain tissue, respectively (see Materials and Methods). Full Hadamard bases of either 32-pixel by 32-pixel or 64-pixel by 64-pixel resolution were projected onto the samples, and the resulting images were reconstructed with different CRs. The lateral resolution of the microscope is defined as twice the pixel size in the reconstructed images, and thus, it depends on the FOV. Using a Hadamard basis containing 32 pixels by 32 pixels and an FOV of 90 μm by 90 μm, the resolution is 5.6 μm, and for a larger basis of 64 pixels by 64 pixels, it is 2.8 μm (fig. S7). We measured the depth resolution in the absence of any scattering layer for a 40× numerical aperture (NA) = 0.8 objective to be 4.7 ± 0.5 μm (fig. S4) and initially tested the microscope’s performance in imaging beads and HEK cells without scattering (see the Supplementary Materials).
To quantify image quality, we measured the signal-to-background ratio (SBR) for all images presented in this work (see Materials and Methods). All values are summarized in table S1. To assess the effectiveness of this technique in photolocalization, we estimated the spacing between fluorescent beads and the size of cells in the reference image and in the reconstructed images and calculated their deviation from the reference value (see the Supplementary Materials).
Figure 2 shows images of the fluorescent beads and HEK cells obtained through 500 and 540 μm of scattering phantoms (3 to 4 ls), respectively. As a result of the strong scattering, very few illumination photons reach the sample plane, generating a very dim fluorescence signal; therefore, a long exposure time or large binning is required to even obtain a good reference image under uniform TF illumination in transmission. In standard TF microscopes, those few emitted fluorescence photons would need to travel back through the thick scattering medium, losing all their spatial information and hence resulting in uniform noise on the camera (29). Consequently, the SBR would essentially be unity, which means that no signal can be extracted from the background noise. However, in TRAFIX, there is no need to measure spatial information as total intensity coming from the sample under each illumination pattern is detected and used as a coefficient in the reconstruction algorithm. This results in a significant enhancement in signal detection and higher SBR values.
The achievable level of compression depends on the sparsity of the image. If an image contains very little information, then high compression is possible with negligible information loss. As the images of fluorescent beads are sparse, image quality is preserved for large values of CR. A good image can be faithfully reconstructed with CR = 8 (12.5% of the total number of patterns). Similar CRs have been achieved in the literature, although with different optical imaging systems (26). Nevertheless, we did not achieve a high compression with cells in the present configuration. They covered a larger area of the image and thus cannot be compressed as much without a significant loss of information with the present algorithm and pixel resolution. In addition, the 800-nm excitation laser used in the experiments is not optimal for excitation of GFP, which has its highest absorption in the range of wavelengths between 870 and 920 nm (34). As a result, the cells appear very dim. Despite these issues, an SBR exceeding 4 was achieved at CR = 2 (i.e., using only 50% of the full Hadamard basis in the image reconstruction algorithm).
In the next stage, the performance of TRAFIX was tested with unfixed human colon tissue as a scattering medium. One of the main problems in imaging through biological tissue is autofluorescence. Coda et al. (35) showed the single-photon excitation spectrum of human colon tissue at different wavelengths. Under 435-nm single-photon excitation, colon tissue presents a very intense autofluorescence signal at the green part of the spectrum, overlapping with the light emitted from the beads or cells used in our experiment. Single-photon excitation at 435 nm is relatively similar to two-photon excitation at 800 nm, so it poses a big obstacle in the experiments because it reduces the number of photons that can reach the beads or HEK cells and it also generates undesired background light. The optical sectioning capability of TF would seem to circumvent this impediment; however, as temporally focused laser pulses propagate longer distances through scattering tissue, the resulting excitation plane becomes thicker (fig. S4) (36), and consequently, some autofluorescence is excited in the colon tissue, resulting in high noise levels even in the reference images taken in transmission. Despite the intense autofluorescence light emitted by the colon tissue, we succeeded in imaging both 400-nm fluorescent beads and HEK cells through 250 and 200 μm (~3 ls), respectively, obtaining high SBR values (Fig. 3). An additional image taken in a scattering phantom with fluorophores extending its entire volume confirms that TRAFIX can be used in presence of out-of-focus background fluorescence (fig. S8).
The photolocalization analysis looked at spacing between adjacent beads and cell size in a given image. It was satisfactory in the case of images through the scattering phantom obtaining deviations smaller than 3% for beads in any CR (table S3). We also obtained acceptable results in the case of cells for the image with no compression (table S2). In general, larger deviations were observed for the images through colon tissue presumably because of very low photon count reaching the detector and distortions caused by inhomogeneities in the tissue.
We generated fluorescent micropatterns having a more detailed structure than beads or cells on a thin fluorescent film (see Materials and Methods) and imaged them through a scattering phantom (figs. S7 and S9), colon tissue (fig. S10), and fixed rat brain tissue of different thicknesses (Fig. 4). The maximum imaging depth achieved through rat brain tissue was 400 μm, which corresponds to approximately 7 ls. The improvement of TRAFIX over conventional TF microscopy becomes evident by comparing Fig. 4B with Fig. 4 (C and D).
A simple point-scanning two-photon microscope (2PM) was developed to compare the performance of TRAFIX with this widely used imaging approach (see Materials and Methods). To provide a fair comparison, we performed two experiments in which either the lateral or axial resolution of 2PM was matched to those of TRAFIX (see the Supplementary Materials). The laser power per unit area was adjusted to generate equivalent fluorescence intensity on the sample for both techniques. Exposure time and camera binning were set accordingly to perform imaging in analogous conditions. Under these conditions, images taken without scattering show equal values of SBR in the two imaging modalities (fig. S9, A and B). Figure S9 shows that SBR in 2PM degrades more rapidly than that in TRAFIX when imaging at depth. This trend was confirmed by imaging through 200 μm of unfixed human colon tissue under the previously defined imaging conditions (fig. S10). Both studies show that TRAFIX achieves between two and five times higher SBR than 2PM for the samples and depths considered in this study. Furthermore, an additional study shows that the wide-field nature of TRAFIX combined with patterned illumination results in at least three times lower photobleaching of the fluorescent sample compared to 2PM, even for laser power levels favorable to the latter (fig. S12).
Figure S13 shows how the focused spot of 2PM and various TF Hadamard patterns of TRAFIX get distorted at different depths through unfixed human colon tissue. After 400 μm, the 2PM focused spot is not discernible and turns into a complete speckle pattern. At the same depth, low-frequency Hadamard patterns retain their shape reasonably well, although having substantial intensity inhomogeneities. These results align well with the data presented by Rowlands et al. (22) using TF illumination. In these conditions, the fact that fluorescence excitation in 2PM occurs outside the expected region of focal spot suggests that TRAFIX may achieve improved imaging depths compared to 2PM, although in low resolution. It should also be noted that the axial resolution through scattering media, for the current embodiment of TRAFIX, is reduced more rapidly than that of 2PM (fig. S11). Axial confinement in TRAFIX could be improved by relying on line-scanning TF rather than wide-field TF illumination (37).
Numerical simulation
To illustrate how TRAFIX behaves in scattering media, we performed a simplified one-dimensional simulation of the imaging process. We took into account the propagation of TF Gaussian beams through a scattering medium and the detection of fluorescent light after backward propagation through the same medium (see the Supplementary Materials). Our simulation shows that monochromatic light propagating through a highly scattering layer, such as a 400-μm-thick brain tissue, is transformed into a spatial speckle pattern, as expected. However, one important feature of TF is that each monochromatic portion of the beam propagates through a different optical path. As identified by Papagiakoumou et al. (9), waves traveling with very different optical paths produce an overall smoothing of the beam, while slightly different optical paths produce only an anisotropic smoothing. As a result, large features of the initial beam profile are remarkably well conserved as shown in Fig. 5A. Although the main source of two-photon excitation in TRAFIX is typically generated by ballistic photons, at large depths, the excitation caused by scattered photons becomes important when compared to the highly attenuated ballistic light. As the TF beams are basically speckle free, scattering of light in this case does not heavily distort the Hadamard patterns but, in fact, contributes into making them brighter with the only disadvantage of generating softer edges in the features of the pattern.
In the second part of the simulation, we estimated the total fluorescent light that would reach our detector with respect to the total laser power deposited on the sample surface. It is clear to see in Fig. 5B that it decays markedly as the thickness of the scattering medium increases. Owing to single-pixel detection, in our experimental measurements, we could use those very few photons to form images through fixed rat brain tissue of up to 400 μm thickness.
DISCUSSION AND CONCLUSIONS
The combination of patterned TF illumination with single-pixel detection achieves remarkable imaging depths for wide-field multiphoton microscopy as it provides a way of exciting fluorescent structures deeper inside turbid media than existing imaging techniques and can efficiently collect the emitted light in an epifluorescence configuration. We have demonstrated the effectiveness and potential of TRAFIX by imaging fluorescent beads of 400 nm in diameter and fixed HEK293T/17-GFP cells through a layer of a scattering phantom with a thickness of more than 500 μm (~4 ls), without any aberration correction, guide star, or detector placed in/behind the turbid media. We then imaged a bright custom fluorescent microstructure through rat brain tissue of hundreds of micrometers in thickness, reaching a maximum imaging depth of ~7 ls. In addition, we showed that TRAFIX works well under typical biological research conditions by imaging both fluorescent beads and HEK cells through depths of more than 3 ls of unfixed human colon tissue and even in the presence of intense background fluorescence.
The main factor that limits imaging depth of TRAFIX is the penetration depth of the TF Hadamard patterns. Propagation of TF beams through very large distances in scattering media results in distortions on the illumination patterns mainly caused by refractive index changes in the sample. These distortions generate a basis mismatch that may result in deformities in the reconstructed images (38). In addition, the use of a one-dimensional diffraction grating generates horizontal shifts in the illumination Hadamard patterns that could potentially be minimized by dispersing the patterns isotropically. A future embodiment using dispersion in two dimensions with two perpendicular diffraction gratings would be an improvement. Despite these present issues, TRAFIX is capable of imaging at remarkable depths with low power per unit area over a large FOV. Its performance may be further improved by combining it with wavefront correction, making it possible to maintain spatial integrity of the illumination patterns even beyond the current limits. Furthermore, the imaging depth could be significantly improved by relying on longer wavelengths and higher-order multiphoton processes such as three-photon excitation (see the Supplementary Materials) (22, 39, 40).
The results presented here align well with previous work published in the literature such as the study by Rowlands et al. (29). They compared the penetration depth of standard TF microscopy with 2PM. A careful look at their measured modulation transfer functions (MTFs) shows a remarkably higher contrast under TF illumination at depths up to 100 to 150 μm with respect to 2PM. At larger depths, the MTF of the standard TF microscope drops markedly because of the impossibility of retaining any spatial information in the detection system. In contrast, our novel TRAFIX approach uses single-pixel detection to efficiently collect fluorescent light, extending the high performance of TF to deeper regions. Our comparison with 2PM shows that TRAFIX achieves an enhancement of up to five times in SBR when imaging through a scattering phantom and unfixed human colon tissue. Moreover, photobleaching of the sample is substantially reduced as a result of using wide-field TF patterned illumination rather than a focused high-intensity beam (see the Supplementary Materials). Image resolution and SBR can be further improved by using new approaches such as digital microscanning (41).
Here, we also demonstrate that compressive sensing measurements are possible in TRAFIX by showing reconstructed images a posteriori. However, in an actual compressive sensing measurement with no a priori knowledge of the sample, choosing the most appropriate illumination patterns is critical. Since the amount of information carried by each pattern is uneven, it is important to wisely choose the order in which they are projected to optimize image quality and acquisition speed (42).
In the present embodiment of TRAFIX, the acquisition speed is mainly limited by the exposure time of the EMCCD camera and the slow refresh rate of the SLM (see the Supplementary Materials). A typical image obtained using a full basis of 1024 patterns (32 pixels by 32 pixels) through a moderate thickness of a scattering sample currently takes ~5 min. This time is increased to up to 1 hour when imaging in high resolution (64 pixels by 64 pixels) with a full basis through the most challenging conditions shown in this article. To speed imaging up, the EMCCD camera would be replaced with a fast, sensitive photodetector such as a photomultiplier tube (PMT) and the imaging speed would no longer be limited by the exposure time of the detector. In addition, as TRAFIX currently uses binary Hadamard patterns, the SLM may be replaced with a significantly faster digital micromirror device, which may run at tens of kilohertz. These changes, combined with the new advances in compressive imaging, suggests that frame rates for 128-pixel by 128-pixel images can be increased to more than ~30 Hz (43, 44), enabling studies in time-varying turbulence (45).
Since our scheme can be easily implemented in a standard multiphoton microscope, we believe that one of its main applications will be in the field of optogenetics where it would lend itself to achieve long-term simultaneous imaging and photoactivation of neuronal networks with minimal photodamage deep inside the brain. Last, as the polarization state of the illumination light does not change over propagation in scattering media through the range of distances normally considered for imaging (see the Supplementary Materials) (46), TRAFIX could also be combined with polarization-resolved imaging techniques (47).
In summary, TRAFIX is a novel approach for deep multiphoton imaging that presents an increased SBR compared to the ubiquitous 2PM while also reducing photobleaching of the sample. In addition, the almost speckle-free propagation of TF illumination patterns suggests that TRAFIX may surpass the maximum imaging depth limit of 2PM and may be very beneficial for long-term biological studies, particularly in neuroscience.
MATERIALS AND METHODS
Experimental setups
TempoRAl Focusing microscopy with single-pIXel detection
An illumination laser (Coherent Chameleon Ultra II) delivers 140-fs pulses with an 80-MHz repetition rate, up to 4-W average output power at a variable central wavelength between 680 and 1080 nm. The central wavelength of the laser was set to 800 nm for all the experiments performed. The illumination beam was expanded four times to cover the active area of a phase-only SLM (LCOS-SLM, Hamamatsu Photonics). The SLM was then imaged onto a blazed reflective grating (1200 g/mm) with a 4f (f = 400 mm) telescope to create wide-field TF illumination. The first diffraction order from the SLM was transmitted through an iris in the telescope, while all other orders were blocked. The beam was diffracted from the grating, and all wavelengths were collimated with an f = 400 mm lens relayed onto the back focal aperture of the illumination objective. Two different illumination objectives were used in this work. A water dipping objective (40× NA = 0.8; Nikon), which is enclosed in a custom-made chamber filled with water, generates a TF illumination plane with a size of 90 μm by 90 μm. The highest average laser power per unit area used in this configuration is 64 ± 5 μW/μm2. An air objective (20× NA = 0.75; Nikon) was used for additional studies presented in the Supplementary Materials, as accordingly specified. Backscattered fluorescent light propagated through the turbid media and was collected by an EMCCD camera run without amplification (iXonEM+ 885, Andor Technology) via the same illumination objective in epifluorescence configuration. To provide reference images for this paper, forwardly emitted photons from the sample were collected by a CCD camera (Clara, Andor Technology) in transmission via a long working distance air objective (100× NA = 0.7; Mitutoyo). Appropriate short-pass filters were used to reject the illumination laser at 800 nm and transmit fluorescence below 700 nm. In contrast to other single-pixel imaging approaches (25, 26), the EMCCD camera with 64 × 64 binning was used as a bucket detector instead of using a single-element detector such as a PMT or an avalanche photodiode. Using high binning helps reducing the effect of readout noise. All objectives, samples, and cameras were attached on the body of an inverted microscope (Eclipse Ti, Nikon) accordingly.
Point-scanning two-photon microscope
The 2PM shares the same setup as TRAFIX, except for the diffraction grating and a lens that are replaced with a mirror to obtain a focused beam on the focal plane of the illumination objective. A Nikon 20× NA = 0.75 air objective was used for all experiments. A variable iris was used to adjust the size of the focused spot. An X-Y-Z motorized stage (Nano-LP200, Mad City Labs) scanned the sample in a stepwise motion across the fixed focused beam covering the entire FOV. The same binned EMCCD camera run with no amplification (iXonEM+ 885, Andor Technology) collected the fluorescent light emitted by the sample.
Fluorescent and scattering samples
Fluorescent layer and fluorescent micropattern
A 200-nm-thin layer of super-yellow polymer spin-coated on a glass coverslip was used to characterize the profile and depth resolution of the TF beam (see the Supplementary Materials). It was also used to generate a fluorescent micropattern that was then imaged through scattering media. The negative of a pattern of interest was encoded on the SLM, and the thin fluorescent layer was placed at the focal plane of the microscope without any scattering layer. The laser power was set to the maximum, and the negative pattern was photobleached on the fluorescent film. Therefore, the only portion of the FOV that remained fluorescent was exactly the desired micropattern.
Fluorescent beads
Green fluorescent polymer microspheres (G400, Duke Scientific) with a diameter of 0.39 μm were used to test the performance of the imaging system. A very small amount of beads was deposited on a glass coverslip and placed on top of the scattering samples to image them through the turbid media.
HEK cells
HEK293T/17-GFP cells were used to demonstrate the capability of the microscope in imaging real biological samples through scattering. HEK293T/17 cell line obtained from American Type Culture Collection was cultured in Dulbecco’s modified Eagle’s medium GlutaMAX-I supplemented with 10% fetal bovine serum and 1% penicillin/streptomycin and was transfected using TransIT-LT1 transfection reagent with the Vesicular Stomatitis Virus glycoprotein (VSV-G) pseudotyped lentivirus vector and the packaging plasmid psPAX2 to deliver the plasmid pLenti-GFP-Puro. Regarding the sample preparation, the HEK293T/17-GFP cells were replated on World Precision Instruments FluoroDish poly-d-Lysine–coated cell culture dishes at a low density to achieve ideal imaging conditions. The day after plating, before imaging, the HEK293T/17-GFP cells were fixed in a phosphate-buffered saline 4% paraformaldehyde solution. The scattering samples were attached directly on the bottom of the dishes containing the cells.
Scattering phantom
Polystyrene beads of 1 μm in diameter were used as scatterers to simulate a turbid sample. The beads were purchased in a 1% concentration solution in water (Microbead NIST Traceable Particle Size Standard, 1.00 μm; Polysciences). The solution was thoroughly stirred in a vortex mixer and then mixed with a 1% solution of agarose in water (preheated above melting point). Agarose and beads were mixed in the vortex mixer again and placed into sample wells of variable height. The wells consisted of a 100-μm glass slide with multiple 90-μm vinyl spacers stacked on top of each other. An additional coverslip was placed on top to seal the well. The concentration of polystyrene beads in the sample was chosen to roughly match the scattering coefficient of real biological tissue (48). Using an on-line Mie scattering calculator (49), we determined the reduced scattering coefficient of our phantom to approximately be , corresponding to a mean free path of about , where g is the anisotropy factor (g ~ 0.9 for most biological tissue at the wavelength considered in this investigation). Different scattering phantoms were used in some experiments in the Supplementary Materials as appropriately specified.
Rat brain tissue
Similar to our previous work (50), rat brain tissue was obtained from adult Sprague Dawley rats, in accordance with the UK Animals (Scientific Procedures) Act 1986. It was fixed and then sectioned into slices at thicknesses of 200 and 400 μm. The mean free path of the rat brain tissue was estimated by measuring the ratio of the incident laser intensity I0 with the intensity of the ballistic photons IB and by applying an exponential law IB = I0 exp(− L/ls), where L is the thickness of the brain tissue (18). The obtained value of ls = 55 ± 9 μm is consistent with other measurements reported in the literature for rat (51) and mouse brains (52).
Colon tissue
Thin fragments of unfixed normal human colon tissue were used as scattering samples. They were stored in a freezer at −80°C and mounted between two coverslips. Their thickness ranged from 200 to 250 μm, and their reduced scattering coefficient was approximately 12 cm−1 (53, 54), giving a mean free path of ls ≈ 85 μm. The colon tissue sample used in this study was obtained from the Tayside Tissue Bank, Ninewells Hospital and Medical School, Dundee (tissue request no. TR000289) with appropriate ethical permission.
Image quality quantification
Signal-to-background ratio
SBR is defined here as SBR = μsig/μbg, where μsig and μbg are the average values of the signal and the background, respectively. In the case of cells and fluorescent micropatterns, two small regions of interest were defined—one containing fluorescent structures and the other corresponding to the background. In the images of beads, the highest-intensity pixels in the beads were used as signal value, and the maximum intensity pixels in the rest of the image were used as background noise. Uncertainty is given by the SD of all averaged measurements. All values of SBR presented in this work are summarized in table S1.
Cell size
As the cells used here appear approximately spherical, their diameter was estimated by taking a measurement of their size in two orthogonal directions and averaging the obtained values. Their diameter was determined by fitting a Gaussian function to the intensity values and measuring its full width at half maximum. Table S2 shows the diameters of the cells that appear in the different images presented in this work. Deviations in cell size between reconstructed and reference images are expressed as a percentage error.
Bead spacing
The central pixel for each individual bead was located, and the distance between beads was measured in the reference image and in all retrieved images with different CRs (table S3). Deviations in bead spacing between reconstructed and reference images are expressed as a percentage error.
Supplementary Material
Acknowledgments
We thank J. Glackin and P. Manousiadis from University of St. Andrews for preparing the uniform thin fluorescent layers of super-yellow polymer and J. Nylk, Z. Yang, G. Bruce, and F. Gasparoli for useful discussions and support. Funding: This work was supported by the U.K. Engineering and Physical Sciences Research Council for funding through grants EP/P030017/1 and EP/M000869/1 and has received funding from the European Union’s Horizon 2020 Programme through the project Advanced BiomEdical OPTICAL Imaging and Data Analysis (BE-OPTICAL) under grant agreement no. 675512, The Cunningham Trust, and The RS MacDonald Charitable Trust. K.D. acknowledges the financial support of E. Killick and S. Gurney. Author contributions: A.E.-M. and R.S. developed the experimental setup with guidance from K.D. M.M. and R.S. developed the initial code for single-pixel microscopy, which A.E.-M. adapted to the presented experiments. A.E.-M. performed the experiments, recorded the presented data, and performed the analysis with input and guidance from K.D. M.C. developed the numerical model with input from K.D. and A.E.-M. W.A.S., M.A., and C.S.H. provided the cell and tissue samples. A.E.-M., M.C., and K.D. wrote the paper with input from the other authors. K.D. conceived and supervised the study. Competing interests: K.D. is an inventor on a patent related to this work filed by the University of St. Andrews (U.K. patent application no. 1715385.9, filed 22 September 2017). All other authors declare that they have no competing interests. Data and materials availability: All data needed to evaluate the conclusions in the paper are present in the paper and/or the Supplementary Materials. The data that support the findings of this study are available upon request from the corresponding author K.D. The data are not publicly available because of the intellectual property filed with regard to the work presented.
SUPPLEMENTARY MATERIALS
REFERENCES AND NOTES
- 1.Betzig E., Patterson G. H., Sougrat R., Lindwasser O. W., Olenych S., Bonifacino J. S., Davidson M. W., Lippincott-Schwartz J., Hess H. F., Imaging intracellular fluorescent proteins at nanometer resolution. Science 313, 1642–1645 (2006). [DOI] [PubMed] [Google Scholar]
- 2.Hell S. W., Wichmann J., Breaking the diffraction resolution limit by stimulated emission: Stimulated-emission-depletion fluorescence microscopy. Opt. Lett. 19, 780–782 (1994). [DOI] [PubMed] [Google Scholar]
- 3.Chen B.-C., Legant W. R., Wang K., Shao L., Milkie D. E., Davidson M. W., Janetopoulos C., Wu X. S., Hammer J. A. III, Liu Z., English B. P., Mimori-Kiyosue Y., Romero D. P., Ritter A. T., Lippincott-Schwartz J., Fritz-Laylin L., Mullins R. D., Mitchell D. M., Bembenek J. N., Reymann A.-C., Böhme R., Grill S. W., Wang J. T., Seydoux G., Tulu U. S., Kiehart D. P., Betzig E., Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution. Science 346, 1257998 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Pullman J. M., Nylk J., Campbell E. C., Gunn-Moore F. J., Prystowsky M. B., Dholakia K., Visualization of podocyte substructure with structured illumination microscopy (SIM): A new approach to nephrotic disease. Biomed. Opt. Express 7, 302–311 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Westmoreland D., Shaw M., Grimes W., Metcalf D. J., Burden J. J., Gomez K., Knight A. E., Cutler D. F., Super-resolution microscopy as a potential approach to diagnosis of platelet granule disorders. J. Thromb. Haemost. 14, 839–849 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Huang D., Swanson E. A., Lin C. P., Schuman J. S., Stinson W. G., Chang W., Hee M. R., Flotte T., Gregory K., Puliafito C. A., Fujimoto J. G., Optical coherence tomography. Science 254, 1178–1181 (1991). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Power R. M., Huisken J., A guide to light-sheet fluorescence microscopy for multiscale imaging. Nat. Methods 14, 360–373 (2017). [DOI] [PubMed] [Google Scholar]
- 8.Bertolotti J., van Putten E. G., Blum C., Lagendijk A., Vos W. L., Mosk A. P., Non-invasive imaging through opaque scattering layers. Nature 491, 232–234 (2012). [DOI] [PubMed] [Google Scholar]
- 9.Papagiakoumou E., Bègue A., Leshem B., Schwartz O., Stell B. M., Bradley J., Oron D., Emiliani V., Functional patterned multiphoton excitation deep inside scattering tissue. Nat. Photonics 7, 274–278 (2013). [Google Scholar]
- 10.Katz O., Heidmann P., Fink M., Gigan S., Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nat. Photonics 8, 784–790 (2014). [Google Scholar]
- 11.Kang S., Jeong S., Choi W., Ko H., Yang T. D., Joo J. H., Lee J.-S., Lim Y.-S., Park Q.-H., Choi W., Imaging deep within a scattering medium using collective accumulation of single-scattered waves. Nat. Photonics 9, 253–258 (2015). [Google Scholar]
- 12.Booth M. J., Adaptive optical microscopy: The ongoing quest for a perfect image. Light Sci. Appl. 3, e165 (2014). [Google Scholar]
- 13.Débarre D., Botcherby E. J., Watanabe T., Srinivas S., Booth M. J., Wilson T., Image-based adaptive optics for two-photon microscopy. Opt. Lett. 34, 2495–2497 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Rueckel M., Mack-Bucher J. A., Denk W., Adaptive wavefront correction in two-photon microscopy using coherence-gated wavefront sensing. Proc. Natl. Acad. Sci. U.S.A. 103, 17137–17142 (2006). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Čižmár T., Mazilu M., Dholakia K., In situ wavefront correction and its application to micromanipulation. Nat. Photonics 4, 388–394 (2010). [Google Scholar]
- 16.Mosk A. P., Lagendijk A., Lerosey G., Fink M., Controlling waves in space and time for imaging and focusing in complex media. Nat. Photonics 6, 283–292 (2012). [Google Scholar]
- 17.Popoff S. M., Lerosey G., Carminati R., Fink M., Boccara A. C., Gigan S., Measuring the transmission matrix in optics: An approach to the study and control of light propagation in disordered media. Phys. Rev. Lett. 104, 100601 (2010). [DOI] [PubMed] [Google Scholar]
- 18.Badon A., Li D., Lerosey G., Boccara A. C., Fink M., Aubry A., Smart optical coherence tomography for ultra-deep imaging through highly scattering media. Sci. Adv. 2, e1600370 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Oron D., Tal E., Silberberg Y., Scanningless depth-resolved microscopy. Opt. Express 13, 1468–1476 (2005). [DOI] [PubMed] [Google Scholar]
- 20.Zhu G., van Howe J., Durst M., Zipfel W., Xu C., Simultaneous spatial and temporal focusing of femtosecond pulses. Opt. Express 13, 2153–2159 (2005). [DOI] [PubMed] [Google Scholar]
- 21.Schrödel T., Prevedel R., Aumayr K., Zimmer M., Vaziri A., Brain-wide 3D imaging of neuronal activity in Caenorhabditis elegans with sculpted light. Nat. Methods 10, 1013–1020 (2013). [DOI] [PubMed] [Google Scholar]
- 22.Rowlands C. J., Park D., Bruns O. T., Piatkevich K. D., Fukumura D., Jain R. K., Bawendi M. G., Boyden E. S., So P. T., Wide-field three-photon excitation in biological samples. Light Sci. Appl. 6, e16255 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Pégard N. C., Mardinly A. R., Oldenburg I. A., Sridharan S., Waller L., Adesnik H., Three-dimensional scanless holographic optogenetics with temporal focusing (3D-SHOT). Nat. Commun. 8, 1228 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Padgett M. J., Boyd R. W., An introduction to ghost imaging: Quantum and classical. Philos. Trans. A Math. Phys. Eng. Sci. 375, 20160233 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Tajahuerce E., Durán V., Clemente P., Irles E., Soldevila F., Andrés P., Lancis J., Image transmission through dynamic scattering media by single-pixel photodetection. Opt. Express 22, 16945–16955 (2014). [DOI] [PubMed] [Google Scholar]
- 26.Durán V., Soldevila F., Irles E., Clemente P., Tajahuerce E., Andrés P., Lancis J., Compressive imaging in scattering media. Opt. Express 23, 14424–14433 (2015). [DOI] [PubMed] [Google Scholar]
- 27.Katz O., Small E., Bromberg Y., Silberberg Y., Focusing and compression of ultrashort pulses through scattering media. Nat. Photonics 5, 372–377 (2011). [Google Scholar]
- 28.Sun B., Salter P. S., Booth M. J., Effects of sample dispersion on ultrafast laser focusing. J. Opt. Soc. Am. B 32, 1272–1280 (2015). [Google Scholar]
- 29.Rowlands C. J., Bruns O. T., Bawendi M. G., So P. T. C., Objective, comparative assessment of the penetration depth of temporal-focusing microscopy for imaging various organs. J. Biomed. Opt. 20, 061107 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Tropp J. A., Gilbert A. C., Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inf. Theory 53, 4655–4666 (2007). [Google Scholar]
- 31.Candès E. J., Wakin M. B., An introduction to compressive sampling. IEEE Signal Process. Mag. 25, 21–30 (2008). [Google Scholar]
- 32.Cheong W. F., Prahl S. A., Welch A. J., A review of the optical properties of biological tissues. IEEE J. Quantum Electron. 26, 2166–2185 (1990). [Google Scholar]
- 33.Yaroslavsky A. N., Schulze P. C., Yaroslavsky I. V., Schober R., Ulrich F., Schwarzmaier H.-J., Optical properties of selected native and coagulated human brain tissues in vitro in the visible and near infrared spectral range. Phys. Med. Biol. 47, 2059–2073 (2002). [DOI] [PubMed] [Google Scholar]
- 34.Drobizhev M., Makarov N. S., Tillo S. E., Hughes T. E., Rebane A., Two-photon absorption properties of fluorescent proteins. Nat. Methods 8, 393–399 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Coda S., Thompson A. J., Kennedy G. T., Roche K. L., Ayaru L., Bansi D. S., Stamp G. W., Thillainayagam A. V., French P. M. W., Dunsby C., Fluorescence lifetime spectroscopy of tissue autofluorescence in normal and diseased colon measured ex vivo using a fiber-optic probe. Biomed. Opt. Express 5, 515–538 (2014). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Dana H., Shoham S., Numerical evaluation of temporal focusing characteristics in transparent and scattering media. Opt. Express 19, 4937–4948 (2011). [DOI] [PubMed] [Google Scholar]
- 37.Durst M. E., Zhu G., Xu C., Simultaneous spatial and temporal focusing in nonlinear microscopy. Opt. Commun. 281, 1796–1805 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Chi Y., Scharf L. L., Pezeshki A., Calderbank A. R., Sensitivity to basis mismatch in compressed sensing. IEEE Trans. Signal Processing 59, 2182–2195 (2011). [Google Scholar]
- 39.Horton N. G., Wang K., Kobat D., Clark C. G., Wise F. W., Schaffer C. B., Xu C., In vivo three-photon microscopy of subcortical structures within an intact mouse brain. Nat. Photonics 7, 205–209 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Toda K., Isobe K., Namiki K., Kawano H., Miyawaki A., Midorikawa K., Temporal focusing microscopy using three-photon excitation fluorescence with a 92-fs Yb-fiber chirped pulse amplifier. Biomed. Opt. Express 8, 2796–2806 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Sun M.-J., Edgar M. P., Phillips D. B., Gibson G. M., Padgett M. J., Improving the signal-to-noise ratio of single-pixel imaging using digital microscanning. Opt. Express 24, 10476–10485 (2016). [DOI] [PubMed] [Google Scholar]
- 42.Sun M.-J., Meng L.-T., Edgar M. P., Padgett M. J., Radwell N., A Russian dolls ordering of the Hadamard basis for compressive single-pixel imaging. Sci. Rep. 7, 3464 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Higham C. F., Murray-Smith R., Padgett M. J., Edgar M. P., Deep learning for real-time single-pixel video. Sci. Rep. 8, 2369 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Xu Z.-H., Chen W., Penuelas J., Padgett M., Sun M.-J., 1000 fps computational ghost imaging using LED-based structured illumination. Opt. Express 26, 2427–2434 (2018). [DOI] [PubMed] [Google Scholar]
- 45.Edgar M. P., Gibson G. M., Bowman R. W., Sun B., Radwell N., Mitchell K. J., Welsh S. S., Padgett M. J., Simultaneous real-time visible and infrared video with single-pixel detectors. Sci. Rep. 5, 10669 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.de Aguiar H. B., Gigan S., Brasselet S., Polarization recovery through scattering media. Sci. Adv. 3, e1600743 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Chen X., Nadiarynkh O., Plotnikov S., Campagnola P. J., Second harmonic generation microscopy for quantitative analysis of collagen fibrillar structure. Nat. Protoc. 7, 654–669 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Jacques S. L., Optical properties of biological tissues: A review. Phys. Med. Biol. 58, R37–R61 (2013). [DOI] [PubMed] [Google Scholar]
- 49.S. Prahl, Mie scattering calculator (2007); http://omlc.org/calc/mie_calc.html.
- 50.Chen M., Mas J., Forbes L. H., Andrews M. R., Dholakia K., Depth-resolved multimodal imaging: Wavelength modulated spatially offset Raman spectroscopy with optical coherence tomography. J. Biophotonics 11, e201700129 (2018). [DOI] [PubMed] [Google Scholar]
- 51.Oheim M., Beaurepaire E., Chaigneau E., Mertz J., Charpak S., Two-photon microscopy in brain tissue: Parameters influencing the imaging depth. J. Neurosci. Methods 111, 29–37 (2001). [DOI] [PubMed] [Google Scholar]
- 52.Chaigneau E., Wright A. J., Poland S. P., Girkin J. M., Silver R. A., Impact of wavefront distortion and scattering on 2-photon microscopy in mammalian brain tissue. Opt. Express 19, 22755–22774 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Wei H. J., Xing D., Wu G. Y., Gu H. M., Lu J. J., Jin Y., Li X.-Y., Differences in optical properties between healthy and pathological human colon tissues using a Ti:sapphire laser: An in vitro study using the Monte Carlo inversion technique. J. Biomed. Opt. 10, 44022 (2005). [DOI] [PubMed] [Google Scholar]
- 54.Bashkatov A. N., Genina E. A., Kochubey V. I., Rubtsov V. S., Kolesnikova E. A., Tuchin V. V., Optical properties of human colon tissues in the 350–2500 nm spectral range. Quant. Electron. 44, 779–784 (2014). [Google Scholar]
- 55.Chen M., Dainty C., Roux F. S., Speckle evolution with multiple steps of least-squares phase removal. Phys. Rev. A 84, 023846 (2011). [Google Scholar]
- 56.Chen M., Dholakia K., Mazilu M., Is there an optimal basis to maximise optical information transfer? Sci. Rep. 6, 22821 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Flock S. T., Wilson B. C., Patterson M. S., Total attenuation coefficients and scattering phase functions of tissues and phantom materials at 633 nm. Med. Phys. 14, 835–841 (1987). [DOI] [PubMed] [Google Scholar]
- 58.Olivas S. J., Rachlin Y., Gu L., Gardiner B., Dawson R., Laine J.-P., Ford J. E., Characterization of a compressive imaging system using laboratory and natural light scenes. Appl. Opt. 52, 4515–4526 (2013). [DOI] [PubMed] [Google Scholar]
- 59.J. M. Phillips, Compressed sensing and orthogonal matching pursuit, in CS 6140 Data Mining (University of Utah, 2017). [Google Scholar]
- 60.Papagiakoumou E., de Sars V., Oron D., Emiliani V., Patterned two-photon illumination by spatiotemporal shaping of ultrashort pulses. Opt. Express 16, 22039–22047 (2008). [DOI] [PubMed] [Google Scholar]
- 61.Boudreau C., Wee T.-L., Duh Y.-R., Couto M. P., Ardakani K. H., Brown C. M., Excitation light dose engineering to reduce photo-bleaching and photo-toxicity. Sci. Rep. 6, 30892 (2016). [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.