Multi-pass transmission electron microscopy

Abstract

Feynman once asked physicists to build better electron microscopes to be able to watch biology at work. While electron microscopes can now provide atomic resolution, electron beam induced specimen damage precludes high resolution imaging of sensitive materials, such as single proteins or polymers. Here, we use simulations to show that an electron microscope based on a multi-pass measurement protocol enables imaging of single proteins, without averaging structures over multiple images. While we demonstrate the method for particular imaging targets, the approach is broadly applicable and is expected to improve resolution and sensitivity for a range of electron microscopy imaging modalities, including, for example, scanning and spectroscopic techniques. The approach implements a quantum mechanically optimal strategy which under idealized conditions can be considered interaction-free.

Introduction

Only a finite number of electrons can be used to probe a biological specimen before damaging the structure of interest¹. In conjunction with electron counting statistics (shot-noise), this leads to a finite signal-to-noise ratio (SNR) and a spatial resolution which is not limited by the quality of the electron optics, but rather by the sample-specific maximally allowed electron dose. For typical proteins imaged using cryo electron microscopy (cryo-EM) the achievable spatial resolution is about 2 nm assuming ideal instrumentation². To reconstruct a protein model at atomic resolution, thousands of images of single proteins have to be averaged^{3, 4}. However, for polymers, heterogeneous organic molecules and other forms of aperiodic beam-sensitive soft matter, averaging techniques are not applicable, and conceptually new approaches are required.

In transmission electron microscopy (TEM), biological specimens manifest as weak phase objects. Using uncorrelated probe particles, the lowest achievable measurement error is $1∕\sqrt{N}$, where N is the number of probe particle-sample interactions. This so-called shot-noise limit can be overcome using correlated particles, and the error can be reduced to 1/N, the Heisenberg limit⁵. Adequately entangled photons provide these correlations and have been applied in optical microscopes^{6, 7}. Unfortunately these entangled states are difficult to create especially the most commonly discussed N00N states⁸. While one can conceive entangled (hybrid) systems that allow approaching the Heisenberg limit with fermions^{9, 10} these appear difficult to implement experimentally. However, this limit can also be approached with a single probe particle which interacts with the phase object multiple times¹¹ and it was shown that this is an optimal measurement strategy at a given number of probe particle-sample interactions¹². Using self-imaging cavities¹³ this approach has recently been extended to full field optical microscopy^{14, 15}.

Here we demonstrate through simulations that a multi-pass protocol can enhance the sensitivity and spatial resolution of dose-limited TEM. Multi-pass TEM image simulations of protein structures embedded in vitreous ice demonstrate order-of-magnitude improvements in typical cryo-EM experiments, and simulations of single-layer graphene images illustrate the limits of the multi-pass technique.

Results

Reduced damage using multi-pass microscopy

A sketch of a multi-pass TEM is shown in Fig. 1. The image formed by an aberration-free implementation can be obtained through iterative application of the single pass transmission function t of the sample. For m passes, the effective transmission function t _m is equivalent to the one of an m times thicker sample $t_m=t^m={\mid t\mid }^m{e}^{im\phi }$, where $\mid t\mid$ is the transmission magnitude and ϕ is the phase shift induced by its potential, both of which vary spatially. In a phase microscope the undiffracted wave is first phase shifted in the Fourier plane by π/2, and then interfered with the diffracted beam in order to transfer phase information into intensity variations in the image plane^{16, 17}. A highly transmissive ($1-{\mid t\mid }^m\ll 1$) and weak phase ($m\phi \ll 1$) specimen will yield $N\left(x,y\right)~N_0\left[1-2m\phi \left(x,y\right)\right]$ detected electrons, with N ₀ electrons illuminating an area ${\delta }^2$ that is imaged onto a single pixel of the detector. A multi-pass configuration thus leads to an m-fold signal and sensitivity enhancement, while shot noise is $~\sqrt{N\left(x,y\right)}$. The signal to noise ratio becomes $\mathrm{SNR}=\mid N_{\mathrm{S}}-N_{\mathrm{B}}\mid ∕\sqrt{N_{\mathrm{S}}+N_{\mathrm{B}}}~\sqrt{2N_0}m\mathrm{\Delta }\phi$, where N _S and N _B give the number of detected electrons when imaging the specimen and background, respectively, and Δϕ is the single-pass phase shift difference between the specimen and background.

Figure 1.

Schematic of multi-pass microscopy. A sample S is placed between two two objective and field lenses (OL and FL, respectively). This configuration is placed in between two mirrors M, which can be gated for in- and out-coupling of the electron beam (see methods). A pulsed probe beam is coupled into the optical path of the multi-pass microscope and illuminates S. The exit wave is subsequently re-imaged back onto the sample, which is now illuminated with an in-focus image of itself. This process is repeated multiple (m) times, after which the pulse is out-coupled and imaged onto a detector. For illustration, field (black) and imaging (red) rays are shown, which retrace themselves after one full roundtrip.

For operation at constant damage the number of incoming probe particles has to be chosen such that the total number of probe-particle sample interactions is independent of m. This yields a SNR at constant damage proportional to $\sqrt{m}$ and, alternately, a damage reduction at constant SNR proportional to 1/m. This also holds for scattering contrast and dark-field detection techniques (see methods). Under idealized conditions, the multi-pass method has similar damage scaling as interaction-free methods^18–21 (see methods).

Reduced damage directly translates into improved dose limited spatial resolution (DLR). Since the SNR at constant damage is proportional to $\sqrt{N_{0}m}\mathrm{\Delta }\phi$, this suggests that even at m  = 1 the smallest phase objects could be detected with high SNR as long as N ₀ is large enough. However, as radiation can destroy the structural features of interest, images are often acquired at a single-pass dose $D=\frac{e{N}_0}{{\delta }^2}$ about twice the critical dose D _c ^{22, 23}. This leads to a minimum feature size δ that can be imaged with a given SNR. Using the above equations we see that δ improves as $\mathrm{1∕}\sqrt{m}$. This proportionality also holds for scattering contrast (see methods).

Multi-pass TEM simulations

In the following we show multi-pass TEM simulations of three model systems of known structure: graphene^{24, 25} the hexameric unit of the immature HIV-1 Gag CTD-SP1 lattice ($\mathrm{HIV}-\mathrm{1Gag}$, PDB ID: 5I4T)²⁶ and the Marburg Virus VP35 Oligomerization Domain P4222 (MARV VP35), PDB ID: 5TOI)²⁷. In the simulations of an aberration-free multi-pass TEM (see methods for details) an electron wave passes through a sample multiple times. After m passes, the resulting exit wave is imaged onto an ideal detector. We consider a phase sensitive detection scheme employing a phase plate to shift the phase of the undiffracted beam by ±π/2. This can be realized with various techniques^{16, 17, 28–30}. Poissonian noise is applied to the detected intensity to simulate shot-noise. The incoming electron dose is chosen such that the effective dose, i.e. the number of electron-sample interactions and thus the electron induced damage, is independent of m. For a lossless sample this implies that the incoming dose is scaled by 1/m. In the simulations, both elastic and inelastic loss is considered (see methods).

The simulations for graphene were done with an electron energy of 60 keV, chosen to be low enough to minimize damage³¹. Figure 2(a) and (b) show the phase and amplitude (respectively) of the simulated exit wave function as a function of the number of interactions. The phase shifts build up linearly, eventually to more than π. The amplitude of the exit wave function decreases with the number of interactions. Although inelastic loss is assumed to be homogeneous across the unit cell³² the lattice structure becomes apparent at higher interaction numbers. This is because the spatially distributed phase shifts cause significant lensing. In this regime, phase contrast is transferred into amplitude contrast even in absence of a phase plate. A noise-free image of the exit wave function is shown in Fig. 2(c). The detrimental effect of counting statistics on spatial resolution becomes apparent in Fig. 2(d–f), which show simulated images as a function of effective dose. While in Fig. 2(d) and (e) the lattice structure is not visible after a single interaction, multiple passes improve the SNR and therefore the spatial resolution. At higher interaction numbers the SNR decreases again, mainly because phase shifts build up to an extent that standard phase microscopy is no longer the ideal read-out scheme, an effect that also becomes apparent in Fig. 2(c). Electron losses also reduce the visibility at higher interaction numbers. The optimum number of interactions thus depends on the details of the sample, the energy of the electrons, the read-out method as well as on the information that is to be extracted from the image.

Figure 2.

Multi-pass TEM simulation of graphene. (a) and (b) show the phase and amplitude of the exit wave function after a given number of passes, respectively. Simulated multi-pass phase TEM images, noise-free (c), and at various effective dose levels (d–f). The colorscale for (c–f) is in units of standard deviations from the mean intensity of each image. The scalebar is 0.14 nm.

Figure 3(a) and (b) show the ribbon diagram and projected potential of MARV VP35, which is embedded in 20 nm of vitreous ice for cryo-EM. Inelastic losses are dominated by scattering in the vitreous ice, which has an inelastic mean free path of 350 nm for electrons at 300 keV³³. Figure 3(c) shows simulated multi-pass TEM results at various effective dose levels. For a given effective dose (D _eff) the image quality improves with the number of passes. The best SNR is achieved after 10 to 20 passes, where a single alpha helix becomes apparent at a dose below the critical dose for biological specimens. For a higher number of passes the SNR decreases again, both due to phase build-up and inelastic losses. Figure 3(c) also shows the 1/m damage reduction at constant SNR. The image at (m = 1, D _eff = 128 e⁻/Ų) has a SNR equivalent to to the one at (m = 4, D _eff = 32 e⁻/Ų), and at (m = 16, D _eff = 8 e⁻/Ų).

Figure 3.

Multi-pass TEM simulation of protein structures. (a) Shows the ribbon diagram and (b) shows the projected potential of MARV VP35. (c) Shows simulated multi-pass phase TEM images for 300 keV electrons, calculated at three respective levels of effective dose, which are shown on the right. Note that the incoming dose for each panel is roughly m-fold lower than the effective dose, as explained in the text. The white circles indicate figures of similar SNR (see text). The red line indicates the typical critical dose (~20 e⁻/Ų) for biological specimens²³. (d–f) Show the results for two different projections of HIV–1 Gag. All scalebars are 2 nm, the colorscale for (c) and (f) is in units of standard deviations from the mean intensity of each image.

Figure 3(d–f) show simulations for HIV–1 Gag in two different orientations. Due to phase wrapping, the best SNR is now achieved after 8 to 12 (4 to 8) passes for the projection along the thin (thick) axis of the protein, respectively. For such medium sized proteins, multi-pass microscopy enables the identification of the protein orientation at extremely low dose. One important application of this might be to record dose-fractionated movies with lower effective exposure levels per frame compared to what is currently needed to align successive frames. The reason to do so is that beam-induced movement is much greater over the first 2 to 4e⁻/Ų of an exposure, while, at the same time, the high-resolution features of a specimen are rapidly becoming damaged during that time³⁴. Reduction of frame-to-frame motion is expected to retain most of the high-resolution signal that is currently lost due to beam-induced motion.

Discussion

Our analysis shows that the signal enhancement provided by multi-pass protocols can enable the detection of highly transmissive specimens at minimal damage. We have shown that details of dose sensitive specimens can be revealed without averaging, under realistic imaging conditions. Multi-pass TEM offers a quantum optimal approach to imaging, for example, single proteins, DNA, and polymers.

Methods

Scattering Contrast (Gray-Scale) Multi-Pass TEM

In scattering contrast TEM, contrast is obtained from spatially varying electron loss due to elastic and inelastic scattering events. Scattering contrast is insensitive to weak phase shifts. A local and real transmission T of the sample can then be defined based on λ _f, the mean free path length in between scattering events that lead to loss:

$$T\left({\alpha }_0\right)={\mid t\left({\alpha }_0\right)\mid }^2=e^{-s∕{\lambda }_f\left({\alpha }_0\right)},$$ 1

where s is the local thickness of the sample. λ _f depends on α ₀, the aperture of the objective lens, as electrons scattered to higher angles will not be detected. In a TEM a sample is typically located on some kind of support film or embedded in a homogeneous medium, as for example in cryo-EM, where the medium is vitrified water. The transmission of the sample T _S and the background film or medium T _B can be calculated according to (1). Assuming shot-noise limited electron detection, the SNR of multi-pass scattering TEM can be written as

$${\mathrm{SNR}}_m=\sqrt{N_0}\frac{\mid T_{\mathrm{S}}^m-T_{\mathrm{B}}^m\mid }{\sqrt{T_{\mathrm{S}}^m+T_{\mathrm{B}}^m}},$$ 2

where T ^m is the effective transmission after m passes. Passing an incoming electron through a sample multiple times increases the totally applied dose a sample is exposed to and an effective multi-pass dose can be defined as

$$D_{\mathrm{e}\mathrm{f}\mathrm{f},\mathrm{m}}=\frac{e{N}_0}{{\delta }^2}\sum _{i=1}^m{T}_S^{i-1}=\frac{e{N}_0}{{\delta }^2}\frac{1-T_{\mathrm{S}}^m}{1-T_{\mathrm{S}}},$$ 3

which for T _S → 1 yields $D=m\frac{e{N}_0}{{\delta }^2}$. For m = 1 the above equations reduce to the single-pass result. In order to identify a feature with a certain SNR = SNR₁ and applying a particular effective dose $D_{\mathrm{e}\mathrm{f}\mathrm{f}}=D_{\mathrm{e}\mathrm{f}\mathrm{f},1}$, the feature size must be

$${\delta }_m=\frac{{\mathrm{S}\mathrm{N}\mathrm{R}}_1\sqrt{e}}{\sqrt{D_{\mathrm{e}\mathrm{f}\mathrm{f}}}}\frac{\sqrt{T_{\mathrm{S}}^m+T_{\mathrm{B}}^m}}{\mid T_{\mathrm{S}}^m-T_{\mathrm{B}}^m\mid }\sqrt{\frac{1-T_{\mathrm{S}}^m}{1-T_{\mathrm{S}}}},$$ 4

which gives the multi-pass DLR. For highly transmissive samples (T _S → 1, T _B → 1) it scales as $\mathrm{1∕}\sqrt{m}$. Note that an image of constant resolution could be taken at an effective dose that is m times lower, implying m times less damage.

Multi-pass microscopy and interaction free measurements

Several schemes have previously been proposed for the interaction-free detection of absorptive samples^18–21. Under idealized conditions multi-pass microscopy provides the same damage scaling and can enable interaction free microscopy. To demonstrate this, we consider the threshold SNR for detection of a phase object to be $\mathrm{SNR}=\sqrt{2N_0}m\mathrm{\Delta }\phi ~1$. On the other hand, the number of electrons that cause damage by scattering inelastically is $N_{\mathrm{inel}}=N_0\left(1-{\mid t_{\mathrm{inel}}\mid }^{2m}\right)~2N_{0}m\alpha$, where $\alpha =1-\mid t_{\mathrm{inel}}\mid$, and elastic losses are assumed to be negligible (i.e. no electrons are scattered out of the aperture of the microscope). The quantum interaction-free regime is reached for $N_{\mathrm{inel}}=\alpha ∕m\mathrm{\Delta }{\phi }^2\ll 1$, which can be approached for a large enough number of passes m.

A similar scaling is obtainable in dark field configurations. In this case, for weak phase shifts Δϕ (taking the limit $\mathrm{\Delta }\phi \gg \alpha$), the threshold for detection is $N_0{m}^2\mathrm{\Delta }{\phi }^2~1$ while the number of inelastically scattered electrons is $N_{inel}~2N_{0}m\alpha$. Combining these expressions results in $N_{inel}~\alpha ∕m\mathrm{\Delta }{\phi }^2$, again, $\ll 1$ for $m\gg 1$. When both elastically scattered and unscattered electron are detected with high quantum efficiency, threshold detectability shares the same counter-factual flavor of the original Elitzur-Vaidman proposal¹⁸: if an elastically scattered electron is detected, the probabalistic nature of quantum mechanics implies no inelastic damage to the sample (likewise for unscattered electrons). This suggests the possibility of damage-free imaging in certain cases.

Multislice Simulations of Multi-Pass TEM

Multislice simulations were done using the methods and atomic potentials given in Kirkland³⁵, using custom Matlab code. An ideal plane wave was propagated in alternating directions through the sample, with no wavefront aberrations applied between passes (we assume that the lenses and mirrors in the optical system can compensate for each other’s aberrations). For both the protein samples and graphene, thermal smearing of 0.1 Å was applied to the atomic potentials. For graphene this was done with 32 frozen phonon configurations, while for the proteins Gaussian convolution was applied to the atomic potentials. A maximum scattering angle was enforced between each pass by applying an aperture cutoff function, equal to 20 mrad for the protein samples and 50 mrad for the graphene sample. Inelastic losses were included by filtering out a fraction of the electron wave each pass, effectively assuming that we can filter out electrons with large inelastic losses (>5 eV) each pass using the optical stack. For graphene imaged at 60 kV, we assume 1.54% inelastic loss per pass, estimated by measuring losses from an experimental STEM-EELS spectrum recorded on a NION TEM at the SuperSTEM facility. For the protein sample, we assume the inelastic losses are dominated by the vitreous ice portion of the sample. We assumed an ice thickness of 20 nm, and a loss of roughly 5.5% per pass at 300 kV, estimated from the literature³³. The protein structures were taken from the Protein Data Bank (PDB ID: 5I4T²⁶ and PDP ID: 5TOI²⁷). At the surface of the protein, we used the continuum model of vitreous ice given by Shang and Sigworth³⁶, which was implemented using 3D integration. Finally, we assumed an ideal phase plate (−π/2 phase shift of the unscattered center beam) was applied to the electron plane wave after it is coupled out of the optical cavity (a near-ideal phase plate design has been demonstrated experimentally³⁷).

Engineering and Design of a Multi-Pass TEM Instrument

While a multi-pass TEM still has to be demonstrated, the necessary components exist. Lenses and mirrors are lossless and can be used to correct for each other’s aberrations³⁸, which allows for re-imaging of the transverse electron wave-front. Long storage times and cavity enhanced measurements have been demonstrated in charged particle traps and storage rings^{39, 40}. Fast in- and out-coupling of a charged particle beam can readily be achieved using fast beam blanking or pulsed entry and exit electrodes⁴¹. Given typical electron microscope dimensions and electron energies, the required gating time is on the order of 1–10 ns, which can be realized using commercial pulse generators. A design for a multi-pass TEM is currently under development. Proof-of-concept design simulations show that at 10 keV re-imaging to within 4 nm is possible in a full-field all-electrostatic design using a tetrode mirror to partially correct for the aberrations induced by the objective.

Author Contributions

T.J., B.K. and M.K. conceived the technique. S.K., T.J. and C.O. performed the simulations. T.J., S.K., C.O. and M.K. analyzed the results. All authors prepared the manuscript.

Competing Interests

The authors declare that they have no competing interests.