Summary
How actin filaments (F-actins) are dynamically reorganized in motile cells at the level of individual filaments is an open question. To find the answer, a high-speed atomic force microscopy (HS-AFM) system has been developed to live-imagine intracellular dynamics of the individual F-actins. However, noise and low resolution made it difficult to fully recognize individual F-actins in the HS-AFM images. To tackle this problem, we developed a new machine learning method that quantitatively recognizes individual F-actins. The method estimates F-actin orientation from the image while improving the resolution. We found that F-actins were oriented at ±35° toward the membrane in the lamellipodia, which is consistent with Arp2/3 complex-induced branching. Furthermore, in the cell cortex our results showed non-random orientation at four specific angles, suggesting a new mechanism for F-actin organization demonstrating the potential of our newly developed method to fundamentally improve our understanding of the structural dynamics of F-actin networks.
Subject areas: physics, biological sciences, computer science, engineering
Graphical abstract

Highlights
-
•
Cyto-LOVE reconstructs F-actin network at individual filamentous level from AFM images
-
•
Novel four-angle orientation of F-actins were discovered in cell cortex
-
•
F-actin orientation at ±35° in lamellipodia was consistent with branching by Arp2/3
-
•
Cyto-LOVE method enhances understanding of F-actin organization mechanism
Physics; Biological sciences; Computer science; Engineering
Introduction
Actin cytoskeletons are important for a wide range of cellular processes, such as morphogenesis and motility, due in part to their ability to facilitate polymerization/depolymerization, branching, and crosslinking between filaments.1,2,3 Actin reorganization is regulated by intracellular signaling via actin-associated molecules. Many studies have live-imaged the activity of signaling molecules such as Rho GTPases and examined the relationship between molecular activities and morphological changes.4,5 Our understanding of the relationship between the molecular activities and morphological changes of the cytoskeleton, however, is currently limited. Indeed, it is unclear how signaling molecules regulate the polymerization/depolymerization, branching, and crosslinking of each F-actin, and subsequently, how this affects morphological changes. To fill this knowledge gap, each F-actin in living cells should be tracked.
Cytoskeleton architecture has predominantly been observed using electron microscopy (EM) at a high spatial resolution.6,7 F-actins can assemble into several formations, including branched networks in the lamellipodia, bundled filaments in the filopodia, and actomyosin in stress fibers.1,8,9,10,11 F-actin architecture was recently analyzed quantitatively in terms of branching point density, actin filament density and the angular distribution of actin filaments from EM images.6,10,12 However, EM observations are limited to dead, rather than living, cells. It has consequently been impossible, until date, to observe the dynamics of each F-actin in living cells using EM.
Tip-scan high-speed atomic force microscopy (HS-AFM) imaging systems have been established for live-cell imaging of cellular surfaces.13,14 We have developed a new HS-AFM that can help to visualize the structural dynamics of the cortical actin network.15 Using this technology, the polymerization rate and frequency of filament synthesis were measured in living cells. However, precisely recognizing the F-actin architecture from the HS-AFM images was challenging due to the low spatial resolution, which makes it difficult for the human eye to recognize branching points and terminals in the actin network. Additionally, the presence of AFM-specific noise, caused by the high scanning rate of the AFM needle, further imitates this method. The images were distorted with sine noise perpendicular to the scanning direction. Another difficulty in recognizing F-actin structures is imaging three-dimensional (3D) F-actin network structures in a 2D view. In fact, F-actin is localized beneath and parallel to the plasma membrane. F-actins thus can be studied by projecting them onto a 2D plane, which can then be imaged by HS-AFM. In such a two-dimensional representation, the individual F-actins intersect, which makes it difficult to identify overlaps and branches at each intersection.
In this study, we developed a new machine learning method called cytoskeletal location of various filamentous entity (cyto-LOVE) to quantitatively recognize F-actin networks in noisy, low-resolution HS-AFM images to an individual filament level. The new method can estimate the location and orientation of F-actin from noisy, low-resolution observations, and track each F-actin to extract the topology of the F-actin network. By applying our method to HS-AFM images of lamellipodia and cortex F-actin, the actin network was successfully modeled from low-resolution images and morphological network attributes, such as orientation and persistence length distribution, are determined. Using cyto-love, we discovered that F-actins in the lamellipodia predominantly orient at ±35° relative to the membrane, aligning with the angle of Apr2/3-induced branching. Additionally, we found that F-actins in the cell cortex exhibit four specific orientations, challenging the widely held belief of their random orientation.
Results
HS-AFM imaging
HS-AFM can be used to live-image F-actin dynamics beneath the cellular membrane,15 using a needle that is targeted to living cells to scan across the surface area of interest at a high-speed (e.g., 0.1 frames/s; Figure 1A). A needle was pushed into the cell surface using a weak loading force to successfully visualize the dynamics of the F-actin in the lamellipodia at the leading edge and in the cell cortex, which is distant from the leading edge in motile cells (Figures 1B and 1C). Although this is the first report in which F-actin dynamics have been imaged in vivo, it was difficult to recognize individual F-actins using the spatial resolution of the HS-AFM, which is determined by multiple factors, including needle width, scanning rate, and flexibility of the cellular membrane. Furthermore, the AFM image inevitably included scanning noise caused by the line scan of the needle (Figures 1B and 1C).
Figure 1.
HS-AFM imaging of F-actin dynamics in living cells
(A) Image showing the areas of interest for the HS-AFM imaging system for live cells. Red and black dashed-line boxes represent the areas in which the F-actins in the lamellipodia and cortex were imaged, respectively. Scale bar: .
(B) HS-AFM images of F-actins in the cell surface area of the lamellipodia and (C) cell cortex. Scale bar: .
Data processing flow for cyto-LOVE
To quantitatively extract the topology of the F-actin network from AFM images, a new machine learning-based image analysis method was developed to determine the cytoskeletal locations of various filamentous entities (cyto-LOVE). The flow of the developed cyto-LOVE process is depicted in Figures 2A and 2C.
Figure 2.
Schematic illustration of the cyto-LOVE processing flow
(A) Flow of data processing in cyto-LOVE. FFT/iFFT processing removes scanning noise. SDS clears filamentous structures of the F-actins by estimating the presence and orientation of individual F-actins. MCMC extracts the F-actin structure as a connected particle network.
(B) The Notch filtering method is used to remove scanning noise. The HS-AFM image was transferred to the frequency domain using fast Fourier transform (FFT). The notch filter kernel was applied to remove the frequency component of the scanning noise. The denoized image is reconstructed using an inverse Fourier transform (iFFT). Scale bar: .
(C) Demonstration of the cyto-LOVE process using a real AFM image. Scale bar: .
Data processing in cyto-LOVE consists of preprocessing and two essential steps. During preprocessing, scanning noise was removed by notch filtering using a fast Fourier transform (FFT; Figures 2B and 2A after FFT/iFFT). The first step after preprocessing was the Bayesian estimation of the location and orientation of individual F-actins based on the steerable deconvolution smoothing (SDS) algorithm.16 Noisy AFM images were clarified, indicating that the filamentous structures were highly enhanced (Figure 2A after SDS). The second step was recognition of the F-actin architecture as a connected-node network by tracking the individual F-actins using the Markov chain Monte Carlo (MCMC) method17 (Figure 2A after MCMC).
Step 1: Image clarification using MAP estimations of the cytoskeletal location
The first step in the cyto-LOVE process is to estimate the location and orientation of individual F-actins using MAP (Maximum A Posteriori) estimations. To represent the F-actin orientation, we have introduced a function, , which describes the probability of F-actin orientating at specific angles at pixel coordinate , where ( is the 1-sphere) denotes a unit vector with angle . This function is known as the angle orientation distribution (AOD) function.18,19 An example of the AOD function on an image with two filaments at different angles is shown in Figure 3A. At point (a), the AOD function peaked at 45°, as the filament running through point (a) was oriented at 45°. At point (b), the AOD function had double peaks at 45° and 90°, as point (b) is located at a cross point between two filaments oriented at 45° and 90°. However, at point (c), which is outside the filament, the AOD function had no peak and remained low.
Figure 3.
Angle orientation distribution (AOD) function for describing orientation of F-actin
(A) Representation of F-actin orientation when using the AOD function. The image shows an example of two crossed F-actins. The AOD functions are depicted at positions (a–c) in the image.
(B) Clarified image derived from the AOD function estimated from an AFM image. This image was visualized using the maximum values of the AOD function with respect to at each pixel. Scale bar: .
(C) Magnified images of the red rectangular ROI in image (B).
(D) The estimated AOD functions are depicted at positions (a’, b’, c’) in image (C). At point (a’), the AOD function has a single peak that indicates a filament without crossing. At point (b’), the AOD function has double peaks that indicates filaments with crossing. At point (c’), the AOD function has no peak and remained low because point (c’) is outside the filament.
A previously published method was used to estimate .16 According to Bayes’ theorem, the following relationship holds:
| (Equation 1) |
where and is the pixel index. represents a posterior distribution of given image , represents a likelihood, and this describes a probabilistic process by which the AFM images are generated when using an unknown orientation for the F-actins; and represents a prior distribution of , which regularizes the continuous fiber structure of F-actins (see STAR Methods for details). This was followed by the estimation of by maximizing as follows:
| (Equation 2) |
where and indicate the most likely AOD functions. The filamentous structures of the F-actins were then reconstructed (Figure 3B) as follows:
| (Equation 3) |
The maximization of with respect to (Equation 3) enhanced the F-actin signal, as shown in Figure 3B. To validate the estimation of the AOD function, we confirmed that it had a single peak corresponding to the angle of the filament at the non-crossing point and double peaks corresponding to the two filaments oriented at different angles (Figures 3C and 3D). Furthermore, it can be easily noticed that the F-actin network was visualized as if it was in three-dimension space, especially at the crossing point of F-actins (Figure 3B). This was because at the maximum operation, the AOD function at the crossing points had two peaks (Figure 3D), and the selection of the highest peak by the maximum operation only visualizes the F-actin with the higher intensity, which could be present near the membrane.
Step 2: Object recognition of individual F-actins using MCMC
The second step in the cyto-LOVE method is to reconstruct the topological structures of the F-actin network using the AOD functions estimated in Step 1. As previously described,19,20 F-actin was represented by the model , which is built upon a set of particles and the set of connections between them (Figure 4A). In this model, a particle is ellipse-shaped, and the orientation represents the orientation of the F-actin, while position represents the location of F-actin; and the edge connecting the particles determines the topology of the F-actin network. To find a model of the F-actin network from the AFM images, a function that describes how well the model fits the F-actin network in an observed image is required. The function is then maximized by tuning the model, that is, reorganizing the F-actin network model. This function is the posterior probability of model given AFM image , , which can be computed using Bayes’ theorem as
| (Equation 4) |
is the likelihood representing how well the model fits the observed image , described by
| (Equation 5) |
| (Equation 6) |
is called the “external energy,” where ( and are constants), denotes the temperature parameter and is the estimated AOD function from image . Note that is an energy representing how the model differs from the image ; at the minimum of the energy landscape of , the model most fits the noisy image observed using HS-AMF. is the prior probability representing the connection rule of the particles in the model, which is described by:
| (Equation 7) |
| (Equation 8) |
where is the “internal energy,” describes the elastic energy of the F-actin, is the collision energy between the neighboring particles, and is an energy to prohibit the loop structure of the F-actin network (see STAR Methods in details). Therefore, the posterior probability can be written as
| (Equation 9) |
where denotes the total energy. Model was estimated by maximizing , which is the same problem as minimizing the total energy .
Figure 4.
Model describing topological structure of F-actin
(A) Connected particle model for topological structure of F-actin. Particles are ellipse-shaped, and their semi-minor axis represents the orientation of the F-actin.
(B) Particles in model with low external energy should be placed on the central line of and orient with F-actin.
(C) In model with low internal energy, (1) two connected particles should orient at the same angle and be placed in a short distance; (2) particles can collide nearly orthogonally to represent the crossing of the two F-actins but should not collide parallelly; and (3) no closed loop appears.
(D) Example of the total energy of two models (left) and (middle) for a single F-actin. In the right panel, is lower than because more fits the F-actin structure in the observed image than .
The original model19,20 did not fully represent the F-actin network in the HS-AFM image, as its function was to track axonal fibers, whose characteristics differ from F-actins. Axon fibers are wiggly wired in the brain tissue, whereas F-actin exists in smooth and continuous segments with a high persistence length. In the original formulation, was described by a single energy term simultaneously that included the repulsive and bending effects of particles. However, the effect of bending was weak compared with the repulsive effect and cannot be controlled independently of the repulsive effect. Therefore, cyto-LOVE introduces a new internal energy that strengthen the bending of the connected particle to represent the smooth and continuous segments of the F-actin network (see STAR Methods).
The estimated model must satisfy three characteristics: (1) elliptical particles should be placed on the central F-actin line; (2) particles should be oriented along the F-actin; and (3) the two adjacent particles should be placed at almost equal distances. The external energy, , is minimized when a model satisfies the first and second characteristics, indicating that particles are accurately aligned with the F-actin’s central line and orient along it (Figure 4B). This alignment suggests a strong correspondence between the model and the observed data. The internal energy, , is reduced when the model satisfies the third characteristic, specifically when two connected particles maintain the same orientation at a close distance ([1] in Figure 4C). However, the internal energy increases significantly when particles either collide while parallel ([2] in Figure 4C) or form a closed loop ([3] in Figure 4C).
Notably, the was designed such that it has a low value when two particles collide in a nearly orthogonal manner, representing the crossing of two F-actins ([2] in Figure 4C). Consequently, the more model meets the three identified characteristics, the lower the total energy value (Figure 4D).
We optimized model by minimizing using the RJMCMC method.17 In each iteration of the RJMCMC method, an alternative model, , is sequentially generated from the current model in a random manner and then probabilistically accepted or rejected (see STAR Methods). Alternate models are then generated as follows; particle birth and death (adding or deleting particles from the current model; Figures 5A and 5B), moving and rotating of particles (changing the position or orientation of particles; Figure 5C), connection/reconnection between particles (adding or altering connections; Figure 5D), and track-birth and track-death (like the polymerization and depolymerization of actin, adding or removing particles from the end of a modeled F-actin; Figures 5E and 5F).
Figure 5.
Efficient sampling of the MCMC method to optimize the connected particle model
(A) Particle birth; a new particle is randomly added to the current model.
(B) Particle death; a particle is randomly selected to be removed from the current model.
(C) Moving and rotating of particles; the positions or orientations of the particles are altered.
(D) Connection/reconnection between particles; a new connection is created between two adjacent particles or an existing connection is reconnected to another adjacent particle.
(E) Track-birth of particles; F-actin is randomly selected, and a new particle is added to the end, similar to polymerization.
(F) Track-death of particles; F-actin is randomly selected and a particle at the end is removed, similar to depolymerization.
To test the performance of the MCMC method, it was used to process an artificial image created using two independent crossing F-actins and Gaussian noise (Figure 6A). Model estimations were then visualized during the MCMC iterations (Figure 6B). Here, we observed the elementary model alterations in the MCMC. First, seed particles are generated and randomly placed on the F-actin by “birth” (plotted in red color; at 100 iterations in Figure 6B). Based on those particles, “track-birth” generates particles (plotted in green color) to elongate the connections like the polymerization of F-actin (at 500 iterations in Figure 6B). On the same F-actin, two separated connections appeared (at 1,000 iterations in Figure 6B), as the seed particles were randomly generated by “birth.” The two separated connections were elongated by “track-birth,” then met head-on and linked by “connection/reconnections” (at 10,000 iterations in Figure 6B). At this moment, the MCMC recognized the crossing of two independent F-actins, not as an x-shaped object (at 10,000 iterations in Figures 6B and 6C), as the collision of differently oriented particles was allowed at the crossing point (Figure 6D; see STAR Methods). Finally, the F-actin networks were fully represented by the connections between particles (at 50,000 iterations in Figure 6B). The total energy of the model was confirmed to decrease during the MCMC iterations (Figure 6E).
Figure 6.
Demonstration of the developed method using an artificial F-actin image
(A) Artificial image containing two crossing F-actins. Noise was added to the image, which mimics the actual AFM images.
(B) Visualization of the MCMC method. The F-actin network is represented by connected-ellipse-shaped particles, and the green and red particles are generated by the track-birth and birth samplings, respectively.
(C) Estimated model of the F-actin network.
(D) Magnifications of the red ROI at 50,000 iterations in (B). Note the colliding particles, each of which are assigned to different F-actins.
(E) Change in the total energy during the MCMC iterations. Note that the intrinsic energy consisting of the F-actin elastic energy and the collision energy has a positive value as the number of particles increases, while the external energy always has a negative value.
F-actin network characteristics in the lamellipodia and cell cortex
The cyto-LOVE method was used to process an HS-AFM image of COS-7 cells in culture (Figure 7). To observe the subcellular F-actin structures, HS-AFM was used to image the lamellipodia and the cell cortex distant from the lamellipodia.
Figure 7.
Different orientations of estimated F-actins in the lamellipodia and cell cortex
(A and G) AFM images of the lamellipodia and cell cortex. The image contains a large amount of scanning noise along the scanning direction of the AFM needle. Scale bar: .
(B and H) AFM images after processing using the FFT/iFFT and SDS algorithm. The scanning noise in (A and G) was removed using FFT/iFFT. The image was visualized using the maxima of the estimated AOD function with respect to angle at each pixel.
(C and I) Estimated F-actin structures. Individual F-actins are depicted in different colors.
(D and J) Distribution of the estimated F-actin angle structures in the lamellipodia and cell cortex. The individual F-actin angles were calculated using the average angle of the connecting particles.
(E and K) Changes in the total energy during the MCMC iterations in the lamellipodia (E) and cell cortex (K).
(F and L) Persistence length distribution of lamellipodia (F) and cell cortex (L) network. The persistence length is measured to be and respectively.
The AFM images of the lamellipodia were examined first. For the cyto-LOVE data processing, scanning noise was removed from the raw images using FFT/iFFT methods (Figure 7A); the images were then clarified using the SDS algorithm (Figure 7B), and the F-actin structures estimated using the MCMC algorithm (Figure 7C). The angles of individual F-actin were quantified in the estimated F-actin structure. It was then confirmed that the angle distribution had two peaks in the lamellipodia, with an interpeak interval of 70°, which was consistent with the angle of branched F-actin by the Arp2/3 complex6 (Figure 7D). These results clearly indicate that cyto-LOVE can accurately estimate the F-actin structure. The total energy of the model was confirmed to decrease during the MCMC iterations (Figure 7E). The persistence length is measured to be in the estimated F-actin structure and the distribution was shown in Figure 7F. The persistence length of F-actin was reported to be nearly with low deviation when its length ranges between 5 and .21
The AFM images of the cell cortex were then examined using the cyto-LOVE method (Figures 7G–7L). The F-actins in the cell cortex were non-randomly oriented, which is in contrast to that in previous studies that reported that they were uniformly oriented.22,23 In contrast to the two peaks in the lamellipodia, the angle distribution had four peaks at approximately −60°, −30°, 30°, and 60°, respectively, in the cell cortex (arrows in Figure 7J). Two orthogonal pairs (−60° and 30°, and −30° and 60°) were identified and indicated the presence of an actin-associated protein, filamin A (FLNa), which orthogonally links two F-actins in the cell cortex.24 Furthermore, this strongly suggests a novel mechanism for F-actin organization that involves FLNa, which exists latently in the cell cortex.
Discussion
In this study, a machine learning method (cyto-LOVE) was developed to quantitatively recognize F-actin networks in HS-AFM images. The method sequentially conducts a two-step computation: the first step extracts the angle orientation of F-actin as the AOD function, and the second step recognizes the individual F-actin represented as the connected particle model, which is biologically reasonable and fits well with the observed HS-AFM images using MCMC. By analyzing the HS-AFM images of COS-7 cells, we demonstrated that cyto-LOVE can accurately reconstruct the Arp2/3-indued branched F-actin network in lamellipodia. Moreover, we identified novel characteristic of F-actins in the cell cortex, specifically that F-actin dominantly orients at four specific angles, although it is widely believed that F-actins are uniformly oriented in this region. This discovery suggests the existence of an unknown mechanism for F-actin organization. The developed cyto-LOVE method will thus be a fundamental tool to help improve our understanding of the structural dynamics of the F-actin network.
The approach described in this study has three defining characteristics when compared with previous models. First, cyto-LOVE is robust in its ability to recognize individual F-actins in noisy AFM images with low spatial resolution. This robust ability was accomplished by estimating the AOD function, in which prior knowledge regularized the shape of F-actin as a continuous fiber structure. In a low-resolution image, noise can generate random patterns rather than a specific continuous fiber structure. Thus, prior knowledge of the F-actin structures enables a more robust estimation of AOD function by suppressing the noise effects. Second, cyto-LOVE adopts the biological kinetics of F-actin to optimize the connected particle model. In the MCMC, track-birth and track-death proposals were used for the sampling models of the F-actin network. The track-birth proposal mimics the polymerization of F-actin by adding a new particle at the terminus using a single particle as an actin monomer. The track-death method mimics depolymerization by removing the terminal particles. Thus, these proposals efficiently sampled biologically realistic models of the F-actin network in MCMC. Third, cyto-LOVE adopts the physical properties of F-actin, which is a stiff and almost straight filament that has a high level of persistence. In MCMC, we incorporated a novel bending elastic energy to realize a realistically smooth and continuous F-actin structure.
However, two problems still need to be addressed. The first is time-lapse tracking of individual F-actins. It is difficult to predict what a certain F-actin will become in the next frame during time-lapse tracking, as their length, position, and shape change between neighboring frames and they may even disappear. The second is the recognition of branching points, as owing to the low resolution of HS-AFM images, they are not recognized by the human eye. Future research will thus be required to improve the resolution of the HS-AFM images in the experiment and develop a model that includes branching points in theory.
The tracking of individual F-actins using cyto-LOVE revealed that they predominantly orient at ±35° respective to the membrane in the lamellipodia. This is consistent with the results of a previous study using EM.6,7 In addition, the Arp2/3 complex induces a new branched F-actin at 70°, and the branched F-actin networks are specifically oriented toward the membrane at ±35°.6 This has validated the accuracy of cyto-LOVE as a method to quantify F-actin orientation.
In the cell cortex, F-actin was thought to be randomly oriented,22,23 but the results of this study showed that it is predominantly oriented to the membrane at four specific angles at ±30° and ±60°. Pairs of −60° and 30° and −30° and 60° correspond to the orthogonal crossing regulated by FLNa.24 While how F-actins are organized and oriented to the four peaks is unknown, a mechanism for this phenomenon has been suggested. As a premise, it was assumed that F-actins orienting at 0° are present in the lamellipodia of non-migrating cells,25 whereas those orienting at ±35° are regulated by Arp2/3. If F-actins orienting at 0° and −35° are linked with FLNa (green triangle in Figure 8), they can reorient at −62.5° and 27.5°, which is similar to that at −60° and 30° (Figure 8A). However, if F-actins orienting at 0° and 35° are linked with FLNa, they can reorient at −27.5° and 62.5°, which is similar to that at −30° and 60° (Figure 8B). Further experiments, such as the knockdown of FLNa, are required to verify the proposed mechanism.
Figure 8.
Possible F-actin organization mechanism
(A) Two crossing F-actins (yellow lines) with angles of 0° and −35°. Two F-actins will reorient at −62.5° and 27.5° when linked with FLNa (green triangle), which expands their angles by 27.5°, respectively.
(B) Two crossing F-actins with angles of 0° and 35°. Two F-actins will reorient at −27.5° and 62.5° when linked with FLNa, which expands their angles by 27.5°, respectively.
The recognition and tracking of F-actins has been computationally addressed based on two methods: the Canny method following a steerable filter26 and the Radon transform-based method.12 However, these methods have two major limitations. First, they are based on direct computation of image intensities; therefore, the results are susceptible to inevitable noise in the images. Second, these methods are not applicable to low-resolution AFM images because of miss and wrong misrecognition due to a lack of prior knowledge of the F-actin structures. However, our method overcomes the shortcomings of the two methods by using MAP estimation of the AOD function from the AFM images with prior knowledge of the F-actin structure (see Equations 13 and 14 in the STAR Methods section).
Recently, two robust methods, EMILOVE20 and PAT,19 were developed to track axon fibers. Similar to the method presented in this study, these methods use the MCMC method to reconstruct a connected particle model that represents the fiber structure. The reconstruction process of the connected particle model in these two methods was optimized for axon fiber tracking but was not suitable for F-actin tracking. This is because axon fibers are wiggly wired in brain tissues, whereas F-actins exist as smooth and continuous segments with a high persistence length. Thus, these two methods are not suitable for the analysis of F-actin images obtained using HS-AFM. The method developed in this study overcomes the shortcomings of introducing new elastic energies and developing polymerization kinetics-based MCMC samples.
Recently, we succeeded in simultaneously imagining live F-actin dynamics and molecular fluorescence signals by developing a hybrid system of HS-AFM and fluorescence imaging.4,14 Using this hybrid imaging system with a Förster (or fluorescence) resonance energy transfer (FRET)-based biosensor, it is possible to improve our understanding of how signaling molecules such as Rac1 and Cdc42 control cellular morphologies via the reorganization of F-actin networks.27 In addition, simultaneous imaging of molecules with unknown functions could contribute to the discovery of their functions in the organization of F-actin dynamics. To this end, the newly developed cyto-LOVE method provides a fundamental tool that will help to understand such mechanisms within the cell.
Resource availability
Lead contact
Further information and requests should be directed to and will be fulfilled by the lead contact, Honda Naoki (nhonda@hiroshima-u.ac.jp).
Materials availability
The study did not generate any new materials.
Data and code availability
No datasets were generated or analyzed during the current study. The computer simulation and data analysis were performed using MATLAB (version R2020b) software. The code and image data used for this work is available on GitHub at https://github.com/kyotohamakko/CytoLove.
Acknowledgments
The authors thank Mr. N. Sakai and Mr. Y. Itagaki for their technical assistance with the HS-AFM imaging. This work was supported by JSPS KAKENHI (grant numbers JP18H02436, JP18KK0196, and JP22H05171; to S.H.Y.), and the Japan Agency for Medical Research and Development (AMED; grant number JP18gm5810018; to S.H.Y.). This study was also supported in part by the Grant-in-Aid for Challenging Research (Exploratory; grant number 19K22422 to H.N. and S.H.Y.) from the Japan Society for the Promotion of Science (JSPS), the Moonshot R&D–MILLENNIA Program (grant number JPMJMS2024-9; to H.N.), Grant-in-Aid for Transformative Research Areas (B) (grant number 21H05170), and the Cooperative Study Program of Exploratory Research Center on Life and Living Systems (ExCELLS; program number 19–102 to H.N.).
Author contributions
H.N. and S.H.Y. conceived the study. H.J., H.S., and H.N. developed the method; H.J. implemented the method and performed mathematical and data analyses; M.F., H.J., and H.N. proposed the F-actin organization mechanism in the cell cortex. All authors contributed to the writing of the manuscript.
Declaration of interests
The authors declare no competing interests.
STAR★Methods
Key resources table
| REAGENT or RESOURCE | SOURCE | IDENTIFIER |
|---|---|---|
| Software and algorithms | ||
| MATLAB | https://jp.mathworks.com/products/matlab.html | RRID: SCR:001622 Version: 9.8.0.1323502 (R2020a) |
| Simulation codes | https://github.com/kyotohamakko/CytoLove | |
Experimental model and study participant details
This study did not use experimental models and subjects.
Method details
HS-AFM imaging
COS-7 cells were grown on a poly l-lysine-coated glass slide 1 d prior to AFM imaging at 37°C with 5% CO2 in Dulbecco’s modified Eagle’s medium (DMEM), supplemented with 10% fetal bovine serum (FBS, Hyclone). AFM imaging was performed in DMEM supplemented with 10% FBS and 10 mM HEPES-NaOH (pH 7.0–7.6; Sigma Aldrich) with a tip-scan type HS-AFM unit combined with an inverted optical microscope (BIXAM™, Olympus Corp.). An electron-beam deposited sharp cantilever tip with a spring constant of 0.1 N/m (USC-F0.8-k0.1, Nanoworld) was used. The AFM tip was targeted to a specific area of the cell based on the phase-contrast image. AFM images were then acquired at a scanning rate of 0.1 frames/s.
Estimation of AOD functions
The AOD functions were estimated from the AFM images using the Bayes theorem Equation 1. The AOD function of the AFM image was denoted by , where and ( is the 1-sphere) indicate the location of the pixel and F-actin orientation, respectively. The likelihood of was described using a Gaussian distribution with mean and covariance matrix , as follows:
| (Equation 10) |
where , , and indicates the intensity of pixel in the AMF image. For simplicity, and are used instead of and in Equation 10. It is also of note that in Equation 10 represents the linear mapping from the hidden fiber structure to the AFM observation, as follows:
| (Equation 11) |
where indicates the kernel for linear mapping, and it was chosen to be imaginary and combined with both the fiber and edge detectors,16,28 as follows:
| (Equation 12) |
where , is the angle between r and n, and is the complex number, is related to as . The second line represents the Fourier series, by which the computational cost was reduced, where and denote the order complex derivative operator. The real part of is a tubular structure detector, and the resulting shapes with various values are shown in Figure S1. In this study, only the real part is used to estimate the AOD function. In the implementation, the summation of the Fourier series was computed until .
A previously proposed prior distribution16,18 was adopted, which regularizes the continuity of F-actin as follows:
| (Equation 13) |
where
| (Equation 14) |
This prior constrains the F-actin, whose orientation is perpendicular to the image gradient of .
Then, was estimated using an MAP estimation. By substituting Equations 13, 14, and 10 into Equation 1, the maximization of the posterior of becomes the minimization of the following objective function:
| (Equation 15) |
As the optimization of Equation 15 is quadratic, the conjugate gradient algorithm was used to solve the problem.16
Internal model energy
Here we describe , and that form in Equation 8; where model is represented by the two attributes of particle , position and orientation , and where scale () and thickness are constants () (Figure S2A). In the model, particles have two connecting sites at , where which indicates both polar sides of the particles, and that they are connected by the edge . An edge connecting two particles and is defined by . In this study, the scale and thickness of each particle in model was empirically set to a fixed value of and , as the individual F-actins in the HS-AMF image had almost the same thickness.
F-actin elastic energy
describes the elastic energy of the edge connecting particles (Figure S2B). The energy is formulated as follows:
| (Equation 16) |
where , and denote the angles of and , respectively, and denote parameters weighting two elastic energies, and denotes the positive constant. The first term, represents the elastic energy identified in previous studies.19,20 However, by using only this term, this energy was found to have a small effect on penalizing particles with different orientations. Consequently, bending energy was also introduced into the second term.
To illustrate the bending effect of , Equation 16 was expanded with geometric interpretation as follows:
where , , , , and are defined in Figure S2C. From the first to second line, the law of cosines was used, which is as follows: (). The was then decomposed into the stretching energy in the first term and two bending energies in the second and third terms. The stretching energy penalizes the distance between the particles, and the bending energy penalizes the different angles between the connected particles. The bending energy in the second term is weak as it independently depends on the particle angles, whereas the bending energy introduced in the third term is strong as it is determined by the relative angle between two connected particles i.e., - . Owing to the new energy term, we can adjust the strength of the bending energy of the connected particle by setting the value of and to represent smooth and continuous segments of the F-actin network.
Collision energy and loop energy
describes the collision energy between the neighboring particles,19 the formula for which is as follows:
| (Equation 18) |
where denotes the inner product of two vectors, denotes the set of particles that collide with , and , are constants. Non-overlapping particles were not penalized (Figure S2D left). The inner product of this equation indicates that overlapping particles with parallel orientations are strongly penalized (Figure S2D middle), whereas overlapping particles with orthogonal orientations are weakly penalized (Figure S2D right). This collision energy thus allows for crossing between the two F-actins.
The loop energy prevents the loop connection of particles in the model by returning to infinity when a loop appears and 0 if there is no loop,19 as shown in Figure S2E:
| (Equation 19) |
An infinite value of energy indicates that model is unexpected and is discarded immediately.
MCMC modeling method
Model was optimized by maximizing using the reversible jump Markov chain Monte Carlo (RJMCMC) sampler.17 The RJMCMC sampler is an iterative algorithm combined with simulated annealing over the temperature . Specifically, we set the initial temperature at , and then decrease it slowly by for every iterations, where is the total number of iterations. RJMCMC samples an alternative model from a proposed distribution . The new model is sampled from proposals for the birth and death of particles, moving and rotating of particles, connections and reconnections between particles, and the track-birth and track-death of particles. The RJMCMC sampling starts with the empty model without any particles or edges, and at each iteration, one of the proposals is randomly chosen. Whether is accepted is determined by ratio , as follows:
| (Equation 20) |
If , will be accepted; if , will be accepted with probability . By substituting Equations 7 and 9 into Equation 20, to obtain the following:
| (Equation 21) |
where and is the total energy function of a model that represents the F-actin network in HS-AFM image .
Details of the proposals
A new model was proposed by reorganizing the connected structures of the particles in the current model with the MCMC sampling. The design of proper proposals is important to help prevent their rejection; proposals with completely random reorganization of the model must be unrealistic and cannot fit the AFM images, and consequently the rejection ratio is high. Biologically realistic sampling was thus adopted to efficiently determine the optimal model that maximizes or nearly maximizes . In this study, six proposal types were uniformly sampled1: particle birth2; particle death3; moving and/or rotating of particles4; connection/reconnection of edges5; track-birth of particle; and6 track-death of particle.
Birth proposal
The birth proposal generates a new particle in the current model, and the position of was sampled from the distribution as follows:
| (Equation 22) |
where . The small constant ensures that particles can appear at any location in the HS-AFM image . is the normalized AOD function, which is defined as follows:
| (Equation 23) |
where is a small constant, and and represent the local average and variance of the AOD function around image position , respectively, as follows:
| (Equation 24) |
| (Equation 25) |
where indicates a normal distribution with mean and variance , and indicates a constant set to be the scale of the particles, i.e., . The orientation of is given by for efficient realistic proposals, instead of the random sampling previously described.19,20 After generating a new particle for the model, the change in energy was found to be as follows; . The acceptance ratio of the birth proposal is:
| (Equation 26) |
where means the total number of particles in the model.
Death proposal
The death proposal randomly selects an existing particle for removal from the current model. If the selected particle is connected to others, the death proposal is rejected. Otherwise, is removed using the acceptance ratio:
| (Equation 27) |
where .
Moving and/or rotating proposal
The moving and rotating proposals randomly select particle from the current model and then randomly determine whether to propose altering its position and orientation . We denote as the particle selected after an attribute change is proposed. If the rotating proposal is selected, is updated by the normalized result of , where is the Gaussian noise with zero mean and covariance matrix and is chosen to be 1.5 empirically. If the moving proposal is selected, then , where is the Gaussian noise with zero mean and covariance matrix , and is chosen to be 2 empirically. If the proposal is to change both, the position and orientation of the selected particle will be changed simultaneously, as described above. These proposals for are accepted at
| (Equation 28) |
where
| (Equation 29) |
and is the set of all edges connected to a particle .
Connection/reconnection proposal
The connection/reconnection proposal either reconnects the existing edges or adds new edges to the terminal particles in the model. The proposal uniformly samples a connecting site (black point in Figure S3) of particle from the current model. If there is a edge at , the proposal reconnects the edge as follows; first is removed and then a set of candidate edges is created in the vicinity as follows:
| (Equation 30) |
where indicates candidate particles for reconnection, is the connecting site of that no edge is connecting to, and is the searching radius. In contrast to that in previous studies,19,20 to increase the efficiency of the algorithm, the conditions and were used to ensure that the set of candidate edges is located in front of with the searching radius (blue semicircle in Figure S3). The condition ensures that the connecting site of the candidate particle inside the searching area is chosen to be the one that faces (green points in Figure S3). The new edge is selected to have minimal elastic energy in , as , instead of the random sample method used in previous studies.19,20 The proposal of is accepted as:
| (Equation 31) |
where .
If the selected connecting site has no edges, the proposed method adds an edge from the set of candidate edges in Equation 30 and follows the same method as described above. In this case, .
Track-birth proposal
The track-birth proposal adds a new particle and connects it to a terminal particle with an edge. The proposal randomly selects a particle from , which is the set of terminal particles in model . The unconnecting site for the selected terminal particle is . The position for adding particle is sampled from a Gaussian distribution as , where , and was determined empirically. This sampling ensures that is located as if the existing F-actin were elongated in a straight line. Note that the orientation of is given by instead of sampling from a distribution19,20 to facilitate efficient sampling. The new edge connecting and is created as . The acceptance ratio is:
| (Equation 32) |
where .
Track-death proposal
The track-death proposal randomly selects a terminal particle from for removal. If the second particle from the terminal (denoted by ) does not have two edges, the track-death proposal is rejected, otherwise, is removed using the acceptance ratio:
| (Equation 33) |
where , and indicates the edge connecting and .
Quantification and statistical analysis
This study did not include statistical analysis and quantification.
Additional resources
This study did not generate and contributed to a new website/forum, and it is not part of a clinical trial.
Published: September 10, 2024
Footnotes
Supplemental information can be found online at https://doi.org/10.1016/j.isci.2024.110907.
Supplemental information
References
- 1.Blanchoin L., Boujemaa-Paterski R., Sykes C., Plastino J. Actin Dynamics, Architecture, and Mechanics in Cell Motility. Physiol. Rev. 2014;94:235–263. doi: 10.1152/physrev.00018.2013. [DOI] [PubMed] [Google Scholar]
- 2.Nonaka S., Naoki H., Ishii S. A multiphysical model of cell migration integrating reaction–diffusion, membrane and cytoskeleton. Neural Netw. 2011;24:979–989. doi: 10.1016/j.neunet.2011.06.009. [DOI] [PubMed] [Google Scholar]
- 3.Mullins R.D., Heuser J.A., Pollard T.D. The interaction of Arp2/3 complex with actin: Nucleation, high affinity pointed end capping, and formation of branching networks of filaments. Proc. Natl. Acad. Sci. USA. 1998;95:6181–6186. doi: 10.1073/pnas.95.11.6181. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Yamao M., Naoki H., Kunida K., Aoki K., Matsuda M., Ishii S. Distinct predictive performance of Rac1 and Cdc42 in cell migration. Sci. Rep. 2015;5 doi: 10.1038/srep17527. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Imoto D., Saito N., Nakajima A., Honda G., Ishida M., Sugita T., Ishihara S., Katagiri K., Okimura C., Iwadate Y., Sawai S. Comparative mapping of crawling-cell morphodynamics in deep learning-based feature space. PLoS Comput. Biol. 2021;17 doi: 10.1371/journal.pcbi.1009237. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Vinzenz M., Nemethova M., Schur F., Mueller J., Narita A., Urban E., Winkler C., Schmeiser C., Koestler S.A., Rottner K., et al. Actin branching in the initiation and maintenance of lamellipodia. J. Cell Sci. 2012;125:2775–2785. doi: 10.1242/jcs.107623. [DOI] [PubMed] [Google Scholar]
- 7.Maly I.V., Borisy G.G. Self-organization of a propulsive actin network as an evolutionary process. Proc. Natl. Acad. Sci. USA. 2001;98:11324–11329. doi: 10.1073/pnas.181338798. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Mullins R.D., Stafford W.F., Pollard T.D. Structure, Subunit Topology, and Actin-binding Activity of the Arp2/3 Complex from Acanthamoeba. J. Cell Biol. 1997;136:331–343. doi: 10.1083/jcb.136.2.331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Vignjevic D., Yarar D., Welch M.D., Peloquin J., Svitkina T., Borisy G.G. Formation of filopodia-like bundles in vitro from a dendritic network. J. Cell Biol. 2003;160:951–962. doi: 10.1083/jcb.200208059. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Yang C., Svitkina T. Visualizing branched actin filaments in lamellipodia by electron tomography. Nat. Cell Biol. 2011;13:1012–1014. doi: 10.1038/ncb2321. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Yang C., Svitkina T. Filopodia initiation. Cell Adh. Migr. 2011;5:402–408. doi: 10.4161/cam.5.5.16971. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Winkler C., Vinzenz M., Small J.V., Schmeiser C. Actin filament tracking in electron tomograms of negatively stained lamellipodia using the localized radon transform. J. Struct. Biol. 2012;178:19–28. doi: 10.1016/j.jsb.2012.02.011. [DOI] [PubMed] [Google Scholar]
- 13.Suzuki Y., Sakai N., Yoshida A., Uekusa Y., Yagi A., Imaoka Y., Ito S., Karaki K., Takeyasu K. High-speed atomic force microscopy combined with inverted optical microscopy for studying cellular events. Sci. Rep. 2013;3:2131. doi: 10.1038/srep02131. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Yoshida A., Sakai N., Uekusa Y., Deguchi K., Gilmore J.L., Kumeta M., Ito S., Takeyasu K. Probing in vivo dynamics of mitochondria and cortical actin networks using high-speed atomic force/fluorescence microscopy. Gene Cell. 2015;20:85–94. doi: 10.1111/gtc.12204. [DOI] [PubMed] [Google Scholar]
- 15.Zhang Y., Yoshida A., Sakai N., Uekusa Y., Kumeta M., Yoshimura S.H. In vivo dynamics of the cortical actin network revealed by fast-scanning atomic force microscopy. Microscopy. 2017;66:272–282. doi: 10.1093/jmicro/dfx015. [DOI] [PubMed] [Google Scholar]
- 16.Reisert M., Skibbe H. Joint Pattern Recognition Symposium. Springer Berlin Heidelberg; Berlin, Heidelberg: 2011. Steerable Deconvolution Feature Detection as an Inverse Problem; pp. 326–335. [DOI] [Google Scholar]
- 17.GREEN P.J. Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika. 1995;82:711–732. doi: 10.1093/biomet/82.4.711. [DOI] [Google Scholar]
- 18.Reisert M., Kiselev V.G. Fiber Continuity: An Anisotropic Prior for ODF Estimation. IEEE Trans. Med. Imag. 2011;30:1274–1283. doi: 10.1109/TMI.2011.2112769. [DOI] [PubMed] [Google Scholar]
- 19.Skibbe H., Reisert M., Nakae K., Watakabe A., Hata J., Mizukami H., Okano H., Yamamori T., Ishii S. PAT—Probabilistic Axon Tracking for Densely Labeled Neurons in Large 3-D Micrographs. IEEE Trans. Med. Imag. 2019;38:69–78. doi: 10.1109/TMI.2018.2855736. [DOI] [PubMed] [Google Scholar]
- 20.Skibbe H., Reisert M., Maeda S.i., Koyama M., Oba S., Ito K., Ishii S. Efficient Monte Carlo Image Analysis for the Location of Vascular Entity. IEEE Trans. Med. Imag. 2015;34:628–643. doi: 10.1109/TMI.2014.2364404. [DOI] [PubMed] [Google Scholar]
- 21.Ott A., Magnasco M., Simon A., Libchaber A. Measurement of the persistence length of polymerized actin using fluorescence microscopy. Phys. Rev. E. 1993;48:R1642–R1645. doi: 10.1103/PhysRevE.48.R1642. [DOI] [PubMed] [Google Scholar]
- 22.Svitkina T.M. Actin Cell Cortex: Structure and Molecular Organization. Trends Cell Biol. 2020;30:556–565. doi: 10.1016/j.tcb.2020.03.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Chugh P., Clark A.G., Smith M.B., Cassani D.A.D., Dierkes K., Ragab A., Roux P.P., Charras G., Salbreux G., Paluch E.K. Actin cortex architecture regulates cell surface tension. Nat. Cell Biol. 2017;19:689–697. doi: 10.1038/ncb3525. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Nakamura F., Osborn T.M., Hartemink C.A., Hartwig J.H., Stossel T.P. Structural basis of filamin A functions. J. Cell Biol. 2007;179:1011–1025. doi: 10.1083/jcb.200707073. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Weichsel J., Urban E., Small J.V., Schwarz U.S. Reconstructing the orientation distribution of actin filaments in the lamellipodium of migrating keratocytes from electron microscopy tomography data. Cytometry A. 2012;81:496–507. doi: 10.1002/cyto.a.22050. [DOI] [PubMed] [Google Scholar]
- 26.Aguet F., Jacob M., Unser M. Vol. 2. IEEE; 2005. Three-dimensional feature detection using optimal steerable filters; pp. 1158–1161. (IEEE Int. Conf. Image Process.). [DOI] [Google Scholar]
- 27.Yamao M., Aoki K., Yukinawa N., Ishii S., Matsuda M., Naoki H. Two New FRET Imaging Measures: Linearly Proportional to and Highly Contrasting the Fraction of Active Molecules. PLoS One. 2016;11 doi: 10.1371/journal.pone.0164254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Reisert M., Burkhardt H. Complex Derivative Filters. IEEE Trans. Image Process. 2008;17:2265–2274. doi: 10.1109/TIP.2008.2006601. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
No datasets were generated or analyzed during the current study. The computer simulation and data analysis were performed using MATLAB (version R2020b) software. The code and image data used for this work is available on GitHub at https://github.com/kyotohamakko/CytoLove.









