Abstract
Despite ongoing efforts in cardiovascular research, the acquisition of high-resolution and high-speed images for the purpose of assessing cardiac contraction remains challenging. Light-sheet fluorescence microscopy (LSFM) offers superior spatiotemporal resolution and minimal photodamage, providing an indispensable opportunity for the in vivo study of cardiac micro-structure and contractile function in zebrafish larvae. To track the myocardial architecture and contractility, we have developed an imaging strategy ranging from LSFM system construction, retrospective synchronization, single cell tracking, to user-directed virtual reality (VR) analysis. Our system enables the four-dimensional (4D) investigation of individual cardiomyocytes across the entire atrium and ventricle during multiple cardiac cycles in a zebrafish larva at the cellular resolution. To enhance the throughput of our model reconstruction and assessment, we have developed a parallel computing-assisted algorithm for 4D synchronization, resulting in a nearly tenfold enhancement of reconstruction efficiency. The machine learning-based nuclei segmentation and VR-based interaction further allow us to quantify cellular dynamics in the myocardium from end-systole to end-diastole. Collectively, our strategy facilitates noninvasive cardiac imaging and user-directed data interpretation with improved efficiency and accuracy, holding great promise to characterize functional changes and regional mechanics at the single cell level during cardiac development and regeneration.
INTRODUCTION
Cardiac contraction relies on the orchestrated interplay among cells at the tissue level.1–3 The continuous investigation of myocardial properties and mechanics is critical for the assessment of cardiac structure and contractility under physiological and pathophysiological conditions. Recent progress has demonstrated that zebrafish is a powerful model for investigating cardiac development and repair due to its optical transparency, genetic tractability, and regenerative capacity.4–7 However, conventional techniques face limitations in analyzing cardiac architecture and function of zebrafish heart due to insufficient spatiotemporal resolution and shallow penetration depth. Light-sheet fluorescence microscopy (LSFM) overcomes these challenges by rapidly scanning across the entire ventricle and atrium with high spatiotemporal resolution and minimal photodamage,8–13 allowing for the concurrent investigation of myocardial micro-structure and contractile function.
To reconstruct cardiac contraction following LSFM imaging, both prospective14 and retrospective15–19 synchronization have been developed. Bypassing the extra camera and real-time processing for cardiac gating in the former method, retrospective synchronization allows for the four-dimensional (4D) reconstruction of quasi-periodic cardiac dynamics. However, due to the deluge of raw data and tedious procedures, the retrospective algorithm usually requires over three hours to process ∼100 GB images under the current computational power, limiting our high-throughput capability to iterate and analyze cardiac activities. Since parallelization of algorithms provides an efficient way for the time-consuming computation in biomedical imaging reconstruction,20 we designed and implemented our 4D reconstruction algorithm based on parallel computing, resulting in a tenfold improvement in reconstruction efficiency.
In addition, the technical challenge of analyzing intercellular interaction within a complex environment poses a major challenge to assessing cardiac contractility and regional mechanics.21 Current unparalleled high-resolution 4D LSFM image stack requires an accurate segmentation approach and a user-directed method to interpret cardiac contraction at the single cell level. In this context, we implemented a deep learning approach termed 3DeeCellTracker22 to track individual cells across the entire heart in the zebrafish larva within multiple cardiac cycles, and we developed a virtual reality (VR)-based interactive platform23–25 to identify local differences of contracting velocity and quantify cellular motion from end-systole to end-diastole. This further allows us to investigate intricate micro-structure, quantify regional contractility, and assess myocardial mechanics across the ventricle and atrium at different cardiac phases. Collectively, our holistic framework including imaging system construction, parallel computation, and advanced quantitative analysis allows for the in vivo investigation of regional variations in myocardium of zebrafish models with high accuracy and efficiency, holding potential to foster our understanding of the cardiac development and regeneration.
RESULTS
We have developed a framework, including sample preparation, image acquisition, and post-processing [Fig. 1(a) and supplementary material Fig. S1], to demonstrate the feasibility and potential of our prototype for zebrafish heart imaging and analysis. Briefly, we anesthetized zebrafish larvae ranging from 3 to 7 days post fertilization (dpf) with 0.05% tricaine and immobilized them in 0.8% low-melting-point agarose under the microscope, to ensure the growth of the larvae and optimal transparency. Our six-axis translational stage synchronized by the customized LabVIEW control scanned the contracting heart across the sheet of laser, while the sCMOS camera captured image sequences at each slice [Fig. 1(b) and supplementary material video 1]. Our retrospective synchronization algorithm based on image similarity analysis26 has been empowered by parallel computation to reconstruct the 4D cardiac contraction [Fig. 1(c)]. We have further tracked individual cells using the established 3DeeCelltracker22 within one cardiac cycle and implemented our VR platform for the interactive quantitative analysis of cells across the entire heart [Figs. 1(d) and 1(e)].
POINT SPREAD FUNCTION CALIBRATION
Our LSFM system is composed of a horizontal detection arm and a cylindrical lens-based illumination (supplementary material Fig. S2). To measure the point spread function (PSF) of our LSFM system, we imaged fluorescent beads with a diameter of ∼0.53 μm as shown by Fire pseudo color [Fig. 2(a), supplementary material video 2). To verify the spatial resolution and minimize the variation of opacity at different depths, we calibrated the PSF across the whole sample and demonstrated the representative results of the full width at half maximum (FWHM) at depths of 10, 30, 50, and 70 μm [Fig. 2(b)]. Our results indicate that the lateral and axial resolutions are 1.26 ± 0.15 and 2.48 ± 0.15 μm (n = 60 beads), respectively, suggesting the invariant spatial resolution within the imaging depth.
PARALLEL COMPUTATION-BASED RETROSPECTIVE RECONSTRUCTION
To improve the efficiency of our retrospective synchronization for high-throughput analysis, we have established parallel computation to maximize the usage of multi-core CPU and GPU processors for 4D cardiac reconstruction. In contrast to 3-h processing of 30 000 frames (800 × 800 pixels/frame) from 100 movies, our current method accomplished the same task within 20 min. Briefly, two steps were involved. First, to identify cardiac cycles, we assigned independent Z-movies to individual CPU cores and aligned cardiac phases in different cardiac cycles using GPU cores until all Z-movies were processed [Fig. 3(a)]. Next, to synchronize different Z-movies, we assigned two consecutive Z-movies to each CPU core and aligned cardiac phases within multiple cycles of all movies using GPU cores [Fig. 3(a)]. We implemented image similarity analysis to match the targeted phase (in red) with the potential frames (in yellow) in other cardiac cycles in both steps. Since GPU is able to handle more pixels in parallel,27 we tested different numbers of frames and Z-movies to compare the computational efficiency of our new method with the previous version under varying conditions [Fig. 3(b)]. The results indicate that the image registration time is proportional to the number of frames (left panel) and Z-movies (right panel), and the parallel computation improved our reconstruction efficiency over ten times in both steps.
IMAGING OF THE BEATING ZEBRAFISH HEART
We implemented the aforementioned system and algorithm to capture the traveling cardiomyocyte nuclei across the entire ventricle and atrium in transgenic (Tg(cmlc2:nucGFP)) zebrafish larvae (Fig. 4). We acquired around 100–200 Z-movies per fish (depending on its size) to cover the entire contracting heart at a rate of 200 frames per second (fps), with each movie consisting of 300 frames and the step size of 1 μm between consecutive movies. Each Z-movie usually included five cardiac cycles, but we retained the three complete cardiac cycles during the 4D reconstruction. The LSFM system provided us the single cell resolution to investigate the ventricular and atrial contraction in zebrafish larvae from 3 to 7 dpf [Figs. 4(a) and supplementary material videos 3 and 4), and our reconstruction algorithm allowed us to establish 4D digital heart models from end-systole to end-diastole with 200 volumes per second [Fig. 4(b) and supplementary material videos 5 and 6). The integration of our engineering methods with green fluorescence protein (GFP) labeled myocyte nuclei depicted the contour of the micro-architecture of ventricle (in pink), atrium (in blue), and atrioventricular canal in zebrafish larvae, providing an entry point for the in vivo study of myocardial trabeculation and compaction during cardiac development and regeneration.
TRACKING OF INDIVIDUAL CARDIOMYOCYTE NUCLEI
To further the quantitative analysis of myocardial contraction and mechanics, we incorporated an established deep learning approach termed 3DeeCellTracker22 into our computational framework. Using our reconstructed cardiac LSFM images [Fig. 5(a)], we were allowed to segment and differentiate individual cardiomyocytes within multiple cardiac cycles [Fig. 5(b) and supplementary material videos 7 and 8). The raw images were first segmented and classified into cell or non-cell categories by 3D U-Net, which was followed by the 3D tracking step. To pinpoint the precise cell locations, two approaches, feedforward network and PR-GLS, were utilized. Unlike manual annotation, these methods allowed for efficient registration of cardiomyocytes in current (red circles) and subsequent volumes (blue crosses) within the region of interest, until all volumes were registered. To ensure the accuracy of the tracking results, we selected a 2D slice from the central region of the heart with 64 cell nuclei and manually annotated all cells as the ground truth for comparison [Fig. 5(c)]. Due to the varying intensity and irregular shape of cells close to the boundary, our results indicated that about 80% of cells were correctly tracked using this approach within one cardiac cycle (∼400 ms). To identify differences in contractility across various myocardial regions, we analyzed the displacements of three representative cells in the atrium, ventricle, and atrioventricular canal of zebrafish at 3 and 7 dpf, respectively [Figs. 5(d) and 5(e)]. The results indicated that the atrial cell had the largest displacement during heart contraction, implying that the atrial contractile function undergoes more significant changes compared to other regions within one cardiac cycle.
USER-DIRECTED ANALYSIS OF CARDIAC CONTRACTION
Due to numerous traveling cells across the entire heart, an effective data interpretation method could provide an in-depth analysis of cardiac contractile function. We have developed a VR platform that enables us to visualize and assess the regional cardiac contraction with numerous manipulative functionalities, such as selecting arbitrary cells and cardiac phase, and measuring cellular properties (Fig. 6 and supplementary material video 9). To demonstrate the feasibility of our approach, we tracked the whole-cycle trajectories of targeted individual cells and their current positions indicated by glowing points [Figs. 6(a) and 6(b)]. In addition to individual cells, we were able to select two arbitrary cardiomyocytes from different regions, such as ventricle and atrium, to quantify their traveling velocities, volumes, surface areas, and relative distance to each other over time [Figs. 6(c) and 6(d)]. In addition to individual cells, we also could conduct the group analysis to measure average velocity [Fig. 6(e)], relative distance variation between cell pairs [Fig. 6(f)], and surface area to volume (SA:V) ratio of cells [Fig. 6(g)] in different regions within one cardiac cycle for zebrafish at 3 and 7 dpf. Our results reflect that the average velocity of atrial cells was higher than that of ventricular cells, suggesting that the regional contractility of the atrium is always larger. Additionally, the relative distance between cells varies depending on their locations, allowing us to further investigate the local stretch and strain. The SA:V ratio holds promise for evaluating the local strain of individual nuclei and also reflects the developmental change. Collectively, in contrast to conventional pre-defined visualization and operations, we have proved the concept that VR platform holds great potential for multi-dimensional structural and functional investigation of cardiac contraction at the single cell resolution with the user-directed interaction.
DISCUSSION
Zebrafish is a powerful model for cardiac research due to its optical transparency, remarkable regenerative capacity, and genetic and physiological similarity to humans.4–7 We are able to identify over 70% of human genes and more than 80% of human disease genes in at least one zebrafish counterpart.28 This makes it an ideal model for both fundamental research and translational investigations in cardiovascular disease. The advent of LSFM fosters the 4D investigation of cardiac morphology and contractile function of zebrafish larvae due to its high spatiotemporal resolution, minimal photodamage, and optical sectioning in contrast to other optical imaging methods.16–19 To better understand the myocardial structure and contractility during heart formation, development, injury, and repair, we developed a holistic strategy that integrates LSFM system construction and control, retrospective synchronization, individual cell tracking, and interactive VR platform for quantitative assessments. Overall, our framework enables us to efficiently image the heart, reconstruct the 4D model, track and quantify individual cells, providing an entry point to assess cardiomyocytes functionalities and regional myocardial deformation.
Our customized LSFM system provides a cellular resolution of 1.26 μm in the lateral direction and 2.48 μm in the axial. While the anisotropic resolution of our current LSFM might affect the quality of 4D reconstruction, the cellular resolution of this customized system is sufficient for distinguishing zebrafish cardiomyocytes with the diameter ranging from 10 to 20 μm.29,30 The 3D reconstruction model of fluorescent beads further verifies the resolving power of our current system (supplementary material video 2). Further efforts in multi-view fusion and deconvolution techniques will enhance our imaging capabilities, allowing us to overcome the limitations stemming from resolution disparities between different imaging directions.13
Our LSFM system with retrospective reconstruction method allows us to analyze the contracting ventricle and atrium at over 200 volumes per second. However, the deluge of data in 4D light-sheet imaging remains a challenge in both acquisition and analysis. Our system generated approximately 100 GB of images in a single fluorescent channel within five cardiac cycles. Due to the independence of each Z-movie, parallel computation depending on multi-core CPU and GPU is able to improve the reconstruction efficiency over ten folds. However, parallel computing also poses challenges for memory management. To avoid memory fragmentation and computer slowdown caused by excessive memory consumption, we optimized our algorithm by minimizing the size of memory allocation and deallocation. For instance, we cleared the loaded images after each call and experimented with different types of image buffers. As a result, our memory usage increased much less than the reconstruction efficiency. We performed a quantitative comparison to demonstrate the improvement in memory performance of our parallel computing algorithm (supplementary material Fig. S3).
While the retrospective synchronization assumes that cardiomyocytes return to their original positions after each cardiac cycle, previous studies have demonstrated the feasibility of this method and indicated that the heartbeat variability in zebrafish embryos is only ∼1% in the period length between consecutive beats,15,16 echoed by our results in Figs. 5(d) and 5(e). Other methods such as light-field microscopy hold great potential to minimize the impact of this assumption and redundant sampling in a single slice.31–33 In addition, our results indicate a larger fluctuation of the SA:V ratio in the atrium in comparison to the ventricle [Fig. 6(g)], implying that the multi-view deconvolution approach could improve the image contrast if the atrium is away from the detection objective lens.13 To further improve the accuracy and efficiency of the reconstruction algorithm, we will also investigate two methods for identifying cardiac cycle and aligning cardiac phases: the sum of squared differences (SSD)34 and Pearson's correlation.35 The former one is potentially useful for finding cardiac cycle in each Z-movie as this approach assumes that all processed images have a similar range of intensities. The latter is better suited for cardiac phase alignment across different Z-movies as it assumes a linear relationship among all processing images.
While computational analysis of cardiac contractile function has been established in some imaging modalities,21 approaches tailored for LSFM are still under development. Due to the contribution of cardiomyocytes to cardiac contraction,36,37 we utilized the 3DeeCellTracker tool to track individual cardiomyocytes from end-systole to end-diastole. More training data for this neural network will definitely improve the tracking accuracy from 80% to a higher level, but a data-efficient method is also needed to reduce the time-consuming manual annotation. Our ongoing efforts in machine learning38,39 provide an entry point to minimize the training dataset for this purpose. By integrating LSFM and deep learning methods, we investigated representative cardiomyocytes in the atrium, ventricular apex, base, and atrioventricular canal of zebrafish at 3 and 7 dpf. Our findings indicate that ventricular myocardium undergoes less deformation, which could be attributed to the thicker myocardium of the ventricle.40 We also found that the cardiomyocytes at 3 dpf exhibited a larger displacement [Figs. 5(d) and 5(e)] and SA:V ratio [Fig. 6(g)] compared to those at 7 dpf. These findings suggest that myocardial properties or hemodynamics may contribute to the changes observed as the fish grow.41,42 However, it is crucial to emphasize that conducting a comprehensive statistical analysis is imperative for future investigations to further understand and validate these observations.
In addition to the current study of myocardial contractility using the transgenic Tg(cmlc2:nucGFP) zebrafish line, other transgenic models such as Tg(tp1:GFP) for Notch activity and Tg(fli1:DsRed) for endocardium could also extend our study in elucidating cardiac morphogenesis and regeneration (supplementary material Fig. S4). One possible extension of our method is to implement multi-channel fluorescence imaging to track numerous lineages and cell types such as cardiomyocytes, endothelial cells, and fibroblasts for the study of cellular heterogeneity and intercellular interaction during the cardiac development and regeneration.43 Ongoing efforts on the integration of advanced imaging methods such as light-field microscopy will enable us to investigate hemodynamics, hemostasis, and thrombosis, as well as their interaction with cardiac function in the live zebrafish models.44–46
To better visualize and analyze the 4D heart model, we also developed a VR platform for user-directed manipulation with more freedom. Our platform provides an immersive and interactive experience for studying individual cells and global patterns with high accuracy and efficiency. This enables us to quantify the cellular velocity and SA:V ratio change across the entire ventricle and atrium, investigate the physical relationship between arbitrary cells and regions during the contraction, and further deepen our understanding of their roles in myocardial mechanics.41,47 The use of VR will also enable us to perform complex tasks such as cell segmentation and annotation more efficiently and accurately, as users can interact with the data in a straightforward manner and adjust parameters in real time.23–25 Since this progressive research provides more potential for the study of intricate architecture and dynamics, we will improve its generalizability and functionality for more animal models across numerous scales.13,24
Different from conventional ejection fraction or strain analysis, our computational analysis allows us to unravel the difference in regional myocardial contractile function under physiological and pathophysiological conditions.21,48 Our continuous efforts in 4D live imaging enable us to investigate the underlying mechanisms of heart disease that perturb cardiac structure and function. The integration of our 4D imaging platform and multi-dimensional computation with transgenic zebrafish models provides an entry point for the in vivo investigation of myocardial infarction, cardiac arrhythmias, and congenital heart defects. With the enhancement of computation power, we will assess more cardiac phases and cycles to capture the variability of contractility over time. A more comprehensive assessment including stress and strain analysis will also advance our understanding of myocardial contractile function at both cellular and tissue levels. Collectively, we have proved that this holistic strategy allows for the in vivo study of cardiac contractile function, holding great promise to uncover the mechanism underlying cardiac morphogenesis and facilitate new therapies.
METHODS
Customized LSFM system with program control
We built an in-house LSFM imaging system (supplementary material Fig. S2) using a continuous-wave diode-pumped solid-state (DPSS) laser system with dual wavelengths at 473 nm (LRS-0473-GFM-00100–03, Laserglow Technologies) and 532 nm (LRS-0532-GFM-00100–03, Laserglow Technologies) as the illumination sources. The initial beam diameter was ∼2 mm, with a divergence less than 1.5 mrad. Both beams were aligned before passing through a 5× achromatic beam expander (GBE05-A, Thorlabs) and a variable iris (ID25, Thorlabs). The aligned beam was focused by a plano–convex cylindrical lens (f = 50 mm, Thorlabs) and relayed by a pair of lenses (CLS-SL, ITL200, Thorlabs) to the back focal plane of the illumination objective lens (Plan Fluor, 4×/0.13, Nikon). This optical setup yields a light sheet with a beam waist of 1 μm and an effective width of 2 mm. The detection module was composed of a water-immersion objective lens (Plan Fluor, 20×/0.5, Olympus) for fluorescence detection, a tube lens (ITL180, Thorlabs), a filter set (Semrock), and an sCMOS camera (Flash 4.0 v3, Hamamatsu). A 3D-printed chamber was made to hold the zebrafish larva and the detection objective. A six-axis stage was installed to precisely position the specimen. The control of this whole system was customized via LabVIEW 2020 for laser illumination, sample scanning, and fluorescence detection.
PSF calibration
We diluted the fluorescent beads to a concentration of 1:150 000 using a solution of 0.8% agarose with de-ionized water. The diluted beads were mounted in a fluorinated ethylene propylene (FEP) tube and immersed in a water-filled chamber for imaging. The waist of the Gaussian beam, determined by the excitation wavelength and the numerical aperture (NA) of the illumination objective lens dominates the axial resolution in the LSFM system. In our light-sheet setup, axial resolution is mainly given by the beam waist, and other factors include the NA of the detection lens, the refractive index, and the emission wavelength.49
Preparation of the transgenic zebrafish sample
Transgenic Tg(cmlc2: nucGFP), Tg(tp1: GFP), and Tg(fli1a: DsRed) zebrafish lines were used. Animal protocols, experiments, and housing in this manuscript have been approved (IACUC #20–07) and conducted under the oversight of the University of Texas at Dallas and University of Texas at Arlington Institutional Animal Care and Use Committee. To maintain the optical transparency of the larvae, we added 0.003% phenylthiourea (PTU) in the medium to suppress pigmentation of larvae at 20 hours post fertilization (hpf). Zebrafish larvae were anesthetized in 0.05% tricaine for 10 min to ensure immobilization, followed by the immersion in 0.8% low-melt agarose at 37 °C in the FEP tube (refractive index: ∼1.33). The whole specimen with the FEP tube was held by the translational stages and placed inside the chamber filled with water. Tg(cmlc2: nucGFP) larvae were imaged every 24 h from 72 to 168 hpf, while Tg(tp1: GFP) and Tg(fli1a: DsRed) lines were imaged at 96 and 120 hpf.
Image acquisition
The sCMOS camera continuously recorded Z-movies (image sequences), while the light-sheet sectioned a thin layer of the contracting heart at different depths. We reiterated the recording-scanning process to capture 300 frames in each Z-movie to cover 3–5 cardiac cycles. To meet the Nyquist-Shannon sampling theorem, we set the step size between two consecutive slices as 1 μm and captured 100–200 Z-movies to cover the entire volume.
Image registration
To register different Z-movies, the first key step was to estimate the cardiac cycle length. The number of images N between the first and fourth peak systolic frames in the first movie was manually counted, and the average cycle length L was defined as L = N/3 * E, where E is the exposure time. The cardiac cycle length was empirically between 0.85 L to 1.15 L.17 Then, each Z-movie was split into different cycles based on each possible cycle length from 0.85 L to 1.15 L, and a within-movie similarity comparison was performed for each Z-movie. Specifically, every image in each cycle was back projected to the previous cycle, and the SSD between the two cycles was calculated. The cycle length with the smallest SSD was chosen as the most possible cycle length. The second key step was to align the starting points of Z-movies at different axial locations. An iterative image similarity comparison through the first Z-movie to the last Z-movie was used. First, a clip including around three cardiac cycles in the first Z-movie with start slice number S was cropped. Multiple clips in the second and third Z-movies were cropped with the same length but with adjusted start slice number S + D, where D stands for the cardiac phase difference between these two Z-movies. To determine the best D for aligning the first two clips, we computed the SSD between them. We also calculated the SSD between the clips of the first and third Z-movies, as well as the second and third Z-movies, to avoid local optimization.15 We picked the correct clip in the second Z-movie by identifying the smallest SSD and aligned all subsequent Z-movies iteratively using the same method.
Parallel computation
We used two parallelism strategies to speed up the processing of images in our algorithm. First, we implemented task parallelism into the CPU multi-core parallel processing by adapting the MATLAB parallel computing toolbox into our established algorithm.50 Next, we applied the data parallelism strategy to the image to be processed. We converted them into gpuArray datatype and used CUDA (Compute Unified Device Architecture) to perform computations on GPU. The improved reconstruction algorithm was programmed using MATLAB and tested on a workstation equipped with Intel i9-10900X CPU (3.7 GHz, 10 cores), 64.0 GB RAM, NVIDIA Quadro RTX 5000 graphics card (3072 CUDA cores, 16 GB GDDR6 memory).
Cell tracking
We implemented the deep learning method, 3DeeCellTracker,22 to segment cardiomyocytes at different cardiac phases. We used watershed method51 to separate continuous regions of voxels, and then assigned each region a number. The segmented cells were manually corrected only in the first volume of 3D images. In the following 3D tracking step, feedforward network was used to predict cell positions based on spatial patterns of cells maintained between previous and current images. The predicted positions are corrected with PR-GLS52 to obtain precise cell locations. We visually inspected the tracking results by comparing the locations of tracked cells with the corresponding raw images.
VR analysis for assessment of cardiac activities
Our VR analysis framework consisted of processing and segmenting zebrafish cardiac images, producing a surface mesh for each individual cardiomyocyte nucleus, model importing, and interaction with each individual nucleus to intuitively analyze the cardiac contractility and morphology such as cell trajectory during each cycle. To interact with the 4D heart model in the virtual environment, we started by obtaining the cell tracking results from 3DeeCellTracker. Next, we validated the tracking data and saved cells with consistent image intensity across all volumes in Python. Afterward, we customized a Python program to generate a surface mesh and assign a unique color code to each cell in 3D Slicer. The heart models including all cells in different timepoints were exported as .obj files with .mtl files and imported into Unity. We further customized C# programs to allow for 4D visualization and interactive analysis. The VR platform allows for cell selection, time point selection, time pause, and lighting adjustment. The user can select two cells and analyze their trajectories, velocities, volume, surface area, and relative distance. The time point selection option allows the user to choose a specific time for 4D data analysis.
SUPPLEMENTARY MATERIAL
ACKNOWLEDGMENTS
The authors would like to express gratitude to Ms. Elizabeth Ibanez for her help in husbanding zebrafish at UT Dallas. We also appreciate all the constructive comments provided by D-incubator members at UT Dallas.
This study was supported by NIH R00HL148493 (Y.D.), R01HL162635 (Y.D.), and UT Dallas STARS program (Y.D.).
AUTHOR DECLARATIONS
Conflict of Interest
The authors have no conflicts to disclose.
Ethics Approval
Ethics approval for experiments reported in the submitted manuscript on animal or human subjects was granted. Animal protocols, experiments, and housing in this manuscript have been approved (IACUC No. 20-07) and conducted under the oversight of the University of Texas at Dallas and University of Texas at Arlington Institutional Animal Care and Use Committee.
Author Contributions
Y.D. proposed the experiments and reviewed the process. X.Z. built the imaging system, developed the control system, conducted the imaging experiments, developed the parallel computing method, and analyzed the cell tracking results. X.Z., M.A., and R.J. performed the image analysis. X.Z., S.H., and J.Y. generated the VR model and conducted the analysis. X.Z., V.K., and A.P. optimized the memory management of the image registration code. X.Z., A.S., and A.R. conducted the statistical analysis. K.C. and J.L. provided the samples. X.Z. drafted the first version of the manuscript, and X.Z. and Y.D. finalized the version with feedback from all co-authors.
Xinyuan Zhang: Data curation (equal); Formal analysis (equal); Methodology (equal); Validation (equal); Writing - original draft (equal); Writing - review & editing (equal). Milad Almasian: Formal analysis (equal); Methodology (equal); Validation (equal). Sohail S. Hassan: Formal analysis (equal); Methodology (equal); Software (equal); Visualization (equal). Rosemary Jotheesh: Validation (equal); Visualization (equal). Vinay A. Kadam: Methodology (equal); Software (equal). Austin R. Polk: Methodology (supporting). Alireza Saberigarakani: Methodology (equal); Validation (equal). Aayan Rahat: Methodology (equal). Jie Yuan: Formal analysis (equal); Methodology (equal). Juhyun Lee: Methodology (equal); Resources (equal). Kelli Carroll: Methodology (equal) Resources (equal). Yichen Ding: Conceptualization (equal); Data curation (equal); Formal analysis (equal); Funding acquisition (equal); Investigation (equal); Methodology (equal); Project administration (equal); Resources (equal); Software (equal); Supervision (equal); Validation (equal); Visualization (equal); Writing - original draft (equal); Writing - review & editing (equal).
DATA AVAILABILITY
The data that support the findings of this study are openly available in Zenodo at https://doi.org/10.5281/zenodo.7953887, Ref. 53.
References
- 1. de la Pompa J. L. and Epstein J. A., “ Coordinating tissue interactions: Notch signaling in cardiac development and disease,” Dev. Cell 22(2), 244–254 (2012). 10.1016/j.devcel.2012.01.014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. MacGrogan D., Münch J., and de la Pompa J. L., “ Notch and interacting signalling pathways in cardiac development, disease, and regeneration,” Nat. Rev. Cardiol. 15(11), 685–704 (2018). 10.1038/s41569-018-0100-2 [DOI] [PubMed] [Google Scholar]
- 3. Weber M., Scherf N., Meyer A. M., Panakova D., Kohl P., Huisken J., Panáková D., Kohl P., and Huisken J., “ Cell-accurate optical mapping across the entire developing heart,” eLife 6, e28307 (2017). 10.7554/eLife.28307 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Power R. M. and Huisken J., “ A guide to light-sheet fluorescence microscopy for multiscale imaging,” Nat. Methods 14(4), 360–373 (2017). 10.1038/nmeth.4224 [DOI] [PubMed] [Google Scholar]
- 5. Liu J. and Stainier D. Y. R., “ Zebrafish in the study of early cardiac development,” Circ. Res. 110(6), 870 (2012). 10.1161/CIRCRESAHA.111.246504 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Ding Y., Bu H., and Xu X., “ Modeling inherited cardiomyopathies in adult zebrafish for precision medicine,” Front. Physiol. 11, 599244 (2020). 10.3389/fphys.2020.599244 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Giardoglou P. and Beis D., “ On zebrafish disease models and matters of the heart,” Biomedicines 7(1), 15 (2019). 10.3390/biomedicines7010015 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Weber M. and Huisken J., “ In vivo imaging of cardiac development and function in zebrafish using light sheet microscopy,” Swiss Med. Wkly. 145(51), w14227 (2015). 10.4414/smw.2015.14227 [DOI] [PubMed] [Google Scholar]
- 9. Vedula V., Lee J., Xu H., Kuo C. C. J., Hsiai T. K., and Marsden A. L., “ A method to quantify mechanobiologic forces during zebrafish cardiac development using 4-D light sheet imaging and computational modeling,” PLoS Comput. Biol. 13(10), e1005828 (2017). 10.1371/journal.pcbi.1005828 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Yalcin H. C., Amindari A., Butcher J. T., Althani A., and Yacoub M., “ Heart function and hemodynamic analysis for zebrafish embryos,” Dev. Dyn. 246(11), 868–880 (2017). 10.1002/dvdy.24497 [DOI] [PubMed] [Google Scholar]
- 11. Baek K. I., Ding Y., Chang C. C., Chang M., Sevag Packard R. R., Hsu J. J., Fei P., and Hsiai T. K., “ Advanced microscopy to elucidate cardiovascular injury and regeneration: 4D light-sheet imaging,” Prog. Biophys Mol. Biol. 138, 105–115 (2018). 10.1016/j.pbiomolbio.2018.05.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Salman H. E. and Yalcin H. C., “ Advanced blood flow assessment in zebrafish via experimental digital particle image velocimetry and computational fluid dynamics modeling,” Micron 130, 102801 (2020). 10.1016/j.micron.2019.102801 [DOI] [PubMed] [Google Scholar]
- 13. Sodimu O., Almasian M., Gan P., Hassan S., Zhang X., Liu N., and Ding Y., “ Light sheet imaging and interactive analysis of the cardiac structure in neonatal mice,” J. Biophotonics 16(5), e202200278 (2023). 10.1002/jbio.202200278 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Taylor J. M., Nelson C. J., Bruton F. A., Baghbadrani A. K., Buckley C., Tucker C. S., Rossi A. G., Mullins J. J., and Denvir M. A., “ Adaptive prospective optical gating enables day-long 3D time-lapse imaging of the beating embryonic zebrafish heart,” Nat. Commun. 10(1), 5713 (2019). 10.1038/s41467-019-13112-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Liebling M., Forouhar A. S., Gharib M., Fraser S. E., and Dickinson M. E., “ Four-dimensional cardiac imaging in living embryos via postacquisition synchronization of nongated slice sequences,” J Biomed. Opt. 10(5), 54001 (2005). 10.1117/1.2061567 [DOI] [PubMed] [Google Scholar]
- 16. Mickoleit M., Schmid B., Weber M., Fahrbach F. O., Hombach S., Reischauer S., and Huisken J., “ High-resolution reconstruction of the beating zebrafish heart,” Nat. Methods 11(9), 919–922 (2014). 10.1038/nmeth.3037 [DOI] [PubMed] [Google Scholar]
- 17. Lee J., Fei P., Packard R. R., Kang H., Xu H., Baek K. I., Jen N., Chen J., Yen H., Kuo C. J., Chi N. C., Ho C. M., Li R., and Hsiai T. K., “ 4-Dimensional light-sheet microscopy to elucidate shear stress modulation of cardiac trabeculation,” J. Clin. Invest. 126(5), 1679–1690 (2016). 10.1172/JCI83496 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Fei P., Lee J., Packard R., Sereti K.-I. I., Xu H., Ma J., Ding Y., Kang H., Chen H., Sung K., Kulkarni R., Ardehali R., Kuo C. C. J., Xu X., Ho C. M., and Hsiai T. K., “ Cardiac light-sheet fluorescent microscopy for multi-scale and rapid imaging of architecture and function,” Sci. Rep. 6(1), 22489 (2016). 10.1038/srep22489 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Ding Y., Ma J., Langenbacher A. D., Baek K. I., Lee J., Chang C. C., Hsu J. J., Kulkarni R. P., Belperio J., Shi W., Ranjbarvaziri S., Ardehali R., Tintut Y., Demer L. L., Chen J. N., Fei P., Packard R. R. S., and Hsiai T. K., “ Multiscale light-sheet for rapid imaging of cardiopulmonary system,” JCI Insight 3(16), e121396 (2018). 10.1172/jci.insight.121396 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Kadah Y. M., Abd-Elmoniem K. Z., and Farag A. A., “ Parallel computation in medical imaging applications,” Int. J. Biomed. Imaging 2011, 840181–842012. 10.1155/2011/840181 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Zhang X., Alexander R. V., Yuan J., and Ding Y., “ Computational analysis of cardiac contractile function,” Curr. Cardiol. Rep. 24(12), 1983–1994 (2022). 10.1007/s11886-022-01814-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Wen C., Miura T., Voleti V., Yamaguchi K., Tsutsumi M., Yamamoto K., Otomo K., Fujie Y., Teramoto T., Ishihara T., Aoki K., Nemoto T., Hillman E. M. C., and Kimura K. D., “ 3DeeCellTracker, a deep learning-based pipeline for segmenting and tracking cells in 3D time lapse images,” eLife 10, e59187 (2021). 10.7554/eLife.59187 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Ding Y., Abiri A., Abiri P., Li S., Chang C. C., Baek K. I., Hsu J. J., Sideris E., Li Y., Lee J., Segura T., Nguyen T. P., Bui A., Sevag Packard R. R., Fei P., and Hsiai T. K., “ Integrating light-sheet imaging with virtual reality to recapitulate developmental cardiac mechanics,” JCI Insight 2(22), e97180 (2017). 10.1172/jci.insight.97180 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Koger C. R., Hassan S. S., Yuan J., and Ding Y., “ Virtual reality for interactive medical analysis,” Front. Virtual Real. 3, 782854 (2022). 10.3389/frvir.2022.782854 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Yuan J., Hassan S. S., Wu J., Koger C. R., Packard R. R. S., Shi F., Fei B., and Ding Y., “ Extended reality for biomedicine,” Nat. Rev. Methods Primers 3(1), 15 (2023). 10.1038/s43586-023-00198-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Jiang M., “ Review of image similarity measures for joint image reconstruction from multiple measurements,” in Time-dependent Problems in Imaging and Parameter Identification (Springer, 2021), pp. 267–286. [Google Scholar]
- 27. Buber E. and Diri B., “ Performance analysis and CPU vs GPU comparison for deep learning,” in 6th International Conference on Control Engineering & Information Technology (CEIT), 2018. [Google Scholar]
- 28. Howe K., Clark M. D., Torroja C. F., Torrance J., Berthelot C., Muffato M., Collins J. E., Humphray S., McLaren K., Matthews L., McLaren S., Sealy I., Caccamo M., Churcher C., Scott C., Barrett J. C., Koch R., Rauch G. J., White S., Chow W., Kilian B., Quintais L. T., Guerra-Assunção J. A., Zhou Y., Gu Y., Yen J., Vogel J. H., Eyre T., Redmond S., Banerjee R., Chi J., Fu B., Langley E., Maguire S. F., Laird G. K., Lloyd D., Kenyon E., Donaldson S., Sehra H., Almeida-King J., Loveland J., Trevanion S., Jones M., Quail M., Willey D., Hunt A., Burton J., Sims S., McLay K., Plumb B., Davis J., Clee C., Oliver K., Clark R., Riddle C., Eliott D., Threadgold G., Harden G., Ware D., Mortimer B., Kerry G., Heath P., Phillimore B., Tracey A., Corby N., Dunn M., Johnson C., Wood J., Clark S., Pelan S., Griffiths G., Smith M., Glithero R., Howden P., Barker N., Stevens C., Harley J., Holt K., Panagiotidis G., Lovell J., Beasley H., Henderson C., Gordon D., Auger K., Wright D., Collins J., Raisen C., Dyer L., Leung K., Robertson L., Ambridge K., Leongamornlert D., McGuire S., Gilderthorp R., Griffiths C., Manthravadi D., Nichol S., Barker G., Whitehead S., Kay M., Brown J., Murnane C., Gray E., Humphries M., Sycamore N., Barker D., Saunders D., Wallis J., Babbage A., Hammond S., Mashreghi-Mohammadi M., Barr L., Martin S., Wray P., Ellington A., Matthews N., Ellwood M., Woodmansey R., Clark G., Cooper J., Tromans A., Grafham D., Skuce C., Pandian R., Andrews R., Harrison E., Kimberley A., Garnett J., Fosker N., Hall R., Garner P., Kelly D., Bird C., Palmer S., Gehring I., Berger A., Dooley C. M., Ersan-Ürün Z., Eser C., Geiger H., Geisler M., Karotki L., Kirn A., Konantz J., Konantz M., Oberländer M., Rudolph-Geiger S., Teucke M., Osoegawa K., Zhu B., Rapp A., Widaa S., Langford C., Yang F., Carter N. P., Harrow J., Ning Z., Herrero J., Searle S. M. J., Enright A., Geisler R., Plasterk R. H. A., Lee C., Westerfield M., De Jong P. J., Zon L. I., Postlethwait J. H., Nüsslein-Volhard C., Hubbard T. J. P., Crollius H. R., Rogers J., and Stemple D. L., “ The zebrafish reference genome sequence and its relationship to the human genome,” Nature 496(7446), 498 (2013). 10.1038/nature12111 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29. Narumanchi S., Wang H., Perttunen S., Tikkanen I., Lakkisto P., and Paavola J., “ Zebrafish heart failure models,” Front. Cell Dev. Biol. 9, 1061 (2021). 10.3389/fcell.2021.662583 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Tekeli I., Garcia-Puig A., Notari M., García-Pastor C., Aujard I., Jullien L., and Raya A., “ Fate predetermination of cardiac myocytes during zebrafish heart regeneration,” Open Biol. 7(6), 170116 (2017). 10.1098/rsob.170116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Wang Z., Zhu L., Zhang H., Li G., Yi C., Li Y., Yang Y., Ding Y., Zhen M., and Gao S., “ Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning,” Nat. Methods 18(5), 551–556 (2021). 10.1038/s41592-021-01058-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Wang Z., Ding Y., Satta S., Roustaei M., Fei P., and Hsiai T. K., “ A hybrid of light-field and light-sheet imaging to study myocardial function and intracardiac blood flow during zebrafish development,” PLoS Comput. Biol. 17(7), e1009175 (2021). 10.1371/journal.pcbi.1009175 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Voleti V., Patel K. B., Li W., Perez Campos C., Bharadwaj S., Yu H., Ford C., Casper M. J., Yan R. W., Liang W., Wen C., Kimura K. D., Targoff K. L., and Hillman E. M. C., “ Real-time volumetric microscopy of in vivo dynamics and large-scale samples with SCAPE 2.0,” Nat. Methods 16(10), 1054–1062 (2019). 10.1038/s41592-019-0579-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Zhou S. K., Medical Image Recognition, Segmentation and Parsing: Machine Learning and Multiple Object Approaches (Academic Press, 2016). [Google Scholar]
- 35. Rodgers J. L. and Nicewander W. A., “ Thirteen ways to look at the correlation coefficient,” Am. Stat. 42(1), 59–66 (1988). 10.2307/2685263 [DOI] [Google Scholar]
- 36. Legrice I., Pope A., and Smaill B., “ The architecture of the heart: Myocyte organization and the cardiac extracellular matrix,” Interstitial Fibrosis in Heart Failure (Springer, 2005), pp. 3–21.
- 37. Wright P. T., Tsui S. F., Francis A. J., MacLeod K. T., and Marston S. B., “ Approaches to high-throughput analysis of cardiomyocyte contractility,” Front. Physiol. 11, 612 (2020). 10.3389/fphys.2020.00612 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Ding Y., Gudapati V., Lin R., Fei Y., Packard R. R. S., Song S., Chang C. C., Baek K. I., Wang Z., Roustaei M., Kuang D., Kuo C. J., and Hsiai T. K., “ Saak transform-based machine learning for light-sheet imaging of cardiac trabeculation,” IEEE Trans. Biomed. Eng. 68(1), 225–235 (2021). 10.1109/TBME.2020.2991754 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39. Jiao Y., Yuan J., Sodimu O. M., Qiang Y., and Ding Y., “ Deep neural network-aided histopathological analysis of myocardial injury,” Front. Cardiovasc. Med. 8, 724183 (2021). 10.3389/fcvm.2021.724183 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Menke A. L., Spitsbergen J. M., Wolterbeek A. P. M., and Woutersen R. A., “ Normal anatomy and histology of the adult zebrafish,” Toxicol. Pathol 39(5), 759–775 (2011). 10.1177/0192623311409597 [DOI] [PubMed] [Google Scholar]
- 41. Satoh H., Delbridge L. M. D., Blatter L. A., and Bers D. M., “ Surface: Volume relationship in cardiac myocytes studied with confocal microscopy and membrane capacitance measurements: Species-dependence and developmental effects,” Biophys. J 70(3), 1494–1504 (1996). 10.1016/S0006-3495(96)79711-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Marshall W. F., Young K. D., Swaffer M., Wood E., Nurse P., Kimura A., Frankel J., Wallingford J., Walbot V., Qu X., and Roeder A. H. K., “ What determines cell size?,” BMC Biol. 10(1), 1–22 (2012). 10.1186/1741-7007-10-101 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Hsieh P. C. H., Davis M. E., Lisowski L. K., and Lee R. T., “ Endothelial-cardiomyocyte interactions in cardiac development and repair,” Annu. Rev. Physiol. 68, 51 (2006). 10.1146/annurev.physiol.68.040104.124629 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Schwarz E. L., Pegolotti L., Pfaller M. R., and Marsden A. L., “ Beyond CFD: Emerging methodologies for predictive simulation in cardiovascular health and disease,” Biophys. Rev. 4(1), 011301 (2023). 10.1063/5.0109400 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45. Chen Y. and Ju L. A., “ Biomechanical thrombosis: The dark side of force and dawn of mechano-medicine,” Stroke Vasc. Neurol. 5(2), 185–197 (2020). 10.1136/svn-2019-000302 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46. Simpson A., Shukla A., and Brown A. C., “ Biomaterials for Hemostasis,” Annu. Rev. Biomed. Eng. 24, 111–135 (2022). 10.1146/annurev-bioeng-012521-101942 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Coelho-Filho O. R., Shah R. V., Mitchell R., Neilan T. G., Moreno H., Simonson B., Kwong R., Rosenzweig A., Das S., and Jerosch-Herold M., “ Quantification of cardiomyocyte hypertrophy by cardiac magnetic resonance: Implications on early cardiac remodeling,” Circulation 128(11), 1225 (2013). 10.1161/CIRCULATIONAHA.112.000438 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Chen J., Ding Y., Chen M., Gau J., Jen N., Nahal C., Tu S., Chen C., Zhou S., Chang C.-C. C., Lyu J., Xu X., Hsiai T. K., and Packard R. R. S., “ Displacement analysis of myocardial mechanical deformation (DIAMOND) reveals segmental susceptibility to doxorubicin-induced injury and regeneration,” JCI Insight 4(8), e125362 (2019). 10.1172/jci.insight.125362 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49. Stelzer E. H. K. K., Strobl F., Chang B.-J. J., Preusser F., Preibisch S., McDole K., and Fiolka R., “ Light sheet fluorescence microscopy,” Nat. Rev. Methods Primers 1(1), 73 (2021). 10.1038/s43586-021-00069-4 [DOI] [Google Scholar]
- 50. Sharma G. and Martin J., “ MATLAB®: A language for parallel computing,” Int. J. Parallel Program 37(1), 3–36 (2009). 10.1007/s10766-008-0082-5 [DOI] [Google Scholar]
- 51. Beucher S. and Meyer F., in Mathematical Morphology in Image Processing ( CRC Press, 2018), pp. 433–481. [Google Scholar]
- 52. Ma J., Zhao J., and Yuille A. L., “ Non-rigid point set registration by preserving global and local structures,” IEEE Trans. Image Process. 25(1), 53–64 (2016). 10.1109/TIP.2015.2467217 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Zhang X. and Ding Y. (2023). “4D light-sheet imaging and interactive analysis of cardiac contractility in zebrafish larvae,” Zenodo, Dataset. 10.5281/zenodo.7953887 [DOI] [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Citations
- Zhang X. and Ding Y. (2023). “4D light-sheet imaging and interactive analysis of cardiac contractility in zebrafish larvae,” Zenodo, Dataset. 10.5281/zenodo.7953887 [DOI] [PMC free article] [PubMed]
Supplementary Materials
Data Availability Statement
The data that support the findings of this study are openly available in Zenodo at https://doi.org/10.5281/zenodo.7953887, Ref. 53.