Skip to main content
eLife logoLink to eLife
. 2015 Dec 17;4:e11214. doi: 10.7554/eLife.11214

A versatile pipeline for the multi-scale digital reconstruction and quantitative analysis of 3D tissue architecture

Hernán Morales-Navarrete 1, Fabián Segovia-Miranda 1, Piotr Klukowski 1, Kirstin Meyer 1, Hidenori Nonaka 1,2, Giovanni Marsico 1, Mikhail Chernykh 1, Alexander Kalaidzidis 1, Marino Zerial 1,*, Yannis Kalaidzidis 1,3,*
Editor: Fiona M Watt4
PMCID: PMC4764584  PMID: 26673893

Abstract

A prerequisite for the systems biology analysis of tissues is an accurate digital three-dimensional reconstruction of tissue structure based on images of markers covering multiple scales. Here, we designed a flexible pipeline for the multi-scale reconstruction and quantitative morphological analysis of tissue architecture from microscopy images. Our pipeline includes newly developed algorithms that address specific challenges of thick dense tissue reconstruction. Our implementation allows for a flexible workflow, scalable to high-throughput analysis and applicable to various mammalian tissues. We applied it to the analysis of liver tissue and extracted quantitative parameters of sinusoids, bile canaliculi and cell shapes, recognizing different liver cell types with high accuracy. Using our platform, we uncovered an unexpected zonation pattern of hepatocytes with different size, nuclei and DNA content, thus revealing new features of liver tissue organization. The pipeline also proved effective to analyse lung and kidney tissue, demonstrating its generality and robustness.

DOI: http://dx.doi.org/10.7554/eLife.11214.001

Research Organism: Mouse

eLife digest

Understanding how individual cells interact to form tissues in animals and plants is a key problem in cell and developmental biology. To be able to answer this question researchers need to use microscopy to observe the cells in a tissue, extract structural information from the images, and then generate three-dimensional digital models of the tissue. However, the software solutions that are currently available are limited, and reconstructing three-dimensional tissue from microscopy images remains problematic.

To meet this challenge, Morales-Navarrete et al. extended the free software platform called MotionTracking, which had been used previously for two-dimensional work. The software now combines a series of new and established algorithms for analysing fluorescence microscopy images that make it possible to identify the different structures that make up a tissue and then create and analyse a three-dimensional model.

Morales-Navarrete et al. used the software to analyse liver tissue from mice. The resulting model revealed that liver cells called hepatocytes are arranged in particular zones within the tissue according to their size and DNA content. The software was also applied successfully to analyse lung and kidney tissue, which demonstrates that the approach can be used to create three-dimensional models of a variety of tissues.

Morales-Navarrete et al.’s approach can rapidly generate accurate models of larger tissues than were previously possible. Therefore, it provides researchers with a powerful tool to analyse the different features of tissues. This tool will be useful for many areas of research: from understanding of how cells form tissues, to diagnosing diseases based on the changes to features in particular tissues.

DOI: http://dx.doi.org/10.7554/eLife.11214.002

Introduction

A major challenge for the understanding of mammalian tissue structure and function is the ability to monitor cellular processes across different levels of complexity, from the subcellular to the tissue scale (Megason and Fraser, 2007). This information can then be used to develop quantitative functional models that describe and predict the system behaviour under perturbed conditions (Hunter et al., 2008; Smith et al., 2011; Fonseca et al., 2011; Sbalzarini, 2013). The development of such multi-scale models requires first a geometrical model of the tissue, that is, an accurate three-dimensional (3D) digital representation of the cells in the tissue as well as their critical subcellular components (Peng et al., 2010; Boehm et al., 2010; Mayer et al., 2012). This can be constructed from high-resolution microscopy images with multiple fluorescent markers, either fusion proteins or components detected by antibody staining. Since organelles can be as small as ~0.1 µm in size, the geometrical model has also to cover a wide range of scales spanning over three orders of magnitude. However, substantial limitations persist with respect to availability of markers, volume of tissue to reconstruct, scale of measurements, computational methods to perform the analysis and sample throughput. Although a few existing platforms provide standard tools for 3D segmentation and methods to process 2D surface layers of cells [ImageJ/Fiji (Girish and Vijayalakshmi, 2004; Collins, 2007), ICY (de Chaumont et al., 2012) and MorphoGraphX (Barbier de Reuille et al., 2015)], the challenges posed by dense and thick tissue specimens require the development of new algorithms. Therefore, there is a demand for a platform that can provide the required set of methods for the reconstruction of multi-scale digital 3D geometrical models of mammalian tissues from confocal microscopy images.

The number of fluorescent markers that can be used simultaneously is limited to 4–5, making the reconstruction of tissue models a challenging problem. For a meaningful model, it is necessary to properly identify the different cell types within the tissue but also to detect subcellular and extracellular structures, for example, nuclei, plasma membrane or cell cortex, extracellular matrix (ECM) and cell polarity. Automated morphological cell recognition is a possible way to reconstruct dense tissue with limited number of markers.

Geometrical digital models of tissues also require 3D information over large volumes. Validated fluorescent protein chimeras are not always available, especially in the appropriate combination of fluorescence emission spectral profiles. On the other hand, in dense tissues immunostaining is inhomogeneous due to restricted antibody penetration. The development of protocols that render tissues optically transparent and permeable to macromolecules without significantly compromising their general structure enables the imaging of relatively thick specimens (Chung and Deisseroth, 2013; Ke et al., 2013). However, in the case of a densely packed tissue, for example, liver, homogeneous staining is still limited to a thickness of ~100 µm. Therefore, obtaining high-resolution data from large volumes of tissue (typically from 0.1 mm to a few centimetres) requires sectioning the sample into serial 100-µm-thick slices that are stained and imaged separately. Furthermore, the cutting process introduces artefacts, such as bending, uneven section surfaces and partial damage of tissue, that require corrections during tissue model reconstruction. Unfortunately, the publicly available generic image processing software is unable to deal with such problems.

In this study, we addressed these challenges by developing a set of new algorithms as well as implementing established ones in an adjustable pipeline implemented in stand-alone freely available software (http://motiontracking.mpi-cbg.de). As proof of principle, we tested the pipeline on the reconstruction of a geometrical model of liver tissue. We chose this particular tissue due to its utmost importance for basic research, medicine and pharmacology. In order to test the accuracy of the pipeline, we created a benchmark for the evaluation of dense tissue reconstruction algorithms comprising a set of realistic 3D images generated from the digital model of liver tissue. Furthermore, we applied the platform to the analysis of lung and kidney tissue, demonstrating its generality and robustness.

Results

Despite its importance and a long history of histological studies, only a few geometrical models of liver tissue have been published (Hardman et al., 2007; Hoehme et al., 2010; Hammad et al., 2014). The liver is composed of functional units, the lobules. In each lobule, bile canaliculi and sinusoidal endothelial cells form two 3D networks between the portal vein (PV) and the central vein (CV). The bile canalicular (BC) network is formed by hepatocytes and transports the bile, whereas the sinusoidal endothelial network transports the blood. The liver tissue has a number of remarkable features. One is the zonation of metabolic functions due to the fact that the hepatocytes located in the vicinity of the PV do not have the same metabolic activities as the hepatocytes located near the CV (Kuntz and Kuntz, 2006). Second, hepatocytes are remarkably heterogeneous in terms of number of nuclei (mono- and bi-nucleated) and ploidy (Martin et al., 2002; Guidotti et al., 2003; Faggioli et al., 2011). Third, the lobules contain two additional important cell types, stellate and Kupffer cells (Baratta et al., 2009).

To analyse the 3D organization of liver tissue, we established a workflow for confocal imaging of mouse liver specimens and developed an adjustable pipeline of new and established image analysis algorithms to process the images and build digital models of the tissue (Figure 1 and Figure 1—figure supplement 1). First, we established a protocol for the preparation of tissue specimens for single- and double-photon confocal microscopy at different resolutions. To cover multiple scales from subcellular organelles to tissue spanning over three orders of magnitude, we used a 3D multi-resolution tissue image acquisition approach (Figure 1A). This consisted of imaging a tissue sample at low resolution (1 μm × 1 μm × 1 μm per voxel) and zooming on the parts of interest at high resolution (0.3 μm × 0.3 μm × 0.3 μm per voxel). Second, the multi-scale reconstruction of tissue architecture was obtained following the pipeline of Figure 1B and Figure 1—figure supplement 1. Briefly, (1) images were filtered using a novel Bayesian de-noising algorithm; (2) individual low-resolution images of each physical section were assembled in 3D mosaics; (3) tissue deformations caused by sample preparation were corrected; (4) large vessels were segmented; (5) the 3D mosaics of sections were combined in a full-scale low-resolution model; (6) high-resolution images were registered into the low-resolution one; (7) sinusoidal and BC networks as well as nuclei were segmented and, finally, (8) the different cell types were identified, classified and segmented. We used the geometrical model to provide a detailed and accurate quantitative description of liver tissue geometry, including the complexity of the sinusoidal and BC networks, hepatocyte size distribution, stellate and Kupffer cells distribution in the tissue. Additionally, our platform comprises a set of methods for the proper statistical analysis of different morphometric parameters of the tissue as well as their spatial variability (Figure 1C).

Figure 1. Schematic representation of the proposed pipeline.

(A) 3D multi-resolution image acquisition: example of arrays of 2D images of liver tissue acquired at different resolutions. Low- (1 μm × 1 μm × 1 μm per voxel) and high- (0.3 μm × 0.3 μm × 0.3 μm per voxel) resolution images on the left and right sides, respectively. (B) Multi-scale reconstruction of tissue architecture: on the left, reconstruction of a liver lobule showing tissue-level information, i.e., the localization and relative orientation of key structures such as the portal vein (PV) (orange) and central vein (CV) (light blue). The high-resolution images registered into the low-resolution one are shown in white. On the middle, a cellular-level reconstruction of liver showing the main components forming the tissue, i.e., bile canalicular (BC) network (green), sinusoidal network (magenta) and cells (random colours). The reconstruction corresponds to one of the high-resolution cubes (white) registered on the liver lobule reconstruction (left side). On the right, reconstruction of a single hepatocyte showing subcellular-level information, i.e., apical (green), basal (magenta) and lateral (grey) contacts. (C) Quantitative analysis of the tissue architecture: example of the statistical analysis performed over a morphometric tissue parameter (hepatocyte volume) using the information extracted from the multi-scale reconstruction. On the left, hepatocyte volume distribution over the sample (traditional statistics). On the right, spatial variability (spatial statistics) of the same parameter within the liver lobule. Our workflow allows not only to perform traditional statistical analysis of different morphometric parameters but also to perform spatial characterizations of them. The graphs were generated from the analysis of one high-resolution cube of the multi-scale reconstruction (the one shown in middle of panel B). Boundary cells were excluded from the analysis.

DOI: http://dx.doi.org/10.7554/eLife.11214.003

Figure 1.

Figure 1—figure supplement 1. Workflow for the multi-scale reconstruction of tissue architecture from multi-resolution confocal microscopy images.

Figure 1—figure supplement 1.

The necessary methods for each step (implemented in our software) are listed. They include newly developed ones (N) as well as standard image analysis algorithms (S) and modified versions of them (M).

Figure 1—figure supplement 2. Probabilistic image de-noising algorithm for 3D images.

Figure 1—figure supplement 2.

Single 2D plane of a high-resolution image stained with phalloidin for actin (cell borders) and Flk1 for sinusoids (A, D) before and (B, E) after applying our probabilistic image de-noising algorithm. The outlier-tolerant estimation of the background was done using a 10-pixel window. (C, F) Phalloidin/Flk1 intensity values of pixels along the horizontal yellow line for both, the original and the de-noised images. Our probabilistic image de-noising algorithm efficiently reduces the noise while preserving the edges present in the image even in the presence of high diffusive background. (G) Mean variance for each intensity level (I). The experimental data are represented by the red dots, the error bar represents SEM and the theoretical curve (straight line) is represented by the solid black line. (H) Prediction of the background intensity using linear fitting by least-squares method (solid black line) and the outlier-tolerant algorithm (solid red line) for a set of sequential intensities in z-direction (blue dots). The dots represent the intensity values of the voxels along the vertical yellow line at the original image on the left [stained with CD13 for bile canalicular (BC) network].

Figure 1—figure supplement 3. Optimal parameter selection.

Figure 1—figure supplement 3.

(A) The mask defining the objects vicinity in the case of bile canalicular (BC) network (yellow) is shown in red and was created by applying an inflation of two voxels (~0.5 µm) to the original objects. (B) Selection of the best parameters for the ‘pure denoise’ method. We used as fixed parameter the number of cycles (10, the maximum possible). ‘Number of frames’ = 11 (the maximum available in the plug-in) shows the best results, i.e., minimum global mean square error (MSE) as well as MSE in the vicinity of the objects. (C) Selection of the best parameters for the ‘edge preserving de-noising and smoothing’ method. We used as fixed parameter the number of cycles (100). ‘Smoothing level’ = 70 corresponds the point before the MSE in the vicinity of the objects starts increasing while the global MSE remains low.

Figure 1—figure supplement 4. Comparison of our 3D image de-noising algorithm (BFBD) with standard methods in the field.

Figure 1—figure supplement 4.

Panel (A) shows single 2D plane projections of an artificial high-resolution image of bile canalicular (BC) network (2:1 signal-to-noise ratio) before adding Poisson noise (ground truth) and the result of the application of our de-noising algorithm (BFBD) as well as a median filter, a Gauss low-pass filter and an anisotropic diffusion. (B) The resulting images were analysed in terms of the global mean square error (MSE) and coefficient of correlation (CoC). (C) The same metrics were evaluated only on the vicinity of the BC. Our method shows considerably better noise reduction (low global MSE and high global CoC) than the other methods, except the Gauss low-pass filter. However, the Gauss low-pass filter shows a high MSE and low CoC in the vicinity of the objects (in comparison with our method), suggesting a blurring of the object edges. The bars show the average values over three samples and the error bars correspond to standard deviations. A median filter (smooth window 3 ×3 ×3 voxels), a Gauss low-pass filter (s = 1 voxels) and an anisotropic diffusion (It=-D1α|I|I), where D = 0.05, α = 2, number iterations= 100, were applied.

Figure 1—figure supplement 5. Comparison of our 3D image de-noising algorithm (BFBD) with ‘pure denoise’ (PD) (Luisier et al., 2010) and ‘edge preserving de-noising and smoothing’ (EPDS) (Beck and Teboulle, 2009).

Figure 1—figure supplement 5.

Panel (A) shows single 2D plane projections of an artificial image of bile canalicular (BC) network (2:1 signal-to-noise ratio) after applying our de-noising algorithm as well as PD and EPDS. (B) The resulting images were analysed in terms of the global mean square error (MSE) and coefficient of correlation (CoC). (C) The same metrics evaluated only on the vicinity of the BC. Our method shows a better reduction of the noise (low global MSE and high global CoC) than the other methods. Additionally, it shows a relatively low MSE and high CoC in the vicinity of the objects. Panel (D) shows that global MSE increases with the depth of the sample for PD and EPDS, whereas it is more stable in our method. In the graph, each curve represents one independent sample. (E) Execution time of the algorithms in an Intel(R) Xeon(R) CPU E5-2620 @ 2.00 GHz. EPDS and BFBD are ~ 20 times faster than PD. The bars show the average values over three samples and the error bars correspond to standard deviations. PD and FPDS were performed using the optimal parameters shown in Figure 1—figure supplement 3. For the BFBD, we use a window of five pixels and a threshold = 1.25.

Sample preparation and multi-resolution tissue imaging

Mouse livers were fixed by trans-cardial perfusion instead of the conventional immersion fixation (Burton et al., 1987) to minimize the time lag between the termination of blood flow and fixation (Gage et al., 2012). This proved to be absolutely essential to preserve the tissue architecture and the epitopes for immunostaining. Serial sections of fixed tissues were prepared at a thickness of 100 µm to maximize antibody penetration and limit laser light scattering. Liver sections were stained to visualize key subcellular and tissue structures, namely nuclei (DAPI), the apical surfaces of hepatocytes (CD13), the sinusoidal endothelial cells (Flk1) or ECM (Laminin and Fibronectin) and the cell cortex (F-actin stained by phalloidin). We tested various reagents and protocols to clear the liver tissue, such as glycerol and 2,2′thiodiethanol (TDE), and found that SeeDB (Ke et al., 2013) yielded the best results. Stained sections were imaged sequentially (generating Z-stacks) by one- and two-photon laser scanning confocal microscopy to maximize the number of fluorescent channels available. The same section was imaged twice, at low and high magnification, using 25×/0.8 and 63×/1.3 objectives, respectively. The first covers a large volume to reconstruct the whole lobule and the latter focuses on a small area to reconstruct the tissue at high resolution. The registration of 3D high-resolution images within low-resolution ones provides tissue-scale context information that is essential for the interpretation of the data at the cellular and subcellular level.

Bayesian foreground/background discrimination (BFBD) de-noising

A major problem for the image analysis of thick tissue sections is the low signal-to-noise ratio deep into the tissue, especially for stainings that yield high and diffuse background (e.g. actin staining with phalloidin throughout the cytoplasm). To address this problem, we developed a new Bayesian de-noising algorithm that first makes a probabilistic estimation of the background and separates it from the foreground (see ‘Methods’). Subsequently, the estimated background and foreground signals are independently smoothed and summed to generate a new de-noised image (Figure 1—figure supplement 2). We applied BFBD de-noising to both low- and high-resolution images. BFBD de-noising provides better results than the standard ones in the field, such as median filtering, Gauss low-pass filtering and anisotropic diffusion (Figure 1—figure supplement 4), but also outperforms (by quality and computational performance) other algorithms, known to be more elaborate, such as the ‘Pure Denoise’ (Luisier et al., 2010) and ‘edge preserving de-noising and smoothing’ (Beck and Teboulle, 2009) (see ‘Methods’) (Figure 1—figure supplement 5).

Reconstruction of multi-scale tissue images

The tissue was imaged at low- and high-resolution for the multi-scale reconstruction. The reconstruction was performed in three steps: (1) images of physical sections were assembled as mosaics of low-resolution images, (2) all mosaics were corrected for physical distortions and combined in a single 3D image (image stitching) and (3) the high-resolution images were registered into the low-resolution one.

In more detail, the partially overlapping (~10% overlap) low-resolution images of each physical section were combined in 3D mosaics (Figure 2A and Figure 2—figure supplement 1A) using the normalized cross-correlation (NCC) approach (see ‘Methods’). NCC was chosen because it allows finding accurate shifts given a coarse initial match between 3D images (Emmenlauer et al., 2009; Peng et al., 2010; Bria and Iannello, 2012). Then, the 3D image mosaics were combined into a single 3D image. The mechanical distortion and tissue damage produced by sectioning are such (as illustrated in Figure 2B and Figure 2—figure supplement 1C) that even advanced and well-established methods for image stitching (Preibisch et al., 2009; Saalfeld et al., 2012; Hayworth et al., 2015) fail due to the lack of texture correlations between adjacent sections. To address this problem, we developed a Bayesian algorithm for stitching images of bended and partially damaged soft tissue sections. The algorithm first corrects section bending and then uses the empty space at the interior of large structures (e.g. vessels) within adjacent sections to register and stitch them.

Figure 2. Reconstruction of a multi-scale lobule image.

(A) Schematic representing a single serial section obtained from a grid of M × N partially overlapping 3D images (tiles). The cross-correlation between two neighbouring tiles in the grid provides a local metric, which describes the value of their relative shifts. The reconstruction of each section was performed by maximizing the sum correlations of each tile to all adjacent tiles (see ‘Methods’ for details). (B, C) Correction of tissue deformations (introduced during the sample preparation process) using a surface detection algorithm and β-spline transformation. (B) Output of the surface detection algorithm. The proposed Bayesian approach uses prior information about expected bending of the section, its thickness and measurement error (see ‘Methods’ for details) to determine the volume of the image belonging to the tissue and to the out-of-field region. (C) The tissue section after correcting its bending by using quadratic β-splines. (D) Tissue section before (left) and after (right) the correction of the mechanical distortions and the tissue damage. (E) Full lobule-level reconstruction established by the alignment of six low-resolution sections (1 μm × 1 μm × 1 μm per voxel) and the interpolation of blood vessels. Two high-resolution images (0.3 μm × 0.3 μm × 0.3 μm per voxel) were registered in the low-resolution reconstruction and are shown in grey (see Video 1).

DOI: http://dx.doi.org/10.7554/eLife.11214.009

Figure 2.

Figure 2—figure supplement 1. Reconstruction of multi-scale tissue images.

Figure 2—figure supplement 1.

Tissue section reconstruction: (A) Schematic representation of an M × N grid of partially overlapping 3D images. The regions in light blue and light red represent the overlapping areas between neighbouring images. The colour-coded maps show the cross-correlation matrixes between neighbouring images. (B) Reconstructed tissue section from 4×4 a grid of low-resolution images. The pattern of DAPI staining (nuclei) at the intersection of two neighbouring images is shown. Correction mechanical distortion and tissue damage on serial sections: (C) x–z section of the image of a tissue section showing the main obstacles for the tissue surface detection: unstained volume of blood vessels (C') and blurring (C''). Probabilities (Dp(ym1,ym2,|y1,y2), (Ep(y2|y1) and (Fp(y1) calculated from the maximum entropy segmentation (red), model equations (blue) and manual solution (green). All distributions in the figure were averaged over all tissue sections in the benchmark. (G) Comparison of manual and automated surfaces calculated for two tissue sections from P16 (upper) and adult (lower) mice datasets. (H) Accuracy of surface detection. Plot presenting the mean absolute deviation calculated between manually and automatically detected surfaces for 33 different tissue sections in 4 data sets. Since tissue section segmentation is ambiguous, the control experiment was conducted by segmenting the same tissue sections manually three times.
Figure 2—figure supplement 2. Reconstruction of multi-scale tissue images.

Figure 2—figure supplement 2.

Tissue-level network segmentation: (A) Reconstructed image of a tissue section. Large vessels appear as empty space in the image. (B) Spatial distribution of the local maximum entropy threshold value. (C) Segmentation of large vessel in a single tissue section. Registration of high-resolution images into low-resolution ones: Representative region of a 2D plane of (D) a low-resolution (yellow) and (E) a high-resolution (red) image stained with Flk1 for sinusoids. (F) Superimposed images after the registration.

A prerequisite for the correction of section bending is the detection of its upper and lower surfaces (Figure 2B). The high degree of image axial blurring in thick samples (Nasse and Woehl, 2010) and the presence of large vessels pose problems for the detection of surfaces (see Figure 2—figure supplement 1C). The algorithm reconstructed the probability distribution of the surface excursion (deviation from the mean position over the neighbourhood) and then used it to predict the localization of each point at the surface (see ‘Methods’). The surface predicted by the algorithm closely matched the surface detected manually (Figure 2—figure supplement 1G). Then, the bending correction was performed by standard β-spline transformation (Figure 2C,D).

Next, the individual sections were combined. Since approximately one cell layer is removed upon sectioning, direct matching of two adjacent sections is impossible. Therefore, we first segmented the large vessels and then aligned the sections by matching them (Figure 2D). The vessels were segmented by using the local maximum entropy (LME) approach (Brink, 1996) (see ‘Methods’). Subsequently, the segmented vessels were classified (marked as PV or CV) revealing the precise arrangement of lobule-level structures. Finally, we interpolated these vessels within the gaps caused by tissue removal by tri-linear intensity approximation.

Following the assembly of the low-resolution model, we registered the high-resolution images within it using rigid body transformation. To accelerate the search for registration parameters, we built a hierarchy of binned images and performed registration sequentially from the coarsest to the finest one (see ‘Methods’). This method was used for the reconstruction of a liver tissue model from six serial sections, each imaged as a 3 × 3 mosaic grid with 10% overlap and resolution of 1 μm × 1 μm × 1 μm per voxel. Then, two sections, each imaged as a 2 × 2 mosaic grid at high-resolution (0.3 μm × 0.3 μm × 0.3 μm per voxel) were registered within the low-resolution model. The reconstruction covers about 1300 μm × 1300 μm × 600 μm of the tissue and is presented in Figure 2E and Video 1.

Video 1. 3D image visualization of a multi-resolution geometrical model of liver tissue.

Download video file (2.8MB, mp4)
DOI: 10.7554/eLife.11214.012

A set of six low-resolution (1.0 μm × 1.0 μm × 2.0 μm per voxel) and two high-resolution tissue sections (0.3 μm × 0.3 μm × 0.3 μm per voxel) were used. Central veins are shown in light blue, portal veins in orange and high-resolution cubes in grey.

DOI: http://dx.doi.org/10.7554/eLife.11214.012

3D image segmentation and active mesh tuning for the accurate reconstruction of tubular networks (sinusoids and BC) and nuclei

The next step was to reconstruct the tubular structures present in the tissue, that is, sinusoidal and BC networks. One of the most popular tools for image segmentation is global thresholding (Pal and Pal, 1993). In particular, the maximum entropy approach has been widely applied to image reconstruction problems, including the segmentation of fluorescent microscopy images (Dima et al., 2011; Pecot et al., 2012). However, since 3D confocal images are usually heterogeneous in intensity due to staining unevenness and light scattering in the tissue (Lee and Bajcsy, 2006), global thresholding approaches may produce segmentation artefacts. In contrast, local thresholding allows adjusting the segmentation threshold to the spatial variability. We applied the LME method to find segmentation thresholds in the de-noised images. For this, we split the 3D image into a set of cubes and calculated the maximum entropy segmentation threshold (Brink, 1996) within each cube. The threshold values were tri-linearly interpolated to the entire 3D image.

However, this segmentation approach produced two major artefacts. The objects were moderately swollen and contained holes resulting from local uneven staining. We used standard approaches to close the holes by morphological operations (opening/closing), which unfortunately led to even higher overestimation of the diameter of thin structures, such as sinusoids and BC. To correct this, we extended the segmentation algorithm by including the following steps. We generated a triangulation mesh of the segmented surfaces by the cube marching algorithm (Lorensen and Cline, 1987) (Figure 3A). Then, we tuned the active mesh so that the triangle mesh vertexes aligned to the maximum gradient of fluorescence intensity in the original image (Figure 3A). Finally, we generated a representation of the skeletonized image via a 3D graph describing the geometrical and topological features of the BC and sinusoidal networks. The reconstruction of sinusoidal and BC networks are shown in Figure 3B,C, respectively.

Figure 3. Reconstruction of tubular structures, nuclei and cells.

(A) A single 2D image section is shown with the contours of the sinusoidal network reconstruction overlaid on the de-noised image. The contours of the initial mesh are drawn in yellow, and the ones of the tuned mesh are drawn in cyan. (B–E) 3D representation of the different structures segmented in a sample of liver tissue: sinusoids (B), BC (C), nuclei (D) and cells (E). All the reconstructed structures are shown together in (F). The reconstructed triangle meshes are drawn inside the inner box and the raw images are outside. In the case of tubular networks (i.e. sinusoids and BC), the central lines of the structures are shown together with the raw images.

DOI: http://dx.doi.org/10.7554/eLife.11214.013

Figure 3.

Figure 3—figure supplement 1. Nuclei splitting.

Figure 3—figure supplement 1.

(A) 3D visualization of a confocal image of closely packed nuclei (DAPI). (B) Objects resulting from the initial segmentation and reconstruction: triangle meshes of the artificially merged structures. The approximation of different structures (C) by (D) one or (E) two overlapping ellipsoids is shown. Prediction of multi-nuclear structures: (F) distribution of the In(MSE) values obtained from the nuclei approximation by one and double ellipsoids. The distribution was fitted by a sum of two Gaussian distributions. The fitting curve is shown in blue (solid line) and the components in magenta and red (dash lines). (G) Calculated threshold that discriminates between bi/mono-nuclear and multi-nuclear structures. The graphs were obtained from the analysis of a sample of liver tissue, which covers the entire central vein (CV)-portal vein (PV) axis. Multi-nuclei splitting: (H) original confocal image where the nuclei seeds were detected (I) and expanded to the real nuclei shape (J). (K) The performance of the splitting algorithm was evaluated in both synthetic and real 3D images. The synthetic image consisted of 150 nuclei, which included single nuclei, double- and triple-nucleated structures. The individual nuclei had a radius between 5 and 7 µm. The multi-nucleated structures were generated with different degrees of overlap. A global background of 10% of the intensity of the nuclei was added to the whole image, then it was blurred using a Gaussian filter and finally salt and paper noise was added. The real image corresponds to an adult mouse tissue sample of 2.3 ×10–3 mm3 volume. The initial segmentation yielded 281 structures, which were analysed (the nuclei touching the borders of the sample were excluded from the analysis). The performance was evaluated in terms of true positive (TP), false positive (FP), true negative (TN) and false negative (FN) values. TP = correctly split, FP = over-splitting, TN = correctly not split, FN = under-splitting. Precision (PR) = TP/(TP FP), sensitivity (SN) = TP/(TP FN), specificity (SP) = TN/ (TN FP), F-score = 2 × (PR × SN)/(PR SN) and accuracy (AC) = (TP TN)/(TP TN FP FN).
Figure 3—figure supplement 2. Cell classification.

Figure 3—figure supplement 2.

(A) Example of an image used to generate the training set for the classifier. The different types of nuclei forming in liver tissue where manually classified using the specific markers, that is, Flk1 (magenta) for sinusoidal endothelial cells (SECs), the macrophage antibody F/4/80 (yellow) for Kupffer cells and the intermediate filament Desmin (green) for stellate cells. The training set was extracted from three samples covering the entire central-portal vein axis. (B) Selection of the set of parameters for the linear discriminant analysis (LDA). The 74 calculated parameters were sorted by the Fisher score and the top five ranked parameters with the largest Fisher scores are shown. The classifier accuracy in dependency of the number of parameters used for the classification is plotted. The set of parameters that yielded the highest accuracy of the classifier was chosen. (C) Features dependency obtained in the Bayesian network classifier. The Bayesian network structure learning from the experimental data revealed that 15 parameters were relevant for the nuclei classification. The five parameters with the highest mutual information to the nuclei type are shown in inset.
Figure 3—figure supplement 3. Cell classification accuracy.

Figure 3—figure supplement 3.

Confusion matrixes obtained with the (A) linear discriminant analysis and (B) the Bayesian network classifier. The instances (e.g. nuclei) in each predicted class are represented in the columns of the matrix, while the instances in an actual class (manually identified) are represented in the rows. 3D representation of the different nuclei types identified in a representative sample of liver tissue: (C) hepatocytes, (D) sinusoidal endothelial cells (SECs), (E) stellate and (F) Kupffer cells.
Figure 3—figure supplement 4. Reconstruction of tubular structures, nuclei and cells.

Figure 3—figure supplement 4.

Single 2D image planes are shown with contours of (A) sinusoidal and (B) and bile canalicular (BC) networks, (C) nuclei and (D) cells reconstructions overlaid on raw data. Insets show zoomed areas of the image.
Figure 3—figure supplement 5. Generation of realistic 3D images of liver tissue.

Figure 3—figure supplement 5.

(A) Generation of images with uneven staining. The image of the idealized structure (homogeneous tubes) created for the bile canalicular (BC) network is shown in the top left image. The initial coarse grained sampling (6 × 6 ×6 binning) of intensities is shown in the top-right image. The fine sampling (unbinned image) of intensities is shown in the bottom-right image and final result in the bottom-left one. (B) 3D representation and 2D projections of a model image of BC with uneven staining. (C) Characteristic point spread function (PSF) of a confocal microscope. (D) 3D representation and 2D projections of a model image of BC convolved with the PSF. (E) Mean variance of each intensity level for different depth (z-direction) levels of a confocal image. (F) Linear increase of the intensity scaling factor (alpha) with the sample depth for different channels. The error bars represent the standard deviation between three samples. (G) 3D representation and 2D projections of a final model image of BC after adding spatially variable Poisson noise.
Figure 3—figure supplement 6. Benchmark of images to evaluate 3D reconstructions of dense tissue.

Figure 3—figure supplement 6.

Example of a realistic 3D image of liver tissue. 3D representation and 2D projections (xy and xz) of a high-resolution image created for bile canalicular (BC) (A) and sinusoidal (B) networks as well as nuclei (C) and cell borders (D). The images size is 256 ×256 ×256 voxels with a resolution of 0.3 μm × 0.3 μm × 0.3 μm per voxel. The image shown corresponds to a 2:1 signal-to-noise ratio.
Figure 3—figure supplement 7. Model validation: Evaluation of the accuracy of our pipeline for the 3D reconstruction of dense tissue.

Figure 3—figure supplement 7.

The reconstructions of the different structures forming the tissue were evaluated in terms of true positive (TP), false positive (FP), true negative (TN) and false negative (FN) values extracted from the comparison of the reconstructed image and the ground truth (image without distortions). The precision (PR) and sensitivity (SN) are defined as TP/ (TP FP) and TP/ (TP FN), respectively. F-score is given 2 × (PR × SN)/ (PR SN). The tests were performed in three sets of images (three images per set) with different signal-to-noise ratio (10:1, 4:1, 2:1). (A–C) and (D–F) The results for the bile canalicular (BC) and sinusoidal networks, respectively. (G–I) and (J–L) The ones for nuclei and cells, respectively. Whereas in the case of BC, sinusoids and nuclei, the error bar corresponds to standard deviations of the values between three images, for the cells the error bar corresponds to the standard deviation of the values over all the cells in the samples (32 cells). Only the cells that were not in contact with the boundary of the image were analysed. (M–N) The mean values for the radius of BC and sinusoidal networks. (O) The mean error in the estimation of the cell volume. The error was calculated as 100×Vs-VgtVgt, where Vand Vgt are the volumes of the reconstructed and ground truth cells, respectively.

Nuclei were reconstructed similar to the tubular structures. However, as shown in Figure 3—figure supplement 1A,B, closely packed nuclei are optically not well-resolved in 3D confocal images, resulting in artificially merged structures. Since 30–60% (depending on the animal strain and age) of hepatocytes in adult liver are bi-nucleated, artificial nuclei merging compromises the tissue analysis. To address this problem, we used a probabilistic algorithm for double- and multi-nuclei splitting (Figure 3—figure supplement 1). Briefly, the algorithm first discriminated between mono-, double and multi-nuclear structures by learning the misfit distribution of triangulation mesh and nuclei approximation by single and double ellipsoids (Figure 3—figure supplement 1A–G). Then, the seed points for the multi-nuclear structures were detected using the Laplacian-of-Gaussian (LoG) scale-space maximum intensity projection (Stegmaier et al., 2014) and, finally, the real nuclear shapes were found using an active mesh expansion starting from the nuclei seeds (see ‘Methods’ for details). Tested in both synthetic and real 3D images, the algorithm proved capable of splitting clustered nuclei with different degrees of overlap (Figure 3—figure supplement 1K) with an accuracy of over 90%. Although this approach is based on active triangulation mesh, it achieved similar accuracy values to other recently published voxel-based methods for nuclei segmentation (Amat et al., 2014; Chittajallu et al., 2015).

Cell classification and reconstruction

Generating geometrical models of tissues requires the proper recognition of different cell types. A previous automated classification system discriminated hepatocytes from non-parenchymal cells in 2D human liver images with a 97.8% accuracy (O'Gorman et al., 1985). However, the automatic classification of non-parenchymal cells in 3D liver tissue is more challenging. Given their importance in physiology and disease (Bouwens et al., 1992; Kmiec, 2001; Malik et al., 2002) and the limitation on the number of fluorescent markers that can be simultaneously imaged, we designed an algorithm to automatically classify different cell types in the tissue based on nuclear morphological features. We chose two deterministic supervised classifiers, linear discriminant analysis (LDA) and Bayesian network classifier (BNC). LDA, also known as Fisher LDA (Fisher, 1936), is a fundamental and widely used technique to classify data into several mutually exclusive groups (Duda et al., 2001). It has been successfully applied for nuclei discrimination in microscopy images (Huisman et al., 2007; Lin et al., 2007). On the other hand, BNCs are more recently developed classifiers which not only show good performance but also allow for probabilistic classification. In addition, BNCs reveal the hierarchy of parameters used for the classification (Friedman et al., 1997), which may provide insights into underlying biological processes.

As input for the classifiers, we manually built a training set of 2301 nuclei using specific cellular markers (Figure 3—figure supplement 2A) and computed for each nucleus a profile of 74 parameters (Table 1) describing nuclei morphology, texture and localization relative to sinusoids and cell borders (density of actin in vicinity of nuclei) (see ‘Methods’). For the LDA, the parameters were ranked using Fisher score (Duda et al., 2001), and the most relevant ones were selected based on the classification accuracy (Figure 3—figure supplement 2B and ‘Methods’). Independently, the most relevant parameters were selected on the basis of Bayesian network structure reconstruction (Friedman et al., 1999) (Figure 3—figure supplement 2C).

Table 1.

List of the 74 parameters calculated for the nuclei classification.

DOI: http://dx.doi.org/10.7554/eLife.11214.021

Parameter F-score Parameter F-score
FLK1 surface intensity 1 vx 4.802 Mean radius 0.920
FLK1 surface intensity 0 vx 4.737 FLK1 KURT 0.915
FLK1 mean 4.674 MB Frac Dim 0.904
FLK1 surface intensity 2 vx 4.570 Log Lac2 0.885
FLK1 surface intensity 3 vx 4.100 HF2 0.833
Phallo surface intensity 2 vx 3.477 HF13 0.825
FLK1 surface intensity 4 vx 3.453 HF3 0.817
Phallo surface intensity 1 vx 3.430 Phallo surface intensity 9 vx 0.787
FLK1 SKEW 3.351 Surface area 0.768
Phallo surface intensity 3 vx 3.253 Log lac 3 0.718
Phallo surface intensity 0 vx 3.236 Radius variance 0.669
Norm lac 3 2.930 Volume 0.668
Norm lac 2 2.913 BC Frac Dim 0.649
FLK1 surface intensity 5 vx 2.857 Log lac 4 0.612
Norm lac 4 2.847 Phallo surface intensity 10 vx 0.554
Phallo surface intensity 4 vx 2.838 Log lac 5 0.536
Norm lac 5 2.753 Sphericity 0.423
Phallo surface intensity 5 vx 2.347 HF7 0.408
FLK1 surface intensity 6 vx 2.310 Shape index 0.402
HF9 2.141 Lacunarity 1 0.381
FLK1 surface intensity 7 vx 1.893 b/c 0.342
Phallo surface intensity 6 vx 1.868 Lacunarity 2 0.333
HF5 1.575 Lacunarity 3 0.309
HF8 1.554 Lacunarity 4 0.295
FLK1 surface intensity 8 vx 1.552 HF4 0.287
HF11 1.471 Lacunarity 5 0.285
Phallo surface intensity 7 vx 1.444 HF12 0.153
a/c 1.406 DAPI Sd 0.123
Log lac 1 1.287 DAPI gradient surface 0.094
FLK1 surface intensity 9 vx 1.265 Log norm lac 2 0.087
HF6 1.158 CVM 0.076
Phallo surface intensity 8 vx 1.084 Log norm lac 3 0.062
FLK1 surface intensity 10 vx 1.018 Log norm lac 4 0.045
HF1 0.978 DAPI SKEW 0.035
FLK1 Sd 0.942 Log norm lac 5 0.033
HF10 0.939 DAPI mean 0.029
a/b 0.937 DAPI KURT 0.022

Note: The parameters are sorted based on their Fisher score, which is a measure of the discriminative power of the parameter.

The performance of the classifiers was measured using the leave-one-out cross-validation method on the training set. Both classifiers recognized hepatocytes with ~100% accuracy, thus further improving the previous performance (O'Gorman et al., 1985). The overall cell-type classification yielded 95.4% and 92.6% accuracy for the LDA and BNC, respectively. Although discriminating non-parenchymal cells is difficult even for a person skilled in the art, our algorithms achieved accuracy higher than 90%. The predictive performance of the classifiers is shown in Figure 3—figure supplement 3A,B. As expected, the first largest population of cells corresponds to hepatocytes (44.6% ± 2.7%, mean ± SEM) followed by sinusoidal endothelial cells (29.8% ± 2.5%). Surprisingly, we found important quantitative differences for Kupffer and stellate cells. The percentage of Kupffer cells (8.7% ± 0.7%) was lower than that of stellate cells (11.2% ± 1.0%), against previous estimates on 2D images (Baratta et al., 2009). The percentage of other cells was 5.7% ± 0.8%. A 3D visualization of the localization of the nuclei of the different cell types is shown in Figure 3—figure supplement 3C–F.

Finally, cells were segmented by expansion of the active mesh from the nuclei to the cell surface. The expansion was either limited to the cell cortex (i.e. the maximum density of actin) or to contacts with neighbouring cells or tubular structures (Figure 3E). The active mesh expansion was parameterized by inner pressure and mesh rigidity. However, this algorithm over-segmented bi-nucleated cells into two cells with a single nucleus. Therefore, we used phalloidin intensity and nucleus-to-nucleus distance to recognize over segmented multinuclear cells and merge them. A manual check of segmentation of 2559 cells revealed only ~2% error for hepatocyte segmentation that is a further improvement of the state-of-the-art achievements by voxel-based segmentation methods (Mosaliganti et al., 2012). The results of the segmentation of all imaged cellular and subcellular structures in the liver tissue (i.e. cells, nuclei, sinusoidal and BC networks) are presented in Figure 3E, Figure 3—figure supplement 4, and Videos 2 and 3.

Video 2. Reconstruction of all imaged structures in a high-resolution image.

Download video file (28MB, mp4)
DOI: 10.7554/eLife.11214.022

A 2x2 stitched (~ 400 μm × 400 μm × 100 μm) high-resolution image (0.3 μm × 0.3 μm × 0.3 μm per voxel) was used. First, the reconstruction of the large vessels, that is, central vein (CV) (cyan), portal vein (PV) (orange) and bile duct (green) are shown. Then, raw images and the corresponding reconstructed objects of the different structures are shown sequentially: sinusoids (magenta), BC (green), nuclei (random colours) and cells (random colours). Additionally, central lines are shown for the tubular structures. Finally, all segmented structures are shown. This video provides a complete over view of the reconstructed objects in a typical high-resolution image.

DOI: http://dx.doi.org/10.7554/eLife.11214.022

Video 3. Detailed reconstruction of all imaged structures in a high-resolution image.

Download video file (10MB, mp4)
DOI: 10.7554/eLife.11214.023

In order to highlight the details of the reconstruction of small structures [e.g. nuclei, bile canalicular (BC) network, etc.], a video of a small, cropped (~125 μm × 125 μm × 75 μm) high-resolution image (3 μm × 0.3 μm × 0.3 μm per voxel) was generated. Similarly to Video 2, the raw image and the corresponding reconstructed structures of sinusoids (magenta), BC (green), nuclei (random colours) and cells (random colours) are shown sequentially.

DOI: http://dx.doi.org/10.7554/eLife.11214.023

Model validation

To evaluate the performance of the pipeline for the reconstruction of dense tissues, we generated a benchmark comprising a set of realistic 3D images of liver tissue. Each synthetic image consisted of four channels for the main structures forming the tissue, that is, cell nuclei, cell borders, sinusoidal and BC networks. We first generated 3D models of liver tissue based on experimental data (see ‘Methods’). The benchmark models had levels of complexity similar to that of the real tissue (Figure 3—figure supplement 5,6). Second, we imposed uneven staining to the models in order to resemble the experimental data. Third, the artificial microscopy images were simulated by convolving the models according to the 3D confocal microscope point spread function (PSF) (Nasse et al., 2007; Nasse and Woehl, 2010) and adding z-dependent Poisson noise. The resulting benchmark image statistics were similar to those from the images acquired in our experimental setup (see ‘Methods’) (Figure 3—figure supplement 5). Given their general usefulness for testing image analysis software, the benchmark images and models are provided as supplementary material (Supplementary file 1, Morales-Navarrete et al., 2016). Finally, we applied our 3D tissue reconstruction pipeline to the benchmark images and quantified the accuracy of the reconstructed models using the precision-sensitivity framework (Powers, 2011). The overall quality was expressed as F-score, the harmonic mean between precision and sensitivity. The benchmark tests were performed in three sets of images with different signal-to-noise ratio (10:1, 4:1, 2:1). For tubular structures, we achieved average (over the different noise level sets) F-scores of 0.90 ± 0.04 and 0.73 ± 0.06 for sinusoidal and BC networks, respectively. In the case of the nuclei and cell segmentation, we found average F-scores 0.91 ± 0.03 and 0.92 ± 0.03, respectively. The detailed quantifications are shown in Figure 3—figure supplement 7A–L. Additionally, we measured morphometric parameters of the reconstructed structures such as the average radius of the tubular structures (BC and sinusoidal networks) and cell volumes. We obtained values of 2.72 ± 0.13 µm (ground truth value = 3.0 µm) and 0.58 ± 0.05 µm (ground truth value = 0.5 µm) for sinusoidal and BC networks, respectively (Figure 3—figure supplement 7M,N). The average error for cell volume estimation was found to be 5.17% ± 1.97% (Figure 3—figure supplement 7O). The benchmark experiments showed high accuracy for the reconstruction of the ‘ground truth’ models of all the morphologically different structures forming the liver tissue (Figure 3—figure supplement 7).

New insights into liver tissue organization from the geometrical model

Next, we applied our software to quantitatively analyse the geometric features of liver tissue from three adult mice. Geometric features have important implications, for example, for the development of models of fluid exchange between blood and hepatocytes (Wisse et al., 1985). A critical parameter for blood flux models is the radius of sinusoids. We measured a radius of 4.0 ± 1.1 μm, a value close to quantifications by electron microscopy (EM) analysis (Wisse et al., 1985; Oda et al., 2003; McCuskey, 2008). In the sinusoidal networks, we determined the angles between two branching arms to be 111.6° ± 12.37° (Figure 4—figure supplement 1B), against previous estimates (Hammad et al., 2014). Moreover, the values for the BC network are similar to the sinusoidal network (110.36° ± 9.85°, Figure 4—figure supplement 1B). Additionally, we provided new geometric information such as the cardinality of the branching nodes (Figure 4—figure supplement 1C).

Recent studies on the morphometric parameters of the liver tissue (Hammad et al., 2014; Friebel et al., 2015) provided either average values or limited data measurements of the hepatocytes volume, omitting information on their heterogeneity. We could not only perform accurate measurements of hepatocytes volumes and poly-nucleation, but also correlate them with polyploidy and spatial localization within the tissue. Interestingly, we found a multi-modal distribution of hepatocyte volumes (Figure 4A) in line with measurements on isolated hepatocytes (Martin et al., 2002). A trivial explanation is that it reflects the presence of mono- and bi-nucleated hepatocytes. However, we found that this was not the case. The distribution of volumes of both mono- and bi-nucleated hepatocytes can be independently described by a mixture of two populations with mean volumes 3126 ± 1302 µm3 (~14% of cells) and 5313 ± 1175 µm3 (~10% of cells), and 5678 ± 1176 µm3 (~45% of cells) and 10606 ± 1532 µm3 (~30% of cells), respectively (Figure 4B,C). Hence, surprisingly, although the bi-nucleated hepatocytes are assumed to be larger than the mono-nucleated, we found that a population of mono-nucleated hepatocytes can have a volume that does not differ from that of bi-nucleated hepatocytes (Figure 4A–C).

Figure 4. Distribution of hepatocyte volumes and DAPI integral intensity per cell for all hepatocytes (A, B) and separated by number of nuclei (B, C and E, F).

Whereas experimental data are shown by dots, the log-normal components fitted to data are shown by solid lines. (A) Cell volume distribution of all hepatocytes. (B, C) Cell volume distribution obtained for mono and bi-nucleated hepatocytes, respectively. (D) Distribution of DAPI integral intensity (proportional to the content of DNA) of all hepatocytes. (E, F) Distributions of DAPI integral intensity obtained for mono and bi-nucleated hepatocytes, respectively. The analysis was performed on 2559 hepatocytes (excluding boundary cells) from three adult mice.

DOI: http://dx.doi.org/10.7554/eLife.11214.024

Figure 4.

Figure 4—figure supplement 1. Morphometric features of the sinusoidal and bile canalicular (BC) networks.

Figure 4—figure supplement 1.

(A) Radius distribution of the sinusoidal capillary network. (B) Distributions of the angles between branches of BC and sinusoidal networks. (C) Cardinality of branching nodes of BC and sinusoidal networks. The data shown here correspond to a representative sample of adult mouse liver.
Figure 4—figure supplement 2. (A, B) DAPI integral intensity normalization.

Figure 4—figure supplement 2.

Distribution of DAPI integral intensity per nucleus calculated for each sample (A) before and (B) after normalization. We found scaling (stretching) factors 1.19 and 0.93 for the second and third samples, respectively. (C, D) DNA content in bi-nuclear hepatocytes. DAPI integral intensity per nucleus was calculated for each nucleus of the cells. (C) The distribution of the ratio between DAPI integral intensity of the two nuclei in each cell. It follows a normal distribution with mean value 1.0 ± 0.21 (mean ± SD). (D) The dependency between DAPI integral intensity of the two nuclei in bi-nuclear cells. They show a linear dependency (R2 = 0.945433) with a slope of 0.995, showing that both nuclei have the same DNA content in bi-nuclear hepatocytes. (E, F) Scatter plot of the volume versus DAPI integral intensity of (E) mono-nuclear and (F) bi-nuclear hepatocytes. The results of the hierarchical clustering of (E) mono-nuclear and (F) bi-nuclear hepatocytes are shown. Four (2n, 4n, 8n, 16n) and three (2×2n, 2×4n, 2×8n) populations were found for mono-nuclear and bi-nuclear hepatocytes, respectively. The classification was performed using volume and DAPI integral intensity per cell. We used an agglomerative hierarchical cluster algorithm and tested several distances for the dissimilarity calculation and different methods for the clustering. We found that the standardized Euclidean distance with the Ward method yielded the best results.

Having found such a peculiar size distribution of bi-nucleated hepatocytes, we measured the total content of DNA per nucleus in every cell sub-population as the integral intensity of DAPI (Coleman et al., 1981; Xing and Lawrence, 1991; Dmitrieva et al., 2011; Zhao and Darzynkiewicz, 2013) (see ‘Methods’). The resulting distribution (Figure 4D) shows three well-separated peaks. These presumably correspond to the 2n (diploid nuclei), 4n and 8n (polyploid nuclei) DNA content previously reported (Guidotti et al., 2003; Martin et al., 2002) (note that this analysis does not resolve the aneuploidy of specific chromosomes (Faggioli et al., 2011)).

Next, we asked how the nuclei are distributed between the mono- and bi-nucleated cell populations. Interestingly, in the small bi-nucleated hepatocytes (volume < 8000 µm3) both nuclei had 2n DNA content, whereas in the large hepatocytes (volume > 8000 µm3) both had 4n DNA content. Almost no bi-nuclear hepatocytes (<1.0%) with different amount of DNA per nucleus (e.g. one nucleus with 2n and one with 4n) were observed (Figure 4—figure supplement 2C,D). These results suggest that the hepatocyte volume does not depend on the number of nuclei but rather on their polyploidy, in agreement with previous reports (Miyaoka and Miyajima, 2013). Therefore, we classified hepatocytes with respect to number of nuclei, volume and DNA content using a hierarchical cluster algorithm. We identified seven populations, namely 2n, 4n, 8n, 16n for mono-nuclear and 2×2n, 2×4n, 2×8n for bi-nuclear hepatocytes (Figure 4—figure supplement 2E,F). Four populations (mono-nucleated 2n and 4n, and bi-nucleated 2×2n and 2×4n) were major, representing around 97% of all hepatocytes.

The reports on the spatial distribution of polyploid hepatocytes are controversial (Gentric and Desdouets, 2014). Whereas some suggest that periportal hepatocytes show a lower polyploidy than the perivenous ones (Gandillet et al., 2003; Asahina et al., 2006), others suggest that both regions have similar polyploid compositions (Margall-Ducos et al., 2007; Pandit et al., 2012). These discrepancies prompted us to analyse the spatial distribution of mono- and bi-nucleated hepatocytes within the lobule. We particularly analysed the largest populations of hepatocytes, 2n, 4n, 2×2n and 2×4n. Strikingly, we found a pronounced zonation in their localization. Whereas the 2n mono-nucleated were enriched in the PC and PV regions, mono-nucleated 4n showed a homogeneous distribution between PV and PC regions (Figure 5). The 2×2n bi-nucleated hepatocytes have a similar pattern as the 2n mono-nucleated (highly enriched in the CV and PV regions), but the density of 2×4n bi-nucleated was lower in those regions and increased in the middle region (Figure 5). As far as we know, this is the first time that polyploidy and poly-nuclearity are found to be zonated and follow a specific pattern. These findings have important implications for both the structural organization of liver tissue and its proliferating and metabolic activities.

Figure 5. Relative density of different sub-populations of hepatocytes as function of central vein (CV)-portal vein (PV) axis coordinate.

Figure 5.

(A, C, E, G) Relative density of 2n mono-nucleated, 2x×2n bi-nucleated, 4n mono-nucleated, 2x×4n bi-nucleated hepatocytes, respectively. (B, D, F, H) 3D visualization of the corresponding sub-populations of hepatocytes. The analysis was performed on 2559 hepatocytes (excluding boundary cells) from three adult mice. The CV-PV axis is determined by the coordinate χ, which describes the position of a point relative to the closest CV and PV. χ=50×(|D-dpv|-|D-dcv|D+1), where dcv and dpv are the distances to the closest CV and PV respectively, and D is the CV-PV distance. χ takes values between 0 and 100, where 0 and 100 represents a localization at the CV and PV surfaces, respectively.

DOI: http://dx.doi.org/10.7554/eLife.11214.027

Application of the pipeline to lung and kidney tissue

To test the general applicability of the pipeline as well as the robustness of our algorithms, we applied it to two morphologically distinct tissues, lung and kidney. Lung and kidney sections were stained for nuclei (DAPI) and the cell cortex (F-actin by phalloidin). Kidney samples were additionally stained for the apical (CD13) and basal (fibronectin and laminin) cell surface. The pipeline allowed us to generate geometrical reconstructions of the tissues (Figure 6 and Videos 4 and 5, respectively) without fine-tuning of the parameters. As proof of principle, we extracted some statistics of the most relevant structures from each tissue. Structural information from both relatively large structures like alveoli in lung or glomerulus in kidney, and smaller ones like cells and nuclei were extracted from the geometrical models. Figure 6—figure supplement 1,2 show the statistical distributions of some interesting tissue features, such as cell volume and elongation, number of neighbouring cells, etc. Information about the spatial organization of the alveolar cells (i.e. their localization relative to the alveoli) in the lung was extracted as well.

Video 4. 3D reconstruction of lung tissue.

Download video file (10.3MB, mp4)
DOI: 10.7554/eLife.11214.031

Nuclei and cells reconstructed from a high-resolution image (∼220 μm × 220 μm × 80 μm). First, the raw images of the cell cortex (F-actin by phalloidin) and nuclei (DAPI) staining are displayed. Then, the reconstruction of the nuclei (random colours) and the cells (random colours) are shown.

DOI: http://dx.doi.org/10.7554/eLife.11214.031

Video 5. 3D reconstruction of kidney tissue.

Download video file (5.9MB, mp4)
DOI: 10.7554/eLife.11214.032

Nuclei and cells reconstructed from a high-resolution image (∼220 μm × 220 μm × 80 μm). First, the raw images of the cell cortex (F-actin by phalloidin) and nuclei (DAPI) staining are displayed. Then, the reconstruction of the nuclei (random colours) and the cells (random colours) are shown.

DOI: http://dx.doi.org/10.7554/eLife.11214.032

Figure 6. Reconstruction of geometrical models of lung and kidney tissues.

3D representation of the different structures segmented in each tissue: (A, C) nuclei and (B, D) cells in the lung and kidney tissues, respectively. The triangle meshes are drawn inside the inner box and the raw images outside.

DOI: http://dx.doi.org/10.7554/eLife.11214.028

Figure 6.

Figure 6—figure supplement 1. Morphometric features of lung tissue.

Figure 6—figure supplement 1.

Distributions of (A) volume, (B) elongation and (C) number of neighbouring cells for the lung cells. (D) Distribution of the cell position (centre of the cell) relative to the closest alveoli.
Figure 6—figure supplement 2. Morphometric features of kidney tissue.

Figure 6—figure supplement 2.

(A) and (B) The size and volume distribution of the two cell types identified in the kidney tissue, proximal and distal tubular structures. It was observed that the two cell populations have different characteristic sizes, proximal cells were found to be larger than distal ones. (C) and (D) The distribution for the cells elongation and the number of neighbouring cells, respectively.

For example, in the lung, we found that the alveolar cells constitute around 19% of the volume, consistent with previous measurements (Irvin and Bates, 2003). In the kidney, we found that proximal tubule cells have larger volumes than distal tubule cells (Figure 6—figure supplement 2), also in agreement with previous studies (Nyengaard et al., 1993; Rasch and Dørup, 1997). Altogether, the new data show that our pipeline is versatile and able to reconstruct geometrical models of tissues with fairly different architectures.

Discussion

We developed a versatile pipeline that combines new algorithms with established ones aimed to reconstruct geometrical models of dense tissues from confocal microscopy images acquired at different levels of resolution. Our pipeline is implemented in a freely available platform designed to address unmet computational needs. Despite many efforts, the reconstruction of digital geometrical models of tissues suffers from critical bottlenecks such as lack of automation, limited accuracy and low throughput analysis (Peng et al., 2010). The platform developed here overcomes such bottlenecks in that it (1) achieves high accuracy of geometric reconstruction, (2) can process large volumes of imaged tissue, for example, a full liver lobule, (3) increases the image analysis performance to such an extent that the model reconstruction time is shorter than the biological experimental time and compatible with middle-throughput (this is achieved by combining the computational efficiency of C++ with the CPU/GPU multi-threading capabilities), (4) can be run on a regular PC and (5) provides a flexible tool for constructing image processing pipelines that are tuneable for specific tissue and imaging conditions. For the automatic recognition of different cell types, we included morphological classifiers into the software. The user-friendly pipeline assembly mechanism allows adjusting the platform for specific tissue analysis demands. The newly developed algorithms both increase the quality of the results (e.g. 3D image de-noising, LME method, active mesh tuning, cell classification) and deal with problems for which there appears currently to be no real good solutions available (e.g. correction of tissue deformation and combination of individual sections in the case of partial tissue removal) (Figure 1—figure supplement 1). Our platform is implemented as stand-alone free to download software (http://motiontracking.mpi-cbg.de). Furthermore, we created a benchmark of realistic images (with the underlying ground truth model) for the evaluation of 3D segmentation algorithms in biological images (Supplementary file 1, Morales-Navarrete et al., 2016).

To test its efficacy, we applied it towards the generation of a multi-resolution geometrical model of liver tissue. The resulting model was used to extract quantitative measurements of various features of liver tissue organization, such as radius, branching angles and cardinality of the sinusoidal and BC networks, and to recognize different cell types based on their morphological parameters. Our analysis revealed an unexpected zonation pattern of hepatocytes with different size, nuclei and DNA content within the liver lobule. Furthermore, we extended the analysis to two additional tissues, lung and kidney, demonstrating the general applicability and robustness of our platform.

In building our pipeline, we spent considerable effort to improve the accuracy of the measurements of cell and tissue parameters and preserve their contextual information. The new algorithms allow correcting major defects originating from tissue sectioning, improve the segmentation of cellular, subcellular and tissue-level structures, and extract morphological features and distributions in space. A major limiting factor in the development of a comprehensive geometrical model is the trade-off between imaging large volumes of samples to gain a view of the overall tissue architecture and imaging at high-resolution to achieve an accurate description of the structures at the limit of resolution of the light microscope, for example, the apical surface of hepatocytes forming the BC network. We solved this problem by imaging the tissue at low-resolution and registering within it the parts of tissue (the PV-PC area in the case of the liver lobule) imaged at high resolution. In this way, the measured morphological features (e.g. BC) and parameters (e.g. cell size) are embedded in their proper context of tissue architecture. For example, the hepatocyte volume is a parameter that has little value as average without considering the distribution of parameter values in the lobule (Figure 5). In general, the diversity of geometric features of the cells within the liver lobule could provide new insights into the regulation of metabolic zonation (see below).

Our nuclei reconstruction approach achieved accuracy higher than 90%. As shown in Figure 3—figure supplement 1K, the major source of errors is over-segmented nuclei. Additional steps to improve nuclei reconstruction, such as the region-merging algorithm (Chittajallu et al., 2015) to correct for over-segmentation, could reduce such errors. Even though our cell segmentation method proved able to identify and reconstruct cells with high accuracy, in a few cases (~2%), binuclear cells were mistaken for two separate cells due to weak staining of the cell cortex. Therefore, implementation of additional methods for enhancing the staining of the cell surface, such as the anisotropic plate diffusion filters (Mosaliganti et al., 2010; 2012), could help reduce further the over-segmentation of multi-nuclear cells.

The active mesh tuning allowed improving the accuracy of segmentation of the BC and sinusoidal networks. This is important since the accuracy of a geometrical model is indispensable for the development of predictive models of tissue function. For example, a model of blood flow through the sinusoidal network and exchange with hepatocytes via the space of Disse (Ohtani and Ohtani, 2008; Wisse et al., 1985) critically depends on the estimation of the sinusoid diameter. An overestimation of the sinusoidal tube radius would have major consequences for the predictions of blood cells flow through the sinusoidal network. Our geometrical model yielded a diameter of the sinusoidal-walled tube equal to the typical size of erythrocytes and lymphocytes. Therefore, it supports the model of active exchange of blood serum and lymph in the space of Disse, whereby blood flux propels cells through the sinusoids causing waves of capillary walls deformation (McCuskey, 2008; Wisse et al., 1985). The active mesh tuning algorithm yielded a distribution of the radius of sinusoid capillaries with a mean value that was 20% lower (Figure 4—figure supplement 1A) than previously estimated by similar approaches (Hammad et al., 2014; Hoehme et al., 2010), but in line with the values reported by EM (Wisse et al., 1985). The reconstruction also revealed a large difference with the previously reported angles between two arms of branching sinusoids (112° vs. 32°, Figure 4—figure supplement 1B). Moreover, the geometrical model provides correct values for other sinusoidal network parameters such as number of intersection nodes per mm3 (8.3 × 104 ± 1.9 × 104) and network length per mm3 (3.1 × 106 ± 0.3 × 106 µm), which appear to have been overestimated in a recent report (Hammad et al., 2014) (see ‘Methods’). The discrepancy between our geometrical model and others (Hoehme et al., 2010; Hammad et al., 2014) could be due to differences in image processing and/or experimental procedures (tissue fixation, image acquisition, etc.). One possible explanation for this discrepancy is that our platform applies the active mesh approach to the segmentation of structures on different scales (from the apical surface of hepatocytes forming the BC to cells) and this may yield a more precise geometrical reconstruction in comparison with voxel-based methods (Figure 3A).

For the marker-less cell-type recognition, we compared two approaches, the classical LDA and the more recent BNC, applied to nuclei morphology. The accuracy of both approaches was comparable, reaching higher than 99% efficiency for hepatocyte recognition and about 92–95% for all cell types. The latter value is highly significant since the distinction between stellate and sinusoid endothelial cells in the absence of specific markers is challenging even for a skilled person. The analysis of parameters that were mostly informative for cell type discrimination yielded some unexpected results. Although nuclear size and roundness were traditionally considered a priori as the most relevant parameters to discriminate hepatocytes from non-parenchymal cells (Baratta et al., 2009; O'Gorman et al., 1985), we found that they are less informative than the parameters related to nuclear texture (e.g. moments of lacunarity). The analysis of parameters relevant for cell classification can shed light on the differences in cell morphology that are difficult to grasp by the naked eye. The accurate active mesh-based cell shape estimation led to well-separated peaks of cell volume distribution (Figure 4A–C), which failed to be discriminated by approximation through Voronoi tessellation (Bock et al., 2010) (data not shown).

The analysis of liver tissue using our software platform revealed some unexpected biological findings. It is well established that hepatocytes are heterogeneous in size, number of nuclei (mono and bi-nucleated cells) and DNA content (polyploidy). However, we observed that these features are not randomly distributed but follow a specific zonation pattern within the liver lobule. Surprisingly, the mono-nucleated 2n and bi-nucleated 2×2n hepatocytes were enriched in the CV and PV regions, whereas bi-nucleated 2×4n were more frequent in the middle region. This particular distribution suggests that polyploidy is spatially regulated and follows a gradient between CV and PV. Zonation of metabolic activities in the liver is well known, but zonation of mono- and bi-nucleated cells and total DNA content (polyploidy) remains controversial. The spatial distribution of hepatocytes according to their ploidy in the CV-PV axes correlates with the metabolic zonation. This correlation suggests a possible role of polyploidy in regulating hepatocyte functions in the liver lobule. Interestingly, two unique populations of cells with stem cell-like properties and the capacity to repopulate the liver have been recently identified (Ray, 2015; Wang et al., 2015; Font-Burgada et al., 2015). One population located close to the CV, which has been implicated in homeostatic hepatocyte renewal (Wang et al., 2015), coincides with the mono-nucleated 2n cells we identified. The other population of hepatocytes located near the PV, which was found to repopulate the liver after injury (Font-Burgada et al., 2015), could correspond to the low ploidy cells (2n and 2×2n) we observed. These results inspire future studies aimed at exploring the mechanisms underlying regulation of mono- versus bi-nuclearity and polyploidy in the context of liver tissue structure, function and regeneration (Zaret, 2015; Ray, 2015). In this context, the accurate digital geometrical model of tissue is a valuable resource.

Geometrical models provide the means of extracting structural information as a precondition for the development of functional models of tissues. They can be a tool for acquiring accurate quantitative measurements of morphological features and, as such, have the potential of uncovering the fundamental rules underlying tissue organization. In addition, the measurement of specific parameters, such as BC and sinusoid diameters, network cardinality, cell volume and shape, etc., can serve as diagnostic markers of early stages of tissue dysfunction/repairing, thus providing new tools for clinical research and drug development.

Methods

Mice and ethics statement

Six- to nine-week-old C57BL/6JOlaHsd mice were purchased from Charles River Laboratory. All animal studies were conducted in accordance with German animal welfare legislation and in strict pathogen-free conditions in the animal facility of the Max Planck Institute of Molecular Cell Biology and Genetics, Dresden, Germany. Protocols were approved by the Institutional Animal Welfare Officer (Tierschutzbeauftragter) and all necessary licenses were obtained from the regional Ethical Commission for Animal Experimentation of Dresden, Germany (Tierversuchskommission, Landesdirektion Dresden) (license number: AZ 24-9168.24-9/2012-1, AZ 24-9168.11-9/2012-3).

BFBD algorithm for de-noising images of fluorescent microscopy

We took advantage of the fact that point-spread-function of confocal microscopes is strongly elongated in z-axis and developed a new de-noising algorithm based on the linear approximation of the image background intensity in the z-direction. Since confocal microscopy images are photon-limited and therefore obey Poisson statistics, we first found the parameters α and β that convert the photon counts (N) into the intensity (I) units, such that:

I=αN+β

where the operator . represents the average, α is the conversion coefficient from number of photons to intensity values and β is the offset of the microscope digitization system (dark current).

For this, we calculated the variance of the intensities between sequential optical z-sections for each X–Y pixel and binned them according to the pixel intensities. Then, the mean variance was calculated within each bin and, as a result, the dependency of mean variance upon the intensities was found (Figure 1—figure supplement 2G). This dependency was found to be linear, as expected for a Poisson noise model:

V(I)=α2N=α(I-β)

where V(I) is the variance for each intensity level I.

Moreover, when thick 3D tissue samples are imaged, it is required to use different laser intensity and microscope gain. This results in an increase of the intensity scaling factor α with the image depth. Therefore, we calculated the Poisson noise model for different image depths (z-direction) and then, we used α and β to estimate the variance for every pixel.

After that, we estimated the background intensity of every pixel. Briefly, for each pixel a set of sequential intensities in z-direction was extracted (Figure 1—figure supplement 2H, left). Then, the intensities were fitted by a straight line using the outlier-tolerant algorithm described in (Sivia, 1996) (Figure 1—figure supplement 2H, right). The prediction of the straight line was considered as the background intensity, and the difference between the measured intensity and background was considered as candidate foreground intensity. The candidate foreground intensities below a defined threshold (expressed in variance units) were excluded. Finally, the background was added to the foreground to form the de-noised image.

To evaluate the performance of our algorithm, we applied it to a set of three artificial images of BC from our benchmark (2:1 signal-to-noise ratio). Additionally, we applied other methods such as median filtering, Gauss low-pass filtering and anisotropic diffusion, ‘pure denoise’ (PD) (Luisier et al., 2010) and ‘edge preserving de-noising and smoothing’ (EPDS) (Beck and Teboulle, 2009) for comparison. The performance of each method was quantitatively evaluated using the metrics mean square error (MSE) and coefficient of correlation (CoC), defined as follows:

MSE=iΩ(Ii-Ii*)2|Ω|
CoC=iΩ(Ii-I)·(Ii*-I*)(iΩ(Ii-I)2·iΩ(Ii*-I*)2)1/2

where Ω is the region of interest in the image, Ii and Ii* are the intensities at voxel i of the de-noised and noise-free (ground truth) images respectively, I and I* are the mean intensities of the de-noised and noise-free images, respectively. We calculated the MSE and CoC over the whole images (global) as well as in the vicinity of the objects (Figure 1—figure supplement 3A). For PD and EPDS, we selected the best parameters for their performance before the comparison (Figure 1—figure supplement 3B,C). The results of our quantifications are shown in Figure 1—figure supplement 45.

Methods for the reconstruction of 3D multi-scale images

Reconstruction of physical sections

To image large and complex tissue structures such as the liver lobule, we generated a grid of partially overlapping low-resolution 3D images (stacks) for each individual tissue section. We applied an image mosaicking procedure to merge the stacks into a single 3D image of the section (Figure 2A and Figure 2—figure supplement 1A). Our merging procedure adopts a standard approach to maximize the sum of cross-correlations calculated for pairs of neighbouring tiles in the grid. The input data set for the reconstruction of physical sections was composed of N-by-M grids of partially overlapping 3D images (Z-stacks) (Figure 2—figure supplement 1A). It is assumed that an approximation of their overlapping area is known and that transitional image registration is sufficient for reconstruction purposes.

Let (Zx,y'Zx',y') be a pair of neighbour images located within the grid (0 ≤ < N, 0 ≤ < M, 0 ≤ x′ < N, 0 ≤ y′ < M, |xx′| = 1 ⋎ |yy′| = 1), and Cx,y,x′,y′(i,j,k) the cross-correlation of their overlapping areas. The quality of their local alignment for a given shift (i,j,k) is measured by the corresponding value of the cross-correlation Cx,y,x′,y′(i,j,k). The goal of the reconstruction is to find a set of shifts (i,j,k) (one for each image) that maximizes the global metric:

G(i,j,k)=x=0Ny=0M(x',y')x+1,y,x,y+1,x+1,y+1x'0,Nλy'0,MCx,y,x',y'(ix,y,jx,y,kx,y)

To solve this maximization problem, we used the optimization technique proposed in (Griffiths et al., 1999), which allowed finding the appropriate shifts with high accuracy (Figure 2—figure supplement 1B). All input 3D images were shifted according to the optimization results and registered using the multi-band blending approach (Burt and Adelson, 1983; Brown and Lowe, 2003).

Bayesian algorithm for the detection of the surface of tissue sections

Most publicly available 3D image stitching methods were developed for EM data, where the samples are first embedded in resin or deep-frozen, which makes them solid and prevents partial removal of tissue by cutting. Therefore, they are based on local correlation of the images (Saalfeld et al., 2012; Hayworth et al., 2015). In the case of soft tissues, the removal of tissue upon cutting is much more significant, leading to a lack of texture correlations between two adjacent sections. The sample preparation process introduces several mechanical artefacts to the imaged sample, including uneven thickness of the section and tissue bending. When large vessels are aligned along the section surface, it becomes difficult to determine whether the empty space corresponds to the interior of the vessel or section damages or bending, which constitutes a major obstacle in their segmentation (Figure 2—figure supplement 1C). To address this issue, we propose a surface detection method, which uses prior distributions of expected section shape to find the border between the volume of the image of the sample (including blood vessels) and the out-of-field region.

Our approach is based on Bayesian statistics. According to the Bayes theorem:

p(y1,y2|ym1,ym2)=p(ym1,ym2|y1,y2)p(y1,y2)p(ym1,ym2)

Using the chain rule to obtain the joint probability distribution p(y1,y2), we got:

p(y1,y2|ym1,ym2)p(ym1,ym2|y1,y2)p(y1|y2)p(y1)

The empirical analysis of several tissue sections with manually specified surfaces allowed us to estimate the probabilities (ym1,ym2|y1,y2), p(y1|y2) and p(y1) :

p(ym1,ym2|y1,y2)=x,y1πs1+y1,x,y-ym1,x,ys21πs1+y2,x,y-ym2,x,ys2
p(y1|y2)=x,y12πσexp(y2,x,y-y1,x,y)22σ2
p(y1)=x,yεx[-1,1] εy[-1,1]λexp(-λ|y1,x+εx,y+εx-y1,x,y|)

Where s is a parameter that specifies how close the real surface is to the measured one, σ describes the variability of the section thickness, λ specifies the smoothness of the real surface and (x,y) are the coordinates of the real surface nodes.

By analysing our benchmark data set, we found that the median absolute deviation (tMAD) of the section thickness |ym2 -− ym1| constituted a good approximation for the parameters and σ. The parameter λ was found by the maximum likelihood estimation of the empirical distribution measured from the maximum entropy segmentation. Then, the final posterior probability for surface detection has the following form: 

p(ym1,ym2|y1,y2)x,y1π2tMAD1+y1,x,y-ym1,x,yπ2tMAD21π2tMAD1+y2,x,y-ym2,x,yπ2tMAD2
×x,y12ππ2tMADexpy2,x,y-y1,x,y22π2tMAD2
×x,yεx[-1,1]εy[-1,1]λMLexp(-λML|y1,x+εx,y+εx-y1,x,y|)

To check whether the surface energy model of this equation can be applied to different images, we created a benchmark data set composed of 10 section images with manually segmented surfaces. The model distributions p(ym1,ym2|y1,y2), p(y1|y2) and p(y1) closely matched with the corresponding empirical distributions calculated from the manual detection (Figure 2—figure supplement 1D–F).

The proposed model was used for the automated surface detection by minimizing the posterior p(y1,y2|ym1,ym2) probability . This minimization was performed using iterative conditional modes. The surfaces calculated by the maximum entropy approach were used as initial guess. To evaluate the quality of the automatically detected surfaces, we created a benchmark data set composed of 30 sections collected from three tissue samples. The average displacement between the manual and the automatic segmentation was 4.53 ± 1.12 voxels (Figure 2—figure supplement 1G,H).

Segmentation of tissue-level networks

The goal of the segmentation of tissue-level networks is to identify the volume of a sample, which is occupied by large vessels such as CV, PV, hepatic artery or bile ducts. These structures appear in the images as empty volume (Figure 2—figure supplement 2A); therefore, their segmentation is possible without using a specific staining.

The direct application of thresholding methods like maximum entropy (Kapur et al., 1985) is troublesome due to several obstacles that arise from sample preparation artefacts. First, mechanical distortions such as uneven cutting of the section or tissue bending during imaging are introduced in the imaged sample. Since large vessels are not stained, it is impossible to distinguish them from out-of-field region using only the voxels intensities. Second, image intensities vary spatially within the sample due to uneven staining. In consequence, a global threshold underestimates the size of vessels in the bright regions of the image and overestimates it in the dark ones. To address these problems,we introduced two pre-processing steps. At first, we used the detected surfaces of the section to discriminate the parts of the image belonging to the sample from the ones in the out-of-field region. Subsequently, the 3D images (excluding the out-of-field region) were split into regular grids of overlapping sub-regions and the maximum entropy threshold was calculated for each of them. After that, the threshold values were interpolated over the entire image using tri-linear interpolation (Figure 2—figure supplement 2B). Finally, the vessels were segmented using the calculated threshold values (Figure 2—figure supplement 2C).

Multi-resolution image positioning

Multi-resolution image positioning involves the rigid-body registration of a high-resolution 3D image (moving image) within the reconstructed low-resolution image of a section (fixed image). Since individual images have sizes up to 500 Mpx, we performed the image registration in the scaled-space using a stepwise approach.

We built a three-level scale pyramid using the original images and their copies scaled by factors of 0.50 and 0.25. The last level of the pyramid was used to find an initial approximation for the rigid-body registration, which was performed by rotating the moving image with respect to the fixed image. The rotation (r) with the highest value of cross-correlation was used as initial guess for further alignment.

Then, a registration based on polar transformations (Wolberg and Zokai, 2000) was performed. First, the relative shift between two images was found by the peak of their NCC, the images were shifted accordingly and its overlapping part was cropped. Second, the cropped images were transformed to polar coordinates (where a shift is equivalent to a rotation in the Cartesian coordinate system) and their NCC was calculated. The updated angle r was extracted from the peak of the cross-correlation of the transformed image. Note that the initial estimation of r (±15°) found in the initial step is required for the convergence of the polar registration. The polar registration procedure was repeated subsequently using the images stored in the second and first level of scale pyramid, which results in the increase of the registration accuracy and computational time in each iteration of the algorithm. Also, 2–3 iterations were sufficient to achieve full convergence and register images with subcellular accuracy (Figure 2—figure supplement 2D–F).

Methods for 3D image segmentation

Nuclei splitting algorithm

In order to split artificially clustered structures, either the volumetric data from the segmented image or the triangle meshes of the reconstructed objects can be used (Bilgin et al., 2013). We used the information of the triangle meshes in a probabilistic algorithm, which first learns from the error distribution for the nuclei approximation by single and double ellipsoids. Based on the extracted statistics, the algorithm identifies and splits multi-nuclear structures. Further, we will refer to both the mono-, bi- and multi-nucleated structures as 3D objects.

First, all 3D objects were approximated by single and double overlapping ellipsoids. The first model corresponds to the minimum volume ellipsoid (MVE) that encloses the vertexes of the triangle mesh (Figure 3—figure supplement 1D). For the second model, the triangle mesh was symmetrically split in two subsets and each subset was approximated by an MVE (Figure 3—figure supplement 1E). Both models were evaluated on the data (vertexes) by using mean square error (MSE):

MSE=1n-9i=1n((pi-c)TE(pi-c)-1)2

where n is the number of vertexes, pi is the coordinates vector of the vertex i, c is the centre of the ellipsoid and is the matrix describing the orientation and dimensions of the ellipsoid. The model with the lowest MSE was selected as the best model for the 3D object.

Second, the error distribution (from the best models) resulting from the first step was analysed as follows: the natural logarithm of each MSE value was computed and the resulting histogram was fitted with a sum of two Gaussian distributions (Figure 3—figure supplement 1F). The two distributions were split by a threshold value, which was chosen such that it corresponded to the upper limit of the 95% confidence interval of the first component (the one with lowest mean value) (Figure 3—figure supplement 1G). The objects whose In(MSE) is smaller than the threshold corresponds either to one nucleus or two overlapping nuclei, and the rest corresponds to multi-nuclear structures. The 3D objects recognized as two overlapping ellipsoids were reconstructed using the models as boundaries to split the initially segmented images.

The multi-nuclear objects were split following two steps: first, the nuclei seeds were detected as proposed in (Stegmaier et al., 2014) and then the real shape of the nuclei was found by an active mesh expansion from the seeds. The nuclei seeds were extracted from the Laplacian of Gaussian scale-space maximum intensity projection (LoGMP) image (Stegmaier et al., 2014):

LoGMP(x,σmin,σmax)=maxσminσσmaxLoG(x,σ)

where LoG(x,σ) represents the Laplacian of Gaussian filtered image found using a standard deviation σ. Considering that the radius (r) of the objects to be detected is given by r=√2σ (Al-Kofahi et al., 2010), σmin and σmax are determined by a priori knowledge of the typical size of the nuclei we want to detect. Each local maximum in the LoGMP image corresponds to a nuclei seed. Then, we used an active mesh expansion from the seeds to the real shape of the nuclei. The expansion was either limited to the nuclei border (regions of maximum intensity at the complement image of the LoGMP) or to the contact with neighbouring nuclei (Figure 3—figure supplement 1H –J).

Methods for cell classification

Feature extraction

For each nucleus, a profile of 74 parameters was calculated (Table 1). We used the information of the triangle mesh of the reconstructed nucleus as well as the information of the DAPI, Flk1 and phalloidin channels. All channel intensities were normalized using histogram equalization before the parameter extraction. The parameters include:

  • Nuclear geometrical properties: volume (V), surface area (A), all possible ratios between the lengths of the semi-principal axis (a,b,c) of the MVE, sphericity (ε=π1/3(6V)2/3A), mean and variance values of nucleus radius, shape index (Levitt et al., 2004) and curvature variation measure (Sukumar et al., 2005).

  • DAPI and Flk1 intensity-based features:mean, standard deviation, skewness and kurtosis values of the intensity inside the nucleus.

  • Haralick texture features (Haralick et al., 1973): The intensity of DAPI inside the nucleus was used. Thirteen statistical features were extracted from the normalized grey-level co-occurrence matrix, which was calculated from 65 independent co-occurrence matrices (considering all possible 13 directions in 3D and 5 different distances from 1 to 5 pixels). All co-occurrence matrices were calculated using 256 grey levels.

  • Box-counting (BC) (Lopes and Betrouni, 2009) and Minkowski–Bouligand (MB) (Einstein et al., 1998) fractal dimensions: in both cases, the intensity of DAPI inside the nucleus was used. Integer values from 1 to 5 pixels were used as box length and radius values for the respective calculations. For theBC, the gliding box method was applied.

  • Mean-weighted lacunarity (Einstein et al., 1998): it was calculated for the intensity of DAPI inside the nucleus using box lengths from 1 to 5 (lacunarity1, lacunarity2, etc.). Additionally, the values of the normalized lacunarity (NormLac2 = lacunarity2/ lacunarity1, etc.), and the natural logarithms of lacunarity (LogLac1, LogLac2, etc.), and normalized lacunarity (LogNormLac2, etc.) were extracted.

  • DAPI mean surface intensity gradient: The surface gradient of DAPI signal was calculated at the centre of each triangle of the mesh. The mean value was calculated using a weighted average (using the area of the triangles as weights).

  • Phalloidin and Flk1 intensity at different distances of the nucleus surface: the mean signal intensity (phalloidin or Flk1) at different distance (0 to 10 voxels) from the triangle mesh was calculated.

Feature selection for the LDA

In order to get the most relevant parameter for the LDA classifier, we used the Fisher score and one-leave-out cross-validation as measure of the classifier accuracy. Firstly, the Fisher scores (Fi) was calculated for each parameter i as follows:

Fi=k=1mnk(uki-ui)2k=1mnk(σki)2

where m is the number of classes, nk is the size of the kth class uki and σki are the mean values and the standard deviation of the parameter i for the kth class ui is the mean value of the parameter i over the whole sample.

The parameters were sorted based on Fi (Table 1) and systematically added to the classification while the accuracy of the algorithm was calculated, i.e., the first parameter from the sorted vector was taken, the classification was performed and the accuracy was calculated, then the second parameter was added and the process was repeated. Figure 3—figure supplement 2B shows how the classifier accuracy depends on the number of parameters used in the classification. For further analysis, only the set of parameters that yielded the highest accuracy was used.

The LDA was performed in three independent steps. Each corresponds to a two-class classification. First, hepatocytes were classified from other nuclei, then SECs were classified from the remaining nuclei and, finally, the rest of the nuclei were classified either into Kupffer or stellate cells.

Cell classification by Bayesian network

The training set was presented as a vector of 75 parameters. The first one corresponded to the cell type and the following 74 were the measured nucleus features. Each parameter was discretized into 5 bins with equal population. Then, we calculated the mutual information MI between every parameter and the cell type parameter as

MI(X,Y)=x,yP(x,y)lnP(x,y)P(x)P(y)

where X and Y denote sets of parameters, x and y denote instances of parameters. The probabilities were calculated from the training set as

P(x)=nx+1xnx+r

where ndenotes the number of instances in the bin and r is the number of bins (in our case r = 5 for all parameters but the first one). Then the parameters were sorted in descent order according to the mutual information. The structure of Bayesian network was learned from the training data by the K2 algorithm (Heckerman et al., 1995) (Figure 3—figure supplement 2C). For each nucleus, the probability for each cell type was calculated. The type with the highest probability was taken as classification output.

Validation of the resulting model

Benchmark for the evaluation of 3D reconstructions of dense tissue

We generated a set of artificial images of liver tissue that can be used for developing and evaluating methods for the reconstruction of geometrical models of dense tissue. The benchmark consists of a set of realistic 3D high-resolution images (0.3 μm × 0.3 μm × 0.3 μm per voxel) of normal liver tissue. To generate artificial images that emulate the complexity of the real tissue images as well as exhibit meaningful biological characteristics, we extracted data from real images to produce idealized ground truth images of the main structures forming the tissue, that is, nuclei, sinusoids, BC and cell borders. Then, distortions coming from different sources such as uneven staining, optical distortion due to the PSF of the confocal microscope and spatially variation of Poisson noise were added to the idealized ground truth images (Figure 3—figure supplement 5).

The ground truth images were generated as follows: (1) the initial outlines were extracted from three real 3D images: central lines of the tubular networks (e.g. BC and sinusoids), position of the nuclei centres and cell borders; (2) idealized structures were built on top of the outlines: solid tubes with a constant radius of ~0.5 µm for the BC networks, hollow tubes with constant internal (~2.5 µm) and external (~3.0 µm) radius for the sinusoidal networks, solid spheres with radius between ~3.5 and ~5.5 µm for the nuclei and solid border of ~0.5 µm width for the cells.

Next, the uneven staining was simulated by applying random intensities at different scale levels. Briefly, first a 6 × 6 × 6 binning was applied to a black image and an intensity value extracted from a log-normal distribution with mean 1000 a.u. and standard deviation 0.5 was assigned to each binned voxel. Next, the image was unbinned and the new intensity values of each pixel were extracted from a log-normal distribution with mean equal to the original value and standard deviation 0.2. Finally, the uneven stained image was obtained by applying a mask (ground truth) to the generated one. Additionally, a homogeneous background (10:1, 4:1 and 2:1 signal-to-noise ratios) was added to the images (Figure 3—figure supplement 5A,B).

In thick samples far from the coverslip, the acquired images are highly distorted by the illumination PSF, leading to an asymmetric smearing of the image in z-direction (Nasse et al., 2007; Nasse and Woehl, 2010). We convolved the uneven stained images with realist PSFs (Figure 3—figure supplement 5C,D). The PSFs were generated using different excitations wavelengths for each structure: 568, 647, 780 and 488 nm for BC, sinusoids, nuclei and cell borders, respectively. Finally, we added Poisson noise with different scaling factors according to the models extracted from the real data (Figure 3—figure supplement 5E–G). An example of the resulting images is shown in Figure 3—figure supplement 6.

Internal consistency of the data extracted from sinusoidal network reconstruction

In order to check the internal consistency of the morphometric features that we extracted from the reconstructed sinusoidal networks, we independently calculated the fraction of volume of the sinusoids (VS), the length of the sinusoidal network per volume unit (LS) and the average radius of the network (rs). Then, we estimated the fraction of volume of sinusoids (VC) using Land rs, and approximating the tubular network by a cylindrical network. We found that Vc⁄Vs = 0.99 ± 0.09, showing the internal consistency of our data. When applying the same calculation to the data reported in (Hammad et al., 2014), we found Vc⁄Vs = 2.55, which suggests an over-estimation of the network parameters (e.g. number of intersection nodes per mm3, network length per mm3); see Table 2.

Table 2.

Internal consistency of the sinusoidal network data.

DOI: http://dx.doi.org/10.7554/eLife.11214.033

Sample Vs Ls/(mm/mm3) rs/(mm × 103)  Vc ∼ π × rs2 × Ls  Vc/Vs
1 0.16 2853.4 4.05 0.15 0.92
2 0.14 2976.4 3.75 0.13 0.95
3 0.20 3505.8 4.50 0.22 1.09
Hammad et al., 2014 0.15 5400.0 4.80 0.39 2.55

Notes: The fraction of volume of the sinusoids (Vs), the length of the sinusoidal network per volume unit (Ls) and the average radius of the network (rs) were measured independently for each sample. A theoretical approximation of the fraction of volume of the sinusoids (Vc), considering it consists of ideal cylinders, was calculated (Vc ∼ π × rs2 × Ls). Then, the ratio between the measured and the calculated fractions of volume (Vc/Vs) was calculated. Values close to 1.0 reflect auto consistency on the data. We performed the same calculation with the data reported in Hammad et al. (2014).

Quantitative analysis of liver tissue architecture

DAPI integral intensity calculation

For each nucleus, the total content of DNA was calculated as the integral intensity of the original DAPI image inside the corresponding 3D triangle mesh. Since calculation was performed for three independent samples, the integral intensity per nucleus was normalized to the intensity of first one. Briefly, the distribution of DAPI integral intensity per nucleus was independently calculated for each sample (Figure 4—figure supplement 2). Then, each distribution was aligned (stretched) to the reference one (the first one in our case) by minimizing the functional:

dj=i(f0(xi0))2-i(f0(xi0)·fj(s·xi1))i(fj(s*xi1))2

where ∑i is the sum over the bins of the distributions, f0(xi0) is the height of the i bin of the reference curve, fj(xij) is the height of the i bin of the j curve to be aligned and s is the scaling (stretching) factor.

We found scaling factors 1.19 and 0.93 for the second and third samples respectively. Finally, the DAPI integral intensity of each nucleus was recalculated using the corresponding scaling factor.

Acknowledgements

The authors acknowledge I. Sbalzarini, P. Tomancak and F. Jug (MPI-CBG) for comments on the manuscript. They also thank W. John and A. Muench-Wuttke from the Biomedical Services Facility for mouse care. Thanks also to J. Peychl for the management of the Light Microscopy Facility. This work was financially supported by the Virtual Liver initiative (http://www.virtual-liver.de), funded by the German Federal Ministry of Research and Education (BMBF), the Max Planck Society (MPG) and the DFG.

Funding Statement

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Funding Information

This paper was supported by the following grants:

  • Bundesministerium für Bildung und Forschung to Piotr Klukowski, Kirstin Meyer, Hidenori Nonaka, Giovanni Marsico.

  • Max-Planck-Gesellschaft to Mikhail Chernykh, Alexander Kalaidzidis, Marino Zerial, Yannis Kalaidzidis.

  • Deutsche Forschungsgemeinschaft to Kirstin Meyer.

Additional information

Competing interests

The authors declare that no competing interests exist.

Author contributions

HM-N, Developed the set of algorithms and statistics for cell classification, Developed the set of algorithms to create synthetic images, developed the network analysis statistics, Implemented the new and existing algorithms into a single platform, Conception and design, Analysis and interpretation of data, Drafting or revising the article.

FS-M, Acquisition of data, Analysis and interpretation of data.

PK, Developed the algorithm for the section surface detection, Analysis and interpretation of data, Drafting or revising the article.

KM, Acquisition of data, Analysis and interpretation of data.

HN, Acquisition of data, Analysis and interpretation of data.

GM, Implemented the new and existing algorithms into a single platform, Analysis and interpretation of data.

MC, Implemented the new and existing algorithms into a single platform, Analysis and interpretation of data.

AK, Transferred CPU implementation of the algorithms to GPU, Analysis and interpretation of data.

MZ, Acquisition of data, Analysis and interpretation of data.

YK, Conceived and directed the project, developed the de-noising algorithm, supervise the implemented the new and existing algorithms into a single platform, Conception and design, Acquisition of data, Drafting or revising the article.

Ethics

Animal experimentation: All animal studies were conducted in accordance with German animal welfare legislation and in strict pathogen-free conditions in the animal facility of the Max Planck Institute of Molecular Cell Biology and Genetics, Dresden, Germany. Protocols were approved by the Institutional Animal Welfare Officer (Tierschutzbeauftragter) and all necessary licenses were obtained from the regional Ethical Commission for Animal Experimentation of Dresden, Germany (Tierversuchskommission, Landesdirektion Dresden)(License number: AZ 24-9168.24-9/2012-1, AZ 24-9168.11-9/2012-3).

Additional files

Supplementary file 1. 3D ‘ground truth’ voxelated model of liver tissue (0.3 μm × 0.3 μm × 0.3 μm per voxel).

DOI: http://dx.doi.org/10.7554/eLife.11214.034

elife-11214-supp1.zip (5.9MB, zip)
DOI: 10.7554/eLife.11214.034

Major datasets

The following datasets were generated:

Morales-Navarrete H, Segovia-Miranda F, Klukowski P, Meyer K, Nonaka H, Marsico G, Chernykh M, Kalaidzidis A, Zerial M, Kalaidzidis Y,2016,A versatile pipeline for the multi-scale digital reconstruction and quantitative analysis of 3D tissue architecture,http://dx.doi.org/10.5061/dryad.m67r6,Available at Dryad Digital Repository under a CC0 Public Domain Dedication

References

  1. Al-Kofahi Y, Lassoued W, Lee W, Roysam B. Improved automatic detection and segmentation of cell nuclei in histopathology images. IEEE Transactions on Bio-Medical Engineering. 2010;57:841–852. doi: 10.1109/TBME.2009.2035102. [DOI] [PubMed] [Google Scholar]
  2. Amat F, Lemon W, Mossing DP, McDole K, Wan Y, Branson K, Myers EW, Keller PJ. Fast, accurate reconstruction of cell lineages from large-scale fluorescence microscopy data. Nature Methods. 2014;11:951–958. doi: 10.1038/nmeth.3036. [DOI] [PubMed] [Google Scholar]
  3. Asahina K, Shiokawa M, Ueki T, Yamasaki C, Aratani A, Tateno C, Yoshizato K. Multiplicative mononuclear small hepatocytes in adult rat liver: their isolation as a homogeneous population and localization to periportal zone. Biochemical and Biophysical Research Communications. 2006;342:1160–1167. doi: 10.1016/j.bbrc.2006.02.076. [DOI] [PubMed] [Google Scholar]
  4. Baratta JL, Ngo A, Lopez B, Kasabwalla N, Longmuir KJ, Robertson RT. Cellular organization of normal mouse liver: a histological, quantitative immunocytochemical, and fine structural analysis. Histochemistry and Cell Biology. 2009;131:713–726. doi: 10.1007/s00418-009-0577-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Barbier de Reuille P, Routier-Kierzkowska AL, Kierzkowski D, Bassel GW, Schüpbach T, Tauriello G, Bajpai N, Strauss S, Weber A, Kiss A, Burian A, Hofhuis H, Sapala A, Lipowczan M, Heimlicher MB, Robinson S, Bayer EM, Basler K, Koumoutsakos P, Roeder AH, Aegerter-Wilmsen T, Nakayama N, Tsiantis M, Hay A, Kwiatkowska D, Xenarios I, Kuhlemeier C, Smith RS. MorphoGraphX: a platform for quantifying morphogenesis in 4D. eLife. 2015;4 doi: 10.7554/eLife.05864. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Beck A, Teboulle M. Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Transactions on Image Processing : A Publication of the IEEE Signal Processing Society. 2009;18:2419–2434. doi: 10.1109/TIP.2009.2028250. [DOI] [PubMed] [Google Scholar]
  7. Bilgin CC, Kim S, Leung E, Chang H, Parvin B. Integrated profiling of three dimensional cell culture models and 3D microscopy. Bioinformatics. 2013;29:3087–3093. doi: 10.1093/bioinformatics/btt535. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bock M, Tyagi AK, Kreft JU, Alt W. Generalized voronoi tessellation as a model of two-dimensional cell tissue dynamics. Bulletin of Mathematical Biology. 2010;72:1696–1731. doi: 10.1007/s11538-009-9498-3. [DOI] [PubMed] [Google Scholar]
  9. Boehm B, Westerberg H, Lesnicar-Pucko G, Raja S, Rautschka M, Cotterell J, Swoger J, Sharpe J. The role of spatially controlled cell proliferation in limb bud morphogenesis. PLoS Biology. 2010;8:e11214. doi: 10.1371/journal.pbio.1000420. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Bouwens L, De Bleser P, Vanderkerken K, Geerts B, Wisse E. Liver cell heterogeneity: functions of non-parenchymal cells. Enzyme. 1992;46:155–168. doi: 10.1159/000468782. [DOI] [PubMed] [Google Scholar]
  11. Bria A, Iannello G. TeraStitcher - a tool for fast automatic 3D-stitching of teravoxel-sized microscopy images. BMC Bioinformatics. 2012;13 doi: 10.1186/1471-2105-13-316. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Brink AD. Using spatial information as an aid to maximum entropy image threshold selection. Pattern Recognition Letters. 1996;17:29–36. doi: 10.1016/0167-8655(95)00096-8. [DOI] [Google Scholar]
  13. Brown M, Lowe DG. Recognising panoramas. Ninth Ieee International Conference on Computer Vision, Vols I and Ii. 2003:1218–1225. [Google Scholar]
  14. Burt PJ, Adelson EH. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics. 1983;2:217–236. doi: 10.1145/245.247. [DOI] [Google Scholar]
  15. Burton GJ, Ingram SC, Palmer ME. The influence of mode of fixation on morphometrical data derived from terminal villi in the human placenta at term: a comparison of immersion and perfusion fixation. Placenta. 1987;8:37–51. doi: 10.1016/0143-4004(87)90038-5. [DOI] [PubMed] [Google Scholar]
  16. Chittajallu DR, Florian S, Kohler RH, Iwamoto Y, Orth JD, Weissleder R, Danuser G, Mitchison TJ. In vivo cell-cycle profiling in xenograft tumors by quantitative intravital microscopy. Nature Methods. 2015;12:577–585. doi: 10.1038/nmeth.3363. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Chung K, Deisseroth K. CLARITY for mapping the nervous system. Nature Methods. 2013;10:508–513. doi: 10.1038/nmeth.2481. [DOI] [PubMed] [Google Scholar]
  18. Coleman AW, Maguire MJ, Coleman JR. Mithramycin- and 4'-6-diamidino-2-phenylindole (dAPI)-DNA staining for fluorescence microspectrophotometric measurement of DNA in nuclei, plastids, and virus particles. Journal of Histochemistry & Cytochemistry. 1981;29:959–968. doi: 10.1177/29.8.6168681. [DOI] [PubMed] [Google Scholar]
  19. Collins T. ImageJ for microscopy. BioTechniques. 2007;43:S25–S30. doi: 10.2144/000112517. [DOI] [PubMed] [Google Scholar]
  20. de Chaumont F, Dallongeville S, Chenouard N, Hervé N, Pop S, Provoost T, Meas-Yedid V, Pankajakshan P, Lecomte T, Le Montagner Y, Lagache T, Dufour A, Olivo-Marin JC. Icy: an open bioimage informatics platform for extended reproducible research. Nature Methods. 2012;9:690–696. doi: 10.1038/nmeth.2075. [DOI] [PubMed] [Google Scholar]
  21. Dima AA, Elliott JT, Filliben JJ, Halter M, Peskin A, Bernal J, Kociolek M, Brady MC, Tang HC, Plant AL. Comparison of segmentation algorithms for fluorescence microscopy images of cells. Cytometry Part A. 2011;79A:545–559. doi: 10.1002/cyto.a.21079. [DOI] [PubMed] [Google Scholar]
  22. Dmitrieva NI, Cui K, Kitchaev DA, Zhao K, Burg MB. DNA double-strand breaks induced by high NaCl occur predominantly in gene deserts. Proceedings of the National Academy of Sciences of the United States of America. 2011;108:20796–20801. doi: 10.1073/pnas.1114677108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Duda R, Hart P, Stork D. Pattern Classification. New York: John Wiley & Sons; 2001. [Google Scholar]
  24. Einstein AJ, Wu H-S, Sanchez M, Gil J. Fractal characterization of chromatin appearance for diagnosis in breast cytology. The Journal of Pathology. 1998;185:366–381. doi: 10.1002/(SICI)1096-9896(199808)185:4&#x0003c;366::AID-PATH122&#x0003e;3.0.CO;2-C. [DOI] [PubMed] [Google Scholar]
  25. Emmenlauer M, Ronneberger O, Ponti A, Schwarb P, Griffa A, Filippi A, Nitschke R, Driever W, Burkhardt H. XuvTools: free, fast and reliable stitching of large 3D datasets. Journal of Microscopy. 2009;233:42–60. doi: 10.1111/j.1365-2818.2008.03094.x. [DOI] [PubMed] [Google Scholar]
  26. Faggioli F, Vezzoni P, Montagna C. Single-cell analysis of ploidy and centrosomes underscores the peculiarity of normal hepatocytes. PloS One. 2011;6:e11214. doi: 10.1371/journal.pone.0026080. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Fisher RA. The use of multiple measurements in taxonomic problems. Annals of Eugenics. 1936;7:179–188. doi: 10.1111/j.1469-1809.1936.tb02137.x. [DOI] [Google Scholar]
  28. Fonseca CG, Backhaus M, Bluemke DA, Britten RD, Chung JD, Cowan BR, Dinov ID, Finn JP, Hunter PJ, Kadish AH, Lee DC, Lima JA, Medrano-Gracia P, Shivkumar K, Suinesiaputra A, Tao W, Young AA. The cardiac atlas project--an imaging database for computational modeling and statistical atlases of the heart. Bioinformatics. 2011;27:2288–2295. doi: 10.1093/bioinformatics/btr360. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Font-Burgada J, Shalapour S, Ramaswamy S, Hsueh B, Rossell D, Umemura A, Taniguchi K, Nakagawa H, Valasek MA, Ye L, Kopp JL, Sander M, Carter H, Deisseroth K, Verma IM, Karin M. Hybrid periportal hepatocytes regenerate the injured liver without giving rise to cancer. Cell. 2015;162:766–779. doi: 10.1016/j.cell.2015.07.026. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Friebel A, Neitsch J, Johann T, Hammad S, Hengstler JG, Drasdo D, Hoehme S. TiQuant: software for tissue analysis, quantification and surface reconstruction. Bioinformatics. 2015;31 doi: 10.1093/bioinformatics/btv346. [DOI] [PubMed] [Google Scholar]
  31. Friedman N, Geiger D, Goldszmidt M. Bayesian network classifiers. Machine Learning. 1997;29:131–163. doi: 10.1023/A:1007465528199. [DOI] [Google Scholar]
  32. Friedman N, Nachman I, Peer D. Learning bayesian network structure from massive datasets: the "sparse candidate" algorithm. Uncertainty in Artificial Intelligence, Proceedings. 1999:206–215. [Google Scholar]
  33. Gage GJ, Kipke DR, Shain W. Whole animal perfusion fixation for rodents. Journal of Visualized Experiments. 2012 doi: 10.3791/3564. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Gandillet A, Alexandre E, Holl V, Royer C, Bischoff P, Cinqualbre J, Wolf P, Jaeck D, Richert L. Hepatocyte ploidy in normal young rat. Comparative Biochemistry and Physiology. Part A, Molecular & Integrative Physiology. 2003;134:665–673. doi: 10.1016/s1095-6433(02)00374-4. [DOI] [PubMed] [Google Scholar]
  35. Gentric G, Desdouets C. Polyploidization in liver tissue. The American Journal of Pathology. 2014;184:322–331. doi: 10.1016/j.ajpath.2013.06.035. [DOI] [PubMed] [Google Scholar]
  36. Girish V, Vijayalakshmi A. Affordable image analysis using NIH Image/ImageJ. Indian Journal of Cancer. 2004;41 [PubMed] [Google Scholar]
  37. Griffiths TR, Nerukh DA, Eremenko SA. The application of theoretical models of complex shape to the fitting of experimental spectra having closely overlapping bands. Physical Chemistry Chemical Physics. 1999;1:3199–3208. doi: 10.1039/a902569c. [DOI] [Google Scholar]
  38. Guidotti JE, Brégerie O, Robert A, Debey P, Brechot C, Desdouets C. Liver cell polyploidization: a pivotal role for binuclear hepatocytes. The Journal of Biological Chemistry. 2003;278:19095–19101. doi: 10.1074/jbc.M300982200. [DOI] [PubMed] [Google Scholar]
  39. Hammad S, Hoehme S, Friebel A, von Recklinghausen I, Othman A, Begher-Tibbe B, Reif R, Godoy P, Johann T, Vartak A, Golka K, Bucur PO, Vibert E, Marchan R, Christ B, Dooley S, Meyer C, Ilkavets I, Dahmen U, Dirsch O, Böttger J, Gebhardt R, Drasdo D, Hengstler JG. Protocols for staining of bile canalicular and sinusoidal networks of human, mouse and pig livers, three-dimensional reconstruction and quantification of tissue microarchitecture by image processing and analysis. Archives of Toxicology. 2014;88:1161–1183. doi: 10.1007/s00204-014-1243-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Haralick RM, Shanmugam K, Dinstein Its'Hak. Textural features for image classification. IEEE Transactions on Systems, Man, and Cybernetics. 1973;3:610–621. doi: 10.1109/TSMC.1973.4309314. [DOI] [Google Scholar]
  41. Hardman RC, Volz DC, Kullman SW, Hinton DE. An in vivo look at vertebrate liver architecture: three-dimensional reconstructions from medaka (oryzias latipes) Anatomical Record. 2007;290:770–782. doi: 10.1002/ar.20524. [DOI] [PubMed] [Google Scholar]
  42. Hayworth KJ, Xu CS, Lu Z, Knott GW, Fetter RD, Tapia JC, Lichtman JW, Hess HF. Ultrastructurally smooth thick partitioning and volume stitching for large-scale connectomics. Nature Methods. 2015;12 doi: 10.1038/nmeth.3292. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Heckerman D, Geiger D, Chickering DM. Learning bayesian networks: the combination of knowledge and statistical data. Machine Learning. 1995;20:197–243. doi: 10.1007/BF00994016. [DOI] [Google Scholar]
  44. Hoehme S, Brulport M, Bauer A, Bedawy E, Schormann W, Hermes M, Puppe V, Gebhardt R, Zellmer S, Schwarz M, Bockamp E, Timmel T, Hengstler JG, Drasdo D. Prediction and validation of cell alignment along microvessels as order principle to restore tissue architecture in liver regeneration. Proceedings of the National Academy of Sciences of the United States of America. 2010;107:10371–10376. doi: 10.1073/pnas.0909374107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Huisman A, Ploeger LS, Dullens HF, Jonges TN, Belien JA, Meijer GA, Poulin N, Grizzle WE, van Diest PJ. Discrimination between benign and malignant prostate tissue using chromatin texture analysis in 3-d by confocal laser scanning microscopy. The Prostate. 2007;67:248–254. doi: 10.1002/pros.20507. [DOI] [PubMed] [Google Scholar]
  46. Hunter PJ, Crampin EJ, Nielsen PM. Bioinformatics, multiscale modeling and the IUPS physiome project. Briefings in Bioinformatics. 2008;9:333–343. doi: 10.1093/bib/bbn024. [DOI] [PubMed] [Google Scholar]
  47. Irvin CG, Bates JH. Measuring the lung function in the mouse: the challenge of size. Respiratory Research. 2003;4 doi: 10.1186/rr199. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Kapur JN, Sahoo PK, Wong AKC. A new method for gray-level picture thresholding using the entropy of the histogram. Computer Vision, Graphics, and Image Processing. 1985;29:273–285. doi: 10.1016/0734-189X(85)90125-2. [DOI] [Google Scholar]
  49. Ke MT, Fujimoto S, Imai T. SeeDB: a simple and morphology-preserving optical clearing agent for neuronal circuit reconstruction. Nature Neuroscience. 2013;16:1154–1161. doi: 10.1038/nn.3447. [DOI] [PubMed] [Google Scholar]
  50. Kmieć Z. Cooperation of liver cells in health and disease. Advances in Anatomy, Embryology and Cell Biology. 2001;161:1–151. doi: 10.1007/978-3-642-56553-3. [DOI] [PubMed] [Google Scholar]
  51. Kuntz E, Kuntz H-D. Hepatology Principles and Practice History - Morphology - Biochemistry - Diagnostics Clinic - Therapy. Berlin: Springer Medizin Verlag Heidelberg; 2006. [Google Scholar]
  52. Lee SC, Bajcsy P. Intensity correction of fluorescent confocal laser scanning microscope images by mean-weight filtering. Journal of Microscopy. 2006;221:122–136. doi: 10.1111/j.1365-2818.2006.01546.x. [DOI] [PubMed] [Google Scholar]
  53. Levitt JJ, Westin C-F, Nestor PG, Estepar RSJ, Dickey CC, Voglmaier MM, Seidman LJ, Kikinis R, Jolesz FA, McCarley RW, Shenton ME. Shape of caudate nucleus and its cognitive correlates in neuroleptic-naive schizotypal personality disorder. Biological Psychiatry. 2004;55:177–184. doi: 10.1016/j.biopsych.2003.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  54. Lin G, Chawla MK, Olson K, Barnes CA, Guzowski JF, Bjornsson C, Shain W, Roysam B. A multi-model approach to simultaneous segmentation and classification of heterogeneous populations of cell nuclei in 3D confocal microscope images. Cytometry. Part a : The Journal of the International Society for Analytical Cytology. 2007;71:724–736. doi: 10.1002/cyto.a.20430. [DOI] [PubMed] [Google Scholar]
  55. Lopes R, Betrouni N. Fractal and multifractal analysis: a review. Medical Image Analysis. 2009;13:634–649. doi: 10.1016/j.media.2009.05.003. [DOI] [PubMed] [Google Scholar]
  56. Lorensen WE, Cline HE. Marching cubes: a high resolution 3D surface construction algorithm. ACM SIGGRAPH Computer Graphics. 1987;21:163–169. doi: 10.1145/37402.37422. [DOI] [Google Scholar]
  57. Luisier F, Vonesch C, Blu T, Unser M. Fast interscale wavelet denoising of poisson-corrupted images. Signal Processing. 2010;90:415–427. doi: 10.1016/j.sigpro.2009.07.009. [DOI] [Google Scholar]
  58. Malik R, Selden C, Hodgson H. The role of non-parenchymal cells in liver growth. Seminars in Cell & Developmental Biology. 2002;13:425–431. doi: 10.1016/S1084952102001301. [DOI] [PubMed] [Google Scholar]
  59. Margall-Ducos G, Celton-Morizur S, Couton D, Brégerie O, Desdouets C. Liver tetraploidization is controlled by a new process of incomplete cytokinesis. Journal of Cell Science. 2007;120:3633–3639. doi: 10.1242/jcs.016907. [DOI] [PubMed] [Google Scholar]
  60. Martin NC, McCullough CT, Bush PG, Sharp L, Hall AC, Harrison DJ. Functional analysis of mouse hepatocytes differing in DNA content: volume, receptor expression, and effect of IFNgamma. Journal of Cellular Physiology. 2002;191:138–144. doi: 10.1002/jcp.10057. [DOI] [PubMed] [Google Scholar]
  61. Mayer J, Swoger J, Ozga AJ, Stein JV, Sharpe J. Quantitative measurements in 3-dimensional datasets of mouse lymph nodes resolve organ-wide functional dependencies. Computational and Mathematical Methods in Medicine. 2012;2012:1–8. doi: 10.1155/2012/128431. [DOI] [PMC free article] [PubMed] [Google Scholar]
  62. McCuskey RS. The hepatic microvascular system in health and its response to toxicants. Anatomical Record. 2008;291:661–671. doi: 10.1002/ar.20663. [DOI] [PubMed] [Google Scholar]
  63. Megason SG, Fraser SE. Imaging in systems biology. Cell. 2007;130:784–795. doi: 10.1016/j.cell.2007.08.031. [DOI] [PubMed] [Google Scholar]
  64. Miyaoka Y, Miyajima A. To divide or not to divide: revisiting liver regeneration. Cell Division. 2013;8 doi: 10.1186/1747-1028-8-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Morales-Navarrete H, Segovia-Miranda F, Klukowski P, Meyer K, Nonaka H, Marsico G, Chernykh M, Kalaidzidis A, Zerial M, Kalaidzidis Y. 2016. Data from: a versatile pipeline for the multi-scale digital reconstruction and quantitative analysis of 3D tissue architecture. Dryad Digital Repository. [DOI] [PMC free article] [PubMed]
  66. Mosaliganti K, Janoos F, Gelas F, Noche F, Obholzer F, Machiraju F, Megason F. Anisotropic plate diffusion filtering for detection of cell membranes in 3d microscopy images. 2010 7th Ieee International Symposium on Biomedical Imaging: From Nano to Macro. 2010:588–591. doi: 10.1109/ISBI.2010.5490110. [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Mosaliganti KR, Noche RR, Xiong F, Swinburne IA, Megason SG. ACME: automated cell morphology extractor for comprehensive reconstruction of cell membranes. PLoS Computational Biology. 2012;8:e11214. doi: 10.1371/journal.pcbi.1002780. [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Nasse MJ, Woehl JC. Realistic modeling of the illumination point spread function in confocal scanning optical microscopy. Journal of the Optical Society of America A. 2010;27:295–302. doi: 10.1364/JOSAA.27.000295. [DOI] [PubMed] [Google Scholar]
  69. Nasse MJ, Woehl JC, Huant S. High-resolution mapping of the three-dimensional point spread function in the near-focus region of a confocal microscope. Applied Physics Letters. 2007;90:031106. doi: 10.1063/1.2431764. [DOI] [Google Scholar]
  70. Nyengaard JR, Flyvbjerg A, Rasch R. The impact of renal growth, regression and regrowth in experimental diabetes mellitus on number and size of proximal and distal tubular cells in the rat kidney. Diabetologia. 1993;36:1126–1131. doi: 10.1007/BF00401056. [DOI] [PubMed] [Google Scholar]
  71. O'Gorman L, Sanderson AC, Preston K. A system for automated liver tissue image analysis: methods and results. IEEE Transactions on Bio-Medical Engineering. 1985;32:696–706. doi: 10.1109/TBME.1985.325587. [DOI] [PubMed] [Google Scholar]
  72. Oda M, Yokomori H, Han JY. Regulatory mechanisms of hepatic microcirculation. Clinical Hemorheology and Microcirculation. 2003;29:167–182. [PubMed] [Google Scholar]
  73. Ohtani O, Ohtani Y. Lymph circulation in the liver. Anatomical Record (Hoboken, N.J. : 2007) 2008;291:643–652. doi: 10.1002/ar.20681. [DOI] [PubMed] [Google Scholar]
  74. Pal NR, Pal SK. A review on image segmentation techniques. Pattern Recognition. 1993;26:1277–1294. doi: 10.1016/0031-3203(93)90135-J. [DOI] [Google Scholar]
  75. Pandit SK, Westendorp B, Nantasanti S, van Liere E, Tooten PC, Cornelissen PW, Toussaint MJ, Lamers WH, de Bruin A. E2F8 is essential for polyploidization in mammalian cells. Nature Cell Biology. 2012;14:1181–1191. doi: 10.1038/ncb2585. [DOI] [PubMed] [Google Scholar]
  76. Pecot T, Singh S, Caserta E, Huang K, Machiraju R, Leone G. Non parametric cell nuclei segmentation based on a tracking over depth from 3d fluorescence confocal images. 9th Ieee International Symposium on Biomedical Imaging (Isbi) 2012:170–173. [Google Scholar]
  77. Peng H, Ruan Z, Long F, Simpson JH, Myers EW. V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets. Nature Biotechnology. 2010;28:348–353. doi: 10.1038/nbt.1612. [DOI] [PMC free article] [PubMed] [Google Scholar]
  78. Powers DMW. Evaluation: from precision, recall and f-factor to roc, informedne, markedness & correlation. Journal of Machine Learning Technologies. 2011;2:37. [Google Scholar]
  79. Preibisch S, Saalfeld S, Tomancak P. Globally optimal stitching of tiled 3D microscopic image acquisitions. Bioinformatics. 2009;25:1463–1465. doi: 10.1093/bioinformatics/btp184. [DOI] [PMC free article] [PubMed] [Google Scholar]
  80. Rasch R, Dørup J. Quantitative morphology of the rat kidney during diabetes mellitus and insulin treatment. Diabetologia. 1997;40:802–809. doi: 10.1007/s001250050752. [DOI] [PubMed] [Google Scholar]
  81. Ray K. Developmental biology: on the origin of liver regeneration. Nature Reviews Gastroenterology & Hepatology. 2015;12:549. doi: 10.1038/nrgastro.2015.147. [DOI] [PubMed] [Google Scholar]
  82. Saalfeld S, Fetter R, Cardona A, Tomancak P. Elastic volume reconstruction from series of ultra-thin microscopy sections. Nature Methods. 2012;9:717–720. doi: 10.1038/nmeth.2072. [DOI] [PubMed] [Google Scholar]
  83. Sbalzarini IF. Modeling and simulation of biological systems from image data. BioEssays : News and Reviews in Molecular, Cellular and Developmental Biology. 2013;35:482–490. doi: 10.1002/bies.201200051. [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Sivia DS. Dealing with duff data . MAXENT96 - Proceedings of the Maximum Entropy Conference.1996. [Google Scholar]
  85. Smith N, Waters S, Hunter P, Clayton R. The cardiac physiome: foundations and future prospects for mathematical modelling of the heart. Progress in Biophysics and Molecular Biology. 2011;104:1. doi: 10.1016/j.pbiomolbio.2010.12.006. [DOI] [PubMed] [Google Scholar]
  86. Stegmaier J, Otte JC, Kobitski A, Bartschat A, Garcia A, Nienhaus GU, Strähle U, Mikut R. Fast segmentation of stained nuclei in terabyte-scale, time resolved 3D microscopy image stacks. PloS One. 2014;9:e11214. doi: 10.1371/journal.pone.0090036. [DOI] [PMC free article] [PubMed] [Google Scholar]
  87. Sukumar SR, Page DL, Gribok AV, Koschan AF, Abidi MA, Gorsich DJ, Gerhart GR. Surface shape description of 3D data from under vehicle inspection robot. Unmanned Ground Vehicle Technology Vii. 2005;5804:621–629. [Google Scholar]
  88. Wang B, Zhao L, Fish M, Logan CY, Nusse R. Self-renewing diploid Axin2(+) cells fuel homeostatic renewal of the liver. Nature. 2015;524:180–185. doi: 10.1038/nature14863. [DOI] [PMC free article] [PubMed] [Google Scholar]
  89. Wisse E, De Zanger RB, Charels K, Van Der Smissen P, McCuskey RS. The liver sieve: considerations concerning the structure and function of endothelial fenestrae, the sinusoidal wall and the space of disse. Hepatology. 1985;5:683–692. doi: 10.1002/hep.1840050427. [DOI] [PubMed] [Google Scholar]
  90. Wolberg G, Zokai S. Robust image registration using log-polar transform. International Conference on Image Processing, Vol 1, Proceedings. 2000:493–496. [Google Scholar]
  91. Xing YG, Lawrence JB. Preservation of specific RNA distribution within the chromatin-depleted nuclear substructure demonstrated by in situ hybridization coupled with biochemical fractionation. The Journal of Cell Biology. 1991;112:1055–1063. doi: 10.1083/jcb.112.6.1055. [DOI] [PMC free article] [PubMed] [Google Scholar]
  92. Zaret KS. Regenerative biology: maintaining liver mass. Nature. 2015;524:165–166. doi: 10.1038/nature15201. [DOI] [PubMed] [Google Scholar]
  93. Zhao H, Darzynkiewicz Z. Biomarkers of cell senescence assessed by imaging cytometry. Methods in Molecular Biology. 2013;965:83–92. doi: 10.1007/978-1-62703-239-1_5. [DOI] [PMC free article] [PubMed] [Google Scholar]
eLife. 2015 Dec 17;4:e11214. doi: 10.7554/eLife.11214.038

Decision letter

Editor: Fiona M Watt1

In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.

Thank you for submitting your work entitled "A versatile pipeline for the multi-scale digital reconstruction and quantitative analysis of 3D tissue architecture" for consideration by eLife. Your article has been reviewed by two peer reviewers, and the evaluation has been overseen by Fiona Watt as the Senior Editor. One of the two reviewers has agreed to reveal his identity: Gaudenz Danuser.

The reviewers have discussed the reviews with one another and the editor has drafted this decision to help you prepare a revised submission.

The reviewers were very positive about your manuscript and would like to see it published in eLife. While the complexity of the synthetic data is appreciably lower than the experimental data, these simulations challenge the image analysis pipeline in a relevant way. Using these simulations as a test set for such algorithms is going to be helpful. We would even suggest that you make the code and parameter files available that generate these volumes for other labs to generate systematic other test data sets.

One concern we have is that the manuscript should be re-written to make it easier to follow. The main text should describe in broad strokes the necessary image analysis steps to a fairly naive audience. Currently, there is a large fluctuation in the level of detail – sometimes, unnecessary information is highlighted in the main text, whereas other, important, concepts are left out. The authors should then discuss the strengths and source of failures of the chosen approaches. For a resource article the failures are as interesting as the successes.

The authors should also avoid claims of exclusivity as much as possible. Individually, none of the image processing steps is out of the ordinary. The authors' achievement is to combine all the steps together into a working system. That said, the authors have failed to cite recent papers that address some of the same aspects. For example, it would be interesting to compare the recent work on nucleus segmentation with work published by Philip Keller's lab or Gaudenz Danuser's lab, and discuss Sean Megason's work on cell segmentation in 3D.

A second area of concern is the comparison of the new methods to other liver tissue reconstructions. The authors claim that substantial differences between the present and cited work originate in the advances of the image analysis algorithms. However, is this really the case? Could this not be due to differences in the tissue fixation or image acquisition? Some of the cited references are fairly recent. This might offer an excellent opportunity to apply the new image analysis pipeline to data that has been analyzed by other means. Such validation would be necessary to support the statement that 'in comparison with most recent previous reports, our model therefore provides a more precise estimation of the geometrical characteristics of sinusoidal and BC networks.'

eLife. 2015 Dec 17;4:e11214. doi: 10.7554/eLife.11214.039

Author response


The reviewers were very positive about your manuscript and would like to see it published in eLife. While the complexity of the synthetic data is appreciably lower than the experimental data, these simulations challenge the image analysis pipeline in a relevant way. Using these simulations as a test set for such algorithms is going to be helpful. We would even suggest that you make the code and parameter files available that generate these volumes for other labs to generate systematic other test data sets.

We thank the reviewers for this suggestion and included all necessary functions and scripts (scripts_image_generation.zip) for the generation of synthetic images as part of the MotionTracking (MT) software.

One concern we have is that the manuscript should be re-written to make it easier to follow. The main text should describe in broad strokes the necessary image analysis steps to a fairly naive audience. Currently, there is a large fluctuation in the level of detail – sometimes, unnecessary information is highlighted in the main text, whereas other, important, concepts are left out. The authors should then discuss the strengths and source of failures of the chosen approaches. For a resource article the failures are as interesting as the successes.

We modified the text and especially re-wrote the Results section to make it clearer and easier to follow. We added descriptions of general concepts as well as justifications for the use of the specific features of our pipeline. Specific technical details were moved to the Methods section.

The authors should also avoid claims of exclusivity as much as possible. Individually, none of the image processing steps is out of the ordinary. The authors' achievement is to combine all the steps together into a working system. That said, the authors have failed to cite recent papers that address some of the same aspects. For example, it would be interesting to compare the recent work on nucleus segmentation with work published by Philip Keller's lab or Gaudenz Danuser's lab, and discuss Sean Megason's work on cell segmentation in 3D.

We modified the text to avoid misunderstandings about claims of exclusivity. We now cite the published work, compare the results with ours and discuss recent work on nucleus and cell segmentation (Results, end of the subsection “3D image segmentation and active mesh tuning for the accurate reconstruction of tubular networks (sinusoids and BC) and nuclei”; Discussion, fourth paragraph; and Results, subsection “Cell classification and reconstruction”, last paragraph).

A second area of concern is the comparison of the new methods to other liver tissue reconstructions. The authors claim that substantial differences between the present and cited work originate in the advances of the image analysis algorithms. However, is this really the case? Could this not be due to differences in the tissue fixation or image acquisition? Some of the cited references are fairly recent. This might offer an excellent opportunity to apply the new image analysis pipeline to data that has been analyzed by other means. Such validation would be necessary to support the statement that 'in comparison with most recent previous reports, our model therefore provides a more precise estimation of the geometrical characteristics of sinusoidal and BC networks.'

We agree with the reviewers that the differences between our results and others on liver reconstruction could be due to not only differences in the image processing but also sample preparation and image acquisition. We moved this comparison from the Results section to the Discussion section (fifth paragraph) and expanded it. We applied our pipeline to a publicly available dataset (TiQuant: http://ms.izbi.uni-leipzig.de/index.php/software) (Hammad et al., 2014, Friebel et al., 2015). As shown in the Author response image 1, our pipeline produces qualitatively more accurate segmentations than previous studies by others. In particular, our radius estimation for the sinusoidal network is closer to the values reported from EM data.

Author response image 1. Comparison of our pipeline with TiQuant (Hammad et al., 2014, Friebel et al., 2015) applied on the reconstruction of liver tissue.

Author response image 1.

Our image analysis pipeline (MT) was applied on the dataset provided as a test for TiQuant ( http://ms.izbi.uni-leipzig.de/index.php/software). Panel (A) shows single 2D plane sections of a liver tissue image stained for sinusoids (magenta), whereas the segmentation generated by TiQuant (provided within the dataset) is shown as a partially transparent (green) image overlapping with the original one. Our reconstructions are shown as object contours (magenta lines). Panel (B) shows the radius distributions of the sinusoidal network extracted from reconstructions provided by TiQuant (red) and generated by the MT pipeline (blue). The estimated value of the radius is expressed in voxels since no information about the voxel size is provided. Each histogram was fit by a Gaussian distribution (with mean 14.08 and 11.00, for TiQuant and MT, respectively). The dots correspond to the extracted data and the solid lines to the corresponding fits. Our active mesh tuning approach yielded radius estimation for the sinusoidal network ~20% smaller than the voxel-based methods of TiQuant. These results are in line with the ones obtained from our experimental data.

DOI: http://dx.doi.org/10.7554/eLife.11214.035

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Citations

    1. Morales-Navarrete H, Segovia-Miranda F, Klukowski P, Meyer K, Nonaka H, Marsico G, Chernykh M, Kalaidzidis A, Zerial M, Kalaidzidis Y. 2016. Data from: a versatile pipeline for the multi-scale digital reconstruction and quantitative analysis of 3D tissue architecture. Dryad Digital Repository. [DOI] [PMC free article] [PubMed]

    Supplementary Materials

    Supplementary file 1. 3D ‘ground truth’ voxelated model of liver tissue (0.3 μm × 0.3 μm × 0.3 μm per voxel).

    DOI: http://dx.doi.org/10.7554/eLife.11214.034

    elife-11214-supp1.zip (5.9MB, zip)
    DOI: 10.7554/eLife.11214.034

    Articles from eLife are provided here courtesy of eLife Sciences Publications, Ltd

    RESOURCES