Three-dimensional histopathological reconstruction of bladder tumours

Abstract

Background

Histopathological analysis is the cornerstone in bladder cancer (BCa) diagnosis. These analysis suffer from a moderate observer agreement in the staging of bladder cancer. Three-dimensional reconstructions have the potential to support the pathologists in visualizing spatial arrangements of structures, which may improve the interpretation of specimen. The aim of this study is to present three-dimensional (3D) reconstructions of histology images.

Methods

En-bloc specimens of transurethral bladder tumour resections were formalin fixed and paraffin embedded. Specimens were cut into sections of 4 μm and stained with Hematoxylin and Eosin (H&E). With a Phillips IntelliSite UltraFast scanner, glass slides were digitized at 20x magnification. The digital images were aligned by performing rigid and affine image alignment. The tumour and the muscularis propria (MP) were manually delineated to create 3D segmentations. In conjunction with a 3D display, the results were visualized with the Vesalius3D interactive visualization application for a 3D workstation.

Results

En-bloc resection was performed in 21 BCa patients. Per case, 26–30 sections were included for the reconstruction into a 3D volume. Five cases were excluded due to export problems, size of the dataset or condition of the tissue block. Qualitative evaluation suggested an accurate registration for 13 out of 16 cases. The segmentations allowed full 3D visualization and evaluation of the spatial relationship of the BCa tumour and the MP.

Conclusion

Digital scanning of en-bloc resected specimens allows a full-fledged 3D reconstruction and analysis and has a potential role to support pathologists in the staging of BCa.

Background

Histopathological analysis is the cornerstone in bladder cancer (BCa) diagnosis. The histological grade and stage of BCa are important prognostic parameters for therapeutic decision-making [1, 2]. Patients with muscle-invasive bladder cancer have a higher risk of cancer-specific mortality compared to patients without muscle invasion [2]. Initial treatment is generally performed by transurethral resection of the bladder tumour (TURB), allowing tissue removal regardless the location or size. Histopathologic analysis of TURB specimens is limited since it is difficult to determine the degree of invasion [3]. Important landmarks for staging, such as the lamina propria or the muscularis propria (MP), are often difficult to recognize in the small TURB fragments. Moreover, these fragments are often subject to thermal artifacts or tangential sectioning [4]. Both factors result in a poor interobserver agreement of BCa staging [5]. Furthermore, BCa is often understaged at the initial resection because of the absence of MP in the resection specimen [6]. As a result, upstaging to a muscle-invasive tumour after a second TURB occurs in 10–20% [2] of BCa. To improve staging, en-bloc resections, in which the bladder tumour is resected as a whole are increasingly performed [3]. Previous studies including en-bloc resections have reported to contain MP in 96–100% of cases [3, 7, 8]. In en-bloc resections, a better impression of the spatial arrangement of the tissue can be obtained, assisting the pathologists with the orientation [3]. In general, pathologists examine an average number of 1–2 slides per tissue block, depending on the type of tissue [9]. These sections are only a small fraction of a the three-dimensional (3D) resected specimen. As only a fraction of heterogeneous tissue is examined, undersampling of the BCa specimen is likely to occur. To enable a pathologist to study a complete tissue sample comprehensively, it is necessary to cut and stain multiple consecutive tissue slides. However, it is impractical and time consuming to visualize and analyze a large number of tissue slides per sample by conventional microscopy.

Whole slide image (WSI) systems provide pathologists histopathologic glass slides as digital high resolution images with magnifications similar to conventional microscopy. WSI offers the possibility to create a digital 3D reconstruction based on stacks of two-dimensional (2D) WSIs. 3D reconstructed histology images hold the potential to assist pathologists in visualizing the 3D spatial arrangements of structures. One of the major problems encountered in 3D image reconstruction of histology slides is tissue deformation due to fixation, cutting, and mounting of the specimen during sample preparation [10–14]. Several methods have been proposed to align multiple 2D WSIs to create a 3D image [10–16]. To our knowledge, the 3D digital reconstruction of BCa tumours from histological slides has not been described before.

In this study, we present a method of preparing, reconstructing and visualizing 3D images reconstructed from multiple consecutive 2D WSIs of BCa en-bloc specimens. Moreover, we introduce a technology that enables interactive manipulation of 3D histological volumes. Additionally, we describe a method to visualize the tumour and MP, without the submucosal layer, allowing to review the spatial relationship of these structures.

Methods

Tissue preparation

Formalin fixed, paraffin-embedded tissue blocks from en-bloc TURB specimens were retrieved from the archive of the Amsterdam UMC, location Academic Medical Center (AMC), the Netherlands. The study was approved by Institutional Review Board of the AMC, Amsterdam (W16_088 # 16.108). Fifty-one sequential sections of 4–5 μm were cut using a microtome. Every second slide was mounted onto a glass slide, leaving the possibility to use the adjacent section for different stains or other imaging modalities.

The mounting protocol, as extension on the protocol created by Soufan et al. was aimed to minimize folding and deformation of the tissue [17]. In short, the tissue section was kept horizontal by placing the section on a drop of water on a glass slide. The glass slides were placed on a hot plate of 42 °C for 2 min, allowing the section to stretch. Using a vacuum pump, water was gently removed. The glass slide was placed on a hot plate of 32 °C for 30 min to let the remaining water evaporate. The slides were dried for at least 2 h at 37 °C and stained with Hematoxylin and Eosin (H&E). Smoothelin (Biocare medical, 1:200 dilution, clone R4A) was used on an additional slide to visualize the smooth muscle bundles of the MP [18]. The slides were stained using an automated slide preparation system (Benchmark Ultra, Ventana). The signal detection was performed with a biotin-free OptiView DAB IHC detection kit (Ventana Medical Systems).

If present, the BCa was staged according to the TNM classification system and the World Health Organization (WHO) 1997 and 2004 grading system [19].

Scanning

The glass slides were digitized using the Phillips IntelliSite UltraFast Scanner (Philips Digital Pathology Solutions, Best, the Netherlands) and were exported as a TIFF file at 20x magnification, resulting in images with a resolution of 0.5 μm/pixel. WSIs with tissue folds or out-of-focus areas were excluded. When slides were excluded, a neighboring slide was doubled to have a good representation of the distance between slides.

Alignment

A pair-wise reconstruction of the bladder tumour was performed by aligning the 2D WSIs, starting the alignment with the center slide. The datasets were aligned using the Elastix toolbox [20], by performing coarse-to-fine multi-resolution rigid Euler transformation followed by an affine transformation and a subsequent multi-scale b-spline transformation. To speed up the registration, the alignment was performed on 10x downsampled grayscale images. The resulting transformations were applied on the high-resolution images. The normalized correlation coefficient metric was used for the similarity measure. Deformation during the b-spline transformation was restricted by not only taking into account the similarity into the cost-function, but also limit the amount of bending by introducing a bending energy penalty term. Via this term, the sum of the second order spatial derivatives of the transformation, sharp deviations of the transformation are penalized.

Segmentation and visualization

The BCa and the MP were manually delineated by an experienced observer (IJ) using in-house developed software [21] (Fig. 1) operated on a computer with 28 in. touchscreen (Microsoft Surface Studio, Microsoft, Redmond, USA). These delineations were subsequently checked and corrected by a specialized urinary tract pathologist (CDSH). The segmentations of different structures allow the user to highlight the structures of interest (e.g. tumour), and to see the 3D distribution.

Fig. 1.

Left: Impression of the software and hardware used for delineation of the digitized tissue slides. Right: digitized en-bloc resection specimen with manual delineations. The tumour has been delineated in red, the MP in orange

The aligned dataset was imported into a 3D workstation (C-Station, PS-Medtech, Amsterdam, NL) (Fig. 2) and visualized using an interactive application (Vesalius3D, PS-Medtech, Amsterdam, NL). Using optical tracking, footswitches and live 3D rendering, users interact with their data as if they are holding the data in their hands. Thus 3D data volumes can be rotated, zoomed, and virtually sectioned through multiple planes of the data volume.

Fig. 2.

PS-Medtech C-station with a 3D reconstruction of an en-bloc bladder tumour resection, allowing manual manipulation of the data

Qualitative assessment of the registration performance

The accuracy of the alignment of 2D slices to create a 3D volume was qualitatively assessed by two expert observers (IJ, ML) by viewing the 3D renderings. Special attention has been devoted to tissue borders and the course of larger structures (e.g. the lumen of a blood vessel). Misalignment errors were seen as discontinuities between slides.

Results

Samples

Figure 3 shows the flow diagram of the included and excluded cases. A total of sixteen en-bloc resection specimens were reconstructed into a 3D volume. The most common reason of slide exclusion was slide loss due to export problems from the Philips server. The size of the datasets varied from 1.5 GB to 66 GB. The number of slides per case varied from 26 to 30. In two patients, slides were doubled due to tissue folds or out-of-focus areas. No difference between the initial staging and staging of the whole 3D reconstructions was observed.

Fig. 3.

Flow diagram of the included cases

Qualitative assessment showed good alignment in 13 out of 16 cases. 3D reconstruction results of the full rendering, sagittal and detailed view of two datasets are shown in Figs. 4 and 5. Figure 4a-c demonstrates tissue of a papillary low grade (grade 2) Ta BCa with presence of the MP. The zoomed-in images are showing the high quality of the registration. Figure 5a-c shows tissue of a high grade (grade 3) T1 BCa without presence of the MP.

Fig. 4.

3D reconstruction of en-bloc resection specimen of patient 1 a. 3D rendering b. Detailed view showing a zoomed-in view of a lumen and tumour nests. c. Sagittal view, showing the alignment

Fig. 5.

3D reconstruction of en-bloc resection of patient 21. The lamina propria is faded out in order to see the differences in tumour growth into the lamina propria. a. 3D rendering b. Detailed view showing a tumour border c. Sagittal view, showing the alignment

Segmentation and visualization

After importing the aligned datasets into the visualization application Vesalius3D, the datasets were visualized on a 3D monitor. Through the 3D interaction on the C-Station the data could be rotated and virtually scrolled through. This way the multiple slides could be easily evaluated.

Figure 6 shows a tumour in relation to the MP using the segmentations. By using the segmentations, the distance of the BCa and the MP is clearly visible in the Ta tumour. The blurred area might give the pathologist the possibility to clearly view the areas that deviate, and where a more invasive aspect is seen.

Fig. 6.

Segmentation of en-bloc resection specimen 1. The upper part shows the bladder cancer, the lower part shows the muscularis propria. The tissue between these two structures is blurred, making it possible to easily view the relationship of the two layers

Discussion

We have demonstrated the work-up of high quality 3D reconstructions of en-bloc TURB specimen from sequential 2D WSIs. With the provided segmentations of BCa tumour and MP, the spatial relationship between these structures could be visualized in 3D. By providing better insight in the growth pattern of a tumour, this method has the potential to assist the pathologist in accurate staging of BCa.

To our knowledge, this is the first study focusing on 3D reconstructing BCa tumours out of multiple 2D histological slides. By evaluating a 3D volume instead of the conventional 2D images, we assume that more information can be visualized. We created segmentations of the tumour and the MP and faded out the area in between, to emphasize the distance between these two layers and clarify the changes that occur throughout the different slides. Booth et al. used 3D segmentations to visualize the mammarian lobule in relation to ductal carcinoma in situ and noticed a complexity that was of higher order than was apparent from the 2D slides [13]. A small number of previous studies have created 3D reconstructions out of histological slides, using multiple sections [10–15]. Booth et al. discussed the depth of the stack for the 3D reconstruction of breast cancer and found 30 slides, with a thickness of 4 μm, to be an insufficient number for a spatial reconstruction [13]. In future, we aim to increase our reconstructions to determine the optimal number of sections to create a 3D volume. Moreover, we would like to investigate if it is necessary to use consecutive slides. Due to the anisotropic voxel (volumetric pixel) size of the 3D image, important information could be missed.

We have shown good qualitative results in the registration of multiple WSIs. In previous studies that focused on the 3D reconstruction of histological slides, various registration methods have been used [10–15]. In our study, we have only used existing open-source tools, being easily accessible. Registration of the WSIs is a challenging task since the volume of the slides within a specimen can differ enormously due to deformation of the tissue. Deformation occurs as a result of the fixation with formalin, cutting and mounting of the specimen. In our protocol, we tried to minimize deformation by adjusting the protocol and keeping the slides as horizontal as possible. Some groups used artificial fiducial markers as a reference point for the registration [14, 22]. These fiducial markers are placed alongside the specimen during embedding. However, during cutting and mounting of the specimen, non-linear deformation occurs throughout the whole specimen, and therefore external fiducial markers cannot predict this deformation for the whole tissue [15, 22]. Other groups have used structures that are visible through several planes as a reference point [10, 13]. However, especially in tumourous tissue, it is difficult to use this method for the basis of alignment because of the heterogeneity of the tumour. Another obstacle for the visualization is the staining inconsistency, which can even be noted within sections, several groups have tried to make up for the staining differences by colour normalization [23].

In our study, we only mentioned a qualitative measure for the accuracy of registration. Quantitative measures for registration are difficult to determine. Some groups have used Hausdorff evaluation based on manual delineations and concluded only minor registration errors [12, 14]. However, in our study we did not use Hausdorff evaluation due to the lack of anatomic markers in the tissue, in specific within the tumour. Thereby are these anatomic markers mostly based on manual segmentation of the marker, thereby introducing a dependency.

During the sample workup the major reason of slide loss were exportation problems from the Philips server due to the size of the images. Therefore, local storage solutions as well as network speed and infrastructures must be adapted. The FDA recently gave approval for the use of digital slides scanners in diagnostics [24]. We expect that this recent development may give a boost to the use and therefore the evolution of digital slide scanners and subsequently data storage more reliable.

A drawback of the presented methodology is the time consuming process of tissue preparation, as also reported in other studies [12, 13, 25, 26]. Sectioning and mounting of the tissue requires human labour. Onozato et al. have showed a method for automated sectioning with positive results [16, 26]. As for now, this is not common practice in pathology laboratories, since these machines still take more time than manual sectioning [26]. Furthermore, the manually delineation of the tissue structures was a time consuming process. Eventually, automatic tissue segmentation can be implemented [10]. Furthermore, we have used only a small portion of the tumors to create a 3D reconstruction since were not allowed to section entire tumor blocks. In future work we would like to use tumor specimen that we can section completely.

3D pathology has the potential to improve insight in the growth pattern of BCa and thus refine the staging. Although pathologist are trained in visualizing the spatial arrangement of a tumour based on the 2D representation of a single slide, 3D reconstructions could support when orientation of specimen is difficult to determine. Moreover, 3D reconstructions could give better insight in the suggested sub-staging of non-muscle invasive T1 BCa. In T1 BCa the 5-year progression rates vary between 21 and 50% [1]. The two most studied systems, stratification of the muscularis mucosa invasion (T1a versus T1b) and assessing the amount of invasion into the lamina propria (T1e and m), show an increased prognostic value compared to normal T1 staging [27]. The main objection of not implementing the T1a/b sub-staging system in clinical practice is the discontinuous nature of the muscularis mucosae and interobserver variability [28]. The T1e/m staging system however, proved to be a more consistent method [29, 30]. We believe by implementing the 3D reconstructions of en-bloc bladder resection specimen into clinical practice, the visualization of the possible tumour ingrowth can be simplified. In the future, we will focus on the clinical relevance of creating 3D reconstructions for routine diagnosis. Eventually, we need to assess the added value of 3D reconstructions, together with optimizing visualization techniques. Moreover, this could be of use in other fields, such as follicular thyroid neoplasms, to determine invasion depth.

Conclusion

In conclusion, we have created a 3D reconstruction of a BCa tumour out of multiple 2D WSIs. 3D reconstructions show added value of tumour configurations and may improve insight into the architectural changes and refine the classification of BCa by providing detailed spatial and structural information to the assessment by light microscopy.

Abbreviations

2D

Two-dimensional

3D

Three-dimensional

BCa

Bladder cancer

CIS

Carcinoma in situ

H&E

Hematoxylin & Eosin

MP

Muscularis propria

TURB

Transurethral resection of bladder tumour

WSI

Whole slide imaging

Authors’ contributions

IJ contributed to the acquisition of data, the interpretation of the data and was a major contributor in writing the manuscript. ML analyzed and interpreted the data and was a major contributor in writing the manuscript. CDSH performed the histologic evaluation of the bladder and was involved in revising the manuscript. EIMLL contributed to the acquisition of data and was involved in revising the manuscript. SLM revised the manuscript. OJB revised the manuscript. TGL revised the manuscript. HAM contributed to the design of the study and revised the manuscript. DMB contributed to the design of the study and revised the manuscript. All authors read and approved the final manuscript.

Ethics approval and consent to participate

This project did not involve any human participants or animals. The study was approved by Institutional Review Board of the Amsterdam UMC, location AMC (W16_088 # 16.108).

Consent for publication

Not applicable, data used in this manuscript is unidentifiable and no details on individuals are reported.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.