Abstract
The retina provides a window to study the pathophysiology of cerebrovascular diseases. Pathological retinal microvascular changes may reflect microangiopathic processes in the brain. Recent advances in optical imaging techniques have enabled imaging of the retinal microvasculature at the capillary level, and the generation of high-resolution, non-invasive capillary perfusion maps (nCPMs) with the Retinal Function Imager (RFI). However, the lack of quantitative analyses of the nCPMs may limit the wider application of the method in clinical research. The goal of this project was to demonstrate the feasibility of automated segmentation and fractal analysis of nCPMs. We took two nCPMs of each subject in a group of 6 healthy volunteers and used our segmentation algorithm to do the automated segmentation for monofractal and multifractal analyses. The monofractal dimension was 1.885 ± 0.020, and the multifractal dimension was 1.876 ± 0.010 (P =0.108). The coefficient of repeatability was 0.070 for monofractal analysis and 0.026 for multifractal analysis. This study demonstrated that the automatic segmentation of nCPMs is feasible for fractal analyses. Both monofractal and multifractal analyses yielded similar results. The quantitative analyses of microvasculature at the capillary level may open up a new era for studying the microvascular diseases such as cerebral small vessel disease.
Keywords: retina, capillary perfusion, fractal analysis, segmentation, image processing, in vivo, Non-invasive capillary perfusion map
Introduction
In biology and medicine, the shapes of structures, such as molecules, cells, tissues and organs, have been found to have fractal characteristics (Goldberger and West, 1987). A fractal is a mathematical set with a fractal dimension that differs from its topological dimension. Fractal analysis has been used to assess fractal characteristics, and fractal dimensions are capable of revealing the differences and irregularities in these structures (Mandelbrot BB, 1983). Quantitative measurements of the fractal dimension could be an effective approach to discriminate diseased tissues from healthy tissue (Talu, 2011). Moreover, the utilization of various types of medical imaging techniques promotes the application of fractal analysis in biology and medicine. Abnormal tissue can be detected by performing a fractal analysis for particular biological structures in medical images (Lim et al., 2009). Thus, fractal analysis with medical imaging techniques may provide an effective diagnostic methodology to detect diseases.
Fractal analysis has been extensively used to investigate changes in the retinal vascular complexity and branching density (MacGillivray and Patton, 2006;Avakian et al., 2002;Azemin et al., 2011;Cheung et al., 2010;Liew et al., 2008). It has been used to analyze retinal vascular trees in fundus photos and fluorescein angiography to quantitatively measure the microvascular damage in diabetes (Lim et al., 2009;Cheung et al., 2009;Avakian et al., 2002) and lacunar infarcts (Doubal et al., 2010;Cheung et al., 2010). However, these studies were based on the analysis of large vessels in the fundus images. Recent advances in optical imaging techniques have enabled the generation of nCPMs of the retinal capillary vessels using the Retinal Function Imager (RFI, Optical Imaging Ltd, Rehovot, Israel) (Burgansky-Eliash et al., 2010). The vessel network, as shown in perfusion maps, extends far beyond the fourth branches, and the spider web-like capillary map can be visualized. Based on the nCPMs, one could realize that the network of the vasculature is very dense, with the perfusion area covering almost the entire foveal region except for the avascular zone. Thus, nCPMs reveals more information about small vessels than standard fundus images. Although the microvascular network can be visualized in great detail, the lack of quantitative analyses on nCPMs may limit its application. The goal of this study was to demonstrate the feasibility of automated segmentation and fractal analysis applied to the retinal microvascular network observed in the nCPMs from the RFI.
Materials and Methods
This protocol was approved by the institutional review board for human research at the University of Miami; informed consent was obtained from each subject; and all subjects were treated in accordance with the tenets of the Declaration of Helsinki. In this prospective study, there were 6 healthy subjects (3 males and 3 females, mean age: 28.5 ± 6.2 years, range: 19 – 41 years) without history of cerebral small vessel disease, hypertension, diabetes or kidney disease. The nCPMs were acquired using RFI. As described elsewhere in details (Nelson et al., 2011;Nelson et al., 2005;Beutelspacher et al., 2011;Landa et al., 2012;Landa and Rosen, 2010). The device has a specific digital camera with 1024×1024 camera pixels and is attached to a standard Topcon fundus camera (Topcon Medical Systems, Inc, Oakland, NJ, USA). Stroboscopic illumination with wavelengths between 530 and 590 nm was used to capture eight consecutive images with flashes. Multiple image sessions were acquired for the creation of nCPMs using the proprietary software in the device. The motion of the hemoglobin in the red blood cells serving as a contrast agent was detected by the proprietary software (Nelson et al., 2011;Izhaky et al., 2009). This software aligns sequential images with one another, and a signal-averaged map is generated, resulting in the nCPM (Figure 1A). One eye of each subject was imaged after pupil dilation. Two nCPMs were obtained at the same visit.
Figure 1. Automated segmentation results of a nCPM.
A healthy subject was imaged with RFI, and an nCPM was created (A). To segment the capillary perfusion pattern, the order of gray scale in the image was inverted (B), and non-uniform illumination was corrected (C). After the removal of the background noise and non-vessel structures using a morphological opening operation the vessel network was segmented (D). The image was then skeletonized (E) for fractal analysis. The macular area (in the yellow circle with a diameter of 2.3 mm) was extracted (F) for fractal analysis. Bar = 1 mm.
Image segmentation was custom-developed in Matlab (The Mathworks, Inc, Natick, MA, USA). The processing procedures were similar to those reported previously for segmenting the retinal vascular tree in fundus images (MacGillivray et al., 2007). The order of gray scale in the nCPMs (image size of 1024 × 1024 pixels) was inverted, and non-uniform illumination in the images was corrected by applying adaptive histogram equalization, which enhanced the contrast between the vessel and the background (Figure 1). The background noise was removed, and non-vessel structures were eliminated by morphological opening operations, which consisted of erosion followed by dilation. First, the supremum of the openings with a linear structuring element [se=strel (`line´,10,0)] at 18 rotations each 10°apart were taken as the vessel images where the vessel was enhanced along the vessel direction. The infima of the openings were then taken as the background. Subtracting the background image from the enhanced vessel image enabled the removal of the background noise and non-vessel structures. The processed image was then converted to a binary image using thresholding. Image J (Wayne Rasband, National Institutes of Health, Bethesda, MD) was used to skeletonize the segmented vascular network before the fractal analysis was run (Figure 1). In addition, an area of a diameter of 2.3 mm (512 pixels, half of the full size of the nCPM) centered on the fovea was extracted from the nCPMs, representing the macular area for fractal analysis (Figure 1).
The fractal dimension can be analyzed using monofractal and multifractal methods. In the present study, we used the fractal analysis toolbox from Benoit (TruSoft Benoit Pro 2.0, TruSoft International Inc, St. Petersburg, FL, USA) to analyze the fractal dimension of the segmented vascular network images. Compared to monofractal analysis, multifractal analysis may be more sensitive to subtle changes in the retinal vasculature because the retina appeared to have multifractal properties (Doubal et al., 2010;Talu, 2013). We used both monofractal and multifractal analyses to process nCPMs and compare the results. We measured the monofractal dimension (Dbox) using the box-counting technique with a max size of 104 and a rotation of 15 in the monofractal analysis settings. We used the dimension D0 as the measure of multifractal analysis; D0 has been suggested as the most appropriate parameter of the retinal vasculature (Doubal et al., 2010).
A statistical software package (Statistic, StatSoft, Inc, Tulsa, OK) was used for descriptive statistics and data analysis. All data were presented as the mean ± standard deviation. A paired t-test was used to test the differences between these repeated measurements of each subject. P < 0.05 was considered significantly different between the two sets of images. The coefficient of repeatability (CoR) was calculated as 2 standard deviations (SDs) of difference between two measurements. CoR% was defined as the percentage of the CoR over the mean of two measurements.
Results
Our results showed that the methodology evaluated for quantifying nCPMs from RFI produced promising segmentation results (Figure 1) for further fractal analysis. A visual inspection of the segmented results indicates that the algorithm successfully detects vessels of all shapes and sizes, including the small capillaries that were not well defined in the original nCPMs because of a non-homogeneous textured background. Of note, no incorporation of the foveal contour detection stage was required to avoid the algorithm’s false classification of the fovea as a capillary perfusion region. For the full-sized nCPMs, the mean Dbox was 1.885 ± 0.020, and the mean D0 was 1.876 ± 0.010 when the two measurements were averaged (P = 0.108). The CoR of Dbox was 0.070 (CoR%: 3.7%), and the CoR of D0 was 0.026 (1.3%). For the macular area analyzed in the cropped image, the mean Dbox was 1.732 ± 0.034, and the mean D0 was 1.773 ± 0.020 when the two measurements were averaged (P = 0.001). The CoR of Dbox was 0.076 (4.3%), and the CoR of D0 was 0.052 (2.9%).
Discussion
In the present work, we demonstrated for the first time the feasibility of using an unsupervised algorithm for automatically segmenting nCPMs from the RFI. The retina provides a window to study the pathophysiology of cerebrovascular diseases. Pathological retinal vascular changes may reflect microangiopathic processes in the brain (Wong et al., 2002;Wong, 2004). Increased retinal venule diameters and decreased arteriovenous ratios have been found to be significantly associated with lacunar, rather than cortical ischemic strokes (Doubal et al., 2009;Bettermann et al., 2012). The causes of these changes are not clear. These structural changes in the larger vessels usually do not present in the early stages of microvascular disease, and therefore they may not be useful as markers to evaluate therapeutic interventions or to identify subclinical stroke patients. The study of the microvasculature of smaller vessels, especially at the capillary level, may hold the key to unlocking the mysteries of the enlarged venules in central nerve system vascular diseases, such as lacunar strokes.
RFI was designed to directly and non-invasively image the capillary network of the retina while providing a great deal of detail regarding capillary perfusion (Izhaky et al., 2009;Witkin et al., 2012). This information can be used to measure the microvascular dysfunction at the capillary level due to its unique ability to enhance the images by utilizing red blood cells as contrast agents. Based on the quantitative analysis of the capillary network and perfusion demonstrated in our work, the fractal analysis of nCPMs could be well suited for large-scale clinical studies. Ultimately, this method can be used in the clinical routine. Adding quantitative analysis of the nCPMs will extend the usefulness of this new imaging modality.
The normal retina has a vascular branching network obtained from fundus photos that provides an ideal vascular distribution of the large vessels with a fractal dimensional value of ~1.7 (MacGillivray et al., 2007;Talu, 2013). In patients with lacunar stroke, the fractal dimension was performed on wide-field fundus images and was found to be decreased, indicating the loss of vascular branching and complexity (Doubal et al., 2010). Controversially, the fractal dimension was found to be increased in another study investigating the fractal features in a small field centered by the optic nerve head (Cheung et al., 2010). The diameters of the smallest vessels in those previous methods were reported to be up to 50 µm, which represent the third to fourth branches of the retinal vessels (Avakian et al., 2002). The current fractal analysis of fundus photos and fluorescein angiograms may lack of the ability to visualize smaller vessels, such as capillaries, with widths as small as 4 µm. The capillary perfusion can be non-invasively visualized by RFI, which reveals the capillary network in great detail. As expected, the fractal dimension from both monofractal and multifractal analyses showed high scores, indicating a greater density and complexity in the capillary perfusion compared to the retinal vascular tree obtained from fundus photos. Interestingly, we found that the results from both monofractal and multifractal analyses are similar to those of the full-sized nCPMs. This phenomenon may indicate that nCPMs exhibit both mono- and multiple-fractal characterizations, which may differ from those of the retinal vessel tree (Doubal et al., 2010;Talu, 2013). On the other hand, when the macular area was analyzed, multifractal analysis showed higher score than that by monofractal analysis, which may indicate the multifractal features in the macular capillary perfusion. We noted that the score of the cropped image in the macula was smaller than that of the full-sized image, possibly due to the avascular zone in the fovea, which comprised a large portion of the image.
The nCPMs showed the details of capillary perfusion, making it almost impossible to manually segment the capillary network, as it often appears to be intricate or ill-defined. A fully automatic segmentation approach will be essential for applying the RFI in future clinical studies. As we demonstrated in the present work, this approach may add diagnostic value to advanced optical imaging modalities and could open up a new era for studying retinal microvasculature. The repeatability is good for both monofractal and multifractal analyses. It appears that the repeatability was better with multifractal analysis in both full-sized and cropped nCPMs. This may constitute a piece of evidence that the nCPMs are more suitable for multifractal analysis (Talu, 2013;Doubal et al., 2010).
In conclusion, this study demonstrated that the automatic segmentation of nCPMs is feasible for fractal analysis. The quantitative analysis may open a new field of quantitative analysis for the monitoring of microvascular changes in various ocular and systemic diseases, such as cerebral small vessel disease, lacunar stroke, hypertension and diabetic retinopathy.
Table 1.
Fractal analyses of nCPMs (n=6) using monofractal analysis (Dbox) and multiple fractal analysis (D0)
| First | Second | Difference | P-value* | |
|---|---|---|---|---|
| Full image size (1024 × 1024) | ||||
| Mean ± SD | Mean ± SD | Mean ± SD | ||
| Dbox | 1.889 ± 0.017 | 1.881 ± 0.034 | 0.008 ± 0.035 | 0.108 |
| D0 | 1.877 ± 0.009 | 1.875 ± 0.014 | 0.002 ± 0.013 | |
| Cropped image size centered on the fovea | ||||
| Dbox | 1.739 ± 0.029 | 1.725 ± 0.047 | 0.014 ± 0.038 | 0.001 |
| D0 | 1.777 ± 0.017 | 1.769 ± 0.029 | 0.008 ± 0.026 | |
paired t-test between monofractal and multifractal analyses using averaged results of the two repeated measurements.
Highlights.
Retinal microvascular changes reflect microangiopathic processes in the brain.
Retina is easily accessible for in vivo studying of cerebral small vessel disease.
Non-invasive capillary perfusion maps (nCPMs) are generated.
The nCPMs were automatically segmented and measured by fractal analysis.
Quantitative in vivo analyses of nCPMs are feasible with high repeatability.
Acknowledgments
Grant/financial support: Supported in part by the research grants NIH R01EY020607, NIH R01EY020607S, NIH Center Grant P30 EY014801 and the grant from Research to Prevent Blindness (RPB).
Footnotes
Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Commercial relationship: None
Financial Disclosures: All authors of the manuscript report no disclosures.
References
- Avakian A, Kalina RE, Sage EH, Rambhia AH, Elliott KE, Chuang EL, Clark JI, Hwang JN, Parsons-Wingerter P. Fractal analysis of region-based vascular change in the normal and non-proliferative diabetic retina. Curr. Eye Res. 2002;24:274–280. doi: 10.1076/ceyr.24.4.274.8411. [DOI] [PubMed] [Google Scholar]
- Azemin MZ, Kumar DK, Wong TY, Kawasaki R, Mitchell P, Wang JJ. Robust methodology for fractal analysis of the retinal vasculature. IEEE Trans. Med. Imaging. 2011;30:243–250. doi: 10.1109/TMI.2010.2076322. [DOI] [PubMed] [Google Scholar]
- Beutelspacher SC, Serbecic N, Barash H, Burgansky-Eliash Z, Grinvald A, Jonas JB. Central serous chorioretinopathy shows reduced retinal flow circulation in retinal function imaging (RFI) Acta Ophthalmol. 2011;89:e479–e482. doi: 10.1111/j.1755-3768.2011.02136.x. [DOI] [PubMed] [Google Scholar]
- Burgansky-Eliash Z, Nelson DA, Bar-Tal OP, Lowenstein A, Grinvald A, Barak A. Reduced retinal blood flow velocity in diabetic retinopathy. Retina. 2010;30:765–773. doi: 10.1097/IAE.0b013e3181c596c6. [DOI] [PubMed] [Google Scholar]
- Cheung N, Donaghue KC, Liew G, Rogers SL, Wang JJ, Lim SW, Jenkins AJ, Hsu W, Li LM, Wong TY. Quantitative assessment of early diabetic retinopathy using fractal analysis. Diabetes Care. 2009;32:106–110. doi: 10.2337/dc08-1233. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cheung N, Liew G, Lindley RI, Liu EY, Wang JJ, Hand P, Baker M, Mitchell P, Wong TY. Retinal fractals and acute lacunar stroke. Ann. Neurol. 2010;68:107–111. doi: 10.1002/ana.22011. [DOI] [PubMed] [Google Scholar]
- Doubal FN, Dhillon B, Dennis MS, Wardlaw JM. Retinopathy in ischemic stroke subtypes. Stroke. 2009;40:389–393. doi: 10.1161/STROKEAHA.108.529388. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Doubal FN, MacGillivray TJ, Patton N, Dhillon B, Dennis MS, Wardlaw JM. Fractal analysis of retinal vessels suggests that a distinct vasculopathy causes lacunar stroke. Neurology. 2010;74:1102–1107. doi: 10.1212/WNL.0b013e3181d7d8b4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goldberger AL, West BJ. Fractals in physiology and medicine. Yale J. Biol. Med. 1987;60:421–435. [PMC free article] [PubMed] [Google Scholar]
- Izhaky D, Nelson DA, Burgansky-Eliash Z, Grinvald A. Functional imaging using the retinal function imager: direct imaging of blood velocity, achieving fluorescein angiography-like images without any contrast agent, qualitative oximetry, and functional metabolic signals. Jpn. J. Ophthalmol. 2009;53:345–351. doi: 10.1007/s10384-009-0689-0. [DOI] [PubMed] [Google Scholar]
- Landa G, Jangi AA, Garcia PM, Rosen RB. Initial report of quantification of retinal blood flow velocity in normal human subjects using the Retinal Functional Imager (RFI) Int. Ophthalmol. 2012;32:211–215. doi: 10.1007/s10792-012-9547-z. [DOI] [PubMed] [Google Scholar]
- Landa G, Rosen RB. A new vascular pattern for idiopathic juxtafoveal telangiectasia revealed by the retinal function imager. Ophthalmic Surg. Lasers Imaging. 2010;41:413–417. doi: 10.3928/15428877-20100325-04. [DOI] [PubMed] [Google Scholar]
- Liew G, Wang JJ, Cheung N, Zhang YP, Hsu W, Lee ML, Mitchell P, Tikellis G, Taylor B, Wong TY. The retinal vasculature as a fractal: methodology, reliability, and relationship to blood pressure. Ophthalmology. 2008;115:1951–1956. doi: 10.1016/j.ophtha.2008.05.029. [DOI] [PubMed] [Google Scholar]
- Lim SW, Cheung N, Wang JJ, Donaghue KC, Liew G, Islam FM, Jenkins AJ, Wong TY. Retinal vascular fractal dimension and risk of early diabetic retinopathy: A prospective study of children and adolescents with type 1 diabetes. Diabetes Care. 2009;32:2081–2083. doi: 10.2337/dc09-0719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- MacGillivray TJ, Patton N. A reliability study of fractal analysis of the skeletonised vascular network using the "box-counting" technique. Conf. Proc. IEEE Eng Med. Biol. Soc. 2006;1:4445–4448. doi: 10.1109/IEMBS.2006.260821. [DOI] [PubMed] [Google Scholar]
- MacGillivray TJ, Patton N, Doubal FN, Graham C, Wardlaw JM. Fractal analysis of the retinal vascular network in fundus images. Conf. Proc. IEEE Eng Med. Biol. Soc. 2007;2007:6456–6459. doi: 10.1109/IEMBS.2007.4353837. [DOI] [PubMed] [Google Scholar]
- Mandelbrot BB. The Fractal Geometry of Nature. San Francisco: WH Freeman; 1983. Nonscaling Fractals; pp. 151–165. [Google Scholar]
- Nelson DA, Burgansky-Eliash Z, Barash H, Loewenstein A, Barak A, Bartov E, Rock T, Grinvald A. High-resolution wide-field imaging of perfused capillaries without the use of contrast agent. Clin. Ophthalmol. 2011;5:1095–1106. doi: 10.2147/OPTH.S20103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nelson DA, Krupsky S, Pollack A, Aloni E, Belkin M, Vanzetta I, Rosner M, Grinvald A. Special report: Noninvasive multi-parameter functional optical imaging of the eye. Ophthalmic Surg. Lasers Imaging. 2005;36:57–66. [PubMed] [Google Scholar]
- Talu S. Fractal analysis of normal retinal vascular network. Oftalmologia. 2011;55:11–16. [PubMed] [Google Scholar]
- Talu S. Multifractal Geometry in Analysis and Processing of Digital Retinal Photographs for Early Diagnosis of Human Diabetic Macular Edema. Curr Eye Res. 2013 doi: 10.3109/02713683.2013.779722. http://informahealthcare.com/doi/pdf/10.3109/02713683.2013.779722. [DOI] [PubMed] [Google Scholar]
- Witkin AJ, Alshareef RA, Rezeq SS, Sampat KM, Chhablani J, Bartsch DU, Freeman WR, Haller JA, Garg SJ. Comparative Analysis of the Retinal Microvasculature Visualized With Fluorescein Angiography and the Retinal Function Imager. Am. J. Ophthalmol. 2012;154(5):901–907. doi: 10.1016/j.ajo.2012.03.052. [DOI] [PubMed] [Google Scholar]
- Wong TY. Is retinal photography useful in the measurement of stroke risk? Lancet Neurol. 2004;3:179–183. doi: 10.1016/s1474-4422(04)00682-9. [DOI] [PubMed] [Google Scholar]
- Wong TY, Klein R, Sharrett AR, Couper DJ, Klein BE, Liao DP, Hubbard LD, Mosley TH. Cerebral white matter lesions, retinopathy, and incident clinical stroke. JAMA. 2002;288:67–74. doi: 10.1001/jama.288.1.67. [DOI] [PubMed] [Google Scholar]

