Abstract
Background and Objective
Diabetic retinopathy (DR) is a major complication of diabetes and the leading cause of blindness among US working-age adults. Detection of subclinical DR is important for disease monitoring and prevention of damage to the retina before occurrence of vision loss. The purpose of this retrospective study is to describe an automated method for discrimination of subclinical DR using fine structure analysis of retinal images.
Methods
Discrimination between nondiabetic control (NC; N = 16) and diabetic without clinical retinopathy (NDR; N = 17) subjects was performed using ordinary least squares regression and Fisher's linear discriminant analysis. A human observer also performed the discrimination by visual inspection of the images.
Results
The discrimination rate for subclinical DR was 88% using the automated method and higher than the rate obtained by a human observer which was 45%.
Conclusions
The method provides sensitive and rapid analysis of retinal images and could be useful in detecting subclinical DR.
1. Introduction
Diabetic retinopathy (DR) is a microvascular complication of diabetes and the leading cause of vision loss among working-age adults in the developed world [1, 2]. A population-based study has shown that DR prevalence after 15 years of diabetes is over 97% [3]. Although DR is a vision-threatening disease, its progression can be substantially controlled with early diagnosis, intensive glycemic management, and other systemic treatments [2–4]. However, detection of individuals in whom manifest DR is impending is an ongoing challenge to healthcare systems worldwide.
Microaneurysms and dot hemorrhages are the earliest signs of DR detectable by conventional clinical methods. More severe DR stages are characterized by the presence of hard exudates, neovascularization, capillary nonperfusion, fluid-filled spaces, and retinal detachment [5]. Advanced treatments, such as laser therapy, intravitreal steroid injections, intravitreal anti-VEGF agent injections, or vitreous surgery, are used to prevent vision impairment in progressed DR [6]. These treatments, however, carry risks [7], and hence, it would be advantageous to identify diabetes-related retinal abnormalities at an earlier subclinical stage for close monitoring and potential application of preventative treatment to delay development of vision-threatening DR.
Since retinal abnormalities in clinical DR are well documented, automated DR diagnosis using image analysis methods has been reported previously [8–10]. However, to the best of our knowledge, automated subclinical DR detection has not been reported, likely due to the fact that retinal abnormalities at this early stage are generally not directly discernable by visual inspection of fundus image. However, with the recent advent of optical coherence tomography angiography (OCTA), studies have shown alterations in capillary density, foveal avascular zone (FAZ) size, vessel diameters, tortuosity, branching angles, and the ratio of vessel length to diameter in subclinical DR [6, 11–14]. These alterations were detected based on statistical significance which does not necessarily translate to clinical significance and does not allow detection of abnormalities in individual cases [15]. Nevertheless, the confirmed presence of retinal vascular abnormalities in subclinical DR provides a rationale for developing image analysis techniques for automated subclinical DR detection which can be a potentially useful screening tool for the already large and rapidly growing diabetic population.
We showed in a previous study that fine structure analysis of conjunctival microvascular images can be useful for detecting clinical stages of DR [16], and this technique is highly sensitive to changes in vessel morphology such as tortuosity, vasodilation, and vasoconstriction [17]. The purpose of the current retrospective study is to test the hypothesis that fine structure analysis of retinal images can discriminate subclinical DR from nondiabetic controls.
2. Materials and Methods
2.1. Subjects
A total of 33 subjects (6 females and 27 males) participated in the study. Subjects underwent a comprehensive clinical retinal examination and were classified into nondiabetic control (NC; N = 16) and diabetic without clinical retinopathy (NDR; N = 17) subjects. The study was conducted in accordance with the tenets of the Declaration of Helsinki. An institutional review board of the University of Illinois at Chicago approved the current study. The study was explained to the subjects, and informed consents were obtained in accordance with the tenets of Declaration of Helsinki. Subjects' age (mean ± standard deviation (SD)) was 56 ± 9 years and 53 ± 10 years in NC and NDR subjects, respectively (P=0.2). The diabetes duration and hemoglobin A1C levels in NDR were 10 ± 8 years and 8 ± 2%, respectively. Three of the NDR subjects had coronary heart disease. The NDR and age-matched NC subjects were selected from our previous study [18], based on availability of good quality fundus images.
2.2. Image Acquisition and Processing
Imaging was performed by a commercially available fundus camera system with a 60° field of view. Images were acquired in color, and each one consisted of 2392 × 2048 pixels covering optic nerve head and the macula. A circular area of interest (ROI) with a radius of 3.6 mm (1000 pixels) centered on the fovea was selected from each image and converted to grayscale for analysis. Selection of this area allowed analysis of consistent regions between the subjects and was based on the assumption that retinal vascular alterations in subclinical DR are more likely to be detectable in smaller vessels and capillaries [6]. Figure 1 shows an example of selected ROI outlined by a yellow circle overlaid on the fundus images and converted to grayscale in a NC subject.
Fundus image discrimination was performed by a previously described fine structure image analysis method using a custom algorithm written in MATLAB (Release 2015b, MathWorks, Inc., Natick, MA, USA) [19]. In summary, pixels of each fundus ROI were shifted 1- or 2-pixel column-wise, row-wise, and along the diagonal to provide 8 different representations of the original images. Pixels in columns of the shifted images were stacked over each other to provide a 1D vector representation of the original image. The vectors formed a matrix and a column of ones was added to the foremost left column of this matrix to improve the discrimination by removing a parameter estimate bias due to nonzero sample means. A model image (yi,j) was defined as the weighted sum of the shifted images plus a zero-mean random process error term (ui,j) as shown in the following equation:
(1) |
where bk,l are the coefficients needing estimation. Ordinary least square (OLS) regression was used to estimate the bk,l parameters by minimizing the variance of error term. The estimated bk,l covariance matrices for each class are the source of discrimination information.
For each group of subjects (i.e., NC and NDR), a representative matrix was generated where each column of the matrix was formed by bk,l parameters that were obtained from each image in the group. Fisher's linear discriminant (FLD) analysis was used to determine a projection vector (v) based on the 2 matrices to project bk,l parameters onto a scalar axis (z-projection). For 2 groups of images acquired from N1 and N2 subjects, 3 matrixes of B1, B2, and a pooled sample Bp were formed. B1 and B2 contained OLS coefficients for group 1 and group 2, respectively, and Bp was B1 stacked over B2. Finally, covariance matrices Ωs of the Bs, s = 1, 2, and p, were estimated and used to determine the projection vector v as shown in the FLD eigenvalue equation:
(2) |
where n1 = N1 + N1 − 1, n2 = N1 − 1, and n3 = N2 − 1 and γ1 is the only nonzero eigenvalue. The projection vector v provides maximum absolute difference between the sample means of the 2 groups, while normalized by the sum of the covariance of each group.
Normality of distributions of z-projections was verified using Kolmogorov–Smirnov (KS) test to allow Kullback–Leibler discrimination (KLD) statistics as an indicator of likelihood of accurate discrimination. KLD of a discrimination function L(z) was calculated as shown in the following equation:
(3) |
where f1(z) and f2(z) are 2 z-projection density functions (Figure 2), m1 and m2 are sample means of the z-projection functions, and s1 and s2 are SD of the z-projection functions. When 2 groups of images are perfectly discriminated, L1 values for all the images in group 1 are positive and L2 values for all the images in group 2 are all negative. Consequently, misclassified images in group 1 and misclassified images in group 2 have negative and positive L1 and L2 values, respectively. Additionally, the higher L1 value for a group 1 image and the lower L2 value for a group 2 image indicate the higher likelihood of accurate discrimination. Discrimination rate was determined as the percentage ratio of the number of correctly discriminated images to the total number of the images in the 2 groups. Additional description of the fine structure technique may be found elsewhere [19].
2.3. Human Observer Image Discrimination
An experienced retinal specialist masked to subjects' diagnosis, and the result obtained by the automated discrimination, served as human observer and performed image discrimination. Each of the ROIs was visually inspected and assigned to one of the two groups. The discrimination rate for the human observer was calculated using the same formula as that used for the automated method.
3. Results
The KS test results showed that the distribution of z-projects in NC and NDR subjects was normal (P < 0.001). The automated discrimination rate was 88% (29/33) with 1 and 3 misclassifications in NC and NDR subjects, respectively. The KLD statistics between the NC and NDR subjects are shown in Figure 2. The range of L1 values for correctly classified images in group 1 was between 0.1 and 4, while the range of L2 values for correctly classified images in group 2 was between −0.2 and −6. Discrimination rate by the human observer between NC and NDR subjects was 45%.
4. Discussion and Conclusion
In the current study, an automated fine structure discrimination [19] was performed for the first time for analysis of retinal images to detect subclinical DR. Additionally, the likelihood of accurate discrimination for each of the images in the 2 groups of subclinical DR and nondiabetic control was reported.
The rate of subclinical DR discrimination using the automated technique was higher than the rate obtained by the human observer, suggesting that the method can detect retinal alterations which cannot be visually discerned by a trained observer. DR diagnosis and progression monitoring are currently based on presence of vascular pathologies, such as microaneurysms and vascular leakage. Detection of abnormalities in this early stage may prompt assessment to optimize glycemic control and possibly add new treatment to prevent or delay DR progression. It can also be used as a basis to urge patients to optimize their diabetic control. Moreover, these early-stage alterations may suggest presence of undetectable microvascular alterations in other critical organs such as the kidney or brain. In fact, association between diabetes and presence of microvascular alterations in various tissues such as brain, nail fold, and conjunctiva have been reported previously [18, 20–25]. Therefore, the method shows promise to improve monitoring and managing diabetic-related disorders throughout the body.
DR is a progressive complication of diabetes that causes vision impairment by affecting retinal vessels that supply inner retinal layers [26]. Alterations in intercapillary area, capillary density, and FAZ size were shown to be correlated with the progression of DR [6, 27, 28]. Furthermore, retinal imaging by an adaptive optics confocal scanning laser ophthalmoscope [29] showed a significant increase in tortuosity of retinal arteriovenous channels at subclinical DR [6]. Furthermore, changes in retinal oxygenation, resistive index, and blood flow have been reported in subclinical DR [27, 28, 30]. These and other retinal physiological alterations can cause vasodilation, vessel wall stiffening, and tortuosity alterations in subclinical DR which may not be visually detected by clinical evaluations. However, techniques such as fine structure analysis which use all the information in the image rather than specific microvasculopathies might be able to provide automated subclinical DR detection.
At subclinical DR stage, there are previously reported changes in the retinal vasculature, including alterations in tortuosity of retinal arteriovenous channels, retinal oxygenation, resistive index, blood flow, vessel caliber, and vessel wall stiffness [6, 26–30]. It is likely that the fine structure analysis of the retinal images detects such pathologies as a basis for discrimination. Detection of global alterations by fine structure is based on statistical and mathematical analysis at pixel level. Hence, each of the 3 × 106 ROI pixels is treated as a feature that can influence the discrimination result. This provides detection of global alterations such as vascular integrity and their pattern at an early stage, prior to visualization by clinical examination in which gross vascular changes are detectable. However, further studies are needed to determine which of these changes have greater influence on the fine structure analysis.
We believe that shortly after diabetes, abnormalities begin to develop and reach a threshold over years manifested by DR. The fine structure analysis is highly sensitive to these premature abnormalities and hence provides early diagnosis on the course of the disease. Moreover, the KLD statistics provide quantitative representation of severity of abnormalities rather than only on an ordinal scale. Furthermore, the algorithm has the advantage of requiring short computational time (e.g., less than 5 seconds on a 1.3 GHz system with 8 GB RAM) which offers substantial potential for its application to very large image sets. In fact, the method may have a significant clinical impact for subclinical DR detection, particularly due to the expected increase in the prevalence of diabetes and shortage in the number of qualified screening healthcare providers [31].
In the current study, the macular region selected for analysis contains mostly smaller caliber vessels that are more vulnerable to the disease than the larger ones [6]. Selection of this region also allowed analysis of a consistent area among the subjects. In future, inclusion of different size retinal regions in the analysis can be useful for determining the effect of regional differences on the discrimination rates. Also, the specificity of the current technique was not determined in the current study and future research is needed to determine whether it can discriminate between DR and other retinal diseases. It is important to note that since it takes time for diabetes-related abnormalities to develop [32], it is expected that there will be an interval between the onset of diabetes and the development of abnormal test results using the fine structure method. Hence, future studies are needed to determine the performance of the automated discrimination with changes over time and investigate potential correlation between the KLD values and duration of diabetes. Such a study can also demonstrate whether the glycemic treatment can reverse the level of abnormalities detected by the automated method. Finally, future studies are needed to determine the clinical utility of the current technique in evaluating, monitoring, and treating subclinical DR. Nevertheless, the finding of the current study demonstrates the potential for fine structure analysis to detect subclinical DR based on retinal images.
Acknowledgments
This study was supported by NIH research grants DK104393 and EY001792, Senior Scientific Investigator Award (MS), and departmental award from Research to Prevent Blindness.
Data Availability
The data used in this study are not publicly available due to institutional restrictions.
Conflicts of Interest
The authors have no conflicts of interest to declare.
References
- 1. Prevention C for DC and. National Diabetes Fact Sheet : National Estimates and General Information on Diabetes and Prediabetes in the United States, 2010. https://www.caldiabetes.org/Content_displayCfm?FontSize=normal&contentID=562&CategoriesID=31_2011.
- 2.Abràmoff M. D., Reinhardt J. M., Russell S. R., et al. Automated early detection of diabetic retinopathy. Ophthalmology. 2010;117(6):1147–1154. doi: 10.1016/J.OPHTHA.2010.03.046. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Klein R., Klein B. E. K., Moss S. E., Davis M. D., DeMets D. L. The wisconsin epidemiologic study of diabetic retinopathy: III—prevalence and risk of diabetic retinopathy when age at diagnosis is 30 or more years. Archives of Ophthalmology. 1984;102(4):527–532. doi: 10.1001/archopht.1984.01040030405011. [DOI] [PubMed] [Google Scholar]
- 4.Group TDC and CTR. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. New England Journal of Medicine. 1993;329:977–986. doi: 10.1056/NEJM199309303291401. [DOI] [PubMed] [Google Scholar]
- 5.Wu L., Fernandez-Loaiza P., Sauma J., Hernandez-Bogantes E., Masis M. Classification of diabetic retinopathy and diabetic macular edema. World Journal of Diabetes. 2013;4(6):290–294. doi: 10.4239/wjd.v4.i6.290. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Tam J., Dhamdhere K. P., Tiruveedhula P., et al. Disruption of the retinal parafoveal capillary network in type 2 diabetes before the onset of diabetic retinopathy. Investigative Opthalmology & Visual Science. 2011;52(12):9257–9266. doi: 10.1167/iovs.11-8481. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Merani R., Hunyor A. P. Endophthalmitis following intravitreal anti-vascular endothelial growth factor (VEGF) injection: a comprehensive review. International Journal of Retina and Vitreous. 2015;1(1) doi: 10.1186/s40942-015-0010-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Niemeijer M., Van Ginneken B., Cree M. J., et al. Retinopathy online challenge: automatic detection of microaneurysms in digital color fundus photographs. IEEE Transactions on Medical Imaging. 2010;29(1):185–195. doi: 10.1109/TMI.2009.2033909. [DOI] [PubMed] [Google Scholar]
- 9.Zhang B., Karray F., Li Q., Zhang L. Sparse Representation Classifier for microaneurysm detection and retinal blood vessel extraction. Information Sciences. 2012;200:78–90. doi: 10.1016/j.ins.2012.03.003. [DOI] [Google Scholar]
- 10.Tavakoli M., Shahri R. P., Pourreza H., Mehdizadeh A., Banaee T., Bahreini Toosi M. H. A complementary method for automated detection of microaneurysms in fluorescein angiography fundus images to assess diabetic retinopathy. Pattern Recognition. 2013;46(10):2740–2753. doi: 10.1016/j.patcog.2013.03.011. [DOI] [Google Scholar]
- 11.Safi H., Safi S., Hafezi-Moghadam A., Ahmadieh H. Early detection of diabetic retinopathy. Survey of Ophthalmology. 2018;63(5):601–608. doi: 10.1016/j.survophthal.2018.04.003. [DOI] [PubMed] [Google Scholar]
- 12.de Carlo T. E., Chin A. T., Bonini Filho M. A., et al. Detection of microvascular changes in eyes of patients with diabetes but not clinical diabetic retinopathy using optical coherence tomography angiography. Retina. 2015;35(11):2364–2370. doi: 10.1097/IAE.0000000000000882. [DOI] [PubMed] [Google Scholar]
- 13.Schottenhamml J., Moult E. M., Ploner S., et al. An automatic, intercapillary area-based algorithm for quantifying diabetes-related capillary dropout using optical coherence tomography angiography. Retina. 2016;36:S93–S101. doi: 10.1097/IAE.0000000000001288. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Sasongko M. B., Wang J. J., Donaghue K. C., et al. Alterations in retinal microvascular geometry in young type 1 diabetes. Diabetes Care. 2010;33(6):1331–1336. doi: 10.2337/dc10-0055. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Stein J. D., Lum F., Lee P. P., Rich W. L., Coleman A. L. Use of health care claims data to study patients with ophthalmologic conditions. Ophthalmology. 2014;121(5):1134–1141. doi: 10.1016/j.ophtha.2013.11.038. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Khansari M. M., O’Neill W., Penn R., Chau F., Blair N. P., Shahidi M. Automated fine structure image analysis method for discrimination of diabetic retinopathy stage using conjunctival microvasculature images. Biomedical Optics Express. 2016;7(7):p. 2597. doi: 10.1364/BOE.7.002597. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Khansari M. M., O’Neill W., Penn R., Blair N. P., Chau F., Shahidi M. An automated image processing method for classification of diabetic retinopathy stages from conjunctival microvasculature images. In: Krol A., Gimi B., editors. Proceedings of the Medical Imaging 2017: Biomedical Applications in Molecular, Structural, and Functional Imaging; 2017; Orlando, FL, USA. International Society for Optics and Photonics; p. 101372C. [DOI] [Google Scholar]
- 18.Khansari M. M., Wanek J., Tan M., et al. Assessment of conjunctival microvascular hemodynamics in stages of diabetic microvasculopathy. Scientific Reports. 2017;7(1):p. 45916. doi: 10.1038/srep45916. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.O’Neill W., Penn R., Werner M., Thomas J. A theory of fine structure image models with an application to detection and classification of dementia. Quantitative Imaging in Medicine and Surgery. 2015;5(1):356–367. doi: 10.3978/j.issn.2223-4292.2015.03.11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Brown M. R., Dyck P. J., McClearn G. E., Sima A. A. F., Powell H. C., Porte D. Central and peripheral nervous system complications. Diabetes. 1982;31(1):65–70. doi: 10.2337/diab.31.1.s65. [DOI] [PubMed] [Google Scholar]
- 21.Feke G. T., Tagawa H., Yoshida A., et al. Retinal circulatory changes related to retinopathy progression in insulin-dependent diabetes mellitus. Ophthalmology. 1985;92(11):1517–1522. doi: 10.1016/S0161-6420(85)33827-7. [DOI] [PubMed] [Google Scholar]
- 22.Zhou Y., Zhang X., Wu J. Clinical significance of microtransferrinuria in diabetic patients. Zhonghua Nei Ke Za Zhi. 1997;36(3):165–168. [PubMed] [Google Scholar]
- 23.Rayman G., Hassan A., Tooke J. E. Blood flow in the skin of the foot related to posture in diabetes mellitus. BMJ. 1986;292(6513):87–90. doi: 10.1136/bmj.292.6513.87. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.To W. J., Telander D. G., Lloyd M. E., Chen P. C., Cheung A. T. Correlation of conjunctival microangiopathy with retinopathy in type-2 diabetes mellitus (T2DM) patients. Clinical Hemorheology and Microcirculation. 2011;47(2):131–141. doi: 10.3233/CH-2010-1374. [DOI] [PubMed] [Google Scholar]
- 25.Khansari M. M., Tan M., Karamian P., Shahidi M. Inter-visit variability of conjunctival microvascular hemodynamic measurements in healthy and diabetic retinopathy subjects. Microvascular Research. 2018;118:7–11. doi: 10.1016/j.mvr.2018.01.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Sapieha P., Hamel D., Shao Z., et al. Proliferative retinopathies: angiogenesis that blinds. International Journal of Biochemistry & Cell Biology. 2010;42(1):5–12. doi: 10.1016/j.biocel.2009.10.006. [DOI] [PubMed] [Google Scholar]
- 27.Geyer O., Neudorfer M., Snir T., et al. Pulsatile ocular blood flow in diabetic retinopathy. Acta Ophthalmologica Scandinavica. 1999;77(5):522–525. doi: 10.1034/j.1600-0420.1999.770507.x. [DOI] [PubMed] [Google Scholar]
- 28.Dimitrova G., Kato S., Tamaki Y., et al. Choroidal circulation in diabetic patients. Eye. 2001;15(5):602–607. doi: 10.1038/eye.2001.193. [DOI] [PubMed] [Google Scholar]
- 29.Tam J., Martin J. A., Roorda A. Noninvasive visualization and analysis of parafoveal capillaries in humans. Investigative Opthalmology & Visual Science. 2010;51(3):1691–1698. doi: 10.1167/iovs.09-4483. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Khoobehi B., Firn K., Thompson H., Reinoso M., Beach J. Retinal arterial and venous oxygen saturation is altered in diabetic patients. Investigative Opthalmology & Visual Science. 2013;54(10):7103–7106. doi: 10.1167/iovs.13-12723. [DOI] [PubMed] [Google Scholar]
- 31.National Institute of Diabetes and Digestive and Kidney Diseases. National Diabetes Statistics. Bethesda, MD, USA: National Institute of Diabetes and Digestive and Kidney Diseases; 2007. [Google Scholar]
- 32.Riddle M. C. Type 2 Diabetes Mellit. Totowa, NJ, USA: Humana Press; 2008. The transition from oral agents to combination insulin/oral therapy; pp. 169–181. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The data used in this study are not publicly available due to institutional restrictions.