Abstract
This study evaluates the use of infrared (IR) images of the retina, obtained without flashes of light, for machine-based detection of macular oedema (ME). A total of 41 images of 21 subjects, here with 23 cases and 18 controls, were studied. Histogram and gray-level co-occurrence matrix (GLCM) parameters were extracted from the IR retinal images. The diagnostic performance of the histogram and GLCM parameters was calculated in hindsight based on the known labels of each image. The results from the one-way ANOVA indicated there was a significant difference between ME eyes and the controls when using GLCM features, with the correlation feature having the highest area under the curve (AUC) (AZ) value. The performance of the proposed method was also evaluated using a support vector machine (SVM) classifier that gave sensitivity and specificity of 100%. This research shows that the texture of the IR images of the retina has a significant difference between ME eyes and the controls and that it can be considered for machine-based detection of ME without requiring flashes of light.
Subject terms: Biomarkers, Signs and symptoms
Introduction
Macular edema (ME) refers to swelling within the retinal tissues that occurs when damaged blood vessels leak fluid and protein deposits into the macula region, leading to tissue thickening and distorting vision1. ME is irreversible and is the major cause of a decrease in visual acuity in patients with diabetes2. Early diagnosis and monitoring of ME can decrease the risk of vision loss.
The diagnosis and monitoring of ME require retinal imaging; here, the three routinely used modalities are as follows: colour fundus photography (FP), fluorescein angiography (FA) and optical coherence tomography (OCT). Some of the recent advancements in the field include the use of hyperspectral imaging and infrared imaging3. Various automatic methods for ME detection and grading using image processing and pattern recognition techniques have been investigated3–39. Previously, a number of methods have been proposed for grading diabetic macular oedema (DME) based on the location and segmentation of exudates13,25,38 and macula or on the extraction of texture or image-based features23,40.
A texture analysis is performed by extracting the statistical feature sets from the local distributions, which can be used later for segmentation or classification purposes. The gray-level co-occurrence matrix (GLCM) for obtaining the texture features were introduced by Haralick in 1973, and this has been widely used in retinal image analyses41,42. Lim et al. used a modified combined local binary pattern to extract local gray-level features of all channels and then a support vector machine (SVM) classifier to classify DME. The proposed method yields a sensitivity and specificity of 80% and 70%, respectively20. Jerald et al. extracted global features such as intensity, colour and texture for detecting the severity of DME. Hard exudates were detected using an extreme learning machine classifier (ELM); the detection performance had an accuracy rate of 98%, sensitivity of 99.5% and specificity of 85–98%43. Tariq et al. used morphological features and a Gabor filter to segment the exudates; then, the distance between the exudate and macula centre was used to grade the severity of DME44.
One common limitation when it comes to retinal vasculature examinations is that an eye-fundus examination requires a flash of light, which is unpleasant and causes short-term blindness for most people; however, a small number of people are intolerant to this. OCT provides a cross-section of the retina that is suitable for detecting ME but has limited availability in remote regions45–47. One option is to use the IR image of the retina, which does not require a flash of light and is routinely performed during the step before OCT. Infrared imaging offers certain advantages over the traditional colour FP. The ocular fundus shows a high reflection of IR compared with visible light and has a longer depth of penetration that can reach into retinal sublayers. Compared with color images, IR produces a better vessel to background contrast and is suitable for detecting subretinal pathologies. Moreover, IR images improve the quality of illumination by removing the out-of-focus, scattered components of the reflected light48,49. Further, IR imaging does not require a flash of light and, hence, is less traumatising. These images have the potential to provide deeper visualisation of the retina, including the choroidal vessels, because it comprises longer wavelengths compared with the Green channel, which is commonly used in colour FP. Thus, detecting pathologies, even in the presence of haemorrhages and cataracts, which may go undetected under other imaging systems50–52.
IR imaging is routinely used during an OCT examination to view the structure of the retina, subretinal lesions and accumulation of fluid in the retina; to image patients with choroidal neovascularization53–56, with age-related macular degeneration57,58 and with Stargardt’s disease;59 and to provide information about the site of leakage and leakage patterns. However, the use of IR images for macular edema has not been reported. There is also no reported GLCM analysis of IR images of the retina.
The current paper reports the differences between the IR images of the retina of eyes with ME and eyes without ME. To overcome the limitation of poor contrast and for the unsupervised analysis of these images, global features of the image were investigated.
Results
The performance of the proposed method was evaluated on a dataset of 41 IR images, which are described in the methodology section. The dataset consists of 18 eyes of control subjects who had no sign of Diabetic Retinopathy (DR) or DME and 23 eyes with clinically diagnosed ME.
Histogram and GLCM parameters were extracted from IR images of ME eyes and controls. Statistical analyses were performed using MedCalc 10.0.2.0 (MedCalc Software Ostend, Belgium) for both the histogram and GLCM parameters. The statistical distribution was obtained and evaluated using the Shapiro–Wilk test. A one-way ANOVA was performed to determine statistically significant group differences between the control and ME cases. Table 1 shows the comparison of the texture parameters obtained from IR images of the control and ME cases.
Table 1.
Comparison of the texture parameters between IR images of the control and ME cases.
| Parameter | Control | ME cases | P-value* | |
|---|---|---|---|---|
| Histogram | Mean | 4.68 | 4.53 | 0.07 |
| Skewness | − 0.20 | − 0.05 | 0.08 | |
| Kurtosis | 3.45 | 3.42 | 0.84 | |
| Entropy | 0.257 | 0.25 | 0.75 | |
| Variance | 1.58 | 1.44 | 0.15 | |
| Energy | 1.57 | 1.56 | 0.81 | |
| GLCM | Autocorrelation | 15.09 | 16.61 | 0.04* |
| Contrast | 0.143 | 0.107 | 0.007* | |
| Correlation | 0.997 | 0.961 | < 0.001* | |
| Cluster shade | − 4.09 | − 2.15 | 0.19 | |
| Cluster prominence | 107.19 | 111.0 | 0.80 | |
| Dissimilarity | 0.125 | 0.101 | 0.03* | |
| Homogeneity | 0.939 | 0.950 | 0.04* | |
| Diffuse variance | 0.143 | 0.107 | 0.007* | |
| Diffuse entropy | 0.378 | 0.325 | 0.02* | |
| The infinite measure of correlation 2 | 0.933 | 0.948 | 0.001* | |
| Sum average | 7.04 | 7.73 | 0.06 | |
| Sum entropy | 1.83 | 1.83 | 0.96 | |
| Sum variance | 36.95 | 40.05 | 0.04* | |
| Maximum probability | 0.38 | 0.33 | 0.86 | |
| Inverse difference moment normalised (IDMNC) | 0.997 | 0.998 | 0.008* | |
| Inverse difference normalised (INDNC) | 0.986 | 0.988 | 0.04* |
*p-value from a one-way ANOVA.
The six histogram parameters that do not show statistically significant differences between the case and control are as follows: the mean, skewness, variance, kurtosis, entropy and energy (p > 0.05). Among the GLCM parameters the features autocorrelation, contrast, correlation, dissimilarity, homogeneity, diffuse variance, diffuse entropy, sum variance and inverse difference moment normalised are the parameters that show a significant difference between the cases and controls. Other GLCM features were not found to be significantly different between the two groups.
In the current work, an SVM classifier was used for classifying the features of the IR images, and a “leave-one-out” cross-validation method was used to validate the results. In this method, the learning algorithm can be tested once for each instance after it is trained using all the other instances of the dataset60. The results show a sensitivity, specificity and accuracy of 100% when using an SVM classifier with five top-ranked texture features of IR images.
The diagnostic performance for diagnosing ME was calculated using the cut-off values for each GLCM parameter according to the Youden Index. The receiver operating characteristic (ROC) was constructed, and the area under the curve (AUC), here referred to as AZ, for each parameter was calculated. The ROC curve provides sensitivity versus specificity, while the AUC estimates the overall performance.
The diagnostic performance using the cut-off values were calculated for each significant GLCM parameter to diagnose ME; these are summarised in Table 2. Among these GLCM parameters, the correlation feature has the highest AUC (AZ) value; AZ = 1, having a sensitivity, specificity and accuracy of 100%. Figure 1 shows the ROC curve and AUC for the top six GLCM parameters for categorising ME.
Table 2.
Diagnostic performance of the GLCM features for detecting ME.
| Parameter | Cut-off | Sensitivity | Specificity | AUC (Az) | |
|---|---|---|---|---|---|
| GLCM parameters | Contrast | ≤ 0.13 | 82.61 | 66.67 | 0.74 |
| Correlation | ≤ 0.98 | 100 | 100 | 1.00 | |
| Diffuse entropy | < 0.38 | 86.96 | 50.0 | 0.69 | |
| Diffuse variance | ≤ 0.13 | 82.61 | 66.67 | 0.74 | |
| Dissimilarity | ≤ 0.12 | 86.96 | 50.0 | 0.67 | |
| Homogeneity | > 0.93 | 86.96 | 44.4 | 0.64 | |
| Inverse difference moment normalised | > 0.99 | 78.26 | 66.67 | 0.72 | |
| Inverse difference normalised | ≤ 0.98 | 86.96 | 44.44 | 0.65 | |
| The infinite measure of correlation 1 | > 0.72 | 78.26 | 66.67 | 0.78 | |
| The infinite measure of correlation 2 | > 0.93 | 86.96 | 72.22 | 0.78 |
Figure 1.
The ROC curve analysis for the top six GLCM features used for categorising ME. Among these GLCM parameters, the correlation feature has the highest AUC (AZ) value; AZ = 1 and is the most suitable for differentiating between the ME case and control subjects.
Discussion
The current research proposes the use of an IR image of the retina as an alternative modality for detecting ME. IR imaging has the advantage that it does not require a flash of light or dilation of the pupil and can be performed by inexpensive eye-fundus imaging.
Several eye-examination devices such as OCT incorporate the use of infrared images to support the scan. Although IR has number of potential advantages, it suffers from some technical limitations. Some of these include the following: (a) the presence of hyperreflective artefacts—related to reflection or light-scatter because of posterior chamber intraocular lenses—in almost 25% of eyes, here most commonly in pseudophakic patients61,62, and (b) restricting the illumination wavelength to an IR band that emphasises the subretinal structures at the expense of other layers63,64. IR reflectance images also lack direct quantitative measures of retinal thickness. Finally, IR images have low contrast, blurred edges with a central light reflex that causes a light streak along the vessel length, making the segmentation of these images a challenging task. Our previous work overcame some of these limitations by enhancing the quality of the image and segmentation of retinal vasculature using a series of morphological operations65. Our work has as shown that for healthy eyes, the vasculature information in IR images is comparable with the colour fundus images.
A texture analysis gives global measures of the texture of the image and has been used for medical images to identify disease conditions. It has the advantage of not requiring segmentation of the images, and it can be performed automatically and without supervision. In the current paper, we have proposed the automatic detection of ME using first- and second-order texture features of IR retinal images, identifying the most significant features that can be used for differentiating between ME eyes and eyes with no ME or DME.
The results from the one-way ANOVA test show that there is no statistically significant difference between healthy eyes and ME eyes for the histogram features, with all p-values > 0.05. However, 10 Haralick texture features—autocorrelation, contrast, correlation, dissimilarity, homogeneity, diffuse variance, diffuse entropy, an infinite measure of correlation, sum variance, inverse difference and inverse difference moment normalised—extracted using the GLCM matrix showed a statistically significant difference between the controls and ME cases; p-value < 0.05.
Feature selection was performed using the ANOVA filter-based method, which selects the top-ranked features as an input to the classifier. The performance of the proposed method was evaluated based on the ROC curve. The results show that the GLCM parameter ‘correlation’ is the most suitable for differentiating between the ME case and control subjects, with AUC = 1.0, here having 100% sensitivity and specificity. A comparison of the proposed method with several previous works reported in the literature is shown in Table 3; this shows that the method described in the current paper is better than the other methods. Another potential advantage of this method is that it uses IR retinal images, which have been reported to detect pathologies even in presence of haemorrhages and cataracts, which can go undetected when using other imaging systems51,52. This is also the first time the GLCM of IR images have been reported.
Table 3.
Summary of various methods used for automatic detection of ME using colour FP, FA and OCT.
| Author | Imaging type | Database | Method and classifiers | Performance index |
|---|---|---|---|---|
| Nayak et al.25 | Colour fundus photography | Private (350) | Matched correlation and neural network |
Sensitivity—95.40% Specificity—100% |
| Siddalingaswamy et al.34 | Private (148) | Clustering and location of exudates |
Sensitivity—95.60% Specificity—96.15% |
|
| Fleming et al.12 | Private (14,406) | Morphological image processing, exudate location |
Accuracy—99.2% (NCSME) Accuracy—97.3% (CSME) |
|
| Lim et al.20 | MESSIDOR (88) | Watershed transform and exudate location |
Sensitivity—80.90% Specificity—90.20% Accuracy—85.20% |
|
| Ang et al.6 | Private (90) | Mathematical morphology and neural network |
Sensitivity—90% Specificity—100% Accuracy—96.67% |
|
| Akram et al.4 | MESSIDOR (1,200) | Morphological image processing features extracted from filter bank response, energy and support vector machine |
Sensitivity—92.60% Specificity—97.80% Accuracy—97.30% |
|
| Giancardo et al.13 | HEI-MED and MESSIDOR (1,200) | Wavelet transform, Kirsch edge detection, colour, and support vector machine | AUC—0.94 | |
| Punnolil et al.28 | DRIVE, DIARETDB1, STARE (251) | Morphological features of exudates, texture and SVM |
Sensitivity—96.89% Specificity—97.15% |
|
| Alipour et al.5 | Private (75) | Curvelet and foveal avascular zone (FAZ) size |
Sensitivity—93% Specificity—86% |
|
| Tariq et al.44 | MESSIDOR and STARE (1,281) | Gabor filter, thresholding and support vector machine |
Accuracy—97.20% (MESSIDOR) Accuracy—97.53% (STARE) |
|
| Tariq et al.38 | MESSIDOR and STARE (1,281) | Morphological features of exudates, Gabor filter, thresholding, texture and Gaussian mixture model |
Accuracy—97.30% (MESSIDOR) Accuracy—97.89% (STARE) |
|
| Medhi and Dandapat22 |
DRIVE, DIARETDB1, and HRF (174) |
Top hat filtering, thresholding and exudate location |
Sensitivity—97.5% Specificity—98.7% |
|
| Ibrahim et al.18 | Private (300) | Entropies, fuzzy Sugeno, discrete wavelet transform, and neuro-fuzzy interference |
Accuracy—95.93% (MESSIDOR) Accuracy—98.55% |
|
| Aditya et al.19 | MESSIDOR (1,200) | Texture features |
Sensitivity—91% Specificity—75% Accuracy—80% |
|
| Rabbani et al.29 |
oct, fa, fp oct |
24 eyes | Segmentation of leakage areas in FA | Active contour model, accuracy—86.6% |
| Goebel et al.14 | 136 eyes | OCT can detect macular oedema with great reliability; retinal thickness correlated with FA leakage in angiograms | The sensitivity of the system for detecting CSME was 89% with a specificity of 96% | |
| Yang et al.39 | 33 eyes | OCT showed a mean standard deviation foveal thickness as 255.6 ± 138.9 μm in CSME eyes and 174.6 ± 38.2 μm in eyes without CSME (p = 0.051) | ||
| Arif et al.7 | 62 eyes | The discriminant analyser was used to classify retina oedema using OCT | Accuracy 100%—retinal oedema patients, 91.8%—healthy | |
| Bilal et al.15 | 90 oct volumes | Detection and grading of maculopathy using coherent tensor features from OCT volume and 7D vector features (three features—retinal thickness profile and four features—retinal fluids) | Accuracy—97.98% | |
| Sugmuk et al.36 | 16 images | RNFL segmentation to find the drusen and then the classification of disease into Age Related Macular Degeneration (AMD) and DME using the binary classifier | ||
| Pai et al.26 | 3 images | OCT shows some volcano signs in the vitreo-foveolar interface in patients' chronic DME | ||
| Sadda et al.30 | 71 eyes | Grid scanning OCT was used for the detection of CSME | System sensitivity 89% and specificity 85% | |
| Schaudig et al.33 | 22 patients | A significant difference in retinal thickness was found between the subjects having diabetic retinopathy and normal | ||
| Tocino et al.32 | 111 subjects | Foveal thickness was a strong and independent predictor of CSME | AUC for this predictor-0.92; for a cut-off point of 180 micron, the sensitivity was 93% and specificity 75% | |
| Syed et al.37 | 90 OCT volumes | Automatic diagnostic of ME and central serous retinopathy using 3D retinal surface |
Accuracy—98.88% Sensitivity—100% Specificity—96.66% |
|
| Martinez et al.21 | 277 eyes |
Detection and validation of OCT using foveal thickness and intraretinal fluid Binary logistic regression model |
Accuracy—0.88 Sensitivity—0.83 Specificity—0.89 |
|
| Panozzo et al.27 | 1,200 eyes |
Classification of ME using OCT The classification takes into account five parameters: retinal thickness, diffusion, volume, morphology and presence of vitreous traction for determine the severity of ME |
||
| Hassan et al.16 | 71 images |
Segmentation of retinal layers using OCT Coherent tensor used |
SVM classifier, Accuracy—97.78% | |
| Dash et al.11 | 55 IMAGES | Pattern classification techniques |
Sensitivity—95% Specificity—100% Accuracy—96% |
|
| Samagaio et al.31 | Multi-level image thresholding approach | F-Measures of 87.54% and 91.99% for the Diffuse Retinal Thickening (DRT) and Cystoid Macular Edema (CME) detections, respectively | ||
| Sibide et al.35 | Two datasets: 32 SD-OCT and 45 SD-OCT volumes | Anomaly detection for DME detection | Sensitivity and a Specificity of 80% and 93% on the first dataset, and 100% and 80% on the second one | |
| Our proposed work | Private (44) | Histogram and GLCM texture features, SVM, KNN and Naïve Bayes |
KNN and SVM: Sensitivity—100% Accuracy—100% Naïve Bayes: Sensitivity—100% Accuracy—97.6% |
|
One of the limitations of the present study is that the sample size is small, and the study is only cross-sectional. Longitudinal studies with a larger number of patients are necessary to validate the results before these can be considered to be used in clinical practice.
Deep learning algorithms have shown a high level of performance for the classification of medical images and have been developed for the detection of DR and DME66. In the future, integrating deep learning algorithms for extracting features, segmentation and classification could help in the automatic detection of ME when using IR retinal images.
Methodology
Data collection
The current study investigated the IR images of the retina of ME patients who presented at Gladstone Park Eye Clinic, Melbourne, Australia, irrespective of any aetiologies such as diabetes, central retinal branch vein occlusion and dye leakage associated with choroidal neovascularisation syndrome. The study was approved by the RMIT human ethics committee and conducted following Helsinki accord 1986 (modified 2004). The experimental protocol was explained in plain language to each participant, and written informed consent was obtained before the experiment. An optic disc-centred IR image was obtained from each participant using the Spectralis SD-OCT (Heidelberg Engineering, Heidelberg, Germany) with an integrated IR-SLO imaging system, having a λ = 830 nm, FOV = 30 × 30 degree and 768 × 768 pixels minimum image size. A total of 41 images of 21 subjects—23 cases and 18 control images—were used. All the volunteers (controls) self-declared themselves as healthy, non-smokers, moderately active and with no history of diabetes, hypertension or retinopathy. Two experienced clinicians visually inspected the OCT B-scans for structural changes, such as the presence of intraretinal cysts, thickened posterior vitreous surface adhering to the macula, sponge-like retinal swelling, cystoid macular oedema and serous retinal detachment67, and graded the IR images as ME present (cases).
Methods
The current paper presents an automatic method for the detection of ME using the first- and second-order texture features of IR retinal images. The proposed system is accomplished in four stages: (i) image pre-processing, (ii) feature extraction, (iii) feature selection and (iv) classification. The framework of the proposed method is shown in Fig. 2.
Figure 2.

The framework of the proposed method for the detection and classification of ME cases and controls.
Image pre-processing
IR images suffer from noise and low contrast, making pre-processing of these images a crucial step. This improves the quality of the image by reducing the noise and uneven illumination in the images and enhancing the contrast. A two-step approach was used for this purpose: IR retinal images were first filtered using a median filter, and this was followed by a contrast enhancement procedure using contrast-limited histogram equalisation (CLAHE).
A median filter is a nonlinear filter with edge-preserving properties that reduce noise without compromising the edges. This was used to remove the Gaussian and Speckle noise68. Contrast enhancement was performed by using CLAHE with regional operations and suitable retinal images, which may have light intensity variations across the image69. Figure 3 shows an example of the pre-processing performed on IR retinal images prior to feature extraction.
Figure 3.
An example of pre-processing operations performed on the IR retinal image. (a) Original IR image. (b) IR image after performing CLAHE. (c) Median filtered IR image.
The optic disc (OD) appears as a bright, yellow region with a higher colour intensity than the surrounding retinal areas. In the current study, for the automatic detection of macular oedema, we focused on the texture of the exudates, microaneurysm and blood vessels in the IR retinal image. To reduce the effect of intensity variations caused by optic disc, segmentation of OD was performed by pre-processing using contrast stretching, CLAHE and morphological opening and closing operations70.
Feature extraction
Feature extraction is an important step in designing an automatic diagnostic system71. Statistical texture features have been reported as useful for the classification of retinal images by analysing the spatial distribution of the gray levels, computing the local features and obtaining a statistical distribution of the local features.
Statistical texture analysis methods are classified as first-, second- and higher-order based on the number of pixels that define the local features. In first-order statistics, only one pixel is involved, and a pair of pixels are used for the second-order statistics72.
In the current study, we investigated the first- and second-order texture features, that is, histogram and GLCM features for the extraction of a texture from IR retinal images for classifying these images to detect ME cases. This was performed after these images had been pre-processed, as described earlier.
First-order statistics—histogram texture features
The first-order statistics histogram texture features provide a 1D histogram of the image based on its gray-level values. The histogram of an image gives a count of how many pixels an image possesses with a given gray-level value. The probable density (p(i)) of occurrence of intensity level is calculated by dividing the values h(i) by the total number of pixels in the Nx × Ny image73, and h(i) represents the intensity level histogram .
| 1 |
We considered the gray levels in the image range from 0 ≤ i ≤ Ng − 1, where Ng is a total number of particular gray levels.
A histogram describes the characteristics of an image, for example, a narrowly distributed histogram represents a low contrast image74. The features extracted from a histogram that can be used to characterise textures are called central moments. The most commonly used central moments are mean, variance, kurtosis, energy, entropy and skewness. Mean defines the average level of intensity in an image. The variance describes the variation of intensity around the mean. Skewness is the measure of the asymmetry of gray-level values around the mean. Kurtosis gives a measure of the flatness of the histogram. While, energy gives an estimate of the uniformity of the intensity level distribution, entropy is a measure of randomness or degree of disorder present in an image. The entropy value is the largest when all the elements of the co-occurrence matrix are the same and small when the elements are unequal75. A simple image has a low entropy, while a complex image entropy value is high76.
GLCM features
The GLCM is a statistical method for extracting second-order statistical texture features from an image. It characterizes the texture of an image by calculating how often a pair of pixels with a specific value and relationships occur in an image. The GLCM is a square matrix (G) with dimension Ng, where Ng is the number of gray levels in the image.
[i, j] represents the number of times a pixel value i is adjacent to pixel value j in an image and then dividing the entire matrix i by the total number of such comparisons made. Each entry in the matrix represents the probability of pixel value i to be found adjacent to the pixel value j77.
| 2 |
Because the adjacency can be defined to occur in each of four directions (horizontal, vertical, left and right diagonals) in 2D, for a square pixel image for four matrices can be calculated. Figure 4 shows the four directions of adjacency used to calculate the Haralick texture features77.
Figure 4.

The four directions of adjacency used to calculate the Haralick features. The Haralick statistics are generated for co-occurrence matrix using these directions.
Haralick et al.78 proposed a method for using the GLCM to quantify the spatial relationship between neighbourhood pixels in an image. Haralick features have been successfully used in various application for the analysis of skin cancer and medical image analysis41,42,79–82. In the current paper, we have extracted the texture features from the probability matrix to classify macular oedema from IR retinal images. Around 56 GLCM parameters that include 14 Haralick features were extracted in four directions 0°, 45°, 90° and 135° using the IR images78,83–85. No other study has investigated the GLCM features of IR images. Table 4 shows the important Haralick features calculated from the IR retinal images. Haralick texture features were computed using these equations and the notations mentioned below.
Table 4.
Haralick texture features calculated from the GLCM matrix.
| Autocorrelation84 | ||
| Contrast78 | ||
| Correlation78 | ||
| Cluster prominence78 | ||
| Cluster shade78 | ||
| Difference entropy78 | ||
| Difference variance78 | ||
| Dissimilarity84 | ||
| Entropy78 | ||
| Energy78 | ||
| Homogeneity84 | ||
| Maximum probability84 | ) | |
| Sum average78 | ||
| Sum entropy78 | ||
| Inverse difference85 | ||
| Information measure of correlation 178 | ||
| Information measure of correlation 278 | ||
Where: is the ith and jth entry in the normalized gray level dependence matrix.
Feature selection
Feature selection removes extraneous features, leading to improved model prediction. In the present study, ANOVA was used to extract the best features for classifying images; this applies statistical measures to assign scores to each feature, retaining the top-ranked features in the system and removing the low-ranked features. The top-ranked five features were selected and fed to the classifier for further processing.
Classification
The texture features of the IR eye-fundus images were classified into two groups using an SVM: normal and ME eyes. SVMs are reliable and practical classifiers for small datasets, can be applied in classifications and regression analyses and have been previously used for similar applications42,44,86. A linear function was used in this model, and the dataset was divided into training (50%) and test sets (50%).
Acknowledgements
The authors would like to thank Olivija Tsaketas and the entire staff of North West Eye Specialists, Gladstone Park, Melbourne, Australia for their valuable time, advice and support during the data collection and the entire study.
Author contributions
A.A. managed the experiments, collected the database, performed the statistical analysis and drafted the manuscript. D.K. developed the concept, designed the study, supervised the study and edited the manuscript.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Scholl S, Augustin A, Loewenstein A, Rizzo S, Kupperman B. General pathophysiology of macular edema. Eur. J. Ophthalmol. 2011;21(Suppl 6):S10–19. doi: 10.5301/EJO.2010.6050. [DOI] [PubMed] [Google Scholar]
- 2.Bresnick GH. Diabetic macular edema. A review. Ophthalmology. 1986;93:989–997. doi: 10.1016/s0161-6420(86)33650-9. [DOI] [PubMed] [Google Scholar]
- 3.Jain, A. B., Prakash, V. J. & Bhende, M. Techniques of fundus imaging. Sci. J. Med. Vis. Res. Foun.33 (2015).
- 4.Akram, M. U., Akhtar, M. & Javed, M. Y. In Neural Information Processing. (eds Huang T., Zeng Z., Li C., & Leung C.S.) 36–43 (Springer, Berlin).
- 5.Alipour SHM, Rabbani H, Akhlaghi M, Dehnavi AM, Javanmard SH. Analysis of foveal avascular zone for grading of diabetic retinopathy severity based on curvelet transform. Graefes Arch. Clin. 2012;250:1607–1614. doi: 10.1007/s00417-012-2093-6. [DOI] [PubMed] [Google Scholar]
- 6.Ang M, Acharya R. Computer-based identification of diabetic maculopathy stages using fundus images. In: El-Baz AS, editor. Multi Modality State-of-the-Art Medical Image Segmentation and Registration Methodologies. Berlin: Springer; 2011. pp. 377–399. [Google Scholar]
- 7.Arif, A. W., Nasim, A., Syed, A. M. & Hassan, T. Automated diagnosis of retinal edema from optical coherence tomography images. In Conf Proc CSCI, 554–557 (2017).
- 8.Baby, C. G. & Chandy, D. A. Content-based retinal image retrieval using dual-tree complex wavelet transform. In Conf Proc IEEE SIPP, 195–199 (2013).
- 9.Chowriappa P, Dua S, Acharya U, Muthu Rama Krishnan M. Ensemble selection for feature-based classification of diabetic maculopathy images. Comput. Biol. Med. 2013;43:2156–2162. doi: 10.1016/j.compbiomed.2013.10.003. [DOI] [PubMed] [Google Scholar]
- 10.Chua, K. et al. Automated diagnosis of maculopathy stages using texture features. Int. J. Integr. Care13 (2013).
- 11.Dash P, Sigappi AN. Automatic detection of diabetic macular edema from b-scan oct images based on pattern classification techniques. Eurasian J. Anal. Chem. 2018;13:219–230. [Google Scholar]
- 12.Fleming AD, et al. Automated detection of exudates for diabetic retinopathy screening. Phys. Med. Biol. 2007;52:7385–7396. doi: 10.1088/0031-9155/52/24/012. [DOI] [PubMed] [Google Scholar]
- 13.Giancardo L, et al. Exudate-based diabetic macular edema detection in fundus images using publicly available datasets. Med. Image Anal. 2012;16:216–226. doi: 10.1016/j.media.2011.07.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Goebel W, Kretzchmar-Gross T. Retinal thickness in diabetic retinopathy: a study using optical coherence tomography (OCT) Retina. 2002;22:759–767. doi: 10.1097/00006982-200212000-00012. [DOI] [PubMed] [Google Scholar]
- 15.Hassan, B. & Hassan, T. Fully automated detection, grading and 3D modeling of maculopathy from OCT volumes. In Conf Proc IEEE C-CODE, 252–257 (2019).
- 16.Hassan T, Akram MU, Hassan B, Syed AM, Bazaz SA. Automated segmentation of subretinal layers for the detection of macular edema. Appl. Opt. 2016;55:454–461. doi: 10.1364/AO.55.000454. [DOI] [PubMed] [Google Scholar]
- 17.Hunter A, Lowell JA, Ryder B, Basu A, Steel D. Automated diagnosis of referable maculopathy in diabetic retinopathy screening. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2011;2011:3375–3378. doi: 10.1109/IEMBS.2011.6090914. [DOI] [PubMed] [Google Scholar]
- 18.Ibrahim S, et al. Classification of diabetes maculopathy images using data-adaptive neuro-fuzzy inference classifier. Med. Biol. Eng. Comput. 2015;53:1345–1360. doi: 10.1007/s11517-015-1329-0. [DOI] [PubMed] [Google Scholar]
- 19.Kunwar, A., Magotra, S. & Sarathi, M. P. Detection of high-risk macular edema using texture features and classification using SVM classifier. In Conf Proc IEEE ICACCI, 2285–2289 (2015).
- 20.Lim, S. T., Ahmed, M. K. & Lim, S. L. Automatic classification of diabetic macular edema using a modified completed local binary pattern (CLBP). In Conf Proc IEEE ICSIPA, 6–10 (2017).
- 21.Martinez-Perez ME, et al. Retinal vascular tree morphology: a semi-automatic quantification. IEEE Trans. Biomed. Eng. 2002;49:912–917. doi: 10.1109/TBME.2002.800789. [DOI] [PubMed] [Google Scholar]
- 22.Medhi, J. P. N., Meenakshi Dandapat, S. Automatic grading of macular degeneration from color fundus images. In Conf Proc WCIT, 511–514 (2012).
- 23.Mookiah MRK, et al. Application of different imaging modalities for diagnosis of diabetic macular edema. Comput. Biol. Med. 2015;66:295–315. doi: 10.1016/j.compbiomed.2015.09.012. [DOI] [PubMed] [Google Scholar]
- 24.Naguib, A. M., Ghanem, A. M. & Fahmy, A. S. Content based image retrieval of diabetic macular edema images. In Conf Proc IEEE CBMS, 560–562 (2013).
- 25.Nayak J, Bhat PS, Acharya UR. Automatic identification of diabetic maculopathy stages using fundus images. J. Med. Eng. Technol. 2009;33:119–129. doi: 10.1080/03091900701349602. [DOI] [PubMed] [Google Scholar]
- 26.Pai SA, Hussain N, Hebri SP, Lootah AM, Dekhain MA. Volcano like pattern in optical coherence tomography in chronic diabetic macular edema. Saudi J. Ophthalmol. 2014;28:157–159. doi: 10.1016/j.sjopt.2014.03.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Panozzo G, et al. Diabetic macular edema: an OCT-based classification. Semin. Ophthalmol. 2004;19:13–20. doi: 10.1080/08820530490519934. [DOI] [PubMed] [Google Scholar]
- 28.Punnolil, A. A novel approach for diagnosis and severity grading of diabetic maculopathy. In Conf Proc IEEE ICACCI, 1230–1235 (2013).
- 29.Rabbani H, Allingham MJ, Mettu PS, Cousins SW, Farsiu S. Fully automatic segmentation of fluorescein leakage in subjects with diabetic macular edema. Invest. Ophthalmol. Vis. Sci. 2015;56:1482–1492. doi: 10.1167/iovs.14-15457. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Sadda SR, et al. Automated detection of clinically significant macular edema by grid scanning optical coherence tomography. Ophthalmology. 2006;113(1187):e1181–1187.e1112. doi: 10.1016/j.ophtha.2005.12.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Samagaio G, et al. Automatic macular edema identification and characterization using OCT images. Comput. Methods Programs Biomed. 2018;163:47–63. doi: 10.1016/j.cmpb.2018.05.033. [DOI] [PubMed] [Google Scholar]
- 32.Sanchez-Tocino H, Alvarez-Vidal A, Maldonado MJ, Moreno-Montanes J, Garcia-Layana A. Retinal thickness study with optical coherence tomography in patients with diabetes. Invest. Ophthalmol. Vis. Sci. 2002;43:1588–1594. [PubMed] [Google Scholar]
- 33.Schaudig UH, Glaefke C, Scholz F, Richard G. Optical coherence tomography for retinal thickness measurement in diabetic patients without clinically significant macular edema. Ophthalmic Surg. Lasers. 2000;31:182–186. [PubMed] [Google Scholar]
- 34.34Siddalingaswamy, P. C. & Prabhu, K. G. Automatic grading of diabetic maculopathy severity levels. In Conf Proc IEEE ICSMB, 331–334 (2010).
- 35.Sidibé D, et al. An anomaly detection approach for the identification of DME patients using spectral domain optical coherence tomography images. Comput. Methods Programs Biomed. 2017;139:109–117. doi: 10.1016/j.cmpb.2016.11.001. [DOI] [PubMed] [Google Scholar]
- 36.Sugmk, J., Kiattisin, S. & Leelasantitham, A. Automated classification between age-related macular degeneration and diabetic macular edema in OCT image using image segmentation. In Conf Proc IEEE BEMiCON, 1–4 (2014).
- 37.Syed AM, Hassan T, Akram MU, Naz S, Khalid S. Automated diagnosis of macular edema and central serous retinopathy through robust reconstruction of 3D retinal surfaces. Comput. Methods Programs Biomed. 2016;137:1–10. doi: 10.1016/j.cmpb.2016.09.004. [DOI] [PubMed] [Google Scholar]
- 38.Tariq, A., Akram, M. U., Shaukat, A. & Khan, S. A. A computer aided system for grading of maculopathy. In Conf Proc IEEE CIBEC, 31–34 (2012).
- 39.Yang CS, Cheng CY, Lee FL, Hsu WM, Liu JH. Quantitative assessment of retinal thickness in diabetic patients with and without clinically significant macular edema using optical coherence tomography. Acta Ophthalmol. Scand. 2001;79:266–270. doi: 10.1034/j.1600-0420.2001.790311.x. [DOI] [PubMed] [Google Scholar]
- 40.Deepak KS, Sivaswamy J. Automatic assessment of macular edema from color retinal images. IEEE Trans. Med. Imaging. 2012;31:766–776. doi: 10.1109/TMI.2011.2178856. [DOI] [PubMed] [Google Scholar]
- 41.Lee J, Zee BCY, Li Q. Detection of neovascularization based on fractal and texture analysis with interaction effects in diabetic retinopathy. PLoS ONE. 2013;8:e75699–e75699. doi: 10.1371/journal.pone.0075699. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Naseri, A., Pouyan, A. A. & Kavian, N. An image processing approach to automatic detection of retina layers using texture analysis. In Conf Proc IEEE ICBME, 1–4 (2010).
- 43.Kumar, S. J. J. & Ravichandran, C. G. Macular Edema severity detection in colour fundus images based on ELM classifier. In Conf Proc IEEE I-SMAC, 926–933 (2017).
- 44.Tariq A, Akram MU, Shaukat A, Khan SA. Automated detection and grading of diabetic maculopathy in digital retinal images. J. Digit. Imaging. 2013;26:803–812. doi: 10.1007/s10278-012-9549-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Bodnar ZM, Desai A, Akduman L. Diabetic macular edema. In: Meyer C, Saxena S, Sadda S, editors. Spectral Domain Optical Coherence Tomography in Macular Diseases. India: Springer; 2017. pp. 117–127. [Google Scholar]
- 46.Schmidt-Erfurth U, et al. Guidelines for the management of diabetic macular edema by the european society of retina specialists. Ophthalmologica. 2017;237:185–222. doi: 10.1159/000458539. [DOI] [PubMed] [Google Scholar]
- 47.Brancato R. Optical coherence tomography (oct) in macular edema. Doc. Ophthalmol. 1999;97:337–339. doi: 10.1023/a:1002146408861. [DOI] [PubMed] [Google Scholar]
- 48.Elsner AE, Burns SA, Weiter JJ, Delori FC. Infrared imaging of sub-retinal structures in the human ocular fundus. Vision. Res. 1996;36:191–205. doi: 10.1016/0042-6989(95)00100-e. [DOI] [PubMed] [Google Scholar]
- 49.Webb RH, Hughes GW, Delori FC. Confocal scanning laser ophthalmoscope. Appl. Opt. 1987;26:1492–1499. doi: 10.1364/AO.26.001492. [DOI] [PubMed] [Google Scholar]
- 50.Aliahmad B, Kumar DK, Jain R. Automatic analysis of retinal vascular parameters for detection of diabetes in Indian patients with no retinopathy sign. Int. Sch. Res. Notices. 2016;2016:8423289. doi: 10.1155/2016/8423289. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Elsner AE, Burns SA, Hughes GW, Webb RH. Reflectometry with a scanning laser ophthalmoscope. Appl. Opt. 1992;31:3697–3710. doi: 10.1364/AO.31.003697. [DOI] [PubMed] [Google Scholar]
- 52.Schmitz-Valckenberg S, et al. Combined confocal scanning laser ophthalmoscopy and spectral-domain optical coherence tomography imaging of reticular drusen associated with age-related macular degeneration. Ophthalmology. 2010;117:1169–1176. doi: 10.1016/j.ophtha.2009.10.044. [DOI] [PubMed] [Google Scholar]
- 53.Viola F, et al. Choroidal abnormalities detected by near-infrared reflectance imaging as a new diagnostic criterion for neurofibromatosis 1. Ophthalmology. 2012;119:369–375. doi: 10.1016/j.ophtha.2011.07.046. [DOI] [PubMed] [Google Scholar]
- 54.Theelen T, Hoyng CB, Klevering BJ. Near-infrared subretinal imaging in choroidal neovascularization. In: Holz FG, Spaide R, editors. Medical Retina: Focus on Retinal Imaging. Berlin: Springer; 2010. pp. 77–93. [Google Scholar]
- 55.Hassenstein A, Meyer CH. Clinical use and research applications of heidelberg retinal angiography and spectral-domain optical coherence tomography—a review. Clin. Exp. Ophthalmol. 2009;37:130–143. doi: 10.1111/j.1442-9071.2009.02017.x. [DOI] [PubMed] [Google Scholar]
- 56.Bhavsar KV, et al. Acute macular neuroretinopathy: a comprehensive review of the literature. Surv. Ophthalmol. 2016;61:538–565. doi: 10.1016/j.survophthal.2016.03.003. [DOI] [PubMed] [Google Scholar]
- 57.Theelen T, Berendschot TTJM, Hoyng CB, Boon CJF, Klevering BJ. Near-infrared reflectance imaging of neovascular age-related macular degeneration. Graefes Arch. Clin. 2009;247:1625–1633. doi: 10.1007/s00417-009-1148-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Ly A, Nivison-Smith L, Assaad N, Kalloniatis M. Infrared reflectance imaging in age-related macular degeneration. Ophthalmic Physiol. Opt. 2016;36:303–316. doi: 10.1111/opo.12283. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Chun R, et al. The value of retinal imaging with infrared scanning laser ophthalmoscopy in patients with stargardt disease. Retina. 2014;34:1391–1399. doi: 10.1097/IAE.0000000000000070. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Sammut C, Webb GI. Leave One Out Cross-Validation. New York: Springer; 2010. [Google Scholar]
- 61.Pang CE, Freund KB. Ghost maculopathy: an artifact on near-infrared reflectance and multicolor imaging masquerading as chorioretinal pathology. Am. J. Ophthalmol. 2014;158:171–178.e172. doi: 10.1016/j.ajo.2014.03.003. [DOI] [PubMed] [Google Scholar]
- 62.Forte R, et al. Multimodal imaging of dry age-related macular degeneration. Acta Ophthalmol. Scand. 2012;90:e281–287. doi: 10.1111/j.1755-3768.2011.02331.x. [DOI] [PubMed] [Google Scholar]
- 63.Elsner AE, et al. Scanning laser reflectometry of retinal and subretinal tissues. Opt. Express. 2000;6:243–250. doi: 10.1364/oe.6.000243. [DOI] [PubMed] [Google Scholar]
- 64.Hartnett ME, Elsner AE. Characteristics of exudative age-related macular degeneration determined in vivo with confocal and indirect infrared imaging. Ophthalmology. 1996;103:58–71. doi: 10.1016/s0161-6420(96)30731-8. [DOI] [PubMed] [Google Scholar]
- 65.Ajaz A, Aliahmad B, Kumar DK. A novel method for segmentation of Infrared Scanning Laser Ophthalmoscope (IR-SLO) images of retina. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2017;2017:356–359. doi: 10.1109/EMBC.2017.8036836. [DOI] [PubMed] [Google Scholar]
- 66.Sahlsten J, et al. Deep learning fundus image analysis for diabetic retinopathy and macular edema grading. Sci. Rep. 2019;9:10750–10750. doi: 10.1038/s41598-019-47181-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Trichonas G, Kaiser PK. Optical coherence tomography imaging of macular oedema. Br. J. Ophthalmol. 2014;98:ii24–ii29. doi: 10.1136/bjophthalmol-2014-305305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Paranjape RB. Fundamental enhancement techniques. In: Bankman IN, editor. Handbook of Medical Image Processing and Analysis. 2. Cambridge: Academic Press; 2009. pp. 3–18. [Google Scholar]
- 69.Pizer SM, et al. Adaptive histogram equalization and its variations. Comput. Vis. Graph Image Process. 1987;39:355–368. [Google Scholar]
- 70.Zubair, M., Yamin, A. & Khan, S. A. Automated detection of optic disc for the analysis of retina using color fundus image. In Conf Proc IEEE IST, 239–242 (2013).
- 71.Li Y, Zhang Y, Geng A, Cao L, Chen J. Infrared image enhancement based on atmospheric scattering model and histogram equalization. Opt. Laser Technol. 2016;83:99–107. [Google Scholar]
- 72.Agwu, K. K. & Ohagwu, C. Histogram-based texture characterization and classification of brain tissues in non-contrast CT images of stroke patients. In Pattern Recognition-Analysis and Applications, 81–108 (2016).
- 73.Nailon WH. Texture Analysis Methods for Medical Image Characterisation. In: Mao Y, editor. Biomedical Imaging. London: IntehOpen; 2010. [Google Scholar]
- 74.Materka, A. & Strzelecki, M. Texture analysis methods—a review. COST B11 report (1998).
- 75.Sergyan, S. Color histogram features based image classification in content-based image retrieval systems. In Conf Proc IEEE SAMI, 221–224 (2008).
- 76.Selvarajah S, Kodituwakku S. Analysis and comparison of texture features for content based image retrieval. IJLTC. 2011;108:2045–5364. [Google Scholar]
- 77.Boland, M. V. Haralick texture features. https://murphylab.web.cmu.edu/publications/boland/boland_node26.html (1999).
- 78.Haralick RM, Shanmugam K, Dinstein I. Textural features for image classification. IEEE Trans. Syst. Man Cybern. 1973;SMC-3:610–621. [Google Scholar]
- 79.Fernandez C, et al. Texture analysis in gel electrophoresis images using an integrative kernel-based approach. Sci. Rep. 2016;6:19256. doi: 10.1038/srep19256. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Marcos JV, et al. Automated pollen identification using microscopic imaging and texture analysis. Micron. 2015;68:36–46. doi: 10.1016/j.micron.2014.09.002. [DOI] [PubMed] [Google Scholar]
- 81.Ou X, Pan W, Xiao P. In vivo skin capacitive imaging analysis by using grey level co-occurrence matrix (GLCM) Int. J. Pharm. 2014;460:28–32. doi: 10.1016/j.ijpharm.2013.10.024. [DOI] [PubMed] [Google Scholar]
- 82.VijayaLakshmi B, Mohan V. Kernel-based PSO and FRVM: An automatic plant leaf type detection using texture, shape, and color features. Comput. Electron. Agric. 2016;125:99–112. [Google Scholar]
- 83.Lofstedt T, Brynolfsson P, Asklund T, Nyholm T, Garpebring A. Gray-level invariant haralick texture features. PLoS ONE. 2019;14:e0212110. doi: 10.1371/journal.pone.0212110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Soh L, Tsatsoulis C. Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices. Trans. Geosci. Remote Sens. 1999;37:780–795. [Google Scholar]
- 85.Clausi DA. An analysis of co-occurrence texture statistics as a function of grey level quantization. Can J. Remote Sens. 2002;28:45–62. [Google Scholar]
- 86.Usman Akram, M., Mahmood A. & Javed, M. Y. An automated system for the grading of diabetic maculopathy in fundus images. In Conf Proc IEEE ICONIP, 36–43 (2012).


