Abstract
In this paper, an algorithm is introduced to solve the global optimization problem for melanoma skin cancer segmentation. The algorithm is based on the smoothing of an auxiliary function that is constructed using a known local minimizer and smoothed by utilising Bezier curves. This function achieves all filled function properties. The proposed optimization method is applied to find the threshold values in melanoma skin cancer images. The proposed algorithm is implemented on PH2, ISBI2016 challenge, and ISBI 2017 challenge datasets for melanoma segmentation. The results show that the proposed algorithm exhibits high accuracy, sensitivity, and specificity compared with other methods.
1. Introduction
Skin cancers are the most widely recognised type of growths in humans. They are a type of destructive disease that affects skin [1]. Most skin growths are reparable during the early stages. Therefore, the early diagnosis of skin tumours can save patients. Nowadays, computers and intelligent handheld devices are common and therefore can help diagnose melanoma earlier. Computer-Aided Diagnosis (CAD) tools can be connected to such devices to create a smart system that helps dermatologists recognize the melanoma. Moreover, Codella et al. [2] have shown in recent research that some of these CAD systems have better performance than average human expert agreements. Traditional melanoma detection CAD programs generally consist of three main components: the segmentation of the lesion, the extraction of functions, and the classification of features [3]. Yu et al. [4] showed that although melanoma patients can only be classified by means of features extracted using deep study models, the diagnostic performance is significantly improved by incorporating segmented lesions.
Numerous problems in the fields of engineering, economics, and natural sciences can be represented as global optimization problems. Thus, from a technical and scientific point of view, it is becoming increasingly important to study and develop methods that can solve this class of difficult mathematical problems. Currently, numerous new theoretical and practical methods have been reported to search for the global optimum. The one-dimensional optimization method is one of the most effective approaches for this purpose. This method is based on selecting directions randomly. The group of one-dimensional algorithms is referred to as line search methods [5]. They define an algorithm in which the direction of search is determined randomly at each iteration. This class of optimization methods is used as a part of descent techniques, which depend on objective function derivatives. The filled function method was produced by Ge (1990) [6]. It is produced with respect to passing from the current local minimizer to the lower one until the global minimizer is determined. Numerous classes of filled functions have been introduced by several authors (see, e.g., [6–12]). Bezier curves were introduced to solve the nonsmoothness of curves. They were developed by Pierre Bezier in 1962 for the styling of motorcar bodies [13]. Currently, Bezier curves are broadly used in computer graphics and animation. They are normally used for curve and surface design. In this study, a new auxiliary function with properties in nonsmooth global optimization is developed. This auxiliary function achieves all filled function properties, and it is used for finding the threshold value in melanoma skin cancer images. Even though the proposed algorithm has demonstrated powerful in both local and global searches and can be widely used in various optimization problems, it has some limitations including parameters adjustment, as it is a delicate task since it directly affects the efficiency of the auxiliary function. This paper contributes to the development of melanoma detection using new auxiliary function with properties in nonsmooth global optimization algorithm. In this study, the melanoma in the dermoscopic images was detected by three steps. The red channel on the colored dermoscopy image is selected in the preprocessing step. A 2D median-size 25∗25 filter and morphological filtering based on the Gaussian kernel have been used for smoothing. The following step was to determine the optimum melanoma segmentation threshold value using the proposed algorithm. Eventually, the estimated optimum threshold value has been used as the thresholding method used in the Otsu [14]. In order to demonstrate the effectiveness of this study, the proposed method has been evaluated on three public dermoscopic image databases: PH2 [15], ISBI2016 challenge [16], and ISBI 2017 challenge [17]. This paper is organized as follows. In Section 2, related works are viewed. In Section 3, the new method is presented, preceded by preliminaries and assumptions related to global optimization. In Section 4, the melanoma detection using global optimization algorithm is proposed. Evaluation results with comparisons are reported in Section 5. Finally, the conclusion of the study is remarked in Section 6.
2. Related Works
The conventional method for determining skin malignancy is the biopsy technique [3, 18]. In this technique, skin is scratched or evacuated, and samples are collected for research and testing. Computer-based skin disease location is beneficial to patients because patients can distinguish skin tumours without visiting a healing centre or without the assistance of a specialist [3].
Xie et al. [19] proposed novel convolutional neural network for skin lesion segmentation. In their method, they generated high-resolution feature maps to preserve spatial details. For the enhancement of features, the special and channel-wise mechanism was adopted.
Hwang and Celebi [20] solved surface in skin figures and applied mathematical approaches such as the gray stage coprevalence matrix. They reported that surface investigation may exactly detect the boundary with a smooth surface, and such surface study is the segmentation of dermatological images [21, 22]. Mishra and Celebi [23] reported the detection of skin abnormalities (particularly melanomas) using image processing methods and machine learning. Melanoma is typically considered as a dull-raised injury; these tumours develop from colored cells. A few melanomas lose color, having no or almost dull shade, and they can appear pink, white, or tan. Melanomas are considered to be the most dangerous of skin growths. Even though Merkel cell carcinoma is lethal in most cases, melanoma generally causes more deaths than several other types of skin disease. According to the American Cancer Society, approximately 76,380 (46,870 male and 29,510 female) new instances of melanoma were reported in 2016, among which 10,130 cases were fatalities (6750 male and 3380 female). The frequency of melanoma has been rising globally each year. Numerous lives can be saved if melanomas can be identified at the earliest stages when they are effectively treatable. Various examination methods based on different advances are being widely developed for the early identification of melanoma.
Jain and Pise [24] proposed methods of detecting melanoma skin cancer using computer systems and image processing. Numerous studies have demonstrated that computer vision can play a vital role in medical image diagnosis. The contribution to the framework was the skin sore figure. After that, by applying novel figure preparing procedures, it is examined to finish near the skin growth.
Jaleel et al. [25] detected skin cancer using computer systems. The biopsy technique is commonly used for skin disease recognition. In biopsy, skin is evacuated or scratched and samples undergo extensive testing. Computer-based skin growth identification is beneficial to patients who can distinguish a skin malignancy without visiting a healing centre or without the assistance of a specialist. Computer-based identification utilises imaging strategies and artificial intelligence. The distinctive phases of identification include the accumulation of dermoscopic figures, search of the figures for expelled hairs and noise, fragmentation of the figures by utilising the maximum entropy threshold, extraction of highlights using a gray level coevent matrix, and arrangement by employing an artificial neural network. A backpropagation neural network is utilised for ordering. It categorises a given informational index as cancerous or noncancerous.
Esteva et al. [26] proposed techniques for the segmentation of different types of skin carcinoma. Profound convolutional neural networks (CNNs) indicated the potential for general and specific factor assignments crosswise over multiple fine-grained protest classes.
Ramlakhan and Shang [27] proposed a classification system for cancerous skin lesions. In their technique, a model of a figure was constructed by a robotised melanoma acknowledgement framework using Android cell phones. The framework comprised of three noteworthy segments, i.e., figure division, computation, and characterisation. It was intended to be run on a cell phone with a camera or on a tablet computer. Hoshyar et al. [28] investigated the automated early detection of skin malignancy. Dermatology imaging researchers assumed that finding skin melanomas can be automated based on certain physical features and shading information that are typical of the characterisations of skin tumours. Goyal and Jain [29] reported the computer-based automated detection of melanoma skin malignancy. Melanoma skin tumours occur when shade-producing cells (melanocytes) grow uncontrollably, and these tumours result in pain.
Karargyris et al. [30] proposed a new application for image processing to identify skin malignancy using a smartphone. Xu et al. [31] proposed a technique for the analysis and classification of melanocytic skin cancer. The proposed technique contains four essential modules. In the first module, a multiassurance framework parcels the epidermis and dermis zones. Next, an epidermis examination is performed, in which the nuclear morphologies and spatial spreads of the epidermis features are investigated.
Li and Shen [32] proposed a method of analysing skin lesions using a deep learning network. Two deep learning techniques were proposed to address three principle aspects in the field of skin injury figure manipulation, i.e., sore division, sore dermoscopic highlight extraction, and sore characterisation. A deep learning system composed of two completely coevolutionary residual networks (FCRNs) is proposed to produce segment results and rough configuration results at the same time. A measurement unit for the lesion index (LICU) was designed to simplify coarse cluster tests by computing a warm separation chart. For dermoscopic highlight extraction, a straight CNN was suggested. Various injury rates were over 1000 × 700 pixels, requiring high-estimation costs. A deep learning system requires to rescale of injury estimates. Moreover, resizing figures can misrepresent the skin injury. In the first case, a sore figure's middle region has been edited and then comparatively resized to a lower determination. The median area value has been set at 0.8 of the figure height and thus modified with respect to the figure emphasis. Since the exact probability maps of various skin soreness groups provide pathologists with valuable data, the LICU has been suggested to refine the conceived gross skin sore result maps derived from FCRNs.
Dorj et al. [33] proposed a method for skin cancer classification using a deep CNN. The focus of the proposed strategy was the assignment of characterising skin tumours by utilising an ECOC SVM and a profound CNN. A number of figures contained noise such as different organs and apparatuses. These figures were edited to decrease noise for obtaining better results. A current and preprepared AlexNet CNN was utilised for removing highlights. An ECOC SVM classifier was used for skin growth.
Cueva et al. [34] proposed a method for skin cancer detection using computer systems. In their method, figure handling was created to produce the asymmetry, border, color, and diameter of melanoma by utilising neural systems to group various types of moles. Subsequently, this calculation was created after an examination of 200 figures produced an execution of 97.51%. The early identification of skin tumours increases the probability of a cure, such as those found in the cutting-edge stages. In this manner, the death rate of this condition may be reduced. Additionally, late examinations have demonstrated that the estimations of the execution on the arrangement of melanoma by a dermatologist are in the range of 75 to 84%.
Alfed and Khelifi [35] proposed a technique for detecting the types of skin cancers from dermoscopic images. Numerous mechanised methods have been proposed to determine and arrange infections to have agreeable skin disease location execution. Despite this, reducing the false discovery rate is difficult and time consuming because false positives trigger alerts and require mediation by a specialist pathologist for facilitating examination and screening. In this technique, a programmed skin malignancy-finding framework that consolidates diverse textural and shading highlights was proposed. New textural and shading highlights were utilised for effective and exact discovery.
3. Preliminaries of Global Optimization
This section provides definitions and assumptions. A general global optimization problem is indicated as follows:
(1) |
where Λ ⊂ ℝn is the feasible domain of x that is specified by constraints, and x = (x1, ⋯⋯,xn)T.
Problem (1) is smooth if function f is continuously differentiable; otherwise, problem (1) is nonsmooth.
Definition 1 (see [36]). —
The point x∗ ∈ Λ is said to be a global minimizer of f if f(x∗) ≤ f(x) for all x ∈ Λ.
Definition 2 (see [8]). —
The basin, B∗, of the function, f(x), at an isolated local minimizer, xk∗, is a connected domain containing xk∗, in which the steepest descent trajectory of f(x) converges to xk∗ from any initial point in B∗.
Definition 3 (see [13]). —
A Bezier curve is characterised by a set of control points, Cn, and it is defined as follows:
(2) where
(3) denotes the Bernstein basis polynomials of degree n.
The following assumptions are satisfied in the rest of this paper:
-
(A1).The search should ideally have decent directions; this implies that
(4) -
(A2).The search directions should be gradient related, so that
where q > 0 is a constant.(5) -
(A3).The determination of δk should include one-dimensional minimisation. This ensures that
(6)
3.1. New Global Optimization Method
The proposed auxiliary function is constructed based on the best local minimizer of f(x) found so far and the elimination function as
(7) |
The typical feature of this function is to remove local minimizers, higher than the previously found minimizer, and keep the original, f(x), function unchanged in a region in which the function values are lower than the best value of the algorithm. In other words, it has the following properties:
If f(xk∗) ≤ f(x)⟹γ(x, xk∗) = f(xk∗), for all x ∈ Λ
If f(xk∗) > f(x)⟹γ(x, xk∗) = f(x), for all x ∈ Λ
By utilising multiplication with a piecewise function, ψΛ1(x), function (7) can be rewritten as
(8) |
where piecewise function ψΛ1(x) is defined by
(9) |
and includes all possible cases of function γ(x, xk∗) according to the values of x and set Λ1 = {x ∈ Λ : f(xk∗) > f(x)}. All terms of function (8) are smooth except for those related to piecewise function ψΛ1(x). Hence, it is sufficient to smooth function ψΛ1(x) to ensure that function (8) is smoothed. By utilising the Bezier curves given by Definition 3, the functions y1 and y2 can be defined as follows:
(10) |
where τ = f(x) − f(xk∗) and b1 > 0, 0 < b2 < 1. These functions can be used to obtain the smoothed form of ψΛ1(x), which can be written as
(11) |
Thus, the smoothed form of function (8) can be written as follows:
(12) |
Theorem 1 . —
Suppose xk∗ is the local minimizer of f, and parameters b1 and b2 are defined as above, then we have
(13) for all x ∈ Λ.
Proof —
From the definitions of and γ(x, xk∗), we have
(14)
According to the states of τ and parameters b1 and b2, we consider the following four cases:
Case 1 . —
If τ > b2, this gives
(15) for x ∈ Λ.
Case 2 . —
If b2 ≥ τ > 0, we have
(16) for x ∈ Λ.
Case 3 . —
If 0 ≥ τ>−b2/b1, we have
(17) for x ∈ Λ.
Case 4 . —
If τ≤−b2/b1, we have for
(18) for x ∈ Λ.
As described above, the local removal process loses significant information and contains several removed local minimizers, which are so hard to handle for the algorithm. Improper implementation also leads to additional complications in addressing the global optimization problem. Developing an appropriate method for looking for the best solutions that have been identified so far to find better solutions or basins is important. An escape function, ζ, is therefore provided for the treatment of removed local minimizers. This feature is based on the best, xk∗, solution that has been found so far, as follows:
(19) |
where a is a real-value constant. ζ is an escape function that has the form (1/(1 + ‖x − xk∗‖2)) and satisfies the following properties:
(20) |
The fundamental properties of auxiliary function (19) can be demonstrated by multiple theorems.
Theorem 2 . —
Suppose xk∗ is a local minimizer of f and is defined by (19), then point xk∗ is a local maximiser of .
Proof —
As xk∗ is a local minimizer of function f, there exists κ > 0. χ = N(xk∗, κ) is a neighbourhood of xk∗, such that f(x) ≥ f(xk∗) for any x ∈ χ. When x ≠ xk∗, then
(21) Therefore, we have
(22)
Thus, xk∗ is a local maximiser of .
Theorem 3 . —
Suppose xk∗ is a local minimizer of f, then has no stationary point for x ∈ Λ2, where Λ2 = {x ∈ Λ | f(x) ≥ f(xk∗), x ≠ xk∗}.
Proof —
In case τ = f(x) − f(xk∗) > b2, we have
(23) For any x satisfying f(x) ≥ f(xk∗), we have
(24)
However, ‖a∇ζ(‖x − xk∗‖2)‖ > 0 for any x ∈ Λ2, i.e., does not have a stationary point at x ∈ Λ2.
Theorem 4 . —
Suppose xk∗ is a local minimizer point of f but not global and f has a lower minimizer than xk∗, then has a stationary point in Λ1 = {x ∈ Λ | f(x) < f(xk∗)} if a = |a| ≤ L/T, where ‖∇(aζ(‖x − xk∗‖2))‖ ≤ |a|T and ‖∇f‖ ≤ L.
Proof —
Selecting parameters b1 and b2 to be sufficiently small, our smoothed function, , can be obtained as
(25) in the most part of the lower basin. As the norm of the gradient of the function,
(26) is bounded, there exists a number T > 0 such that
(27) Hence, the following inequality,
(28) enables f to increase faster than escape function ζ decreases, providing a stationary point in Λ1, which implies
(29)
The idea of the algorithm can be described in the following three important steps:
The first step is to reduce the objective function into a one-dimensional function in each search direction, dk. The one-dimensional functions are found using Fdk(δ) = f(x0 + δdk) as a function of δ
The second step is to construct an auxiliary function, , at δki. Point δki is any arbitrary local minimum of Fdk(δ), and it is used as an initial point to search for the global minimizer in direction dk
The third step is to repeat the above phases for all search directions to obtain the local minimizers of f(x). The lowest among these minimizers is the required global minimizer of f(x).
4. Melanoma Detection Using Global Optimization Algorithm
In this section, the method of global-optimization-based melanoma detection is explained step by step.
Step 1 . —
The original image is fetched from a database.
Step 2 . —
The ground truth image is fetched from the database.
Step 3 . —
In current melanoma skin cancer segmentation, the original grayscale image is preprocessed by employing two transformations. One is the conversion of the grayscale image to RGB, and the other is median filtering conversion. This conversion eliminates hue and saturation but maintains luminance. Median filtering reduces noise such as salt-and-pepper noise.
Step 4 . —
After median filtering, the histogram of the median image is calculated. It provides information about the intensity distribution of the median image along with the location of the distribution.
Step 5 . —
The proposed global optimization algorithm is applied to the histogram of the median image using Otsu's method. The weighted sum of the variance of the histogram is considered as a fitness function.
Step 6 . —
Finally, the global optimization method provides the threshold value for detecting melanoma. This threshold value is compared with the median filtering image. If a point of the image is larger than the threshold value, then the point is changed to white; otherwise, the point is changed to black.
Step 7 . —
After the image is converted to black and white, an image overlay function is applied to mask the corner of the image. After the masking, the final detected image is generated and compared with the ground truth image.
Sensitivity, specificity, positive predicted value, negative predicted value, accuracy, and computation time are analysed for effective comparison.
The flowchart for global-optimization-based melanoma detection is shown in Figure 1. The steps of global optimization for skin cancer segmentation are shown as a graphical abstract in Figure 2. In this study, for the validation of the proposed optimization process, the PH2 dataset has been used. Every coefficient was evaluated by a competent dermatologist for the numbering factors of analytic performance, the manual partition of lesion areas, and the dermoscopic norm [37].
5. Evaluation Results
The International Skin Imaging Collaboration recommends several metrics for performance evaluation. These metrics indicate the performance of each algorithm and method that categorises pixels correctly. Such metrics show the output of each algorithm and process that correctly categorises pixels. This analysis measures precision (Acc (%)), specificity (Spe (%)), positive prediction (PPV), negative predictive value (NPV), and sensitivity (Sen (%)). The following equations are used for the quantitative analysis of the results of all the techniques applied by the various parameters:
(30) |
Figure 3 shows the processed melanoma images used to prove the effectiveness of the proposed algorithm. The effectiveness of the proposed method is proved by comparing it with a newly developed method, i.e., the ASLM method∗ (details available at 10.1016/j.com-pmedimag.2016.05.002). Six melanoma images are randomly selected, and detection is carried out using the proposed method and ASLM method. The images are shown in Figure 4. The final images obtained by the proposed method are more accurate than those obtained by the ASLM method. Table 1 shows the comparison of the performance parameters of the global optimization algorithm with JSEG, SRM, KPP, K-means, Otsu, Level Set, and ASLM for 200 image detections. Based on these results, the proposed method produces superior parameters, with a specificity of 0.9928 and an accuracy of 0.9011.
Table 1.
Method | Sen | Spe | Acc |
---|---|---|---|
Otsu (MATLAB 2014a) | 0.5221 | 0.7064 | 0.6518 |
SRM [49] | 0.6518 | 08757 | 0.6766 |
KPP (MATLAB 2014a) | 0.4147 | 0.9581 | 0.7815 |
Level set [50] | 0.7188 | 0.8003 | 0.7842 |
K-means (open CV2.4) | 0.7291 | 0.8430 | 0.8249 |
JSEG [51] | 0.7108 | 0.9714 | 0.8947 |
ASLM | 0.8024 | 0.9722 | 0.8966 |
Global optimization algorithm | 0.8892 | 0.9933 | 0.932 |
The sensitivity of the proposed method higher than that of the other methods, except the ALSM method. The results obtained using the proposed global optimization method on the PH2 database images of malignant lesions (melanomas) show IMD088 (blue-whitish veil, streaks, and regression areas), IMD284, IMD405, and IMD419 (blue-whitish veil) for the second, third, and fourth rows, IMD424 (blue-whitish veil and streaks) for the fifth row, and IMD425 (blue-whitish veil and regression areas) for the sixth row. The computational speeds for all processing steps are provided in Table 2.
Table 2.
Proposed method (global optimization) | Total time consuming (sec) |
---|---|
Image processing | 19.25 ± 2.02 |
Classification | (18.27 ± 12.13) × 10−3 |
All performance parameters are calculated utilising a stratified cross validation method, in which the PH2 database is divided into three subgroups, each with approximately 40 unhealthy moles and 160 healthy moles for skin cancer lesions. Table 3 shows a few performance parameters of the six processed images selected randomly from the PH2 database. A recognised statistical assessment parameters are applied to experimentally compare the implementation of the proposed algorithm with existing state-of-the-art segmentation algorithms. The proposed algorithm is applied to 200 benign and melanoma medical images obtained from the PH2 database [38], and the values of the parameters in the algorithm are taken as follows:
(31) |
Table 3.
Image no. | PPV | NPV | Computation time (sec) |
---|---|---|---|
1 | 0.901184 | 0.999942 | 3.312 |
2 | 1 | 0.988564 | 3.407 |
3 | 0.984021 | 1 | 3.489 |
4 | 0.970134 | 0.997304 | 3.579 |
5 | 0.924157 | 0.998954 | 3.357 |
6 | 0.9327 | 0.9898 | 3.217 |
From the ISBI 2016 and ISBI 2017 databases, the most complicated images (i.e., images with dermoscopes, bubbles, hair, and multiple colors) have been used in their original dimensions. These databases contain 8-bit dermoscopic RGB images from 540∗722 to 4499∗6748 pixels, with different image dimensions. In addition, both databases included the original images coupled with the boundaries of lesion segmentation, which have been recorded by professional dermatologists.
Figure 5 lists the segmentation results, where the measurement of the comparative methods was taken from the original papers. Deeper learning methods achieve better results than the method in [39], and with the proposed method, the highest Jac and Dic values are obtained. Therefore, the proposed method outperforms comparable methods and segments of skin lesions effectively.
Figure 6 also compares, in terms of Sen, Spe, Acc, Dic, and Jac, the proposed approach and other common methods employed by the ISBI 2017 database.
According to uneven skin patches, such as freckles, dermoscopic image repositories could have several small objects.
Such small objects can be screened out by using the median filter. In some cases, all impurities are not removed and the filter has an impact on algorithm work and results.
Figure 7 shows images that fail to the segment. The color contrast of skin lesion and underlying skin in rows 2 and 3 is identical. In this case, the optimal threshold value is difficult to determine because of color differences between the skin lesions and the background with no noticeable pigmentation in the lesions. If the contrast between the skin lesion and the skin around is not sufficient enough, the gray threshold algorithm of global optimization takes in a large part of the skin around the image and stretches to the edge of the image. It also causes a segmentation failure as the mask reaches the image's edge. Considering that the primary skin lesion is an adjacent area, segmented images should first involve only one adjacent context with no isolated elements or troughs. The first area (including the image) can be of any size and possibly bordering the image. This is why the image failed in row 1.
The comparison of state-of-the-art methods and the global optimization algorithm is provided in Table 4. If sensitivity is considered as the most significant component, which implies that every patient with skin cancer is detected, the global optimization algorithm has the highest performance. Thus, the global optimization algorithm is suitable for finding and segmenting melanoma skin cancer.
Table 4.
Number of cases | |||||
---|---|---|---|---|---|
References | Benign | Melanoma | Sen (%) | Spe (%) | Acc (%) |
D'Amico and Stanganelli [52] | 927 | 50 | 96.41 | 87.16 | 91.78 |
Tanaka et al. [53] | 181 | 70 | 90.00 | 98.30 | 94.00 |
Maglogiannis and Kosmopoulosb [54] | 14 | 20 | 90.00 | 93 | 94.00 |
Marques et al. [55] | 146 | 17 | 94.10 | 77.40 | 85.50 |
Olszewska and Semantic [56] | 24 | 24 | 100 | 66.66 | 83.33 |
Zagrouba and Barhoumi [57] | 160 | 40 | 71.30 | 93.50 | 82.00 |
Aljanabi et al. [58] | 160 | 40 | 95.50 | 98.40 | 96.02 |
Proposed global optimization algorithm | 160 | 40 | 95.93 | 98.99 | 96.28 |
6. Conclusion
In this paper, a new method is proposed for melanoma skin cancer segmentation. The method is based on the global optimization technique, and it uses an auxiliary function for performing directional search via Bezier curves. The proposed algorithm is a fully automatic detection technique that does not require a training phase. Moreover, its computation time for detecting melanoma images is extremely short. The proposed method is verified experimentally using three public dermoscopic image databases. The performance of the proposed algorithm is compared with the existing melanoma segmentation techniques in terms of sensitivity, specificity, and accuracy. Evaluation test results show that our proposed segmentation method outperforms the other conventional state-of-the-art segmentation algorithms, and its efficiency is comparable to the new approaches based on deep neural networks. The proposed method is suitable for melanoma segmentation in skin cancer diagnosis.
Acknowledgments
The authors would like to thank the Dermatology Service of Pedro Hispano Hospital, Matosinhos, Portugal for making their database available.
Data Availability
The PH2 database means the Pedro Hispano Hospital that deals with dermatology by dermoscopic images in a Tubingen Mole Analyzer system. This data set is free and open source and all people they can use these data set. Also we used these data set to our proposed method.
Ethical Approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Conflicts of Interest
The authors declare that there is no conflict of interest regarding the publication of this paper.
References
- 1.Intraocular B. Melanoma Treatment (PDQ): Health Professional Version. PDQ Cancer Information Summaries; 2015. [Google Scholar]
- 2.Codella N. C. F., Nguyen Q. B., Pankanti S., et al. Deep learning ensembles for melanoma recognition in dermoscopy images. IBM Journal of Research and Development. 2017;61(4/5):5:1–5:15. doi: 10.1147/jrd.2017.2708299. [DOI] [Google Scholar]
- 3.Tajeddin N. Z., Asl B. M. A general algorithm for automatic lesion segmentation in dermoscopy images. 2016 23rd Iranian Conference on Biomedical Engineering and 2016 1st International Iranian Conference on Biomedical Engineering (ICBME); November 2016; Tehran, Iran. pp. 134–139. [DOI] [Google Scholar]
- 4.Yu L., Chen H., Dou Q., Qin J., Heng P.-A. Automated melanoma recognition in dermoscopy images via very deep residual networks. IEEE Transactions on Medical Imaging. 2017;36(4):994–1004. doi: 10.1109/TMI.2016.2642839. [DOI] [PubMed] [Google Scholar]
- 5.Gardeux V., Chelouah R., Siarry P., Glover F. EM323: a line search based algorithm for solving high-dimensional continuous non-linear optimization problems. Soft Computing. 2011;15(11):2275–2285. doi: 10.1007/s00500-010-0651-6. [DOI] [Google Scholar]
- 6.Ren-Pu G. The theory of filled function method for finding global minimizers of nonlinearly constrained minimization problems. Journal of Computational Mathematics. 1987;5(1):1–9. [Google Scholar]
- 7.Wei F., Wang Y., Lin H. A new filled function method with two parameters for global optimization. Journal of Optimization Theory and Applications. 2014;163(2):510–527. doi: 10.1007/s10957-013-0515-1. [DOI] [Google Scholar]
- 8.Zhang Y., Xu Y., Zhang L. A filled function method applied to nonsmooth constrained global optimization. Journal of Computational and Applied Mathematics. 2009;232(2):415–426. doi: 10.1016/j.cam.2009.06.020. [DOI] [Google Scholar]
- 9.Liang Y. M., Zhang L. S., Li M. M., Han B. S. A filled function method for global optimization. Journal of Computational and Applied Mathematics. 2007;205(1):16–31. doi: 10.1016/j.cam.2006.04.038. [DOI] [Google Scholar]
- 10.Sahiner A., Yilmaz N., Demirozer O. Mathematical modeling and an application of the filled function method in entomology. International Journal of Pest Management. 2014;60(3):232–237. doi: 10.1080/09670874.2014.958879. [DOI] [Google Scholar]
- 11.Liu H., Wang Y., Gao X. Z., Dang C., Meng Z. A parameter free filled function method for global optimization. Pacific Journal of Optimization. 2018;14(4):567–580. [Google Scholar]
- 12.Sahiner A., Ibrahem S. A. A new global optimization technique by auxiliary function method in a directional search. Optimization Letters. 2019;13(2):309–323. doi: 10.1007/s11590-018-1315-1. [DOI] [Google Scholar]
- 13.Bezier P. Mathematical and practical possibilities of UNISURF. Computer Aided Geometric Design. 1974:127–152. doi: 10.1016/B978-0-12-079050-0.50012-6. [DOI] [Google Scholar]
- 14.Otsu N. A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man, and Cybernetics. 1979;9(1):62–66. doi: 10.1109/TSMC.1979.4310076. [DOI] [Google Scholar]
- 15.Dey N., Rajinikanth V., Ashour A., Tavares J. M. Social group optimization supported segmentation and evaluation of skin melanoma images. Symmetry. 2018;10(2):p. 51. doi: 10.3390/sym10020051. [DOI] [Google Scholar]
- 16.Casari A., Chester J., Pellacani G. Actinic keratosis and noninvasive diagnostic techniques: an update. Biomedicines. 2018;6(1):p. 8. doi: 10.3390/biomedicines6010008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.ISIC. ISIC 2017: Skin Lesion Analysis towards Melanoma Detection. 2017. June 2018, https://challenge.kitware.com/#challenge/n/ISIC 2017: Skin Lesion Analysis Towards Melanoma Detection.
- 18.Stewart B., Wild C. P. World Cancer Report. WHO; 2014. [Google Scholar]
- 19.Xie F., Yang J., Liu J., Jiang Z., Zheng Y., Wang Y. Skin lesion segmentation using high-resolution convolutional neural network. Computer Methods and Programs in Biomedicine. 2020;186:p. 105241. doi: 10.1016/j.cmpb.2019.105241. [DOI] [PubMed] [Google Scholar]
- 20.Hwang S., Celebi M. E. Texture segmentation of dermoscopy images using Gabor filters and G-means clustering. IPCV 2010: Proceedings of the 2010 International Conference on Image Processing, Computer Vision, & Pattern Recognition; 2015; Las Vegas NV, USA. pp. 882–886. [Google Scholar]
- 21.Yao T., Wang Z., Xie Z., Gao J., Feng D. D. A multiview joint sparse representation with discriminative dictionary for melanoma detection. 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA); November 2016; Gold Coast, QLD, Australia. pp. 1–6. [DOI] [Google Scholar]
- 22.Moussa R., Gerges F., Salem C., Akiki R., Falou O., Azar D. Computer-aided detection of melanoma using geometric features. 2016 3rd Middle East Conference on Biomedical Engineering (MECBME); October 2016; Beirut, Lebanon. pp. 125–128. [DOI] [Google Scholar]
- 23.Mishra N. K., Celebi M. E. An overview of melanoma detection in dermoscopy images using image processing and machine learning. 2016. http://arxiv.org/abs/1601.07843.
- 24.Jain S., jagtap V., Pise N. Computer aided melanoma skin cancer detection using image processing. Procedia Computer Science. 2015;48:735–740. doi: 10.1016/j.procs.2015.04.209. [DOI] [Google Scholar]
- 25.Jaleel J. A., Salim S., Aswin R. Computer aided detection of skin cancer. 2013 International Conference on Circuits, Power and Computing Technologies (ICCPCT); March 2013; Nagercoil, India. [DOI] [Google Scholar]
- 26.Esteva A., Kuprel B., Novoa R. A., et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542(7639):115–118. doi: 10.1038/nature21056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Ramlakhan K., Shang Y. A mobile automated skin lesion classification system. 2011 23rd IEEE International Conference on Tools with Artificial Intelligence (ICTAI); November 2011; Boca Raton, FL, USA. [DOI] [Google Scholar]
- 28.Hoshyar A. N., Al-Jumaily A., Sulaiman R. Review on automatic early skin cancer detection. 2011 International Conference on Computer Science and Service System (CSSS); June 2011; Nanjing, China. [DOI] [Google Scholar]
- 29.Goyal P. K., Jain M. K. Computer-aided diagnosis of melanoma skin cancer: a review. In: Kolhe M., Trivedi M., Tiwari S., Singh V., editors. Advances in Data and Information Sciences. Lecture Notes in Networks and Systems, vol 38. Singapore: Springer; 2018. pp. 63–73. [DOI] [Google Scholar]
- 30.Karargyris A., Karargyris O., Pantelopoulos A. DERMA/care: an advanced image-processing mobile application for monitoring skin cancer. 2012 IEEE 24th International Conference on Tools with Artificial Intelligence (ICTAI); November 2012; Athens, Greece. [DOI] [Google Scholar]
- 31.Xu H., Lu C., Berendt R., Jha N., Mandal M. Automated analysis and classification of melanocytic tumor on skin whole slide images. Computerized Medical Imaging and Graphics. 2018;66:124–134. doi: 10.1016/j.compmedimag.2018.01.008. [DOI] [PubMed] [Google Scholar]
- 32.Li Y., Shen L. Skin lesion analysis towards melanoma detection using deep learning network. Sensors. 2018;18(2):p. 556. doi: 10.3390/s18020556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Dorj U. O., Lee K. K., Choi J. Y., Lee M. The skin cancer classification using deep convolutional neural network. Multimedia Tools and Applications. 2018;77(8):9909–9924. doi: 10.1007/s11042-018-5714-1. [DOI] [Google Scholar]
- 34.Cueva W. F., Muñoz F., Vásquez G., Delgado G. Detection of skin cancer melanoma through computer vision. 2017 IEEE XXIV International Conference on Electronics, Electrical Engineering and Computing (INTERCON); August 2017; Cusco, Peru. [DOI] [Google Scholar]
- 35.Alfed N., Khelifi F. Bagged textural and color features for melanoma skin cancer detection in dermoscopic and standard images. Expert Systems with Applications. 2017;90:101–110. doi: 10.1016/j.eswa.2017.08.010. [DOI] [Google Scholar]
- 36.Chong E. K., Zak S. H. An Introduction to Optimization (Vol. 76) John Wiley & Sons; 2013. [Google Scholar]
- 37.Mendona T., Ferreira P. M., Marques J. S., Marcal A. R., Rozeira J. PH2-a dermoscopic image database for research and benchmarking. 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC); July 2013; Osaka, Japan. pp. 5437–5440. [DOI] [PubMed] [Google Scholar]
- 38.Guo Y., Ashour A., Smarandache F. A novel skin lesion detection approach using neutrosophic clustering and adaptive region growing in dermoscopy images. Symmetry. 2018;10(4):p. 119. doi: 10.3390/sym10040119. [DOI] [Google Scholar]
- 39.Xie F., Fan H., Li Y., Jiang Z., Meng R., Bovik A. Melanoma classification on dermoscopy images using a neural network ensemble model. IEEE Transactions on Medical Imaging. 2017;36(3):849–858. doi: 10.1109/TMI.2016.2633551. [DOI] [PubMed] [Google Scholar]
- 40.Menegola A., Fornaciali M., Pires R., Bittencourt F. V., Avila S., Valle E. Knowledge transfer for melanoma screening with deep learning. 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017); April 2017; Melbourne, VIC, Australia. pp. 297–300. [DOI] [Google Scholar]
- 41.Vasconcelos C. N., Vasconcelos B. N. Experiments using deep learning for dermoscopy image analysis. Pattern Recognition Letters. 2017 doi: 10.1016/j.patrec.2017.11.005. [DOI] [Google Scholar]
- 42.Oliveira R. B., Pereira A. S., Tavares J. M. R. S. Computational diagnosis of skin lesions from dermoscopic images using combined features. Neural Computing and Applications. 2019;31(10):6091–6111. doi: 10.1007/s00521-018-3439-8. [DOI] [Google Scholar]
- 43.Yuan Y., Chao M., Lo Y. C. Automatic skin lesion segmentation using deep fully convolutional networks with jaccard distance. IEEE Transactions on Medical Imaging. 2017;36(9):1876–1886. doi: 10.1109/TMI.2017.2695227. [DOI] [PubMed] [Google Scholar]
- 44.Bi L., Kim J., Ahn E., Feng D. Automatic skin lesion analysis using large-scale dermoscopy images and deep residual networks. 2017. http://arxiv.org/abs/1703.04197.
- 45.Al-Masni M. A., Al-antari M. A., Choi M. T., Han S. M., Kim T. S. Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks. Computer Methods and Programs in Biomedicine. 2018;162:221–231. doi: 10.1016/j.cmpb.2018.05.027. [DOI] [PubMed] [Google Scholar]
- 46.Jahanifar M., Zamani Tajeddin N., Mohammadzadeh Asl B., Gooya A. Supervised saliency map driven segmentation of lesions in dermoscopic images. IEEE Journal of Biomedical and Health Informatics. 2019;23(2):509–518. doi: 10.1109/JBHI.2018.2839647. [DOI] [PubMed] [Google Scholar]
- 47.Tschandl P., Sinz C., Kittler H. Domain-specific classification-pretrained fully convolutional network encoders for skin lesion segmentation. Computers in Biology and Medicine. 2019;104:111–116. doi: 10.1016/j.compbiomed.2018.11.010. [DOI] [PubMed] [Google Scholar]
- 48.Bi L., Kim J., Ahn E., Kumar A., Feng D., Fulham M. Step-wise integration of deep class-specific learning for dermoscopic image segmentation. Pattern Recognition. 2019;85:78–89. doi: 10.1016/j.patcog.2018.08.001. [DOI] [Google Scholar]
- 49.Boltz S. SRM method implementation. 2010. http://www.mathworks.com/matlabcentral/fileexchange/authors/73145.
- 50.Crandall R. Level set implementation. https://github.com/rcrandall/ChanVese. http://www.opencv.org.
- 51.Zhao Q. JSEG method implementation. 2001. cs.joensuu.fi/Zhao/Software/JSEG.zip.
- 52.D’Amico M., Stanganelli I. Qualitative asymmetry measure for melanoma detection. 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821); April 2004; Arlington, VA, USA. pp. 15–18. [DOI] [Google Scholar]
- 53.Tanaka T., Yamada R., Tanaka M., Shimizu K., Tanaka M., Oka H. A study on the image diagnosis of melanoma. The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society; September 2004; San Francisco, CA, USA. pp. 1597–1600. [DOI] [PubMed] [Google Scholar]
- 54.Maglogiannis I., Kosmopoulos D. I. Computational vision systems for the detection of malignant melanoma. Oncology Reports. 2006;15:1027–1032. doi: 10.3892/or.15.4.1027. [DOI] [PubMed] [Google Scholar]
- 55.Marques J. S., Barata C., Mendonc T. On the role of texture and color in the classification of dermoscopy images. 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society; August-September 2012; San Diego, CA, USA. pp. 4402–4405. [DOI] [PubMed] [Google Scholar]
- 56.Olszewska J. I. Semantic, automatic image annotation based on multi-layered active contours and decision trees. International Journal of Advanced Computer Science and Applications. 2013;4(8):201–208. doi: 10.14569/ijacsa.2013.040828. [DOI] [Google Scholar]
- 57.Zagrouba E., Barhoumi W. An accelerated system for melanoma diagnosis based on subset feature selection. Journal of Computing and Information Technology. 2005;13(1):69–82. doi: 10.2498/cit.2005.01.06. [DOI] [Google Scholar]
- 58.Aljanabi M., Ozok Y., Rahebi J., Abdullah A. Skin lesion¨ segmentation method for dermoscopy images using artificial bee colony algorithm. Symmetry. 2018;10(8):p. 347. doi: 10.3390/sym10080347. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The PH2 database means the Pedro Hispano Hospital that deals with dermatology by dermoscopic images in a Tubingen Mole Analyzer system. This data set is free and open source and all people they can use these data set. Also we used these data set to our proposed method.