Abstract
Quantum-behaved bat algorithm with mean best position directed (QMBA) is a novel variant of bat algorithm (BA) with good performance. However, the QMBA algorithm generates all stochastic coefficients with uniform probability distribution, which can only provide a relatively small search range, so it still faces a certain degree of premature convergence. In order to help bats escape from the local optimum, this article proposes a novel Gaussian quantum bat algorithm with mean best position directed (GQMBA), which applies Gaussian probability distribution to generate random number sequences. Applying Gaussian distribution instead of uniform distribution to generate random coefficients in GQMBA is an effective technique to promote the performance in avoiding premature convergence. In this article, the combination of QMBA and Gaussian probability distribution is applied to solve the numerical function optimization problem. Nineteen benchmark functions are employed and compared with other algorithms to evaluate the accuracy and performance of GQMBA. The experimental results show that, in most cases, the proposed GQMBA algorithm can provide better search performance.
1. Introduction
Recently, optimization problems are usually encountered in a mount of real-word areas such as artificial intelligence, computer science, pattern recognition, information theory, etc. Many of the actual optimization problems are frequently NP-hard problems, and searching for optimal solutions is pretty hard. It stands for the reason that it takes too long to solve these NP-hard optimization problems with traditional optimization methods. Therefore, different optimization techniques, especially bioinspired metaheuristic optimization algorithms or swarm intelligence (SI) optimization algorithms, have raised many researchers' growing interest in the past twenty years and they have proposed or developed various optimization algorithms such as particle swarm optimization (PSO) [1, 2], gravitational search algorithm (GSA) [3], ant colony optimization (ACO) [4], cuckoo search (CS) [5], and bat algorithm (BA) [6]. These algorithms are verified that they are very suited for optimizing problems such as feature selection [7, 8], task scheduling [9], unit commitment [10], artificial neural networks [11], fuzzy control [12], parameter selection and optimization [13, 14], and numerical function optimization [15]. They have also been applied to multiobjective optimization problems [16]. Compared with traditional optimization techniques, these algorithms can provide better generalization ability and parallelism. Hence, in many high-dimensional optimization problems, these algorithms outperform the traditional optimization techniques.
The bat algorithm is a relatively new nature-inspired swarm-based optimization algorithm that was proposed by Yang in 2010 [6]. This algorithm mimics the foraging behavior of bats to search the optima and it has successfully combined the merits of many well-known algorithms in a structured way, such as PSO, simulated annealing (SA) [17] and genetic algorithm (GA) [18]. BA also inherits the simplicity of PSO and it has been proved to be more efficient than its predecessor PSO and GA, especially in low-dimensional cases. Also, it is easy to implement BO in various computer languages. Hence, it has been applied to many engineering optimization problems [19]. However, due to its low population diversification, it may get trapped in local optima and premature convergence when solving high-dimensional optimization problems [20]. Therefore, to issue this deficiency, many bat algorithm variants are proposed to improve BA performance, such as CLBA [21], DLBA [22], IBA [23], HSBA [24], etc. QMBA [15] is also a variant of BA, which introduced the quantum behavior to improve the population diversity. Also, with the direction of mean best position in the later phase of searching, QMBA can convergence more quickly. QMBA is verified to be superior to the original BA and other four BA variants, including IBA, HSBA, MBA [25], and CBA [26].
However, all stochastic coefficients in the QMBA algorithm are generated using the uniform probability distribution, which can only provide a relatively small search range. Therefore, QMBA still faces a certain degree of premature convergence. To solve this issue, this article presents a technique of quantum-behaved BA directed by mean best position (QMBA) based on Gaussian distribution (GQMBA) for numerical function optimization. The employment of random Gaussian generation instead of random uniform generation in QMBA is an effective method to enhance the performance of QMBA in avoiding local solutions. In order to verify the performance of the Gaussian QMBA (GQMBA) technique, nineteen classical benchmark functions were employed, and the experimental results obtained by GQMBA over 30 trials were compared with some other algorithms mentioned in the literature.
The remainder of this article is structured as follows: the original bat algorithm is described in Sections 2 and 3 gives an overview to the QMBA. Section 4 presents the Gaussian quantum bat algorithm with the direction of mean best position. The following Section 5 provides the simulation results and comparison of this proposed techinique. Finally, conclusions are made, and future research direction is presented in Section 6.
2. The Original BA Algorithm
Bat algorithm is a nature-inspired optimization algorithm inspired by foraging behavior of bats [6]. This technique is simple and easy to implement and efficient, which is swarm-based on a stochastic optimization method. When bats foraging, they search for prey and avoid obstacles by using the echolocation technique. The original BA employs a frequency-tuning approach to increase the diversification of the swarm, while, at the same time, it adopts the automatic zooming method to try to keep the balance of global search and local search during the search procedure by simulating the variations of pulse loudness and emission rates of bats when foraging. Based on three idealized rules [6], the foraging behavior of bats can be transformed to the bat algorithm. The following paragraphs present the details of BA.
In the original BA, each bat flies toward the prey, that is, moving toward the current global best position. The frequency vector (fi), velocity vector (vi), and position vector (xi) of the artificial bats are updated during the process of iteration using the following equations:
| (1) |
| (2) |
| (3) |
where β is a uniform random number in the range of [0, 1], fmin and fmax indicate the minimum and maximum frequency, respectively, gbt means the current global best solution. With these equations, the global search capacity of BA can be guaranteed.
For the local search, to produce new solution for each bat when a solution is chosen from the current best solutions, a local random walk strategy is employed. This strategy can be described as follows:
| (4) |
where ε is a uniform random number in the range of [−1, 1] and decides the direction of new solution. Here, At is the average loudness value of all bats at the tth iteration.
During the foraging process, bats will gradually adapt the values of loudness and pulse emission rate for the purpose of locating the prey. The loudness value Ai and pulse emission rate ri can be updated in each cycle as follows:
| (5) |
| (6) |
where r0 indicates the initial rate of pulse emission of ith artificial bat. α and γ are constants. The range of α is [0, 1] and γ is a positive number (γ > 0). Actually, as the cooling coefficient in the SA, α decides the convergence of BA. For simplicity, α=γ is usually adopted in the researches.
The basic procedure of BA is described as the pseudocode illustrated in Algorithm 1.
Algorithm 1.
Pseudocode of the BA algorithm.
3. The QMBA Algorithm
The original bat algorithm has the characteristics of simplicity, easy to implement and quick convergence; hence, it has been applied to many optimization problems. However, BA performs bad in the multimodal cases, due to its low population diversity. Through the analysis of the trajectory of artificial bats, Zhu et al. [15] proposed the quantum-behaved bat algorithm with mean best position directed. In QMBA, the quantum-behaved mutation operator can increase the diversity of swam and it also can help to avoid premature convergence. Additionally, the mean beast solution used in the later phase can quick up the convergence speed of the algorithm. The following paragraphs describe the details of QMBA [15].
QMBA is basically constructed on the basis of the original BA. The decreasing coefficient A and increasing coefficient r control the global search and local search, respectively. But the method to generate new candidate solutions is different from the original BA. The new method is described as follows:
| (7) |
where η indicates a random number uniformly distributed in the range [0, 1].
| (8) |
and it represents the distance between the dth dimension of current global best position gb in the swarm and the position of dth dimension of ith bat, rand is a uniform random number in [0, 1]. If the distance δd is smaller than the threshold TH, the ith bat can fly randomly. However, if the distance δd is larger than the threshold TH, then the ith bat flies toward to the current global best position.
For the local search, the random walk strategy is not employed again. According to certain mutation probability pm, some of the bats will be mutated with quantum-behaved operator, which can be described as follows:
| (9) |
where U is a random number in the range [0, 1] generated by the uniform distribution and μ is a self-adaptive linear decreasing coefficient defined as
| (10) |
and μmax and μmin are the initial and final values of μ. In the QMBA, μmax=1 and μmin=0.5 are adopted.
| (11) |
where the mbest denotes the mean best position, that is, the average value of Pit positions of all artificial bats. Pit represents the present best position of the ith bat, M indicates the size of swarm, and D represents the dimension of problem.
If a bat does not mutate with quantum-behaved operation mentioned above during the local search, then the position of the bat is updated as follows:
| (12) |
where ϕ also denotes a random number of uniform distribution in the range [0, 1].
The pseudocode of QMBA is presented in Algorithm 2.
Algorithm 2.
Pseudocode of the QMBA algorithm.
4. The GQMBA Algorithm
Various novel variants of BA have been developed to improve the performance of the original BA in recent years. Most of these BA variants generate random numbers with uniform probability distribution. However, some researches have proved that other probability distributions, such as Gaussian (normal) probability distribution, can be a good choice to improve the performance of heuristic algorithms [27–29]. In fact, any long-tail distribution helps increase the step size and distance of the random walk.
In this section, following the same direction of research, we give out a combination of QMBA and Gaussian probability distribution, which is called Gaussian QMBA (GQMBA).
A random generation that the Gaussian probability distribution with a mean of 0 and a standard deviation of 1 is utilized for initializing stochastic coefficients of GQMBA. GQMBA offers a good trade-off between the probability of having numerous small amplitudes near the present position and the small probability of having a higher amplitude. This random generation allows bats fly away from the present position and jump out of local optima. It can not only promote the accuracy of the solutions but also improve the robustness of the optimization technique. As described in Section 3, there are three uniformly distributed random sequences in the search process of QMBA. Therefore, with the application of Gaussian random generation, the GQMBA algorithm can provide a wider search space and the performance of QMBA may be improved.
In this article, stochastic numbers in GQMBA are generated using the absolute value of Gaussian probability distributions with a mean of zero and a standard deviation of one, that is, abs(N(0,1)) or |randn|. The one-dimensional probability density function of abs(N(0,1)) is defined by:
| (13) |
The combination of QMBA and Gaussian probability distribution is simple but effective. Only three equations need to be modified. The three major highlights are described below.
Firstly, parameter η of equation (7) is modified according to the following equation:
| (14) |
where G=abs(N(0,1)).
Secondly, U of equation (9) is also replaced with the absolute value of the Gaussian probability distribution with a mean of zero and unit standard deviation. This quantum-behaved mutation operator now is updated according to
| (15) |
where G=abs(N(0,1)). Note that, according to equation (13), q(0)=0; therefore, abs(N(0,1)) satisfies the domain requirement of logarithmic function (>0).
Thirdly, the random number ϕ in equation (12) is modified according to the following equation:
| (16) |
where G=abs(N(0,1)).
Overall, in GQMBA, the present global best solution guides the exploration phase to guarantee convergence, while the Gaussian quantum-behaved mutation operator and mean best position contribute to the exploitation phase to escape from local optimum and prevent premature convergence.
Based on the above description, the pseudocode of the GQMBA algorithm is summarized in Algorithm 3.
Algorithm 3.
Pseudocode of the GQMBA algorithm.
5. Experiments and Discussion
In this section, nineteen classical benchmark functions are illustrated in Tables 1–3, which are adopted to test the performance of the GQMBA algorithm. These benchmark functions are usually employed in numerical optimization techniques [15, 30–32]. In this article, the nineteen benchmark functions are grouped into three categories. The first category includes seven unimodal functions, which have only one optimal solution and are efficient to verify metaheuristic optimization techniques in terms of convergence speed and exploitation capability. The second category includes six multimodal functions, which have an exponential increasing number of local minima. Therefore, these multimodal functions are suitable for examining the local solutions avoidance and exploration capability of algorithms. The third category includes six composite functions, which are very complex with the combination of different rotated, shifted, and biased multimodal test functions. These composite functions are highly similar to the actual applications and suitable to benchmark the performance of methods in terms of balanced global search and local search. In these tables, D denotes the dimension of the solution space, Range is the boundary of the search space, and the global best value fm is also given in column 4. Thirty independent tests are completed for every benchmark function. All the tests illustrated in this research are performed on a PC with Intel (R) Core (TM) i5-6500 3.20 GHz CPU and 8.0 GB RAM of memory, and the codes are implemented in Matlab 2014a.
Table 1.
F 1–F7 unimodal benchmark functions.
| Function | D | Range | f min |
|---|---|---|---|
| F 1(x)=∑i=1nxi2 | 30 | [−100, 100] | 0 |
| F 2(x)=∑i=1n|xi|+∏i=1n|xi| | 30 | [−10, 10] | 0 |
| F 3(x)=∑i=1n(∑j=1ixj)2 | 30 | [−100, 100] | 0 |
| F 4(x)=maxi{|xi|, 1 ≤ i ≤ n} | 30 | [−100, 100] | 0 |
| F 5(x)=∑i=1n−1[100(xi+1 − xi2)2+(xi − 1)2] | 30 | [−30, 30] | 0 |
| F 6(x)=∑i=1n([xi+0.5])2 | 30 | [−100, 100] | 0 |
| F 7(x)=∑i=1nixi4+random[0,1) | 30 | [−1.28, 1.28] | 0 |
Table 2.
F 8–F13 multimodal benchmark functions.
| Function | D | Range | f min |
|---|---|---|---|
| 30 | [−500, 500] | −418.9829 × D | |
| F 9(x)=∑i=1n[xi2 − 10 cos(2πxi)+10] | 30 | [−5.12, 5.12] | 0 |
| 30 | [−32, 32] | 0 | |
| 30 | [−600, 600] | 0 | |
|
F
12(x)=(π/n){10 sin(πy1)+∑i=1n−1(yi − 1)2[1 + 10 sin2(πyi+1)]+(yn − 1)2}+∑i−1nu(xi, 10,100,4) + ∑i=1nu(xi, 10,100,4) yi=1+(xi+1/4) |
30 | [−50, 50] | 0 |
| F 13(x)=0.1{sin2(3πx1)+∑i=1n(xi − 1)2[1 + sin2(3πxi+1)]+(xn − 1)2[1+ sin2(2πxn)]}+ ∑i=1nu(xx, 5,100,4) | 30 | [−50, 50] | 0 |
Table 3.
F 14–F19 composite benchmark functions.
| Function | D | Range | f min |
|---|---|---|---|
| F 14(CF1) | |||
| f1, f2, f3,…, f10=Sphere Function, [σ1, σ2, σ3,…, σ10=[1,1,1,…, 1] | 30 | [−5, 5] | 0 |
| [λ1, λ2, λ3,…, λ10]=[5/100, 5/100, 5/100,…, 5/100] | |||
| F 15(CF2) | |||
| f1, f2, f3,…, f10=Griewank's Function, [σ1, σ2, σ3,…, σ10=[1,1,1,…, 1] | 30 | [−5, 5] | 0 |
| [λ1, λ2, λ3,…, λ10]=[5/100, 5/100, 5/100,…, 5/100] | |||
| F 16(CF3) | |||
| f1, f2, f3,…, f10=Griewank's Function, [σ1, σ2, σ3,…, σ10=[1,1,1,…, 1] | 30 | [−5, 5] | 0 |
| [λ1, λ2, λ3,…, λ10]=[1,1,1,…, 1] | |||
| F 17(CF4) | |||
| f1, f2=Ackley's Function, f3, f4=Rastrigin's Function | |||
| f5, f6=Weierstrass Function, f7, f8=Griewank's Function | 30 | [−5, 5] | 0 |
| f9, f10=Sphere Function, [σ1, σ2, σ3,…, σ10=[1,1,1,…, 1] | |||
| [λ1, λ2, λ3,…, λ10]=[5/32, 5/32, 5/32,…, 5/32] | |||
| F 18(CF5) | |||
| f1, f2=Rastrigin's Function, f3, f4=Weierstrass Function | |||
| f5, f6=Griewank's Function, f7, f8=Ackley's Function | 30 | [−5, 5] | 0 |
| f9, f10=Sphere Function, [σ1, σ2, σ3,…, σ10=[1,1,1,…, 1] | |||
| [λ1, λ2, λ3,…, λ10]=[1/5, 1/5, 5/0.5, 5/0.5, 5/100, 5/100, 5/32, 5/32, 5/100, 5/100] | |||
| F 19(CF6) | |||
| f1, f2=Rastrigin's Function, f3, f4=Weierstrass Function | |||
| f5, f6=Griewank's Function, f7, f8=Ackley's Function | |||
| f9, f10=Sphere Function | 30 | [−5, 5] | 0 |
| [σ1, σ2, σ3,…, σ10=[0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, 1] | |||
| [λ1, λ2, λ3,…, λ10]=[0.1∗1/5, 0.2∗1/5, 0.3∗5/0.5, 0.4∗5/0.5, 0.5∗5/100, 0.6∗5/100, 0.7∗5/32, 0.8∗5/32, 0.9∗5/100, 1∗5/100] |
Since metaheuristic algorithms belong to stochastic optimization methods, they need to be completed at least over 10 independent runs for producing meaningful statistical consequences. Besides the mean and standard deviation, statistical tests, such as Wilcoxon rank-sum test, should be conducted to verify the significance of the results based on every independent runs. In this article, the nonparametric Wilcoxon rank-sum tests are completed to verify whether there exists a statistical difference between the results obtained by GQMBA and the results searched by the other algorithms. A p value of less than 0.05 (<0.05) means that there exists statistical difference between the performances of the two algorithms, while a p value of greater than 0.05 (≥0.05) denotes that the performances are statistically similar.
Considering that QMBA has been verified to be more efficient than other variants of BA [15], therefore, GQMBA is compared with the original BA and QMBA as well as a new metaheuristic algorithm MFO [30] to verify its efficiency. MFO is a novel nature-inspired heuristic algorithm. It shows high and competitive global search ability in multimodal functions and local search ability in unimodal functions. Also, MFO can balance global search and local search properly. Comparing with PSO, GSA, BA, FPA, SMS, FA, and GA, it can provide promising and competitive performance [30]. So MFO is selected as the comparative algorithm. In all swarm-based algorithms mentioned above, the maximum number of iterations is taken as 1000 for unimodal and multimodal functions, while the maximum number of iterations is taken as 100 for composite functions due to its high complexity, and the size of population is set as 50. Table 4 shows the other parameter settings for each algorithm. As presented in Tables 1–3, nineteen classical benchmark functions are employed. The experimental results are presented in Tables 5 and 6 and Figures 1–19. Note that the optimal mean (Mean) and the optimal standard deviations (SD) of the results obtained by the four methods for each function are illustrated in bold.
Table 4.
The parameter settings of BA, QMBA, MFO, and GQMBA.
| Algorithms | Parameter design |
|---|---|
| BA | f min=0, fmax=2, A=u(0,1), r=0.01, α=0.5, γ=0.5 |
| QMBA | A=u(0,1), r=0.01, α=0.5, γ=0.5, TH=0.005, Pm=0.01 |
| MFO | Identical to the values in the original article |
| GQMBA | A=u(0,1), r=0.01, α=0.5, γ=0.5, μmax=0.9, μmin=0.5, TH=0.005, pm=0.01 |
u(0,1) denotes a uniform random number ranged in [0, 1].
Table 5.
Mean and standard deviations of the benchmark functions.
| F | BA | QMBA | MFO | GQMBA | ||||
|---|---|---|---|---|---|---|---|---|
| Mean | SD | Mean | SD | Mean | SD | Mean | SD | |
| F 1 | 3.25e + 04 | 9.53e + 03 | 8.13e − 04 | 2.87e − 03 | 1.67e + 03 | 4.61e + 03 | 1.37e + 00 | 4.07e + 00 |
| F 2 | 2.64e + 08 | 1.36e + 09 | 4.70e − 02 | 2.06e − 01 | 3.27e + 01 | 2.27e + 01 | 2.39e − 02 | 3.77e − 02 |
| F 3 | 8.15e + 04 | 3.28e + 04 | 7.99e + 03 | 4.97e + 03 | 1.61e + 04 | 8.92e + 03 | 2.62e + 03 | 1.43e + 03 |
| F 4 | 6.45e + 01 | 9.17e + 00 | 1.65e + 01 | 5.47e + 00 | 5.77e + 01 | 1.38e + 01 | 4.81e − 01 | 7.13e − 01 |
| F 5 | 6.67e + 07 | 3.21e + 07 | 9.72e + 01 | 1.31e + 02 | 2.69e + 06 | 1.46e + 07 | 1.09e + 02 | 1.30e + 02 |
| F 6 | 3.14e + 04 | 8.06e + 03 | 1.85e + 00 | 5.70e + 00 | 1.66e + 03 | 3.78e + 03 | 1.43e + 00 | 3.63e + 00 |
| F 7 | 6.18e + 01 | 3.69e + 01 | 5.07e − 02 | 2.41e − 02 | 2.12e + 00 | 5.01e + 00 | 5.14e − 02 | 4.52e − 02 |
| F 8 | −3.82e + 03 | 1.41e + 03 | −6.66e + 03 | 1.61e + 03 | −8.70e + 03 | 8.74e + 02 | −6.99e + 03 | 7.49e + 02 |
| F 9 | 3.64e + 02 | 3.34e + 01 | 4.25e + 01 | 1.68e + 01 | 1.47e + 02 | 3.23e + 01 | 3.47e + 01 | 1.19e + 01 |
| F 10 | 1.99e + 01 | 1.78e − 01 | 2.06e + 00 | 1.29e + 00 | 1.30e + 01 | 9.12e + 00 | 1.53e − 02 | 4.69e − 02 |
| F 11 | 2.83e + 02 | 8.03e + 01 | 1.71e − 01 | 3.45e − 01 | 1.51e + 01 | 4.17e + 01 | 8.08e − 02 | 2.31e − 01 |
| F 12 | 1.01e + 08 | 8.36e + 07 | 5.93e − 01 | 8.74e − 01 | 2.51e − 01 | 3.44e − 01 | 3.88e − 02 | 8.50e − 02 |
| F 13 | 2.38e + 08 | 1.46e + 08 | 5.46e − 01 | 1.56e + 00 | 4.49e − 02 | 1.64e − 01 | 8.59e − 02 | 2.31e − 01 |
| F 14 | 1.22e + 03 | 1.12e + 02 | 4.06e + 02 | 2.59e + 02 | 5.08e + 02 | 1.76e + 02 | 3.27e + 02 | 1.91e + 02 |
| F 15 | 1.22e + 03 | 1.24e + 02 | 4.98e + 02 | 1.92e + 02 | 6.35e + 02 | 2.46e + 02 | 4.25e + 02 | 1.83e + 02 |
| F 16 | 1.59e + 03 | 1.66e + 02 | 1.25e + 03 | 1.96e + 02 | 1.02e + 03 | 2.02e + 02 | 8.66e + 02 | 1.60e + 02 |
| F 17 | 1.44e + 03 | 1.00e + 02 | 1.10e + 03 | 7.58e + 01 | 1.16e + 03 | 1.61e + 02 | 9.80e + 02 | 1.46e + 02 |
| F 18 | 1.45e + 03 | 1.29e + 02 | 7.44e + 02 | 3.69e + 02 | 5.83e + 02 | 3.46e + 02 | 4.00e + 02 | 2.61e + 02 |
| F 19 | 1.39e + 03 | 8.79e + 01 | 1.03e + 03 | 4.32e + 01 | 1.18e + 03 | 6.28e + 01 | 1.04e + 03 | 5.40e + 01 |
Table 6.
p-values of the Wilcoxon rank-sum test over all runs.
| F | GQMBA | MFO | QMBA | BA |
|---|---|---|---|---|
| F 1 | 0.0150 | 0.0176 | N/A | 3.0199e − 11 |
| F 2 | N/A | 5.5727e − 10 | 0.0207 | 3.0199e − 11 |
| F 3 | N/A | 8.8411e − 07 | 3.8053e − 07 | 3.0199e − 11 |
| F 4 | N/A | 3.0199e − 11 | 3.0199e − 11 | 3.0199e − 11 |
| F 5 | 0.4376 | 3.3679e − 04 | N/A | 3.0199e − 11 |
| F 6 | N/A | 0.3255 | 0.0133 | 3.0199e − 11 |
| F 7 | 0.2707 | 5.5611e − 04 | N/A | 3.0199e − 11 |
| F 8 | 7.1186e − 09 | N/A | 0.0168 | 4.1997e − 10 |
| F 9 | N/A | 3.0199e − 11 | 0.1188 | 3.0199e − 11 |
| F 10 | N/A | 2.3897e − 08 | 7.7725e − 09 | 1.4110e − 09 |
| F 11 | N/A | 0.4290 | 0.0251 | 3.0199e − 11 |
| F 12 | N/A | 3.5708e − 06 | 4.0840e − 05 | 3.0199e − 11 |
| F 13 | 0.0850 | N/A | 9.7917e − 05 | 3.0199e − 11 |
| F 14 | N/A | 5.2640e − 04 | 0.2340 | 3.0199e − 11 |
| F 15 | N/A | 0.0023 | 0.1055 | 3.0199e − 11 |
| F 16 | N/A | 0.0021 | 2.1947e − 08 | 3.6897e − 11 |
| F 17 | N/A | 4.0840e − 05 | 8.1200e − 04 | 3.0199e − 11 |
| F 18 | N/A | 0.0083 | 1.0407e − 04 | 3.3384e − 11 |
| F 19 | 0.3871 | 2.2273e − 09 | N/A | 4.0772e − 11 |
N/A means not applicable. p ≥ 0.05 have been italized.
Figure 1.
The average curve of fitness value for F1.
Figure 2.
The average curve of fitness value for F2.
Figure 3.
The average curve of fitness value for F3.
Figure 4.
The average curve of fitness value for F4.
Figure 5.
The average curve of fitness value for F5.
Figure 6.
The average curve of fitness value for F6.
Figure 7.
The average curve of fitness value for F7.
Figure 8.
The average curve of fitness value for F8.
Figure 9.
The average curve of fitness value for F9.
Figure 10.
The average curve of fitness value for F10.
Figure 11.
The average curve of fitness value for F11.
Figure 12.
The average curve of fitness value for F12.
Figure 13.
The average curve of fitness value for F13.
Figure 14.
The average curve of fitness value for F14.
Figure 15.
The average curve of fitness value for F15.
Figure 16.
The average curve of fitness value for F16.
Figure 17.
The average curve of fitness value for F17.
Figure 18.
The average curve of fitness value for F18.
Figure 19.
The average curve of fitness value for F19.
As can be seen from Table 5, the GQMBA provides the best performance on most test functions, followed by the QMBA and MFO algorithms. And they are much better than the BA algorithm. To some extent, the results obtained also demonstrate that BA is easy to get trapped into local minimums when the dimension of search space is high.
The GQMBA algorithm obtains the best mean on 14 benchmark functions of 19 test functions, except F1, F5, F7, F8, and F19. At the same time, GQMBA provides the most stable solutions on fourteen benchmark functions, except F1, F7, F13, F14, and F19. The p-values in Table 6 illustrate that the superiority of the GQMBA algorithm is statistically significant on 9 benchmark functions, including F2, F3, F4, F10, F12, F16, F17, and F18, which cover the unimodal, multimodal, and composite benchmark functions. On the other functions, GQMBA and QMBA perform statistically similar and there is no significant difference between these two algorithms, except F1 and F8. With the analysis above, it can be concluded that the introduction of Gaussian probability distribution to QMBA is an effective mechanism and GQMBA has the significant advantage over the other three algorithms in terms of accuracy, stability, and local minimum avoidance.
Figures 1–19 demonstrate the average curves of fitness values obtained by four algorithms on nineteen functions. The values presented in these curves are the average function fitness values obtained from 30 independent tests. These figures show that the original BA and MFO converge quickly with few iterations, but they are easy to get trapped into the local optimum in many cases. These figures also demonstrate that the convergence speed of GQMBA is similar to QMBA, while GQMBA can provide better accuracy and prevent premature convergence on most benchmark functions.
In order to compare the performance in terms of computational time, the average computational time of approaches on each test function over 30 independent runs is also provided in Table 7. As can be seen from this table, for unimodal and multimodal benchmark functions, the performance of MFO in terms of computational time is best and the average computational time of GQMBA is slightly more than that of QMBA. For composite benchmark functions, the computational time of GQMBA is similar to other approaches. The obtained results comfirm that GQMBA can achieve better results with slightly more computational time.
Table 7.
Average computational time of approaches on each benchmark function.
| f | BA | MFO | QMBA | GQMBA |
|---|---|---|---|---|
| f 1 | 1.10036 | 0.469359 | 0.889615 | 0.929227 |
| f 2 | 1.04243 | 0.524513 | 0.921171 | 0.980138 |
| f 3 | 3.0765 | 2.43098 | 2.88777 | 2.95636 |
| f 4 | 1.07779 | 0.567324 | 1.00172 | 1.03555 |
| f 5 | 1.22965 | 0.71997 | 1.14489 | 1.19135 |
| f 6 | 1.09087 | 0.599222 | 1.04263 | 1.08032 |
| f 7 | 1.35753 | 0.886334 | 1.29639 | 1.33972 |
| f 8 | 1.15973 | 0.654205 | 1.10923 | 1.14526 |
| f 9 | 1.18425 | 0.672098 | 1.11233 | 1.16105 |
| f 10 | 1.23347 | 0.716191 | 1.16477 | 1.19911 |
| f 11 | 1.29489 | 0.754089 | 1.20586 | 1.25417 |
| f 12 | 1.99625 | 1.43408 | 1.90856 | 1.95945 |
| f 13 | 1.98464 | 1.42408 | 1.89719 | 1.93967 |
| f 14 | 18.8752 | 16.5838 | 22.6735 | 17.1589 |
| f 15 | 18.325 | 18.08 | 18.72 | 18.7628 |
| f 16 | 19.9876 | 25.5575 | 23.0384 | 21.1629 |
| f 17 | 27.0739 | 24.9261 | 23.0546 | 28.294 |
| f 18 | 22.5187 | 22.7105 | 22.3053 | 22.7562 |
| f 19 | 22.4076 | 21.9222 | 22.2938 | 22.2832 |
6. Conclusions and Future Research Directions
In this article, novel Gaussian quantum bat algorithm with direction of mean best position (GQMBA) is proposed to simultaneously promote the search accuracy and stability of the original BA as well as QMBA. QMBA is combined with Gaussian probability distribution, which can improve the diversity, magnify the search range, and avoid falling into local optimum. Besides, GQMBA also inherits the characteristics of the original BA and QMBA, including simplicity, feasibility, and ease to implement. Nineteen benchmark functions are experimented and results show that GQMBA outperforms other algorithms. In summary, the proposed GQMBA is efficient, and it is a good alternative method to solve the numerical function optimization.
However, there still exist some deficiencies in GQMBA. One of the major deficiencies is that it has plenty of parameters to be set. Few works have already been done to reduce or make BA without any parameter as presented in [33, 34]. Therefore, in the future, we could also do some works to reduce the number of parameters in order to make GQMBA simpler but still efficient.
Finally, the proposed GQMBA algorithm might be a good choice to integrate with angle modulation method [35–37] to solve binary optimization problems. We are suggesting angle modulation method because it can change the search space from high dimension to low dimension. Hence, it can improve the accuracy and reduce the search time. In addition, the GQMBA algorithm will be applied to more optimization applications such as task scheduling, image segmentation, logic circuit design, etc.
Acknowledgments
This work was supported in part by the Scientific Research Foundation of Jimei University, China, under Grant ZQ2019006 and in part by the Fujian Provincial Science and Technology Program Project under Grants 2019H0021 and 2017H0026.
Data Availability
No data were used to support this study.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
References
- 1.James K., Russell E. Particle swarm optimization. Proceedings of the 1995 IEEE International Conference on Neural Networks; December 1995; Perth, Western Australia. pp. 1942–1948. [Google Scholar]
- 2.Ning Y., Peng Z., Dai Y., Bi D., Wang J. Enhanced particle swarm optimization with multi-swarm and multi-velocity for optimizing high-dimensional problems. Applied Intelligence. 2019;49(2):335–351. doi: 10.1007/s10489-018-1258-3. [DOI] [Google Scholar]
- 3.Rashedi E., Nezamabadi-pour H., Saryazdi S. Gsa: a gravitational search algorithm. Information Sciences. 2009;179(13):2232–2248. doi: 10.1016/j.ins.2009.03.004. [DOI] [Google Scholar]
- 4.Dorigo M., Di Caro G. Ant colony optimization: a new meta-heuristic. Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406; July 1999; Washington, DC, USA. IEEE; pp. 1470–1477. [DOI] [Google Scholar]
- 5.Gandomi A. H., Yang X.-S., Alavi A. H. Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems. Engineering with Computers. 2013;29(1):17–35. doi: 10.1007/s00366-011-0241-y. [DOI] [Google Scholar]
- 6.Yang X. S. Nature Inspired Cooperative Strategies for Optimization (NICSO 2010) Berlin, Germany: Springer; 2010. A new metaheuristic bat-inspired algorithm; pp. 65–74. [Google Scholar]
- 7.Mafarja M., Mirjalili S. Whale optimization approaches for wrapper feature selection. Applied Soft Computing. 2018;62:441–453. doi: 10.1016/j.asoc.2017.11.006. [DOI] [Google Scholar]
- 8.Zhang L., Shan L., Wang J. Optimal feature selection using distance-based discrete firefly algorithm with mutual information criterion. Neural Computing and Applications. 2017;28(9):2795–2808. doi: 10.1007/s00521-016-2204-0. [DOI] [Google Scholar]
- 9.Jana B., Chakraborty M., Mandal T. Soft Computing: Theories and Applications. Berlin, Germany: Springer; 2019. A task scheduling technique based on particle swarm optimization algorithm in cloud environment; pp. 525–536. [Google Scholar]
- 10.Srikanth R. K., Panwar L., Panigrahi B. K., Kumar R. Binary whale optimization algorithm: a new metaheuristic approach for profit-based unit commitment problems in competitive electricity markets. Engineering Optimization. 2019;51(3):369–389. doi: 10.1080/0305215x.2018.1463527. [DOI] [Google Scholar]
- 11.Armaghani D. J., Hasanipanah M., Mahdiyar A., Majid M. Z. A., Amnieh H. B., Tahir M. M. Airblast prediction through a hybrid genetic algorithm-ann model. Neural Computing and Applications. 2018;29(9):619–629. [Google Scholar]
- 12.Precup R.-E., David R.-C. Nature-Inspired Optimization Algorithms for Fuzzy Controlled Servo Systems. Oxford, UK: Butterworth-Heinemann; 2019. [Google Scholar]
- 13.la Fé-Perdomo I., Beruvides G., Quiza R., Haber R., Rivas M. Automatic selection of optimal parameters based on simple soft-computing methods: a case study of micromilling processes. IEEE Transactions on Industrial Informatics. 2019;15(2):800–811. doi: 10.1109/tii.2018.2816971. [DOI] [Google Scholar]
- 14.Tharwat A., Hassanien A. E. Quantum-behaved particle swarm optimization for parameter optimization of support vector machine. Journal of Classification. 2019:1–23. doi: 10.1007/s00357-018-9299-1. [DOI] [Google Scholar]
- 15.Zhu B., Zhu W., Liu Z., Duan Q., Cao L. A novel quantum-behaved bat algorithm with mean best position directed for numerical optimization. Computational Intelligence and Neuroscience. 2016;2016:17. doi: 10.1155/2016/6097484.6097484 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Beruvides G., Quiza R., Haber R. E. Multi-objective optimization based on an improved cross-entropy method. a case study of a micro-scale manufacturing process. Information Sciences. 2016;334–335:161–173. doi: 10.1016/j.ins.2015.11.040. [DOI] [Google Scholar]
- 17.Van Laarhoven P. J., Aarts E. H. Simulated Annealing: Theory and Applications. Berlin, Germany: Springer; 1987. Simulated annealing; pp. 7–15. [Google Scholar]
- 18.Mirjalili S. Evolutionary Algorithms and Neural Networks. Berlin, Germany: Springer; 2019. Genetic algorithm; pp. 43–55. [Google Scholar]
- 19.Jayabarathi T., Raghunathan T., Gandomi A. Nature-Inspired Algorithms and Applied Optimization. Berlin, Germany: Springer; 2018. The bat algorithm, variants and some practical engineering applications: a review; pp. 313–330. [Google Scholar]
- 20.Jordehi A. R. Chaotic bat swarm optimisation (cbso) Applied Soft Computing. 2015;26:523–530. [Google Scholar]
- 21.Lin J.-H., Chou C.-W., Yang C.-H., Tsai H.-L. A chaotic levy flight bat algorithm for parameter estimation in nonlinear dynamic biological systems. Computer and Information Technology. 2012;2(2):56–63. [Google Scholar]
- 22.Xie J., Zhou Y., Chen H. A novel bat algorithm based on differential operator and lévy flights trajectory. Computational Intelligence and Neuroscience. 2013;2013:13. doi: 10.1155/2013/453812.453812 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Yilmaz S., Kucuksille E. U. Improved bat algorithm (iba) on continuous optimization problems. Lecture Notes on Software Engineering. 2013;1(3):279–283. doi: 10.7763/lnse.2013.v1.61. [DOI] [Google Scholar]
- 24.Wang G., Guo L. A novel hybrid bat algorithm with harmony search for global numerical optimization. Journal of Applied Mathematics. 2013;2013:21. doi: 10.1155/2013/696491.696491 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Yılmaz S., Kucuksille E. U., Cengiz Y. Modified bat algorithm. Elektronika Ir Elektrotechnika. 2014;20(2):71–78. doi: 10.5755/j01.eee.20.2.4762. [DOI] [Google Scholar]
- 26.Afrabandpey H., Ghaffari M., Mirzaei A., Safayani M. A novel bat algorithm based on chaos for optimization tasks. Proceedings of the 2014 Iranian Conference on Intelligent Systems (ICIS); February 2014; Bam, Iran. IEEE; pp. 1–6. [DOI] [Google Scholar]
- 27.Cai X., Wang L., Kang Q., Wu Q. Bat algorithm with Gaussian walk. International Journal of Bio-Inspired Computation. 2014;6(3):166–174. doi: 10.1504/ijbic.2014.062637. [DOI] [Google Scholar]
- 28.dos Santos Coelho L. Gaussian quantum-behaved particle swarm optimization approaches for constrained engineering design problems. Expert Systems with Applications. 2010;37(2):1676–1683. doi: 10.1016/j.eswa.2009.06.044. [DOI] [Google Scholar]
- 29.Liu J., Xu W., Sun J. Quantum-behaved particle swarm optimization with mutation operator. Proceedings of the 17th IEEE international conference on tools with artificial intelligence (ICTAI’05); November 2005; Hong Kong, China. IEEE; p. p. 4. [Google Scholar]
- 30.Mirjalili S. Moth-flame optimization algorithm: a novel nature-inspired heuristic paradigm. Knowledge-Based Systems. 2015;89:228–249. doi: 10.1016/j.knosys.2015.07.006. [DOI] [Google Scholar]
- 31.Chen K., Zhou F., Liu A. Chaotic dynamic weight particle swarm optimization for numerical function optimization. Knowledge-Based Systems. 2018;139:23–40. doi: 10.1016/j.knosys.2017.10.011. [DOI] [Google Scholar]
- 32.Mirjalili S., Lewis A. The whale optimization algorithm. Advances in Engineering Software. 2016;95:51–67. doi: 10.1016/j.advengsoft.2016.01.008. [DOI] [Google Scholar]
- 33.Fister I., Jr., Fister I., Yang X. S. Towards the development of a parameter-free bat algorithm. Proceedings of the 2015 2nd Student Computer Science Research Conference (StuCoSReC); October 2015; Ljubljana, Slovenia. pp. 31–34. [Google Scholar]
- 34.Fister I., Mlakar U., Yang X. S. Nature-Inspired Computation in Engineering. Berlin, Germany: Springer; 2016. Parameterless bat algorithm and its performance study; pp. 267–276. [Google Scholar]
- 35.Leonard B. J., Engelbrecht A. P., Cleghorn C. W. Critical considerations on angle modulated particle swarm optimisers. Swarm Intelligence. 2015;9(4):291–314. doi: 10.1007/s11721-015-0114-x. [DOI] [Google Scholar]
- 36.Pampara G. Pretoria, South Africa: University of Pretoria; 2013. Angle modulated population based algorithms to solve binary problems. Ph.D. thesis. [Google Scholar]
- 37.Huang X., Li P., Pu Y. Amplitude angle modulated bat algorithm with application to zero-one knapsack problem. IEEE Access. 2019;7:27957–27969. doi: 10.1109/access.2019.2901988. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
No data were used to support this study.






















