Abstract
Fusion–Fission Optimization (FuFiO) is proposed as a new metaheuristic algorithm that simulates the tendency of nuclei to increase their binding energy and achieve higher levels of stability. In this algorithm, nuclei are divided into two groups, namely stable and unstable. Each nucleus can interact with other nuclei using three different types of nuclear reactions, including fusion, fission, and β-decay. These reactions establish the stabilization process of unstable nuclei through which they gradually turn into stable nuclei. A set of 120 mathematical benchmark test functions are selected to evaluate the performance of the proposed algorithm. The results of the FuFiO algorithm and its related non-parametric statistical tests are compared with those of other metaheuristic algorithms to make a valid judgment. Furthermore, as some highly-complicated problems, the test functions of two recent Competitions on Evolutionary Computation, namely CEC-2017 and CEC-2019, are solved and analyzed. The obtained results show that the FuFiO algorithm is superior to the other metaheuristic algorithms in most of the examined cases.
Subject terms: Mathematics and computing, Physics
Introduction
Optimization is a branch of applied mathematics that is widely used in various scientific disciplines because many problems can be expressed in the form of an optimization problem. Obviously, with the present rate of progress in all scientific fields, we face a variety of new real-world problems that have become more complex, such that conventional mathematical methods, such as exact optimizers, cannot solve them efficiently. In particular, exact optimizers do not have sufficient efficiency in dealing with many non-continuous, non-differentiable, and large-scale real-world multimodal problems1.
Early studies in the field of nature-inspired computation demonstrated that some numerical methods developed based on the behavior of natural creatures can solve real-world problems more effectively than exact methods2. Metaheuristic methods are numerical techniques that combine the heuristic rules of natural phenomena with a randomization process. Notably, over the past few decades, many researchers have concluded that developing and enhancing metaheuristic algorithms are practically-effective and computationally-efficient approaches to tackling complex and challenging unsolved real-world optimization problems3–8. A key advantage of metaheuristic methods is that they are problem-independent algorithms which provide acceptable solutions to complex and highly nonlinear problems in a reasonable time. Furthermore, they generally do not need any significant contributions to the algorithm structure from implementers, but it is only needed that they formulate the problem according to the requirements of the chosen metaheuristic. The point worth mentioning is that the core operation of the metaheuristic approaches is based on non-gradient procedures, where there is no need for cumbersome computations such as calculations of derivatives and multivariable generalizations. Moreover, randomization components enable metaheuristic algorithms to perform generally better than conventional methods. In particular, their stochastic nature enables them to escape from local optima and move toward global optimum on the search space of large-scale and challenging optimization problems.
Conventionally, two general criteria are used to classify metaheuristic methods: (1) the number of agents, and (2) the origin of inspiration. Based on the first criterion, metaheuristic algorithms can be divided into two groups: (1) single-solution-based algorithms, and (2) population-based algorithms. Also, according to inspiration, metaheuristic algorithms are divided into two main categories, namely Evolutionary Algorithms (EAs) and Swarm Intelligence (SI) algorithms. Single-solution-based methods try to modify one solution (agent) during the search process like what goes in the Simulated Annealing (SA) algorithm9; on the other hand, in population-based algorithms, a population of solutions is used to find the optimal answer similar to the simulation process in the Particle Swarm Optimization (PSO) algorithm10.
In EAs, the genetic evolution process is the main origin. Evolutionary Programming (EP)2, Evolutionary Strategy (ES)11, Genetic Algorithm (GA)12, and Differential Evolution (DE) are among the most famous methods in this domain. Besides, Simon13 proposed the Biogeography-Based Optimization (BBO) algorithm, which is used for global recombination and uniform crossover. Also, SI algorithms are based on the simulation of the collective behavior of creatures. SI algorithms are classified into three categories as follows. The first category is associated with the behavioral models of animals such as PSO10, Ant Colony Optimization (ACO)14, Artificial Bee Colony (ABC)15, Firefly Algorithm (FA)16, Cuckoo Search (CS)17, Bat Algorithm (BA)18, Eagle Strategy (ES)19, Krill Herd (KH)20, Flower Pollination Algorithm (FPA)21, Grey Wolf Optimizer (GWO)22, Ant Lion Optimizer (ALO)23, Grasshopper Optimization Algorithm (GOA)24, Symbiotic Organisms Search (SOS)25,26, Moth Flame Optimizer (MFO)27, Dragonfly Algorithm (DA)28, Salp Swarm Algorithm (SSA)29, Crow Search Algorithm (CSA)30, Whale Optimization Algorithm (WOA)31,32, Developed Swarm Optimizer (DSO)33, Spotted hyena optimizer (SHO)34, Farmland fertility algorithm (FFA)35,36, African Vultures Optimization (AVO)37, Bald Eagle Search Algorithm (BES)38,39 Tree Seed Algorithm (TSA)40,41, and Artificial Gorilla Troops (GTO) optimizer42. The second category concerns algorithms based on the physical and mathematical laws, such as Simulated Annealing (SA)9, Big Bang–Big Crunch optimization (BB–BC)43, Charged System Search (CSS)44,45, Chaos Game Optimization (CGO)46,47, Gravitational Search Algorithm (GSA)48, Sine Cosine Algorithm (SCA)49, Multi-Verse Optimizer (MVO)50, Atom Search Optimization (ASO)51, Crystal Structure Algorithm (CryStAl)52–55, and Electromagnetic field optimization (EFO)56. The third category includes algorithms that mimic various optimal behaviors of humans, for example, Imperialist Competitive Algorithm (ICA)57, Teaching Learning Based Optimization (TLBO)58, Interior Search Algorithm (ISA)59, and Stochastic Paint Optimizer (SPO)60.
Though there is a wide range of metaheuristic methods developed over the past few decades, they solve problems with different accuracies and time efficiencies; that is, one algorithm may not solve a specific problem with a desired accuracy or within a reasonable time, whereas another algorithm may be capable of achieving this goal. Therefore, computational time and accuracy are two essential considerations in developing novel metaheuristic methods. In other words, new robust methods are developed for more efficient search in the space of problems, and to find more accurate solutions to complex and large-scale problems in less time than previous ones. Therefore, there is an ongoing ambition in the optimization community to develop novel high-performance optimizers which can solve challenging problems more efficiently. In other words, each algorithm has particular advantages and disadvantages that are listed in Table 1 for the abovementioned algorithms.
Table 1.
Advantages and disadvantages of various metaheuristic algorithms.
| Algorithm | References | Advantages | Disadvantages |
|---|---|---|---|
| GA | 61 |
Simplicity, flexibility, and ease of implementation Ability to deal with complex fitness landscapes |
Slow convergence rate Having several tuning parameters Getting easily stuck in local optima |
| DE | 62 |
Simplicity, flexibility, and ease of implementation Robustness |
Having several tuning parameters Getting easily stuck in local optima |
| BBO | 63 | Simplicity, flexibility, and ease of implementation |
Slow convergence rate Having several tuning parameters Low exploration capability |
| PSO | 64 | Simplicity, flexibility, and ease of implementation |
Getting easily stuck in local optima High sensitivity to parameters tunning |
| ACO | 65 |
Suitability for discrete and combinatorial problems Satisfying the local and global searches of the entire search space |
Not suitable for continuous problems Getting easily stuck in local optima High computational cost |
| ABC | 66 |
Simplicity, flexibility, and ease of implementation Good exploration capability Having only one parameter to be tunned |
Slow convergence rate Low exploitation capability Getting easily stuck in local optima |
| FA | 67 |
Simplicity, flexibility, and ease of implementation Being a memory-less algorithm |
Slow convergence rate Having several tuning parameters Low exploration capability |
| CS | 68 |
Simplicity, flexibility, and ease of implementation Having only one parameter to be tunned |
Slow convergence rate Getting easily stuck in local optima |
| BA | 69 | Simplicity, flexibility, ease of implementation |
Fast convergence in early iterations and subsequent slow-down Having several tuning parameters Getting easily stuck in local optima |
| Eagle Strategy | 19 | Efficiency in exploration and exploitation |
Having several tuning parameters Getting easily stuck in local optima |
| KH | 70 |
Ease of implementation Having only one parameter to be tunned |
Slow convergence rate Getting easily stuck in local optima |
| FPA | 71 | Simplicity, flexibility, and ease of implementation |
Suffering from premature convergence Having several tuning parameters Being time-consuming |
| GWO | 72 |
No need for a larger storage Fast convergence |
Getting trapped in local optima of large-scale problems |
| ALO | 73 | High feasibility and efficiency in reaching global optima |
Suffering from premature convergence Probability distribution changes by generations Relatively not simple |
| GOA | 74 | Simplicity, flexibility, and ease of implementation |
Slow convergence rate Getting easily stuck in local optima |
| SOS | 75 |
Being a parameter-free algorithm Satisfying the local and global searches of the entire search space Good exploitation capability |
Low computational efficiency Poor performance in handling high-dimensional and complex problems |
| MFO | 76 | Simplicity, flexibility, and ease of implementation |
Slow convergence rate Getting easily stuck in local optima Having several tuning parameters |
| DA | 77 |
Powerful neighborhood search characteristics Easy to merge with other algorithms |
Suffering from premature convergence Getting easily stuck in local optima Having several tuning parameters |
| SSA | 78 |
Few control parameters High feasibility and efficiency in reaching global optima |
Suffering from premature convergence Probability distribution changes by generations |
| CSA | 79 |
Simplicity, flexibility, and ease of implementation Few control parameters |
Slow convergence rate Getting easily stuck in local optima Poor performance in handling high-dimensional and complex problems |
| WOA | 80 |
Appropriate convergence rate Powerful neighborhood exploration characteristics Lower probably of trapping into local optima |
Several tuning parameters May suffer from premature convergence Probability distribution changes by generations |
| DSO | 33 | Effectively avoiding local optimality with a non-increasing uncertainty |
Several tuning parameters High computational time |
| SHO | 81 |
Simplicity, flexibility, and ease of implementation Compatibility, robustness, and scalability |
Suffers from premature convergence Proneness to get stuck in local optimums Long iterations in some problems |
| FFA | 35 | Appropriate convergence rate |
Relatively high computational cost Several tuning parameters |
| AVO | 37 |
Good convergence performance in handling some complex optimization problems Performing well in high-dimensional problems |
Relatively complex Several tuning parameters |
| BES | 38 |
Simplicity, flexibility, and ease of implementation Appropriate balance between exploration and exploitation abilities |
May stuck in local optimums Several tuning parameters |
| TSA | 82 |
Simplicity, flexibility, and ease of implementation Has just one parameter to be tunned |
May stuck in local optimums Low effectiveness in solving complex and high dimensional optimization problems |
| GTO | 42 |
Compatibility, robustness, and scalability Good convergence performance in handling some complex optimization problems |
Relatively complex Several tuning parameters Relatively high computational cost |
| SA | 83 |
Simplicity and ease of implementation Sound theoretical guarantees |
Getting easily stuck in local optima Long computational time Sensitivity to parameters tunning |
| BB–BC | 84 |
Simplicity and ease of implementation Few control parameters |
Suffering from premature convergence Easily getting stuck in local optima |
| CSS | 85 |
Simplicity and ease of implementation Efficiency for engineering applications |
Several tuning parameters May get stuck in local optima Relatively high computational cost |
| CGO | 47 |
Being a parameter-free algorithm Appropriate convergence rate Satisfying the local and global searches of the entire search space |
May get stuck in local optima for special problems For large-scale problems, sensitive to the number of population |
| GSA | 86 |
Simplicity, flexibility, and ease of implementation Being a memory-less algorithm |
Getting easily stuck in local optima Several tuning parameters Slow search speed in final iterations |
| SCA | 87 |
Reasonable time of execution Lower probability of being stuck in local optima Powerful neighborhood exploration characteristics |
Suffering from premature convergence Several tuning parameters Probability distribution changes by generations |
| MOA | 88 | Powerful neighborhood exploration characteristics |
Suffering from premature convergence Several tuning parameters Probability distribution changes by generations |
| ASO | 51 |
Appropriate balance between exploration and exploitation abilities Being a memory-less algorithm |
Relatively complex Slow convergence rate Several tuning parameters |
| CryStAl | 52 |
Simplicity, flexibility, and ease of implementation Being a parameter-free algorithm Satisfying the local and global searches of the entire search space |
Relatively poor performance for some high-dimensional problems Need for a high number of iterations for some examples to find a suitable solution |
| AEFA | 89 |
Simplicity, flexibility, and ease of implementation Good convergence performance in handling some complex optimization problems |
Suffering from premature convergence Poor search ability in handling complex optimization problems Several tuning parameters |
| ICA | 90 |
Appropriate convergence rate Strong neighborhood search property |
May suffer from premature convergence Several tuning parameters |
| TLBO | 91 |
Being a parameter-free algorithm Appropriate convergence rate Efficient for large-scale problems |
Often loses its effectiveness when tackling problems with optima distant from the origin May get stuck in local optima |
| ISA | 92 | Having only one parameter to be tunned |
May get stuck in local optima Suffering from premature convergence |
| SPO | 60 |
Being a parameter-free algorithm Appropriate convergence rate Capability of working with low initial population sizes Simplicity, flexibility, and ease of implementation |
May get stuck in local optima for special examples Relatively high computational cost for large-scale problems |
The contribution of this paper is to develop a new physics-based metaheuristic algorithm called Fusion Fission Optimization (FuFiO) algorithm. The proposed algorithm simulates the tendency of nuclei to increase their binding energy and achieve higher levels of stability. In the FuFiO algorithm, the nuclei are divided into two groups, namely stable and unstable, based on their fitness. Each nucleus can interact with other nuclei using three different types of nuclear reactions, including fusion, fission, and -decay. These reactions establish the stabilization process of unstable nuclei through which they gradually turn into stable nuclei.
The performance of the FuFiO algorithm is also examined and explained in two steps as follows. In the first step, FuFiO and seven other metaheuristic algorithms are used to solve a complete set of 120 benchmark mathematical test functions (including 60 fixed-dimensional and 60 N-dimensional test functions). Then, to make a valid judgment about the performance of the FuFiO algorithm, the obtained statistical results of FuFiO and the other algorithms are utilized as a dataset to be analyzed by non-parametric statistical methods. In the second step, to compare the ability of the proposed algorithm with state-of-the-art algorithms, the single-objective real-parameter numerical optimization problems of the recent Competitions on Evolutionary Computation (CEC 2017) including sets of 10-, 30-, 50-, and 100- dimensional benchmark test functions are considered. It should be noted that in this work, the main novelty is two-fold. First, the source of inspiration is provided by some fundamental aspects of nuclear physics. Second, that is of higher importance and rigor, the theory of nuclear binding energy to generate stable nuclei is used to develop the equations of a metaheuristic method for the first time. In this model, the tendency of nuclei to increase their binding energy and achieve higher levels of stability using nuclear reactions, including fusion, fission, and β-decay, is considered the central principle to develop the three main steps of the new algorithm.
The rest of this paper is organized as follows: “Fusion–fission optimization (FuFiO) algorithm” section describes the background, inspiration, mathematical model, and implementation of the proposed algorithm. “FuFiO validation” section explains comparative metaheuristics, mathematical functions, comparative results, and statistical analyses. “Analyses based on competitions on evolutionary computation (CEC)” section compares the performance of the FuFiO algorithm on the CEC-2017 and CEC-2019 special season with state-of-the-art algorithms. Finally, conclusions are given in “Conclusions and future work” section.
Fusion–fission optimization (FuFiO) algorithm
In the following sub-sections, the general principles of nuclear reactions, nuclear binding energy, and nuclear stability are discussed as an inspirational basis for the development of the Fusion–Fission Optimization (FuFiO) algorithm.
Inspiration
In nuclear physics, the minimum energy needed to dismantle the nucleus of an atom into its constituent nucleons, i.e., the collection of protons (Z) and neutrons (N), is called nuclear binding energy. The strong nuclear force that attracts the nucleons to each other has a positive value and creates this nuclear binding energy. Therefore, a nucleus with more binding energy provides more stability93. Importantly, the Coulomb repulsive force of protons reduces the nuclear attraction force and decreases the binding energy. Consequently, the stability of the nucleus further decreases when more protons are replaced with neutrons. Also, in the nuclei, most of the paired protons are close to each other such that their repulsive force decreases the strong nuclear force, leading to instability.
The concept of average nuclear binding energy, denoted by , is generally used to evaluate the stability of nuclei. is the amount of energy required to disassemble every single nucleon from the nucleus, which is defined as the nuclear binding energy per nucleon in the nucleus. As increases, disassembling every single nucleon from the nucleus becomes progressively more difficult; in other words, the most stable nucleus corresponds to the highest . The experimental diagram of associated with mass number is shown in Fig. 1. According to this diagram, the binding energy reaches its peak at (), and in , the rate of energy reduction is low, such that the diagram has a relatively flat behavior due to saturation. The nucleus divides the diagram into two parts, namely fusion and fission. The nuclei of the fusion part tend to participate in a fusion reaction, whereas in the fission part, each nucleus tends to participate in a fission reaction.
Figure 1.
Experimental binding energy with respect to mass number A49.
Fusion is a nuclear reaction and occurs when two highly-energetic stable nuclei slam together to form a heavier stable nucleus. In the sun, this reaction creates a lot of energy through the fusion of two hydrogen nuclei to form one helium nucleus. On the other hand, fission is a nuclear reaction in which a larger unstable nucleus is split into two smaller (stable or unstable) nuclei due to a hit by a smaller stable or unstable one. This type of reaction is used to produce a lot of energy in nuclear power reactors through the fission of Uranium and Plutonium nuclei by neutrons. The procedures of nuclear fusion and fission are illustrated in Fig. 2a,b, respectively.
Figure 2.
Nuclear reactions: (a) fusion, and (b) fission.
In nuclear processes, in addition to fusion and fission, there is another process called -decay. The two types of -decay are known as and . In -decay, a neutron is converted to a proton, and the process creates an electron and an electron antineutrino (), while in -decay, a proton is converted to a neutron and the process creates a positron and an electron neutrino ()94. Also, neutrino and antineutrino particles have no essential role in reactions because they have considerably smaller masses compared to other particles. Therefore, protons and neutrons are the main factors in -decays. In Fig. 3, the schematic representations of - and -decays are presented.
Figure 3.
Processes of -decay: (a) -decays, and (b) -decays.
Mathematical model
In this section, we describe the mathematical model of the FuFiO algorithm, which is developed based on the tendency of nuclei to increase their binding energy and get a higher level of stability using nuclear reactions, including fusion, fission, and -decay. Importantly, as a nucleus with a higher level of binding energy is considered a better solution, the FuFiO algorithm will move in a direction that increases the binding energy of the nuclei. FuFiO is designed as a population-based metaheuristic method in which a set of nuclei are considered as the agents of the population. Each agent of the population has a specific position, and each of them has a particular dimension (d) which is determined by the number of problem variables. Therefore, the nuclei move in a d-dimensional space, and are represented in the form of a matrix as follows:
| 1 |
where is the counter of nucleus and is the counter of design variables; is the population size; is the matrix of positions of all nuclei updated in each iteration of algorithm; is the position of the i-th nucleus; and is the j-th design variable of the i-th nucleus the initial value of which is determined randomly as follows:
| 2 |
where represents the initial position of the j-th design variable of the i-th nucleus; and are respectively the maximum and minimum possible values for the j-th design variable; and is a random number in the interval [0,1]. The set of initial s will create that represents the initial position of nuclei. Furthermore, in the FuFiO method, the nuclei are divided into two groups, namely stable and unstable nuclei, based on the level of binding energy. Depending on the types of reacting nuclei, nuclear reactions (i.e., fusion, fission, and -decay) are regarded differently. In other words, as illustrated in Fig. 4, three different types of reaction can be considered in each group for nuclei to update their positions.
Figure 4.
Graphical representation of different reactions in each group of nuclei.
The mathematical formulation of each reaction in each group modeled as follows:
Group 1: Stable nucleus
If the i-th nucleus is stable (), one of the following three reactions is selected randomly:
Reaction 1: In this reaction, the i-th nucleus slams with another stable nucleus. The new position is determined as follows:
| 3 |
where r is a random vector in [0,1] and is a stable nucleus selected randomly from other stable nuclei. This reaction simulates fusion, where two stable nuclei slam together to produce a new nucleus. Figure 5 shows a schematic view of this reaction, from which it can be seen that the new solution is a random point generated in the reaction space using and .
Figure 5.

Schematic representation of a fission reaction.
Reaction 2: If the i-th nucleus interacts with an unstable nucleus, this collision produces a new solution expressed as:
| 4 |
where is an unstable nucleus selected randomly from other unstable nuclei. The process of this reaction, shown in Fig. 6, simulates the rule of fission, where a stable nucleus is hit by an unstable one.
Figure 6.

Schematic representation of a fission reaction.
Reaction 3: If the i-th nucleus decays, the new solution will be generated as follows:
| 5 |
where denotes a random subset of problem variables; is the set of all variables; is the counter of variables; is a random nucleus; and and are the vectors of the lower and upper bound of variables, respectively. This reaction models the process of -decay in a stable nucleus as presented in Fig. 7.
Figure 7.

Procedure of -decay in a stable nucleus.
Group 2: Unstable nucleus
In the second group, if the i-th nucleus is unstable (), one of the following three reactions will be used randomly to update the i-th nucleus:
Reaction 1: If the unstable nucleus slams with another unstable nucleus, the new position is obtained as follows:
| 6 |
where is a random vector in interval [0,1] and is an unstable nucleus selected randomly from other unstable nuclei. As illustrated in Fig. 8, this reaction simulates the rule of fission where an unstable nucleus is hit by an unstable one.
Figure 8.

Fission of two unstable nuclei.
Reaction 2: If the unstable nucleus, , interacts with a stable nucleus, the new position is as follows:
| 7 |
where is a randomly selected stable nucleus from stable nuclei. The process of this reaction, which establishes a fission model of stable and unstable nuclei, is shown in Fig. 9.
Figure 9.

Fission of stable and unstable nuclei.
Reaction 3: If the i-th unstable nucleus decays, the new position is defined as follows:
| 8 |
where denotes a random subset of variables; is the set of all variables; is the counter of variables; and is a randomly selected nucleus from stable nuclei. As presented in Fig. 10, this reaction models the -decay process of an unstable nucleus.
Figure 10.

Procedure of β-decay in an unstable nucleus.
Both third reactions in the stable and unstable groups represent the -decays. In the former reaction, a random set of decision variables takes new random values between their corresponding allowable lower and upper bounds, whereas, in the latter one, a random subset of decision variables takes their new values from the corresponding decision variables of a randomly-chosen stable solution. Importantly, the -decays are considered as mutation operators to escape from local optima.
Stable and unstable nuclei
The level of binding energy of a nucleus determines whether it is stable or unstable, and in the FuFiO algorithm, the objective function value, , is used to specify the group of agents. In other words, in the FuFiO algorithm, a nucleus with a better is considered to be more stable. Moreover, as can be seen from Fig. 1, the nucleus is the boundary of stable and unstable groups. This boundary is also considered in the FuFiO algorithm to distinguish stable nucleus from unstable ones. To this end, the nucleus is evaluated in each iteration and a set of better ones is considered as the set of stable nuclei. The size of stable nuclei is determined as follows:
| 9 |
where is the size of stable nuclei at each iteration; is a function that rounds its argument to the nearest integer number; is the population size; and are the minimum and maximum percent of stable nuclei at the start and the end of the algorithm, respectively; is the counter of iterations; and is the maximum iteration of the algorithm. In Eq. (9), the size of stable particles is determined dynamically as the algorithm progresses. Also, in determining , the two parameters and should be fine-tuned. The values of and are considered 10% and 70%, respectively. This formulation increases the size of stable nuclei from 10 to 70% at the end of the algorithm. In addition, the value of is naturally adopted in which the ratio of stable nuclei to unstable nuclei is assumed to be around 70%.
Boundary handling
In solving an optimization problem with variables, optimizers search in a d-dimensional search space. Each of these dimensions has its upper and lower boundaries, and the variables of found solutions should be placed in the interval of boundaries. Given that some variables may violate boundaries during their movements, in the FuFiO algorithm, the following equations, which replace violated boundaries with violated variables, are used to return them within the boundaries:
| 10 |
where is the j-th design variable of the i-th new solution , and min and max are operators that return the minimum and maximum of and , respectively.
Replacement strategy
In each reaction, a new position is generated to be replaced with the current position of the i-th nucleus . This replacement will take place whenever the new solution has a better level of binding energy than the current one. This procedure is formulated as follows:
| 11 |
Selection of reactions
In the FuFiO algorithm, nuclei are categorized into two groups; in each group, three different reactions are developed, of which one is randomly selected to generate a new solution. It should be noted that different groups and reactions do not represent different phases of the algorithm. In other words, the FuFiO algorithm has one phase, wherein for each nucleus in each iteration, one of the reactions is randomly selected according to the group of the nucleus to generate the new solutions, as shown in Fig. 11.
Figure 11.
Flowchart of the process of determining groups and reactions in each iteration for each agent.
Terminating criterion
In metaheuristics, the search process will be finished after satisfying a terminating criterion, following that the best result will be reported. Some of the most common stop criteria are as follows:
The best result is equal to the minimum specified value determined for the objective function.
The optimization process will be terminated after a fixed number of iterations.
The value of the objective function does not change during the specified period.
The optimization process time has reached a predetermined value.
Implementation of FuFiO
Based on the concepts developed in previous sections, the FuFiO algorithm is implemented in two levels as follows:
Level 1: Initialization
Step 1: Determine the number of nucleus (), maximum number of iterations (), and variable bounds and .
Step 2: Determine the parameters of FuFiO, namely and .
Step 4: Calculate the objective function of initial solutions.
Level 2: Nuclear reaction
In each iteration of the FuFiO algorithm, all of the agents will perform the following steps:
Step 1: is updated (Eq. (9)).
Step 2: Population is sorted according to .
Step 3: Stable and unstable nuclei are determined.
Step 4: The group of current nucleus is determined.
Step 5: The new solution is generated using the selected reaction (Eqs. (3), (4), (5), (6), (7), and (8)).
Step 6: The new solution is clamped as Eq. (10).
Step 7: The new solution is evaluated and objective function is calculated.
Step 8: The new solution is checked to replace the current solution as Eq. (11).
Step 9: Nuclear reaction level is repeated until a terminating criterion is satisfied.
The flowchart of the FuFiO algorithm is illustrated in Fig. 12.
Figure 12.
Flowchart of the Fusion–Fission Optimization (FuFiO) algorithm.
FuFiO validation
The No Free Lunch (NFL) theorem95 is one of the most famous theories which have been cited many times in literature to pave the way for introducing new metaheuristic algorithms. This theorem has logically proved that no algorithm can solve all types of problems. However, the NFL theorem is used here for a different purpose. In other words, it is used here to validate the capability of the FuFiO algorithm in solving various problems compared to other algorithms. To this end, in this study, 120 benchmark test functions are considered to challenge the performance of the proposed algorithm in solving different types of problems. Also, another application of these problems is to create a dataset to be used in non-parametric statistical analyses to examine the performance of the proposed algorithm more thoroughly.
In this section, first, the description of the test problems is presented; then, a number of rival metaheuristics with their settings are reviewed. Subsequently, the evaluation metrics and comparative results are explained; and finally, the results of non-parametric statistical methods will be presented.
Test functions
To evaluate the capability of the proposed algorithm in handling various types of benchmark functions with different properties, a set of 120 mathematical problems has been used. Based on their dimensions, these problems have been categorized into two groups: (1) fixed-dimensional problems, and (2) N-dimensional problems.
Amongst these functions, F1 to F60 are fixed-dimensional functions, with dimensions of 2 to 10. The second group of problems, F61 to F120, includes 60 N-dimensional test functions, the dimensions of which are considered to be equal to 30. The details of the mathematical functions in these two groups are presented in Tables 2 and 3, respectively. In these tables, C, NC, D, ND, S, NS, Sc, NSC, U, and M denote Continuous, Non-Continuous, Differentiable, Non-Differentiable, Separable, Non-Separable, Scalable, Non-Scalable, Unimodal, and Multi-modal, respectively. In addition, R, D, and Min represent the variables range, variables dimension, and the global minimum of the functions, respectively.
Table 2.
Details of the fixed-dimensional benchmark mathematical functions.
| No | Function | Type | Range | D | Formulation | Min |
|---|---|---|---|---|---|---|
| F1 | Ackley 2 Function | C, D, NS, Sc, M | [− 35, 35] | 2 | 96 | − 200 |
| F2 | Ackley 3 Function | C, D, NS, NSc, U | [− 32, 32] | 2 | 96 | − 195.629 |
| F3 | Ackley 4 or Modified Ackley | C, D, NS, Sc, M | [− 32, 32] | 2 | 96 | − 4.590102 |
| F4 | Adjiman Function | C, D, NS, NSc, M | [− 1, 2] and [− 1, 1] | 2 | 96 | − 2.021807 |
| F5 | Bartels Conn Function | C, ND, NS, NSc, M | [− 500, 500] | 2 | 96 | 1 |
| F6 | Bohachevsky 1 Function | C, D, S, NSc, M | [− 100, 100] | 2 | 96 | 0 |
| F7 | Bohachevsky 2 Function | C, D, NS, NSc, M | [− 100, 100] | 2 | 96 | 0 |
| F8 | Bohachevsky 3 Function | C, D, NS, NSc, M | [− 100, 100] | 2 | 96 | 0 |
| F9 | Camel Function-Three Hump | C, D, NS, NSc, M | [− 5, 5] | 2 | 96 | 0 |
| F10 | Carrom table function | NS | [− 10, 10] | 2 | 96 | − 24.15682 |
| F11 | Chichinadze Function | C, D, S, NSc, M | [− 30, 30] | 2 | 96 | − 43.72192 |
| F12 | Cross-in-Tray Function | C, NS, NSc, M | [− 10, 10] | 2 | 96 | − 2.062612 |
| F13 | Cube Function | C, D, NS, NSc, U | [− 10, 10] | 2 | 96 | 0 |
| F14 | Damavandi Function | C, D, NS, NSc, M | [0, 14] | 2 | 96 | 0 |
| F15 | Deckkers–Aarts Function | C, D, NS, NSc, M | [− 20, 20] | 2 | 96 | − 24,776.52 |
| F16 | Egg Crate Function | C, D, NS, Sc, M | [− 5, 5] | 2 | 96 | 0 |
| F17 | Giunta Function | C, D, S, Sc, M | [− 1, 1] | 2 | 96 | 0.0644704 |
| F18 | Hansen Function | C, D, S, NSc, M | [− 10, 10] | 2 | 96 | − 166.0291 |
| F19 | Himmelblau Function | C, D, NS, NSc, M | [− 5, 5] | 2 | 96 | 0 |
| F20 | Hosaki Function | C, D, NS, NSc, M | [0, 5] and [0, 6] | 2 | 96 | − 2.3458 |
| F21 | Jennrich–Sampson Function | C, D, NS, NSc, M | [− 1, 1] | 2 | 96 | 124.36218 |
| F22 | Keane Function | C, D, NS, NSc, M | [0, 10] | 2 | 96 | − 0.673668 |
| F23 | Leon Function | C, D, NS, NSc, U | [− 1.2, 1.2] | 2 | 96 | 0 |
| F24 | Levy 3 Function | S | [− 10, 10] | 2 | 97 | − 176.5418 |
| F25 | Levy 5 Function | NS | [− 10, 10] | 2 | 97 | − 176.1376 |
| F26 | Matyas Function | C, D, NS, NSc, U | [− 10, 10] | 2 | 96 | 0 |
| F27 | McCormick Function | C, D, NS, NSc, M | [− 1.5, 4] and [− 3, 3] | 2 | 96 | − 1.913223 |
| F28 | Mexican hat Function | NS | [− 10, 10] | 2 | 97 | − 19.96668 |
| F29 | Michaelewicz 2 Function | S | [0, π] | 2 | 97 | − 1.8013 |
| F30 | Mishra 5 Function | C, D, NS, NSc, M | [− 10, 10] | 2 | 96 | − 1.01983 |
| F31 | Mishra 6 Function | C, D, NS, NSc, M | [− 10, 10] | 2 | 96 | − 2.28395 |
| F32 | Mishra 8 Function | C, D, NS, NSc, M | [− 10, 10] | 2 | 96 | 0 |
| F33 | Pen Holder Function | C, D, NS, NSc, M | [− 11, 11] | 2 | 96 | − 0.963535 |
| F34 | Periodic Function | S | [− 10, 10] | 2 | 97 | 0.9 |
| F35 | Price 1 Function | C, ND, S, NSc, M | [− 500, 500] | 2 | 96 | 0 |
| F36 | Price 2 Function | C, D, NS, NSc, M | [− 10, 10] | 2 | 96 | 0.9 |
| F37 | Price 4 Function | C, D, NS, NSc, M | [− 500, 500] | 2 | 96 | 0 |
| F38 | Quadratic Function | C, D, NS, NSc | [− 10, 10] | 2 | 96 | − 3873.724 |
| F39 | Ripple 1 Function | NS | [0, 1] | 2 | 97 | − 2.2 |
| F40 | Ripple 25 Function | NS | [0, 1] | 2 | 97 | − 2 |
| F41 | Rosenbrock Modified Function | C, D, NS, NSc, M | [− 2, 2] | 2 | 96 | 34.040243 |
| F42 | Rotated Ellipse Function | C, D, NS, NSc, U | [− 500, 500] | 2 | 96 | 0 |
| F43 | Rotated Ellipse 2 Function | C, D, NS, NSc, U | [− 500, 500] | 2 | 96 | 0 |
| F44 | Scahffer 2 Function | C, D, NS, NSc, U | [− 100, 100] | 2 | 96 | 0 |
| F45 | Scahffer 3 Function | C, D, NS, NSc, U | [− 100, 100] | 2 | 96 | 0.0015669 |
| F46 | Scahffer 4 Function | C, D, NS, NSc, U | [− 100, 100] | 2 | 96 | 0.292579 |
| F47 | Table 1/Holder Table 1 Function | C, D, S, NSc, M | [− 10, 10] | 2 | 96 | − 26.92034 |
| F48 | Table 2/Holder Table 2 Function | C, D, S, NSc, M | [− 10, 10] | 2 | 96 | − 19.2085 |
| F49 | Table 3/Carrom Table Function | C, D, NS, NSc, M | [− 10, 10] | 2 | 96 | − 24.15682 |
| F50 | Ursem 1 Function | S | [− 2.5, 3] and [− 2, 2] | 2 | 97 | − 4.816814 |
| F51 | Ursem 3 Function | NS | [− 2, 2] and [− 1.5, 1.5] | 2 | 97 | − 3 |
| F96 | Ursem 4 Function | NS | [− 2, 2] | 2 | 97 | − 1.5 |
| F53 | Ursem Waves Function | NS | [− 0.9, 1.2] and [− 1.2, 1.2] | 2 | 97 | − 8.5536 |
| F54 | Venter Sobiezcczanski-Sobieski Function | C, D, S, NSc | [− 50, 50] | 2 | 96 | − 400 |
| F55 | Wayburn Seader 3 Function | C, D, NS, Sc, U | [− 500, 500] | 2 | 96 | 19.10588 |
| F56 | Zettl Function | C, D, NS, NSc, U | [− 5, 10] | 2 | 96 | − 0.003791 |
| F57 | Zirilli or Aluffi-Pentini’s Function | C, D, S, NSc, U | [− 10, 10] | 2 | 96 | − 0.352386 |
| F58 | Zirilli Function 2 | C, D, S, S, M | [− 500, 500] | 2 | 96 | 0 |
| F59 | Corana Function | DC, ND, S, Sc, M | [− 500, 500] | 4 | 96 | 0 |
| F60 | Michalewicz 10 | S | [0, ] | 10 | 97 | − 9.66015 |
Table 3.
Details of the N-dimensional benchmark mathematical functions.
| No | Function | Type | Range | D | Formulation | Min |
|---|---|---|---|---|---|---|
| F61 | Ackley 1 Function | C, D, NS, Sc,M | [− 35, 35] | 30 | 96 | 0 |
| F62 | Alpine 1 Function | C, ND, S, NSc,U | [− 10, 10] | 30 | 96 | 0 |
| F63 | Brown Function | C, D, NS, Sc, U | [− 1, 4] | 30 | 96 | 0 |
| F64 | Chung Reynolds Function | C, D, PS, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F65 | Cosine Mixture | C, ND, S, Sc, M | [− 1, 1] | 30 | 96 | − 3 |
| F66 | Csendes Function | C, D, S, Sc, M | [− 1, 1] | 30 | 96 | 0 |
| F67 | Deb 1 Function | C, D, S, Sc, M | [− 1, 1] | 30 | 96 | − 1 |
| F68 | Deb 3 Function | C, D, S, Sc, M | [0, 1] | 30 | 96 | − 1 |
| F69 | Dixon and Price Function | C, D, NS, Sc, U | [− 10, 10] | 30 | 96 | 0 |
| F70 | Exponential Function | C, D, NS, Sc, M | [− 1, 1] | 30 | 96 | − 1 |
| F71 | Griewank Function | C, D, NS, Sc, M | [− 100,100] | 30 | 96 | 0 |
| F72 | Holzman 2 Function | S | [− 10, 10] | 30 | 97 | 0 |
| F73 | Levy 8 Function | NS | [− 10, 10] | 30 | 97 | 0 |
| F74 | Mishra 1 Function | C, D, NS, Sc, M | [0, 1] | 30 | 96 | 2 |
| F75 | Mishra 2 Function | C, D, NS, Sc, M | [0, 1] | 30 | 96 | 2 |
| F76 | Mishra 7 Function | C, D, NS, NSc, M | [− 10, 10] | 30 | 96 | 0 |
| F77 | Mishra 11 Function | C, D, NS, NSc, M | [− 10, 10] | 30 | 96 | 0 |
| F78 | Pathological Function | C, D, NS, NSc, M | [− 100, 100] | 30 | 96 | 0 |
| F79 | Pint´er Function | C, D, NS, Sc, M | [− 10, 10] | 30 | 96 | 0 |
| F80 | Powell Singular Function | C, D, NS, Sc, U | [− 4, 5] | 30 | 96 | 0 |
| F81 | Powell Singular 2 Function | C, D, NS, Sc, U | [− 4, 5] | 30 | 96 | 0 |
| F82 | Powell Sum Function | C, D, S, Sc, U | [− 1, 1] | 30 | 96 | 0 |
| F83 | Rastrigin Function | C, D, S, M | [− 5.12, 5.12] | 30 | 96 | 0 |
| F84 | Qing Function | C, D, S, Sc, M | [− 500, 500] | 30 | 96 | 0 |
| F85 | Quartic | C, D, S, Sc | [− 1.28, 1.28] | 30 | 96 | 0 |
| F86 | Quintic Function | C, D, S, NSc, M | [− 10, 10] | 30 | 96 | 0 |
| F87 | Rosenbrock Function | C, D, NS, Sc, U | [− 30, 30] | 30 | 96 | 0 |
| F88 | Salomon Function | C, D, NS, Sc, M | [− 100, 100] | 30 | 96 | 0 |
| F89 | Sargan | C, D, NS, Sc, M | [− 100, 100] | 30 | 96 | 0 |
| F90 | Schumer Steiglitz Function | C, D, S, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F91 | Schwefel Function | C, D, PS, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F92 | Schwefel 1.2 Function | C, D, NS, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F93 | Schwefel 2.4 Function | C, D, S, NSc, M | [0, 10] | 30 | 96 | 0 |
| F94 | Schwefel 2.20 Function | C, ND, S, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F95 | Schwefel 2.21 Function | C, ND, S, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F96 | Schwefel 2.22 Function | C, D, NS, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F97 | Schwefel 2.23 Function | C, D, NS, Sc, U | [− 10, 10] | 30 | 96 | 0 |
| F98 | Schwefel 2.26 Function | C, D, S, Sc, M | [− 500, 500] | 30 | 96 | − 418.9828 |
| F99 | Shubert | C, D, S, NSc, M | [− 10, 10] | 30 | 96 | − 186.7309 |
| F100 | Shubert 3 | C, D, S, NSc, M | [− 10, 10] | 30 | 96 | − 29.6759 |
| F101 | Shubert 4 | C, D, S, NSc, M | [− 10, 10] | 30 | 96 | − 25.74177 |
| F102 | Schaffer F6 | C, D, NS, Sc, M | [− 100, 100] | 30 | 96 | 0 |
| F103 | Sphere Function | C, D, S, Sc, M | [0, 10] | 30 | 96 | 0 |
| F104 | Step Function | DC, ND, S, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F105 | Step 2 Function | DC, ND, S, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F106 | Step 3 Function | DC, ND, S, Sc, U | [− 100, 100] | 30 | 96 | 0 |
| F107 | Stepint Function | DC, ND, S, Sc, U | [− 5.12, 5.12] | 30 | 96 | − 155 |
| F108 | Streched V Sine Wave Function | C, D, NS, Sc, U | [− 10, 10] | 30 | 96 | 0 |
| F109 | Sum Squares Function | C, D, S, Sc, U | [− 10, 10] | 30 | 96 | 0 |
| F110 | Styblinski–Tang Function | C, D, NS, NSc, M | [− 5, 5] | 30 | 96 | − 1174.985 |
| F111 | Trigonometric 1 Function | C, D, NS, Sc, M | [0, π] | 30 | 96 | 0 |
| F112 | Trigonometric 2 Function | C, D, NS, Sc, M | [− 500, 500] | 30 | 96 | 1 |
| F113 | W/Wavy Function | C, D, S, Sc, M | [− π, π] | 30 | 96 | 0 |
| F114 | Weierstrass | C, D, S, Sc, M | [− 0.5, 0.5] | 30 | 96 | 0 |
| F115 | Whitley | C, D, NS, Sc, M | [− 10.24, 10.24] | 30 | 96 | 0 |
| F116 | Xin-She Yang (Function 1) | DC, ND, NS, Sc, M | [− 20, 20] | 30 | 96 | 0 |
| F117 | Xin-She Yang (Function 2) | DC, ND, NS, Sc, M | [− 10, 10] | 30 | 96 | 0 |
| F118 | Xin-She Yang (Function 3) | DC, ND, NS, Sc, M | [− 2π, 2π] | 30 | 96 | − 1 |
| F119 | Xin-She Yang (Function 4) | DC, ND, NS, Sc, M | [− 5, 5] | 30 | 96 | − 1 |
| F120 | Zakharov Function | C, D, NS, Sc, M | [− 5, 10] | 30 | 96 | 0 |
Metaheuristic algorithms for comparative studies
To investigate the overall performance of the FuFiO algorithm, its results should be compared with those of other methods. The selected metaheuristics for this purpose are FA, CS, Jaya, TEO, SCA, MVO, and CSA algorithms, of which the most recent and improved versions are utilized here. Among the selected methods, only SCA is parameter-free, whereas the other metaheuristics have some specific parameters that should be tuned carefully. Table 4 presents a summary of these parameters, adopted from the literature, that we have utilized in our evaluations.
Table 4.
Summary of parameters associated with the methods used for comparative analyses.
| Metaheuristic | Parameters | Description | Value |
|---|---|---|---|
| FA | Light absorption coefficient | 1 | |
| Attraction coefficient base value | 2 | ||
| Mutation coefficient | 0.2 | ||
| Mutation coefficient damping ratio | 0.98 | ||
| Uniform mutation range | 0.05 | ||
| CS | p | Discovery rate of alien eggs | 0.25 |
| TEO | Controlling parameters | rand | |
| Controlling parameters | rand | ||
| Thermal memory size | 5 | ||
| Mutation probability | 0.05 | ||
| MVO | Maximum Wormhole Existence Probability | 1.0 | |
| Minimum Wormhole Existence Probability | 0.2 | ||
| Exploitation accuracy | 1/6 | ||
| CSA | ap | Awareness probability | 0.10 |
| fl | Flight length | 2.00 | |
| FuFiO | Maximum percent of stable nuclei | 70% | |
| Minimum percent of stable nuclei | 10% |
Generally speaking, the performance of a powerful and versatile algorithm should be independent of the problem that is to be solved. In other words, for a good algorithm, parameter tunning should not be of crucial importance. Considering this point, we developed the FuFiO algorithm in a way that there are only two extra parameters, namely Ls and Us. We performed a statistical study on the effect of these parameters and found out that if they are chosen from within predefined limits, determining the exact values of them is not necessary. Knowing that Ls and Us are respectively the minimum and maximum percentages of stable nuclei at the beginning and end of the algorithm, Ls should be a small value, e.g. 0.1–0.4, whereas Us should be in the range of 0.5–0.9. In this study, we considered Ls and Us to be 0.1 and 0.7, respectively.
Numerical results
This section presents the results of the FuFiO and other methods in dealing with benchmark problems. In this study, due to the random nature of metaheuristics, each algorithm is independently run 50 times for each problem. Then, the statistical results of these runs are utilized to analyze the algorithms. The population size for each of the methods is set to be 50, and the maximum Number of Function Evaluations (NFEs) is considered 150,000 for all of the metaheuristics. The tolerance of 1 × 10−12 from the optimal solution is considered as the terminating criterion, and the NFEs are counted until the algorithm stops. The statistical results of the fixed-dimensional and N-dimensional benchmark problems are presented in Tables 5 and 6, respectively. These results include the minimum (Min), average (Mean), maximum (Max), Standard deviation (Std. Dev.), and mean of the NFEs of each algorithm. Moreover, the last row of each function shows the rank of algorithms, where the ranking is based on the value of the Means.
Table 5.
Comparative results of algorithms for the fixed-dimensional functions.
| No | Statistics | Methods | |||||||
|---|---|---|---|---|---|---|---|---|---|
| FA | CS | Jaya | TEO | SCA | MVO | CSA | FuFiO | ||
| F1 | Min | − 199.99977 | − 200 | − 200 | − 200 | − 200 | − 199.99997 | − 200 | − 200 |
| Mean | − 199.99853 | − 200 | − 200 | − 200 | − 200 | − 199.99925 | − 200 | − 200 | |
| Max | − 199.99688 | − 200 | − 200 | − 200 | − 200 | − 199.99822 | − 200 | − 200 | |
| Std. Dev | 0.0006252 | 0 | 0 | 0 | 0 | 0.000408 | 0 | 0 | |
| NFEs | 150,875.42 | 55,584 | 11,994 | 24,204 | 12,588 | 150,000 | 63,892 | 2364 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F2 | Min | − 195.62903 | − 195.62903 | − 195.62903 | − 195.62903 | − 195.62903 | − 195.62903 | − 195.62903 | − 195.62903 |
| Mean | − 195.62903 | − 195.62903 | − 195.62902 | − 195.61823 | − 195.629 | − 195.62903 | − 195.62903 | − 195.62903 | |
| Max | − 195.62902 | − 195.62903 | − 195.62899 | − 195.55082 | − 195.62893 | − 195.62903 | − 195.62903 | − 195.62903 | |
| Std. Dev | 1.039E−06 | 2.842E−13 | 1.222E−05 | 0.0176225 | 2.404E−05 | 3.938E−07 | 2.842E−13 | 8.527E−14 | |
| NFEs | 150,854 | 28,512 | 150,000 | 150,000 | 149,950 | 150,000 | 11,453 | 127,158 | |
| Rank | 5 | 2.5 | 6 | 8 | 7 | 4 | 2.5 | 1 | |
| F3 | Min | − 4.5901016 | − 4.5901016 | − 4.5901016 | − 4.5901016 | − 4.590101 | − 4.5901016 | − 4.5901016 | − 4.5901016 |
| Mean | − 4.5901001 | − 4.5901016 | − 4.590035 | − 4.5900936 | − 4.5900145 | − 4.5901013 | − 4.5901016 | − 4.5901016 | |
| Max | − 4.5900934 | − 4.5901016 | − 4.5895858 | − 4.5900376 | − 4.5898699 | − 4.5900999 | − 4.5901016 | − 4.5901016 | |
| Std. Dev | 1.501E−06 | 6.217E−15 | 8.846E−05 | 9.997E−06 | 6.885E−05 | 3.267E−07 | 6.217E−15 | 6.217E−15 | |
| NFEs | 150,841.6 | 28,450 | 150,000 | 150,000 | 149,950 | 150,000 | 10,339 | 141,602 | |
| Rank | 5 | 2 | 7 | 6 | 8 | 4 | 2 | 2 | |
| F4 | Min | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218068 |
| Mean | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218066 | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218068 | |
| Max | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218046 | − 2.0218068 | − 2.0218068 | − 2.0218068 | − 2.0218068 | |
| Std. Dev | 8.882E−16 | 8.882E−16 | 8.882E−16 | 4.395E−07 | 1.514E−10 | 3.024E−13 | 6.809E−12 | 8.882E−16 | |
| NFEs | 36,849.12 | 8206 | 1800 | 150,000 | 139,121 | 126,476 | 148,460 | 104,465 | |
| Rank | 2.5 | 2.5 | 2.5 | 8 | 7 | 5 | 6 | 2.5 | |
| F5 | Min | 1.0000886 | 1 | 1 | 1 | 1 | 1.0000304 | 1 | 1 |
| Mean | 1.0007808 | 1 | 1 | 1 | 1 | 1.0004954 | 1 | 1 | |
| Max | 1.0021551 | 1 | 1 | 1 | 1 | 1.0021724 | 1 | 1 | |
| Std. Dev | 0.0004981 | 0 | 0 | 0 | 0 | 0.0003655 | 0 | 0 | |
| NFEs | 150,906.34 | 42,278 | 10,143 | 23,626 | 10,084 | 150,000 | 50,095 | 1963 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F6 | Min | 4.745E−08 | 0 | 0 | 0 | 0 | 1.863E−07 | 0 | 0 |
| Mean | 3.164E−05 | 0 | 0 | 0 | 0 | 1.021E−05 | 0 | 0 | |
| Max | 0.0001135 | 0 | 0 | 0 | 0 | 3.597E−05 | 0 | 0 | |
| Std. Dev | 2.842E−05 | 0 | 0 | 0 | 0 | 9.096E−06 | 0 | 0 | |
| NFEs | 150,869.36 | 28,000 | 7968 | 24,170 | 6469 | 150,000 | 13,524 | 1407 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F7 | Min | 2.619E−07 | 0 | 0 | 0 | 0 | 8.751E−08 | 0 | 0 |
| Mean | 2.058E−05 | 0 | 0 | 0 | 0 | 1.007E−05 | 0 | 0 | |
| Max | 0.0001665 | 0 | 0 | 0 | 0 | 3.131E−05 | 0 | 0 | |
| Std. Dev | 2.807E−05 | 0 | 0 | 0 | 0 | 8.73E−06 | 0 | 0 | |
| NFEs | 150,879.44 | 29,616 | 9088 | 24,543 | 7163 | 150,000 | 13,637 | 1442 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F8 | Min | 1.433E−07 | 0 | 0 | 0 | 0 | 8.879E−08 | 0 | 0 |
| Mean | 8.802E−06 | 0 | 0 | 0 | 0 | 4.63E−06 | 0 | 0 | |
| Max | 3.256E−05 | 0 | 0 | 0 | 0 | 1.745E−05 | 0 | 0 | |
| Std. Dev | 8.204E−06 | 0 | 0 | 0 | 0 | 4.059E−06 | 0 | 0 | |
| NFEs | 150,716.78 | 28,952 | 13,880 | 24,182 | 8836 | 150,000 | 12,687 | 1732 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F9 | Min | 7.769E−11 | 0 | 0 | 0 | 0 | 1.28E−11 | 0 | 0 |
| Mean | 4.322E−09 | 0 | 0 | 0 | 0 | 1.537E−09 | 0 | 0 | |
| Max | 2.212E−08 | 0 | 0 | 0 | 0 | 5.801E−09 | 0 | 0 | |
| Std. Dev | 4.395E−09 | 0 | 0 | 0 | 0 | 1.312E−09 | 0 | 0 | |
| NFEs | 150,853.8 | 20,260 | 6961 | 18,743 | 4363 | 150,000 | 7161 | 1133 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F10 | Min | − 24.156816 | − 24.156816 | − 24.156816 | − 24.156811 | − 24.156495 | − 24.156816 | − 24.156816 | − 24.156816 |
| Mean | − 24.156815 | − 24.156816 | − 24.149847 | − 24.052316 | − 24.149975 | − 24.156815 | − 24.156816 | − 24.156816 | |
| Max | − 24.156814 | − 24.156816 | − 24.085134 | − 22.99984 | − 24.127957 | − 24.156815 | − 24.156816 | − 24.156816 | |
| Std. Dev | 3.34E−07 | 3.553E−15 | 0.014829 | 0.2137027 | 0.0062623 | 1.565E−07 | 3.553E−15 | 3.553E−15 | |
| NFEs | 147,665.02 | 13,320 | 131,436 | 150,000 | 149,950 | 149,964 | 8962 | 138,829 | |
| Rank | 5 | 2 | 7 | 8 | 6 | 4 | 2 | 2 | |
| F11 | Min | − 43.721918 | − 43.721918 | − 43.721918 | − 43.721862 | − 43.721912 | − 43.721918 | − 43.721918 | − 43.721918 |
| Mean | − 43.721917 | − 43.721918 | − 43.721918 | − 43.718356 | − 43.721406 | − 43.697423 | − 43.721918 | − 43.721918 | |
| Max | − 43.721908 | − 43.721918 | − 43.721918 | − 43.695897 | − 43.719038 | − 42.497173 | − 43.721918 | − 43.721918 | |
| Std. Dev | 1.842E−06 | 1.421E−14 | 1.421E−14 | 0.0052094 | 0.0005125 | 0.1714642 | 1.421E−14 | 1.421E−14 | |
| NFEs | 146,520.6 | 16,418 | 5832 | 150,000 | 149,950 | 149,792 | 5113 | 116,227 | |
| Rank | 5 | 2.5 | 2.5 | 7 | 6 | 8 | 2.5 | 2.5 | |
| F12 | Min | − 2.0626119 | − 2.0626119 | − 2.0626119 | − 2.0626119 | − 2.0626119 | − 2.0626119 | − 2.0626119 | − 2.0626119 |
| Mean | − 2.0626119 | − 2.0626119 | − 2.0626106 | − 2.0625604 | − 2.06261 | − 2.0626119 | − 2.0626119 | − 2.0626119 | |
| Max | − 2.0626119 | − 2.0626119 | − 2.0626013 | − 2.0622999 | − 2.0626045 | − 2.0626119 | − 2.0626119 | − 2.0626119 | |
| Std. Dev | 2.464E−09 | 1.332E−15 | 1.913E−06 | 7.927E−05 | 1.7E−06 | 7.389E−10 | 1.332E−15 | 1.332E−15 | |
| NFEs | 150,773.56 | 21,678 | 150,000 | 150,000 | 149,950 | 150,000 | 8141 | 135,404 | |
| Rank | 5 | 2 | 6 | 8 | 7 | 4 | 2 | 2 | |
| F13 | Min | 2.256E−09 | 0 | 0 | 0 | 2.986E−06 | 1.393E−09 | 0 | 0 |
| Mean | 1.258E−07 | 0 | 0 | 0.2884609 | 0.000135 | 1.557E−07 | 0 | 0 | |
| Max | 8.524E−07 | 0 | 0 | 0.5637621 | 0.000692 | 1.302E−06 | 0 | 0 | |
| Std. Dev | 1.529E−07 | 0 | 0 | 0.24578 | 0.0001376 | 2.096E−07 | 0 | 0 | |
| NFEs | 150,830.58 | 56,178 | 66,049 | 145,121 | 149,950 | 150,000 | 12,426 | 141,181 | |
| Rank | 5 | 2.5 | 2.5 | 8 | 7 | 6 | 2.5 | 2.5 | |
| F14 | Min | 2 | 0 | 2 | 0 | 6.925E−05 | 1.59E−06 | 0 | 0 |
| Mean | 2 | 1.4 | 2 | 1.0003941 | 0.1129462 | 1.7600006 | 0.7376044 | 8.219E−05 | |
| Max | 2 | 2 | 2 | 2.0022288 | 2.0015164 | 2.0000001 | 2 | 0.0009885 | |
| Std. Dev | 9.45E−09 | 0.9165151 | 0 | 1.0000166 | 0.3869625 | 0.6499214 | 0.952814 | 0.0002148 | |
| NFEs | 150,732.8 | 122,584 | 150,000 | 149,625 | 149,950 | 150,000 | 117,111 | 139,506 | |
| Rank | 8 | 5 | 7 | 4 | 2 | 6 | 3 | 1 | |
| F15 | Min | − 24,776.518 | − 24,776.518 | − 24,776.518 | − 24,776.518 | − 24,776.518 | − 24,776.518 | − 24,776.518 | − 24,776.518 |
| Mean | − 24,776.518 | − 24,776.518 | − 24,776.509 | − 24,776.518 | − 24,776.518 | − 24,776.518 | − 24,776.518 | − 24,776.518 | |
| Max | − 24,776.517 | − 24,776.518 | − 24,776.465 | − 24,776.518 | − 24,776.516 | − 24,776.516 | − 24,776.518 | − 24,776.518 | |
| Std. Dev | 0.0004613 | 0 | 0.0143299 | 1.474E− 05 | 0.0003663 | 0.0003303 | 0 | 0 | |
| NFEs | 150,828.94 | 38,798 | 150,000 | 150,000 | 149,950 | 150,000 | 18,586 | 131,767 | |
| Rank | 7 | 2 | 8 | 4 | 5 | 6 | 2 | 2 | |
| F16 | Min | 7.608E−09 | 0 | 0 | 0 | 0 | 7.737E−10 | 0 | 0 |
| Mean | 8.682E−08 | 0 | 0 | 0 | 0 | 2.438E−08 | 0 | 0 | |
| Max | 3.304E−07 | 0 | 0 | 0 | 0 | 1.566E−07 | 0 | 0 | |
| Std. Dev | 7.742E−08 | 0 | 0 | 0 | 0 | 2.871E−08 | 0 | 0 | |
| NFEs | 150,840.64 | 24,730 | 8163 | 19,238 | 4424 | 150,000 | 8874 | 1204 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F17 | Min | 0.0644704 | 0.0644704 | 0.0644704 | 0.0644704 | 0.0644705 | 0.0644704 | 0.0644704 | 0.0644704 |
| Mean | 0.0644704 | 0.0644704 | 0.0644704 | 0.0645096 | 0.0644725 | 0.0644704 | 0.0644704 | 0.0644704 | |
| Max | 0.0644704 | 0.0644704 | 0.0644704 | 0.0648164 | 0.0644819 | 0.0644704 | 0.0644704 | 0.0644704 | |
| Std. Dev | 1.121E−10 | 4.163E−17 | 4.163E−17 | 7.195E−05 | 2.324E−06 | 4.378E−11 | 4.163E−17 | 4.163E−17 | |
| NFEs | 150,790.36 | 17,910 | 3848 | 150,000 | 149,950 | 145,984 | 5477 | 135,307 | |
| Rank | 6 | 2.5 | 2.5 | 8 | 7 | 5 | 2.5 | 2.5 | |
| F18 | Min | − 166.02908 | − 166.02908 | − 166.02905 | − 166.027 | − 166.02862 | − 166.02908 | − 166.02908 | − 166.02908 |
| Mean | − 166.02904 | − 166.02908 | − 165.76174 | − 165.84605 | − 165.96834 | − 166.02907 | − 166.02908 | − 166.02908 | |
| Max | − 166.02894 | − 166.02908 | − 163.68494 | − 165.35222 | − 165.77492 | − 166.02906 | − 166.02908 | − 166.02908 | |
| Std. Dev | 3.34E−05 | 1.421E−13 | 0.4400681 | 0.1512756 | 0.0597362 | 6.074E−06 | 1.421E−13 | 1.421E−13 | |
| NFEs | 150,726.86 | 102,932 | 150,000 | 150,000 | 149,950 | 150,000 | 16,488 | 139,180 | |
| Rank | 5 | 2 | 8 | 7 | 6 | 4 | 2 | 2 | |
| F19 | Min | 8.97E−10 | 0 | 6.545E−07 | 0 | 2.122E−05 | 1.37E−10 | 0 | 0 |
| Mean | 1.242E−07 | 0 | 0.0006953 | 0.0002875 | 0.0014032 | 2.735E−08 | 0 | 1.875E−11 | |
| Max | 9.183E−07 | 0 | 0.0084477 | 0.0044577 | 0.0057418 | 8.83E−08 | 0 | 9.375E−10 | |
| Std. Dev | 1.482E−07 | 0 | 0.0014105 | 0.0007401 | 0.0012568 | 2.424E−08 | 0 | 1.313E−10 | |
| NFEs | 150,582.74 | 41,850 | 150,000 | 149,395 | 149,950 | 150,000 | 10,199 | 122,546 | |
| Rank | 5 | 1.5 | 7 | 6 | 8 | 4 | 1.5 | 3 | |
| F20 | Min | − 2.3458 | − 2.3458 | − 2.3458 | − 2.3458 | − 2.3458 | − 2.3458 | − 2.3458 | − 2.3458 |
| Mean | − 2.3458 | − 2.3458 | − 2.3458 | − 2.3450305 | − 2.3457621 | − 2.3458 | − 2.3458 | − 2.3458 | |
| Max | − 2.3458 | − 2.3458 | − 2.3458 | − 2.3407836 | − 2.3455475 | − 2.3458 | − 2.3458 | − 2.3458 | |
| Std. Dev | 2.22E−15 | 2.22E−15 | 2.22E−15 | 0.0012431 | 4.487E−05 | 2.22E−15 | 2.22E−15 | 2.22E−15 | |
| NFEs | 1183.62 | 4432 | 1352 | 117,396 | 139,938 | 76,556 | 1318 | 20,966 | |
| Rank | 3.5 | 3.5 | 3.5 | 8 | 7 | 3.5 | 3.5 | 3.5 | |
| F21 | Min | 124.36218 | 124.36218 | 124.36218 | 124.36221 | 124.36231 | 124.36218 | 124.36218 | 124.36218 |
| Mean | 124.36218 | 124.36218 | 124.36218 | 124.38767 | 124.37351 | 124.36218 | 124.36218 | 124.36218 | |
| Max | 124.36219 | 124.36218 | 124.36218 | 124.58135 | 124.42111 | 124.36218 | 124.36218 | 124.36218 | |
| Std. Dev | 1.271E−06 | 0 | 0 | 0.0410122 | 0.012138 | 5.607E−07 | 0 | 0 | |
| NFEs | 150,859.64 | 31,454 | 9163 | 150,000 | 149,950 | 150,000 | 11,813 | 134,081 | |
| Rank | 6 | 2.5 | 2.5 | 8 | 7 | 5 | 2.5 | 2.5 | |
| F22 | Min | − 0.6736675 | − 0.6736675 | − 0.6736675 | − 0.6736675 | − 0.6736675 | − 0.6736675 | − 0.6736675 | − 0.6736675 |
| Mean | − 0.6736675 | − 0.6736675 | − 0.6736675 | − 0.6736662 | − 0.6736675 | − 0.6736675 | − 0.6736675 | − 0.6736675 | |
| Max | − 0.6736675 | − 0.6736675 | − 0.6736673 | − 0.673659 | − 0.6736675 | − 0.6736675 | − 0.6736675 | − 0.6736675 | |
| Std. Dev | 2.815E−13 | 4.441E−16 | 3.797E−08 | 1.86E−06 | 3.901E−10 | 5.731E−11 | 4.441E−16 | 4.441E−16 | |
| NFEs | 73,580.58 | 14,804 | 144,236 | 150,000 | 146,140 | 144,058 | 26,362 | 106,399 | |
| Rank | 4 | 2 | 7 | 8 | 6 | 5 | 2 | 2 | |
| F23 | Min | 5.878E−12 | 0 | 0 | 0 | 3.668E−07 | 2.803E−11 | 0 | 0 |
| Mean | 2.067E−09 | 0 | 0 | 0.1709006 | 4.914E−05 | 1.714E−09 | 0 | 0 | |
| Max | 7.778E−09 | 0 | 0 | 0.6522596 | 0.0002054 | 1.241E−08 | 0 | 0 | |
| Std. Dev | 2.05E−09 | 0 | 0 | 0.2092172 | 4.871E−05 | 2.322E−09 | 0 | 0 | |
| NFEs | 150,802.1 | 25,674 | 36,540 | 147,146 | 149,950 | 150,000 | 9245 | 140,532 | |
| Rank | 6 | 2.5 | 2.5 | 8 | 7 | 5 | 2.5 | 2.5 | |
| F24 | Min | − 176.54179 | − 176.54179 | − 176.53511 | − 176.53776 | − 176.54098 | − 176.54179 | − 176.54179 | − 176.54179 |
| Mean | − 176.54176 | − 176.54179 | − 176.39606 | − 176.08486 | − 176.46763 | − 176.54179 | − 176.54179 | − 176.54179 | |
| Max | − 176.5417 | − 176.54179 | − 175.40617 | − 174.34907 | − 175.85529 | − 176.54177 | − 176.54179 | − 176.54179 | |
| Std. Dev | 2.566E−05 | 1.705E−13 | 0.2056244 | 0.4274551 | 0.117937 | 6.242E−06 | 1.705E−13 | 1.705E−13 | |
| NFEs | 150,625.4 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 5 | 2 | 7 | 8 | 6 | 4 | 2 | 2 | |
| F25 | Min | − 176.13757 | − 176.13757 | − 176.13706 | − 176.13349 | − 176.13666 | − 176.13757 | − 176.13757 | − 176.13757 |
| Mean | − 176.13756 | − 176.13757 | − 176.07398 | − 175.90307 | − 176.10669 | − 153.47544 | − 176.13757 | − 176.13757 | |
| Max | − 176.13752 | − 176.13757 | − 175.73141 | − 174.87606 | − 176.04619 | − 90.885324 | − 176.13757 | − 176.13757 | |
| Std. Dev | 1.553E−05 | 2.842E−14 | 0.0854863 | 0.2178573 | 0.0257696 | 25.579229 | 2.842E−14 | 2.842E−14 | |
| NFEs | 144,434.6 | 26,452 | 150,000 | 150,000 | 149,950 | 148,756 | 4660 | 103,167 | |
| Rank | 4 | 2 | 6 | 7 | 5 | 8 | 2 | 2 | |
| F26 | Min | 6.313E−12 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Mean | 1.376E−09 | 0 | 0 | 0 | 0 | 4.688E−10 | 0 | 0 | |
| Max | 4.753E−09 | 0 | 0 | 0 | 0 | 2.147E−09 | 0 | 0 | |
| Std. Dev | 1.083E−09 | 0 | 0 | 0 | 0 | 4.674E−10 | 0 | 0 | |
| NFEs | 150,790.52 | 16,980 | 10,538 | 18,943 | 6404 | 150,000 | 6662 | 1388 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F27 | Min | − 1.913223 | − 1.913223 | − 1.9132222 | − 1.9132229 | − 1.9132228 | − 1.913223 | − 1.913223 | − 1.913223 |
| Mean | − 1.913223 | − 1.913223 | − 1.9132117 | − 1.913222 | − 1.9132114 | − 1.913223 | − 1.913223 | − 1.913223 | |
| Max | − 1.9132229 | − 1.913223 | − 1.9131955 | − 1.9132168 | − 1.9131623 | − 1.913223 | − 1.913223 | − 1.913223 | |
| Std. Dev | 1.417E−09 | 2.22E−15 | 7.228E−06 | 1.149E−06 | 1.198E−05 | 6.072E−10 | 2.22E−15 | 2.22E−15 | |
| NFEs | 150,796.96 | 18,484 | 150,000 | 150,000 | 149,950 | 150,000 | 6804 | 122,920 | |
| Rank | 5 | 2 | 7 | 6 | 8 | 4 | 2 | 2 | |
| F28 | Min | − 19.966676 | − 19.966682 | − 19.966682 | − 19.966446 | − 19.965824 | − 19.966682 | − 19.966682 | − 19.966682 |
| Mean | − 19.966614 | − 19.966682 | − 19.966682 | − 19.9516 | − 19.959177 | − 19.966637 | − 19.966682 | − 19.966682 | |
| Max | − 19.966544 | − 19.966682 | − 19.966682 | − 19.873952 | − 19.948416 | − 19.966578 | − 19.966682 | − 19.966682 | |
| Std. Dev | 3.598E−05 | 3.553E−15 | 3.553E−15 | 0.0164593 | 0.0044158 | 2.366E−05 | 3.553E−15 | 3.553E−15 | |
| NFEs | 150,724.42 | 26,880 | 6058 | 150,000 | 149,950 | 150,000 | 7125 | 135,832 | |
| Rank | 6 | 2.5 | 2.5 | 8 | 7 | 5 | 2.5 | 2.5 | |
| F29 | Min | − 1.8013 | − 1.8013 | − 1.8013 | − 1.7308521 | − 1.801276 | − 1.8013 | − 1.8013 | − 1.8013 |
| Mean | − 1.8013 | − 1.8013 | − 1.8013 | − 1.2553068 | − 1.7366044 | − 1.8013 | − 1.8013 | − 1.8013 | |
| Max | − 1.8013 | − 1.8013 | − 1.8013 | − 0.9999082 | − 1 | − 1.8013 | − 1.8013 | − 1.8013 | |
| Std. Dev | 1.11E−15 | 1.11E−15 | 1.11E−15 | 0.2350477 | 0.2172136 | 1.11E−15 | 1.11E−15 | 1.11E−15 | |
| NFEs | 9391.16 | 7936 | 3199 | 150,000 | 149,950 | 135,100 | 2040 | 66,819 | |
| Rank | 3.5 | 3.5 | 3.5 | 8 | 7 | 3.5 | 3.5 | 3.5 | |
| F30 | Min | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 |
| Mean | − 1.0192414 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198295 | |
| Max | − 1.0100283 | − 1.0198295 | − 1.0198295 | − 1.0198295 | − 1.0198294 | − 1.0198295 | − 1.0198295 | − 1.0198295 | |
| Std. Dev | 0.0023277 | 8.882E−16 | 1.447E−09 | 1.28E−09 | 1.92E−08 | 1.682E−11 | 3.994E−12 | 8.882E−16 | |
| NFEs | 85,641.02 | 12,278 | 148,441 | 130,001 | 149,950 | 146,495 | 148,832 | 87,002 | |
| Rank | 8 | 1.5 | 6 | 5 | 7 | 4 | 3 | 1.5 | |
| F31 | Min | − 2.2839498 | − 2.2839498 | − 2.2839498 | − 2.2839494 | − 2.2839466 | − 2.2839498 | − 2.2839498 | − 2.2839498 |
| Mean | − 2.2587729 | − 2.2839498 | − 2.2839498 | − 2.2839256 | − 2.2837873 | − 2.2839498 | − 2.2839498 | − 2.2839498 | |
| Max | − 1.8643355 | − 2.2839498 | − 2.2839498 | − 2.2837646 | − 2.2832559 | − 2.2839498 | − 2.2839498 | − 2.2839498 | |
| Std. Dev | 0.0996529 | 2.22E−15 | 2.22E−15 | 3.073E−05 | 0.0001718 | 1.146E−08 | 2.22E−15 | 2.22E−15 | |
| NFEs | 150,757.1 | 31,624 | 10,498 | 150,000 | 149,950 | 150,000 | 8584 | 129,308 | |
| Rank | 8 | 2.5 | 2.5 | 6 | 7 | 5 | 2.5 | 2.5 | |
| F32 | Min | 1.693E−11 | 0 | 0 | 0 | 2.228E−07 | 5.213E−12 | 0 | 0 |
| Mean | 1.395E−08 | 0 | 0 | 6.251E−05 | 0.0001543 | 6.871E−07 | 0 | 0 | |
| Max | 8.348E−08 | 0 | 0 | 0.0017811 | 0.0017885 | 3.21E−05 | 0 | 0 | |
| Std. Dev | 1.689E−08 | 0 | 0 | 0.0002739 | 0.0003112 | 4.489E−06 | 0 | 0 | |
| NFEs | 150,827.5 | 15,354 | 16,216 | 114,005 | 149,950 | 150,000 | 7777 | 123,591 | |
| Rank | 5 | 2.5 | 2.5 | 7 | 8 | 6 | 2.5 | 2.5 | |
| F33 | Min | − 0.9635348 | − 0.9635348 | − 0.9635348 | − 0.9635348 | − 0.9635346 | − 0.9635348 | − 0.9635348 | − 0.9635348 |
| Mean | − 0.9635348 | − 0.9635348 | − 0.9635298 | − 0.9634256 | − 0.9635281 | − 0.9635348 | − 0.9635348 | − 0.9635348 | |
| Max | − 0.9635348 | − 0.9635348 | − 0.9634769 | − 0.9625693 | − 0.963507 | − 0.9635348 | − 0.9635348 | − 0.9635348 | |
| Std. Dev | 4.176E−10 | 9.992E−16 | 1.056E−05 | 0.000185 | 5.323E−06 | 1.029E−10 | 9.992E−16 | 9.992E−16 | |
| NFEs | 150,679.16 | 24,098 | 142,413 | 150,000 | 149,950 | 150,000 | 8536 | 137,509 | |
| Rank | 5 | 2 | 6 | 8 | 7 | 4 | 2 | 2 | |
| F34 | Min | 0.9 | 0.9 | 0.9 | 0.9 | 0.9 | 0.9 | 0.9 | 0.9 |
| Mean | 0.904 | 0.9 | 0.9043351 | 0.9 | 0.9 | 0.94 | 0.9 | 0.9 | |
| Max | 1 | 0.9 | 1.0000002 | 0.9 | 0.9 | 1 | 0.9 | 0.9 | |
| Std. Dev | 0.0195959 | 1.011E−11 | 0.0195332 | 8.882E−16 | 8.882E−16 | 0.0489898 | 8.882E−16 | 8.882E−16 | |
| NFEs | 150,584.64 | 92,474 | 148,689 | 18,937 | 6074 | 150,000 | 9459 | 1642 | |
| Rank | 6 | 5 | 7 | 2.5 | 2.5 | 8 | 2.5 | 2.5 | |
| F35 | Min | 1.083E−05 | 0 | 2.269E−09 | 0 | 2.515E−06 | 1.533E−08 | 0 | 0 |
| Mean | 7.2E−05 | 0 | 0.0001567 | 0.0296118 | 0.000278 | 7.895E−06 | 0 | 0 | |
| Max | 0.0002798 | 0 | 0.0015145 | 0.4464966 | 0.0012055 | 2.865E−05 | 0 | 0 | |
| Std. Dev | 5.903E−05 | 0 | 0.0002774 | 0.0751466 | 0.0002447 | 7.971E−06 | 0 | 0 | |
| NFEs | 150,634.56 | 33,662 | 150,000 | 147,196 | 149,950 | 150,000 | 15,439 | 121,730 | |
| Rank | 5 | 2 | 6 | 8 | 7 | 4 | 2 | 2 | |
| F36 | Min | 0.9 | 0.9 | 0.9 | 0.9 | 0.9 | 0.9 | 0.9 | 0.9 |
| Mean | 0.902 | 0.9 | 0.9022549 | 0.9 | 0.9 | 0.956 | 0.9 | 0.9 | |
| Max | 1.0000001 | 0.9 | 1.0000188 | 0.9 | 0.9 | 1 | 0.9 | 0.9 | |
| Std. Dev | 0.014 | 8.882E−16 | 0.013969 | 8.882E−16 | 8.882E−16 | 0.0496387 | 8.882E−16 | 8.882E−16 | |
| NFEs | 150,522.18 | 88,092 | 149,244 | 19,153 | 6038 | 150,000 | 10,029 | 1923 | |
| Rank | 6 | 3 | 7 | 3 | 3 | 8 | 3 | 3 | |
| F37 | Min | 4.882E−10 | 0 | 0 | 0 | 0 | 5.268E−09 | 0 | 0 |
| Mean | 2.889E−06 | 0 | 2.138E−12 | 0.002424 | 0 | 6.38E−06 | 0 | 0 | |
| Max | 2.071E−05 | 0 | 1.52E−11 | 0.0899116 | 0 | 4.405E−05 | 0 | 0 | |
| Std. Dev | 3.942E−06 | 0 | 3.381E−12 | 0.01277 | 0 | 9.844E−06 | 0 | 0 | |
| NFEs | 150,778.72 | 43,402 | 119,868 | 53,231 | 46,529 | 150,000 | 15,122 | 6932 | |
| Rank | 6 | 2.5 | 5 | 8 | 2.5 | 7 | 2.5 | 2.5 | |
| F38 | Min | − 3873.7242 | − 3873.7242 | − 3873.7242 | − 3873.7242 | − 3873.7242 | − 3873.7242 | − 3873.7242 | − 3873.7242 |
| Mean | − 3873.7242 | − 3873.7242 | − 3873.7242 | − 3873.7164 | − 3873.724 | − 3873.7242 | − 3873.7242 | − 3873.7242 | |
| Max | − 3873.7242 | − 3873.7242 | − 3873.7242 | − 3873.6565 | − 3873.7237 | − 3873.7242 | − 3873.7242 | − 3873.7242 | |
| Std. Dev | 2.267E−06 | 0 | 0 | 0.0140267 | 0.0001222 | 6.572E−07 | 0 | 0 | |
| NFEs | 150,831.46 | 22,814 | 5346 | 150,000 | 149,950 | 150,000 | 10,542 | 129,884 | |
| Rank | 6 | 2.5 | 2.5 | 8 | 7 | 5 | 2.5 | 2.5 | |
| F39 | Min | − 2.1999998 | − 2.2 | − 2.2 | − 2.1999676 | − 2.1993792 | − 2.2 | − 2.2 | − 2.2 |
| Mean | − 2.1862541 | − 2.2 | − 2.2 | − 2.1873374 | − 2.1741647 | − 2.1999865 | − 2.2 | − 2.2 | |
| Max | − 1.878412 | − 2.2 | − 2.2 | − 2.1467488 | − 1.197857 | − 2.1999189 | − 2.2 | − 2.2 | |
| Std. Dev | 0.0504614 | 1.332E−15 | 1.332E−15 | 0.0102714 | 0.139499 | 1.449E−05 | 1.332E−15 | 1.332E−15 | |
| NFEs | 150,819.32 | 80,638 | 49,622 | 150,000 | 149,950 | 150,000 | 37,427 | 141,833 | |
| Rank | 7 | 2.5 | 2.5 | 6 | 8 | 5 | 2.5 | 2.5 | |
| F40 | Min | − 2 | − 2 | − 2 | − 2 | − 1.9999978 | − 2 | − 2 | − 2 |
| Mean | − 1.9966894 | − 2 | − 2 | − 1.9586812 | − 1.9999167 | − 2 | − 2 | − 2 | |
| Max | − 1.9172359 | − 2 | − 2 | − 1.5572018 | − 1.9994763 | − 1.9999998 | − 2 | − 2 | |
| Std. Dev | 0.0162184 | 0 | 0 | 0.0891136 | 9.768E−05 | 4.243E−08 | 0 | 0 | |
| NFEs | 150,866.58 | 41,076 | 13,838 | 150,000 | 149,950 | 150,000 | 14,200 | 113,798 | |
| Rank | 7 | 2.5 | 2.5 | 8 | 6 | 5 | 2.5 | 2.5 | |
| F41 | Min | 34.040244 | 34.040243 | 34.041799 | 34.040259 | 34.040261 | 34.040243 | 34.040243 | 34.040243 |
| Mean | 70.004025 | 35.638635 | 60.429604 | 65.44762 | 34.078729 | 62.811268 | 34.040243 | 34.040545 | |
| Max | 74 | 74 | 74 | 74.645055 | 34.200075 | 74 | 34.040243 | 34.044278 | |
| Std. Dev | 11.987926 | 7.8304808 | 18.907141 | 16.334442 | 0.0360058 | 17.941886 | 3.553E−14 | 0.0007264 | |
| NFEs | 150,906.58 | 68,526 | 150,000 | 150,000 | 149,950 | 150,000 | 15,282 | 135,124 | |
| Rank | 8 | 4 | 5 | 7 | 3 | 6 | 1 | 2 | |
| F42 | Min | 9.509E−07 | 0 | 0 | 0 | 0 | 2.153E−06 | 0 | 0 |
| Mean | 0.0001767 | 0 | 0 | 0 | 0 | 8.035E−05 | 0 | 0 | |
| Max | 0.0007141 | 0 | 0 | 0 | 0 | 0.0003803 | 0 | 0 | |
| Std. Dev | 0.0001443 | 0 | 0 | 0 | 0 | 8.022E−05 | 0 | 0 | |
| NFEs | 150,888.76 | 28,920 | 8148 | 22,601 | 7467 | 150,000 | 15,459 | 1643 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F43 | Min | 5.846E−07 | 0 | 0 | 0 | 0 | 1.538E−08 | 0 | 0 |
| Mean | 2.716E−05 | 0 | 0 | 0 | 0 | 1.019E−05 | 0 | 0 | |
| Max | 0.0001105 | 0 | 0 | 0 | 0 | 6.326E−05 | 0 | 0 | |
| Std. Dev | 2.765E−05 | 0 | 0 | 0 | 0 | 1.115E−05 | 0 | 0 | |
| NFEs | 150,907.68 | 26,190 | 7723 | 21,785 | 7216 | 150,000 | 12,776 | 1519 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F44 | Min | 8.015E−12 | 0 | 0 | 0 | 0 | 9.939E−12 | 0 | 0 |
| Mean | 1.081E−09 | 0 | 0 | 0 | 0 | 5.018E−10 | 0 | 0 | |
| Max | 6.221E−09 | 0 | 0 | 0 | 0 | 2.927E−09 | 0 | 0 | |
| Std. Dev | 1.243E−09 | 0 | 0 | 0 | 0 | 6.015E−10 | 0 | 0 | |
| NFEs | 150,924.6 | 48,132 | 18,602 | 25,219 | 4935 | 150,000 | 8204 | 1374 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F45 | Min | 0.0015669 | 0.0015669 | 0.0015669 | 0.0015669 | 0.0015669 | 0.0015669 | 0.0015669 | 0.0015669 |
| Mean | 0.0015672 | 0.0015669 | 0.0015683 | 0.0015681 | 0.0015669 | 0.0015669 | 0.0015669 | 0.0015669 | |
| Max | 0.0015687 | 0.0015669 | 0.0015749 | 0.0015763 | 0.0015672 | 0.0015674 | 0.0015669 | 0.0015669 | |
| Std. Dev | 3.142E−07 | 1.952E−18 | 1.74E−06 | 1.673E−06 | 6.137E−08 | 1.203E−07 | 1.952E−18 | 1.952E−18 | |
| NFEs | 150,984.36 | 119,666 | 150,000 | 150,000 | 149,950 | 150,000 | 19,133 | 116,872 | |
| Rank | 6 | 2 | 8 | 7 | 4 | 5 | 2 | 2 | |
| F46 | Min | 0.292579 | 0.292579 | 0.292579 | 0.292579 | 0.292579 | 0.292579 | 0.292579 | 0.292579 |
| Mean | 0.292579 | 0.292579 | 0.2925793 | 0.2925794 | 0.292579 | 0.292579 | 0.292579 | 0.292579 | |
| Max | 0.2925793 | 0.292579 | 0.2925824 | 0.2925825 | 0.292579 | 0.2925791 | 0.292579 | 0.292579 | |
| Std. Dev | 4.95E−08 | 0 | 6.479E−07 | 6.471E−07 | 0 | 7.565E−09 | 0 | 0 | |
| NFEs | 97,215.4 | 36,136 | 105,259 | 115,043 | 46,019 | 143,035 | 10,562 | 41,718 | |
| Rank | 6 | 2.5 | 7 | 8 | 2.5 | 5 | 2.5 | 2.5 | |
| F47 | Min | − 26.920336 | − 26.920336 | − 26.920336 | − 26.920058 | − 26.920305 | − 26.920336 | − 26.920336 | − 26.920336 |
| Mean | − 26.920335 | − 26.920336 | − 26.918206 | − 26.470796 | − 26.916463 | − 26.920335 | − 26.920336 | − 26.920336 | |
| Max | − 26.920334 | − 26.920336 | − 26.89308 | − 24.893102 | − 26.901966 | − 26.920335 | − 26.920336 | − 26.920336 | |
| Std. Dev | 3.083E−07 | 1.421E−14 | 0.0053345 | 0.4860863 | 0.0037564 | 6.892E−08 | 1.421E−14 | 1.421E−14 | |
| NFEs | 150,898.76 | 33,114 | 125,243 | 150,000 | 149,950 | 150,000 | 15,166 | 149,650 | |
| Rank | 5 | 2 | 6 | 8 | 7 | 4 | 2 | 2 | |
| F48 | Min | − 19.2085 | − 19.2085 | − 19.2085 | − 19.208499 | − 19.208464 | − 19.2085 | − 19.2085 | − 19.2085 |
| Mean | − 19.2085 | − 19.2085 | − 19.182987 | − 19.154687 | − 19.205055 | − 19.2085 | − 19.2085 | − 19.2085 | |
| Max | − 19.2085 | − 19.2085 | − 18.020717 | − 18.947059 | − 19.193237 | − 19.2085 | − 19.2085 | − 19.2085 | |
| Std. Dev | 1.421E−14 | 1.421E−14 | 0.1661985 | 0.0633054 | 0.0036247 | 1.421E−14 | 1.421E−14 | 1.421E−14 | |
| NFEs | 60,705.8 | 8362 | 121,320 | 150,000 | 149,950 | 146,656 | 5988 | 92,717 | |
| Rank | 3 | 3 | 7 | 8 | 6 | 3 | 3 | 3 | |
| F49 | Min | − 24.156816 | − 24.156816 | − 24.156816 | − 24.156793 | − 24.156666 | − 24.156816 | − 24.156816 | − 24.156816 |
| Mean | − 24.156815 | − 24.156816 | − 24.152432 | − 24.052886 | − 24.14902 | − 24.156815 | − 24.156816 | − 24.156816 | |
| Max | − 24.156814 | − 24.156816 | − 24.043155 | − 22.600258 | − 24.124724 | − 24.156815 | − 24.156816 | − 24.156816 | |
| Std. Dev | 3.643E−07 | 3.553E−15 | 0.0179508 | 0.2545333 | 0.0070307 | 7.818E−08 | 3.553E−15 | 3.553E−15 | |
| NFEs | 149,117.04 | 13,144 | 107,835 | 150,000 | 149,950 | 149,981 | 8845 | 139,628 | |
| Rank | 5 | 2 | 6 | 8 | 7 | 4 | 2 | 2 | |
| F50 | Min | − 4.8168141 | − 4.8168141 | − 4.8168141 | − 4.816814 | − 4.8168141 | − 4.8168141 | − 4.8168141 | − 4.8168141 |
| Mean | − 4.8168141 | − 4.8168141 | − 4.8168141 | − 4.8168115 | − 4.8168141 | − 4.8168141 | − 4.8168141 | − 4.8168141 | |
| Max | − 4.8168141 | − 4.8168141 | − 4.8168141 | − 4.816804 | − 4.816814 | − 4.8168141 | − 4.8168141 | − 4.8168141 | |
| Std. Dev | 1.122E−09 | 2.665E−15 | 2.665E−15 | 2.315E−06 | 1.291E−08 | 6.057E−10 | 2.665E−15 | 2.665E−15 | |
| NFEs | 150,767.72 | 17,856 | 4531 | 150,000 | 149,950 | 150,000 | 6525 | 121,391 | |
| Rank | 6 | 2.5 | 2.5 | 8 | 7 | 5 | 2.5 | 2.5 | |
| F51 | Min | − 2.9999986 | − 3 | − 3 | − 3 | − 3 | − 2.9999992 | − 3 | − 3 |
| Mean | − 2.9999711 | − 3 | − 3 | − 3 | − 3 | − 2.999984 | − 3 | − 3 | |
| Max | − 2.9999165 | − 3 | − 3 | − 3 | − 3 | − 2.9999597 | − 3 | − 3 | |
| Std. Dev | 1.635E−05 | 0 | 0 | 0 | 0 | 8.645E−06 | 0 | 0 | |
| NFEs | 150,829.94 | 50,204 | 11,902 | 21,641 | 10,312 | 150,000 | 40,795 | 1994 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F52 | Min | − 1.4999956 | − 1.5 | − 1.5 | − 1.5 | − 1.5 | − 1.4999989 | − 1.5 | − 1.5 |
| Mean | − 1.4999854 | − 1.5 | − 1.5 | − 1.5 | − 1.5 | − 1.4999912 | − 1.5 | − 1.5 | |
| Max | − 1.4999622 | − 1.5 | − 1.5 | − 1.5 | − 1.5 | − 1.4999806 | − 1.5 | − 1.5 | |
| Std. Dev | 7.78E−06 | 0 | 0 | 0 | 0 | 4.229E−06 | 0 | 0 | |
| NFEs | 150,837.02 | 53,750 | 12,375 | 21,376 | 10,728 | 150,000 | 37,349 | 2010 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F53 | Min | − 8.5536 | − 8.5536 | − 8.5536 | − 8.5536 | − 8.5536 | − 8.5536 | − 8.5536 | − 8.5536 |
| Mean | − 8.1956153 | − 8.5536 | − 8.5172819 | − 8.5536 | − 8.5536 | − 7.9079136 | − 8.3987104 | − 8.5536 | |
| Max | − 6.4126404 | − 8.5536 | − 7.6456102 | − 8.5536 | − 8.5536 | − 5.574845 | − 7.645779 | − 8.5536 | |
| Std. Dev | 0.5499427 | 5.329E−15 | 0.1779217 | 5.329E−15 | 5.329E−15 | 0.6449876 | 0.3266286 | 5.329E−15 | |
| NFEs | 52,712.52 | 370 | 6582 | 5343 | 55 | 93,088 | 150,000 | 92 | |
| Rank | 7 | 2.5 | 5 | 2.5 | 2.5 | 8 | 6 | 2.5 | |
| F54 | Min | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 |
| Mean | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 | |
| Max | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 | − 400 | |
| Std. Dev | 3.272E−07 | 0 | 0 | 0 | 0 | 1.23E−07 | 0 | 0 | |
| NFEs | 150,916.24 | 28,970 | 8418 | 12,097 | 5499 | 150,000 | 9981 | 1269 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F55 | Min | 19.105881 | 19.10588 | 19.10588 | 19.105921 | 19.105914 | 19.105881 | 19.10588 | 19.10588 |
| Mean | 19.106095 | 19.10588 | 19.10588 | 21.831613 | 19.109977 | 19.105978 | 19.10588 | 19.10588 | |
| Max | 19.106738 | 19.10588 | 19.10588 | 32.43579 | 19.12056 | 19.106313 | 19.10588 | 19.10588 | |
| Std. Dev | 0.0001957 | 1.776E−14 | 1.776E−14 | 3.0751262 | 0.0035102 | 0.0001013 | 1.776E−14 | 1.776E−14 | |
| NFEs | 150,774.86 | 31,054 | 6488 | 150,000 | 149,950 | 150,000 | 15,750 | 132,953 | |
| Rank | 6 | 2.5 | 2.5 | 8 | 7 | 5 | 2.5 | 2.5 | |
| F56 | Min | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 |
| Mean | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | |
| Max | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | − 0.0037912 | |
| Std. Dev | 8.126E−10 | 5.204E−18 | 2.177E−10 | 5.204E−18 | 1.589E−11 | 3.115E−10 | 5.204E−18 | 5.204E−18 | |
| NFEs | 150,954 | 21,796 | 150,000 | 38,727 | 133,528 | 149,998 | 7320 | 115,358 | |
| Rank | 8 | 2.5 | 6 | 2.5 | 5 | 7 | 2.5 | 2.5 | |
| F57 | Min | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 |
| Mean | − 0.3523861 | − 0.3523861 | − 0.352386 | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 | |
| Max | − 0.352386 | − 0.3523861 | − 0.3523858 | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 | − 0.3523861 | |
| Std. Dev | 9.064E−09 | 1.11E−16 | 6.427E−08 | 4.061E−12 | 2.41E−09 | 3.554E−09 | 1.11E−16 | 1.11E−16 | |
| NFEs | 150,749.54 | 19,846 | 150,000 | 117,831 | 149,950 | 150,000 | 7571 | 123,275 | |
| Rank | 7 | 2 | 8 | 4 | 5 | 6 | 2 | 2 | |
| F58 | Min | 4.93E−07 | 0 | 0 | 0 | 0 | 1.391E−07 | 0 | 0 |
| Mean | 3.532E−05 | 0 | 0 | 0 | 0 | 1.165E−05 | 0 | 0 | |
| Max | 0.0001322 | 0 | 0 | 0 | 0 | 6.095E−05 | 0 | 0 | |
| Std. Dev | 3.135E−05 | 0 | 0 | 0 | 0 | 1.326E−05 | 0 | 0 | |
| NFEs | 150,907.54 | 26,578 | 7152 | 21,851 | 6198 | 150,000 | 13,437 | 1399 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F59 | Min | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Mean | 0.0285544 | 0 | 0 | 0 | 0 | 0.2326575 | 0 | 0 | |
| Max | 0.187125 | 0 | 0 | 0 | 0 | 1.318125 | 0 | 0 | |
| Std. Dev | 0.033247 | 0 | 0 | 0 | 0 | 0.3752315 | 0 | 0 | |
| NFEs | 150,564.48 | 36,892 | 13,879 | 27,583 | 11,402 | 149,915 | 7623 | 1296 | |
| Rank | 7 | 3.5 | 3.5 | 3.5 | 3.5 | 8 | 3.5 | 3.5 | |
| F60 | Min | − 9.6538418 | − 9.5216433 | − 8.5956837 | − 9.0184572 | − 5.3826485 | − 9.1580302 | − 9.5723648 | − 9.66015 |
| Mean | − 9.2719934 | − 9.1090113 | − 7.0141044 | − 8.2878871 | − 4.1724485 | − 7.2714165 | − 8.8163225 | − 9.6116718 | |
| Max | − 8.7413045 | − 8.5331766 | − 5.5373408 | − 7.2030572 | − 3.1441789 | − 5.0650679 | − 7.4330183 | − 9.4333188 | |
| Std. Dev | 0.2026321 | 0.1935088 | 0.7028076 | 0.3683613 | 0.4858631 | 0.8917418 | 0.5197141 | 0.0477421 | |
| NFEs | 150,783.96 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 149,386 | |
| Rank | 2 | 3 | 7 | 5 | 8 | 6 | 4 | 1 | |
Table 6.
Comparative results of algorithms for the N-dimensional functions.
| No | Statistics | Methods | |||||||
|---|---|---|---|---|---|---|---|---|---|
| FA | CS | Jaya | TEO | SCA | MVO | CSA | FuFiO | ||
| F61 | Min | 0.1909505 | 2.5048585 | 4.702E−08 | 0 | 1.069E−11 | 0.0294228 | 0.0001546 | 0 |
| Mean | 0.2357005 | 6.8287435 | 11.015686 | 0 | 17.879896 | 0.32013 | 3.1587468 | 0 | |
| Max | 0.2789645 | 13.377361 | 19.979473 | 0 | 20.316789 | 2.1249327 | 5.4122706 | 0 | |
| Std. Dev | 0.0200211 | 2.6266095 | 9.7270521 | 0 | 6.2815761 | 0.5385861 | 0.88528 | 0 | |
| NFEs | 150,604.36 | 150,000 | 150,000 | 31,224 | 149,950 | 150,000 | 150,000 | 8594 | |
| Rank | 3 | 6 | 7 | 1.5 | 8 | 4 | 5 | 1.5 | |
| F62 | Min | 0.0293937 | 3.6621256 | 6.633E−06 | 0 | 0 | 0.6831033 | 0.0019468 | 0 |
| Mean | 0.1083397 | 5.4183604 | 2.0682974 | 0 | 0.0189388 | 2.0075273 | 0.0731469 | 0 | |
| Max | 0.3514523 | 7.2910447 | 17.307255 | 0 | 0.7953306 | 6.1175488 | 1.0803344 | 0 | |
| Std. Dev | 0.0725235 | 0.8871063 | 4.1886493 | 0 | 0.1116362 | 1.1861554 | 0.1739759 | 0 | |
| NFEs | 150,643 | 150,000 | 150,000 | 31,001 | 124,709 | 150,000 | 150,000 | 7906 | |
| Rank | 5 | 8 | 7 | 1.5 | 3 | 6 | 4 | 1.5 | |
| F63 | Min | 0.000325 | 8.162E−09 | 0 | 0 | 0 | 2.379E−05 | 1.494E−08 | 0 |
| Mean | 0.0004231 | 2.783E−08 | 0 | 0 | 0 | 5.185E−05 | 1.593E−07 | 0 | |
| Max | 0.0005437 | 7.79E−08 | 0 | 0 | 0 | 9.892E−05 | 1.051E−06 | 0 | |
| Std. Dev | 5.154E−05 | 1.69E−08 | 0 | 0 | 0 | 1.452E−05 | 2.173E−07 | 0 | |
| NFEs | 150,634.18 | 150,000 | 107,113 | 22,542 | 78,925 | 150,000 | 150,000 | 4242 | |
| Rank | 8 | 5 | 2.5 | 2.5 | 2.5 | 7 | 6 | 2.5 | |
| F64 | Min | 0.0882958 | 2.236E−12 | 0 | 0 | 0 | 0.0001167 | 0 | 0 |
| Mean | 0.139256 | 4.206E−11 | 0 | 0 | 0 | 0.0003964 | 0 | 0 | |
| Max | 0.2302019 | 2.036E−10 | 0 | 0 | 0 | 0.0012738 | 0 | 0 | |
| Std. Dev | 0.0288142 | 3.687E−11 | 0 | 0 | 0 | 0.0002286 | 0 | 0 | |
| NFEs | 150,537.44 | 150,000 | 85,597 | 20,429 | 74,301 | 150,000 | 116,899 | 3313 | |
| Rank | 8 | 6 | 3 | 3 | 3 | 7 | 3 | 3 | |
| F65 | Min | − 2.8407777 | − 2.7094506 | − 2.5377361 | − 3 | − 3 | − 2.666686 | − 3 | − 3 |
| Mean | − 2.6938899 | − 2.5681796 | − 1.6645717 | − 2.1014467 | − 2.9990427 | − 2.3279867 | − 2.8593801 | − 2.9909064 | |
| Max | − 2.4757505 | − 2.4814892 | − 1.0744921 | − 1.8262406 | − 2.9704144 | − 2.0318231 | − 2.5873465 | − 2.8563701 | |
| Std. Dev | 0.0817029 | 0.0457589 | 0.4015555 | 0.220334 | 0.0047897 | 0.1291195 | 0.0933584 | 0.030772 | |
| NFEs | 150,561.02 | 150,000 | 150,000 | 147,400 | 99,640 | 150,000 | 150,000 | 31,429 | |
| Rank | 4 | 5 | 8 | 7 | 1 | 6 | 3 | 2 | |
| F66 | Min | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Mean | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Max | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Std. Dev | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| NFEs | 83,603.08 | 102,576 | 57,227 | 12,501 | 75,047 | 145,323 | 43,363 | 1432 | |
| Rank | 4.5 | 4.5 | 4.5 | 4.5 | 4.5 | 4.5 | 4.5 | 4.5 | |
| F67 | Min | − 0.9987171 | − 0.9864462 | − 0.6059982 | − 0.9351795 | − 0.6515629 | − 0.999978 | − 1 | − 0.999924 |
| Mean | − 0.9797723 | − 0.9795079 | − 0.5695104 | − 0.8093916 | − 0.5946674 | − 0.9986162 | − 0.9476279 | − 0.996766 | |
| Max | − 0.8934949 | − 0.9722801 | − 0.5303084 | − 0.6038427 | − 0.5261549 | − 0.9666056 | − 0.8666668 | − 0.9906059 | |
| Std. Dev | 0.0276643 | 0.0031058 | 0.0171687 | 0.075034 | 0.0287077 | 0.0065319 | 0.0360735 | 0.0024981 | |
| NFEs | 150,240.18 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 3 | 4 | 8 | 6 | 7 | 1 | 5 | 2 | |
| F68 | Min | − 0.9998249 | − 0.9956164 | − 0.8916387 | − 0.6729154 | − 0.5968834 | − 0.9999779 | − 0.9999999 | − 0.9999298 |
| Mean | − 0.9997161 | − 0.9934403 | − 0.6557599 | − 0.5946617 | − 0.5353036 | − 0.9927801 | − 0.945119 | − 0.997763 | |
| Max | − 0.9994418 | − 0.990737 | − 0.5843903 | − 0.5018163 | − 0.456915 | − 0.9665975 | − 0.866756 | − 0.9937146 | |
| Std. Dev | 8.536E−05 | 0.001254 | 0.0638435 | 0.031871 | 0.0317675 | 0.0135061 | 0.0321861 | 0.0016216 | |
| NFEs | 150,687.86 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 1 | 3 | 6 | 7 | 8 | 4 | 5 | 2 | |
| F69 | Min | 0.7071839 | 0.6667536 | 0 | 0.6666667 | 0.6666777 | 0.6683365 | 0.6666811 | 0.6666667 |
| Mean | 0.7198196 | 0.6697147 | 0.6001154 | 0.6685618 | 0.6668629 | 0.8042692 | 0.7277258 | 0.6666667 | |
| Max | 0.743307 | 0.6877307 | 0.6724336 | 0.7201022 | 0.669328 | 1.4526621 | 1.3447683 | 0.6666667 | |
| Std. Dev | 0.0069476 | 0.003796 | 0.2000401 | 0.0075704 | 0.0003774 | 0.1707243 | 0.1265789 | 1.264E−08 | |
| NFEs | 150,654.28 | 150,000 | 148,870 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 6 | 5 | 1 | 4 | 3 | 8 | 7 | 2 | |
| F70 | Min | − 0.9999857 | − 1 | − 1 | − 1 | − 1 | − 0.9999995 | − 1 | − 1 |
| Mean | − 0.9999811 | − 1 | − 1 | − 1 | − 1 | − 0.9999991 | − 1 | − 1 | |
| Max | − 0.9999775 | − 1 | − 1 | − 1 | − 1 | − 0.9999986 | − 1 | − 1 | |
| Std. Dev | 1.734E−06 | 1.353E−10 | 0 | 0 | 0 | 2.571E−07 | 1.493E−12 | 0 | |
| NFEs | 150,601.14 | 150,000 | 98,814 | 18,432 | 77,604 | 150,000 | 149,190 | 3834 | |
| Rank | 8 | 6 | 2.5 | 2.5 | 2.5 | 7 | 5 | 2.5 | |
| F71 | Min | 0.0136628 | 9.762E−06 | 0 | 0 | 0 | 0.0009591 | 1.381E−07 | 0 |
| Mean | 0.0205724 | 0.0005598 | 0.083938 | 0 | 0.0269116 | 0.0186794 | 0.0123858 | 0 | |
| Max | 0.0371669 | 0.0057166 | 0.3590051 | 0 | 0.757095 | 0.0454063 | 0.0663026 | 0 | |
| Std. Dev | 0.0038833 | 0.0009266 | 0.1002033 | 0 | 0.1123686 | 0.0116117 | 0.0172719 | 0 | |
| NFEs | 150,687.56 | 150,000 | 147,427 | 23,475 | 115,725 | 150,000 | 150,000 | 4813 | |
| Rank | 6 | 3 | 8 | 1.5 | 7 | 5 | 4 | 1.5 | |
| F72 | Min | 9.07E−06 | 0 | 0 | 0 | 0 | 8.696E−09 | 0 | 0 |
| Mean | 1.662E−05 | 1.13E−11 | 0 | 0 | 0 | 9.153E−08 | 0 | 0 | |
| Max | 3.205E−05 | 2.011E−10 | 0 | 0 | 0 | 2.951E−07 | 0 | 0 | |
| Std. Dev | 4.734E−06 | 2.859E−11 | 0 | 0 | 0 | 6.492E−08 | 0 | 0 | |
| NFEs | 150,537.58 | 149,604 | 90,679 | 17,985 | 84,676 | 150,000 | 106,382 | 2831 | |
| Rank | 8 | 6 | 3 | 3 | 3 | 7 | 3 | 3 | |
| F73 | Min | 0.0237561 | 24.963929 | 0 | 45.437113 | 66.145956 | 0.5784322 | 8.8575699 | 0.2291156 |
| Mean | 7.291771 | 74.586736 | 0.1739121 | 77.633327 | 85.57113 | 70.587575 | 29.462289 | 4.4853881 | |
| Max | 121.05228 | 157.9981 | 3.636199 | 121.52253 | 127.36365 | 451.62605 | 55.797938 | 13.687722 | |
| Std. Dev | 28.737176 | 27.106377 | 0.5249535 | 17.296893 | 11.192779 | 104.26181 | 10.980962 | 2.4950105 | |
| NFEs | 150,658.06 | 150,000 | 146,317 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 3 | 6 | 1 | 7 | 8 | 5 | 4 | 2 | |
| F74 | Min | 2.0028938 | 2 | 2 | 9.3218549 | 9,481,483.9 | 2 | 603.45497 | 2 |
| Mean | 2.0063296 | 2.0000048 | 2 | 16.578871 | 9.73E + 10 | 2.0164954 | 9,470,382.4 | 2.0035558 | |
| Max | 2.0090752 | 2.0001172 | 2 | 27.052386 | 2.785E + 12 | 2.0749961 | 188,217,730 | 2.0892947 | |
| Std. Dev | 0.0013636 | 1.788E−05 | 0 | 4.3674552 | 4.037E + 11 | 0.016127 | 32,131,011 | 0.0174199 | |
| NFEs | 150,549.66 | 148,552 | 1445 | 150,000 | 149,950 | 147,522 | 150,000 | 13,494 | |
| Rank | 4 | 2 | 1 | 6 | 8 | 5 | 7 | 3 | |
| F75 | Min | 2.004438 | 2 | 2 | 10.919907 | 60,449,472 | 2.0079165 | 1575.3435 | 2 |
| Mean | 2.0066882 | 2.0000056 | 2 | 17.149951 | 4.364E + 10 | 2.1104896 | 30,189,258 | 2.0041156 | |
| Max | 2.0087217 | 2.0000802 | 2 | 24.729305 | 5.059E + 11 | 3.5331902 | 1.009E + 09 | 2.1463304 | |
| Std. Dev | 0.0010125 | 1.387E−05 | 0 | 4.0710945 | 1.03E + 11 | 0.2288759 | 142,182,139 | 0.0208942 | |
| NFEs | 150,664.7 | 149,644 | 1398 | 150,000 | 149,950 | 150,000 | 150,000 | 31,932 | |
| Rank | 4 | 2 | 1 | 6 | 8 | 5 | 7 | 3 | |
| F76 | Min | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Mean | 1.623E−11 | 0 | 3.676E−08 | 1.889E−09 | 1.983E−09 | 7.385E−11 | 0 | 3.374E−08 | |
| Max | 1.457E−10 | 0 | 4.299E−07 | 6.636E−08 | 1.751E−08 | 6.475E−10 | 0 | 8.967E−07 | |
| Std. Dev | 2.994E−11 | 0 | 8.354E−08 | 9.652E−09 | 3.468E−09 | 1.163E−10 | 0 | 1.369E−07 | |
| NFEs | 126,613.98 | 27,150 | 148,361 | 51,591 | 149,691 | 146,959 | 15,877 | 86,978 | |
| Rank | 3 | 1.5 | 8 | 5 | 6 | 4 | 1.5 | 7 | |
| F77 | Min | 3.49E−11 | 0 | 0 | 0 | 0.0001266 | 0 | 0 | 0 |
| Mean | 9.189E−11 | 5.752E−09 | 0 | 0 | 0.004732 | 0 | 0 | 3.196E−09 | |
| Max | 1.67E−10 | 2.435E−07 | 0 | 0 | 0.0160116 | 0 | 0 | 1.293E−07 | |
| Std. Dev | 3.201E−11 | 3.442E−08 | 0 | 0 | 0.0035257 | 0 | 0 | 1.836E−08 | |
| NFEs | 150,623.84 | 34,716 | 4132 | 27,056 | 149,950 | 149,249 | 52,038 | 11,086 | |
| Rank | 5 | 7 | 2.5 | 2.5 | 8 | 2.5 | 2.5 | 6 | |
| F78 | Min | 1.487E−09 | 0 | 1.73E−08 | 0 | 9.073E−09 | 5.983E−11 | 1.028E−10 | 0 |
| Mean | 1.253E−07 | 2.251E−09 | 7.412E−06 | 1.484E−08 | 6.637E−06 | 5.372E−08 | 1.303E−08 | 2.003E−06 | |
| Max | 8.5E−07 | 2.078E−08 | 3.952E−05 | 1.36E−07 | 4.681E−05 | 4.187E−07 | 1.233E−07 | 2.988E−05 | |
| Std. Dev | 1.678E−07 | 3.837E−09 | 9.458E−06 | 2.872E−08 | 9.741E−06 | 7.402E−08 | 2.356E−08 | 5.344E−06 | |
| NFEs | 150,560.56 | 148,544 | 150,000 | 148,948 | 149,950 | 150,000 | 150,000 | 146,781 | |
| Rank | 5 | 1 | 8 | 3 | 7 | 4 | 2 | 6 | |
| F79 | Min | 4.75035 | 714.16445 | 9.08E−10 | 0 | 0 | 329.97758 | 8.2728704 | 0 |
| Mean | 342.71711 | 1551.7937 | 194.12301 | 0 | 2.956E−14 | 1353.2583 | 510.95862 | 0 | |
| Max | 1865.3502 | 2221.5937 | 1780.8772 | 0 | 1.478E−12 | 3311.3709 | 1429.6684 | 0 | |
| Std. Dev | 389.49659 | 375.28206 | 300.40704 | 0 | 2.069E−13 | 595.55732 | 382.41572 | 0 | |
| NFEs | 150,648.18 | 150,000 | 150,000 | 25,900 | 91,836 | 150,000 | 150,000 | 5557 | |
| Rank | 5 | 8 | 4 | 1.5 | 3 | 7 | 6 | 1.5 | |
| F80 | Min | 4.277E−08 | 0 | 8.666E−10 | 0 | 0 | 1.08E−08 | 0 | 0 |
| Mean | 5.203E−07 | 0 | 5.534E−08 | 0 | 8.773E−10 | 1.43E−06 | 0 | 9.974E−12 | |
| Max | 2.146E−06 | 0 | 2.445E−07 | 0 | 2.574E−08 | 6.952E−06 | 0 | 2.55E−10 | |
| Std. Dev | 3.919E−07 | 0 | 5.364E−08 | 0 | 3.895E−09 | 1.62E−06 | 0 | 3.898E−11 | |
| NFEs | 150,816.74 | 28,890 | 150,000 | 73,509 | 104,644 | 150,000 | 17,268 | 62,776 | |
| Rank | 7 | 2 | 6 | 2 | 5 | 8 | 2 | 4 | |
| F81 | Min | 0.0507989 | 1.904E−06 | 8.42E−08 | 0 | 0 | 0.0063994 | 0.0087553 | 0 |
| Mean | 0.0704927 | 5.177E−06 | 2.343E−06 | 0 | 6.602E−10 | 0.0555153 | 0.0945922 | 0 | |
| Max | 0.08765 | 9.856E−06 | 1.679E−05 | 0 | 2.908E−08 | 0.1425746 | 0.2030205 | 0 | |
| Std. Dev | 0.0081709 | 1.886E−06 | 3.075E−06 | 0 | 4.093E−09 | 0.0364778 | 0.0483201 | 0 | |
| NFEs | 150,583.88 | 150,000 | 150,000 | 24,305 | 100,247 | 150,000 | 150,000 | 4937 | |
| Rank | 7 | 5 | 4 | 1.5 | 3 | 6 | 8 | 1.5 | |
| F82 | Min | 7.284E−11 | 0 | 0 | 0 | 0 | 1.928E−09 | 3.676E−12 | 0 |
| Mean | 8.477E−10 | 0 | 0 | 0 | 0 | 1.48E−08 | 1.512E−10 | 0 | |
| Max | 4.974E−09 | 0 | 0 | 0 | 0 | 4.162E−08 | 6.752E−10 | 0 | |
| Std. Dev | 8.408E−10 | 0 | 0 | 0 | 0 | 8.686E−09 | 1.462E−10 | 0 | |
| NFEs | 150,509.1 | 58,536 | 45,735 | 17,035 | 74,357 | 150,000 | 150,000 | 1397 | |
| Rank | 7 | 3 | 3 | 3 | 3 | 8 | 6 | 3 | |
| F83 | Min | 16.206529 | 57.220652 | 118.2245 | 0 | 0 | 54.732461 | 8.9546315 | 0 |
| Mean | 39.402389 | 73.375657 | 198.48474 | 0 | 6.6754191 | 101.73463 | 20.874231 | 3.4557393 | |
| Max | 64.29964 | 97.351438 | 252.42519 | 0 | 91.501502 | 150.24768 | 55.717622 | 22.052833 | |
| Std. Dev | 11.233519 | 9.0611894 | 23.626837 | 0 | 21.689954 | 21.638388 | 10.167064 | 6.4356794 | |
| NFEs | 150,798.86 | 150,000 | 150,000 | 30,788 | 126,313 | 150,000 | 150,000 | 50,853 | |
| Rank | 5 | 6 | 8 | 1 | 3 | 7 | 4 | 2 | |
| F84 | Min | 476.83692 | 16.95717 | 6.2683203 | 2469.6739 | 3333.2051 | 21.138824 | 0.0125266 | 17.659501 |
| Mean | 848.38134 | 34.174575 | 616.30913 | 4359.35 | 4382.0782 | 72.037714 | 0.6154346 | 857.28865 | |
| Max | 1339.9647 | 84.140641 | 1743.4195 | 6880.4811 | 5528.4971 | 281.59346 | 8.7294869 | 2146.8334 | |
| Std. Dev | 167.28326 | 12.072643 | 451.86434 | 950.17063 | 513.79574 | 44.536416 | 1.4947032 | 472.1903 | |
| NFEs | 150,642.12 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 5 | 2 | 4 | 7 | 8 | 3 | 1 | 6 | |
| F85 | Min | 0.0022624 | 0.0106111 | 0.0073923 | 4.474E−07 | 0.0003897 | 0.0023305 | 0.0039062 | 2.758E−05 |
| Mean | 0.005889 | 0.0217699 | 0.0216776 | 9.79E−06 | 0.0043743 | 0.0055503 | 0.0106483 | 0.000111 | |
| Max | 0.0106392 | 0.0355818 | 0.0513195 | 2.812E−05 | 0.0194865 | 0.0113343 | 0.0235451 | 0.000281 | |
| Std. Dev | 0.0018497 | 0.0059137 | 0.0078302 | 6.205E−06 | 0.0040837 | 0.0021194 | 0.0037311 | 5.179E−05 | |
| NFEs | 150,666.74 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 5 | 8 | 7 | 1 | 3 | 4 | 6 | 2 | |
| F86 | Min | 2.6731641 | 7.5802419 | 34.593207 | 74.477091 | 57.675446 | 1.212751 | 5.462842 | 1.123634 |
| Mean | 3.8231773 | 12.04304 | 52.078832 | 94.823548 | 68.552225 | 5.927061 | 25.284379 | 6.0623074 | |
| Max | 5.0428649 | 19.822675 | 82.149488 | 126.82104 | 96.23427 | 28.099066 | 52.787886 | 17.776648 | |
| Std. Dev | 0.5810164 | 2.0026695 | 11.591696 | 9.021576 | 7.2280658 | 4.94532 | 12.008273 | 3.7341928 | |
| NFEs | 150,681.24 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 1 | 4 | 6 | 8 | 7 | 2 | 5 | 3 | |
| F87 | Min | 30.385334 | 18.526352 | 0.0001122 | 28.723718 | 26.525278 | 25.194342 | 24.379185 | 17.007979 |
| Mean | 37.845624 | 24.838249 | 28.643671 | 28.830096 | 27.692608 | 149.15298 | 45.257047 | 26.657807 | |
| Max | 122.74307 | 28.399297 | 96.736648 | 28.97778 | 28.874013 | 1618.7818 | 152.59015 | 28.75041 | |
| Std. Dev | 22.730128 | 1.8644743 | 34.142109 | 0.0885231 | 0.567223 | 270.90577 | 33.987686 | 2.8855651 | |
| NFEs | 150,684.92 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 6 | 1 | 4 | 5 | 3 | 8 | 7 | 2 | |
| F88 | Min | 0.1998733 | 0.5999739 | 0.1998772 | 0.0998733 | 0.0998733 | 0.2998734 | 0.3998733 | 0.0998733 |
| Mean | 0.2098878 | 0.8757759 | 0.3062673 | 0.0998734 | 0.1220494 | 0.4598734 | 0.5118782 | 0.0998734 | |
| Max | 0.2998737 | 1.2001072 | 0.4998735 | 0.0998736 | 0.199876 | 0.5998734 | 0.6998733 | 0.0998736 | |
| Std. Dev | 0.0299953 | 0.1224258 | 0.0571839 | 3.87E−08 | 0.0413495 | 0.072111 | 0.0738637 | 5.448E−08 | |
| NFEs | 150,677.48 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 4 | 8 | 5 | 2 | 3 | 6 | 7 | 1 | |
| F89 | Min | 6.5736979 | 0.0005756 | 3.114E−06 | 0 | 0 | 0.2894817 | 1.903E−06 | 0 |
| Mean | 8.6250994 | 0.0012113 | 3.107E−05 | 0 | 5.979E−10 | 0.5957116 | 7.014E−06 | 0 | |
| Max | 11.491983 | 0.0026968 | 0.0001045 | 0 | 2.32E−08 | 1.1139158 | 1.889E−05 | 0 | |
| Std. Dev | 1.1481738 | 0.0005259 | 2.302E−05 | 0 | 3.261E−09 | 0.1792159 | 3.901E−06 | 0 | |
| NFEs | 150,613.84 | 150,000 | 150,000 | 25,877 | 128,815 | 150,000 | 150,000 | 6128 | |
| Rank | 8 | 6 | 5 | 1.5 | 3 | 7 | 4 | 1.5 | |
| F90 | Min | 0.0085431 | 4.642E−10 | 0 | 0 | 0 | 1.288E−05 | 0 | 0 |
| Mean | 0.0157465 | 1.796E−07 | 0 | 0 | 1.511E−12 | 5.917E−05 | 1.242E−13 | 0 | |
| Max | 0.0236526 | 5.262E−06 | 0 | 0 | 3.997E−11 | 0.0001636 | 3.185E−12 | 0 | |
| Std. Dev | 0.0040431 | 7.512E−07 | 0 | 0 | 6.428E−12 | 3.048E−05 | 6.086E−13 | 0 | |
| NFEs | 150,676.7 | 150,000 | 108,778 | 19,811 | 97,822 | 150,000 | 129,731 | 3328 | |
| Rank | 8 | 6 | 2 | 2 | 5 | 7 | 4 | 2 | |
| F91 | Min | 0.0828701 | 2.831E−12 | 0 | 0 | 0 | 0.0001011 | 0 | 0 |
| Mean | 0.1522853 | 4.172E−11 | 0 | 0 | 0 | 0.0004881 | 0 | 0 | |
| Max | 0.2357805 | 2.258E−10 | 0 | 0 | 0 | 0.0013272 | 0 | 0 | |
| Std. Dev | 0.0323919 | 4.17E−11 | 0 | 0 | 0 | 0.0002692 | 0 | 0 | |
| NFEs | 150,602.58 | 150,000 | 85,592 | 20,403 | 74,698 | 150,000 | 117,817 | 3283 | |
| Rank | 8 | 6 | 3 | 3 | 3 | 7 | 3 | 3 | |
| F92 | Min | 3.2490714 | 49.758983 | 11,550.227 | 0 | 0.0088312 | 0.3265632 | 0.0399548 | 0 |
| Mean | 8.5558734 | 89.187706 | 22,067.937 | 0 | 242.34789 | 1.9688322 | 0.2086749 | 0 | |
| Max | 28.6971 | 144.50595 | 37,278.026 | 0 | 3015.2166 | 4.0043882 | 0.6984432 | 0 | |
| Std. Dev | 3.9890944 | 24.490645 | 5597.7904 | 0 | 548.06092 | 0.8114925 | 0.1505049 | 0 | |
| NFEs | 150,706.66 | 150,000 | 150,000 | 26,396 | 149,950 | 150,000 | 150,000 | 11,595 | |
| Rank | 5 | 6 | 8 | 1.5 | 7 | 4 | 3 | 1.5 | |
| F93 | Min | 0.0038885 | 4.381E−07 | 0 | 7.9598187 | 25.110884 | 0.000471 | 2.399E−07 | 0.2842164 |
| Mean | 0.00518 | 1.647E−06 | 0.0376737 | 11.095765 | 27.02567 | 0.0013931 | 4.267E−06 | 2.2364866 | |
| Max | 0.0067071 | 4.7E−06 | 1.8836847 | 15.008003 | 28.578569 | 0.0028246 | 3.814E−05 | 6.4546824 | |
| Std. Dev | 0.0005287 | 9.06E−07 | 0.2637159 | 1.7561447 | 0.8592409 | 0.0005281 | 7.997E−06 | 1.4572664 | |
| NFEs | 150,652.86 | 150,000 | 101,966 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 4 | 1 | 5 | 7 | 8 | 3 | 2 | 6 | |
| F94 | Min | 2.3391885 | 0.0167398 | 4.339E−08 | 0 | 0 | 0.5513295 | 1.6064746 | 0 |
| Mean | 2.6786618 | 0.0375221 | 9.276E−08 | 0 | 0 | 1.024105 | 9.783841 | 0 | |
| Max | 2.9751368 | 0.0713853 | 1.859E−07 | 0 | 0 | 2.8337048 | 26.234636 | 0 | |
| Std. Dev | 0.150599 | 0.0104621 | 3.508E−08 | 0 | 0 | 0.4126308 | 6.2470217 | 0 | |
| NFEs | 150,623.62 | 150,000 | 150,000 | 32,756 | 82,485 | 150,000 | 150,000 | 8925 | |
| Rank | 7 | 5 | 4 | 2 | 2 | 6 | 8 | 2 | |
| F95 | Min | 0.2117237 | 1.0618729 | 0.0426349 | 0 | 0.0005498 | 0.1054729 | 0.1053016 | 0 |
| Mean | 0.2894195 | 2.0829171 | 0.1049573 | 0 | 1.3390724 | 0.2105898 | 0.8450623 | 0 | |
| Max | 0.3467119 | 3.5026403 | 0.2838106 | 0 | 10.56904 | 0.4675521 | 2.9484023 | 0 | |
| Std. Dev | 0.0284051 | 0.5098974 | 0.0529517 | 0 | 2.2707916 | 0.0723034 | 0.6218968 | 0 | |
| NFEs | 150,662.86 | 150,000 | 150,000 | 32,129 | 149,950 | 150,000 | 150,000 | 11,203 | |
| Rank | 5 | 8 | 3 | 1.5 | 7 | 4 | 6 | 1.5 | |
| F96 | Min | 2.0722718 | 319.84279 | 3.532E−05 | 0 | 0 | 498.05908 | 5.8456756 | 0 |
| Mean | 2.6263329 | 6.626E + 09 | 67.81873 | 0 | 0 | 1.241E + 14 | 127.70072 | 0 | |
| Max | 2.9543237 | 2.688E + 11 | 2346.6554 | 0 | 0 | 2.976E + 15 | 243.33086 | 0 | |
| Std. Dev | 0.164081 | 3.821E + 10 | 336.57779 | 0 | 0 | 5.319E + 14 | 76.290843 | 0 | |
| NFEs | 150,587.84 | 150,000 | 150,000 | 34,685 | 81,137 | 150,000 | 150,000 | 8965 | |
| Rank | 4 | 7 | 5 | 2 | 2 | 8 | 6 | 2 | |
| F97 | Min | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Mean | 0 | 0 | 0 | 0 | 1.013E−09 | 0 | 0 | 0 | |
| Max | 0 | 0 | 0 | 0 | 3.663E−08 | 0 | 0 | 0 | |
| Std. Dev | 0 | 0 | 0 | 0 | 5.451E−09 | 0 | 0 | 0 | |
| NFEs | 103,417.96 | 110,790 | 70,891 | 13,264 | 90,850 | 146,683 | 47,408 | 1568 | |
| Rank | 4 | 4 | 4 | 4 | 8 | 4 | 4 | 4 | |
| F98 | Min | − 351.09111 | − 315.90328 | − 417.35904 | − 335.79433 | − 176.3927 | − 326.09835 | − 281.79119 | − 417.10837 |
| Mean | − 312.26511 | − 300.11098 | − 243.21344 | − 262.25003 | − 141.70724 | − 275.15033 | − 237.95215 | − 405.5676 | |
| Max | − 267.34269 | − 283.92668 | − 166.45562 | − 183.70124 | − 123.84073 | − 216.72155 | − 199.64106 | − 386.0422 | |
| Std. Dev | 19.607015 | 7.8121935 | 63.476851 | 28.528918 | 8.6292698 | 23.283784 | 23.54223 | 6.3389761 | |
| NFEs | 150,728.8 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 2 | 3 | 6 | 5 | 8 | 4 | 7 | 1 | |
| F99 | Min | − 186.7309 | − 186.7309 | − 186.73051 | − 186.72297 | − 186.73075 | − 186.7309 | − 186.7309 | − 186.7309 |
| Mean | − 186.73085 | − 186.7309 | − 186.61038 | − 186.22443 | − 186.68061 | − 186.73089 | − 186.7309 | − 186.72988 | |
| Max | − 186.73052 | − 186.7309 | − 186.0333 | − 184.33148 | − 186.45089 | − 186.73086 | − 186.7309 | − 186.72152 | |
| Std. Dev | 6.908E−05 | 1.421E−13 | 0.1415174 | 0.5253541 | 0.0608498 | 9.734E−06 | 1.421E−13 | 0.0017373 | |
| NFEs | 148,743.26 | 20,080 | 150,000 | 150,000 | 149,950 | 148,084 | 7756 | 131,832 | |
| Rank | 4 | 1.5 | 7 | 8 | 6 | 3 | 1.5 | 5 | |
| F100 | Min | − 29.6759 | − 29.6759 | − 29.675666 | − 29.67575 | − 29.675871 | − 29.6759 | − 29.6759 | − 29.6759 |
| Mean | − 29.675895 | − 29.6759 | − 29.657811 | − 29.654279 | − 29.670218 | − 29.675899 | − 29.6759 | − 29.675841 | |
| Max | − 29.675883 | − 29.6759 | − 29.593144 | − 29.556596 | − 29.611869 | − 29.675896 | − 29.6759 | − 29.67492 | |
| Std. Dev | 4.212E−06 | 2.487E−14 | 0.020901 | 0.0227367 | 0.009789 | 8.864E−07 | 2.487E−14 | 0.0001468 | |
| NFEs | 149,466.18 | 25,198 | 150,000 | 150,000 | 149,950 | 149,997 | 8162 | 131,527 | |
| Rank | 4 | 1.5 | 7 | 8 | 6 | 3 | 1.5 | 5 | |
| F101 | Min | − 25.741771 | − 25.741771 | − 25.741643 | − 25.741739 | − 25.741763 | − 25.741771 | − 25.741771 | − 25.741771 |
| Mean | − 25.741767 | − 25.741771 | − 25.717766 | − 25.736839 | − 25.731797 | − 25.74177 | − 25.741771 | − 25.741709 | |
| Max | − 25.741747 | − 25.741771 | − 25.600663 | − 25.703 | − 25.68527 | − 25.741767 | − 25.741771 | − 25.740868 | |
| Std. Dev | 4.117E−06 | 7.105E−15 | 0.0321383 | 0.00803 | 0.0119928 | 7.87E−07 | 7.105E−15 | 0.0001496 | |
| NFEs | 150,581.42 | 65,730 | 150,000 | 150,000 | 149,950 | 150,000 | 14,551 | 138,749 | |
| Rank | 4 | 1.5 | 8 | 6 | 7 | 3 | 1.5 | 5 | |
| F102 | Min | 8.1198442 | 10.364853 | 11.564461 | 0 | 2.0922015 | 9.5414678 | 3.2110559 | 1.2864735 |
| Mean | 9.0401124 | 11.079985 | 12.210616 | 1.2072064 | 7.0504204 | 10.793357 | 5.5610738 | 3.3161353 | |
| Max | 10.119105 | 11.665728 | 12.63911 | 7.4895577 | 10.140474 | 11.718235 | 7.9989358 | 5.0044133 | |
| Std. Dev | 0.4661416 | 0.3066065 | 0.2442096 | 2.489496 | 1.8785652 | 0.5433896 | 1.0898252 | 0.9291788 | |
| NFEs | 150,802.54 | 150,000 | 150,000 | 108,193 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 5 | 7 | 8 | 1 | 4 | 6 | 3 | 2 | |
| F103 | Min | 0.2440617 | 1.62E−06 | 0 | 0 | 0 | 0.0098693 | 6.999E−09 | 0 |
| Mean | 0.3690504 | 5.496E−06 | 0 | 0 | 0 | 0.0190147 | 4.328E−08 | 0 | |
| Max | 0.4847939 | 1.398E−05 | 0 | 0 | 0 | 0.0344797 | 1.065E−07 | 0 | |
| Std. Dev | 0.0576115 | 2.724E−06 | 0 | 0 | 0 | 0.0053539 | 2.341E−08 | 0 | |
| NFEs | 150,633.72 | 150,000 | 132,933 | 24,700 | 86,320 | 150,000 | 150,000 | 5145 | |
| Rank | 8 | 6 | 2.5 | 2.5 | 2.5 | 7 | 5 | 2.5 | |
| F104 | Min | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Mean | 0 | 0 | 0 | 0 | 0 | 0.98 | 0.1 | 0 | |
| Max | 0 | 0 | 0 | 0 | 0 | 6 | 2 | 0 | |
| Std. Dev | 0 | 0 | 0 | 0 | 0 | 1.3926952 | 0.4123106 | 0 | |
| NFEs | 73,690.22 | 84,046 | 31,439 | 10,866 | 55,922 | 146,638 | 90,522 | 1240 | |
| Rank | 3.5 | 3.5 | 3.5 | 3.5 | 3.5 | 8 | 7 | 3.5 | |
| F105 | Min | 0.2826588 | 1.877E−06 | 2.044854 | 4.1248448 | 2.8815577 | 0.0092474 | 4.955E−09 | 0.0001645 |
| Mean | 0.3854357 | 5.137E−06 | 2.7432517 | 6.3494812 | 3.7775958 | 0.0203817 | 3.614E−08 | 0.4792333 | |
| Max | 0.4825408 | 1.004E−05 | 3.6073175 | 6.7917822 | 4.4252885 | 0.0336237 | 9.205E−08 | 1.3467063 | |
| Std. Dev | 0.0523391 | 2.224E−06 | 0.3231843 | 0.3977501 | 0.2879924 | 0.0053202 | 1.965E−08 | 0.3514871 | |
| NFEs | 150,677.46 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 4 | 2 | 6 | 8 | 7 | 3 | 1 | 5 | |
| F106 | Min | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| Mean | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Max | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Std. Dev | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| NFEs | 66,845.72 | 60,004 | 31,970 | 10,792 | 63,256 | 143,090 | 22,160 | 1264 | |
| Rank | 4.5 | 4.5 | 4.5 | 4.5 | 4.5 | 4.5 | 4.5 | 4.5 | |
| F107 | Min | − 155 | − 155 | − 145 | − 155 | − 127 | − 153 | − 101 | − 155 |
| Mean | − 155 | − 154.34 | − 137.1 | − 155 | − 113.68 | − 148.16 | − 75.82 | − 154.36 | |
| Max | − 155 | − 152 | − 130 | − 155 | − 103 | − 139 | − 59 | − 150 | |
| Std. Dev | 0 | 0.8151074 | 2.8017851 | 0 | 4.7431635 | 2.8660775 | 9.5638695 | 1.0537552 | |
| NFEs | 9939.34 | 132,770 | 150,000 | 17,059 | 149,950 | 150,000 | 150,000 | 83,348 | |
| Rank | 1.5 | 4 | 6 | 1.5 | 7 | 5 | 8 | 3 | |
| F108 | Min | 4.5392844 | 33.642812 | 0.5871564 | 0 | 0 | 11.049074 | 18.117263 | 0 |
| Mean | 7.4423342 | 41.719893 | 1.8513384 | 0 | 2.173E−09 | 29.050608 | 24.930286 | 0 | |
| Max | 21.067286 | 49.994433 | 7.1144969 | 0 | 4.058E−08 | 53.307162 | 29.591488 | 0 | |
| Std. Dev | 4.2316886 | 4.2837502 | 1.4147333 | 0 | 7.121E−09 | 9.826126 | 2.7641032 | 0 | |
| NFEs | 150,558.32 | 150,000 | 150,000 | 46,005 | 149,243 | 150,000 | 150,000 | 17,168 | |
| Rank | 5 | 8 | 4 | 1.5 | 3 | 7 | 6 | 1.5 | |
| F109 | Min | 0.0394756 | 1.428E−07 | 0 | 0 | 0 | 0.0026946 | 6.16E−05 | 0 |
| Mean | 0.0527372 | 7.119E−07 | 0 | 0 | 0 | 0.0161522 | 0.0132389 | 0 | |
| Max | 0.0709243 | 3.6E−06 | 0 | 0 | 0 | 0.0781991 | 0.1184532 | 0 | |
| Std. Dev | 0.0074115 | 5.121E−07 | 0 | 0 | 0 | 0.0162108 | 0.0214838 | 0 | |
| NFEs | 150,655.6 | 150,000 | 126,098 | 23,981 | 84,764 | 150,000 | 150,000 | 4899 | |
| Rank | 8 | 5 | 2.5 | 2.5 | 2.5 | 7 | 6 | 2.5 | |
| F110 | Min | − 1132.5565 | − 1144.3311 | − 771.06973 | − 1136.6987 | − 760.2832 | − 1104.3007 | − 1061.8912 | − 1174.9832 |
| Mean | − 1051.9793 | − 1091.4401 | − 698.73085 | − 1077.0015 | − 647.85495 | − 1024.004 | − 1012.13 | − 1172.6442 | |
| Max | − 906.37007 | − 1060.8122 | − 644.77548 | − 1031.9777 | − 582.11401 | − 934.65983 | − 920.52403 | − 1165.9043 | |
| Std. Dev | 40.407428 | 15.334159 | 25.434318 | 23.698519 | 39.821583 | 40.524819 | 37.427898 | 2.2004236 | |
| NFEs | 150,639.74 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 4 | 2 | 7 | 3 | 8 | 5 | 6 | 1 | |
| F111 | Min | 2469.7051 | 0 | 0 | 0 | 0 | 2306.905 | 216.57404 | 0 |
| Mean | 4196.5525 | 1233.3595 | 204.07436 | 0 | 0 | 6131.6934 | 1266.4692 | 0 | |
| Max | 4889.7299 | 5963.5903 | 3651.9685 | 0 | 0 | 12,036.516 | 2429.471 | 0 | |
| Std. Dev | 518.27442 | 1433.9371 | 570.3299 | 0 | 0 | 2394.5309 | 446.05259 | 0 | |
| NFEs | 150,547.04 | 142,194 | 113,762 | 39,498 | 1050 | 150,000 | 150,000 | 3340 | |
| Rank | 7 | 5 | 4 | 2 | 2 | 8 | 6 | 2 | |
| F112 | Min | 164.60841 | 71.949683 | 137.78151 | 24.696335 | 24.468051 | 147.67746 | 89.757421 | 24.660514 |
| Mean | 186.51224 | 99.815878 | 164.06475 | 24.933105 | 51.736085 | 193.73563 | 149.36768 | 47.970949 | |
| Max | 200.83196 | 119.10462 | 198.38504 | 25.49441 | 125.9227 | 296.34431 | 217.15848 | 81.606885 | |
| Std. Dev | 8.3658057 | 10.267658 | 12.871777 | 0.1797349 | 29.714679 | 29.640256 | 33.48754 | 14.230126 | |
| NFEs | 150,683.78 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 7 | 4 | 6 | 1 | 3 | 8 | 5 | 2 | |
| F113 | Min | 3.53E−10 | 0 | 0 | 0 | 0 | 1.266E−10 | 0 | 0 |
| Mean | 3.232E−08 | 0 | 0 | 0 | 0 | 9.353E−09 | 0 | 0 | |
| Max | 1.135E−07 | 0 | 0 | 0 | 0 | 6.292E−08 | 0 | 0 | |
| Std. Dev | 2.778E−08 | 0 | 0 | 0 | 0 | 1.189E−08 | 0 | 0 | |
| NFEs | 150,888.56 | 32,514 | 19,074 | 18,720 | 5033 | 150,000 | 9700 | 1203 | |
| Rank | 8 | 3.5 | 3.5 | 3.5 | 3.5 | 7 | 3.5 | 3.5 | |
| F114 | Min | 1.2169811 | 2.8947126 | 0.0003839 | 0 | 0 | 2.6871831 | 5.3315469 | 0 |
| Mean | 2.1666108 | 4.9259417 | 0.5153793 | 0 | 0 | 6.8368507 | 10.175872 | 0 | |
| Max | 4.3834416 | 6.6516057 | 3.0006156 | 0 | 0 | 12.269068 | 15.287907 | 0 | |
| Std. Dev | 1.051405 | 0.8596602 | 0.7666543 | 0 | 0 | 2.370051 | 2.0501896 | 0 | |
| NFEs | 150,626.5 | 150,000 | 150,000 | 31,220 | 75,108 | 150,000 | 150,000 | 7998 | |
| Rank | 5 | 6 | 4 | 2 | 2 | 7 | 8 | 2 | |
| F115 | Min | 400.22651 | 454.44163 | 0 | 391.02803 | 389.03203 | 433.67796 | 562.77178 | 302.06433 |
| Mean | 423.99483 | 524.24823 | 351.00674 | 397.08273 | 412.30851 | 577.26351 | 655.25655 | 369.01597 | |
| Max | 642.81689 | 572.63484 | 780.45785 | 407.5249 | 561.32999 | 708.68331 | 749.79498 | 399.74704 | |
| Std. Dev | 36.734968 | 27.542317 | 342.59666 | 4.3539142 | 31.883607 | 67.316754 | 48.127237 | 17.662407 | |
| NFEs | 150,739.18 | 150,000 | 127,943 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 5 | 6 | 1 | 3 | 4 | 7 | 8 | 2 | |
| F116 | Min | 1.946E−06 | 7.383E−05 | 1.662E−09 | 0 | 0 | 7.381E−06 | 3.336E−06 | 0 |
| Mean | 0.0088639 | 0.0018742 | 0.1221956 | 0 | 3.437E−07 | 0.1088226 | 0.0003463 | 0 | |
| Max | 0.2195172 | 0.0077134 | 3.0643003 | 0 | 1.248E−05 | 1.7435142 | 0.0035676 | 0 | |
| Std. Dev | 0.0334188 | 0.001761 | 0.4930401 | 0 | 1.774E−06 | 0.3030003 | 0.0007079 | 0 | |
| NFEs | 150,616.42 | 150,000 | 150,000 | 52,287 | 108,203 | 150,000 | 150,000 | 3222 | |
| Rank | 6 | 5 | 8 | 1.5 | 3 | 7 | 4 | 1.5 | |
| F117 | Min | 8.443E−12 | 1.136E−11 | 2.747E−11 | 4.069E−12 | 4.788E−11 | 7.036E−12 | 3.512E−12 | 3.819E−12 |
| Mean | 1.204E−11 | 1.742E−11 | 2.973E−11 | 4.929E−12 | 2.436E−10 | 1.187E−11 | 3.662E−12 | 5.446E−12 | |
| Max | 1.718E−11 | 2.082E−11 | 3.157E−11 | 5.921E−12 | 7.245E−10 | 2.39E−11 | 4.273E−12 | 8.028E−12 | |
| Std. Dev | 1.929E−12 | 2.134E−12 | 7.558E−13 | 4.596E−13 | 1.307E−10 | 3.605E−12 | 1.845E−13 | 9.152E−13 | |
| NFEs | 150,758.46 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 5 | 6 | 7 | 2 | 8 | 4 | 1 | 3 | |
| F118 | Min | 7.79E−232 | 4.34E−232 | 4.34E−232 | 5.4E−222 | 9.02E−217 | 7.52E−224 | 4.54E−114 | 4.34E−232 |
| Mean | 1.33E−231 | 4.34E−232 | 6.32E−229 | 2.12E−209 | 6.04E−197 | 7.79E−178 | 7.19E−70 | 4.34E−232 | |
| Max | 1.74E−231 | 4.34E−232 | 2.39E−227 | 1.05E−207 | 1.12E−195 | 3.88E−176 | 3.137E−68 | 4.34E−232 | |
| Std. Dev | 0 | 0 | 0 | 0 | 0 | 0 | 4.393E−69 | 0 | |
| NFEs | 150,615.08 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 3 | 1.5 | 4 | 5 | 6 | 7 | 8 | 1.5 | |
| F119 | Min | 2.818E−12 | 2.983E−12 | 2.473E−09 | 2.979E−12 | 1.117E−09 | 2.808E−12 | 2.807E−12 | 2.814E−12 |
| Mean | 3.191E−12 | 3.061E−12 | 8.026E−09 | 3.25E−12 | 5.225E−09 | 6.38E−12 | 2.862E−12 | 2.882E−12 | |
| Max | 6.056E−12 | 3.158E−12 | 1.9E−08 | 3.669E−12 | 1.857E−08 | 2.162E−11 | 5.565E−12 | 3.04E−12 | |
| Std. Dev | 9.187E−13 | 4.489E−14 | 3.817E−09 | 1.757E−13 | 3.202E−09 | 5.311E−12 | 3.861E−13 | 5.743E−14 | |
| NFEs | 150,664.42 | 150,000 | 150,000 | 150,000 | 149,950 | 150,000 | 150,000 | 150,000 | |
| Rank | 4 | 3 | 8 | 5 | 7 | 6 | 1 | 2 | |
| F120 | Min | 0.0118379 | 8.6378582 | 46.641399 | 0 | 3.576E−06 | 0.001705 | 2.5883177 | 0 |
| Mean | 0.0221057 | 13.359538 | 75.00896 | 0 | 0.0855598 | 0.0038338 | 6.3506408 | 0 | |
| Max | 0.0539693 | 19.713932 | 106.77373 | 0 | 2.5400129 | 0.0068168 | 11.903133 | 0 | |
| Std. Dev | 0.0080628 | 2.6657201 | 14.445587 | 0 | 0.358683 | 0.001097 | 2.4237925 | 0 | |
| NFEs | 150,598.88 | 150,000 | 150,000 | 27,196 | 149,950 | 150,000 | 150,000 | 17,673 | |
| Rank | 4 | 7 | 8 | 1.5 | 5 | 3 | 6 | 1.5 | |
Non-parametric statistical analyses
Non-parametric statistical methods are useful tools for comparing and ranking the performance of metaheuristic algorithms. In this study, four well-known non-parametric tests including the Wilcoxon Signed-Rank98, Friedman99, Friedman Aligned Ranks100, and Quade101 tests, are used to analyze the ability of algorithms in solving benchmark problems; in all of these tests, the significance level, , is 0.05102.
The results of the Wilcoxon Signed-Rank test are presented in Table 7, which shows that the R+ of FuFiO is less than the R− of all the other methods, which means that FuFiO performs better than all of the compared ones. Furthermore, the p-values show that the FuFiO algorithm significantly outperforms other algorithms in solving benchmark problems, except in competition with the CS and CSA algorithms in solving the fixed-dimensional problems.
Table 7.
The Wilcoxon Signed-Rank test results.
| One-to-one comparison | Type | R+ | R- | T | p-value |
|---|---|---|---|---|---|
| FuFiO vs. FA | Fixed-dimensional | 0 | 1596 | 0 | 7.5475E−11 |
| N-dimensional | 269 | 1327 | 269 | 1.5953E−05 | |
| FuFiO vs. CS | Fixed-dimensional | 2 | 13 | 2 | 0.13801074 |
| N-dimensional | 273 | 1158 | 273 | 8.9528E−05 | |
| FuFiO vs. Jaya | Fixed-dimensional | 0 | 406 | 0 | 3.7896E−06 |
| N-dimensional | 182 | 899 | 182 | 8.9752E−05 | |
| FuFiO vs. TEO | Fixed-dimensional | 0 | 820 | 0 | 3.5694E−08 |
| N-dimensional | 115 | 381 | 115 | 0.00915154 | |
| FuFiO vs. SCA | Fixed-dimensional | 0 | 780 | 0 | 5.2553E−08 |
| N-dimensional | 29 | 961 | 29 | 5.3788E−08 | |
| FuFiO vs. MVO | Fixed-dimensional | 0 | 1653 | 0 | 5.1438E−11 |
| N-dimensional | 248 | 1405 | 248 | 4.3005E−06 | |
| FuFiO vs. CSA | Fixed-dimensional | 7 | 21 | 7 | 0.23672357 |
| N-dimensional | 199 | 1232 | 199 | 4.8205E−06 |
The Friedman test is a ranking method the results of which are presented in Table 8. According to this test, the FuFiO algorithm is placed in the first rank in all types of problems.
Table 8.
The Friedman test results.
| Method | Type | |||
|---|---|---|---|---|
| Fixed-dimensional | N-dimensional | |||
| R | Rank | R | Rank | |
| FA | 6.1916667 | 8 | 5.0833333 | 7 |
| CS | 2.775 | 2 | 4.5583333 | 3 |
| Jaya | 4.7166667 | 4 | 4.9583333 | 6 |
| TEO | 5.875 | 7 | 3.525 | 2 |
| SCA | 5.35 | 5 | 4.9333333 | 5 |
| MVO | 5.6833333 | 6 | 5.5083333 | 8 |
| CSA | 2.8083333 | 3 | 4.65 | 4 |
| FuFiO | 2.6 | 1 | 2.7833333 | 1 |
| Statistic | 163.69444 | 56.783333 | ||
| p-value | 5.351E−32 | 6.601E−10 | ||
In the Friedman Aligned Rank test, the average of each set of values is calculated and then subtracted from the results. Subsequently, this method ranks algorithms based on their corresponding shifted values which are called aligned ranks. The results of this test, presented in Table 9, show that the FuFiO algorithm gains the first rank in solving both fixed- and N-dimensional benchmark problems.
Table 9.
The Friedman aligned ranks test results.
| Method | Type | |||
|---|---|---|---|---|
| Fixed-dimensional | N-dimensional | |||
| R | Rank | R | Rank | |
| FA | 259.6917 | 6 | 232.4167 | 3 |
| CS | 194.7917 | 3 | 240.7167 | 4 |
| Jaya | 250 | 5 | 270.7083 | 7 |
| TEO | 328.5583 | 8 | 225.7583 | 2 |
| SCA | 230.1833 | 4 | 266.6333 | 6 |
| MVO | 279.3667 | 7 | 276.7417 | 8 |
| CSA | 194.2083 | 2 | 241.9333 | 5 |
| FuFiO | 187.2 | 1 | 169.0917 | 1 |
| Statistic | 73.96375 | 29.77014 | ||
| p-value | 2.33E−13 | 0.000105 | ||
The Quade test can be considered as an extension of the Wilcoxon Signed-Rank test for comparing multiple algorithms, making it often more effective than the previous tests. The results of the Quade test are presented in Table 10, showing that the FuFiO method is ranked first in comparison with the other methods for all types of problems.
Table 10.
The Quade test results.
| Method | Type | |||
|---|---|---|---|---|
| Fixed-dimensional | N-dimensional | |||
| R | Rank | R | Rank | |
| FA | 5.870219 | 7 | 4.813661 | 4 |
| CS | 2.753552 | 3 | 4.70082 | 3 |
| Jaya | 4.843989 | 4 | 4.903279 | 5 |
| TEO | 6.26612 | 8 | 3.521858 | 2 |
| SCA | 5.572678 | 6 | 4.990984 | 6 |
| MVO | 5.543716 | 5 | 5.520219 | 8 |
| CSA | 2.709016 | 2 | 5.048361 | 7 |
| FuFiO | 2.44071 | 1 | 2.50082 | 1 |
| Statistic | 27.94946 | 8.282949 | ||
| p-value | 0.000225 | 0.308306 | ||
The final statistical method considered here is the analysis of variance (ANOVA) test, which compares the variance of results across the means of various algorithms. In this research, the ANOVA test has been employed with a significance level of 5% to study the efficiency and relative performance of optimizers. The results of this test are presented in Table 11. According to these results, the p-values indicate significant differences between the means in the majority of the considered problems. Besides, the results of the ANOVA test for four fixed-dimension and four N-dimension problems are plotted in Figs. 13 and 14, respectively.
Table 11.
Results of the ANOVA test.
| No | F | p-value | No | F | p-value | No | F | p-value |
|---|---|---|---|---|---|---|---|---|
| 1 | 212.628 | 3E−129 | 41 | 91.4162 | 2.1E−78 | 81 | 163.779 | 3E−112 |
| 2 | 18.3774 | 3.6E−21 | 42 | 60.4215 | 1.6E−58 | 82 | 138.653 | 6E−102 |
| 3 | 38.6995 | 3.4E−41 | 43 | 42.0432 | 4.3E−44 | 83 | 984.778 | 3E−244 |
| 4 | 9.41856 | 8.2E−11 | 44 | 32.5073 | 1.5E−35 | 84 | 843.09 | 7E−232 |
| 5 | 95.5752 | 9.2E−81 | 45 | 23.1121 | 3.1E−26 | 85 | 219.699 | 2E−131 |
| 6 | 55.7522 | 4.5E−55 | 46 | 14.172 | 2E−16 | 86 | 1016.25 | 7E−247 |
| 7 | 26.3995 | 1.3E−29 | 47 | 41.745 | 7.7E−44 | 87 | 9.15264 | 1.7E−10 |
| 8 | 51.0346 | 1.9E−51 | 48 | 4.78228 | 3.5E−05 | 88 | 909.013 | 7E−238 |
| 9 | 44.5832 | 3.1E−46 | 49 | 7.9035 | 5.6E−09 | 89 | 2658.81 | 0 |
| 10 | 11.2979 | 4.6E−13 | 50 | 59.8849 | 4E−58 | 90 | 742.438 | 9E−222 |
| 11 | 0.97232 | 0.45099 | 51 | 137.807 | 1E−101 | 91 | 1081.97 | 6E−252 |
| 12 | 20.3401 | 2.6E−23 | 52 | 158.415 | 4E−110 | 92 | 751.033 | 1E−222 |
| 13 | 67.4868 | 1.8E−63 | 53 | 25.6152 | 8.1E−29 | 93 | 6092.99 | 0 |
| 14 | 75.3191 | 1.2E−68 | 54 | 44.9057 | 1.7E−46 | 94 | 115.783 | 2.4E−91 |
| 15 | 21.5699 | 1.3E−24 | 55 | 38.4801 | 5.4E−41 | 95 | 38.7123 | 3.3E−41 |
| 16 | 54.0947 | 8.2E−54 | 56 | 5.43352 | 5.8E−06 | 96 | 2.6681 | 0.01044 |
| 17 | 14.3731 | 1.2E−16 | 57 | 62.3563 | 6.7E−60 | 97 | 1.69325 | 0.10904 |
| 18 | 19.2364 | 4.2E−22 | 58 | 53.5171 | 2.3E−53 | 98 | 338.736 | 7E−162 |
| 19 | 24.8055 | 5.4E−28 | 59 | 18.3172 | 4.2E−21 | 99 | 40.3648 | 1.2E−42 |
| 20 | 18.5329 | 2.4E−21 | 60 | 621.352 | 9E−208 | 100 | 30.853 | 5.6E−34 |
| 21 | 18.6236 | 1.9E−21 | 61 | 119.601 | 3.3E−93 | 101 | 19.0169 | 7.2E−22 |
| 22 | 25.0435 | 3.1E−28 | 62 | 73.4034 | 2E−67 | 102 | 491.788 | 1E−189 |
| 23 | 32.6928 | 1E−35 | 63 | 2997.81 | 0 | 103 | 1969.43 | 6E−301 |
| 24 | 41.7835 | 7.2E−44 | 64 | 1143.49 | 2E−256 | 104 | 21.8893 | 5.9E−25 |
| 25 | 38.3024 | 7.7E−41 | 65 | 352.692 | 7E−165 | 105 | 4608.94 | 0 |
| 26 | 67.8982 | 9.4E−64 | 66 | NaN | NaN | 106 | NaN | NaN |
| 27 | 53.9871 | 9.9E−54 | 67 | 1461.31 | 2E−276 | 107 | 2405.03 | 0 |
| 28 | 42.3063 | 2.6E−44 | 68 | 2258.09 | 0 | 108 | 741.745 | 1E−221 |
| 29 | 139.703 | 2E−102 | 69 | 16.6731 | 2.8E−19 | 109 | 170.616 | 8E−115 |
| 30 | 3.12764 | 0.00317 | 70 | 5645.22 | 0 | 110 | 1855.05 | 5E−296 |
| 31 | 3.12116 | 0.00323 | 71 | 13.0153 | 4.4E−15 | 111 | 242.365 | 4E−138 |
| 32 | 7.10771 | 5.3E−08 | 72 | 602.852 | 2E−205 | 112 | 518.713 | 8E−194 |
| 33 | 16.5702 | 3.7E−19 | 73 | 41.1597 | 2.5E−43 | 113 | 56.1407 | 2.3E−55 |
| 34 | 23.754 | 6.6E−27 | 74 | 2.84673 | 0.0066 | 114 | 474.154 | 6E−187 |
| 35 | 7.57138 | 1.4E−08 | 75 | 8.7876 | 4.8E−10 | 115 | 36.6578 | 2.3E−39 |
| 36 | 52.7857 | 8.2E−53 | 76 | 3.91161 | 0.00039 | 116 | 3.25476 | 0.00227 |
| 37 | 1.76362 | 0.09318 | 77 | 88.268 | 1.4E−76 | 117 | 155.142 | 8E−109 |
| 38 | 15.0353 | 2E−17 | 78 | 18.4005 | 3.4E−21 | 118 | 1.31254 | 0.2428 |
| 39 | 1.71051 | 0.10494 | 79 | 171.251 | 5E−115 | 119 | 157.206 | 1E−109 |
| 40 | 10.0222 | 1.5E−11 | 80 | 36.5495 | 2.8E−39 | 120 | 1192.05 | 9E−260 |
*NaN means there is no difference between means.
Figure 13.
ANOVA test results for fixed-dimension functions.
Figure 14.
ANOVA test results for N-dimension functions.
Analyses based on competitions on evolutionary computation (CEC)
In this section, the performance of the FuFiO algorithm is investigated using the single-objective real-parameter numerical optimization problems of two recent Competitions on Evolutionary Computation, namely CEC-2017 and CEC-2019 benchmark test functions. Then, the computational time and complexity of FuFiO is compared with other state-of-the-art algorithms.
Comparative analyses based on the CEC-2017 test functions
To investigate the ability of FuFiO in solving more difficult problems, the CEC 2017 Special Season on single-objective problems are utilized in this sub-section. To establish and perform a comparative analysis, four state-of-the-art algorithms including the Effective Butterfly Optimizer with Covariance Matrix Adapted Retreat (EBOwithCMAR)103, ensemble sinusoidal differential covariance matrix adaptation with Euclidean neighborhood (LSHADE-cnEpSin)104, Multi-Method-based Orthogonal Experimental Design (MM_OED)105], and Teaching Learning Based Optimization with Focused Learning (TLBO-FL)106 are considered. Table 12 contains a list of these problems the mathematical details of which was presented by the CEC 2017 committee107.
Table 12.
Summary of the CEC-2017 test functions.
| No | Function | D | Min |
|---|---|---|---|
| C1 | Shifted and Rotated Bent Cigar Function | 10, 30, 50, 100 | 0 |
| C2 | Removed by committee | – | – |
| C3 | Shifted and Rotated Zakharov Function | 10, 30, 50, 100 | 0 |
| C4 | Shifted and Rotated Rosenbrock’s Function | 10, 30, 50, 100 | 0 |
| C5 | Shifted and Rotated Rastrigin’s Function | 10, 30, 50, 100 | 0 |
| C6 | Shifted and Rotated Expanded Scaffer’s F6 Function | 10, 30, 50, 100 | 0 |
| C7 | Shifted and Rotated Lunacek Bi_Rastrigin Function | 10, 30, 50, 100 | 0 |
| C8 | Shifted and Rotated Non-Continuous Rastrigin’s Function | 10, 30, 50, 100 | 0 |
| C9 | Shifted and Rotated Levy Function | 10, 30, 50, 100 | 0 |
| C10 | Shifted and Rotated Schwefel’s Function | 10, 30, 50, 100 | 0 |
| C11 | Hybrid Function 1 (N = 3) | 10, 30, 50, 100 | 0 |
| C12 | Hybrid Function 2 (N = 3) | 10, 30, 50, 100 | 0 |
| C13 | Hybrid Function 3 (N = 3) | 10, 30, 50, 100 | 0 |
| C14 | Hybrid Function 4 (N = 4) | 10, 30, 50, 100 | 0 |
| C15 | Hybrid Function 5 (N = 4) | 10, 30, 50, 100 | 0 |
| C16 | Hybrid Function 6 (N = 4) | 10, 30, 50, 100 | 0 |
| C17 | Hybrid Function 6 (N = 5) | 10, 30, 50, 100 | 0 |
| C18 | Hybrid Function 6 (N = 5) | 10, 30, 50, 100 | 0 |
| C19 | Hybrid Function 6 (N = 5) | 10, 30, 50, 100 | 0 |
| C20 | Hybrid Function 6 (N = 6) | 10, 30, 50, 100 | 0 |
| C21 | Composition Function 1 (N = 3) | 10, 30, 50, 100 | 0 |
| C22 | Composition Function 2 (N = 3) | 10, 30, 50, 100 | 0 |
| C23 | Composition Function 3 (N = 4) | 10, 30, 50, 100 | 0 |
| C24 | Composition Function 4 (N = 4) | 10, 30, 50, 100 | 0 |
| C25 | Composition Function 5 (N = 5) | 10, 30, 50, 100 | 0 |
| C26 | Composition Function 6 (N = 5) | 10, 30, 50, 100 | 0 |
| C27 | Composition Function 7 (N = 6) | 10, 30, 50, 100 | 0 |
| C28 | Composition Function 8 (N = 6) | 10, 30, 50, 100 | 0 |
| C29 | Composition Function 9 (N = 3) | 10, 30, 50, 100 | 0 |
| C30 | Composition Function 10 (N = 3) | 10, 30, 50, 100 | 0 |
The statistical results of FuFiO and the other algorithms in solving 10-, 30-, 50- and 100-dimensional problems are presented in Tables 13, 14, 15, and 16, respectively. These results are based on 51 independent runs. An error value is considered in this study such that when it is less than 10−8, the error is considered zero. The total number of function evaluations for each test problem is taken as 10000D, where D is the problem dimension. The results confirm that the FuFiO method can provide very competitive results.
Table 13.
Statistical results of different algorithms for the 10-dimensional CEC-2017 problems.
Table 14.
Statistical results of different algorithms for the 30-dimensional CEC-2017 problems.
Table 15.
Statistical results of different algorithms for the 50-dimensional CEC-2017 problems.
Table 16.
Statistical results of different algorithms for the 100-dimensional CEC-2017 problems.
Computational time and complexity analyses
A complete computational time and complexity analysis is conducted to evaluate the FuFiO algorithm. Awad et al. have proposed a simple procedure to analyze the complexity of metaheuristic algorithms in the CEC-2017 instructions107, in which complexity is reflected by four times, namely , , , and , as follows: is the computing time of the test program shown in Fig. 15; is given by the time of 200,000 evaluations of by itself with D dimensions; is the total computing time of the FuFiO algorithm in 200,000 evaluations of the same D-dimensional ; and denotes the mean value of five different runs of .
Figure 15.

Procedure of T0 assessment.
The complexity results of the FuFiO algorithm and other methods in 10, 30, 50, and 100 dimensions are presented in Table 17, which demonstrate that FuFiO can perform competitively.
Table 17.
Computational complexity of the FuFiO algorithm versus the other algorithms.
| D | Time | EBOwithCMAR | LSHADE-cnEpSin | MM-OED | TLBO-FL | FuFiO |
|---|---|---|---|---|---|---|
| 10 | 0.0413 | 0.1093 | 2.157784 | 0.09 | 0.053148815 | |
| 0.8218 | 0.8391 | 0.146416 | 0.41 | 0.919610921 | ||
| 7.5794 | 2.1835 | 6.704923 | 1.62 | 6.692289658 | ||
| 163.622276 | 12.30009149 | 3.039464098 | 13.44444444 | 108.6134986 | ||
| 30 | 1.1507 | 1.057 | 0.592848 | 0.79 | 1.408477381 | |
| 6.591 | 3.6724 | 20.84485 | 2.17 | 8.167910826 | ||
| 131.7263923 | 23.92863678 | 9.385555737 | 15.33333333 | 127.179382 | ||
| 50 | 1.8792 | 1.4338 | 1.606688 | 1.45 | 2.256751371 | |
| 8.7886 | 3.7066 | 38.51665 | 3.03 | 9.881637315 | ||
| 167.2978208 | 20.79414456 | 17.10549434 | 17.55555556 | 143.462953 | ||
| 100 | 5.6887 | 3.0237 | 5.776893 | 4.81 | 6.769188826 | |
| 18.4969 | 7.7564 | 72.62159 | 6.93 | 16.64127159 | ||
| 310.125908 | 43.30009149 | 30.97840053 | 23.55555556 | 185.7441744 |
The key metric in evaluating the running time of an algorithm is computational complexity, which is defined based on its structure. According to Big O notation, the complexity of the FuFiO algorithm is calculated based on the number of nuclei n, number of design variables d, maximum number of iterations t, and the sorting mechanism of nuclei in each iteration as follows:
Comparative analyses based on the CEC-2019 test functions
In this sub-section, the problems defined by the CEC-2019 Special Season are utilized. Different physics-based methods including the Gravitational Search Algorithm (GSA)86 and Electromagnetic Field Optimization (EFO)56. Furthermore, three recently-developed evolutionary methods including the Farmland Fertility Algorithm (FFA)35, African Vultures Optimization Algorithm (AVOA)37, and Artificial Gorilla Troops Optimizer (GTO)42, are considered for this comparative study. Table 18 presents the properties of the CEC-2019 examples108.
Table 18.
Summary of the CEC 2019 test functions.
| No | Function | D | Limits |
|---|---|---|---|
| C1 | Storn's Chebyshev Polynomial Fitting Problem | 9 | [− 8192, 8192] |
| C2 | Inverse Hilbert Matrix Problem | 16 | [− 16384, 16,384 |
| C3 | Lennard–Jones Minimum Energy Cluster | 18 | [− 4,4] |
| C4 | Rastrigin’s Function | 10 | [− 100,100] |
| C5 | Griewangk’s Function | 10 | [− 100,100] |
| C6 | Weierstrass Function | 10 | [− 100,100] |
| C7 | Modified Schwefel’s Function | 10 | [− 100,100] |
| C8 | Expanded Schaffer’s F6 Function | 10 | [− 100,100] |
| C9 | Happy Cat Function | 10 | [− 100,100] |
| C10 | Ackley Function | 10 | [− 100,100] |
The statistical results of the algorithms are presented in Table 19. These results are based on 50 independent runs, but for reporting the final result, we select the best 25 ones according to the CEC-2019 rules. An error value is considered in this study such that when it is less than 10−10, the error is considered zero. The total number of function evaluations for each test problem is taken as 106. A conclusion concerning the statistical results is also added to the table. The final output shows that FuFiO is placed in the second place with a very small difference while its stability in finding results is so far better that the other methods based on the standard divination values. Moreover, the ANOVA test has been employed with a significance level of 5% and the related results for all problems are plotted in Fig. 16. The results show a good performance of the present method for many of the examined functions.
Table 19.
Statistical results of different algorithms for the CEC-2019 problems.
| No | Statistics | Methods | |||||
|---|---|---|---|---|---|---|---|
| AVOA | EFO | GSA | GTO | FFA | FuFiO | ||
| F1 | Min | 1 | 1.0000 | 8.3415 | 1 | 345.00 | 1 |
| Mean | 1 | 56.719 | 3877.1 | 1 | 9118.7 | 1 | |
| Max | 1 | 1320.8 | 16,074.4 | 1 | 37,546.3 | 1 | |
| Std. Dev | 0 | 263.7365 | 4954.383 | 0 | 9680.685 | 0 | |
| Rank | 1 | 4 | 5 | 1 | 6 | 1 | |
| F2 | Min | 4.1582 | 136.50 | 146.73 | 4.3429 | 102.31 | 4.07647 |
| Mean | 4.4786 | 282.26 | 763.01 | 4.3015 | 318.49 | 4.2940 | |
| Max | 5.0000 | 479.01 | 1379.8 | 4.2323 | 539.96 | 4.5248 | |
| Std. Dev | 0.3368 | 90.761 | 358.24 | 0.2222 | 114.97 | 0.1079 | |
| Rank | 3 | 4 | 6 | 2 | 5 | 1 | |
| F3 | Min | 1.4091 | 1 | 1.4091 | 1.4091 | 1.0213 | 1 |
| Mean | 2.2820 | 1.3600 | 5.4944 | 1.3764 | 1.4650 | 1.3764 | |
| Max | 5.4761 | 1.4091 | 11.062 | 1.4091 | 2.0300 | 1.4091 | |
| Std. Dev | 1.2939 | 0.1356 | 3.3347 | 0.1132 | 0.23135 | 0.1132 | |
| Rank | 5 | 1 | 6 | 2 | 4 | 2 | |
| F4 | Min | 10.949 | 2.9899 | 13.934 | 29.853 | 2.0010 | 5.1018 |
| Mean | 25.917 | 6.3727 | 28.192 | 24.57 | 5.0354 | 10.478 | |
| Max | 55.722 | 13.934 | 40.798 | 10.949 | 7.9884 | 13.934 | |
| Std. Dev | 9.8415 | 2.4371 | 6.7920 | 11.344 | 1.5161 | 2.6720 | |
| Rank | 5 | 2 | 6 | 4 | 1 | 3 | |
| F5 | Min | 1.0443 | 1.0073 | 1 | 1.2019 | 1.0098 | 1.0098 |
| Mean | 1.3033 | 1.0308 | 1.0051 | 1.2848 | 1.0432 | 1.1575 | |
| Max | 2.1119 | 1.0787 | 1.0123 | 1.2263 | 1.1074 | 1.3149 | |
| Std. Dev | 0.2309 | 0.0176 | 0.0056 | 0.1598 | 0.0265 | 0.0781 | |
| Rank | 6 | 2 | 1 | 5 | 3 | 4 | |
| F6 | Min | 2.5555 | 1 | 1.0000 | 5.2358 | 1 | 1.5501 |
| Mean | 5.2067 | 1.0913 | 1.9335 | 4.2949 | 1.1720 | 2.3619 | |
| Max | 8.9700 | 2.5784 | 4.1527 | 3.1026 | 2.0007 | 2.9909 | |
| Std. Dev | 1.7852 | 0.3270 | 1.1032 | 1.563 | 0.2715 | 0.3842 | |
| Rank | 6 | 1 | 3 | 5 | 2 | 4 | |
| F7 | Min | 456.5332 | 1.0624 | 652.48 | 629.81 | 4.6023 | 1.4371 |
| Mean | 757.44 | 129.58 | 1177.514 | 730.64 | 133.6176 | 214.4899 | |
| Max | 1177.4 | 360.58 | 1741.3 | 630.92 | 432.81 | 368.39 | |
| Std. Dev | 160.64 | 120.70 | 233.21 | 271.69 | 114.88 | 97.056 | |
| Rank | 5 | 1 | 6 | 4 | 2 | 3 | |
| F8 | Min | 2.6710 | 1.2071 | 4.2678 | 3.4973 | 1.1316 | 2.1755 |
| Mean | 3.5125 | 1.9530 | 5.1443 | 3.6896 | 1.8749 | 2.9748 | |
| Max | 4.1638 | 3.9034 | 5.4618 | 3.1992 | 3.0803 | 3.2865 | |
| Std. Dev | 0.4250 | 0.7031 | 0.2736 | 0.4179 | 0.5817 | 0.3140 | |
| Rank | 4 | 2 | 6 | 5 | 1 | 3 | |
| F9 | Min | 1.0977 | 1.0403 | 1.0225 | 1.1049 | 1.0410 | 1.0760 |
| Mean | 1.2612 | 1.0754 | 1.0326 | 1.1378 | 1.0693 | 1.1797 | |
| Max | 1.5168 | 1.122754 | 1.0457 | 1.1782 | 1.1296 | 1.2576 | |
| Std. Dev | 0.1051 | 0.01727 | 0.0057 | 0.0481 | 0.0176 | 0.0524 | |
| Rank | 6 | 3 | 1 | 4 | 2 | 5 | |
| F10 | Min | 20.988 | 1 | 1.0000 | 21.130 | 1.0000 | 3.3168 |
| Mean | 21.018 | 11.564 | 5.7999 | 19.654 | 16.431 | 18.254 | |
| Max | 21.240 | 21.303 | 21.000 | 21.125 | 21.311 | 21.000 | |
| Std. Dev | 0.0545 | 10.267 | 8.7176 | 4.9808 | 8.3136 | 6.4201 | |
| Rank | 6 | 2 | 1 | 5 | 3 | 4 | |
|
Total Rank Based on: |
Min | 4.1 | 2.2 | 4 | 5 | 2.95 | 2.75 |
| Mean | 4.8 | 2.2 | 4.1 | 3.9 | 2.9 | 3.1 | |
| Max | 4.8 | 2.85 | 4.2 | 2.8 | 3.3 | 3.05 | |
| Std. Dev | 4.2 | 3.4 | 3.8 | 3.7 | 3.4 | 2.5 | |
| Total | 4.475 | 2.6625 | 4.025 | 3.85 | 3.1375 | 2.85 | |
Figure 16.
ANOVA test results for the CEC-2019 functions.
Conclusions and future work
Inspired by the concept of nuclei stability in physics, we developed a swarm-based intelligence metaheuristic method, called Fusion Fission Optimization (FuFiO), to deal with various optimization problems. In this method, three nuclear reactions including fusion, fission, and -decay are modeled to simulate the tendency to change a stable nuclei.
The effectiveness of the FuFiO algorithm in solving optimization problems with better results can be related to its mechanism for creating the right balance between exploration and exploitation. Also, in the FuFiO method, three different reactions are proposed for each group with novel formulations. The search procedure of each reaction in each group can be interpreted as follows:
Fusion: Through this reaction, a nucleus in the stable group slams with another stable nucleus and exploits the search space. On the other hand, this operator explores the search space in the unstable group because the unstable nuclei slam with each other.
Fission: Through this reaction, in the first group, a stable nucleus slams with an unstable one that explores the search space around the stable nucleus. On the other hand, in the second group, the fission operator guides the unstable nuclei toward the stable region to exploit it.
-decay: According to these operators, a stable nucleus slams with a randomly-generated nucleus, which results in exploration. However, in the second group, -decay generates the new solution by a uniform crossover between the unstable nucleus and a stable one to transfer some stable features to the unstable nucleus.
The right balance between exploration and exploitation is guaranteed by randomness in selecting the reactions in each group algorithm.
To examine the performance of FuFiO in comparison with seven well-known optimizers, an extensive set of 120 benchmark problems were considered, where the obtained results were used as the inputs of several non-parametric statistical methods. The results of statistical analysis showed that the FuFiO algorithm has a superior performance in solving all considered types of problems. To further investigate the ability of FuFiO in solving complex optimization problems, the CEC 2017 and CEC 2019 was utilized. The results showed that the FuFiO algorithm can perform competitively when compared to the state-of-the-art algorithms.
Despite the good performance of FuFiO in solving different well-studied mathematical problems, this method, like other metaheuristics, may have some limitations for solving difficult constrained or engineering problems. The main reason is the influence of the utilized constraint-handling approach on the performance of the proposed method. In addition, for more complex problems where each function evaluation needs a considerable amount of time, applying this method may need further investigations. Importantly, not the advantages of the new method, but its limitations open up a new avenue to improve or adapt it for applications in other fields.
Future studies concerning the FuFiO algorithm can be classified into two main categories. The first category contains investigations in which FuFiO is utilized as an optimization solver in dealing with complex real-world optimization problems. The second category concerns modifying the FuFiO algorithm to enhance its computational accuracy and efficiency. To this end, various kinds of modification can be designed, some of which are as follows:
The proposed algorithm has two parameters, namely and . The value of is determined according to the natural ratio of stable nuclei, whereas the value of is decided empirically. These parameters and their effects should be studied more thoroughly.
In this paper, as the first version of the algorithm, the value of is determined through a deterministic procedure. A more advanced approach could be developed to define the size of stable nuclei.
For updating the position of nuclei, in each group, three different reactions are modeled. In order to enhance the performance of the algorithm, developing new formulations for reactions could be advantageous.
In each reaction, another stable or unstable nucleus, , is selected randomly. Using a more thoughtful, systematic selection method could improve the performance of the algorithm.
During the updating process, a reaction is randomly selected without any specific rule. Developing a deterministic, adaptive, or self-adaptive approach to choosing an appropriate reaction could improve the algorithm.
In addition to the abovementioned approaches, one may use alternative strategies to improving the FuFiO algorithm. For example, as a conventional approach, the hybridization of the proposed algorithm with other popular metaheuristic algorithms could lead to the development of more robust optimization algorithms.
Author contributions
All authors contributed to the analysis and discussion of the results and to the writing and reviewing of the manuscript.
Data availability
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Competing interests
The authors declare no competing interests.
Footnotes
The original online version of this Article was revised: The original version of this Article contained an error in the spelling of the author Nima Darabi which was incorrectly given as Nima Darabai, and errors in two Equations and Figure 13.
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Change history
9/2/2022
A Correction to this paper has been published: 10.1038/s41598-022-18952-9
References
- 1.Wu G, Pedrycz W, Suganthan PN, Mallipeddi R. A variable reduction strategy for evolutionary algorithms handling equality constraints. Appl. Soft Comput. J. 2015;37:774–786. doi: 10.1016/j.asoc.2015.09.007. [DOI] [Google Scholar]
- 2.Fogel LJ, Owens AJ, Walsh MJ. Intelligent decision making through a simulation of evolution. Behav. Sci. 1966;11:253–272. doi: 10.1002/bs.3830110403. [DOI] [PubMed] [Google Scholar]
- 3.Simpson AR, Dandy GC, Murphy LJ. Genetic algorithms compared to other techniques for pipe optimization. J. Water Resour. Plan. Manag. 1994;120:423–443. doi: 10.1061/(asce)0733-9496(1994)120:4(423). [DOI] [Google Scholar]
- 4.Spall JC. Introduction to Stochastic Search and Optimization. Hoboken: Wiley; 2003. [Google Scholar]
- 5.Boussaïd, I., Lepagnot, J. & Siarry, P. A survey on optimization metaheuristics. In: Information Sciences (Elsevier, 2013) pp. 82–117. 10.1016/j.ins.2013.02.041.
- 6.Biswas A, Mishra KK, Tiwari S, Misra AK. Physics-inspired optimization algorithms: A survey. J. Optim. 2013;2013:1–16. doi: 10.1155/2013/438152. [DOI] [Google Scholar]
- 7.Gogna A, Tayal A. Metaheuristics: Review and application. J. Exp. Theor. Artif. Intell. 2013;25:503–526. doi: 10.1080/0952813X.2013.782347. [DOI] [Google Scholar]
- 8.AbWahab MN, Nefti-Meziani S, Atyabi A. A comprehensive review of swarm optimization algorithms. PLoS ONE. 2015;10:e0122827. doi: 10.1371/journal.pone.0122827. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Kirkpatrick S, Gelatt CD, Vecchi MP. Optimization by simulated annealing. Science. 1983;220:671–680. doi: 10.1126/science.220.4598.671. [DOI] [PubMed] [Google Scholar]
- 10.Kennedy, J.& Eberhart, R. Particle swarm optimization. In: Proceedings of ICNN’95 - International Conference on Neural Networks (IEEE, 1995) pp. 1942–1948. 10.1109/ICNN.1995.488968.
- 11.Rechenberg, I. Evolutionsstrategien. In: 1978: pp. 83–114. 10.1007/978-3-642-81283-5_8.
- 12.Holland, J. H. Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence (1975). http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=8929. Accessed December 25, 2020.
- 13.Simon D. Biogeography-based optimization. IEEE Trans. Evol. Comput. 2008;12:702–713. doi: 10.1109/TEVC.2008.919004. [DOI] [Google Scholar]
- 14.Dorigo, M., Birattari, M. & Magazine, T.S.-I.C.I. Ant colony optimization: Artificial ants as a computational intelligence technique, (n.d.).
- 15.Karaboga, D. & Basturk, B. Artificial Bee Colony (ABC) optimization algorithm for solving constrained optimization problems. In: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2007: pp. 789–798. 10.1007/978-3-540-72950-1_77.
- 16.Yang XS. Firefly algorithm, stochastic test functions and design optimization. Int. J. Bio-Inspired Comput. 2010;2:78–84. doi: 10.1504/IJBIC.2010.032124. [DOI] [Google Scholar]
- 17.Yang X-S, Deb S. Engineering optimisation by cuckoo search. Int. J. Math. Model. Numer. Optim. 2010;1:330–343. [Google Scholar]
- 18.Yang XS. A new metaheuristic Bat-inspired Algorithm. Stud. Comput. Intell. 2010;284:65–74. doi: 10.1007/978-3-642-12538-6_6. [DOI] [Google Scholar]
- 19.Yang XS, Deb S. Eagle strategy using Lévy walk and firefly algorithms for stochastic optimization. Stud. Comput. Intell. 2010;284:101–111. doi: 10.1007/978-3-642-12538-6_9. [DOI] [Google Scholar]
- 20.Gandomi AH, Alavi AH. Krill herd: A new bio-inspired optimization algorithm. Commun. Nonlinear Sci. Numer. Simul. 2012;17:4831–4845. doi: 10.1016/j.cnsns.2012.05.010. [DOI] [Google Scholar]
- 21.Yang, X. S. Flower pollination algorithm for global optimization. In: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2012: pp. 240–249. 10.1007/978-3-642-32894-7_27.
- 22.Mirjalili S, Mirjalili SM, Lewis A. Grey Wolf optimizer. Adv. Eng. Softw. 2014;69:46–61. doi: 10.1016/j.advengsoft.2013.12.007. [DOI] [Google Scholar]
- 23.Mirjalili S. The ant lion optimizer. Adv. Eng. Softw. 2015;83:80–98. doi: 10.1016/j.advengsoft.2015.01.010. [DOI] [Google Scholar]
- 24.Saremi S, Mirjalili S, Lewis A. Grasshopper optimisation algorithm: Theory and application. Adv. Eng. Softw. 2017;105:30–47. doi: 10.1016/j.advengsoft.2017.01.004. [DOI] [Google Scholar]
- 25.Cheng MY, Prayogo D. Symbiotic organisms search: A new metaheuristic optimization algorithm. Comput. Struct. 2014;139:98–112. doi: 10.1016/j.compstruc.2014.03.007. [DOI] [Google Scholar]
- 26.Goldanloo MJ, Gharehchopogh FS. A hybrid OBL-based firefly algorithm with symbiotic organisms search algorithm for solving continuous optimization problems. J. Supercomput. 2021;78:3998–4031. doi: 10.1007/s11227-021-04015-9. [DOI] [Google Scholar]
- 27.Mirjalili S. Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm. Knowl. Based Syst. 2015;89:228–249. doi: 10.1016/j.knosys.2015.07.006. [DOI] [Google Scholar]
- 28.Mirjalili S. Dragonfly algorithm: A new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problems. Neural Comput. Appl. 2016;27:1053–1073. doi: 10.1007/s00521-015-1920-1. [DOI] [Google Scholar]
- 29.Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris H, Mirjalili SM. Salp Swarm Algorithm: A bio-inspired optimizer for engineering design problems. Adv. Eng. Softw. 2017;114:163–191. doi: 10.1016/j.advengsoft.2017.07.002. [DOI] [Google Scholar]
- 30.Askarzadeh A. A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm. Comput. Struct. 2016;169:1–12. doi: 10.1016/j.compstruc.2016.03.001. [DOI] [Google Scholar]
- 31.Mirjalili S, Lewis A. The whale optimization algorithm. Adv. Eng. Softw. 2016;95:51–67. doi: 10.1016/j.advengsoft.2016.01.008. [DOI] [Google Scholar]
- 32.Asghari K, Masdari M, Gharehchopogh FS, Saneifard R. Multi-swarm and chaotic whale-particle swarm optimization algorithm with a selection method based on roulette wheel. Expert Syst. 2021 doi: 10.1111/exsy.12779. [DOI] [Google Scholar]
- 33.Sheikholeslami R, Talatahari S. Developed swarm optimizer: A new method for sizing optimization of water distribution systems. J. Comput. Civ. Eng. 2016;30:04016005. doi: 10.1061/(asce)cp.1943-5487.0000552. [DOI] [Google Scholar]
- 34.Dhiman G, Kumar V. Spotted hyena optimizer: A novel bio-inspired based metaheuristic technique for engineering applications. Adv. Eng. Softw. 2017;114:48–70. doi: 10.1016/j.advengsoft.2017.05.014. [DOI] [Google Scholar]
- 35.Shayanfar H, Gharehchopogh FS. Farmland fertility: A new metaheuristic algorithm for solving continuous optimization problems. Appl. Soft Comput. 2018;71:728–746. doi: 10.1016/j.asoc.2018.07.033. [DOI] [Google Scholar]
- 36.Gharehchopogh FS, Farnad B, Alizadeh A. A modified farmland fertility algorithm for solving constrained engineering problems. Concurr. Comput. Pract. Exp. 2021 doi: 10.1002/cpe.6310. [DOI] [Google Scholar]
- 37.Abdollahzadeh B, Gharehchopogh FS, Mirjalili S. African vultures optimization algorithm: A new nature-inspired metaheuristic algorithm for global optimization problems. Comput. Ind. Eng. 2021;158:107408. doi: 10.1016/j.cie.2021.107408. [DOI] [Google Scholar]
- 38.Alsattar HA, Zaidan AA, Zaidan BB. Novel meta-heuristic bald eagle search optimisation algorithm. Artif. Intell. Rev. 2019;53:2237–2264. doi: 10.1007/s10462-019-09732-5. [DOI] [Google Scholar]
- 39.Gharehchopogh FS, Rostampnah B. A New model-based bald eagle search algorithm with sine cosine algorithm for data clustering. J. Adv. Comput. Eng. Technol. 2021;7(3):177–186. [Google Scholar]
- 40.Kiran MS. TSA: Tree-seed algorithm for continuous optimization. Expert Syst. Appl. 2015;42:6686–6698. doi: 10.1016/j.eswa.2015.04.055. [DOI] [Google Scholar]
- 41.Sahman MA, Cinar AC, Saritas I, Yasar A. Tree-seed algorithm in solving real-life optimization problems. IOP Conf. Ser. Mater. Sci. Eng. 2019;675:012030. doi: 10.1088/1757-899x/675/1/012030. [DOI] [Google Scholar]
- 42.Abdollahzadeh B, Gharehchopogh FS, Mirjalili S. Artificial gorilla troops optimizer: A new nature-inspired metaheuristic algorithm for global optimization problems. Int. J. Intell. Syst. 2021;36:5887–5958. doi: 10.1002/int.22535. [DOI] [Google Scholar]
- 43.Erol OK, Eksin I. A new optimization method: Big Bang-Big Crunch. Adv. Eng. Softw. 2006;37:106–111. doi: 10.1016/j.advengsoft.2005.04.005. [DOI] [Google Scholar]
- 44.Kaveh A, Talatahari S. A novel heuristic optimization method: Charged system search. Acta Mech. 2010;213:267–289. doi: 10.1007/s00707-009-0270-4. [DOI] [Google Scholar]
- 45.Yazdchi M, ForoughiAsl A, Talatahari S, Sareh P. Metaheuristically optimized nano-MgO additive in freeze–thaw resistant concrete: A charged system search-based approach. Eng. Res. Express. 2021;3:035001. doi: 10.1088/2631-8695/ac0dca. [DOI] [Google Scholar]
- 46.Talatahari S, Azizi M. Chaos Game Optimization: A Novel Metaheuristic Algorithm. Dordrecht: Springer; 2020. [Google Scholar]
- 47.Talatahari S, Azizi M. Optimization of constrained mathematical and engineering design problems using chaos game optimization. Comput. Ind. Eng. 2020;145:106560. doi: 10.1016/j.cie.2020.106560. [DOI] [Google Scholar]
- 48.Rashedi E, Nezamabadi-pour H, Saryazdi S. GSA: A gravitational search algorithm. Inf. Sci. 2009;179:2232–2248. doi: 10.1016/j.ins.2009.03.004. [DOI] [Google Scholar]
- 49.Mirjalili S. SCA: A Sine Cosine Algorithm for solving optimization problems. Knowl. Based Syst. 2016;96:120–133. doi: 10.1016/j.knosys.2015.12.022. [DOI] [Google Scholar]
- 50.Mirjalili S, Mirjalili SM, Hatamlou A. Multi-verse optimizer: A nature-inspired algorithm for global optimization. Neural Comput. Appl. 2016;27:495–513. doi: 10.1007/s00521-015-1870-7. [DOI] [Google Scholar]
- 51.Zhao W, Wang L, Zhang Z. Atom search optimization and its application to solve a hydrogeologic parameter estimation problem. Knowl. Based Syst. 2019;163:283–304. doi: 10.1016/j.knosys.2018.08.030. [DOI] [Google Scholar]
- 52.Talatahari S, Azizi M, Tolouei M, Talatahari B, Sareh P. Crystal structure algorithm (CryStAl): A metaheuristic optimization method. IEEE Access. 2021;9:71244–71261. doi: 10.1109/ACCESS.2021.3079161. [DOI] [Google Scholar]
- 53.Khodadadi N, Azizi M, Talatahari S, Sareh P. Multi-objective crystal structure algorithm (MOCryStAl): Introduction and performance evaluation. IEEE Access. 2021;9:117795–117812. doi: 10.1109/ACCESS.2021.3106487. [DOI] [Google Scholar]
- 54.Azizi M, Talatahari S, Sareh P. Design optimization of fuzzy controllers in building structures using the crystal structure algorithm (CryStAl) Adv. Eng. Inform. 2022;52:101616. doi: 10.1016/j.aei.2022.101616. [DOI] [Google Scholar]
- 55.Talatahari B, Azizi M, Talatahari S, Tolouei M, Sareh P. Crystal structure optimization approach to problem solving in mechanical engineering design. Multidiscip. Model. Mater. Struct. 2022;18:1–23. doi: 10.1108/MMMS-10-2021-0174. [DOI] [Google Scholar]
- 56.H. Abedinpourshotorban, S. M. Shamsuddin, Z. Beheshti, D. N. A. Jawawi, Electromagnetic field optimization: A physics-inspired metaheuristic optimization algorithm. 26 (2016) 8–22. 10.1016/j.swevo.2015.07.002
- 57.Atashpaz-Gargari E, Lucas C. Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition. IEEE Congr. Evol. Comput. 2007;2007:4661–4667. doi: 10.1109/CEC.2007.4425083. [DOI] [Google Scholar]
- 58.Rao RV, Savsani VJ, Vakharia DP. Teaching–learning-based optimization: A novel method for constrained mechanical design optimization problems. CAD Comput. Aided Des. 2011;43:303–315. doi: 10.1016/j.cad.2010.12.015. [DOI] [Google Scholar]
- 59.Gandomi AH. Interior search algorithm (ISA): A novel approach for global optimization. ISA Trans. 2014;53:1168–1183. doi: 10.1016/j.isatra.2014.03.018. [DOI] [PubMed] [Google Scholar]
- 60.Kaveh A, Talatahari S, Khodadadi N. Stochastic Paint Optimizer: Theory and Application in Civil Engineering. London: Springer; 2020. [Google Scholar]
- 61.Bajpai P, Kumar M. Genetic algorithm: An approach to solve global optimization problems. Indian J. Comput. Sci. Eng. 2010;1(3):199–206. [Google Scholar]
- 62.Deng W, Shang S, Cai X, Zhao H, Song Y, Xu J. An improved differential evolution algorithm and its application in optimization problem. Soft. Comput. 2021;25:5277–5298. doi: 10.1007/s00500-020-05527-x. [DOI] [Google Scholar]
- 63.Guo W, Chen M, Wang L, Mao Y, Wu Q. A survey of biogeography-based optimization. Neural Comput. Appl. 2016;28:1909–1926. doi: 10.1007/s00521-016-2179-x. [DOI] [Google Scholar]
- 64.Yazdani, D. & Meybodi, M. R. A novel Artificial Bee Colony algorithm for global optimization. In: 2014 4th International Conference on Computer and Knowledge Engineering (ICCKE). (2014) 10.1109/iccke.2014.6993393
- 65.Dorigo, M. & Stützle, T. Ant colony optimization: Overview and recent advances. In: International Series in Operations Research and Management Science. (2018) 311–351. 10.1007/978-3-319-91086-4_10.
- 66.Xia X, Gui L, Yu F, Wu H, Wei B, Zhang Y-L, Zhan Z-H. Triple archives particle swarm optimization. IEEE Trans. Cybern. 2020;50:4862–4875. doi: 10.1109/tcyb.2019.2943928. [DOI] [PubMed] [Google Scholar]
- 67.Li J, Wei X, Li B, Zeng Z. A survey on firefly algorithms. Neurocomputing. 2022;500:662–678. doi: 10.1016/j.neucom.2022.05.100. [DOI] [Google Scholar]
- 68.Salgotra R, Singh U, Saha S. New cuckoo search algorithms with enhanced exploration and exploitation properties. Expert Syst. Appl. 2018;95:384–420. doi: 10.1016/j.eswa.2017.11.044. [DOI] [Google Scholar]
- 69.Wang Y, Wang P, Zhang J, Cui Z, Cai X, Zhang W, Chen J. A novel bat algorithm with multiple strategies coupling for numerical optimization. Mathematics. 2019;7:135. doi: 10.3390/math7020135. [DOI] [Google Scholar]
- 70.Bolaji AL, Al-Betar MA, Awadallah MA, Khader AT, Abualigah LM. A comprehensive review: Krill Herd algorithm (KH) and its applications. Appl. Soft Comput. 2016;49:437–446. doi: 10.1016/j.asoc.2016.08.041. [DOI] [Google Scholar]
- 71.Yang X-S, Karamanoglu M, He X. Flower pollination algorithm: A novel approach for multiobjective optimization. Eng. Optim. 2013;46:1222–1237. doi: 10.1080/0305215x.2013.832237. [DOI] [Google Scholar]
- 72.Hatta NM, Zain AM, Sallehuddin R, Shayfull Z, Yusoff Y. Recent studies on optimisation method of Grey Wolf Optimiser (GWO): A review (2014–2017) Artif. Intell. Rev. 2018;52:2651–2683. doi: 10.1007/s10462-018-9634-2. [DOI] [Google Scholar]
- 73.Abualigah L, Shehab M, Alshinwan M, Mirjalili S, Elaziz MA. Ant lion optimizer: A comprehensive survey of its variants and applications. Arch. Comput. Methods Eng. 2020;28:1397–1416. doi: 10.1007/s11831-020-09420-6. [DOI] [Google Scholar]
- 74.Abualigah L, Diabat A. A comprehensive survey of the Grasshopper optimization algorithm: Results, variants, and applications. Neural Comput. Appl. 2020;32:15533–15556. doi: 10.1007/s00521-020-04789-8. [DOI] [Google Scholar]
- 75.Gharehchopogh FS, Shayanfar H, Gholizadeh H. A comprehensive survey on symbiotic organisms search algorithms. Artif. Intell. Rev. 2019;53:2265–2312. doi: 10.1007/s10462-019-09733-4. [DOI] [Google Scholar]
- 76.Shehab M, Abualigah L, Al Hamad H, Alabool H, Alshinwan M, Khasawneh AM. Moth–flame optimization algorithm: Variants and applications. Neural Comput. Appl. 2019;32:9859–9884. doi: 10.1007/s00521-019-04570-6. [DOI] [Google Scholar]
- 77.Alshinwan M, Abualigah L, Shehab M, Elaziz MA, Khasawneh AM, Alabool H, Hamad HA. Dragonfly algorithm: A comprehensive survey of its results, variants, and applications. Multimed. Tools Appl. 2021;80:14979–15016. doi: 10.1007/s11042-020-10255-3. [DOI] [Google Scholar]
- 78.Abualigah L, Shehab M, Alshinwan M, Alabool H. Salp swarm algorithm: a comprehensive survey. Neural Comput. Appl. 2019;32:11195–11215. doi: 10.1007/s00521-019-04629-4. [DOI] [Google Scholar]
- 79.Hussien AG, Amin M, Wang M, Liang G, Alsanad A, Gumaei A, Chen H. Crow search algorithm: Theory, recent advances, and applications. IEEE Access. 2020;8:173548–173565. doi: 10.1109/access.2020.3024108. [DOI] [Google Scholar]
- 80.Gharehchopogh FS, Gholizadeh H. A comprehensive survey: Whale optimization algorithm and its applications. Swarm Evol. Comput. 2019;8:1–24. doi: 10.1016/j.swevo.2019.03.004. [DOI] [Google Scholar]
- 81.Ghafori S, Gharehchopogh FS. Advances in spotted hyena optimizer: A comprehensive survey. Arch. Comput. Methods Eng. 2021;29:1569–1590. doi: 10.1007/s11831-021-09624-4. [DOI] [Google Scholar]
- 82.Kiran MS, Hakli H. A tree–seed algorithm based on intelligent search mechanisms for continuous optimization. Appl. Soft Comput. 2021;98:106938. doi: 10.1016/j.asoc.2020.106938. [DOI] [Google Scholar]
- 83.Guilmeau, T., Chouzenoux, E. & Elvira, V. Simulated annealing: A review and a new scheme. In 2021 IEEE Statistical Signal Processing Workshop (SSP). (2021). 10.1109/ssp49050.2021.9513782.
- 84.Tang H, Zhou J, Xue S, Xie L. Big ban–big crunch optimization for parameter estimation in structural systems. Mech. Syst. Signal Process. 2010;24:2888–2897. doi: 10.1016/j.ymssp.2010.03.012. [DOI] [Google Scholar]
- 85.Talatahari, S. & Azizi, M. An extensive review of charged system search algorithm for engineering optimization applications. In Springer Tracts in Nature-Inspired Computing. (2021) 309–334. 10.1007/978-981-33-6773-9_14.
- 86.Mittal H, Tripathi A, Pandey AC, Pal R. Gravitational search algorithm: A comprehensive analysis of recent variants. Multimed. Tools Appl. 2020;80:7581–7608. doi: 10.1007/s11042-020-09831-4. [DOI] [Google Scholar]
- 87.Abualigah L, Diabat A. Advances in sine cosine algorithm: A comprehensive survey. Artif. Intell. Rev. 2021;54:2567–2608. doi: 10.1007/s10462-020-09909-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Abualigah L. Multi-verse optimizer algorithm: A comprehensive survey of its results, variants, and applications. Neural Comput. Appl. 2020;32:12381–12401. doi: 10.1007/s00521-020-04839-1. [DOI] [Google Scholar]
- 89.Cheng J, Xu P, Xiong Y. An improved artificial electric field algorithm and its application in neural network optimization. Comput. Electr. Eng. 2022;101:108111. doi: 10.1016/j.compeleceng.2022.108111. [DOI] [Google Scholar]
- 90.Hosseini S, AlKhaled A. A survey on the Imperialist Competitive Algorithm metaheuristic: Implementation in engineering domain and directions for future research. Appl. Soft Comput. 2014;24:1078–1094. doi: 10.1016/j.asoc.2014.08.024. [DOI] [Google Scholar]
- 91.Xue R, Wu Z. A survey of application and classification on teaching–learning-based optimization algorithm. IEEE Access. 2020;8:1062–1079. doi: 10.1109/access.2019.2960388. [DOI] [Google Scholar]
- 92.Kler D, Rana KPS, Kumar V. Parameter extraction of fuel cells using hybrid interior search algorithm. Int. J. Energy Res. 2019;43:2854–2880. doi: 10.1002/er.4424. [DOI] [Google Scholar]
- 93.Bethe HA, Morrison P. Elementary Nuclear Theory. Dover Publications; 2006. [Google Scholar]
- 94.Basdevant J-L, Rich J, Spiro M. Fundamentals in Nuclear Physics: From Nuclear Structure to Cosmology. Springer; 2005. [Google Scholar]
- 95.Wolpert DH, Macready WG. No free lunch theorems for optimization. IEEE Trans. Evol. Comput. 1997;1:67–82. doi: 10.1109/4235.585893. [DOI] [Google Scholar]
- 96.Jamil M, Yang XS. A literature survey of benchmark functions for global optimisation problems. Int. J. Math. Model. Numer. Optim. 2013;4:150–194. doi: 10.1504/IJMMNO.2013.055204. [DOI] [Google Scholar]
- 97.Jamil M, Yang XS, Zepernick HJD. Test functions for global optimization: A comprehensive survey. Swarm Intell. Bio-Inspired Comput. 2013 doi: 10.1016/B978-0-12-405163-8.00008-9. [DOI] [Google Scholar]
- 98.Scheff, S. W. Nonparametric statistics. In: Fundamental Statistical Principles for the Neurobiologist (Elsevier, 2016), pp. 157–182. 10.1016/B978-0-12-804753-8.00008-7.
- 99.Friedman M. The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J. Am. Stat. Assoc. 1937;32:675–701. doi: 10.1080/01621459.1937.10503522. [DOI] [Google Scholar]
- 100.García S, Fernández A, Luengo J, Herrera F. Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power. Inf. Sci. 2010;180:2044–2064. doi: 10.1016/j.ins.2009.12.010. [DOI] [Google Scholar]
- 101.Quade D. Using weighted rankings in the analysis of complete blocks with additive block effects. J. Am. Stat. Assoc. 1979;74:680–683. doi: 10.1080/01621459.1979.10481670. [DOI] [Google Scholar]
- 102.Derrac J, García S, Molina D, Herrera F. A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol. Comput. 2011;1:3–18. doi: 10.1016/j.swevo.2011.02.002. [DOI] [Google Scholar]
- 103.Kumar, A., Misra, R. K. & Singh, D. Improving the local search capability of effective butterfly optimizer using covariance matrix adapted retreat phase. In: 2017 IEEE Congress on Evolutionary Computation, CEC 2017—Proceedings (Institute of Electrical and Electronics Engineers Inc., 2017), pp. 1835–1842. 10.1109/CEC.2017.7969524.
- 104.Awad, N. H., Ali, M. Z. & Suganthan, P. N. Ensemble sinusoidal differential covariance matrix adaptation with Euclidean neighborhood for solving CEC2017 benchmark problems. In: 2017 IEEE Congress on Evolutionary Computation, CEC 2017—Proceedings (Institute of Electrical and Electronics Engineers Inc., 2017), pp. 372–379. 10.1109/CEC.2017.7969336.
- 105.Sallam, K. M., Elsayed, S. M., Sarker, R. A. & Essam, D. L. Multi-method based orthogonal experimental design algorithm for solving CEC2017 competition problems. In 2017 IEEE Congress on Evolutionary Computation, CEC 2017 - Proceedings. (2017) 1350–1357. 10.1109/CEC.2017.7969461.
- 106.Kommadath, R. & Kotecha, P. Teaching learning based optimization with focused learning and its performance on CEC2017 functions. In: 2017 IEEE Congress on Evolutionary Computation, CEC 2017—Proceedings (2017), pp. 2397–2403. 10.1109/CEC.2017.7969595.
- 107.Awad, N. H., Ali, M. Z., Suganthan, P. N., Liang, J. J. & Qu, B. Y. Problem definitions and evaluation criteria for the CEC 2017 special session and competition on single objective real-parameter numerical optimization (2017).
- 108.Price, K. V., Awad, N. H., Ali, M. Z. & Suganthan, P. N. The 100-digit challenge: problem definitions and evaluation criteria for the 100-digit challenge special session and competition on single objective numerical optimization (2019).
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.













