Skip to main content
PLOS One logoLink to PLOS One
. 2025 Jun 3;20(6):e0324198. doi: 10.1371/journal.pone.0324198

Comparative analysis of real-coded genetic algorithms for mixture distribution models: Insights from TOPSIS

Jalal- ud-Din 1,*, Ehtasham-ul- Haq 2, Mohammed M A Almazah 3, Mhassen E E Dalam 3, Ishfaq Ahmad 2
Editor: Yirui Wang4
PMCID: PMC12132986  PMID: 40460140

Abstract

This particular study presents two novel parent-centric real-coded crossover operators, named mixture-based Gumbel crossover (MGGX) and mixture-based Rayleigh crossover (MRRX), to increase the efficiency of genetic algorithms (GAs) in tackling complex optimization problems. Conventional crossover operators often struggle in multimodal and extremely restricted situations and fail to find the ideal balance between exploration and exploitation. Proposed parent-centric real-coded crossover operators increase the precision and robustness of GAs, which is confirmed by empirical results on testing constrained and un-constrained benchmark functions having different complexity levels. MGGX parent-centric real-coded crossover operator performs best in 20 out of 36 mean values cases and achieves the lowest standard deviation values in 21 out of 36 cases. Likewise, to confirm the efficiency, robustness, and reliability of the proposed crossover operator the Quade test, Performance index (PI), and multi-criteria TOPSIS method are utilized.

1 Introduction

1.1 Motivation and purpose

Optimized solutions are highly desirable across various domains of today’s rapidly evolving world. The fields of science, particularly computer science, engineering, management science, and applied mathematics are expanding rapidly. We face challenging optimization problems due to the complexity and modality of the problems [13]. Problems in science and engineering research are crucial nowadays because technology is changing the world quickly. Many of these problems are complex global optimization problems with high dimensions search spaces [4]. As the problem’s dimension increases, the search space expands exponentially, finding these problems challenging to solve [5]. Classical and gradient-based optimization methods struggle to handle modern complex problems due to the curse of dimensionality. Additionally, gradient-based searches are often ineffective when local optima exist, as they rely heavily on the choice of initial point [6].

Population-based stochastic methods including genetic algorithms (GA), simulated annealing (SA), particle swarm optimization (PSO), and feature selection techniques have been extensively used to overcome these limitations [7,8]. Heuristic and meta-heuristic approaches are crucial in multi-objective hybrid flow shop scheduling problems (HFSP) with machine capability limitations and constrained waiting times [9]. The problem’s complex nature is tackled by developing solution approaches based on GA [10]. Heuristic methods aim to efficiently approximate solutions with minimal computational efforts. The approximate techniques known as “meta-heuristics” are derived from various ideas in classical heuristics, neural systems, biological evolution, artificial intelligence, natural phenomena, and statistical mechanics [11]. Meta-heuristics inspired by nature are devised to address optimization issues that stem from various physical or biological phenomena. The values used by these algorithms are generated at random. The population can be optimized for iterations by adding the best individual value from the current generation to the next generation of individuals. They can manage several local optima simultaneously and effectively handle higher dimensional global optimization problems. These qualities have made these algorithms well-liked and widely utilized in solving global optimization problems. The researchers used all of these in developing optimization strategies that can address optimization issues in the real world. The two stages of the entire search process are called exploration and exploitation. As much random search as possible is preferred during the exploration stage, where the algorithm must explore the search space considering variables. The exploitation stage is determined by evaluating the possible areas discovered during exploration. The exploitation phase is connected to the local search process. Striking a balance between exploration and exploitation remains one of the primary challenges in optimization [12].

1.2 Literature review

Normally existing methods fail to strike a balance between exploration and exploitation, especially in multimodal optimization and high-dimensional problems, despite the development of crossover and mutation operators to enhance the efficiency of real-coded GAs [13]. Still, there is a lack of resilient, real-coded crossover operators that can maintain solution stability, avoid premature convergence, and frequently obtain ideal solutions across diverse optimization scenarios. Conventional operators such as double Pareto crossover (DPX), simulated binary crossover (SBX), and Laplace crossover (LX) struggle with population diversity, premature convergence, and adaptation to varying optimization landscapes [14]. To address these challenges, this study introduces two novel parent-centric real-coded crossover operators mixture-based Gumbel crossover and mixture-based Rayleigh crossover (MGGX and MRRX), designed to enhance the balance between exploration and exploitation dynamically. The gaps are filled by this study’s inclusion of two new real-coded crossover operators.

1.3 Contribution and paper organization

We suggest the mixture distribution-based MGGX and MRRX crossover operators to improve balancing between exploration and exploitation.

  • (i) Theoretically, these operators are developed to adapt dynamically, which reduces the risk of premature convergence while ensuring efficient exploration of complex search spaces. By leveraging the properties of mixture distributions and Gumbel distribution, they enable diverse yet high-quality offspring generation, improving GA robustness across different levels of benchmark functions.

  • (ii) By testing on constrained and unconstrained benchmark functions, we assessed proposed operators and examined that in most cases, the proposed operator especially MGGX outperforms conventional operators in terms of stability and efficiency, attaining the lowest mean and standard deviation. The inclusion of proposed operators within GA provides a practical approach to handling real-world optimization problems requiring strong consistent solutions. Both approaches PI and TOPSIS further validate MGGX’s robustness and scalability, making it an effective option for challenging, high-dimensional optimization tasks.

The remainder of this paper is organized as follows: Section 2 presents previously used operators. Section 3 introduces proposed mixture-based real-coded crossover operators. Section 4 details the benchmark functions. Section 5 discusses computational results, while Section 6 concludes the study with key finding and future research directions.

2 Previously used operators

For comparison, we considered the three real-coded crossover operators previously used in the literature. Laplace crossover operator (LX) was first proposed by Deep and Thakur [15].

It is a Laplace distribution-based crossover operator that is self-parent-centric. The double Pareto probability distribution, a parent-centric operator, is the foundation of DPX (Thakur, 2014). The procedure has three steps for generating two offspring, δ=(δ1,δ2,,δn) & ζ=(ζ1,ζ2,ζn) from parents w(1)=(w1(1),w2(1),w3(1),,wn(1)) and w(2)=(w1(2),w2(2),w3(2),,wn(2)). In the first step, it begins the procedure by generating a random number (ri) uniformly distributed between zero and one. After a random number is generated in the second step, we calculate βi by simply inverting the Laplace cumulative distribution function in LX and the double Pareto cumulative distribution function in DPX. In the end, offspring are generated with the help of βi:

δi=(wi{1}+wi{2})+βi|wi{1}wi{2}|2 (1)

and

ζi=(wi{1}+wi{2})βi|wi{1}wi{2}|2 (2)

Real-coded crossover operator SBX has a special feature with binary transformation to continuous search space, it was first proposed by Deb and Agarwal [16]. Important steps are adopted for generating following offspring, i.e., δ=(δ1,δ2,,δn) by parents w(1)=(w1(1),w2(1),w3(1),,wn(1)) & w(2)=(w1(2),w2(2),w3(2),,wn(2)) are these:

  • (a)  Starting with a uniform distribution, generate a random number ri between zero and one.

  • (b)  In this important step we obtain a parameter βi from mathematical expression.

Thus, from two parents w(1)& w(2) and an offspring δ=(δ1,δ2,,δn is produced in the Equation 3:

δi=12((wi{1}+wi{2})βi|wi{1}wi{2}|) (3)

2.1 Mutation operators

Population diversity decreases the chance of premature convergence [17,18]. In literature, several mutation operators are used in GA to increase population diversity. In this study, we used three popular mutation operators. Non-uniform mutation (NUM) is one of the most popular mutation operators, and its working mechanism was introduced by Michalewicz et al. [19]. Makinen et al. proposed the Makinen, Periaux, and Toivanen Mutation (MPTM) [20]. MPTM is mostly used in literature to solve multidisciplinary optimization problems. We also used the third mutation operator named power mutation (PM) proposed by Deep and Thakur [21], which is based on power distribution. In GA the mutation operator helps in searching new search spaces and solving complex optimization problems.

3 Proposed mixture-based real-coded crossover operators

Several areas of science and engineering directly employ finite mixture models. Indirect applications of mixture models consist of the empirical Bayes method, cluster analysis, latent structure models, modeling of prior densities, and nonparametric (kernel) density estimation [22]. Here in this particular section, we present two real-coded crossover operators (named MGGX and MRRX). The idea is used to generate real-coded crossover operators based on the mixture of Gumbel distribution (MGGX) and then a mixture of Raleigh distribution (MRRX).

3.1 Proposed mixture Gumbel distribution-based real-coded crossover operator

A wide range of scientific disciplines, including geology, insurance, meteorology, hydrology, and finance, have used the Gumbel distribution and its extensions. It is commonly known that the tails of this distribution are heavier than those of the normal distribution. Since the Gumbel distribution has heavy tails, it can be used to model extreme happenings. In a dataset, it captures the likelihood of rare and extreme values. In extreme value theory, the Gumbel distribution is frequently utilized, particularly when modeling the distribution of maxima or minima in a sample [23]. The probability density function (pdf) of the Gumbel distribution is as follows:

f(p)=1ηe[pμηe(pμη)] (4)

where the cumulative distribution function (cdf) of Gumbel is as shown in equation 5 and μ denotes the location parameter and the scale parameter is denoted by η:

F(p;μ,η)=ee(pμη) (5)

Pdf and cdf for the proposed two-component mixture probability model using Gumbel distribution can be written as follows:

f(p)=γ1f(p1)+γ2f(p2) (6)

where γ1>0, γ2<1 and γ1+γ2=1

f(p)=γ11/(η1)e[p1μ1η1e(p1μ1η1)]+γ21/(η2)e[p2μ2η2e(p2μ2η2)] (7)
F(p)=γ1F(p1)+γ2F(p2) (8)
F(p)=γ1ee(p1μ1η1)+γ2ee(p2μ2η2) (9)

The cumulative function of the proposed two-component mixture distribution as elaborated in equation 9, has scale parameters as represented by η1 and η2, and the location parameters as μ1 and μ2. Using a planned procedure, we get two offspring (o1(1),o2(1),,on(1)) and (o1(2),o2(2),,on(2)) from two-parent p(1)=(p1(1),p2(1),,pn(1) and p(2)=(p1(2),p2(2),,pn(2) by employing mixture-based crossover. The three steps procedure is as follows:

  • i) By utilizing a uniform distribution we generate a random number denoted by ui.

  • ii) The parametric value, shown as βp is then obtained by inverting cdf and generating random numbers from a mixture probability distribution:

βp={γ1[μ1η1log{logui}]+γ2[μ2η2log{logui}],ui0.5γ1[μ1η1log{log(1ui)}]+γ2[μ2η2log{log(1ui)}],ui>0.5 (10)

iii) In the end, two offspring are generated:

oi(1)=(pi(1)+pi(2))+βp|pi(1)pi(2)|2 (11)
oi(2)=(pi(1)+pi(2))βp|pi(1)pi(2)|2 (12)

where i=1,2,,n and variable bounds are oi<oil or oi<oiui, offspring are assigned randomly generated values in the interval {oil,oiui} if they fall outside of these limitations.

3.2 Proposed mixture Rayleigh distribution-based real-coded crossover operator

The Rayleigh distribution is a positively skewed continuous distribution, is also used in wireless communications and signal processing due to its ability to model the magnitude of two-dimensional vectors with independent identical normal components. This distribution was first introduced by Lord Rayleigh [24]. In GA, its adaptive step-size mechanism enhances exploration in the early stages and refines exploitation later, which reduces the chances of pre-mature convergence. This property makes it suitable for high-dimensional and multimodal optimization problems. In equation 13 pdf and in equation 14 cdf of Rayleigh distribution are expressed.

f(g)=gσ2eg22σ2 (13)
F(g)=1eg22σ2 (14)

where sigma denotes the scale parameter.

The cdf of the two-component mixture probability model for Rayleigh distribution is as follows:

F(g)=φ1F(g1)+φ2F(g2) (15)

where φ1>0, φ2<1 and φ1+φ2=1

F(g)=φ1φ1eg122σ12+φ2φ2eg222σ22 (16)

A stepwise process is used to obtain two offspring that are (τ1(1),τ2(1),,τn(1)) and (τ1(2),τ2(2),,τn(2)) from two parents g(1)=(g1(1),g2(1),,gn(1) and g(2)=(g1(2),g2(2),,gn(2)by using two-component mixture distribution crossover. Where the three-step process is as follows:

  • a) The uniform distribution is used to generate a random number vi.

  • b) To obtain βg in the second step, the cumulative density function of the Rayleigh distribution is inverted to generate a random number from the two-component mixture distribution.

βg={φ1[σ1[2log{1vi}]12]+φ2[σ2[2log{1vi}]12],vi0.5φ1[σ1[2log{vi}]12]+φ2[σ2[2log{vi}]12],vi>0.5 (17)
  • c) The last step is the generation of two offspring for i=1,2,,n:

τi(1)=(gi(1)+gi(2))+βg|gi(1)gi(2)|2 (18)
τi(2)=(gi(1)+gi(2))βg|gi(1)gi(2)|2 (19)
  • where variable boundaries are τi<τil or τi<τivi, if offspring are outside these limits then randomly generated values vi are assigned to offspring τi in an interval {τil,τivi}.

4 Benchmark functions

Different types of optimization problems exist, varying in complexity and compatibility. Since there are no set criteria for choosing benchmark functions, there are many different kinds of benchmark functions with distinct characteristics in the literature. For this specific simulated-based study, we choose a set of twelve benchmark functions with various levels of compatibility and complexity. By using the proposed real-coded probabilistic-based algorithms on a set of twelve benchmark functions, we compare their effectiveness with current algorithms. These benchmark functions are extensively employed in numerous comparative analyses to verify the efficacy of algorithms the detail is given in Table 1. We take the first six unconstrained and the remaining six benchmark functions are constrained test problems from CEC 2017.

Table 1. Detail of benchmark functions comparison.

Sr. # Test problem Objective function Limits
1 Levy and Montalvo-2 function minxf(x)=0.1(sin2(3πx1)+i=1n1(xi1)2[1+sin2(3πxi+1)]+(xn1)2[1+sin2(2πxn)]) {-5, 5}
2 Neumair function minxf(x)=in(xi1)2+i=1n1xixi1 {-n2, n2}
3 Griewank function minxf(x)=1+14000i=1nxi2i=1ncos(xii) {-10, 10}
4 Brown3 function minxf(x)=i=1n1[(xi2hat(xi2+1)+(xi+12)(xi+12+1)] {-1, 4}
5 Ellipsoidal function minxf(x)=i=1n(xii)2 {-n, n}
6 Cigar function minxf(x)=x12+10000000i=2nxi2 {-10, 10}
7 C-01 Minf(x)=i=1D(j=1izj)2, z=x-0
g(x=i=1D{zi25000cos(0.1πzi)4000}0
x∊{−100,100}D
8 C-02 Minf(x)=i=1D(j=1izj)2, z = x − 0, y = M * z
g(x=i=1D{yi25000cos(0.1πyi)4000}0
x {−100,100}D
9 C-03 Minf(x)=i=1D(j=1izj)2, z = x − o
g(x=i=1D{zi25000cos(0.1πzi)4000}0
h(x) = -i=1Dzisin(0.1πzi)=0
x {−100,100}D
10 C-04 Minf(x)=i=1D{zi210cos(2πzi)+10},z = x − 0
g1(x=i=1Dzisin(2zi)0
g2(x=i=1Dzisin(zi)0
x {−10,10}D
11 C-05 Minf(x)=i=1D(100(zi2zi+1)2(zi1)2),z = x − 0, y = M1 * z, w = M2 * z
g1(x=i=1D{yi250cos(2πyi)40}0
g2(x=i=1D{wi250cos(2πwi)40}0
x {−10,10}D
12 C-06 Minf(x)=i=1D{zi210cos(2πzi)+10}, z = x − 0
h1(x=i=1Dzisin(zi)=0, h2(x=i=1Dzisin(zi)=0,
h3(x)=i=1Dzicos(zi=0, h4(x)=i=1Dzicos(zi)=0,
h5(x=i=1D(zisin(2*|zi|))=0,
h6(x=i=1D(zisin(2*|zi|))=0
x ∊{−20,20}D

5 Computational results

5.1 The experimental framework

MGGX and MRRX are two proposed real-coded crossover operators compared to DPX, SBX, and LX three conventional crossover operators in this particular simulation-based study for global optimization tasks. So total of fifteen algorithmic combinations are produced by integrating these five crossover operators with three mutation operators which are NUM, MPTM, and PM. We test them on a set of twelve benchmark functions having both constrained and unconstrained scenarios. This set of benchmark functions was chosen for their diverse levels of modality and complexity. To retain the best individual for each generation, tournament selection with an elitism size of one was used for each of the fifteen algorithmic combinations. The termination criteria for all algorithmic combinations were fixed as five hundred generations, and the population size was also specified as three hundred. In Fig 1 we describe the specific mutation and crossover probabilities for each case.

Fig 1. Visual parametric framework for all fifteen algorithms.

Fig 1

5.2 Results and discussion

The goal is to evaluate the effectiveness of the suggested crossover operators with the simulation results over existing operators. We accomplish this by proposing a pair of new real-coded Probabilistic-based crossover operators one is the mixture-based real-coded crossover operator by using Gumbel distribution, and in the other operator, Rayleigh distribution is used. The following are the proposed mixture-based real-coded crossover operators MGGX-NUM, MGGX-MPTM, MGGX-PM, MRRX-NUM, MRRX-MPTM, and MRRX-PM. Table 2 shows the mean values of twelve benchmark functions having diverse characteristics for fifteen algorithms and similarly, Table 3 indicates the values of standard deviation of different benchmark functions. For multiple mutations (NUM, MPTM, and PM), Tables 2 and 3 demonstrate that the MGGX crossover outperforms all other operators. The computational complexity of the proposed approach is influenced by the mixture-based crossover operators. As shown in Table 4, proposed operators have a higher average execution time due to additional sampling and probabilistic combinations of distributions. The increase in run time is justified by better solution quality, robustness, and a better balance between exploration and exploitation in complex situations.

Table 2. Mean values of different benchmark functions.

Sr No. Algorithm Names Name of test problems/benchmark functions
LevyMont Neumair Griewank Brown Ellipsoidal Cigar C-01 C-02 C-03 C-04 C-05 C-06
1 MGGX-NUM 2.13E-05 4648.5 0.000725 0.0013 1.2299 4431 57000 53942 57129 188.147 55632 2540
2 MRRX-NUM 0.0057 20569 0.1153 0.2969 971.0723 2484800 54915 58231 57079 192.944 56908 2478.5
3 DPX-NUM 8.74E-05 3539.3 0.0016 0.0033 8.9061 27657 55562 56685 56448 192.034 55029 2650
4 SBX-NUM 0.0087 35852 0.2108 0.3586 591.2497 4612800 56653 56959 56195 185.841 57788 2528.5
5 LX-NUM 0.00014 8846.9 0.0024 0.004 3.3488 30023 55708 56354 56279 187.742 58183 2532.1
6 MGGX-MPTM 5.32E-06 260 6.58E-05 4.61E-05 0.856 765 56500 54600 54700 192 57402 2568.5
7 MRRX-MPTM 0.000852 2750 0.011 0.0148 1020 168000 55000 56000 57200 189.885 55882 2507.6
8 DPX-MPTM 1.81E-05 892.7273 0.000319 0.000362 8.0844 3640 55989 56841 55434 190.906 57216 2523.9
9 SBX-MPTM 0.0011 3060 0.0135 0.0153 616.77 262000 56297 56297 55951 192.934 57496 2570.5
10 LX-MPTM 2.06E-05 540.0498 0.000329 0.000184 4.9484 4210 56800 56484 55495 190.727 54485 2568.9
11 MGGX-PM 0.000102 7070 0.0025 0.0046 3.6 42400 56900 55400 56100 194 57686 2549.1
12 MRRX-PM 0.0061 22300 0.119 0.365 989 2640000 55200 55700 57500 192.651 57332 2570.7
13 DPX-PM 0.00045 5830 0.0076 0.0182 27.0527 122000 55481 56304 55776 190.215 56522 2545.2
14 SBX-PM 0.01 48200 0.22 0.4092 582.962 5180000 55244 56318 55873 189.8 57026 2524.7
15 LX-PM 0.000292 17700 0.011 0.0171 12.8189 147000 55700 56181 56066 190.618 55585 2527.7

Table 3. Stander deviation values of different benchmark functions.

Sr No Algorithm Names Name of test problems/benchmark functions
LevyMont Neumair Griewank Brown Ellipsoidal Cigar C-01 C-02 C-03 C-04 C-05 C-06
1 MGGX-NUM 1.43E-05 3340 0.0015 0.001 1.1764 2930 5150 6075 4436.9 14.5254 5406.9 219.789
2 MRRX-NUM 0.0024 7890 0.0354 0.0835 106.8213 727000 5498.9 4842.8 4544.8 11.1849 4506.4 213.631
3 DPX-NUM 5.59E-05 1250 0.000841 0.0022 3.038 11500 5404.4 4768.6 4917.4 11.9834 6233.5 199.509
4 SBX-NUM 0.0033 13900 0.0652 0.1069 92.7802 1320000 4381.7 6199.2 5449.7 17.4096 5500.1 212.476
5 LX-NUM 0.000113 4940 0.0017 0.003 1.9276 22500 4178.6 5468.3 4625.7 12.664 4938.8 226.017
6 MGGX-MPTM 1.07E-05 277 8.48E-05 4.96E-05 0.5486 690 5994.5 4828.2 5240.6 12.0147 4472 220.584
7 MRRX-MPTM 0.000779 3110 0.0141 0.0126 109.6718 144000 6052.7 5389.3 5377 13.1197 5344.4 256.564
8 DPX-MPTM 2.28E-05 1060 0.00061 0.000359 6.2504 3480 5389.3 4765.8 4769.4 14.4426 5717.4 212.472
9 SBX-MPTM 0.000765 2640 0.0166 0.0093 88.5754 351000 6526.6 6526.6 5675.2 16.7739 5017.1 219.754
10 LX-MPTM 3.61E-05 666.967 0.000708 0.000211 4.6375 4300 4765.8 5994.5 5169.1 18.8 6750.9 224.024
11 MGGX-PM 5.46E-05 5210 0.0015 0.0044 2.744 62300 4699.9 5249.7 4253.5 9.3703 5309.4 191.608
12 MRRX-PM 0.0018 7070 0.0321 0.0843 90.2339 833000 4709.3 4162.9 5315.2 16.5521 5214.5 199.698
13 DPX-PM 0.000248 1990 0.0032 0.015 12.8489 91600 5475.6 5038.1 6052.6 13.5575 6635.7 222.265
14 SBX-PM 0.0036 17500 0.0643 0.1433 87.0768 1860000 3894.6 5000.6 6033.5 13.9061 5572.5 229.488
15 LX-PM 0.000284 10600 0.0104 0.0157 9.5745 121000 5336.5 4480.1 4541.2 16.9681 6653.9 203.504

Table 4. Average execution time (in seconds) of different benchmark functions.

Sr No Algorithm Names Name of test problems/benchmark functions
LevyMont Neumair Griewank Brown Ellipsoidal Cigar C-01 C-02 C-03 C-04 C-05 C-06
1 MGGX-NUM 250.520 149.192 219.588 332.032 327.211 273.168 312.686 246.703 305.385 269.575 307.956 196.841
2 MRRX-NUM 91.070 79.411 117.301 156.226 109.449 177.686 95.771 88.409 107.130 84.111 80.512 143.794
3 DPX-NUM 83.698 130.145 82.579 341.124 96.815 87.860 68.933 86.584 87.314 81.907 93.998 155.427
4 SBX-NUM 78.645 141.177 80.651 165.874 88.736 181.107 81.769 121.203 87.363 84.620 90.455 186.625
5 LX-NUM 107.713 181.630 81.458 166.843 96.063 106.539 82.792 71.674 86.876 81.813 118.607 114.005
6 MGGX-MPTM 238.793 258.620 279.197 248.384 182.391 237.992 252.858 178.038 278.261 254.664 313.631 210.098
7 MRRX-MPTM 85.230 122.743 84.781 135.553 149.816 92.471 60.464 96.763 86.370 102.885 90.785 89.472
8 DPX-MPTM 104.785 92.002 93.857 189.796 97.119 75.669 74.046 107.380 106.126 98.964 98.727 182.161
9 SBX-MPTM 102.961 87.965 87.568 131.532 89.222 75.015 112.032 87.744 118.770 126.240 112.848 111.366
10 LX-MPTM 102.363 82.434 94.865 161.537 92.945 72.342 88.857 118.286 128.817 78.854 126.841 113.766
11 MGGX-PM 226.266 170.237 250.553 206.320 208.220 246.831 166.323 155.558 256.929 205.197 187.798 144.809
12 MRRX-PM 89.740 108.791 126.972 129.436 87.211 85.800 72.960 98.425 77.687 73.454 97.676 124.794
13 DPX-PM 87.889 77.274 79.575 130.299 87.473 102.063 76.170 125.256 92.763 75.746 61.385 101.608
14 SBX-PM 84.798 74.559 73.456 141.748 83.054 94.860 106.832 68.037 82.136 70.675 62.621 119.214
15 LX-PM 84.625 76.388 77.445 118.098 81.374 103.471 92.151 101.134 94.906 82.980 62.129 77.007

5.3 Performance index

It is common practice to compare different heuristic algorithms utilizing the performance index. It examines the behavior of various stochastic search strategies. Performance index (PI) is used here to obtain a more comprehensive understanding of the respective performance of MGGX-NUM, MGGX-MPTM, MGGX-PM, MRRX-NUM, MRRX-MPTM, and MRRX-PM algorithms, this performance index was also used in literature [18]. The least mean and least standard deviation are given prescribed weighted importance by this index. Equation 20 provides a mathematical setup of this PI.

PI=1Npi=1Np(b1β1i+b2β2i+b3β3i) (20)

where

β1i=Meanimeani
β2i=Sdisdi
β3i=CVicvifori=1,2,3,,Np

and Np denotes the total number of populations, sdi denotes the least standard deviation and CVi denotes the least value of the coefficient of variation. Whereb1,b2, and b3 denote weights and the sum of weights equal to one. Following is the mathematical setup of different three cases.

  • 1st case b1=weight, b2=b3=12(1weight)

  • 2nd case b2=weight, b1=b3=12(1weight)

  • 3rd case b3=weight, b1=b2=12(1weight)

And for all three cases, weights are between 0 and 1.

We also employed the Quade test, a non-parametric test that adopts ranking methodology [18], to compare the performance of two proposed and three conventional real-coded crossover operators. Here equation number 21 represents the mathematical formulation of the Quade test statistics.

Qteststatistic=(b1)j=1pwj2bi=1bj=1pwij2jpwj2 (21)

where,

wij2=ki(Rij(b+1)2), wj=i=1bwij, p = number of crossover operator, b = number of mutation operator, and ki denotes ranked range.

The Quade test statistics value is 5.65 having a p-value of 0.004 concluding a significant difference between crossover operators (MGGX, MRRX, DPX, SBX, and LX). The pairwise comparison is represented in Table 5 below. It demonstrates strong evidence that the proposed operator MGGX outperforms SBX, DPX, MRRX, and LX.

Table 5. Comparison of different crossover operators.

Pairs of crossover operators P-value
MGGX vs SBX 0.0003
MGGX vs DPX 0.0091
MGGX vs MRRX 0.0096
MGGX vs LX 0.0149

In Figs 2, 3, and 4 line graph shows that MGGX is consistently outperforming all other real-coded operators, showing that the MGGX crossover operator is outperforming the others in the form of a plotted metric line. This growing pattern suggests that the proposed crossover operator (MGGX) is approaching the global solution. As the algorithm develops its search, a more successful global solution exploration is made possible by the innovative crossover operator (MGGX). Visual performance of each algorithm with mutations NUM, MPTM, and PM are expressed in Figs 5, 6, and 7 respectively, MGGX performs outperforming in all three cases.

Fig 2. Visual line representation of algorithms with NUM mutation.

Fig 2

Fig 3. Visual line representation of algorithm with MPTM mutation.

Fig 3

Fig 4. Visual line representation of algorithm with PM mutation.

Fig 4

Fig 5. Visual performance of each algorithm with NUM mutation.

Fig 5

Fig 6. Visual performance of each algorithm with MPTM mutation.

Fig 6

Fig 7. Visual performance of each algorithm with PM mutation.

Fig 7

5.4 TOPSIS multi-criteria decision-making method

One common approach to solving multiple objective decision-making problems is to identify compromise solutions for each of the multiple objective functions. People generally want to make optimal decisions when faced with several options [25]. Developing analytical and numerical techniques that consider multiple alternatives with multiple criteria is the goal, of using scientific terminology. TOPSIS (Technique for Order Preference by Similarity to Ideal Solution) is a numerical method for multi-criteria decision-making [26]. This method is broadly applicable and makes use of a straightforward mathematical framework. It is also an effective strategy that requires technological support. The method has been applied to optimal decisions throughout the last few decades.

Based on the performance score of the TOPSIS, a rank was established for every algorithm as shown in Tables 6–8. Consequently, MGGX surpassed the two closest competitors, DPX and LX, to become the most preferred algorithm for every mutation operator among all of these options. Figs 810’s visual representation of the ranks for each algorithm further demonstrates how well the recently suggested MGGX algorithm performs.

Table 6. The ranking of algorithms with NUM mutation by TOPSIS.

Name of algorithms Ideal Best Ideal Worst Performance score Rank
MGGX-NUM 8.17E-06 0.02838385 0.99971223 1
MRR-NUM 0.0141748 0.00384161 0.2132288 4
DPX-NUM 1.223E-05 0.02834789 0.99956871 2
SBX-NUM 0.0254645 0.00078134 0.0297702 5
LX-NUM 0.000117 0.02708503 0.9956998 3

Source: author’s work.

Table 7. The ranking of algorithms with MPTM mutation by TOPSIS.

Name of algorithms Ideal Best Ideal Worst Performance score Rank
MGGX-MPTM 5.656E-06 0.0249744 0.999773567 1
MRR-MPTM 0.0181073 0.0010416 0.054395124 4
DPX-MPTM 0.0001644 0.0231858 0.992958897 3
SBX-MPTM 0.021755 0.0007956 0.035280368 5
LX-MPTM 3.788E-05 0.0238903 0.998417062 2

Source: author’s work.

Table 8. The ranking of algorithms with PM mutation by TOPSIS.

Name of algorithms Ideal Best Ideal Worst Performance score Rank
MGGX-PM 7.35E-06 0.028137546 0.999738791 1
MRRX-PM 0.01339874 0.004715359 0.26031431 4
DPX-PM 1.8325E-05 0.027122303 0.999324796 2
SBX-PM 0.02501556 0.000871786 0.033676167 5
LX-PM 0.00032063 0.025364846 0.987516989 3

Source: author’s work.

Fig 8. Visual representation of ranks of algorithms with NUM mutation.

Fig 8

Fig 10. Visual representation of ranks of algorithms with PM mutation.

Fig 10

Fig 9. Visual representation of ranks of algorithms with MPTM mutation.

Fig 9

6 Conclusions and future research

This study introduces a unique approach using the mixture distribution. A pair of new crossover operators are proposed using Gumbel and Rayleigh distributions separately and efficiency is compared with the three operators in the literature. To examine these five crossover operator versions (MGGX, MRRX, DPX, SBX, and LX) with the co-integration of three mutation operators (NUM, MPTM, and PM), twelve widely recognized benchmark functions with diverse characteristics are utilized. Real-coded algorithms of mixture distribution are designed by combining two components of Gumbel distribution with 3 mutations (MGGX-NUM, MGGX-MPTM, and MGGX-PM). Similarly, real-coded algorithms are proposed using Rayleigh distribution (MRRX-NUM, MRRX-MPTM, and MRRX-PM). The strategies are compared concerning the lowest mean objective function values and standard deviation values. Furthermore, this study employs the performance index (PI) and the multi-criteria decision-making technique TOPSIS for comparison. It is confirmed through these techniques (PI & TOPSIS) that proposed algorithms MGGX-NUM, MGGX-MPTM, and MGGX-PM perform significantly better than all the algorithms taken into consideration for comparison in the present case.

The proposed operators have a great deal of managerial potential for resolving challenging optimization problems in real-world situations. The flexibility of the MGGX operator to efficiently handle high-dimensional and multimodal search spaces could be useful for supply chain management, scheduling, and resource allocation applications. Decision-makers in fields like engineering, manufacturing, and logistics might use these insights to develop optimal solutions that are more resilient and need less computing power.

6.1 Limitations

Despite this study evaluating the proposed operators on both constrained and unconstrained benchmark functions, it focused merely at standard benchmark suites and did not evaluate the operators’ effectiveness for use in specific scenarios.

6.2 Future research directions

Future research could explore the application of MGGX and MRRX to practical problems, such as multimodal optimization in resource allocation, supply chain logistics, and scheduling. To enhance generalization, the operators will be tested on benchmark suites beyond CEC 2014/2015 and CEC 2017. Additionally, hybrid strategies incorporating adaptive parameter mechanisms and combining MGGX and MRRX with other meta-heuristics could further improve their performance and adaptability across various optimization scenarios.

Data Availability

The results of our study have already been presented comprehensively within the paper. The benchmark functions eg (CEC 2017, CEC 2013,2014 ) are publicly available test suites, widely accessible to researchers. Therefore, no additional raw data is generated beyond what is already provided in the tables within the main text of the paper. Reference for Benchmark functions Wu, G., Mallipeddi, R., & Suganthan, P. N. (2017). Problem definitions and evaluation criteria for the CEC 2017 competition on constrained real-parameter optimization. National University of Defense Technology, Changsha, Hunan, PR China and Kyungpook National University, Daegu, South Korea and Nanyang Technological University, Singapore, Technical Report. Liang, J. J., Qu, B. Y., & Suganthan, P. N. (2013). Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore, 635(2), 2014.

Funding Statement

The authors thank the Deanship of Research and Graduate Studies at King Khalid University for funding this work through a Large Research Project under grant number RGP.2/145/46. The funders had no role in study design, data collection and analysis, publication decisions, or manuscript preparation.

References

  • 1.Deb K. Multiobjective Optimization Using Evolutionary Algorithms. New York: Wiley; 2001. [Google Scholar]
  • 2.Goldberg DE. Genetic Algorithms in Search, Optimization, and Machine Learning. Boston: Addison-Wesley; 1989. [Google Scholar]
  • 3.Michalewicz Z, Arabas J. Genetic algorithms for the 0/1 knapsack problem. In: Methodologies for Intelligent Systems. Berlin, Heidelberg: Springer; 1994. p. 134–143. [Google Scholar]
  • 4.Mohapatra S, Dandapat SJ, Thatoi H. Physicochemical characterization, modelling, and optimization of ultrasono-assisted acid pretreatment of two Pennisetum sp. using Taguchi and artificial neural networking for enhanced delignification. J Environ Manage. 2017;187:537–49. doi: 10.1016/j.jenvman.2016.11.005 [DOI] [PubMed] [Google Scholar]
  • 5.Sun S, Cao Z, Zhu H, Zhao J. A Survey of Optimization Methods From a Machine Learning Perspective. IEEE Trans Cybern. 2020;50(8):3668–81. doi: 10.1109/TCYB.2019.2950779 [DOI] [PubMed] [Google Scholar]
  • 6.Luo J, Shi B. A hybrid whale optimization algorithm based on modified differential evolution for global optimization problems. Appl Intell. 2019;49:1982–2000. doi: 10.1007/s10489-018-1331-2 [DOI] [Google Scholar]
  • 7.Eberhart RC, Shi Y, Kennedy J. Swarm Intelligence. San Francisco: Morgan Kaufmann; 2001. [Google Scholar]
  • 8.Mandour S, Gamal A, Sleem A. Mantis Search Algorithm Integrated with Opposition-Based Learning and Simulated Annealing for Feature Selection. Sustain Mach Intell J. 2024;8. doi: 10.61356/smij.2024.8300 [DOI] [Google Scholar]
  • 9.Yılmaz B, Yılmaz Ö, Yeni F. Comparison of lot streaming division methodologies for multi-objective hybrid flowshop scheduling problem by considering limited waiting time. J Ind Manag Optim. 2024;16(0):1–22. doi: 10.3934/jimo.202420 [DOI] [Google Scholar]
  • 10.Yeni FB, Cevikcan E, Yazici B, Yilmaz OF. Aggregated planning to solve multi-product multi-period disassembly line balancing problem by considering multi-manned stations: A generic optimization model and solution algorithms. Computers & Industrial Engineering. 2024;196:110464. doi: 10.1016/j.cie.2024.110464 [DOI] [Google Scholar]
  • 11.Smith GD, Steele NC, Albrecht RF, Tuson A, Wheeler R, Ross P. An evolutionary/meta-heuristic approach to emergency resource redistribution in the developing world. In: Artificial Neural Nets and Genetic Algorithms. Vienna: Springer; 1997. pp. 329–332. [Google Scholar]
  • 12.Kaur G, Arora S. Chaotic whale optimization algorithm. J Comput Des Eng. 2018;5(3):275–84. doi: 10.1016/j.jcde.2018.02.004 [DOI] [Google Scholar]
  • 13.Ahmad I, Hussain A, Almanjahie I. Mixture distribution-based real-coded crossover: a hybrid probabilistic approach for global optimization. J Intell Fuzzy Syst. 2022;42(6):4969–85. doi: 10.3233/JIFS-211952 [DOI] [Google Scholar]
  • 14.Almanjahie IM, Ahmad I. Enhancing probabilistic-based real-coded crossover genetic algorithms with authentication of VIKOR multi-criteria optimization method. AIMS Math. 2024;9(10):29250–68. doi: 10.3934/math.20241541 [DOI] [Google Scholar]
  • 15.Deep K, Thakur M. A new crossover operator for real-coded genetic algorithms. Appl Math Comput. 2007;188(1):895–911. doi: 10.1016/j.amc.2006.10.049 [DOI] [Google Scholar]
  • 16.Deb K, Agrawal R. Simulated binary crossover for continuous search space. Complex Syst. 1995;9(2):115–48. [Google Scholar]
  • 17.Haq EU. Performance evaluation of novel selection processes through hybridization of k-means clustering and genetic algorithm. Appl Ecol Env Res. 2019;17(6):14159–77. doi: 10.15666/aeer/1706_1415914177 [DOI] [Google Scholar]
  • 18.Haq EU, Ahmad I, Hussain A, Almanjahie IM. A novel selection approach for genetic algorithms for global optimization of multimodal continuous functions. Comput Intell Neurosci. 2019;2019:1–14. doi: 10.1155/2019/6940161 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Michalewicz Z, Nazhiyath G, Michalewicz M. A note on usefulness of geometrical crossover for numerical optimization problems. Evol Prog. 1996;5(1):305–12. [Google Scholar]
  • 20.Mäkinen RA, Périaux J, Toivanen J. Multidisciplinary shape optimization in aerodynamics and electromagnetics using genetic algorithms. Int J Numer Methods Fluids. 1999;30(2):149–59. doi: 10.1002/(SICI)1097-0363(19990130)30:2<149::AID-FLD789>3.0.CO;2-R [DOI] [Google Scholar]
  • 21.Deep K, Thakur M. A new mutation operator for real-coded genetic algorithms. Appl Math Comput. 2007;193(1):211–230. doi: 10.1016/j.amc.2007.03.030 [DOI] [Google Scholar]
  • 22.Sultan KS, Al-Moisheer AS. Mixture of inverse Weibull and lognormal distributions: properties, estimation, and illustration. Math Probl Eng. 2015;2015:1–12. doi: 10.1155/2015/515489 [DOI] [Google Scholar]
  • 23.Gumbel EJ. Statistics of Extremes. New York: Columbia University Press; 1958. [Google Scholar]
  • 24.Grimmett G, Stirzaker D. Probability and random processes. Oxford University Press; 2020. [Google Scholar]
  • 25.Xu J, Tao Z. Rough multiple objective decision making. Boca Raton: CRC Press; 2011. [Google Scholar]
  • 26.Hwang C-L, Lai Y-J, Liu T-Y. A new approach for multiple objective decision making. Computers & Operations Research. 1993;20(8):889–99. doi: 10.1016/0305-0548(93)90109-v [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The results of our study have already been presented comprehensively within the paper. The benchmark functions eg (CEC 2017, CEC 2013,2014 ) are publicly available test suites, widely accessible to researchers. Therefore, no additional raw data is generated beyond what is already provided in the tables within the main text of the paper. Reference for Benchmark functions Wu, G., Mallipeddi, R., & Suganthan, P. N. (2017). Problem definitions and evaluation criteria for the CEC 2017 competition on constrained real-parameter optimization. National University of Defense Technology, Changsha, Hunan, PR China and Kyungpook National University, Daegu, South Korea and Nanyang Technological University, Singapore, Technical Report. Liang, J. J., Qu, B. Y., & Suganthan, P. N. (2013). Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization. Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China and Technical Report, Nanyang Technological University, Singapore, 635(2), 2014.


Articles from PLOS One are provided here courtesy of PLOS

RESOURCES