Skip to main content
. 2022 Oct 31:1–104. Online ahead of print. doi: 10.1007/s11063-022-11055-6

Table 3.

A summary of meta-heuristic algorithm developments for training/optimization deep learning architectures

Authors & dates The deep learning categories Optimized components:
1. Weights, 2. Layers & Nodes
3. Other Hyper parameters
4. Learning parameters & Activation function
The meta-heuristic algorithm used for training deep learning Application / dataset
1 2 3 4
Ku et al. [367] RNN Genetic algorithm (GA) Prediction and classification problems
Blanco et al. [368] RNN Real-coded genetic algorithm (GA) Benchmark datasets
Delgado et al. [369] RNN Strength pareto evolutionary algorithm2 & NSGA_II Time-series benchmark problem
Bayer et al. [370] LSTM Non-dominated sorting genetic algorithm (NSGA-II) Sequence learning
Subrahmanya and Shin [372] RNN PSO and CMA-ES Tow MIMO non-linear processes
Lin and Lee [371] RFNN Improved particle swarm optimization (IPSO) Non-linear system control
Hsieh et al. [373] RNN Artificial bee colony algorithm (ABC) Several international stock markets
Cheung and Sable [390] CNN Evolutionary algorithm (EA) MNIST Variations, rectangles-image and image classification
David and Greental [41] DNN Genetic algorithm (GA) MNIST hand-written digit recognition database
Shinozaki and Watanabe [40] DNN Genetic algorithm (GA) & CMA-ES Phoneme recognition and spoken digit detection tasks
Lander and Shang [42] DAE Evolutionary algorithm (EA) MNIST handwritten digits 1 k dataset
Sheikhan et al. [374] RNN Binary gravitational search algorithm (BGSA) Emotion recognition and speech processing
Desell et al. [391] RNN Ant colony optimization (ACO) Predicting general aviation flight data
Rosa et al. [43] CNN Harmony search algorithm (HS) Fingerprint and handwritten digit recognition
Chen et al. [375] DBN Evolutionary function array classification voter (EFACV) MNIST dataset
Rosa et al. [44] DBN Firefly algorithm (FA) MNIST and Semeion Handwritten Digit datasets
Papa et al. [392] DBN Harmony search algorithm (HSA) Binary image reconstruction
Zhang et al. [393] DBN Multi-objective evolutionary algorithm (MOEA) Remaining Useful Life Estimation in Prognostics
Tang et al. [377] DSNN Particle swarm optimization (PSO) Recognition of motor imagery EEG signals
Khalifa et al. [32] CNN Particle swarm optimization (PSO) Classification problem
Badem et al. [394] DNN Hybrid artificial bee colony (HABC) 15 benchmark data sets
Gelly and Gauvain [395] RNN Particle swarm optimization (PSO) Speech activity detection
Liu et al. [396] CNN Multi-objective evolutionary algorithm (MOEA) The MNIST data set and the CIFAR-10 data set
Song et al. [378] DDAE Ecogeography-based optimization (EBO) Predicting morbidity of gastrointestinal infections
ElSaid et al. [397] LSTM-RNN Ant colony optimization (ACO) Turbine engine vibration
Real et al. [376] CNN Evolutionary algorithm (EA) The CIFAR-10 and CIFAR-100 datasets
Jiang et al. [22] DNN Modified genetic algorithm (MGA) Demand Forecasting in Outpatient Department
Lopez-Rincon et al. [33] CNN Evolutionary algorithm (EA) Cancer miRNA biomarkers classification
Ye [37] DNN Particle swarm optimization (PSO) Biological activity prediction datasets
Kim et al. [398] DBN Particle swarm optimization (PSO) Highly class imbalance problem
Fujino et al. [399] CNN Genetic algorithm (GA) Recognition of human sketches problem
Lorenzo et al. [400] DNN Particle swarm optimization (PSO) MNIST and CIFAR-10 dataset
Dufourq and Bassett [34] EDEN Genetic algorithm (GA) Seven image and sentiment classification datasets
da Silva et al. [379] CNN Particle swarm optimization (PSO) Lung nodule false positive reduction on CT images
Chen et al. [401] LSTM Extremal optimization algorithm (EO) Wind speed forecasting
Passos et al. [402] DBM Particle swarm optimization (PSO), AIWPSO, HS & IHS Binary image reconstruction
Soon et al. [403] CNN Particle swarm optimization (PSO) Vehicle logo recognition
Peng et al. [38] LSTM Evolutionary algorithm (EA) Electricity price prediction problem
ElSaid et al. [404] LSTM-RNN Ant colony optimization (ACO) Predict turbine engine vibration
Lorenzo and Nalepa [405] DNN Memetic evolution algorithm (MEA) segmenting medical images and CIFAR-10 benchmark
Pawełczyk et al. [406] CNN Genetic algorithm (GA) MNIST set which contains grayscale images
Fielding and Zhang [407] CNN Particle swarm optimization (PSO) CIFAR-10 image classification task
Martín et al. [45] DNN Evolutionary algorithm (EA) Dataset of handwritten digits images
Sun et al. [408] DNN Evolutionary algorithm (EA) Learning Meaningful Representations
Liang et al. [409] DNN Evolutionary algorithm (EA) Omniglot Character Recognition problem
Wang et al. [35] CNN Hybrid differential evolution approach (HDE) Image classification
Zhou et al. [380] DNN Water wave optimization (WWO) Complex network optimization problems
Khodabandehlou and Fadali [410] RNN Dynamical trajectory-based optimization (DTBO) Three non- linear dynamical systems
Banharnsakun [46] CNN Artificial bee colony (ABC) MNIST handwritten image dataset (classification)
Gao and Li [411] CNN Segmented particle swarm optimization (SPSO) Land cover and land use classification of RS images
Wang et al. [39] CNN Particle swarm optimization (PSO) Linear prediction model
Wang et al. [36] GAN Evolutionary algorithm (EA) Several image classification datasets
Fujino et al. [412] CNN Genetic algorithm (GA) Anime storyboard recognition problem
Li et al. [413] CNN Particle swarm optimization (PSO) Image classification
Li et al. [414] DBNN Multi-objective PSO (MOPSO) Traffic flow forecasting
Nepomuceno [415] RRNN Multi-objective optimization (MOO) System identification and modelling
Wei et al. [416] DBN Artificial fish swarm algorithm (AFSA)-GA-PSO Intrusion detection classification model
Shi et al. [381] DNN Particle swarm optimization (PSO) Digital modulation recognition
Junior and Yen [417] CNN Particle swarm optimization (PSO) Image classification
Navaneeth and Suchetha [418] 1-D CNN Particle swarm optimization (PSO) Real-time detection and classification applications
ZahediNasab and Mohseni [384] CNN Genetic algorithm (GA) CT brain and the MNIST hand written digits dataset
Goel et al. [419] CNN Grey wolf optimizer (GWO) An automatic diagnosis of COVID-19
Gao et al. [420] CNN Gradient-priority particle swarm optimization (GPSO) EEG-based Emotion Recognition
Martín et al. [421] CNN Hybrid statistically coral reef optimization (HSCRO) The CIFAR-10 and the CINIC-10 datasets
Lan et al. [51] CNN Particle swarm optimization (PSO) Enhancing heart disease and breast cancer detection
Tang et al. [422] LSTM Genetic algorithm (GA) Traffic Flow Prediction on Urban Road Network
Elmasry et al. [386] LSTM-RNN Particle swarm optimization (PSO) Network intrusion detection
Guo et al. [383] CNN Distributed particle swarm optimization (DPSO) Image classification benchmarks
Lima et al. [423] CNN Simulating annealing (SA) Toward classifying small lung nodules
Renukadevi and Karunakaran [424] DBN Grasshopper optimization algorithm (GOA) Liver disease classification
Jallal et al. [385] DNN Randomly occurring distributed delayed PSO Monitoring the energy produced by solar trackers
Ali et al. [425] DBN Stacked genetic algorithm (SGA) Heart Disease Prediction
Hong et al. [382] CNN Genetic algorithm (GA) Locational Marginal Price Forecasting
Rajagopal et al. [426] CNN Multi-objective PSO (MOPSO) Scene Classification in Unmanned Aerial Vehicles
Lu et al. [427] CNN Multi-objective genetic algorithm (MOGA) Image Classification
Lin et al. [428] DAE Ecogeography-based optimization (EBO) In-Vehicle Networks-CAN Bus
Kavousi-Fard et al. [429] GAN Modified firefly algorithm (MFA) Securing Vehicles problem
Johnson et al. [430] CNN Genetic algorithm (GA) Image classification dataset: CIFAR10, MNIST and Caltech
Kan et al. [387] CNN Adaptive particle swarm optimization (APSO) IoT network intrusion detection
Zheng et al. [431] CNN Genetic algorithm (GA) Pattern Recognition (parametric eye modeling)
Pang et al. [432] CNN & LSTM Particle swarm optimization (PSO) Hyperspectral imaging classification
Gai et al. [433] DBN Sparrow search algorithm (SSA) Detection of gear fault severity
Sun et al. [434] DBN Improved archimedes optimization algorithm (IAOA) Energy
Samir et al. [435] CNN Heuristic-based JSO optimization algorithm Predicting heart diseases problem
Liu et al. [436] DNN Improved particle swarm optimization (IPSO) COVID-19 spread
Maoa et al. [437] CNN Genetic algorithm (GA) Waste classification—Image recognition
Gao et al. [420] CNN Particle swarm optimization (PSO) EEG-based emotion recognition
Kim and Cho [438] CNN-LSTM Particle swarm optimization (PSO) Anomalous query access control
Zhang et al. [439] CNN-LSTM Swarm-based optimization Intelligent human action recognition
Li et al. [440] CNN Sea lion insisted on dragon fly modification (SL-DU) Hardening prediction in steel
Mohakud and Dash [441] CNN Exponential grey wolf optimization (EN-GWO) Skin cancer image segmentation
Martín et al. [421] CNN Hybrid coral reef optimization (HSCRO) CIFAR-10 and the CINIC-10 Dataset
Altan et al. [442] LSTM Grey wolf optimizer (GWO) Algorithm Wind speed forecasting
Roder et al. [443] DBN hill climb (HC) Metaheuristic optimization Image classification Dataset
Mathe et al. [444] CNN Spider monkey-based electric fish optimization (SM-EFO) Biomedical Signal Processing and Control
Mahesh et al. [445] CNN Jaya-based barnacle mating optimization (J-BMO) Biomedical Signal Processing and Control
Singh et al. [446] CNN Multi-level particle swarm optimization (MPSO) Image classification Dataset
Kumar and Haider [447] RNN–LSTM Flower pollination algorithm (FPA) Prediction of Intra‑day Stock Market
Kumar et al. [448] DNN Genetic algorithm (GA) Four Image classification Dataset
Chitra and Kumar [449] CNN Mutation-based atom search optimization (MASO) Cervical cancer detection
Deighan et al. [450] CNN Genetic algorithm (GA) Gravitational wave classification
Qu et al. [451] DAE Non-dominated sorting genetic algorithm (NSGA_II) Classification problem
Goel et al. [452] CNN Grey wolf optimizer (GWO) algorithm Spread of coronavirus disease (COVID-19)
Liu and Nie [453] SSAE Invasive weed optimization algorithm (IWO) Image datasets
Kumar et al. [454] LSTM Artificial bee colony (ABC) Integrating big data driven sentiments polarity
Das et al. [455] RNN Flower pollination (FP) algorithm Modeling of electron Beam welding process
Gong et al. [456] LSTM Fireworks Algorithm (FWA) Air-conditioning load data of a union office
Chen et al. [457] LSTM Hybrid coding particle swarm optimization (HCPSO) Series prediction and Nonlinear system identification
Bacanin et al. [458] CNN Firefly algorithm (FA) Medical image classification (IXI and cancer dataset)
Sherly and Jaya [459] CNN Improved firefly algorithm (IFA) Scene character recognition
Datta And Chakrabarti [460] RNN Fire fly-oriented multi-verse optimizer (FF-MVO) Classification problem
Alenazy and Alqahtani [461] DBN Gravitational search algorithm (GSA) Facial expression recognition (FER)
Sudha and alarmathi [462] DBN Interactive autodidactic school (IAS) Classification problem
Jammalamadaka and Parveen [463] DBN Search and rescue (SAR) algorithm Classification problem
Gadekallu et al. [464] CNN Crow search algorithm (CSA) Classification: Human–computer interaction (HCI)
Irmak [465] CNN Grid search optimization (GSO) Medical image classification
Arjunagi and Patil [466] CNN Adaptive spider monkey optimization (AOSMO) Identifying and diagnosing maize leaf diseases
Li et al. [467] RNN Adaptive dynamic particle swarm optimization (ADPSO) Air Quality Index Prediction
Oyelade and Ezugwu [468] CNN Multiverse optimizer (MVO), SBO & LCBO Medical image classification
Tripathi and Maktedar [469] CNN Lion assisted firefly algorithm (LA-FF) Classification problem
Karuppusamy et al. [470] DBN Chronological salp swarm algorithm (CSSA)

Intrusion detection system

Intrusion detection in cloud

Priya and Chacko [471] CNN Improved particle swarm optimized (IPSO) Medical image classification
Danesh and Vasuhi [472] CNN Glow worm swarm optimization (GWSO) Spectrum sensing ranks
Zhang et al. [473] LSTM Genetic algorithm (GA) Upper Limb Activities Recognition
Farrag et al. [474] LSTM Genetic algorithm (GA) South Australia State (SA) power system
Arora et al. [475] DAR Grasshopper optimisation algorithm (GOA) Wind Power Forecasting
Goay et al. [476] CNN-LSTM Adaptive successive halving Optimization (ASH-HPO) Transient simulations of high-speed channels
Liu et al. [477] LSTM Adaptive particle swarm optimization (AHMPSO) Monitoring of wastewater treatment plant (WWTP)
Davoudi and Thulasiraman [478] CNN Genetic algorithm (GA) Breast cancer classification problem
Li et al. [478] DBN Simulated annealing cuckoo search algorithm (SA-CSA) Fault diagnosis of railway freight car wheelset
Liu et al. [479] CNN Continuous particle swarm optimization (CPSO) Hyperspectral Image Classification
Brodzicki et al. [480] DNN Whale optimization algorithm (WOA) Classification Dataset (MNIST)
Baniasadi et al. [481] CNN Improved particle swarm optimization (NSBPSO) Intrusion Detection in IoT Systems
Paul et al. [482] LSTM-DBN Sparrow search optimization (SSO) Water quality index prediction
Gonçalves et al. [483] CNN Genetic algorithm (GA) & PSO Cancer detection
Glaret subin and Muthukannan [484] CNN Flower pollination optimization algorithm (FPOA) Multiple eye disease detection
Xu et al. [485] LSTM Particle swarm optimization (PSO) Hydrology (Flood forecasting)
Antony Raj and Giftson Samuel [486] DRBFNN Boosted salp swarm optimization (BSSO) PhotoVoltaic (PV) systems
Hassanzadeh et al. [487] CNN Genetic algorithm (GA) Classification (CIFAR10, MNIST, and EMNIST)
Palaniswamy [488] CNN Swallow swarm optimization (SSO) Automated bone age assessment and classification
Jalali et al. [489] CNN Grey wolf optimization (GWO) algorithm Wind power forecasting
Lokku et al. [490] CNN Fitness sorted rider optimization (FS-ROA) Face recognition
Ewees et al. [491] LSTM Heap-based optimizer (HBO) algorithm wind power forecasting
Huo et al. [492] TCN-LSTM Particle swarm optimization (PSO) Prediction of reservoir key parameters
Li et al. [493] CNN-LSTM Particle swarm optimization (PSO) Reservoir production prediction
Ge et al. [494] DBN Whale optimization algorithm (WOA) Safety prediction of shield tunnel construction
Kanna and Santhi [388] CNN-LSTM Black widow optimization (BWO) Intrusion Detection Systems
Jalali et al. [495] CNN Modified competitive swarm Optimizer (MCSO) X-ray image based COVID-19 detection
Li et al. [496] LSTM Grey wolf optimization (GWO) Wind speed forecasting
Michael Mahesh et al. [497] CNN Rider border collie optimization (RBCO) Road intersection classification
Mohakud and Dash [498] CNN Grey wolf optimization (GWO) Medical image classification
Ahmad et al. [499] DRaNN Particle swarm optimization (PSO) Intrusion detection in the industrial internet of things
Chen et al. [500] CNN Chimp optimization algorithm (ChOA) Diagnose Parkinson’s disease
Karthiga et al. [501] CNN Grey wolf optimization (GWO) & ABC Biomedical Signal Processing and Control
Kanipriya et al. [502] CNN-LSTM Improved capuchin search algorithm (ICapSA) Malignant lung nodule detection
Hu et al. [503] LSTM Grasshopper optimization algorithm (GOA) Building Engineering
Raziania and Azimbagirad [504] CNN Moth flame optimization (MFO) Sensor-based human activity recognition
Falahzadeh et al. [505] CNN Grey wolf optimization (GWO) Speech Emotion Recognition
Vigneshwaran et al. [506] CNN Particle swarm optimization (PSO) Recognition of partial discharge (PD)
Jalali et al. [507] LSTM Grasshopper optimization algorithm (GOA) wind speed forecasting
Surya and Senthilselvi [508] LSTM Seagull optimization algorithm (SOA) Identification of oil authenticity and adulteration
Balasubramanian et al. [509] CNN Particle swarm optimization (PSO) Medical image classification
Pandey and Kamal Jain [510] CNN Opposition-based symbiotic organisms search (OSOS) Medical image classification
Challapalli and Devarakonda [511] CNN Hybrid particle swarm grey wolf (HPSGW) Classification of Indian classical dances
Rodrigues et al. [512] CNN Genetic algorithm (GA) Medical image classification—MRI images
Sasank and Venkateswarlu [513] CNN Adaptive rain optimizer algorithm (AROA) Medical image classification
Kavitha and Prasad [514] CNN Sand piper optimization (SPO) Algorithm Medical image classification
Qader et al. [515] CNN Improved harris hawks optimization (HHO) Medical image classification (brain tumor)
Karthik and Sethukarasi [516] DBM Hybrid atom search arithmetic optimization (HASAO) Natural language processing
Li et al. [517] LSTM Grey wolf optimization (GWO) Water resources management
Gaurav et al. [518] CNN Hosted cuckoo optimization (HCO) Speaker identification framework
Kaushik et al. [519] DBN Whale optimization algorithm (WOA) Software development effort estimation
Liu et al. [520] LSTM Particle swarm optimization (PSO) Short-term subway inbound passenger flow prediction
Souissi and Ghorbel [521] LSTM Genetic algorithm (GA) Click-through rate prediction- digital advertising industry
Balasubramanian et al. [522] DBN Salp swarm optimization algorithm (SSA) Medical image classification
Mukherjee et al. [523] CNN Grey wolf optimization (GWO) Identification of the types of disease
Ponmalar and Dhanakoti [524] CNN Hybrid whale tabu optimization (HWTO) Intrusion detection in big data
Suresh et al. [525] RNN Flamingo search optimization (FSO) Disease diagnosis
Xu et al. [526] LSTM Whale optimization algorithm (WOA) Short-term traffic flow prediction
Tuerxun et al. [527] LSTM Modified tuna swarm optimization (MTSO) Wind speed prediction
Chandraraju and Jeyaprakash [528] DBN Chaotic Krill Herd optimization (CKHO) Diagnosis of breast abnormalities
Jiang et al. [529] CNN-LSTM Improved whale optimization algorithm (IWOA) A Fault Feature Extraction
Fetanat et al. [530] CNN-FENN Improved Harris Hawks optimization (IHHO) Medical image classification
Jiang et al. [531] LSTM Sine–Cosine algorithm (SCA-HHO) Ship attitude prediction
Gampala et al. [532] DBN Hosted cuckoo optimization algorithm (HO-COA) Diagnosis of COVID-19
Li et al. [533] DBN Particle swarm optimization (PSO) Product quality monitoring
Yu et al. [534] CNN Enhanced chicken swarm algorithm (ECSA) Crack detection of concrete structures
Li et al. [535] CNN Multi-strategy particle swarm optimization (MSPSO) Fault diagnosis method for aircraft EHA
Pellegrino et al. [536] DNN Particle swarm optimization (PSO) & GA Predicting BRCA1/BRCA2 Pathogenicity
Mohapatra et al. [537] CNN Cat swarm updated black widow (CSUBW) Medical image classification
Ragab et al. [389] CNN Enhanced gravitational search optimization (EGSO) COVID-19 diagnosis
Shankar et al. [538] RNN Aquila optimization algorithm (AOA) Fruit classification
Fan et al. [539] CNN Hybrid Sparrow Search Algorithm (HSSA) Image classification