Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2021 May 14;18(10):5208. doi: 10.3390/ijerph18105208

Performance of Fuzzy Multi-Criteria Decision Analysis of Emergency System in COVID-19 Pandemic. An Extensive Narrative Review

Vicente Javier Clemente-Suárez 1,2,3,*, Eduardo Navarro-Jiménez 4, Pablo Ruisoto 5, Athanasios A Dalamitros 6, Ana Isabel Beltran-Velasco 7, Alberto Hormeño-Holgado 3, Carmen Cecilia Laborde-Cárdenas 8, Jose Francisco Tornero-Aguilera 1,3
Editors: Juan José Alfaro-Saíz, Miguel Ángel Ortiz-Barrios
PMCID: PMC8153618  PMID: 34068866

Abstract

The actual coronavirus disease 2019 (COVID-19) pandemic has led to the limit of emergency systems worldwide, leading to the collapse of health systems, police, first responders, as well as other areas. Various ways of dealing with this world crisis have been proposed from many aspects, with fuzzy multi-criteria decision analysis being a method that can be applied to a wide range of emergency systems and professional groups, aiming to confront several associated issues and challenges. The purpose of this critical review was to discuss the basic principles, present current applications during the first pandemic wave, and propose future implications of this methodology. For this purpose, both primary sources, such as scientific articles, and secondary ones, such as bibliographic indexes, web pages, and databases, were used. The main search engines were PubMed, SciELO, and Google Scholar. The method was a systematic literature review of the available literature regarding the performance of the fuzzy multi-criteria decision analysis of emergency systems in the COVID-19 pandemic. The results of this study highlight the importance of the fuzzy multi-criteria decision analysis method as a beneficial tool for healthcare workers and first responders’ emergency professionals to face this pandemic as well as to manage the created uncertainty and its related risks.

Keywords: fuzzy decision analysis, decision making, uncertainty, multi-criteria, emergency, COVID-19

1. Introduction

From the end of November 2019 to the present (February 2021), the world is facing one of the most significant pandemics of the last two generations. Every day around the world, thousands of people are dying, and hundreds of thousands are becoming infected with this new coronavirus, characterized by its highly contagious nature [1]. In humans, it usually causes respiratory infections that can range from a common cold to severe illnesses such as the Middle East respiratory syndrome (MERS) or the severe acute respiratory syndrome (SARS) [2]. The recently discovered coronavirus (Sars-CoV-2) has caused the actual pandemic (COVID-19), with a greater ratio of mortality and contagiousness than its predecessors [2]. Unawareness and the unknown nature of the Sars-CoV-2 facilitated its rapid spread, leading to 102 million cases and 2.2 million deaths worldwide. In a matter of short time, the virus has been rapidly spreading from Asia to Europe, North America, the Middle East, Africa, and Latin America. Some countries began preparing their health systems for the increase in severely ill patients and implemented stringent measures to prevent the contagion from spreading, such as closing borders, pre-emptive isolation, and quarantine [2]. Depending on these measures adopted, each country has suffered the appearance of different waves of infection. Globally, three key and common worldwide turning points can be highlighted for these waves. The first is located between May and April 2020, the second between July and August, and a third between December and January [3].

From each of these waves, governments, countries, and societies have been learning and improving their response systems. Yet, given the unpredictability of the virus, its behavior, somatological diversity, the recent appearance of new virus variants as the British [4], we are still suffering many new challenges to the healthcare system worldwide and their sustainable performance. In this line, COVID-19 among its waves has set numerous operational, logistical, organizational, and moral–ethical requirements before management, healthcare workers, and associates. Likewise, and seeing the complications in the processes of the distribution and application of the COVID-19 vaccine, it is more than expected that a fourth wave will occur [5], which, seeing the accumulated total active cases, is more than likely to produce saturation of the healthcare system [6]. Therefore, it is required to improve the organization of specialized training for medical personnel by emerging conditions and the conversion of facilities for patient accommodation. Governments and health organizations should also be concerned about the procurement of medical equipment, information and communication management, as well as continuous monitoring of healthcare systems. The availability of healthcare to specific groups of the population in new conditions should also not be neglected [7]. Thus, given the looming epidemiological spectrum and the shadow it has left, it is strictly necessary to continuously analyze the strengths and weaknesses of the healthcare systems and decision-making processes worldwide, which would lead to an adaptative, efficient model that can give speed, agility flexibility and a prompt response, especially on qualified medical personnel. To confront this crisis situation, decision-making models are currently being used in hospital emergencies by providing essential information regarding the prediction of spreading, the evaluation of different factors, determining the weights of criteria, and re-organizing the healthcare systems [7]. In this sense, fuzzy-based decision models, based on the theory proposed by Zadeh in 1965, have also a significant application in healthcare systems, considered as a more flexible and dynamic approach and—at the same time—a more sensitive procedure to real-life scenarios [8,9].

This paper is structured as follows: After the introduction, in Section 2, the basic principles of MCDA and fuzzy MCDA methods are briefly discussed. Section 3 includes the applications of fuzzy MCDA techniques currently applied in hospital emergencies during the first pandemic wave. Section 4 and Section 5 suggest possible implications in first responders’ emergency professionals, as well as in other areas, while Section 6 presents future implications of this procedure. Finally, the obtained results are shortly presented in Section 7.

Research Methodology

In this paper, a literature search using primary sources, such as scientific articles, and secondary, such as bibliographic indexes, databases, and web pages, was conducted. More specifically, PubMed, Embase, SciELO, Science Direct Scopus, and Web of Science were used, employing keywords including COVID-19, coronavirus 2019, SARS-CoV-2, 2019-nCoV, fuzzy MCDA, multi-criteria decision analysis, MCDM + COVID-19, fuzzy MCDM + COVID-19. We used articles published from 10 January 2020 until 25 March 2021, although some previous studies were included to analyze the basic principles of the multi-criteria decision analysis method in general. The following exclusion criteria were used: i. studies with old data (out of COVID-19), and ii. present inappropriate topics, being not pertinent to the main focus of the review. The information treatment was performed by the eight authors of the review. Finally, the articles were discussed by the authors to write this review.

2. Basic Principles in Fuzzy Multi-Criteria Decision Analysis

Multi-criteria decision analysis (MCDA) is currently one of the most well-known topics of decision making. In a multi-criteria decision-making problem, several alternatives are evaluated with respect to several criteria to select the best feasible alternative(s) [10]. MCDA is an effective tool for helping decision-makers, such as first-response emergency professionals, to find an optimal alternative when solving complex selection problems including decisions that may involve life and death. This technique in particular, MCDA, uses a decision matrix to provide a systematic analytical approach for establishing the criteria and rank of the considered alternatives. Specifically, according to Diaby and Goeree (2014) [11], the fundamental steps in a multi-criteria decision analysis are the following: first, to define the problem and generate alternatives; second, to identify the criteria to compare alternatives; third, to gather value judgments on the relative importance of the criteria; forth, to screen/eliminate clearly inferior alternatives; fifth, to determine the performance of the alternatives for the criteria; and sixth, to rank/select the final alternative(s).

MCDA would refer to a structured decision-making process that allows assessing and easily synthesizing available evidence to facilitate the decision process and estimate risks involve. In other words, MCDA would refer to any decision-making technique involving the numerical analysis of alternatives by determining the relevant criteria and alternatives; assessing the relative impact of the alternatives on those criteria; and finally ranking the alternatives [10]. The initial framework, introduced by Saaty [12], (i.e., the analytical hierarchy process—AHP) used pair-wise comparison matrices and provided weights for the different criteria of decision making. More recently, Rezae developed the best–worst method [13,14]. In this case, the best against the other criteria—and the other against the worst criterion—are evaluated using linear and non-linear models, presenting the advantage of including a lower number of comparisons [15]. Based on the best–worst method, more recent approaches are also proposed [16].

In hospital settings, MCDA models (e.g., AHP, and the decision-making trial and evaluation laboratory method—DEMATEL) have previously been used towards a better preparation for major disasters, by calculating and describing the interrelations of criteria and sub-criteria weights [17]. Additionally, the technique for order of preference by similarity to ideal solution (TOPSIS) was used to evaluate healthcare facilities in the study of Hosseini et al. [14]. More recently, a hybrid model—the A.D.T. model—based on the three above-mentioned ones was proposed to evaluate the disaster readiness of the emergency departments for disaster situations, facilitating the consideration of how well the health system or program is performing in Colombia [18]. Similar “conventional” MCDA methods were also applied in hospitals during this pandemic, which aimed to map areas susceptible to infection [19] as well as to analyze the risk of infection in different urban areas [20].

However, real-world problems are usually too complex and often include imprecision or vagueness, and are inherent to data or information, thus, requiring a more “sensitive” approach. In this context, if MCDA refers to making decisions in the presence of multiple and usually conflicting criteria, fuzzy decision-making analysis is precisely used where vague and incomplete data exist for the solution [21]. Indeed, fuzzy multi-criteria decision-making (fCMDM) analysis is one of the most popular problems handled by researchers in the literature [22]. The application of fuzzy sets has been widely used in several scientific areas, such as computer science, artificial intelligence, social sciences, management, etc., as an extension of the conventional MCDA methods previously mentioned [23].

Similar to MCDA, fMCDM assesses alternatives with respect to the criteria through either a single decision maker or a committee of decision makers, where suitability of the alternatives is based on predetermined criteria, and the importance or weights of such criteria [9,10,24,25,26]. However, the distinctive feature of fMCDM is that a fuzzy number does not refer to one single value but rather to a connected set of possible values, where each possible value has its weight between zero and one [10]. In other words, this can be understood as an extension of the Boolean logic, based on true—1 and false—0 values, with nothing in between. This is important because fuzzy numbers allow to consider uncertainty by using intervals. In other words, a fuzzy number equals a fuzzy interval [21].

In sum, fMCDM conveys uncertainty and risk that may compromise the decision-making process. In this context, the fuzzy logic provides a useful way to approach decision making [24]. Furthermore, most decision making in daily life would fall within this category in including emergency responses in COVID-19 [26]. Finally, in a relatively recent study, Kahraman et al. (2015) [24] surveyed the latest status of fuzzy multi-criteria decision-making methods and found the following two main methods: fuzzy multi-attribute decision-making (fMADM) and fuzzy multi-objective decision-making (fMODM). However, most of the publications were on fMADM since there are plenty of classical multi-attribute decision-making methods in the literature, particularly in the context of first-responder emergency professionals.

3. Applications of Different Fuzzy Techniques on First COVID-19 Wave in Hospital Emergencies

The prevention and control of COVID-19 has become a global priority throughout the world. The measures adopted by the different governments in terms of containment and control continuously may affect the mental and general health as well as the living conditions of the citizens [1,2]. A gradual adaptation process scientifically agreed to achieve a return and adaptation to the “new normal” [19].

Artificial intelligence, big data as well as mathematical modeling and processing, have helped enormously to justify and understand the behavior of the virus from an epidemiological point of view. Indeed, providing important information on various parameters and their effects in different scenarios. Yet, these traditional models and mathematical analyses are insufficient in the case of infections caused by different strains of the virus [27].

To solve this new difficulty, integrative models such as “fuzzy logic” may be a useful mathematical tool for handling various types of uncertainties as in the case of these new virus strains. The fuzzy logic framework can be used in different types of disease diagnosis, mainly chronic non-communicable, but few infections in which the knowledge of the doctors and experts is represented on behalf of the symptoms and diseases [28]. In addition, fuzzy logic has been used for the increase, optimization, and preparation of hospitals placed in low- and medium-resource countries facing natural disasters, or as in the present case, with COVID-19 [18].

Under the COVID-19 umbrella and the fuzzy logic framework, works such as those of Shaban et al. [29] can be made an example of. A patient detection model based on laboratory techniques (RT-PCR) and radiological diagnostic tests using a fuzzy inference engine, and a deep neural network technique, was proposed. The experimental results have shown that the proposed hybrid diagnostic strategy (HDS) outperformed the other competitors in terms of the average value of precision, recovery, and F-value in which it provides approximately 97.658%, 96.756%, 96.55%, and 96.615%, respectively, with the lowest error value of 2.342% [30,31]. Furthermore, Sethy and Behera [32] used the CNN model to classify two classes that achieved an accuracy rate of 95.38%. Xu et al. [33] used two CNN three-dimensional classification models for two classes of chest images, obtaining an 86.7% precision with the data collected from the two classes. Wang et al. [34] analyzed 325 COVID-19 CT images and 325 CT images obtaining an 89.5% success rate using the inception transfer-learning model.

From a pharmacological perspective, studies such as those of Yildirim et al. [8] used Diffuse PROMETHEE and VIKOR fuzzy systems to evaluate the most suitable pharmacological interventions for COVID-19 treatment. Favipiravir (FPV), lopinavir/ritonavir, hydroxychloroquine, interleukin-1 blocker, intravenous immunoglobulin (IVIG), and plasma exchange were analyzed. The results showed that plasma exchange was the most preferred alternative, followed by FPV and IVIG, while hydroxychloroquine was the least favorable. The authors conclude that either PROMETHEE or VIKOR fuzzy systems are optimal tools to help decision makers choose the appropriate treatment technique for the management of COVID-19.

In this line, the work of Batur Sir and Sir (2021) [35] was based on using a multi-criteria decision-making methodology, aiming to guide physicians in the selection and classification of various alternatives for the treatment of pain in patients with COVID-19. First, the criteria and sub-criteria that affect clinical treatment preferences were defined. Then, the weight values were determined for these criteria, since they have different degrees of importance for the problem. At this stage, hesitant fuzzy linguistic term sets (HFLTSs) are used and therefore experts can convey their ideas more accurately. In this first phase of the study, an integrated HFLTS and analytic hierarchy process (AHP) method were used. Subsequently, possible treatment alternatives were evaluated using the vise kriterijumska optimizacija I kompromisno resenje (VIKOR) method. Based on the results obtained when considering expert evaluations, the most preferred treatment is the administration of paracetamol, followed by interventional treatments, opioids, and non-steroidal anti-inflammatory drugs (NSAIDs).

From the point of view of prevention, control, and personal safety equipment regarding COVID-19, Fu et al. [36] used fuzzy logic programming to identify and summarize the set of common medical products used in hallways and household disinfectant products based on recommendations from the World Health Organization and the Center for Disease Control (CDC). Among them, thermometers, disinfectants, face masks, gloves, or oximeters. Yet, these results helped to guide the development and programming of disinfectant products and sanitize protocols for public and private places.

In the primary sector, Palou et al. [37] used the fuzzy delphi method (FDM) and the fuzzy analytical hierarchy process (FAHP) to study the impact of the COVID-19 pandemic on the Iranian poultry supply chain. The authors identified disruptions associated with each stage of the production chain, suggesting that the pandemic has further affected input supply as a stage in the poultry supply chain. This is probably because the poultry industry is highly dependent on the flow of inputs. Furthermore, the governance of the supply chain was seriously affected due to the persistence of the pandemic.

In hospital emergencies, distributive justice and the maximization of global benefit among patients is a decision based on triage. As seen in the previous waves of COVID-19, an overwhelm of the outpatient facilities, emergency departments, hospitals, and intensive medical services has been seen [38]. It impacts available resources, both at the level of structures, equipment and professionals, with serious consequences on the results of patients, their families, their health professionals, and society in general. There is, temporarily, an imbalance between clinical needs and effective availability of health resources.

This exceptional situation should be handled like “medicine of catastrophe” [39], applying exceptional crisis care based on distributive justice and in the adequate allocation of health resources. Indeed, healthcare systems and providers must be prepared to obtain the greatest benefit of limited resources and mitigating harm to people, to the healthcare system, and society.

In the case of the current pandemic, hospitals are the cornerstone, and emergency care, which is essential to safeguard the lives of millions of patients. However, both hospital resources and emergency room beds are limited. Thus, some organizations such as the SMYCIUC, formed by specialists in intensive medicine, have made some guidelines for the objectification of the decision-making process of the patient in hospital emergencies [40], they are as follows:

  • Ensure the presence of an emergency contingency plan that plans the distribution of patients between geographic areas;

  • Ensure the possibility of transfer or referral to another hospital with available and greater resources;

  • If the patient cannot be transferred, assess the possibility of expanding the capacity of local emergency hospitals (E.g., Zendal Hospital in Madrid, Spain, recently opened due to the 9% weekly exponential number of cases) [41];

  • In the case of disproportion between demand and possibilities, it is lawful to establish an admission triage among patients, based on the principle of distributive justice, avoiding following the usual criterion of “the first in arriving is the first to receive assistance”. These triage protocols consist of a system of rules that are applied in the framework of scarce resource situations to help make decisions fairly and transparently [40,42,43] (see Table 1);

  • Solidarity between centers is a priority to maximize the common good for above the individual good.

Table 1.

Decision based on triage for hospital emergencies.

Triage Patient Categorization Patient Description Recommendation
Patient with priority I Critical and unstable patients. Need of intensive monitoring and treatment which cannot be provided outside the ICU (invasive mechanical ventilation, continuous renal clearance …). First priority for admission intensive care.
Patient with priority II Require intensive monitoring and may require interventions immediately. They are patients who will not be ventilated invasively but with high oxygen therapy requirements with PaO2/FiO2 less than 200 or less than 300 with failure of another organ. After patients with priority 1. Encourage admission in intensive care.
Patient with priority III These are unstable and critical patients who have little chance of recovery from their underlying or acute illness. They can receive intensive treatment to alleviate their acute illness, but also establish their therapeutic limits, such as not intubating and/or not attempting resuscitation. In cases of crisis, will not be admitted to units of intensive care.
Patient with priority IV Patients whose admission is not generally indicated due to a minimum benefit or unlikely due to low-risk disease. Patients whose terminal illness and irreversible makes his death imminent. In cases of crisis, will not be admitted to units of intensive care.

4. Fuzzy Multi-Criteria Decision Analysis in First Responders’ Emergency Professionals

Considering the COVID-19 pandemic as a “natural disaster”, first responders’ emergency professionals are on the frontlines of supporting communities. Along with medical staff and paramedic teams previously analyzed, mental health counselors, police and law enforcement officers, as well as military personnel were the first to confront the challenges of the ongoing coronavirus outbreak [44]. Although a considerable number of studies have been devoted to understanding the mental health consequences of this period on the above-mentioned professional groups [45,46], less attention has been given to the decision-making process in threatening situations that may depend on a variety of factors, such as the governments’ targeting, cultural influences, colleagues’ opinions, and subjective judgments.

This pandemic is a unique threat to mental health in the general population [47], while people with physical disabilities and hospitalized patients with confirmed COVID-19 are considered more vulnerable [48,49]. The exacerbation of pre-existing mental issues, although only significant in patients with mild symptoms, is also obvious [43]. In this situation, mental health counselors have to deal with a wide range of psychiatry issues, including anxiety and depression [50], in both non-infected and COVID-19 survivors. Specific population groups such as females, people aged 40 years old and younger, singles, students, people with poor general health status, racial and ethnic minority groups, individuals with a higher educational background, and medical staff, were most associated with depression symptoms and stress-related disorders [47,51,52] (Figure 1). Moreover, job loss or income insecurity has negatively affected mental health in adults [53].

Figure 1.

Figure 1

Priority groups for mental health counselors during the COVID-19 pandemic.

Considering the above-mentioned observations, the establishment of different weights of criteria to identify the priority groups, as applied by the fMCDM method, towards the implication of intervention strategies for moderating the negative impact of COVID-19 on mental health may have significant importance. Complementarily, individuals at a higher risk of suicide should be identified as part of a diagnostic approach and get additional support. Nevertheless, to the author’s knowledge there are no available data referring to the fuzzy method applied by mental health workers during the first or the second pandemic wave while, in general, the respective approaches in social psychology research are scarce [54]. Since the long-term adverse consequences of the coronavirus outbreak on mental health are not yet fully realized, while historically it may last longer compared to the physical health effects, the application of the fMCDM method should be also extended to this emergency group in terms of a comprehensive response to this pandemic.

The duties and responsibilities of police and law enforcement officers consist of fighting the crime and enforcing the law. This unprecedented situation characterized by uncertainty and disorientation created additional duties, namely, to protect communities and prevent the spread of COVID-19. These actions include the encouragement of social distancing and use of face masks, enforcing lockdown rules, imposing travel restrictions, maintaining public order and crowd control, and, additionally, ensuring the safety of health professionals and equipment. One of the main challenges of this crisis for this professional group, however, is to maintain communication with the citizens, especially those affected, create a connection with essential social services for the more vulnerable individuals, provide humanitarian support, while also reducing the rates of specific types of crimes (e.g., domestic violence) [55,56].

In this sense, policing strategies should probably be reconsidered to prioritize responsibilities [57]. In fact, a previous study recommended changes in policy styling during various stages of disasters, aiming to maximize effectiveness [58]. In a study that applied the “least–worst” multi-criteria decision-making method (i.e., actions of high risk with possible negative consequences), it was found that police officers’ gender and previous military experience influenced this process [59]. In the lack of studies focusing on the fMCDM method during the pandemic, characterized by time pressure, incomplete knowledge and limited resources by police and law enforcement officers, individual differences such as personality traits, intuitive styles, and sacred values should also be taken into account.

The MCDA method has also profound implications in the military decision process as the problems faced by the personnel are complex and particularly risky, frequently involving serious issues, for instance, the country’s defense. Selecting the bases site, weapon systems, training equipment, or even the location of military hospitals, and organizing peacekeeping missions have previously used the MCDA method, often with fuzzy logic [60,61,62]. Being highly skilled in disaster management, military personnel have a significant contribution in tackling the COVID-19 pandemic. The transportation of medical supplies and health workers, disinfection of public places, deploying military medical professionals to hospitals, producing medical supplies, or even testing the effectiveness of possible vaccines, among others, are some of the contributions to the frontline services. Since no data regarding the application of the fMCDM method in military professionals during this emergency period are available, future possibilities may include the advisory and the more active role based on previous experience in crisis leadership [63].

5. Application of Fuzzy Multi-Criteria Decision Analysis in Other Areas

Fuzzy multi-criteria decision systems have been used since the early 1990s. They were firstly used in the commercial–economic sphere to assess and analyze the liquidity and debt capacity of people applying for a credit card in Germany. Ten years after this first attempt, MCDM was applied including some modifications to assess military weapon systems [64]. Yet problems arrived with it, the first of these, which was solved with the traditional MCDM, was the multiple objectives of the evaluations of these weapons systems; the second problem referred to the representations of the systems, which meant the inclusion of fuzzy MCDM techniques. With the use of triangular fuzzy number scales, a judgment matrix was elaborated to be able to carry out similes and verifications. Thus, it was possible to achieve an optimal index to obtain the highest level of satisfaction from the person who had to make the decision [9].

Indeed, MCDM has also been used in the selection of suppliers through the application of the fuzzy DEMATEL, which is based on the study and development of matrices and diagrams until reaching a structure of causal relationships. This technique allows evaluating a series of criteria that are compared in pairs and, later, classified into levels. Thus, allowing to establish direct relationships between these criteria to obtain the most appropriate in each case, including qualitative and quantitative aspects, to choose the more positive [65].

In other areas such as knowledge management, it is known that different variables may impact MCDM success. Yet, with more traditional prediction systems there is a tendency to forget qualitative nature variables as factors inherent to the people and the environment [60]. With the fuzzy multi-criteria decision approach, these limitations have been overcome and it has been possible for organizations to identify all the options and variables that will determine the success or failure of the implementation of knowledge management. These are adapted to either the people that make up the institution as well as the organization itself, by analyzing the critical and essential factors within a finite set of alternatives, which are classified and valued using techniques such as simple additive weighting (SAW) or the analytical hierarchy process (AHP), among others [66].

Furthermore, other contexts in which the fuzzy multi-criteria decision method system has been used is in those related to energies, either renewable or traditional. Energy industries have intended to offer a cogeneration model that integrates different energies for the consumer in an efficient way [67]. Yet, the traditional single-criterion analysis model has been rejected once it has been analyzed that decision-making to achieve a trigeneration system, that is, the generation of electrical or mechanical energy simultaneously with heat or cooling with the source of heat only, has more than one feasibility study variable, which was usually economic [68]. Since the implementation of the MCDM model for the study and analysis of the decision criteria, it has been possible in this field to make a selection of weaknesses that appear first. Thus, giving way to the acceptable alternatives and their subsequent classification and analysis, and offering the most valuable alternative is essential. In this line, the ordering of preferences by similarity with the ideal solution (TOPSIS) or the weighted sum method (WSM) are the methods of recent use in this field [69].

6. Future of the Fuzzy Multi-Criteria Decision Analysis

Although a relatively recent research method, the use of multi-criteria methodologies is still emerging and exponentially becoming widespread in the international scientific community [54] to approach difficult decision-making situations in a simpler way. As shown in previous studies, it has been applied successfully as an optimal decision-maker methodology to address complex situations [68,70]. Not only in engineering has commercial or energy fielded, but also to become relevant in the medical sector. The reviewed applications of fMCDA and fMCDM reaffirm their huge contribution in real-life scenarios such as the COVID-19 pandemic. The future in fMCDA must become clear, and the more we understand the importance of fMCDA decision sciences within the different scientific fields, the earlier we will succeed in the large variety of fuzzy sets [9], obtaining an improvement in social health of population [1]. Actually, this is an important fact to consider, specially in emergency first interventions team as practitioners, nurse or psychologies [71,72].

Uncertainty is one of the biggest challenges in different areas. Most networks and especially new settings such as those created in the medical field, for example, the present outbreak of a new virus, are affected by various sources of uncertainty. This uncertainty becomes hard to handle when it leads to increased variability of the effects on patients. Therefore, making explicit the risk linked to the future decision action plan may be an asset for supporting the decision of the health managers. The research on input uncertainty can be added to the study of COVID-19. Certain methods, such as TOPSIS, can manage this situation and several decision-making problems. Also, these new methods were applied in fuzzy environment and could overcome the drawbacks of the existing methods for maldistributed decision making.

As it was mentioned above, fMCDA has been used to reduce uncertainty and shortcomings of the decision-making progress [73]. Regarding its future, fMCDA could avail to deal with dubious and subjective data, minimizing ambiguity and dubiousness during the evaluation process in future matters such as the present pandemic. In this line, the hesitant fuzzy set theory coupled with the TOPSIS tool was applied to finding the most significant risk factor for the spread of the COVID-19 disease, and again TOPSIS to compare the confusion about choosing an effective diagnostic method in order to compare the SARS-CoV-2 diagnostic tests with each other, or evaluation of its risk assessment [74].

As we continue to understand the behavior and characteristics of COVID-19, future research directions will be diverse. In this line, the application to the psychology area, highly impacted in the COVID-19 pandemic [75,76]. In the medical sector, decision-makers have to evaluate both the qualitative and quantitative criteria. Detecting infected cases and tracking people who may be infected is a daunting task, in which technology may play an effective role.

Future fuzzy multi-criteria decision analysis methodology could be used to explore different variables, such as isolation planning, the location for quarantine centers, safe nursing homes, safe homes, safe mask, and an epidemic controlling model and intensive care unit beds augmentation model for COVID-19 hospitals to assure care for a large number of people. Research involving different lockdown models or controlling the population who has developed antibodies of COVID-19 can guarantee better distribution of personnel for COVID-19 management. Detailed research and data analytics will help in understanding the level of community spread. Moreover, new variants of the SARS-CoV-2 virus are detected every week, so the decision criteria must ensure that the current testing, treatment, and vaccines are still effective or examine new ways of tackling the virus effect. The use of the fuzzy-based MCDM method can also be adjusted according to the specific situation of the patient.

7. Conclusions

The present systematic review examined the existing and possible applications of the fuzzy MCDA method for facing issues and challenges related to the ongoing COVID-19 pandemic, as realized by healthcare workers and various professional groups characterized as first responders, as well as in other areas. Additionally, specific results of the application of this method during the first pandemic wave were discussed. Finally, further suggestions related to this methodology to confront the uncertainty caused by this crisis were presented.

Author Contributions

Conceptualization, V.J.C.-S. and J.F.T.-A.; investigation, E.N.-J.; writing—original draft preparation, all authors; writing—review and editing, all authors; supervision, V.J.C.-S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Clemente-Suárez V.J., Dalamitros A.A., Beltran-Velasco A.I., Mielgo-Ayuso J., Tornero-Aguilera J.F. Social and psychophysiological consequences of the COVID-19 pandemic: An extensive literature review. Front. Psychol. 2020;11:580225. doi: 10.3389/fpsyg.2020.580225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Clemente-Suárez V.J., Hormeño-Holgado A., Jiménez M., Benitez-Agudelo J.C., Navarro-Jiménez E., Perez-Palencia N., Maestre-Serrano R., Laborde-Cárdenas C.C., Tornero-Aguilera J.F. Dynamics of population immunity due to the herd effect in the COVID-19 pandemic. Vaccines. 2020;8:236. doi: 10.3390/vaccines8020236. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Solis J., Franco-Paredes C., Henao-Martínez A.F., Krsak M., Zimmer S.M. Structural vulnerability in the US revealed in three waves of COVID-19. Am. J. Trop. Med. Hig. 2020;103:25–27. doi: 10.4269/ajtmh.20-0391. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Conti P., Caraffa A., Gallenga C.E., Kritas S.K., Frydas I., Younes A., Di Emidio P., Tetè G., Pregliasco F., Ronconi G. The British variant of the new coronavirus-19 (Sars-Cov-2) should not create a vaccine problem. J. Biol. Regul. Homeost. Agents. 2021;35:1–4. [PubMed] [Google Scholar]
  • 5.Siu G.K.-H., Lee L.-K., Leung K.S.-S., Leung J.S.-L., Ng T.T.-L., Chan C.T.-M., Tam K.K.-G., Lao H.-Y., Wu A.K.-L., Yau M.C.-Y., et al. Will a new clade of SARS-CoV-2 imported into the community spark a fourth wave of the COVID-19 outbreak in Hong Kong? Emerg. Microbes Infect. 2020;9:2497–2500. doi: 10.1080/22221751.2020.1851146. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Tsang H.F., Chan L.W.C., Cho W.C.S., Yu A.C.S., Yim A.K.Y., Chan A.K.C., Wong S.C.C. An Update on COVID-19 Pandemic: The Epidemiology, Pathogenesis, Prevention and Treatment Strategies. Expert Rev. Anti-Infect. Ther. 2021;29:1–12. doi: 10.1080/14787210.2021.1863146. [DOI] [PubMed] [Google Scholar]
  • 7.Pamučar D., Žižović M., Marinković D., Doljanica D., Jovanović S.V., Brzaković P. Development of a multi-criteria model for sustainable reorganization of a healthcare system in an emergency situation caused by the COVID-19 pandemic. Sustainability. 2020;12:7504. doi: 10.3390/su12187504. [DOI] [Google Scholar]
  • 8.Yildirim F.S., Sayan M., Sanlidag T., Uzun B., Ozsahin D.U., Ozsahin I. Comparative evaluation of the treatment of COVID-19 with multicriteria decision-making techniques. J. Healthc. Eng. 2021;2021:8864522. doi: 10.1155/2021/8864522. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Abdullah L. Fuzzy Multi Criteria Decision Making and its Applications: A Brief Review of Category. Procedia Soc. Behav. Sci. 2013;97:131–136. doi: 10.1016/j.sbspro.2013.10.213. [DOI] [Google Scholar]
  • 10.Carlsson C., Fullér R. Fuzzy multiple criteria decision making: Recent developments. Fuzzy Set Syst. 1996;78:139–153. doi: 10.1016/0165-0114(95)00165-4. [DOI] [Google Scholar]
  • 11.Vakaramoko Diaby V., Goeree R. How to use multi-criteria decision analysis methods for reimbursement decision-making in healthcare: A step-by-step guide. Expert Rev. Pharm. Outcomes Res. 2014;14:81–99. doi: 10.1586/14737167.2014.859525. [DOI] [PubMed] [Google Scholar]
  • 12.Saaty R.W. The Analytic Hierarchy process—What it is and how it is used. Math. Model. 1987;9:161–176. doi: 10.1016/0270-0255(87)90473-8. [DOI] [Google Scholar]
  • 13.Rezaei J. Best-worst multi-criteria decision-making method. Omega. 2015;53:49–57. doi: 10.1016/j.omega.2014.11.009. [DOI] [Google Scholar]
  • 14.Rezaei J. Best-worst multi-criteria decision-making method: Some properties and a linear model. Omega. 2016;64:126–130. doi: 10.1016/j.omega.2015.12.001. [DOI] [Google Scholar]
  • 15.Liang F., Brunelli M., Rezaei J. Consistency issues in the Best Worst Method: Measurements and thresholds. Omega. 2020;96:102175. doi: 10.1016/j.omega.2019.102175. [DOI] [Google Scholar]
  • 16.Faizi S., Sałabun W., Nawaz S. Best-Worst method and Hamacher aggregation operations for intuitionistic 2-tuple linguistic sets. Expert Syst. Appl. 2021:115088. doi: 10.1016/j.eswa.2021.115088. in press. [DOI] [Google Scholar]
  • 17.Hosseini S.M., Bahadori M., Raadabadi M., Ravangard R. Ranking hospitals based on the disasters preparedness using the TOPSIS technique in western Iran. Hosp. Top. 2019;97:23–31. doi: 10.1080/00185868.2018.1556571. [DOI] [PubMed] [Google Scholar]
  • 18.Ortiz-Barrios M.A., Aleman-Romero B.A., Rebolledo-Rudas J., Maldonado-Mestre H., Montes-Villa L., De Felice F., Petrillo A. The analytic decision-making preference model to evaluate the disaster readiness in emergency departments: The ADT model. J. Multi-Criteria Decis. Anal. 2017;24:204–226. doi: 10.1002/mcda.1629. [DOI] [Google Scholar]
  • 19.Sarkar S. COVID-19 Susceptibility Mapping Using Multicriteria Evaluation. Disaster Med. Public Health Prep. 2020;14:521–537. doi: 10.1017/dmp.2020.175. [DOI] [PubMed] [Google Scholar]
  • 20.Sangiorgio V., Parisi P. A multicriteria approach for risk assessment of Covid-19 in urban district lockdown. Saf. Sci. 2020;130:104862. doi: 10.1016/j.ssci.2020.104862. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Dijkman J.G., van Haeringen H., de Lange S.J. Fuzzy numbers. J. Math. Anal. Appl. 1983;92:301–341. doi: 10.1016/0022-247X(83)90253-6. [DOI] [Google Scholar]
  • 22.Kiker G.A., Bridges T.S., Varghese A., Seager T.P., Linkov I. Application of multicriteria decision anal-ysis in environmental decision making. Integr. Environ. Assess. Manag. Int. J. 2005;1:95–108. doi: 10.1897/IEAM_2004a-015.1. [DOI] [PubMed] [Google Scholar]
  • 23.Singh H., Gupta M.M., Meitzler T., Hou Z.-G., Garg K.K., Solo A.M.G., Zadeh L.A. Real-Life Applications of Fuzzy Logic. Adv. Fuzzy Syst. 2013;581879:1–3. doi: 10.1155/2013/581879. [DOI] [Google Scholar]
  • 24.Kahraman C., editor. Fuzzy Multi-Criteria Decision Making: Theory and Applications with Recent Developments. Volume 16 Springer; Berlin, Germany: 2008. [Google Scholar]
  • 25.Guo S., Zhao H. Fuzzy best-worst multi-criteria decision-making method and its applications. Knowl. Based Syst. 2017;121:23–31. doi: 10.1016/j.knosys.2017.01.010. [DOI] [Google Scholar]
  • 26.Tischler G.L. Decision-making process in the emergency room. Archives Gen. Psychiatry. 1966;14:69–78. doi: 10.1001/archpsyc.1966.01730070071009. [DOI] [PubMed] [Google Scholar]
  • 27.Sharma M.K., Dhiman N., Mishra V.N. Mediative fuzzy logic mathematical model: A contradictory management prediction in COVID-19 pandemic. Appl. Soft Comput. 2021;105:107285. doi: 10.1016/j.asoc.2021.107285. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Dhiman N., Sharma M.K. Mediative Sugeno’s-TSK fuzzy logic based screening analysis to diagnosis of heart disease. Appl. Math. 2019;10:448–467. doi: 10.4236/am.2019.106032. [DOI] [Google Scholar]
  • 29.Shaban W.M., Rabie A.H., Saleh A.I., Abo-Elsoud M.A. Detecting COVID-19 patients based on fuzzy inference engine and Deep Neural Network. Appl. Soft Comput. 2021;99:106906. doi: 10.1016/j.asoc.2020.106906. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Ozturk T., Talo M., Yildirim E.A., Baloglu U.B., Yildirim O., Rajendra Acharya U. Automated detection of COVID-19 cases using deep neural networks with X-ray images. Comput. Biol. Med. 2020;121:103792. doi: 10.1016/j.compbiomed.2020.103792. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Pirouz B., Shaffiee Haghshenas S., Shaffiee Haghshenas S., Piro P. Investigating a serious challenge in the sustainable development process: Analysis of confirmed cases of COVID-19 (new type of Coronavirus) through a binary classification using artificial intelligence and regression analysis. Sustainability. 2020;12:2427. doi: 10.3390/su12062427. [DOI] [Google Scholar]
  • 32.Sethy P.K., Behera S.K. Detection of Coronavirus Disease (COVID-19) Based on Deep Features. Preprints. 2020:2020030300. doi: 10.20944/preprints202003.0300.v1. [DOI] [Google Scholar]
  • 33.Xu X., Jiang X., Ma C., Du P., Li X., Lv S., Li L. A deep learning system to screen novel Coronavirus disease 2019 pneumonia. Eng. Beijing China. 2020;6:1122–1129. doi: 10.1016/j.eng.2020.04.010. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Wang J.-J., Jing Y.-Y., Zhang C.-F., Zhao J.-H. Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew. Sustain. Energy Rev. 2009;13:2263–2278. doi: 10.1016/j.rser.2009.06.021. [DOI] [Google Scholar]
  • 35.Batur Sir G.D., Sir E. Pain Treatment Evaluation in COVID-19 Patients with Hesitant Fuzzy Linguistic Multicriteria Decision-Making. J. Healthc. Eng. 2021;8831114:1–11. doi: 10.1155/2021/8831114. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Fu Y.-L., Liang K.-C. Fuzzy logic programming and adaptable design of medical products for the COVID-19 anti-epidemic normalization. Comput. Methods Programs Biomed. 2020;197:105762. doi: 10.1016/j.cmpb.2020.105762. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Palouj M., Lavaei Adaryani R., Alambeigi A., Movarej M., Safi Sis Y. Surveying the impact of the coronavirus (COVID-19) on the poultry supply chain: A mixed methods study. Food Control. 2021;126:108084. doi: 10.1016/j.foodcont.2021.108084. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Oliveira J.F., Jorge D.C., Veiga R.V., Rodrigues M.S., Torquato M.F., Silva N.B., Andrade R.F. Mathematical modeling of COVID-19 in 14. 8 million individuals in Bahia, Brazil. Nat. Commun. 2021;12:1–13. doi: 10.1038/s41467-020-19798-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Caetano M.A.L. Can Catastrophe Theory Explain Expansion and Contagious of Covid-19? medRxiv. 2021 doi: 10.1101/2021.01.02.21249133. [DOI] [Google Scholar]
  • 40.Crítica y Unidades Coronarias. Semicyuc.org Website Recomendaciones Éticas Para La Toma De Decisiones En La Situación Excepcional De Crisis Por Pandemia Covid-19 En Las Unidades De Cuidados Intensivos. (SEMICYUC). Semicyuc.org Website. [(accessed on 20 April 2021)]; Available online: https://semicyuc.org/wp-content/uploads/2020/03/%C3%89tica_SEMICYUC-COVID-19.pdf.
  • 41.Madrid’s New COVID-19 Hospital Faces Backlash. Cgtn.com Website. [(accessed on 20 April 2021)]; Available online: https://newseu.cgtn.com/news/2020-12-03/Madrid-s-new-COVID-19-hospital-faces-backlash-VU85oyZLxe/index.html.
  • 42.Alzamora B., Barros R.T.V. Analysis and financial sustainability of MSW management in Belo Horizonte (Brazil) Int. J. Environ. Waste Manag. 2022 doi: 10.1504/IJEWM.2022.10035485. in press. [DOI] [Google Scholar]
  • 43.Depuydt P., Guidet B. Triage policy of severe Covid-19 patients: What to do now? Ann. Intensive Care. 2021;11:18. doi: 10.1186/s13613-020-00770-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Vujanovic A.A., Lebeaut A., Leonard S. Exploring the impact of the COVID-19 pandemic on the mental health of first responders. Cogn. Behav. Ther. 2021:1–16. doi: 10.1080/16506073.2021.1874506. [DOI] [PubMed] [Google Scholar]
  • 45.Zolnikov T.R., Furio F. Stigma on first responders during COVID-19. Stigma Health. 2020;5:375–379. doi: 10.1037/sah0000270. [DOI] [Google Scholar]
  • 46.De Kock J.H., Latham H.A., Leslie S.J., Grindle M., Munoz S.-A., Ellis L., O’Malley C.M. A rapid review of the impact of COVID-19 on the mental health of healthcare workers: Implications for supporting psychological well-being. BMC Public Health. 2021;21:104. doi: 10.1186/s12889-020-10070-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Xiong J., Lipsitz O., Nasri F., Lui L.M.W., Gill H., Phan L., McIntyre R.S. Impact of COVID-19 pandemic on mental health in the general population: A systematic review. J. Affect. Disord. 2020;277:55–64. doi: 10.1016/j.jad.2020.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Lebrasseur A., Fortin-Bédard N., Lettre J., Bussières E.-L., Best K., Boucher N., Routhier F. Impact of COVID-19 on people with physical disabilities: A rapid review. Disabil. Health J. 2021;14:101014. doi: 10.1016/j.dhjo.2020.101014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Li W., Yang Y., Liu Z.-H., Zhao Y.-J., Zhang Q., Zhang L., Xiang Y.-T. Progression of mental health services during the COVID-19 outbreak in China. Int. J. Biol. Sci. 2020;16:1732–1738. doi: 10.7150/ijbs.45120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Taquet M., Luciano S., Geddes J.R., Harrison P.J. Bidirectional associations between COVID-19 and psychiatric disorder: Retrospective cohort studies of 62 354 COVID-19 cases in the USA. Lancet Psychiatry. 2021;8:130–140. doi: 10.1016/S2215-0366(20)30462-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Giorgi G., Lecca L.I., Alessio F., Finstad G.L., Bondanini G., Lulli L.G., Mucci N. COVID-19-related mental health effects in the workplace: A narrative review. Int. J. Environ. Res. Public Health. 2020;17:7857. doi: 10.3390/ijerph17217857. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.McKnight-Eily L.R., Okoro C.A., Strine T.W., Verlenden J., Hollis N.D., Njai R., Thomas C. Racial and ethnic disparities in the prevalence of stress and worry, mental health conditions, and increased substance use among adults during the COVID-19 pandemic—United States, April and May 2020. Mmwr. Morb. Mortal. Wkly. Rep. 2021;70:162–166. doi: 10.15585/mmwr.mm7005a3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Alcover C.-M., Salgado S., Nazar G., Ramírez-Vielma R., González-Suhr C. Job Insecurity, Financial Threat and Mental Health in the COVID-19 Context: The Buffer Role of Perceived Social Support. MedRxiv. 2020 doi: 10.1101/2020.07.31.20165910. [DOI] [Google Scholar]
  • 54.Cengiz K., Onar S.C., Oztaysi B. Fuzzy multicriteria decision-making: A literature review. Int. J. Comput. Intell. Syst. 2015;8:637–666. [Google Scholar]
  • 55.Matarazzo G., Fernandes A., Alcadipani R. Police institutions in the face of the pandemic: Sensemaking, leadership, and discretion. Rev. Adm. Pública. 2020;54:898–908. [Google Scholar]
  • 56.Kofman Y.B., Garfin D.R. Home is not always a haven: The domestic violence crisis amid the COVID-19 pandemic. Psychol. Trauma Theory Res. Pract. Policy. 2020;12:S199–S201. doi: 10.1037/tra0000866. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Jennings W.G., Perez N.M. The immediate impact of COVID-19 on law enforcement in the United States. Am. J. Crim. Justice Ajcj. 2020;45:1–12. doi: 10.1007/s12103-020-09536-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Bonkiewicz L., Ruback R.B. The role of the police in evacuations: Responding to the social impact of a disaster. Police Q. 2012;15:137–156. doi: 10.1177/1098611112442808. [DOI] [Google Scholar]
  • 59.Shortland N., Thompson L., Alison L. Police perfection: Examining the effect of trait maximization on police decision-making. Front. Psychol. 2020;11:1817. doi: 10.3389/fpsyg.2020.01817. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Sánchez-Lozano J.M., Serna J., Dolón-Payán A. Evaluating military training aircrafts through the combination of multi-criteria decision-making processes with fuzzy logic. A case study in the Spanish Air Force Academy. Aerosp. Sci. Technol. 2015;42:58–65. doi: 10.1016/j.ast.2014.12.028. [DOI] [Google Scholar]
  • 61.Yilmaz B.Ö., Tozan H., Karadayi M.A. Multi-Criteria Decision Making (MCDM) Applications in Military Healthcare Field. J. Health Syst. Policies. 2020;2:149–181. [Google Scholar]
  • 62.Karadayi M.A., Ekinci Y., Tozan H. Operations Research for Military Organizations. IGI Global; Hershey, PA, USA: 2019. A fuzzy MCDM framework for weapon systems selection; pp. 185–204. [Google Scholar]
  • 63.Pearce A.P., Naumann D.N., O’Reilly D. Mission command: Applying principles of military leadership to the SARSCov-2 (covid-19) crisis. BMJ Mil Health. 2021;167:3–4. doi: 10.1136/bmjmilitary-2020-001485. [DOI] [PubMed] [Google Scholar]
  • 64.Karsak E.E., Ethem Tolga E. Fuzzy multi-criteria decision-making procedure for evaluating advanced manufacturing system investments. Int. J. Prod. Econ. 2001;69:49–64. doi: 10.1016/S0925-5273(00)00081-5. [DOI] [Google Scholar]
  • 65.Dalalah D., Hayajneh M., Batieha F. A fuzzy multi-criteria decision making model for supplier selection. Expert Syst. Appl. 2011;38:8384–8391. doi: 10.1016/j.eswa.2011.01.031. [DOI] [Google Scholar]
  • 66.Chang T., Wang T. Using the fuzzy multi-criteria decision making approach for measuring the possibility of successful knowledge management. Inf. Sci. 2009;179:355–370. doi: 10.1016/j.ins.2008.10.012. [DOI] [Google Scholar]
  • 67.Chou T.-Y., Chou S.-C.T., Tzeng G.-H. Evaluating IT/IS investments: A fuzzy multi-criteria decision model approach. Eur. J. Oper. Res. 2006;173:1026–1046. doi: 10.1016/j.ejor.2005.07.003. [DOI] [Google Scholar]
  • 68.Wang C.-N., Yang C.-Y., Cheng H.-C. A fuzzy multicriteria decision-making (MCDM) model for sustainable supplier evaluation and selection based on triple bottom line approaches in the garment industry. Processes. 2019;7:400. doi: 10.3390/pr7070400. [DOI] [Google Scholar]
  • 69.Kaya İ., Çolak M., Terzi F. A comprehensive review of fuzzy multi criteria decision making methodologies for energy policy making. Energy Strategy Rev. 2019;24:207–228. doi: 10.1016/j.esr.2019.03.003. [DOI] [Google Scholar]
  • 70.Khemiri R., Elbedoui-Maktouf K., Grabot B., Zouari B. A fuzzy multi-criteria decision-making approach for managing performance and risk in integrated procurement–production planning. Int. J. Prod. Res. 2017;55:5305–5329. doi: 10.1080/00207543.2017.1308575. [DOI] [Google Scholar]
  • 71.Soto-Baño M.A., Clemente-Suárez V.J. Psicología de emergencias en España: Delimitación conceptual, ámbitos de actuación y propuesta de un sistema asistencial. Papeles del Psicól. 2021;42:56–66. [Google Scholar]
  • 72.Soto-Baño M.A., Clemente-Suárez V.J. Psicología de emergencias en España: Análisis actual, normativa y proposición reguladora. Papeles del Psicól. 2021;42:46–55. [Google Scholar]
  • 73.Yao S. Fuzzy-based multi-criteria decision analysis of environmental regulation and green economic efficiency in a post-COVID-19 scenario: The case of China. Environ. Sci. Pollut. Res. Int. 2021:1–27. doi: 10.1007/s11356-021-12647-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Majumder P., Biswas P., Majumder S. Application of new TOPSIS approach to identify the most significant risk factor and continuous monitoring of death of COVID-19. Electron. J. Gen. Med. 2020;17:em234. doi: 10.29333/ejgm/7904. [DOI] [Google Scholar]
  • 75.Clemente-Suárez V.J., Navarro-Jiménez E., Jimenez M., Hormeño-Holgado A., Martinez-Gonzalez M.B., Benitez-Agudelo J.C., Perez-Palencia N., Laborde-Cárdenas C.C., Tornero-Aguilera J.F. Impact of COVID-19 Pandemic in Public Mental Health: An Extensive Narrative Review. Sustainability. 2021;13:3221. doi: 10.3390/su13063221. [DOI] [Google Scholar]
  • 76.Rodriguez-Besteiro S., Tornero-Aguilera J.F., Fernández-Lucas J., Clemente-Suárez V.J. Gender Differences in the COVID-19 Pandemic Risk Perception, Psychology, and Behaviors of Spanish University Students. Int. J. Environ. Res. Public Health. 2021;18:3908. doi: 10.3390/ijerph18083908. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Not applicable.


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES