Skip to main content
Heliyon logoLink to Heliyon
. 2024 Feb 28;10(5):e27241. doi: 10.1016/j.heliyon.2024.e27241

Identifying and ranking of the main organizational resilience indicators in the hospital during the COVID-19 pandemic: A study using fuzzy Delphi technique (FDT) and fuzzy analytical hierarchy process (FAHP)

Mojtaba Haghighat a, Seyed Mahdi Mousavi b,, Mahsa jahadi naeini b
PMCID: PMC10915563  PMID: 38449624

Abstract

Resilience in a hospital is referred to as the capability to withstand and respond to disasters while maintaining critical functions. The current study aims to identify and prioritize the defining indicators of organizational resilience in dealing with the critical conditions of the COVID-19 pandemic. First, a literature review and semi-structured interviews with experts were performed for the identification of the primary indicators affecting the hospital's organizational resilience in critical conditions caused by the COVID-19 disease. Next, the fuzzy Delphi technique (FDT) was used to determine the effective and final indicators with a 70% agreement level. Finally, the indicators were weighted and prioritized using the FAHP method. The results shows that three indicators of leadership and management (NW = 0.092), preparedness (NW = 0.080), and learning from previous experiences (NW = 0.078) had the greatest impact on the organizational resilience of the hospital, respectively. Three indicators of logistics support, fallibility culture, creativity, and innovation with the final weights of 0.56, 0.054, and 0.053 gained the least importance, respectively. It can be concluded that a higher level of leadership and management, preparedness, and learning from previous experiences in the conditions of the COVID-19 pandemic can help control this crisis.

Keywords: Hospitals, COVID-19, Resilience, Emergencies, Delphi technique, FAHP

1. Introduction

The occurrence of accidents and disasters affects the lives of humans around the world and hampers the development of nations and societies [1]. Accidents can be classified as natural accidents (such as earthquakes, floods, storms, and military events) and artificial accidents (such as biological events and radioactive material leakage) [2]. Epidemic viral-infectious diseases can be considered as a magnificent health challenge [3]. The first case of COVID-19 was reported in December 2019 in Wuhan, China. The rapid transmission of this virus led to the diagnosis of more than a million patients within a few months [4,5]. A significant increase in the number of infected patients creates a difficult condition for hospitals as the front lines of the medical system [6]. The role of hospitals and healthcare centers is very sensitive when accidents and disasters occur. Fast, optimal, and timely health-treatment services can reduce mortality and increase the number of survivors [[7], [8], [9]]. Therefore, it is very crucial to provide strategies for improving resilience in health and treatment centers [10]. In order to manage biological crises in hospitals, the identification of what it is found as the challenges for hospitals, along with solutions and measures, can be very effective [11]. In addition, in term of the design, the hospital must endure least damage during natural or man-made disasters and accidents. Also, their capacity and response to the health and medical needs of the community should be quickly increased [12]. Hospitals must have high organizational resilience to deal with such crises and disasters. Resilience refers to the hospital's capability to withstand and respond to disasters so that it can maintain its defined structure and perform its routine activities [13,14]. Some researchers presented a framework of resilience and methods of its measurement. Olu provided a resilient health system, as a conceptual framework for strengthening risk management of public health disaster [15]. Cimellaroin et al. mentioned the three important factors affecting hospital disaster resilience including cooperation and training management, resources and equipment capability, and structural and organizational operating procedures [16]. Zhong et al. performed a study on the resilience tool of hospitals in China and identified four final factors including emergency response capability, disaster management mechanism, hospital infrastructure safety, and disaster sources [17]. Anderson et al. explained a method for development of indicators of organizational resilience by establishing a balance between organizational processes and structures. They introduced risk awareness and cooperation as the main indicators of organizational resilience [18]. The results of the previous studies show that the determination of the indicators affecting resilience can result in a better analysis and more consistent planning in achieving a resilient hospital during epidemics and pandemics [19,20].

The Delphi technique can be employed in qualitative research with an exploratory aspect for the identification of the fundamental elements of a phenomenon [21]. This technique is a structured process for gathering information and obtaining group consensus. The main goal of this method is the consensus of a group of experts with various opinions. Researchers can identify the factors and develop a framework for their diagnosis using this process [22]. Given that experts’ opinions are highly subjective, it is recommended that fuzzy numbers are applied [23]. The fuzzy Delphi technique was first introduced in 1988 by Kaufman and Gupta. In this technique, the traditional Delphi and fuzzy theory have been combined [24]. The Delphi method has been applied in previous studies to identify the criteria required for the selection of sound control solutions in various industries and to determine safety indicators required for the evaluation of crisis management. Thus, this method can be used in various fields of occupational safety and health [25,26]. Considering that the importance of all identified indicators is not equal, the use of multi-criteria decision-making (MCDM) techniques can be helpful [27]. These techniques reveal the importance and weight of the criteria. One of the most common multi-criteria decision-making (MCDM) methods is the Analytical Hierarchy Process (AHP). This method was developed by Saati in 1980. It is known as a powerful and flexible technique for solving complex problems [28]. The AHP method combines objective and subjective evaluations with an integrated structure based on scales of paired comparisons, and it organizes the essential aspects of a problem with a hierarchical format [29]. In this method, because of the uncertainty of pairwise comparisons, decision-makers have difficulty expressing their opinion on superiority of elements. in order to solve this problem, fuzzy logic is used in the analytical hierarchy process method. In FAHP method, experts are asked to compare the elements and express their relative importance using fuzzy numbers [30]. Given the importance of the pandemic crisis, more studies are required to investigate the various indicators affecting organizational resilience. Therefore, the present study aims to identify and prioritize the important indicators of organizational resilience in a hospital during the COVID-19 pandemic.

2. Materials and methods

2.1. Hospital selection

The present study was conducted in one of the hospitals located in the southwest of Iran. With 300 staff members, this hospital was designated as a special center for the treatment and care of COVID-19 patients. Prior to the outbreak of the COVID-19, this hospital had covered a region with a population of around 180,000 people, whereas, this number soared to 200,000 during COVID-19. As the sole COVID-19 referral center, this hospital was also located in an area with a staggering number of Covid-19 death rate. Various factors such as being understaffed, lack of sufficient space, increase in staff working hours, etc. left this center with numerous challenges in providing services. In order for service provider centers such as hospitals to function normally under crises, resilience is of a great importance. Accordingly, identifying indicators related to resilience in this hospital is one of the necessities that can provide proper identification of the strengths and weaknesses of the center in the face of the COVID-19 crisis.

2.2. Study design

This descriptive-analytical study aimed to identify and prioritize the main indicators of organizational resilience in hospitals during the COVID-19 pandemic using fuzzy Delphi and FAHP methods. First, a literature review and semi-structured interviews were performed with the aim of identification of the primary indicators affecting the hospital's organizational resilience in critical conditions caused by the COVID-19 disease. Second, the fuzzy Delphi technique (FDT) was applied to determine the final indicators. Finally, the indicators were weighed and prioritized using the FAHP method. A detailed three-step description of the study is provided as follows.

2.3. Identifying resilience indicators related to hospitals

At this stage, the free review was done in valid databases such as Web of Science, Scopus, Google Scholar, SID, and Magiran using the keywords of resilience, organizational resilience, resilience engineering, resilient organizations, technical resilience, resilience indicators, measuring of resilience, resilience in crises, resilience in hospitals, resilience and major accidents, adaptive capacity, crisis, emergency management, and emergency preparedness. As inclusion criteria, quantitative and qualitative studies on hospital resilience in the field of crisis management were selected. In the next step, the titles were examined, duplicates and unrelated items were removed, and the abstracts of the remaining articles were studied. A total of 40 articles related to the topic were selected. Finally, the full texts of selected studies were received, and the primary indicators affecting organizational resilience were identified.

Moreover, in addition to free review, a semi-structured interview was performed with the head of the hospital, hospital managers, hospital supervisors and academic staff in order to identify indicators affecting resilience in the hospital. For this purpose, the subjects were asked to answer a question (which indicators can affect the hospital's resilience). The interviews were also recorded for more detailed analysis. In this research, due to the conditions created by the COVID-19, face-to-face and virtual interviews were conducted through communication platforms such as Skype and WhatsApp. A total of 40 semi-structured interviews were conducted. A total of 15 initial indicators affecting resilience obtained from free review and interviews were identified in this stage and entered the next stage in order to determine the final indicators.

2.4. The fuzzy-Delphi technique

The fuzzy Delphi method presented as follows in Fig. 1 [26,31].

Fig. 1.

Fig. 1

Steps of emplaning fuzzy Delphi Technique.

2.4.1. Selection of expert panel

First, the qualified experts were identified and the sampling was done according to convenience sampling method. Therefore, those who were willing to cooperate and also sought to familiarize themselves with the concepts of resilience in the hospital were included in the expert team as a sample size. A total of 40 people were selected as a team of experts to perform fuzzy Delphi method and FAHP. Then, they were briefed on the purposes and steps of the study. The final panel consisted of the hospital president, hospital managers, hospital supervisors, and academic staff. The average age of participating experts was 38.87 ± 6.1. The minimum and maximum age of the experts was 29 and 50 years, respectively, and the average work experience of people was 12 ± 4 years. Table 1 reports the detail of demographic characteristics of the expert panel.

Table 1.

Demographic characteristics of the expert panel (N = 40).

Variables Frequency Percent (%)
Age (year) Less than 30 5 12.5
31 to 35 7 17.5
36 to 40 13 32.5
41 to 45 8 20
More than 46 7 17.5
sex Male 18 45
Female 22 55
Education level Bachelor of Science 15 37.5
Master of Science 10 25
PhD 15 37.5
Marital status Single 10 25
Married 30 75
Job experience (year) 1–5 5 12.5
6–10 10 25
11–15 15 37.5
More than 15 10 25
Job position Hospital managers 10 25
Hospital supervisors 20 50
Academic staff 10 25

2.4.2. Collecting experts’ opinions

In this step, similar to the traditional Delphi method, the experts’ opinions were collected. In this method, linguistic variables were applied to design a questionnaire and gather experts' opinions (see Table 2).

Table 2.

Linguistic expression and importance score.

Linguistic expression Importance score
Very low 1
Low 2
Medium 3
High 4
Very high 5

2.4.3. Calculating the fuzzy value of each question

The linguistic expression of the criterion j from the viewpoint of an expert with the number i among persons is Wij = (aij, bij, cij). The value of j is equal to j = 1, 2, 3, …, m and the value of i is equal to i = 1,2,3, …, n. In this step, the fuzzy value of criterion j was calculated by the following equation, which is equal to Wj= (aj, bj, cj).

aj=min{aij} (1)
bj=1ni=1nbj (2)
cj=max{bij} (3)

2.4.4. Converting the fuzzy value

In this step, the obtained fuzzy value for each of the questions was converted to a de-fuzzified value. The following equation was used for this purpose.

Sj=aj+bj+cj3i=1,2,m (4)

2.4.5. Examining experts’ agreement

In this step, the acceptable level of consensus or agreement of experts was 70 percent. This level of agreement was determined based on previous studies that used the fuzzy Delphi method [26,30].

2.5. Fuzzy hierarchy analysis methods (FAHP)

Chang presented a method (in 1992) to extend the fuzzy hierarchical analysis process [32]. In the present study, this method was used to calculate the final weight of the indicators. The steps were as follows [30,33].

2.5.1. Defining fuzzy numbers

In this step, the linguistic words of experts were converted to fuzzy numbers, described in Table 3. The Fuzzy analytical hierarchical process was performed based on their criteria and opinions.

Table 3.

Linguistic words and their synonymous triangular fuzzy numbers.

Linguistic terms Fuzzy number scale Fuzzy numbers
Equally important 1 (1,1,1)
Equally important to slightly more important 2 (1,2,3)
Slightly more important 3 (2,3,4)
Slightly more important to more important 4 (3,4,5)
More important 5 (4,5,6)
More important to much more important 6 (5,6,7)
Much more important 7 (6,7,8)
Much more important to extremely more important 8 (7,8,9)
Extremely more important 9 (8,9,10)

2.5.2. Forming paired comparison matrix (A) using fuzzy numbers

The paired comparison was performed by the decision matrix, shown in Eq. (5).

A˜=[1M21Mn1M121Mn2M1nM2n1] (5)

2.5.3. Calculating Si

Si is the triangular fuzzy number related to the relative weight of each criterion which is calculated by Eq. (6).

Si=j=1mMgiJ×[i=1nj=1mMgiJ]1 (6)

In this equation, i, j and Mgij are the column number, row number, and fuzzy numbers of the paired matrix, respectively. j=1mMgiJ , i=1nj=1mMgii and [i=1nj=1mMgii]1 are computed using the following equations.

j=1mMgij=(j=1mlj,j=1mmj,j=1muj) (7)
i=1nj=1mMgij=(i=1mli,i=1mmi,i=1mui) (8)
[i=1nj=1mMgij]1=(1i=1mui,1i=1mmi,1i=1mli) (9)

2.5.4. Calculating possibility degree

If S1 = (l1, m1, u1) and S2 = (l2, m2, u2) are two triangular fuzzy numbers, the degree of possibility of S2 ≥ S1 is defined by the following equations.

V(S2S1)=hgt(S2S1)=μS1(d)={1ifm2m10ifl1u2l1u1(m2u2)(m1l1)otherwise (10)

On the other hand, the possibility degree of a triangular fuzzy number relative to k triangular fuzzy numbers was obtained by the following equations.

V(S2S1,S2,,SK)=V[(SS1)and(SS2)andand(SSk)]=MinV(SSi).i=1.2.3..k (11)

2.5.5. Calculating criteria weight

Equation (8) was used for computing the weight vector of criteria in the paired matrix.

d(Ai)=MinV(SiSk)k=1.2..n.ki (12)

Therefore, the non-normal weight vector will be as follows:

W=(d(A1).d(A2)..d(An))TAi(i=1.2..n) (13)

2.5.6. Calculating normal weight

To calculate the normal weight, the non-normal weight vector of the previous step was normalized by Eq. (10).

W=(d(A1).d(A2)..d(An))T (14)

As well as, the geometric mean value was used to combine experts’ opinions. It was computed by Eq. (11).

aij=(K=1KAijk)1KK=1.2..K (15)

2.5.7. Calculating consistency index

In this step, the consistency index was calculated using the Gogus and Boucher method to ensure the reliability of the results obtained [34]. The results showed that the consistency index of all matrices was less than 0.1. Therefore, the results were considered reliable.

2.6. Data analysis

MATLAB software (version 2018a) was used for calculating and analyzing data.

3. Result

The results showed that all identified indicators were appropriate. The experts' agreement for all criteria was higher than 70 percent. Table 4 represents the results of the fuzzy-Delphi technique.

Table 4.

The results of the fuzzy-Delphi technique.

Resilience Indictors in Hospitals (symbol) Importance spectrum
Fuzzy value aggregation
Defuzzied value Consensus Percentage
Very low (1) Low (2) Medium (3) High (4) Very high (5) L M U
Logistics support 0 3 2 31 2 2 3.65 5 3.57 0.775
Adaptive capacity 0 0 3 8 29 3 4.65 5 4.32 0.725
Planning strategy and goal setting 0 0 7 28 5 3 3.25 4 3.37 0.700
Responsibility 1 2 3 29 5 4 3.15 5 3.82 0.725
Preparedness 0 0 2 3 30 3 4.20 5 4.1 0.750
Resources (equipment and sufficient personnel) 0 1 5 28 6 2 3.95 5 3.72 0.700
Communication and teamwork 2 2 1 29 6 1 3.87 5 3.43 0.725
Effective public participation 0 2 3 5 30 2 4.57 5 4.03 0.750
Awareness of the situation 2 2 5 28 3 1 3 5 3 0.700
Leadership and management 0 0 5 5 30 3 4.62 5 4.31 0.750
Creativity and innovation 0 2 5 31 2 1 3.82 5 3.41 0.775
Fallibility culture 2 3 1 28 6 2 3.82 5 3.66 0.700
Learning from previous experiences 0 2 2 6 30 3 4.6 5 4.3 0.750
Education 0 0 3 30 7 3 4.1 5 4.05 0.750
Inter-organizational coordination 0 4 6 29 1 2 3.67 5 3.58 0.725

The results of FAHP in Table 5 indicated that three indicators of leadership and management (NW = 0.092), preparedness (NW = 0.080), and learning from previous experiences (NW = 0.078) had the greatest impact on the organizational resilience of the hospital, respectively. Also, three indicators of logistics support, fallibility culture, and creativity and innovation with the final weights of 0.56, 0.054, and 0.053 had the least importance, respectively.

Table 5.

The results of the Fuzzy Hierarchy Analysis methods (FAHP).

Resilience indicator Fuzzy weight
Relative weight (RW) Normal weight (NW)
L M U
Leadership and management 0.061 0.631 2.117 3.44 0.092
Preparedness 0.091 0.561 1.782 2.995 0.080
Learning from previous experiences 0.077 0.432 1.987 2.928 0.078
Adaptive capacity 0.091 0.432 1.798 2.753 0.074
Effective public participation 0.049 0.432 1.781 2.694 0.072
Awareness of the situation 0.112 0.422 1.630 2.585 0.069
Education 0.046 0.421 1.631 2.519 0.067
Planning strategy and goal setting 0.049 0.211 2.011 2.482 0.066
Responsibility 0.071 0.322 1.562 2.277 0.061
Resources (equipment and sufficient personnel) 0.036 0.321 1.578 2.256 0.060
Communication and teamwork 0.036 0.521 1.113 2.191 0.059
Inter-organizational coordination 0.076 0.142 1.812 2.172 0.058
Logistics support 0.081 0.421 1.186 2.109 0.056
Fallibility culture 0.025 0.321 1.371 2.038 0.054
Creativity and innovation 0.061 0.149 1.637 1.996 0.053

4. Discussion

In this study, 15 indicators were identified as the factors affecting the organizational resilience of the hospital during the COVID-19 pandemic. The results showed that leadership and management, preparedness, and learning from previous experiences were the most important indicators of organizational resilience in the hospital, respectively. Therefore, the mentioned factors play a defining role in creating and maintaining hospital resilience. The management and leadership behavior in any organization influences the thoughts and perception of employees as it keeps them motivated and guided [35,36]. Hence, the role of management and leadership style should be taken well into account to improve hospital resilience. The results of the studies performed by Jafari et al. and mahmoudi et al. showed that the most important indicator in organizational resilience is leadership and management, which is consistent with the findings of the present study [37,38]. Thus, a hospital or an organization will be resilient if it is led by strong leadership and management teams. Preparedness is defined as the prediction of unexpected events and the capability of timely and appropriate response. In a resilient organization, possible problems are predicted and necessary instructions, emergency response maneuvers, and practical exercises are executed. Davids et al. and Sunindijo et al. have introduced preparedness as one of the most important indicators in organizational resilience. The results of the present study showed that the preparedness with the final weight of 0.080 was the second important indicators of organizational resilience in the hospital, which is consistent with the findings of a study performed by Samsuddin et al. in Malaysian hospitals [39]. Zarrin and Azadeh also obtained similar results and concluded that preparedness and management commitment in emergencies are the two main components to determine the resilience level [40]. Based on the results of the present study, the indicator of learning from previous experiences, with a weight of 0.078, ranked as the third most important indicator of organizational resilience in the hospital. If the management has insufficient knowledge on the technical issues of resilience, serious decisions and actions are improbable. The results of a study performed by Billings et al., in 2021 showed that learning from previous experiences in dealing with crises is a very important item, which is in line with the findings of the present study. Hence, hospital managers should create a system for recording and analyzing the crises and disasters occurred in the organization. This information can be used for training of employees. The managers must plan ahead and have the foresight to avoid incidences, however, they should also accept the fact that crises and incidents may happen in an organization. Managers should avoid the strict and rigid controls and increase the organizational flexibility. Agile organizations with a flexible structure can be better adapted to environmental changes [41,42]. In the present study, the adaptability capacity with the final weight of 0.078 stood the fourth priority among indicators. Furthermore, several studies have introduced the factors of weak management and communication, structural problems, and inadequate budget as the most important problems of hospitals during a crisis, which is consistent with the findings of the present study. In the present study, effective public participation with final weight of 0.072 was recognized as another important indicator. Public association during crises, such as the COVID-19, can affect the transmission chain. The results of a study conducted by Farida et al. showed that the high level of public association plays an important role in reducing the infected people and the death rate due to COVID-19. The results of another study also indicated the important role of public association in controlling the COVID-19 disease. In addition, increase of awareness on this unknown disease can be helpful in public association [43,44]. Eventually,the education indicator in the present study had final weight of 0.067. The role of education, as an important indicator in organizational resilience, has been confirmed in several studies. To increase the knowledge on organizational resilience in the hospital, the use of educational models such as the health belief model (IBM) has been recommended by Zhou et al. [45].

5. Methodological limits

The present study was conducted as an example in just one hospital and with a limited number of experts. Considering that several indicators have an effect on resilience, it is recommended that the future studies be conducted in multiple hospitals or similar healthcare environments with a larger panel expert. Another limitation in this study is the internal relationships between organizational resilience indicators, which were ignored. Hence, it is suggested that the internal relationship between the indicators be determined using the DEMATEL technique and the ANP method in future studies. Also, the combination of the fuzzy Delphi technique (FDT) and FAHP techniques can be used to identify and prioritize the resilience indicators in other organizations.

6. Conclusion

The results of this study provide helpful information for hospital managers to plan and improve the resilience of hospitals during crises, such as the COVID-19 pandemic. Moreover, the strengths of this study were the identification and prioritization of indicators affecting resilience in the hospital under the conditions of the COVID-19 pandemic. This study proposed the use of FDT-FAHP for identifying and ranking organizational resilience indicators in hospitals during the COVID-19 pandemic: the results showed that the most important indicators of resilience were leadership and management, preparedness and learning, and learning from previous experiences, respectively.

Ethics statement

Informed consent was obtained from all participants with approval by the ethics committee of Behbahan University of Medical Sciences (code number IR.BHN.REC.1401.024).

Funding statement

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

CRediT authorship contribution statement

Mojtaba Haghighat: Writing – review & editing. SeyedMahdi mousavi: Formal analysis. Mahsa jahadi naeini: Writing – original draft, Data curation.

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgements

Researchers need to thank all staff who have participated in this study.

Footnotes

Appendix A

Supplementary data to this article can be found online at https://doi.org/10.1016/j.heliyon.2024.e27241.

Appendix A. Supplementary data

The following are the Supplementary data to this article:

Multimedia component 1
mmc1.pdf (104.5KB, pdf)
Multimedia component 2
mmc2.pdf (266.8KB, pdf)

References

  • 1.Purba A., Widana I.D.K.K., Sumantri S.H., Kurniadi A., Mayori E. Community resilience to disaster and climate change to support sustainable development in and after the covid-19 pandemic. Technium Social Sciences Journal. 2022;33:479–491. [Google Scholar]
  • 2.Damle S., Mani S.K., Balamurugan G. Natech guide words: a new approach to assess and manage natech risk to ensure business continuity. J. Loss Prev. Process. Ind. 2021;72 [Google Scholar]
  • 3.Abebe G.M. Emerging and re-emerging viral diseases: the case of coronavirus disease-19 (COVID-19) Int J Virol AIDS. 2020;7:67. [Google Scholar]
  • 4.Hui D.S., Azhar E.I., Madani T.A., Ntoumi F., Kock R., Dar O., et al. The continuing 2019-nCoV epidemic threat of novel coronaviruses to global health—the latest 2019 novel coronavirus outbreak in Wuhan, China. Int. J. Infect. Dis. 2020;91:264–266. doi: 10.1016/j.ijid.2020.01.009. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Riou J., Althaus C.L. Pattern of early human-to-human transmission of Wuhan 2019 novel coronavirus (2019-nCoV), December 2019 to January 2020. Euro Surveill. 2020;25(4) doi: 10.2807/1560-7917.ES.2020.25.4.2000058. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Lee N., Lee H.-J. South Korean nurses' experiences with patient care at a COVID-19-designated hospital: growth after the frontline battle against an infectious disease pandemic. Int. J. Environ. Res. Publ. Health. 2020;17(23):9015. doi: 10.3390/ijerph17239015. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Gilson L., Barasa E., Nxumalo N., Cleary S., Goudge J., Molyneux S., et al. Everyday resilience in district health systems: emerging insights from the front lines in Kenya and South Africa. BMJ Glob. Health. 2017;2(2) doi: 10.1136/bmjgh-2016-000224. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Shrestha N., Mishra S.R., Ghimire S., Gyawali B., Marahatta S.B., Maskey S., et al. Health system preparedness for COVID-19 and its impacts on frontline health-care workers in Nepal: a qualitative study among frontline health-care workers and policy-makers. Disaster Med. Public Health Prep. 2021:1–9. doi: 10.1017/dmp.2021.204. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Alhassan Y., Zaizay Z., Dean L., McCollum R., Watson V., Kollie K., et al. Perceived impacts of COVID-19 responses on routine health service delivery in Liberia and UK: cross-country lessons for resilient health systems for equitable service delivery during pandemics. BMC Health Serv. Res. 2023;23(1):1–14. doi: 10.1186/s12913-023-09162-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Benham T.L., Hart A., Bortolin M., Groves J., Kraus A., Newbury B., et al. Preparing for the second surge: preventing posttraumatic stress disorder and building resilience for health care workers in the face of COVID-19. Disaster medicine and public health preparedness. 2022;16(2):714–717. doi: 10.1017/dmp.2020.371. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Donelli C.C., Fanelli S., Zangrandi A., Elefanti M. Disruptive crisis management: lessons from managing a hospital during the COVID-19 pandemic. Manag. Decis. 2022;60(13):66–91. [Google Scholar]
  • 12.Chen J., Amaize A., Barath D. Evaluating telehealth adoption and related barriers among hospitals located in rural and urban areas. J. Rural Health. 2021;37(4):801–811. doi: 10.1111/jrh.12534. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Paulikienė B. Hospital disaster resilience: a conceptual framework. Regional formation and development studies: journal of social sciences. 2022;(2):121–131. [Google Scholar]
  • 14.Finstad G.L., Giorgi G., Lulli L.G., Pandolfi C., Foti G., León-Perez J.M., et al. Resilience, coping strategies and posttraumatic growth in the workplace following COVID-19: a narrative review on the positive aspects of trauma. Int. J. Environ. Res. Publ. Health. 2021;18(18):9453. doi: 10.3390/ijerph18189453. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Olu O. Resilient health system as conceptual framework for strengthening public health disaster risk management: an African viewpoint. Front. Public Health. 2017;5:263. doi: 10.3389/fpubh.2017.00263. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Cimellaro G.P., Malavisi M., Mahin S. Factor analysis to evaluate hospital resilience. ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering. 2018;4(1) [Google Scholar]
  • 17.Zhong S., Clark M., Hou X.-Y., Zang Y., FitzGerald G. Development of key indicators of hospital resilience: a modified Delphi study. J. Health Serv. Res. Policy. 2014;20(2):74–82. doi: 10.1177/1355819614561537. [DOI] [PubMed] [Google Scholar]
  • 18.Andersson T., Cäker M., Tengblad S., Wickelgren M. Building traits for organizational resilience through balancing organizational structures. Scand. J. Manag. 2019;35(1):36–45. [Google Scholar]
  • 19.Zhong S., Clark M., Hou X.-Y., Zang Y., FitzGerald G. Validation of a framework for measuring hospital disaster resilience using factor analysis. Int. J. Environ. Res. Publ. Health. 2014;11(6):6335–6353. doi: 10.3390/ijerph110606335. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Yazdanirad S., Haghighat M. Determining the effect of selected mental factors on turnover intention through two modulators-stress and resilience over COVID-19 period. BMC Health Serv. Res. 2023;23(1):1–10. doi: 10.1186/s12913-023-09268-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Saido G., Siraj S., DeWitt D., Al-Amedy O.S. Development of an instructional model for higher order thinking in science among secondary school students: a fuzzy Delphi approach. Int. J. Sci. Educ. 2018;40(8):847–866. [Google Scholar]
  • 22.Hohmann E., Cote M.P., Brand J.C. Research pearls: expert consensus based evidence using the Delphi method. Arthrosc. J. Arthrosc. Relat. Surg. 2018;34(12):3278–3282. doi: 10.1016/j.arthro.2018.10.004. [DOI] [PubMed] [Google Scholar]
  • 23.Yusof N., Hashim N.L., Hussain A., editors. AIP Conference Proceedings. AIP Publishing LLC; 2022. A review of fuzzy Delphi method application in human-computer interaction studies. [Google Scholar]
  • 24.Roy T.K., Garai A. Intuitionistic fuzzy delphi method: more realistic and interactive forecasting tool. Notes on Intuitionistic fuzzy sets. 2012;18(2):37–50. [Google Scholar]
  • 25.Molassiotis A., Guo C., West C., Loke A.Y. Identifying the priorities in nursing research on disaster management: a Delphi study and international survey. Int. J. Disaster Risk Reduc. 2022;74 [Google Scholar]
  • 26.Haghighat M., Yazdanirad S., Faridan M., Jahadi Naeini M., Mousavi S.M. Application of hybrid Shannon's entropy–PROMEHTEE methods in weighing and prioritizing industrial noise control measures. Theor. Issues Ergon. Sci. 2021:1–14. [Google Scholar]
  • 27.Aoun J., Quaglietta E., Goverde R.M., Scheidt M., Blumenfeld M., Jack A., et al. A hybrid Delphi-AHP multi-criteria analysis of Moving Block and Virtual Coupling railway signalling. Transport. Res. C Emerg. Technol. 2021;129 [Google Scholar]
  • 28.Zhijun C., Hsieh T.-S., Huang C.-H., Ghaffari M. Sustainable tourism supply chain assessment using hybrid decision-making methods under fuzzy uncertainty. Math. Probl Eng. 2022:2022. [Google Scholar]
  • 29.Daneshfar M.A., Ardjmand M. Selecting a suitable model for collecting, transferring, and recycling drilling wastes produced in the operational areas of the Iranian offshore oil company (IOOC) using analytical hierarchy process (AHP) J. Environ. Manag. 2020;259 doi: 10.1016/j.jenvman.2019.109791. [DOI] [PubMed] [Google Scholar]
  • 30.Mousavi S.M., Abbasi M., Yazdanirad S., Yazdanirad M., Khatooni E. Fuzzy AHP-TOPSIS method as a technique for prioritizing noise control solutions. Noise Control Eng. J. 2019;67(6):415–421. [Google Scholar]
  • 31.Huang J., Koopialipoor M., Armaghani D.J. A combination of fuzzy Delphi method and hybrid ANN-based systems to forecast ground vibration resulting from blasting. Sci. Rep. 2020;10(1):1–21. doi: 10.1038/s41598-020-76569-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hsu C.-H., Chang A.-Y., Luo W. Identifying key performance factors for sustainability development of SMEs–integrating QFD and fuzzy MADM methods. J. Clean. Prod. 2017;161:629–645. [Google Scholar]
  • 33.Deshmukh S., Sunnapwar V., editors. Proceedings of International Conference on Intelligent Manufacturing and Automation. Springer; 2019. Fuzzy analytic hierarchy process (FAHP) for green supplier selection in Indian Industries. [Google Scholar]
  • 34.Wang Y., Xu L., Solangi Y.A. Strategic renewable energy resources selection for Pakistan: based on SWOT-Fuzzy AHP approach. Sustain. Cities Soc. 2020;52 [Google Scholar]
  • 35.Arshad M., Abid G., Contreras F., Elahi N.S., Athar M.A. Impact of prosocial motivation on organizational citizenship behavior and organizational commitment: the mediating role of managerial support. European Journal of Investigation in Health, Psychology and Education. 2021;11(2):436–449. doi: 10.3390/ejihpe11020032. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Cheng L., Guo H., Lin H. The influence of leadership behavior on miners' work safety behavior. Saf. Sci. 2020;132 [Google Scholar]
  • 37.Jafari M.J., Nodoushan R.J., Shirali G.A., Khodakarim S., Zare H.K. Indicators of organizational resilience in critical sociotechnical systems: a qualitative study for the refinery complex. Health Scope. 2018;7(3) [Google Scholar]
  • 38.Mahmoudi D., Alizadeh S.S., Rasoulzadeh Y., Jafarabadi M.A. Prioritizing the thirteenth dimensions of Organizational Resilience in dealing with crises and major accidents. 2020;17(1):2020. [Google Scholar]
  • 39.Samsuddin N.M., Takim R., Nawawi A.H., Alwee S.N.A.S. Disaster preparedness attributes and hospital's resilience in Malaysia. Procedia Eng. 2018;212:371–378. [Google Scholar]
  • 40.Zarrin M., Azadeh A. Mapping the influences of resilience engineering on health, safety, and environment and ergonomics management system by using Z‐number cognitive map. Human Factors and Ergonomics in Manufacturing & Service Industries. 2019;29(2):141–153. [Google Scholar]
  • 41.Ali H.M., Ranse J., Roiko A., Desha C. Investigating organizational learning and adaptations for improved disaster response towards “resilient hospitals:” an integrative literature review. Prehospital Disaster Med. 2022:1–9. doi: 10.1017/S1049023X2200108X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Billings J., Ching B.C.F., Gkofa V., Greene T., Bloomfield M. Experiences of frontline healthcare workers and their views about support during COVID-19 and previous pandemics: a systematic review and qualitative meta-synthesis. BMC Health Serv. Res. 2021;21(1):1–17. doi: 10.1186/s12913-021-06917-z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Farida I., Setiawan R. Public participation in preventing covid-19 outbreaks in lampung province, Indonesia. RUDN Journal of Public Administration. 2021;8(3):297–311. [Google Scholar]
  • 44.Al Siyabi H., Al Mukhaini S., Kanaan M., Al Hatmi S., Al Anqoudi Z., Al Kalbani A., et al. Community participation approaches for effective national covid-19 pandemic preparedness and response: an experience from Oman. Front. Public Health. 2021;8 doi: 10.3389/fpubh.2020.616763. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Zhou C., Yue X.D., Zhang X., Shangguan F., Zhang X.Y. Self-efficacy and mental health problems during COVID-19 pandemic: a multiple mediation model based on the Health Belief Model. Pers. Indiv. Differ. 2021;179 doi: 10.1016/j.paid.2021.110893. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia component 1
mmc1.pdf (104.5KB, pdf)
Multimedia component 2
mmc2.pdf (266.8KB, pdf)

Articles from Heliyon are provided here courtesy of Elsevier

RESOURCES