Skip to main content
Springer Nature - PMC COVID-19 Collection logoLink to Springer Nature - PMC COVID-19 Collection
. 2021 Jun 3;55(1):181–206. doi: 10.1007/s10462-021-10029-9

An extended hesitant fuzzy set using SWARA-MULTIMOORA approach to adapt online education for the control of the pandemic spread of COVID-19 in higher education institutions

Mahyar Kamali Saraji 1,6, Abbas Mardani 2,, Mario Köppen 3, Arunodaya Raj Mishra 4, Pratibha Rani 5
PMCID: PMC8173517  PMID: 34103781

Abstract

The world has been challenged since late 2019 by COVID-19. Higher education institutions have faced various challenges in adapting online education to control the pandemic spread of COVID-19. The present study aims to conduct a survey study through the interview and scrutinizing the literature to find the key challenges. Subsequently, an integrated MCDM framework, including Stepwise Weight Assessment Ratio Analysis (SWARA) and Multiple Objective Optimization based on Ratio Analysis plus Full Multiplicative Form (MULTIMOORA), is developed. The SWARA procedure is applied to the analysis and assesses the challenges to adapt the online education during the COVID-19 outbreak, and the MULTIMOORA approach is utilized to rank the higher education institutions on hesitant fuzzy sets. Further, an illustrative case study is considered to express the proposed idea's feasibility and efficacy in real-world decision-making. Finally, the obtained result is compared with other existing approaches, confirming the proposed framework's strength and steadiness. The identified challenges were systemic, pedagogical, and psychological challenges, while the analysis results found that the pedagogical challenges, including the lack of experience and student engagement, were the main essential challenges to adapting online education in higher education institutions during the COVID-19 outbreak.

Keywords: Adapted online education, Higher education institutions, Hesitant fuzzy sets, Multi-criteria decision making (MCDM), Fuzzy sets

Introduction

The world has been challenged since late 2019 by the COVID-19 detected in Wuhan, China, for the first time. Although the number of people infected by coronavirus was rapid growth since then, the world leaders initially disregard COVID-19. As a result, it became a pandemic having considerable adverse effects on economics, education, people's life, etc. (Gössling et al. 2020). Also, there are two main strategies for fighting with COVID-19, including lockdown and social distancing, which are implementing by the world's authorities, while each of the mentioned strategies may affect many aspects of people's lives, especially their daily interactions and education system (Lau et al. 2020). On top of that, the education system is on the front line since it is believed the knowledge is the main factor to know the way of beating COVID-19, while knowledge transferring happens based on a new form of education named online education (Grammegna 2020). The shortcomings of the world education system as to online education have been revealed so that most universities in the world have to tackle various challenges to complete their unfinished semester (Naciri and Kharbach 2020). For instance, Iranian universities and schools closed on March 5, while not only the number of appropriate platforms for online education was not enough to deal with the situation, but also there was a high number of technical challenges which both the government and students have been encountered (Bizaer 2020). On top of that, many teachers and students do not have the technological know-how to face problematic situations to adapt to online education. Also, they have to use online platforms as only means of teaching, while these platforms were utilized as supplementary teaching material.

Besides, the development of online education has internationally improved in light of communication and information technologies. Recently, higher education providers offer online courses both on and off-campus in response to this trend in the world. Due to online education benefits, including adjustable speed of study, more affordable tuition fees, and greater cultural diversity, many students tend to enroll in online classes (Damary et al. 2017). However, some growing concerns have remained, including a lack of appropriate materials and a lack of suitable interaction tasks, and so on. As a result, it negatively affects students, especially the international students, since they may face various challenges, including those challenges related to existing differences between social communication in online learning environments (Rovai and Barnum 2007). In this vein, institutions should handle different challenges to use online platforms to resume their incomplete programs. Thus, a comprehensive framework of challenges is needed in which the importance of the challenges is evaluated using a novel MCDM method to help institutions deal with the current problematic situation.

The present study's main contributions are, first, developing a comprehensive framework in which the challenges of adopting online education during the COVID-19 pandemic are included. Second, even though several MCDM problems have been developed under the environment of HFSs, there is no study on developing the integrated framework with Step-wise Weight Assessment Ratio Analysis (SWARA) method and Multi-Objective Optimization based on Ratio Analysis Plus Full multiplicative Form (MULTIMOORA) approaches over hesitant fuzzy information. Third, there is no study in which HF-SWARA-MULTIMOORA was employed to estimate the criteria weights and rank the institutions for adapting online education to control the pandemic spread of COVID-19, especially in Iran. To this end, the present study aims:

  • To identify the main challenges of adopting online education during the COVID-19 pandemic

  • To propose an integrated framework is introduced within the context of HFSs to handle the complex MCDM problems

  • To determine the most critical challenges of adapting online education during the COVID-19 outbreak using the SWARA model

  • To rank higher education institutions during the COVID-19 outbreak using The MULTIMOORA method

  • To express the applicability and usefulness of the developed integrated framework within the HFSs context through an empirical study

  • To validate the results through comparative analysis with existing methods.

Literature review

Status of online education during COVID-19 pandemic

A majority of individuals can easily access the new knowledge and work remotely through online platforms. To be specific, online education comprising learning management systems, mobile learning, and so on can engage different students (Romero-Rodríguez et al. 2020). However, the course developers and the governments have been faced the challenges of constructing a learning atmosphere in which the learning process and students' assessment happens appropriately, while it is both content and community-centered (Anderson 2008). Furthermore, there is no standard mean of online learning, nor a specific framework, dictating the type of communication, which is suitable for all learners in different fields. Instead, Instructors should extend their knowledge and skills to respond to curriculum and students' needs by extending a set of online education tasks adaptable to various student needs. Surprisingly, online education has become an inseparable part of the education system, especially in training and higher education (Anderson 2008). Although the number of institutions that have adapted their education system with online platforms is not noticeable, the number of students and higher education providers attracted to online education is growing exponentially, especially during the COVID-19 pandemic (Anderson 2008; Huang 2020).

Zapalska and Brozik (2006) mentioned an interest in online education has been increasing in recent years by the advent and development of the internet worldwide so that it was predicted that the education landscape would be changed (Zapalska and Brozik 2006), while COVID-19 boost the utilizing the online platforms these days (Cecilio-Fernandes et al. 2020). However, since online education is dependent on new technologies has been changing rapidly so that the effectiveness of online education may be over shadowed by technological innovation. Furthermore, there are many different learning styles for students (Zapalska and Brozik 2006). For instance, some may learn more effectively by listening and watching, while others may learn by reading or performing some physical activities so that considering variant styles of learning in online education is vital. Nevertheless, due to online education limitations, such as not having practical sessions (Longhurst et al. 2020), it is challenging for adapting online education with learning styles.

Besides, it is reported that near 1.723 billion students in the world have been influenced owing to school closures in regards to the pandemic, while teachers, parents, and universities have been affected as well (Mustafa 2020). As mentioned, many universities have shown interest in using online education to resume their classes remotely during the COVID-19 pandemic. In China, for instance, near 2163 and 1824 online courses have been launched for undergraduate and graduate students, respectively, in the perking university to operate teaching typically, while near 45,000 students have to stay at their homes or dorms (Bao 2020). However, the Chinese government never set country-wide rules in universities' closures, while other countries such as the US, Brazil, Canada, and Russia do the same (Crawford et al. 2020). Although some universities' opportunities to boost their online courses during COVID-19 crises (Vlachopoulos 2020), some universities in some countries such as Jordan encounter many challenges. For example, in Jordan, the number of technology solutions supporting online teaching is low. This is due to the fact; there is not enough time to design a coordinated strategy for dealing with these crises in the world (Crawford et al. 2020).

Furthermore, some scholars have been researched in the field of online education during the COVID-19 pandemic. (Zayapragassarazan 2020) researched to investigate the strategies for engaging students in online medical education. He concluded that behavioral indicators should have effective online education, especially in medical education. There is a wide variety of activities that both instructors and students can do, including observational learning behaviors and Practical learning behaviors. (Dwidienawati and Musrin 2020) carried out research to find the factors affecting e-learning performance and satisfaction regarding students who have to attend online education due to COVID-19. The results indicated that service quality is one factor that has a considerable effect on students' satisfaction. (Longhurst et al. 2020) used Strength, Weakness, Opportunity, Threat (SWOT) analysis to find the challenges and opportunities of online education in anatomical education in the UK and Ireland. The results indicated that there are seven opportunities, including the development of new online resources, academic collaboration, free access to online resources, incorporation of mix learning in development, working remotely, while there are nine challenges, including issues with assessment, time constraints of bsuspensionody donor program.

Challenges of adapting online education in response to COVID-19 pandemic

Higher education institutions have been challenged by students' growing interest in online education to redesign their pedagogical, organizational, academic, and cultural structures to employ new learning and teaching methods (Howell et al. 2004). Similarly, both instructors' roles and the nature of teaching have altered due to the diversity of online courses offered by different institutions (Bennett and Lockyer 2004). On the other hand, a majority of students have faced many challenges during the COVID-19 pandemic. In this section, the challenges of adapting online education in response to the COVID-19 pandemic include systemic challenges, pedagogical challenges, and psychological challenges.

Systemic challenges

Systemic challenges are related to all challenges which stem from the weakness of technological systems, economic, policies, etc. The systemic challenges comprise a lack of technical support, lack of online technologies, cost constraints, and lack of policies for online courses. In the following, the mentioned systemic challenges are presented.

Lack of technical support

Students may become frustrated due to technical problems, while it can affect learning negatively. On top of that, reliable and accessible technical support is vital in assisting learners so that organizations and institutions should develop appropriate technical support (Liu et al. 2005). Also, appropriate technical support affects students' participation in online programs effectively (Shamsy 2014). Nevertheless, it is difficult to provide technical support, mostly when students' vast verity should be supported in the COVID-19 epidemic (Longhurst et al. 2020).

Lack of online technologies

Although the advantages of online education due to technology development, Technological challenges are considered fundamental challenges in the online education system (Arbaugh 2005). Many difficulties may arise due to the existing limitation in terms of the technical capability of the platforms and software (Gillett-Swan 2017). Furthermore, the main technological challenge during the COVID-19 pandemic maybe the lack of appropriate platforms for online education. For example, it is reported that almost 10% of the learners have an appropriate platform for online education in University Grants Commission (UGC), while near 62% of learners were utilizing WhatsApp to share academic inputs (Babu and Jayakumar 2020).

Cost constraints

Online education costs are different from traditional education, though it is believed that online education can reduce costs (Bates and San Francisco 2001). Two types of costs should be considered, including the cost of online education technologies, the cost of distributing and receiving knowledge (Rumble 2004). As mentioned, online technologies are needed to provide online education so that institutions, instructors, and students should provide appropriate technologies having a considerable cost for them. Besides, it cost institutions to provide web-based materials, while distributing and receiving these materials through the internet have cost for institutions and students, respectively (Rumble 2004). Therefore, cost constraints is an important challenge in online education, while almost many students go for online education doe to COVID-19 pandemic so that it may cause a rise in online education cost for institutions, students and even the government.

Lack of policies for online education

Having a clear understanding of the expectations in an online class form, both instructors and students are necessary; therefore, clear policies and standards are required (Lloyd et al. 2012). Online education policies also comprise various issues, including policies related to students' privacy, email, and assignments. On top of that, the appropriate policies related to online discussion, software standards, and intellectual property (Waterhouse and Rogers 2004). Therefore, it is undeniable that policymakers in institutions or the government should set good policies to determine online classes (Lloyd et al. 2012).

Pedagogical challenges

There are some challenges in learning, such as reduced quality of resources, or lack of teaching experience, and so on, presented in this section. The pedagogical challenges comprise the quality of materials, lack of experience, online assessment, student engagement, and practical classes. In the following, the mentioned pedagogical challenges are presented.

Quality of materials

Esfijani (2018) mentioned that one of the most critical indicators in online education quality is resource quality. Quality of resources can be evaluated by the quality of their content, course structure, and learning management (Esfijani 2018). To be more specific, courses' materials should be well-designed, accessible, user friendly, interactive, and so on (Esfijani 2018). However, during the COVID-19 pandemic, it is arduous to design a course properly due to the time constraints and the lack of experience, while the experience of online education should be rich both affectively and intellectually (Kebritchi et al. 2017; Longhurst et al. 2020).

Lack of experience

Planning and preparing course materials is one of the essential responsibilities for instructors, while they may encounter various challenges in terms of producing and adjusting new materials from traditional classes to online classes (Li and Irby 2008). Also, institutions may never provide training and support for instructors so that courses' content transition from traditional to online may be challengeable (Kebritchi et al. 2017); furthermore, since online education depends on technology so that the quality of pedagogical experiences in online education are influenced by technology (Evans et al. 2008).

Online assessment

Longhurst et al. (2020) mentioned that almost 30% of institutions do not have pre-existing summative assessments concerning useful content, while over 40% of universities have been canceled their assessment in response to COVID-19 (Longhurst et al. 2020). Also, online education's assessment process is entirely different since this process happens not in a physical space and both instructors and students are far from each other. Simultaneously, (Jacobs 2014) mentioned that assessment methods that determine students' progress are crucial in the online education system (Kebritchi et al. 2017).

Student engagement

It is believed that student engagement may be reduced in online education due to the existed differences in the learning environment and course materials (Jaggars 2014). For instance, many instructors may use a long video to teach; however, it is considered a potential threat in online education, negatively affecting student engagement (Longhurst et al. 2020). Also, the massification of higher education through online education might impact the students' motivation (Trow 2007) so that it is challenging to maintain students' engagement in online classes during the COVID-19 pandemic since most students have to intend online classes (Longhurst et al. 2020).

Lack of practical classes

Some disciplines have practical sessions in their semester curriculum, while it seems to be impossible to have these types of classes in online education. For instance, near half of the universities offering anatomical classes are concerned about cadaveric exposure and practical sessions (Longhurst et al. 2020). On top of that, practical sessions create a window of opportunities for students to retain knowledge, and it affects students' engagement so that the lack of practical sessions may decrease the efficiency of the learning process (Spiceland et al. 2015).

Psychological challenges

Psychological challenges stem from those factors which have effects mentally or emotionally. Psychological challenges comprise lockdown pressure during the COVID-19 pandemic, time pressure, and fear of digitalization. In the following, the mentioned psychological challenges are presented in detail.

Lockdown pressure

Kazmi et al. (2020) concluded that psychological distress had been created among people due to the Covid-19 pandemic. Since they have been forced to stay at home owing to the existed restrictions due to COVID-19. People may feel a lack of control in their everyday life and routines since it is admitted they are going through a disaster owing to COVID-19 lockdown. As a result, the youth encounter uncertainty regarding their professional life or learning process since they are afraid of getting infected (Kazmi et al. 2020). Also, it is reported that people think that they cannot perform their duty correctly or deal with problematic situations in crucial time so that it may reduce their motivation having adverse effects on different aspects of their life, including education (Jadhav 2020).

Time pressure

The materials' quality and effectiveness may be affected by time constraints due to the fast pace of COVID-19 spreading. At the same time, it is reported that a majority of universities, near 60 percent during the COVID-19 pandemic, were concerned about time pressure involved in preparing new materials for online classes to take the place of lectures and practical sessions (Longhurst et al. 2020). Furthermore, instructors should take much time to learn how to utilize technologies in online education, while creating materials for online education may take three times as much work compared to face-to-face education (Gewin 2020).

Fear of digitalization

Students may feel disconnected and isolated in online education affecting learning (McInnerney and Roberts 2004). The sense of identity among students influenced by learning's community since students co-create their identity through interacting socially within a community (Koole 2014). Thus, to build knowledge effectively, improving the sense of belonging is vital, while it may be challenging in online education (Kebritchi et al. 2017). Although digitalization in higher education gets instructors and students this chance to communicate virtually (Strielkowski et al. 2020), most of them, even the youth who are often online, are not ready for online education. Therefore, they would rather be in a face-to-face class than in a virtual one (Strielkowski 2020). (Table 1) provides information about the challenges of adapting online education during the COVID-19 pandemic.

Table 1.

Challenges of adapting online education in response to COVID-19 pandemic

Factor Sub-factors Sources

Adapting online education in response

to the COIVD-19 pandemic

Systemic challenges Lack of technical support (Liu et al. 2005; Longhurst et al. 2020; Shamsy 2014)
Lack of online technologies (Babu and Jayakumar 2020; Gillett-Swan 2017; Longhurst et al. 2020)
Cost constraints (Bates and San Francisco 2001; Rumble 2004)
Lack of policies (Lloyd et al. 2012; Waterhouse and Rogers 2004)
Pedagogical challenges Quality of materials (Esfijani 2018; Kebritchi et al. 2017; Longhurst et al. 2020)
Lack of experience (Evans et al. 2008; Kebritchi et al. 2017; Li and Irby 2008)
Online assessment (Jacobs 2014; Kebritchi et al. 2017; Longhurst et al. 2020)
Student engagement (Jaggars 2014; Longhurst et al. 2020; Trow 2007)
Lack of practical classes (Longhurst et al. 2020; Spiceland et al. 2015)
Psychological challenges Lockdown pressure (Jadhav 2020; Kazmi et al. 2020)
Time pressure (Gewin 2020; Longhurst et al. 2020)
Fear of digitalization (Kebritchi et al. 2017; Strielkowski 2020)

Research method

Preliminaries

In the decision-making procedure, the Decision-Makers (DMs) might assess the belongingness degree (BD) of an object to a set of various distinct degrees in numerous real-life circumstances because of their attention, time restrictions, and deficiency of information. For example, suppose a DM group is expressed in offering the BD of individual opinion to an adult age group. In that case, the first one wishes 0.55, another 0.60, and the last one does not recommend the BD due to the time restrictions and deficiency of knowledge/information/data. To handle this concern, Torra (2010) and Torra and Narukawa (2009) pioneered the idea of HFSs, which offers the BD to comprise several different evaluation degrees (Torra 2010; Torra and Narukawa 2009). As the extension of fuzzy sets (FSs), HFSs are recognized as useful and eminent environments to tackle real-life situations' ambiguity. It is represented by a BD and signified by a set of possible degrees. Recently, it is worth mentioning that the HFSs have powerfully related to the existing FSs, namely, Intuitionistic Fuzzy Sets (IFSs) (Atanassov 1986), Type-2 Fuzzy Sets (T2FSs) (Zadeh 1975), Fuzzy Multi-Sets (FMSs) (Yager 1986). Several MCDM techniques have been developed in the HFSs context (Li et al. 2020; Mishra et al. 2019a). Mishra et al. (2019a) proposed a Shapley function-based HF-Complex Proportional Assessment (COPRAS) approach to handle the correlative MCDM problems for HFSs. Xu and Zhang (2019) presented an outline of group decision-making implementations from three different aspects of HFSs (Zhao et al. 2017). Mishra et al. (2019b) suggested an integrated HF-WASPAS method to choose an ideal green supplier for HFSs (Mishra et al. 2019b).

Definition 1

(Torra 2010): Given a discourse set Y A HFS R on Y is defined by the function ħRy implemented to Y, which maps a finite subset of [0,1], is denoted by.

R=y,ħRy:yY, 1

where ħRy denotes a set of various degrees in [0,1], illustrating the feasible membership degrees of an object yY to R. For ease of simplicity, ħRy is defined as the hesitant fuzzy number (HFN), which holds ħRy=ι:ιħRy.

Definition 2.

(Torra 2010; Xia and Xu 2011): Assume that ħ,ħ1,ħ2HFNsY, then the fundamental laws on HFNs are discussed as below:

(i). ħc=ιħ1-ι;

(ii). ħ1ħ2=ι1ħ1,ι2ħ2maxι1,ι2;

(iii). ħ1ħ2=ι1ħ1,ι2ħ2minι1,ι2;

(iv). λħ=ιħ1-1-ιλ,λ>0;

(v). ħλ=ιħιλ,λ>0;

(vi). ħ1ħ2=ι1ħ1,ι2ħ2ι1+ι2-ι1ι2;

(vii). ħ1ħ2=ι1ħ1,ι2ħ2ι1ι2.

Definition 3:

In HFS, the score function of the element h is described as.

Sħ=1għιħι. 2

Here, għ denotes the number of objects in ħ. For any HFNs ħ1 and ħ2, if Sħ1>Sħ2, then ħ1>ħ2; if Sħ1=Sħ2, then ħ1=ħ2.

In various cases, the above-discussed comparison law does not hold good. To handle this concern, (Liao et al. 2014) initiated a variance concept to compare the HFSs.

For an HFE ħ, the variance function of the element ħ is given by

ϑħ=1għιi,ιjħιi-ιj2. 3

Based on Sħ and ϑħ, a systematic procedure is derived as follows:

If Sħ1>Sħ2, then ħ1>ħ2;

If Sħ1=Sħ2, then.

if ϑħ1>ϑħ2, then ħ1<ħ2;

if ϑħ1=ϑħ2, then ħ1=ħ2.

Definition 4.

(Liao et al. 2014; Xia and Xu 2011): Consider a set of HFNs H=ħ1,ħ2,...,ħn, then the Hesitant Fuzzy Weighted Average (HFWA) and geometric (HFWG) operators are defined as.

HFWAħ1,ħ2,...,ħn=j=1nωjħj=ι1ħ1,ι2ħ2,...,ιnħn1-j=1n1-ιjωj, 4
HFWGħ1,ħ2,...,ħn=j=1nħjωj=ι1ħ1,ι2ħ2,...,ιnħnj=1nιjωj. 5

Definition 5:

Let RHFSY. Then, an entropy measure defined by (Mishra et al. 2019a), is as follows:

eR=1ni=1n1lyj=1lyħRσ(j)yiħRσ(lz-j+1)yiħRσ(j)yiħRσ(lz-j+1)yi. 6

Definition 6:

Let R,SHFSY. Then, an entropy measure defined by (Xia and Xu 2011), is as follows:

DR,S=1ni=1n1lyj=1lyħRσ(j)yi-ħSσ(j)yi. 7

Proposed hesitant fuzzy SWARA-MULTIMOORA method

This section develops a novel decision-making framework, named hesitant fuzzy SWMOORA (HF-SWARA-MULTIMOORA), to tackle the MCDM problems within the HFSs context. For the development of the proposed MULTIMOORA method, the notions and operations of the HFNs, score function, and entropy measure are utilized within the framework of HFSs. The computation process of the developed approach is presented by.

Step 1: Originate the option and criteria

A set of DEs B1,B2,...,B determines the sets of ′m′ alternative U1,U2,,Um and 'n' criteria T1,T2,...,Tn, respectively. Assume that Z=zijkm×n,i=11m,j=11n be the Hesitant Fuzzy Decision Matrix (HF-DM) specified by kth expert, where zijk means the assessment of an option Ui concerning a criterion Tj in terms of HFNs for kth expert.

Step 2: Determine crisp DMs weights

The formula for the determination of kth expert weight is as follows:

λk=1-eħkk=1l1-eħk,k=11l. 8

Step 3: Calculate the aggregated HF-DM (AHF-DM)

In MCDM, it is essential to aggregate the individual matrices into a single decision matrix. To aggregate the matrices, the HFWA operator is applied and then P=ξijm×n is the required aggregated HF-decision matrix where

ξij=ι1ħ1,ι2ħ2,...,ιnħn1-k=11-zijkλk. 9

Step 4: Evaluating the criteria weights using the SWARA method

Keršuliene et al. (2010) studied a novel SWARA method for the computation of subjective criteria weights in the process of MCDM (Keršuliene et al. 2010). This approach has lesser computational difficulty in comparison with other weight-determining approaches. Just a while ago, the SWARA method has widely been utilized in several MCDM problems. (Rani et al. 2020) studied a hybrid method by employing SWARA and VlseKriterijumska Optimizacija I Kompromisno Resenje in Serbian (VIKOR) approaches to deal with eco-industrial thermal power plant selection problem within the single-valued neutrosophic fuzzy environment. (Mishra et al. 2020) presented an integrated approach using SWARA and COPRAS approaches for the selection of bioenergy production technology alternatives. (Rani et al. 2020) developed an MCDM framework with SWARA and VIKOR methods for solving the Solar Panel Selection (SPS) problem within the Pythagorean fuzzy environment. (Mardani et al. 2020) proposed integrated SWARA and WASPAS under the hesitant fuzzy environment to evaluate the digital health interventions to control the COVID-19 pandemic.

Ranking the criteria is the first step of The SWARA method and compares pairwise direct highest to lowest-ranking criterion. Subsequently, a relative coefficient should be calculated. Next, the weight which is required for dealing with MCDM problems should be evaluated. In the following, the steps of the criteria weight's evaluation using SWARA are presented:

  • Step 4.1: Compute the crisp numbers. Score degrees Sξkj of HFNs are computed based on Eq. (2).

  • Step 4.2: Determine the criterion ranking order. According to DE's choice, all criteria are arranged, from the best to the slightest essential degrees of criteria.

  • Step 4.3: Assess the degree of comparative importance. The comparative importance is determined from the second place's criteria, and the succeeding importance degree is determined to compute the criteria differences.

  • Step 4.4: Evaluate the comparative coefficient. The number kj is discussed as
    kj=1,sj+1,sj+1,j>1, 10
    wherein sj denotes the comparative significance of score value (Keršuliene et al. 2010).
  • Step 4.5: Compute the criteria weight. The value of pj is estimated by
    pj=1,j=1kj-1kj,j>1. 11
  • Step 4.6: Compute the weighted degree. By using the recalculated values pj, the criteria weights are estimated as
    wj=pjj=1npj. 12

Next, the Multi-Objective Optimization based on Ratio Analysis (MOORA) pioneered by (Brauers and Zavadskas 2006), is one of the practical and renowned MCDM methods, which contains Ratio System (RS) and Reference Point (RP) model. To increase the MOORA framework's robustness, (Brauers and Zavadskas 2010) developed a new approach and named as MULTIMOORA, which contains three components: the RS, RP, and the Full Multiplicative Form (FMF) procedure. As compared to Analytic Hierarchy Process (AHP), Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), VIKOR, Preference Ranking Organization METHod for Enrichment of Evaluations (PROMETHEE), Linear Programming Technique for Multidimensional Analysis of Preference (LINMAP) and ELimination Et Choice Translating REality (ELECTRE), the MULTIMOORA framework has more superior stability, easy mathematical expressions, less computation time and strong robustness (Brauers and Zavadskas 2012). Based on the MULTIMOORA approach's advantages, several authors have focused their attention on the developments and applications of the MULTIMOORA framework (Liao et al. 2019; Zhang et al. 2019).

Step 5: Compute the rank of the options-based on the RS procedure

The given sub steps can articulate the preference order of the options and the assessment of the best option-based on RS procedure:

  • Step 5.1: Estimate Yi+ and Yi- by applying Hesitant Fuzzy Weighted Aggregation Operator (HFWAO) as
    Yi+=ι1ħ1,ι2ħ2,...,ιnħn1-jTb1-ξijwj, 13
    Yi-=ι1ħ1,ι2ħ2,...,ιnħn1-jTn1-ξijwj. 14

    where Yi+ and Yi- are the significance of the option i achieved-based on benefit-type and cost-type criteria, respectively.

  • Step 5.2: Calculate the yi+ and yi- by utilizing Eq. (2) as
    yi+=SYi+andyi-=SYi- 15
  • Step 5.3: Assess the overall significance for each option and is given by
    yi=yi+-yi-. 16
  • Step 5.4: Evaluate the ranking order of the options and choose the best option.

Step 6: Compute the rank of the options-based on the RP procedure.

The rank of the options and the choice of the best option based on the RP procedure can be discussed as follows:

  • Step 6.1: Choose the RP. Here, each coordinate of the reference point r=r1,r2,...,rn is an HFN rj whose values are determined as follows:
    rj=maxiξij,forbenefitcriterionTbminiξij,forcostcriterionTnforj=11n. 17
  • Step 6.2: Calculate the differences from each option to the given coordinates of the RP as follows:
    Dij=wjDξij,rj, 18
    where Dij is the discrimination measure and is computed by Eq. (7).
  • Step 6.3: Estimate the maximum distance of each option and is given by
    di=maxjDij;i=11m. 19
  • Step 6.4: Evaluate the ranking order of the options and choose the best option.

Step 7: Compute the rank of the options-based on the FMF procedure.

The rank of the options and the choice of the best option based on the FMF procedure can be discussed as follows:

  • Sub-step 7.1: Estimate Ai and Bi by applying HFWGO as
    Ai=ι1ħ1,ι2ħ2,...,ιnħnjTbξijwj, 20
    Bi=ι1ħ1,ι2ħ2,...,ιnħnjTnξijwj, 21
    where Ai and Bi are HFNs.
  • Sub-step 7.2: Calculate αi and βi by using the score function as follows:
    αi=SAiandβi=SBi. 22
  • Sub-step 7.3: Determine the overall utility for each alternative as follows:
    ui=αiβi 23
  • Sub-step 7.4: Evaluate the ranking order of the options and choose the best option.

Step 8: Determine the final ranking order of the alternatives.

Normalizing the RS, RP and FMF scores of options by vector normalization, we obtain yi, di, and ui, respectively. The assessment value of alternative by Improved Borda Rule (Wu et al. 2018) is obtained by

IBPi=yi·m-ρyi+1mm+1/2-di·ρdimm+1/2+ui·m-ρui+1mm+1/2;i=11m. 24

where yi=yii=1myi2, and ρyi, ρdi, and ρui, are the final rank set of RS, RP and FMF approach, respectively. The best alternative has the maximum value of IBPi.

Results

Tables 2 and 3 present the Linguistic Values (LVs) and their corresponding HFNs for the rating of the relative importance of criteria and options in terms of the MCDM problem, respectively. Due to the lack of information, time limitation, and qualitative nature of considered criteria, it is effortless for the DEs to lucid their judgments with linguistic values (Mishra et al. 2019b).

Table 2.

LVs for the significance of criteria and DEs

LVs HFNs DEs risk preference
Pessimist Moderate Optimist
Very high (VH) [0.85, 1.00] 0.85 0.925 1.00
High (H) [0.70, 0.85] 0.70 0.775 0.85
Medium (M) [0.55, 0.70] 0.55 0.625 0.70
Low (L) [0.40, 0.55] 0.40 0.475 0.55
Very low (VL) [0.25, 0.40] 0.25 0.325 0.40

Table 3.

Linguistic variables for the importance of criteria and options

LVs HFNs DEs risk preference
Pessimist Moderate Optimist
Extremely preferable (EP) [0.90, 1.00] 0.90 0.95 1.00
Strong preferable (SP) [0.75, 0.90] 0.75 0.825 0.90
Preferable (P) [0.60, 0.75] 0.60 0.675 0.75
Moderately preferable (MP) [0.50, 0.60] 0.50 0.55 0.60
Moderate (M) [0.40, 0.50] 0.40 0.45 0.50
Moderately undesirable (MU) [0.30, 0.40] 0.30 0.35 0.40
Undesirable (U) [0.20, 0.30] 0.20 0.25 0.30
Strong undesirable (SU) [0.10, 0.20] 0.10 0.15 0.20
Extremely undesirable (EU) [0.00, 0.10] 0.00 0.05 0.10

Let us consider the weights of DEs in the forms of LVs and are given as H,VH,M. Therefore, by using Table 2, Eq. (6) and Eq. (8), the crisp weights λk: 1, 2, 3 of DEs are obtained asλ1=0.3349,λ2=0.3456,λ3=0.3195. The HF-decision matrices given by DEs Bk (k = 1, 2, 3) can be obtained in Table 4 in the form of Z=zijk6×12,i=116,j=1112 given as.

Table 4.

Linguistic values for criteria performance given by DEs

Criteria DEs U1 U2 U3 U4 U5 U6
T1 B1 SU SU U P SU P
B2 P SU M MP P U
B3 P MP M P M SU
T2 B1 M U P M P SU
B2 P MU P M M MP
B3 P U MU P P U
T3 B1 U M M MP P M
B2 M P U M U P
B3 M P M P MU SU
T4 B1 M MU U M P M
B2 M U P U U P
B3 P SU MU U M MU
T5 B1 M M MU M P M
B2 MP MU U MU P P
B3 M SU M SU MU M
T6 B1 P P M MU SP SP
B2 M P M U M U
B3 P M SP P U M
T7 B1 MU SP M MU SU P
B2 P M SP SU M MU
B3 SP SP P M M SU
T8 B1 SP EP P SP MU MP
B2 M SP SP P P P
B3 SP P P M SP M
T9 B1 P EP SP MU P P
B2 SP M M U MU M
B3 P MU U M M M
T10 B1 M P P U P SP
B2 M M MP P M M
B3 SP P M P U U
T11 B1 M M M SP MU P
B2 P MU P MU P M
B3 SP P M P U SP
T12 B1 U P M P P M
B2 SP SP SP M MP U
B3 P U P M P P

The judgment provided by three DEs has been aggregated utilizing Eq. (9), Table 3 and then create AHF-D matrix P=ξij6×12, taking into effect the importance of individual DE and are provided in Table 5.

Table 5.

AHF-D matrix for the University over criteria

U1 U2 U3 U4 U5 U6
T1 0.591 0.310 0.418 0.607 0.453 0.319
T2 0.579 0.299 0.571 0.516 0.551 0.481
T3 0.404 0.579 0.404 0.533 0.445 0.461
T4 0.485 0.304 0.470 0.352 0.465 0.510
T5 0.498 0.384 0.384 0.376 0.560 0.550
T6 0.579 0.595 0.557 0.427 0.541 0.543
T7 0.591 0.670 0.641 0.384 0.391 0.423
T8 0.680 0.783 0.677 0.644 0.618 0.518
T9 0.677 0.670 0.541 0.304 0.461 0.488
T10 0.583 0.579 0.549 0.544 0.499 0.571
T11 0.639 0.518 0.550 0.620 0.469 0.602
T12 0.610 0.587 0.641 0.517 0.607 0.493

For the SWARA procedure, the character of the experts is a significant part of the assessment of criteria weights. The expert gives the preferences of every criterion-based on their implicit knowledge and experiences (see Table 6). From Table 7, the criterion with the highest significance degree is depicted as the first rank, and the criterion with a less significant degree is mentioned as the last place. Hence, the subjective weights of criteria are computed-based on Eqs. (10)–(12) and Table 7, given as

wj={(0.0846,0.0855,0.0711,0.0794,0.0806,0.0902,0.0860,0.0922,0.0866,0.0802,0.0869,0.0767)}

Table 6.

Linguistic values for criteria performances

Criteria LVs is given by DEs HFNs is given by DEs Sξkj
B1 B2 B3 B1 B2 B3
T1 SU P P 0.15 0.675 0.75 0.583
T2 M P P 0.50 0.675 0.75 0.593
T3 U M M 0.25 0.45 0.50 0.404
T4 M M P 0.40 0.45 0.75 0.518
T5 M MP M 0.45 0.55 0.60 0.533
T6 P P P 0.6 0.675 0.675 0.647
T7 U P SP 0.25 0.675 0.75 0.600
T8 SP M SP 0.75 0.45 0.75 0.670
T9 P MP P 0.60 0.55 0.675 0.607
T10 U P MP 0.30 0.675 0.55 0.528
T11 MP M SP 0.55 0.50 0.75 0.610
T12 MU MP M 0.40 0.55 0.50 0.483

Table 7.

Results obtained by SWARA method

Criteria Crisp degrees Comparative importance of criteria (sj) Coefficient (kj) Recalculated weight (pj) Weight (wj)
T8 0.670 1.000 1.000 0.0922
T6 0.647 0.023 1.023 0.978 0.0902
T11 0.610 0.037 1.037 0.943 0.0869
T9 0.607 0.003 1.003 0.940 0.0866
T7 0.600 0.007 1.007 0.933 0.0860
T2 0.593 0.007 1.007 0.927 0.0855
T1 0.583 0.010 1.010 0.918 0.0846
T5 0.533 0.050 1.050 0.874 0.0806
T10 0.528 0.005 1.005 0.870 0.0802
T4 0.518 0.010 1.010 0.861 0.0794
T12 0.483 0.035 1.035 0.832 0.0767
T3 0.404 0.079 1.079 0.771 0.0711

The ratio system model of HF-SWARA-MULTIMOORA approach for the universities is evaluated by Eq. (13)–Eq. (16) and shown in Table 8.

Table 8.

The preference order of the options-based on the RS procedure

Option Yi+ Yi- yi+ yi- yi Ranking
U1 0.346 0.369 0.346 0.369 − 0.023 2
U2 0.353 0.310 0.353 0.310 0.043 1
U3 0.308 0.344 0.308 0.344 − 0.036 3
U4 0.252 0.329 0.252 0.329 − 0.077 6
U5 0.264 0.335 0.264 0.335 − 0.071 5
U6 0.272 0.316 0.272 0.316 − 0.044 4

The results of the hesitant fuzzy reference point objective for the considered universities are estimated by using Eq. (17)–Eq. (19) and presented in Table 9

rj=0.310,0.299,0.404,0.304,0.560,0.427,0.670,0.783,0.677,0.499,0.639,0.493.

Table 9.

The preference order of the options-based on the RP procedure

Option r1 r2 r3 r4 r5 r6 r7 r8 r9 r10 r11 r12 di Ranking
U1 0.024 0.024 0.000 0.014 0.005 0.014 0.007 0.009 0.000 0.007 0.000 0.009 0.0241 4
U2 0.000 0.000 0.012 0.000 0.014 0.015 0.000 0.000 0.001 0.006 0.010 0.007 0.0152 1
U3 0.009 0.023 0.000 0.013 0.014 0.012 0.003 0.010 0.012 0.004 0.008 0.011 0.0233 2
U4 0.025 0.019 0.009 0.004 0.015 0.000 0.025 0.013 0.032 0.004 0.002 0.002 0.0323 6
U5 0.012 0.022 0.003 0.013 0.000 0.010 0.024 0.015 0.019 0.000 0.015 0.009 0.0240 3
U6 0.001 0.016 0.004 0.016 0.001 0.010 0.021 0.024 0.016 0.006 0.003 0.000 0.0244 5

The hesitant fuzzy full multiplicative form objective based on distance measure for the considered universities is computed by using Eq. (20)–Eq. (23) and given in Table 10.

Table 10.

The preference order of options-based on the FMF procedure

Option Ai Bi αi βi ui Ranking
U1 0.811 0.709 0.811 0.709 1.143 2
U2 0.798 0.627 0.798 0.627 1.273 1
U3 0.774 0.683 0.774 0.683 1.133 4
U4 0.707 0.668 0.707 0.668 1.058 6
U5 0.737 0.680 0.737 0.680 1.085 5
U6 0.749 0.656 0.749 0.656 1.142 3

The summarization of all objectives obtained by the HF-SWARA-MULTIMOORA approach is performed by applying the improved Borda rule, given in Eq. (24) are presented in Table 11.

Table 11.

The overall preference order of the options-based on the MULTIMOORA framework

Option RS approach RP approach FMF approach IBPi Final Ranking
yi ρyi di ρdi ui ρui
U1 − 0.1795 2 0.4017 4 0.4090 2 − 0.0459 2
U2 0.3312 1 0.2544 1 0.4555 1 0.2453 1
U3 − 0.2775 3 0.3897 2 0.4053 4 − 0.0534 3
U4 − 0.5961 6 0.5417 6 0.3786 6 − 0.2167 6
U5 − 0.5541 5 0.4015 3 0.3881 5 − 0.0914 4
U6 − 0.3447 4 0.4092 5 0.4087 3 − 0.1006 5

Finally, the overall ranking of the option is U2>U1>U3>U5>U6>U4.; thus, the optimal option is U2.

Comparative discussion

A comparison is discussed to validate the outcomes of the developed HF-SWARA-MULTIMOORA framework with the HF-TOPSIS procedure. To assess the above problem, we have taken the HF-TOPSIS approach to compare (Xu and Zhang 2013). The system can be exemplified as.

  • Step 1–4: Similar to the previous approach.

  • Step 5: Estimate the Ideal Solution (IS) and Anti-Ideal Solution (AIS).

The IS for numerous criteria are different and described by

ξ+=maxi=1(1)mξijforbenefitcriterionTbmini=1(1)mξijforcostcriterionTnforj=11n. 25

Similarly, the AIS for diverse criteria are defined by

ξ-=mini=1(1)mξijforbenefitcriterionTbmaxi=1(1)mξijforcostcriterionTnforj=1(1)n. 26
  • Step 6: Calculation of discrimination measures from HF-IS and HF-AIS.

Using Eq. (7), we compute the weighted discrimination measure Dξij,ξ+ with the options Uii=1(1)m and the HF-IS ξ+ and the discrimination measure Dξij,ξ- with the options Uii=1(1)m and the HF-AIS ξ-.

  • Step 7: Estimation of relative closeness coefficient (RCC).

The RCC of each option-based on HF-IS can be computed by utilizing the given formula:

CUi=Dξij,ξ-Dξij,ξ-+Dξij,ξ-,i=11m. 27

Step 8: Choose the best University as alternative.

Select the option with maximum RCC degree, represented by CUk, among the RCC degrees CUi,i=11m. and hence Uk is the optimal option.

Step 9: End.

From Table 5 and Eqs. (25)–(26), HF-IS and HF-AIS are evaluated. The whole computational results of HF-TOPSIS (Xu and Zhang 2013) are portrayed in Table 12.

Table 12.

Computational outcomes of HF-TOPSIS procedure

Option Dξij,ξ+ Dξij,ξ- CUi Ranking
U1 0.113 0.109 0.491 2
U2 0.067 0.156 0.700 1
U3 0.119 0.103 0.466 3
U4 0.148 0.074 0.332 6
U5 0.141 0.081 0.365 5
U6 0.119 0.103 0.464 4

Finally, the final ranking of the university is U2>U1>U3>U6>U5>U4.; therefore, the most suitable university is U2. Observably, the outcomes slightly diverge with various types of methods. To this point, the HF-SWARA-MULTIMOORA framework is more robust than the HF-TOPSIS procedure (Xu and Zhang 2013) and thus has a wider range of practicality.

Also, we have compared the proposed HF-SWARA-MULTIMOORA framework with other extant methods namely, HF-VIKOR (Liao and Xu 2019) method and HF-COPRAS (Mishra et al. 2019a) method. Figure 1 depicts the prioritization order from different methods with HFSs and discusses different factors to recognize the developed framework's strengths. From Fig. 2, it is obtained that the developed approach is highly consistent with the existing method with HFSs. To retain homogeneity in the method-related comparison, we consider the method viz., HF-TOPSIS (Xu and Zhang 2013), HF-VIKOR (Liao and Xu 2013) and HF-COPRAS (Mishra et al. 2019a). From Fig. 2, it is clear that the consistency of the developed framework is high with existing methods. The Spearman correlation values of RS procedure, RP procedure, FMF procedure, Borda Rule, HF-TOPSIS, HF-COPRAS and HF-VIKOR with the final ranking solution (0.943, 0.829, 0.829, 1.00 0.943, 0.943, 0.886). Spearman correlation is utilized to these rank values to determine the consistency of the developed framework.

Fig. 1.

Fig. 1

Comparison of preference order of Universities with various approaches

Fig. 2.

Fig. 2

Correlation plot of various measures of MULTIMOORA approach with the existing approach

The main benefits of the proposed HF-SWARA-MULTIMOORA are as follows:

  • The HFS can reflect the DE’s hesitancy more objectively than other classical extensions of FSs. Therefore, the use of developed HF-SWARA-MULTIMOORA approach gives a more flexible way to express the uncertainty in adapting online education for the control of the pandemic spread of COVID-19 in higher education institutions.

  • In the developed method, the SWARA technique is utilized for the assessment of criteria weights, which makes the proposed HF-SWARA-MULTIMOORA approach more efficient, sensible and reliable tool.

  • The proposed HF-SWARA-MULTIMOORA approach is not only suitable for evaluating the MCDM problems under HFSs context, but can also successfully tackle with the MCDM problems under fuzzy sets, intuitionistic fuzzy sets and type-2 fuzzy sets contexts. The developed method has the benefits of accurate and reliable results, and fast information processing.

  • Obviously, the results slightly vary with different types of weights for the criteria. To this point, the HF-SWARA-MULTIMOORA method is more robust than the HF-TOPSIS method and thus has wider applicability. Furthermore, both the HF-VIKOR method and the HF-TOPSIS method fail to tackle the case that the weight vector of the criteria is completely unknown.

  • For the HF-TOPSIS and HF-VIKOR model, it is necessary to calculate the discriminations between each alternative on each criterion and that of the HF-IS, which is time-consuming and reduces the accuracy of the results. Also, the HF-COPRAS method is utilized HFWAO and score function to calculate the utility degree, while in proposed method, we utilize HFWAO, HFWGO, HF-IS and score function to evaluate the preference order of alternatives. In this reason, the proposed HF-SWARA-MULTIMOORA method is superior to the HF-VIKOR method, HF-COPRAS method and the HF-TOPSIS method.

Some limitations of the proposed method are as follows:

  • In the proposed HF-SWARA-MULTIMOORA method, all criteria are assumed to be independent. In reality, there are interrelationships among the criteria.

  • This method has limitation in order to deal with a large number of criteria.

Conclusion and discussions

The present study investigated the key challenges to adapt online education in higher institutions in Iran universities using an integrated decision-making framework. A survey using interviews and literature review has been used to find and evaluate the critical challenges for controlling the pandemic spread of novel coronavirus (COVID-19) in higher education. A learning theory is used to develop a comprehensive framework based on three main challenges: systemic challenges, pedagogical challenges, and psychological challenges. Besides, to evaluate these key challenges, several criteria lack of technical support, lack of online technologies, cost constraints, lack of policies, quality of materials, lack of experience, online assessment, student engagement, lack of practical classes lockdown pressure, time pressure and fear of digitalization are identified using experts opinions and literature review. This study presents a novel integrated framework based on the SWARA approach and the MULTIMOORA approach on HFSs. In the proposed framework, the SWARA approach has been applied to elicit the preferences of a set of DEs under uncertainty, and then, an aggregated subjective weight has been provided for each challenge to adapt the online education during the COVID-19 outbreak. Next, the MULTIMOORA approach has been applied to evaluate the ranking order of higher education institutions. The comparative study has been discussed to validate the results, verifying the reasonability of the HF-SWARA-MULTIMOORA framework. According to the study results, the first rank was related to pedagogical challenges, including a lack of experience and student engagement.

It is noticeable that educational leaders should develop professional opportunities to boost online education quality and efficacy, while the number of students interested in online education has increased dramatically (Ganza 2012). Besides, institutions and governments should propose and employ proper methods and tools to assess proposed professional opportunities' effectiveness and performance. The results indicated a mixture of challenges having considerable effects on the process of adapting online education during the COVID-19 pandemic. Besides, each of the identified challenges has either a negative or positive effect on the adaption process, especially on the design delivery, while the design delivery has a crucial role in evaluating the adaption process. Furthermore, higher education institutions have a crucial role in boosting the quality of online education through supporting students, teachers, and content development, while it is believed that online education will be an inseparable part of higher education in the future (Wickersham and McElhany 2010). On top of that, many scholars and the present research concluded that institutions should deal with variant challenges to boost the quality of online education effectively (Kebritchi et al. 2017; Lion and Stark 2010; Prestera and Moller 2001); however, how institutions should deal with identified challenges, or what are the new platforms for online education, or what are the new learning theories being applicable during challenging situations such as COVID-19 pandemic can be considered as research avenues for future research.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Mahyar Kamali Saraji, Email: Mahyar.Kamali@knf.stud.vu.lt.

Abbas Mardani, Email: abbas.mardani.edu@gmail.com.

References

  1. Anderson T. Towards a theory of online learning. Theory Pract Online Learn. 2008;2:109–119. [Google Scholar]
  2. Arbaugh JB. Is there an optimal design for on-line MBA courses? Acad Manag Learn Educ. 2005;4(2):135–149. [Google Scholar]
  3. Atanassov K. Intuitionistic fuzzy sets. Fuzzy Sets Syst. 1986;20(1):87–96. [Google Scholar]
  4. Babu J, Jayakumar P. Academic engagement of college students during the national lockdown due to Covid-19. GIS-Bus. 2020;15:463–482. [Google Scholar]
  5. Bao W. "Covid-19 and online teaching in higher education: a case study of Peking University. Hum Behav Emerg Technol. 2020 doi: 10.1002/hbe2.191. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Bates AT, and San Francisco JBI (2001) Managing Technological Change-Strategies for Colleges and University Leaders, New technology in the human services), p. 55
  7. Bennett S, Lockyer L. Becoming an online teacher: adapting to a changed environment for teaching and learning in higher education. Educ Media Int. 2004;41(3):231–248. [Google Scholar]
  8. Bizaer M (2020) Pandemic reveals iran's online-learning challenges. Retrieved 17 April 2020, 2020, from https://www.al-monitor.com/pulse/originals/2020/04/iran-pandemic-online-learning-challenges-coronavirus-covid19.html
  9. Brauers WK, Zavadskas EK. the moora method and its application to privatization in a transition economy. Control Cybern. 2006;35:445–469. [Google Scholar]
  10. Brauers WKM, Zavadskas EK. Project Management by Multimoora as an Instrument for Transition Economies. Technol Econ Dev Econ. 2010;16(1):5–24. [Google Scholar]
  11. Brauers WKM, Zavadskas EK. Robustness of multimoora: a method for multi-objective optimization. Informatica. 2012;23(1):1–25. [Google Scholar]
  12. Cecilio-Fernandes D, Parisi MCR, Santos TM, Sandars J. The Covid-19 pandemic and the challenge of using technology for medical education in low and middle income countries. MedEdPublish. 2020 doi: 10.15694/mep.2020.000074.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  13. Crawford J, Butler-Henderson K, Rudolph J, Glowatz M. Covid-19:20 Countries' higher education intra-period digital pedagogy responses. J Appl Teach Learn JALT. 2020 doi: 10.37074/jalt.2020.3.1.7. [DOI] [Google Scholar]
  14. Damary R, Markova T, Pryadilina N. Key Challenges of on-line education in multi-cultural context. Procedia Soc Behav Sci. 2017;237:83–89. [Google Scholar]
  15. Dwidienawati D, Musrin M. Forced shifting to e-learing during Covid-19 outbreak-information quality system quality service quality and goal orientation influence to satisfaction and performance. Int J Adv TrendsComput Sci Eng. 2020 doi: 10.30534/ijatcse/2020/93922020. [DOI] [Google Scholar]
  16. Esfijani A. Measuring quality in online education: a meta-synthesis. Am J Distance Educ. 2018;32(1):57–73. [Google Scholar]
  17. Evans T, Haughey M, Murphy D. International handbook of distance education. Emerald Group Publishing; 2008. [Google Scholar]
  18. Ganza W (2012) The Impact of Online Professional Development on Online Teaching in Higher Education
  19. Gewin V. Five tips for moving teaching online as Covid-19 takes hold. Nature. 2020;580(7802):295–296. doi: 10.1038/d41586-020-00896-7. [DOI] [PubMed] [Google Scholar]
  20. Gillett-Swan J. The challenges of online learning: supporting and engaging the isolated learner. J Learn Des. 2017;10(1):20–30. [Google Scholar]
  21. Gössling S, Scott D, Hall CM. Pandemics, tourism and global change: a rapid assessment of Covid-19. JSustain Tour. 2020;29:1–20. [Google Scholar]
  22. Grammegna A. The new challenge of education value and limits of distance learning today. J Educ Cult Stud. 2020;4(2):59. [Google Scholar]
  23. Howell SL, Saba F, Lindsay NK, Williams PB. Seven strategies for enabling faculty success in distance education. Internet Higher Educ. 2004;7(1):33–49. [Google Scholar]
  24. Huang Y. "Research on online education in the midst of the Covid-19 pandemic. J Adv Educ Res. 2020 doi: 10.22606/jaer.2020.52005. [DOI] [Google Scholar]
  25. Jacobs P. Engaging students in online courses. Res Higher Educ. 2014;26:1–9. [Google Scholar]
  26. Jadhav V (2020) Health Education: During Lockdown
  27. Jaggars SS. Choosing between online and face-to-face courses: community college student voices. Am J Distance Educ. 2014;28(1):27–38. [Google Scholar]
  28. Kazmi SSH, Hasan K, Talib S, and Saxena S (2020) Covid-19 and lockdwon: a study on the impact on mental health, Available at SSRN 3577515
  29. Kebritchi M, Lipschuetz A, Santiague L. Issues and challenges for teaching successful online courses in higher education: a literature review. J Educ Technol Syst. 2017;46(1):4–29. [Google Scholar]
  30. Keršuliene V, Zavadskas EK, Turskis Z. Selection of rational dispute resolution method by applying new step-wise weight assessment ratio analysis (Swara) J Bus Econ Manag. 2010;11(2):243–258. [Google Scholar]
  31. Koole M. Identity and the itinerant online learner. Int Rev Res Open Distrib Learn. 2014;15(6):52–70. [Google Scholar]
  32. Lau H, Khosrawipour V, Kocbach P, Mikolajczyk A, Schubert J, Bania J, Khosrawipour T. The positive impact of lockdown in wuhan on containing the Covid-19 outbreak in China. J Travel Med. 2020 doi: 10.1093/jtm/taaa037. [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Li CS, and Irby B (2008) an overview of online education: attractiveness, benefits, challenges, concerns and recommendations, College Student Journal 42, 2
  34. Li C, Zhao H, and Xu Z (2020) Hesitant fuzzy psychological distance measure, Int J Mach Learn Cybern, pp. 1–12
  35. Liao H, Xu Z. A VIKOR-based method for hesitant fuzzy multi-criteria decision making. Fuzzy Optim Decis Making. 2013;12(04):373–392. [Google Scholar]
  36. Liao H, Xu Z, Xia M. Multiplicative consistency of hesitant fuzzy preference relation and its application in group decision making. Int J Inf Technol Decis Mak. 2014;13(01):47–76. [Google Scholar]
  37. Liao Z, Liao H, Gou X, Xu Z, Zavadskas EK. A hesitant fuzzy linguistic choquet integral-based multimoora method for multiple criteria decision making and its application in talent selection. EconComput Econ Cybern Stud Res. 2019;53(2):113. [Google Scholar]
  38. Lion RW, Stark G. A glance at institutional support for faculty teaching in an online learning environment. Educ Q. 2010;33(3):23–39. [Google Scholar]
  39. Liu X, Bonk CJ, Magjuka RJ, Lee S-H, Su B. Exploring four dimensions of online instructor roles: a program level case study. J Asynchronous Learn Netw. 2005;9(4):29–48. [Google Scholar]
  40. Lloyd SA., Byrne MM. and McCoy TS (2012) Faculty-perceived barriers of online education, J Online Learn Teach 8, 1
  41. Longhurst GJ, Stone DM, Dulohery K, Scully D, Campbell T, Smith CF. Strength, weakness, opportunity, threat (swot) analysis of the adaptations to anatomical education in the united kingdom and republic of ireland in response to the Coivd-19 pandemic. Anat Sci Educ. 2020 doi: 10.1002/ase.1967. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Mardani A, Saraji MK, Mishra AR, Rani P. A novel extended approach under hesitant fuzzy sets to design a framework for assessing the key challenges of digital health interventions adoption during the Covid-19 outbreak. Appl Soft Comput. 2020;96:106613. doi: 10.1016/j.asoc.2020.106613. [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. McInnerney JM, Roberts TS. Online learning: social interaction and the creation of a sense of community. J Educ Technol Soc. 2004;7(3):73–81. [Google Scholar]
  44. Mishra AR, Rani P, Pardasani KR. Multiple-criteria decision-making for service quality selection based on shapley copras method under hesitant fuzzy sets. Granul Comput. 2019;4(3):435–449. [Google Scholar]
  45. Mishra AR, Rani P, Pardasani KR, Mardani A. A novel hesitant fuzzy waspas method for assessment of green supplier problem based on exponential information measures. J Clean Prod. 2019;238:117901. [Google Scholar]
  46. Mishra AR, Rani P, Pandey K, Mardani A, Streimikis J, Streimikiene D, Alrasheedi M. Novel multi-criteria intuitionistic fuzzy swara-copras approach for sustainability evaluation of the bioenergy production process. Sustainability. 2020;12(10):4155. [Google Scholar]
  47. Mustafa N. Impact of the 2019–20 coronavirus pandemic on education. Int J Health Prefer Res. 2020;5(20):13. [Google Scholar]
  48. Naciri A, Kharbach A. Mobile learning in higher education: unavoidable alternative during Covid-19. Aquademia. 2020;4:20016. [Google Scholar]
  49. Prestera GE, and Moller LA (2001) Organizational alignment supporting distance education in post-secondary institutions. Annual Proceedings of Selected Research and Development [and] Practice Papers Presented at the National Convention of the Association for Educational Communications and Technology (24th, Atlanta, GA, November 8-12, 2001). Volumes 1-2; see IR 021 504.
  50. Rani P, Mishra AR, Mardani A, Cavallaro F, Štreimikienė D, Khan SAR. Pythagorean fuzzy swara-vikor framework for performance evaluation of solar panel selection. Sustainability. 2020;12(10):4278. [Google Scholar]
  51. Romero-Rodríguez J, Aznar-Díaz I, Hinojo-Lucena F, Gómez-García G. Mobile learning in higher education: structural equation model for good teaching practices. Ieee Access. 2020;8:91761–91769. doi: 10.1109/ACCESS.2020.2994967. [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Rovai AP, Barnum KT. On-line course effectiveness: an analysis of student interactions and perceptions of learning. Int J E-Learn Distance Educ/Revue Int Du e-Learn Et La Formation à Distance. 2007;18(1):57–73. [Google Scholar]
  53. Rumble G (2004) Papers and debates on the economics and costs of distance and online learning. bibliotheks-und informationssystem der Universität Oldenburg Oldenburg
  54. Shamsy J. A balancing act part i: technical support and the online instructor. eLearn. 2014;5:4. [Google Scholar]
  55. Spiceland CP, Spiceland JD, Schaeffer S., III Using a course redesign to address retention and performance issues in introductory accounting. J Account Educ. 2015;33(1):50–68. [Google Scholar]
  56. Strielkowski W (2020) Covid-19 pandemic and the digital revolution in academia and higher education
  57. Torra V. Hesitant fuzzy sets. Int J Intell Syst. 2010;25(6):529–539. [Google Scholar]
  58. Torra V, and Narukawa Y (2009) On hesitant fuzzy sets and decision, 2009 IEEE International Conference on Fuzzy Systems: IEEE, pp. 1378–1382
  59. Trow M (2007) Reflections on the transition from elite to mass to universal access: forms and phases of higher education in modern societies since Wwii, In: international handbook of higher education. Springer, pp. 243–280
  60. Vlachopoulos D. Covid-19: threat or opportunity for online education? Higher Learn Res Commun. 2020;10(1):2. [Google Scholar]
  61. Waterhouse S, Rogers RO. The importance of policies in e-learning instruction. Educ Q. 2004;27(3):28–39. [Google Scholar]
  62. Wickersham LE, McElhany JA. Bridging the divide: reconciling administrator and faculty concerns regarding online education. Q Rev Distance Educ. 2010;11(1):1. [Google Scholar]
  63. Wu X, Liao H, Xu Z, Hafezalkotob A, Herrera F. Probabilistic linguistic multimoora: a multicriteria decision making method based on the probabilistic linguistic expectation function and the improved borda rule. IEEE Trans Fuzzy Syst. 2018;26(6):3688–3702. [Google Scholar]
  64. Xia M, Xu Z. Hesitant fuzzy information aggregation in decision making. Int J Approx Reason. 2011;52(3):395–407. [Google Scholar]
  65. Xu Z, Zhang X. Hesitant fuzzy multi-attribute decision making based on topsis with incomplete weight information. Knowl-Based Syst. 2013;52:53–64. [Google Scholar]
  66. Yager RR. On the theory of bags. Int J Gen Syst. 1986;13(1):23–37. [Google Scholar]
  67. Zadeh LA. The concept of a linguistic variable and its application to approximate reasoning-Iii. Inf Sci. 1975;9(1):43–80. [Google Scholar]
  68. Zapalska A, Brozik D. Learning styles and online education. Campus-Wide Inform Syst. 2006;23:325–335. [Google Scholar]
  69. Zayapragassarazan Z. "Covid-19: strategies for engaging remote learners in medical education. Education. 2020;1000(9):273. [Google Scholar]
  70. Zhang C, Chen C, Streimikiene D, Balezentis T. Intuitionistic fuzzy multimoora approach for multi-criteria assessment of the energy storage technologies. Appl Soft Comput. 2019;79:410–423. [Google Scholar]
  71. Zhao H, Xu Z, Wang H, Liu S. Hesitant fuzzy multi-attribute decision-making based on the minimum deviation method. Soft Comput. 2017;21(12):3439–3459. [Google Scholar]

Articles from Artificial Intelligence Review are provided here courtesy of Nature Publishing Group

RESOURCES