Skip to main content
BMC Medical Informatics and Decision Making logoLink to BMC Medical Informatics and Decision Making
. 2017 Jan 23;17:14. doi: 10.1186/s12911-017-0409-5

The use of multi-criteria decision making models in evaluating anesthesia method options in circumcision surgery

Gulsah Hancerliogullari 1,3,, Kadir Oymen Hancerliogullari 2, Emrah Koksalmis 3
PMCID: PMC5260115  PMID: 28114944

Abstract

Background

Determining the most suitable anesthesia method for circumcision surgery plays a fundamental role in pediatric surgery. This study is aimed to present pediatric surgeons’ perspective on the relative importance of the criteria for selecting anesthesia method for circumcision surgery by utilizing the multi-criteria decision making methods.

Methods

Fuzzy set theory offers a useful tool for transforming linguistic terms into numerical assessments. Since the evaluation of anesthesia methods requires linguistic terms, we utilize the fuzzy Analytic Hierarchy Process (AHP) and fuzzy Technique for Order Preference by Similarity to Ideal Solution (TOPSIS). Both mathematical decision-making methods are originated from individual judgements for qualitative factors utilizing the pair-wise comparison matrix. Our model uses four main criteria, eight sub-criteria as well as three alternatives. To assess the relative priorities, an online questionnaire was completed by three experts, pediatric surgeons, who had experience with circumcision surgery.

Results

Discussion of the results with the experts indicates that time-related factors are the most important criteria, followed by psychology, convenience and duration. Moreover, general anesthesia with penile block for circumcision surgery is the preferred choice of anesthesia compared to general anesthesia without penile block, which has a greater priority compared to local anesthesia under the discussed main-criteria and sub-criteria.

Conclusions

The results presented in this study highlight the need to integrate surgeons’ criteria into the decision making process for selecting anesthesia methods. This is the first study in which multi-criteria decision making tools, specifically fuzzy AHP and fuzzy TOPSIS, are used to evaluate anesthesia methods for a pediatric surgical procedure.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-017-0409-5) contains supplementary material, which is available to authorized users.

Keywords: Circumcision surgery procedure, Anesthesia methods, Health care, Multi-criteria, Fuzzy, AHP, TOPSIS

Background

Male circumcision, which is the surgical removal of the skin covering the tip of the penis, is the most commonly performed surgical procedure during the newborn period in certain parts of the world, including the United States [13]. It is performed with the use of devices such as the plastibell, the mogan clamp, or the gomco clamp. With all these devices, the same procedure is followed. Before the surgery begins, the genital area is thoroughly cleaned using a surgical scrub preparation. The doctor examines the patient’s penis to ensure he has no conditions which contraindicate circumcision [4]. Then, anesthesia is induced when the surgical team is completely prepared to begin. The doctor pulls the foreskin from the penis. Clipping is performed in, where the foreskin of the penis to the head grows. Finally, the foreskin is cut off with a scalpel or a special device. Doctor, perhaps, need to take steps to reduce bleeding or sew up the area to crop [5, 6]. This procedure is usually performed in an outpatient setting without the need to stay in hospital. Approximately 55 to 65% of all newborn boys are circumcised in the United States [7]. The prevalence of circumcision refers to the percentage of males in a given population who have been circumcised. In 2007, the World Health Organization (WHO) estimated that globally one-third of males aged 15 years and over are circumcised [8]. Figure 1 shows estimated country-level prevalence of male circumcision.

Fig. 1.

Fig. 1

Global map of male circumcision prevalence at country level (source: http://who.int/hiv/pub/malecircumcision/globaltrends/en/)

Several researchers have indicated the reliability and safety of anesthesia methods in eliminating the pain associated with circumcision [913]. Pediatric surgeons face with different alternatives while selecting an appropriate anesthesia method to apply in the circumcision procedure. The decision is complex since there are several factors affecting the operations. The alternatives of anesthesia methods performed include general anesthesia with penile block, without penile block, and local anesthesia. However, investigations have not been conducted to determine which anesthesia method is most effective under multiple conflicting criteria. Selection of a suitable anesthesia method depends on several factors. Deciding the appropriate method is a real concern since selection of an inappropriate method may threaten patients’ lives and lead to loss of resources and time. Nevertheless, physicians may ignore the defined criteria, sub-criteria and particular patient’s values, and select the anesthesia method that they usually apply or are good at. Hence, a multi-criteria evaluation approach is required. Evaluation of anesthesia methods in a surgery is a multi-criteria decision making (MCDM) problem since it involves many conflicting criteria. Moreover, the decision matrices that are used usually include vague and uncertain data. There are several approaches to handle multi-criteria problems in the literature. A variety of decision making approaches and tools are available to support health care and medical decision making.

The interest in healthcare multi-criteria decision making is very recent as the first studies were published in 1990s, and majority was published since 2000. The methodologies adopted in healthcare multi-criteria decision analysis are reviewed [14]. Several research studies discuss the use of AHP across a broad range of applications in health care and medical decision making. A tutorial is provided on the use of AHP in medical decision making [15]. The applicability of AHP for medical and hospital decision support is reviewed [16]. An extended literature review of AHP for important problems in medical and health care decision making are presented [17]. Furthermore, AHP has been proposed for its use in medical diagnosis, for the evaluation and selection of medical treatments and therapies, for organ transplant eligibility and allocation decisions [1829].

In addition to AHP, several research studies discuss the use of TOPSIS, which is also another widely used multi-criteria decision making methods, across a broad range of applications in health care and medical decision making. An extended state-of-art survey of TOPSIS applications and methodologies including health and safety management are presented. TOPSIS has also been used in evaluating treatment and prevention options, and analyzing service quality in health care. A comprehensive performance analyses of health care for children using TOPSIS method are provided [3038].

Although there have been several applications of AHP and TOPSIS methods in health care, no applications of fuzzy AHP and fuzzy TOPSIS methodologies for the evaluation of anesthesia methods was found in the literature. The purpose of this paper is to provide the use of multi-attribute decision making models in evaluating anesthesia methods in circumcision procedure. To our knowledge, this is the first study in which multi-criteria decision making tools, specifically fuzzy AHP and fuzzy TOPSIS, are used to evaluate the anesthesia methods for a surgery in literature.

Methods

Alternative anesthesia methods and criteria for evaluation

This study aims to select the most suitable alternative among the following three anesthesia methods in circumcision surgery procedure: General anesthesia without penile block (A1), general anesthesia with penile block (A2), local anesthesia (A3).

Local anesthesia is defined as loss of sensation in a circumscribed area of the body without inducing loss of consciousness. It is an anesthetic drug, which can be given as a shot, spray, or ointment, numbs only to a small, specific area of the body. Local anesthesia lasts for a short period of time and is often used for minor outpatient procedures [4, 39]. According to some researchers, circumcision is best done using a local anesthetic, especially early in infancy when the infant is less mobile [40]. For neonatal circumcision, it is stated that since local anesthesia is simple to perform, it shows greater efficacy compared to other anesthesia methods [41].

General anesthesia differs from local anesthesia, and it makes and keeps a person completely unconscious (or ‘asleep’) during the operation, with no awareness or memory of the surgery. General anesthesia is necessary for some surgical procedures since it may be safer or more comfortable for you to be unconscious. It will either be given as a liquid injected into your veins through a cannula or gas which you breathe in through a mask [42]. Surgical procedures in children, such as postneonatal circumcision, are usually performed with the patient under general anesthesia [43].

The first main criterion, denoted with C1, is convenience, which consists of two sub-criteria convenience for patient and doctor. The physiological structure, the age and the history of the patient are effective for the decision of which anesthesia method to choose. Therefore, these factors are taken into account under the C11, convenience for patient, sub-criteria. Due to the resource availability and some doctors having more experience on a specific method compared to the others; doctors may tend to choose the anesthesia method which they are in favor and good at. These cases are taken into account under the C12, convenience for doctor.

The second main criterion, denoted with C2, is reliability, which consists of two sub-criteria, condition of penis and vital function. Some patients are born with a common condition called hypospadias, where the urinary opening is not at the usual location on the head of the penis. Moreover, some patients have penis anomalies such as double hole; in which, general anesthesia methods are preferred compared to the local anesthesia. Therefore, these factors are taken into account under the C21, condition of penis. For the cases where the patients have problems in respiratory tract, heart functions, lung functions, in other words, for the medical conditions where narcosis is not suitable, or may have side effects or threat the vital functions, the local anesthesia method is more preferred. Hence, these cases are taken into account under the C22, vital function.

The third main criterion, denoted with C3, is duration, which consists of two sub-criteria, duration of operation, duration of recovery. Compared to the general anesthesia methods, the local anesthesia takes less time and this factor is considered under the C31, duration of operation. The patient may have to undergo a prolonged stay in hospital after general anesthesia due to the effect of narcosis; on the other hand, the patient can be discharged shortly after undergoing a local anesthetic. However, the process of the recovery of the penis is similar in both general anesthesia and local anesthesia methods, and this is considered under the C32, duration of recovery.

The forth main criterion, denoted with C4, is psychology, which consists of two sub-criteria: psychology of patient and psychology of parent. In addition to the physical damage, the circumcision affects the brain; the fact of being circumcised can cause distress, resentment, anger and depression. A local anesthetic is preferred to numb the area so there is less pain and risk of injury to the penis while the baby is still awake. As children get older, they become more aware of their sexual organs, so there are more psychological impacts associated with the surgery, and children become fearful. Therefore, in older children and adults, the procedure is commonly performed under general anesthesia [44]. The severe pain of circumcision and the changes to infant-maternal interaction observed after circumcision raise the question of the effects on the parents especially mothers. Some mothers clearly remember their son’s circumcision after many years as the worst day of their life [45]. If local anesthesia is given, which eliminates risk of general anesthesia, the child will feel pressure and movement but not pain; on the other hand, under general anesthesia, he will not experience any pain during the procedure [46]. Therefore, we take into account the sub-criteria, C41 and C42, psychology of patient, psychology of parent respectively.

Penile block, which represents 85% of anesthetic use in the USA, is a technique for blocking the dorsal nerves of the penis involving injection of anesthetic at the 10 and 2 o’clock positions at the base of the penis [4749]. Numerous previous studies have evaluated the efficacy of penile block given under general anesthesia [50, 51]. It has been proposed that penile block alone provides successful intraoperative analgesia for circumcision in children. Moreover, it has been concluded that general anesthesia with penile block most reliably and safely eliminates the pain of circumcision [10]. Recently, it has been shown that general anesthesia with penile block is more effective for pediatric urological surgeries than standard general anesthesia, i.e., general anesthesia without penile block [52].

The surgeons have four main evaluation criteria for anesthesia methods in circumcision surgery procedure, which are convenience, psychology, reliability and duration. Each of these main criteria consists of two sub-criteria. The summary view of main evaluation criteria and sub-criteria for anesthesia methods can be seen in Table 1. Figure 2 illustrates the hierarchy between these criteria and alternatives.

Table 1.

The evaluation criteria for anesthesia methods

Criteria Sub-criteria
Convenience (C1) Convenience for patient (C11)
Convenience for doctor (C12)
Reliability (C2) Condition of penis (C21)
Vital function (C22)
Duration (C3) Duration of anesthesia method (C31)
Duration of recovery (C32)
Psychology (C4) Psychology of parent (C41)
Psychology of patient (C42)

Fig. 2.

Fig. 2

Hierarchy of criteria and alternatives

Fuzzy multi-attribute decision making methods

Fuzzy AHP

The analytic hierarchy process is a quantitative technique that deals with multi-attribute, multi-criteria, multi-person and multi-period problem hierarchically [53]. Even though the goal of AHP is to capture the expert’s experience, the traditional AHP still cannot fully reflect the vagueness in human thinking style. Therefore, fuzzy analytic hierarchy process (AHP) method, a fuzzy extension of AHP, was developed. In this paper, fuzzy AHP method [54], which is the extension of the conventional AHP method by integrating fuzzy comparison ratios, is used for the multi-criteria analysis.

In order to generate fuzzy weights and performance scores, geometric mean method is used. This method is used since it is easy to extend to the fuzzy case and guarantees a unique solution to the reciprocal comparison matrix. Recently, Buckley’s fuzzy AHP has been used in various applications such as selecting an ERP system for textile industry, urban industrial planning, academic personnel selection in maritime education, portfolio selection [5559]. The steps of the fuzzy AHP can be summarized as follows:

  • Step 1. Establish an expert team. The quality of the evaluation process depends on experts’ knowledge and experiences.

  • Step 2. Determine the evaluation criteria and construct the hierarchy including alternatives. Literature or questionnaires assists the expert to determine evaluation criteria.

  • Step 3. Construct pairwise comparison matrix and evaluate the relative importance of the criteria. The experts are expected to provide their judgments on the basis of their knowledge.

    For any expert the pairwise comparison matrix is given by Eq. (1) as:
    C˜k=1c˜12c˜1nc˜n1c˜n21 1
    where n is the number of criteria, C˜k is a pairwise comparison matrix belongs to k th expert for k = 1, 2,.., K. Arithmetic mean is used to aggregate experts’ opinion as given in Eq. (2).
    C˜=1KC˜1+C˜2++C˜K 2
  • Step 4. Transform the linguistic terms into triangular fuzzy numbers. The following linguistic terms provided in Table 2 are utilized for the evaluation procedure [60].

  • Step 5. Calculate the fuzzy weight matrix using Buckley’s method as follows using Eqs. (3) and (4).
    r˜i=c˜i1c˜i2c˜in1n 3
    w˜i=r˜ir˜1+r˜2++r˜n1 4
    where r˜i is the geometric mean of fuzzy comparison value, w˜i is the fuzzy weight of the i th criterion. After the fuzzy relative weight matrix is calculated, fuzzy numbers are defuzzied into crisp values using a common method, centroid method [61], and then apply the normalization procedure as provided in Eq. (5).
    wi=w˜ij=1nw˜j=Li+Mi+Uij=1nw˜j 5
  • Step 6. Check the consistency of the pairwise comparison matrices by calculating the consistency ratios.

  • Step 7. Select the best alternative using the weights of criteria and alternatives.

Table 2.

Fuzzy evaluation scale for the weights

Linguistic terms Triangular fuzzy scale
Equal (E) (1,1,1)
Slightly Important (SI) (1,1,3)
Fairly Important (FI) (1,3,5)
Highly Important (HI) (3,5,7)
Very Important (VI) (5,7,9)
Extremely Important (EI) (7,9,9)

Fuzzy TOPSIS

A computationally simple, effective and one of the classic multi-criteria decision making methods, TOPSIS, was developed [62]. The methodology chooses an alternative with the shortest distance from the positive ideal solution (PIS) and the farthest distance from the negative ideal solution (NIS). Then, in order to handle uncertainties in decision making problems, it was extended to a fuzzy environment [63]. Recently, fuzzy TOPSIS has been used in various applications such as prioritizing the best sites for treated wastewater in stream, location selection for the faculty of a university, improvement of the general flood vulnerability approach, selection of the green suppliers for an electronic company [6467]. In the following, the steps of the fuzzy TOPSIS are provided [68].

  • Step 1. Define a decision matrix, D as in Eq. (6). Evaluate the ratings of the alternatives using the linguistic variables and determine the criteria weights.
    D=A1Amx11x1jx1nxm1xmjxmn 6
    where x ij may be crisp or fuzzy. If it is fuzzy, it is represented by a trapezoidal number as x ij = (a ijb ij, c ij, d ij). The fuzzy weights are described by Eq. (7).
    wj=αjβjγjδj 7
  • Step 2. Normalize the decision matrix using the linear scale transformation as in Eq. (8):
    rij=xij/xj*,j,xjisabenefitattributexj/xij,j,xjisacostattribute 8
    Then, the normalized decision matrix in Eq. (6) can be written in Eq. (9) by applying Eq. (8) as follows:
    D=r11r1jr1nrm1rmjrmn 9

    When x ij is crisp, its corresponding r ij must be crisp; when x ij is fuzzy, its corresponding r ij must be fuzzy.

    Let x *j = (a *j, b *jc *j, d *j), x j = (a j, b jc j, d j), and x˜ij=aij,bij,cij,dij. Replace the Eq. (8) by these fuzzy operations, then obtain Eq. (10):
    r˜ij=x˜ij÷x˜j*=aijdj*bijcj*cijbj*dijaj*,forbenefitattributesx˜j÷x˜ij=ajdijbjcijcjbijdjaij,forcostattributes 10
  • Step 3. Construct the fuzzy weighted normalized decision matrix using Eq. (11):
    v˜ij=r˜ijw˜j 11
    where w˜j=αjβjγjδj.
    When both r ij and w j are crisp, v ij is crisp. On the other hand, when either r ij or w j (or both) are fuzzy, Eq. (11) can be rewritten as follows in Eq. (12):
    v˜ij=aijdj*αj,bijcj*βj,cijbj*γj,dijaj*δj,forbenefitattributesajdijαj,bjcijβj,cjbijγj,djaijδj,forcostattributes 12
    The result of Eq. (12) can be summarized as a Ṽ = [ ij]m × n matrix in Eq. (13):
    V˜=v˜11v˜1nv˜m1v˜mn 13
  • Step 4. Calculate the fuzzy positive ideal solution (FPIS, *) and the fuzzy negative ideal solution (FNIS, ) as defined in the Eqs. (14) and (15) as follows:
    A*=v˜1*v˜n* 14
    A=v˜1v˜n 15
    where *j = max i ij and j = min i ij.
  • Step 5. Calculate the separation measures S *i and S i that are defined in Eqs. (16) and (17) as follows:
    Si*=j=1nDij*,i=1,2,,m. 16
    Si=j=1nDij,i=1,2,,m. 17
    The difference measures, D *ij and D ij for crisp data are defined in Eqs. (18) and (19) as follows :
    Dij*=v˜ijv˜j* 18
    Dij=v˜ijv˜j 19
  • Step 6. Compute the closeness coefficient (CC i), which is defined to determine the ranking order of all alternatives. Once the crisp numbers S *i and S i, which can be combined, the CC i of each alternative is calculated using the Eq. (20). Then, the alternatives are ranked in descending order of the CC i.
    CCi=SiSi*+Si 20

Participants

To assess the relative importance of aforementioned anesthesia method selection criteria, a questionnaire was designed, which is available as Additional file 1. An online questionnaire, which consists of the participants’ basic characteristics, demographic questions, was prepared based on the identified main criteria and sub-criteria. Participants were recruited in discussion forums of the pediatric surgeons by posting a link to the online-based questionnaire. All participants viewed a brief explanation of the study and their rights on the first page. The participants were experts, in other words pediatric surgeons, who had experience with circumcision procedure. They were asked to rate the relative priority of each criterion with other criterion at the same level within each level of the hierarchy. A pilot questionnaire was conducted with few pediatric surgeons; based on the input received, it was refined.

Results

Application: anesthesia methods in circumcision surgery

Fuzzy AHP

The steps of the methodology provided in the Methods section are applied for the problem.

  • Step 1. The expert team consists of three experts, pediatric surgeons.

  • Step 2. The evaluation criteria are determined, and have been provided in Table 1 and the hierarchy of the criteria and alternatives are provided in Fig. 2.

  • Step 3. After several surveys have been conducted, experts determined the criteria weights by the pairwise comparison matrix. Constructed consensus matrices are provided in Table 3.

  • Step 4. The linguistic terms are transformed into triangular fuzzy numbers given in Table 2.

  • Step 5. The final weights of the alternatives are calculated using Eqs. (3), (4) and (5). Illustrative examples for weights of sub-criteria C31 and C32 are given as follows:
    r˜C31=c˜C31C31c˜C31C3212
    r˜C31=11157912
    r˜C31=2.232.643
    r˜C32=c˜C32C31c˜C32C3212
    r˜C32=1/57911112
    r˜C32=0.330.370.44
    w˜C31=r˜C31r˜C31+r˜C321
    w˜C31=2.232.6432.232.643+0.330.370.441
    w˜C31=0.640.871.17
    w˜C32=r˜C32r˜C31+r˜C321
    w˜C32=0.330.370.442.232.643+0.330.370.441
    w˜C32=0.090.120.17
    wC31=w˜C31j=12w˜C3j=LC31+MC31+UC31w˜C31+w˜C32
    wC31=0.64+0.87+1.170.64+0.87+1.17+0.09+0.12+0.17=0.88
    wC32=w˜C32j=12w˜C3j=LC32+MC32+UC32w˜C31+w˜C32
    wC32=0.09+0.12+0.170.64+0.87+1.17+0.09+0.12+0.17=0.12
    The similar calculation approach is applied for all pairwise comparisons. The final weights of the alternatives are provided in Table 4. An illustrative example for W A3 is provided as follows:
    WA3=0.08×0.83×0.15+0.08×0.17×0.18++0.25×0.30×0.24+0.25×0.70×0.25=0.29
  • Step 6. The consistency ratios of the comparison matrices are checked.

  • Step 7. According to Table 4, the best anesthesia method in circumcision surgery is Alternative 2, general anesthesia with penile block.

Table 3.

Consensus matrices

Criteria C1 C2 C3 C4 C1 C11 C12 C2 C21 C22 C3 C31 C32 C4 C41 C42
C1 E 1/VI FI 1/HI C11 E HI C21 E 1/VI C31 E VI C41 E 1/FI
C2 VI E VI HI C12 1/HI E C22 VI E C32 1/VI E C42 FI E
C3 1/FI 1/VI E 1/HI
C4 HI 1/HI HI E
C11 A1 A2 A3 C12 A1 A2 A3 C21 A1 A2 A3 C22 A1 A2 A3
A1 E 1/HI FI A1 E 1/HI 1/FI A1 E 1/SI HI A1 E SI 1/FI
A2 HI E HI A2 HI E VI A2 SI E VI A2 1/SI E HI
A3 1/FI 1/HI E A3 FI 1/VI E A3 1/HI 1/VI E A3 FI 1/HI E
C31 A1 A2 A3 C32 A1 A2 A3 C41 A1 A2 A3 C42 A1 A2 A3
A1 E 1/VI 1/VI A1 E 1/HI FI A1 E 1/HI SI A1 E 1/FI SI
A2 VI E SI A2 HI E VI A2 HI E FI A2 FI E FI
A3 VI 1/SI E A3 1/FI 1/VI E A3 1//SI 1/FI E A3 1/SI 1/FI E
Table 4.

Final weights

C1 C2 C3 C4
0.08 0.62 0.05 0.25
C11 C12 C21 C22 C31 C32 C41 C42
0.83 0.17 0.14 0.86 0.88 0.12 0.30 0.70 W
A1 0.27 0.13 0.62 0.39 0.08 0.23 0.24 0.33 0.36
A2 0.87 0.80 0.88 0.63 0.57 0.88 0.78 0.73 0.69
A3 0.15 0.18 0.14 0.35 0.45 0.10 0.24 0.25 0.29

Consistency ratio (CR): 0.001 (values at 0.1 or below represent 90% or higher confidence level)

Fuzzy TOPSIS

The steps of the methodology provided in the Methods section are applied for the problem.

  • Step 1. Experts assess the ratings of the alternatives, provided in Table 5, using a linguistic scale.

    The details of the linguistic scale for the evaluation of the alternatives are provided in Table 6.

  • Step 2. The linguistic terms are converted into triangular fuzzy numbers. Then, normalized values are computed by dividing each value to 10 which is the largest upper value in the evaluation matrix. As an illustration, the normalized matrix of Expert 3 is provided in Table 7.

  • Step 3. Weighted normalized fuzzy decision matrix of Expert 3 is provided in Table 8.

    Note that, here, to determine the criteria weights of main criteria (C1, C2, etc.) and sub-criteria (C11, C12, etc.), which are presented in parentheses, we utilize the weights obtained from the fuzzy AHP method. For example, the criteria weights associated with the Expert 3 are calculated using the pairwise matrices of the expert provided in Table 9.

    Regarding to the Table 7, an illustrative example is given for the A3 under C31 as follows:
    A˜3w=wC3×wC31×A˜3
    A˜3w=0.05×0.88×0.250.50.75
    A˜3w=0.0110.0220.033
  • Step 4. The distances of each alternative from the fuzzy positive ideal solution and the fuzzy negative ideal solution for Expert 3 are given in Tables 10 and 11. An illustrative example is provided for the value given in the third row of the sixth column of Table 10 as follows:
    FPIS,A3*=1/30.01112+0.02212+0.033121/2
    FPIS,A3*=0.565
    The value given in the third row of the sixth column of Table 11 is calculated as follows:
    FNIS,A3=1/30.0112+0.0222+0.03321/2
    FNIS,A3=0.014
  • Steps 5–6. Once the separation measures are determined, closeness coefficients are calculated, which are presented in Tables 10 and 11.

    The value of CC * (4.331) for Alternative 3, which is obtained by taking the sum of the third row, is provided in the last column of Table 10. Similarly, the value of CC (0.317) for Alternative 3, is provided by taking the sum of the related row, is in the last column of Table 11.

    The value of CC i for Alternative 3,CC 3, is calculated as follows:
    CC3=0.3174.331+0.317
    CC3=0.068
Table 5.

Linguistic evaluation of alternatives by each expert

Expert 1 C1 C2 C3 C4
C11 C12 C21 C22 C31 C32 C41 C42
A1 VG VG F G VG G VG G
A2 F P G F VG P F F
A3 G F F G F F VG F
Expert 2 C1 C2 C3 C4
C11 C12 C21 C22 C31 C32 C41 C42
A1 G F G F F V F F
A2 VG VG VG G G VG VG G
A3 F G P F G F F G
Expert 3 C1 C2 C3 C4
C11 C12 C21 C22 C31 C32 C41 C42
A1 F F G F F G P F
A2 G G VG G G VG F G
A3 F VG F F F F P F
Table 6.

Fuzzy evaluation scale for the alternatives

Linguistic terms Triangular fuzzy scale
Poor (P) (0,2.5,5)
Fair (F) (2.5,5,7.5)
Good (G) (5,7.5,10)
Very Good (VG) (7,10,10)
Table 7.

Normalized fuzzy decision matrix of Expert 3

Normalized Matrix
Expert 3 C1 C2 C3 C4
C11 C12 C21 C22 C31 C32 C41 C42
A1 (0.25,0.5,0.75) (0.25,0.5,0.75) (0.5,0.75,1) (0.25,0.5,0.75) (0.25,0.5,0.75) (0.5,0.75,1) (0,0.25,0.5) (0.25,0.5,0.75)
A2 (0.5,0.75,1) (0.5,0.75,1) (0.7,1,1) (0.5,0.75,1) (0.5,0.75,1) (0.7,1,1) (0.25,0.5,0.75) (0.5,0.75,1)
A3 (0.25,0.5,0.75) (0.7,1,1) (0.25,0.5,0.75) (0.25,0.5,0.75) (0.25,0.5,0.75) (0.25,0.5,0.75) (0,0.25,0.5) (0.25,0.5,0.75)
Table 8.

Weighted normalized fuzzy decision matrix of Expert 3

Expert 3 C1 (0.08) C2 (0.66) C3 (0.05) C4 (0.21)
C11 (0.90) C12 (0.10) C21 (0.17) C22 (0.83) C31 (0.88) C32 (0.12) C41 (0.40) C42 (0.60)
A1 (0.018,0.036,0.054) (0.002,0.004,0.006) (0.056,0.084,0.112) (0.136,0.273,0.410) (0.011,0.022,0.033) (0.003,0.004,0.006) (0,0.021,0.042) (0.031,0.063,0.094)
A2 (0.036,0.054,0.072) (0.004,0.006,0.008) (0.078,0.112,0.112) (0.273,0.410,0.547) (0.022,0.033,0.044) (0.004,0.006,0.006) (0.021,0.042,0.063) (0.063,0.094,0.126)
A3 (0.018,0.036,0.054) (0.005,0.008,0.008) (0.028,0.056,0.084) (0.273,0.410,0.547) (0.011,0.022,0.033) (0.001,0.003,0.004) (0,0.021,0.042) (0.031,0.063,0.094)
Table 9.

Pairwise matrices of Expert 3

Criteria C1 C2 C3 C4 C1 C11 C12 C2 C21 C22 C3 C31 C32 C4 C41 C42
C1 E 1/VI FI 1/HI C11 E EI C21 E 1/HI C31 E VI C41 E 1/SI
C2 VI E EI VI C12 1/EI E C22 HI E C32 1/VI E C42 SI E
C3 1/FI 1/EI E 1/HI
C4 HI 1/VI HI E
C11 A1 A2 A3 C12 A1 A2 A3 C21 A1 A2 A3 C22 A1 A2 A3
A1 E 1/VI FI A1 E 1/HI 1/FI A1 E 1/SI HI A1 E SI 1/FI
A2 VI E HI A2 HI E VI A2 SI E VI A2 1/SI E VI
A3 1/FI 1/HI E A3 FI 1/VI E A3 1/HI 1/VI E A3 FI 1/VI E
C31 A1 A2 A3 C32 A1 A2 A3 C41 A1 A2 A3 C42 A1 A2 A3
A1 E 1/VI 1/VI A1 E 1/HI FI A1 E 1/HI SI A1 E 1/SI SI
A2 VI E SI A2 HI E VI A2 HI E SI A2 SI E FI
A3 VI 1/SI E A3 1/FI 1/VI E A3 1/SI 1/SI E A3 1/SI 1/FI E
Table 10.

The distances of each alternative from the fuzzy positive ideal solution for Expert 3

FPIS
Expert 3 C1 C2 C3 C4 CC*
C11 C12 C21 C22 C31 C32 C41 C42
A1 0.557 0.573 0.545 0.346 0.565 0.576 0.565 0.541 4.268
A2 0.546 0.574 0.519 0.346 0.558 0.574 0.553 0.523 4.194
A3 0.557 0.575 0.529 0.424 0.565 0.575 0.565 0.541 4.331
Table 11.

The distances of each alternative from the fuzzy negative ideal solution for Expert 3

FNIS
Expert 3 C1 C2 C3 C4 CC CCi
C11 C12 C21 C22 C31 C32 C41 C42
A1 0.022 0.004 0.035 0.246 0.014 0.002 0.016 0.039 0.378 0.081
A2 0.032 0.004 0.059 0.246 0.020 0.003 0.026 0.057 0.446 0.096
A3 0.022 0.002 0.050 0.171 0.014 0.003 0.016 0.039 0.317 0.068

Sensitivity analysis

The objective of the sensitivity analysis is to observe how sensitive that our choice is to potential alterations in criteria weights. To do so, it is assumed that experts change their preferences for the criteria, and we consider various scenarios. In the following, the steps of the sensitivity analysis can be summarized:

  • Step 1. The calculation procedure provided in the Methods section is applied for each expert’s preferences.

  • Step 2. Various weighting scenarios, which are provided in Table 12, are applied in order to find a joint decision matrix.

  • Step 3. Ranking scores with respect to each expert is computed.

Table 12.

Weighting scenarios

Scenario 1 Scenario 2 Scenario 3 Scenario 4
Expert 1 40% 30% 30% 33.33%
Expert 2 30% 40% 30% 33.33%
Expert 3 30% 30% 40% 33.33%

According to the Fig. 3, regarding the consensus decisions, the best anesthesia method alternative is the A2, which is general anesthesia with penile block. Moreover, except Expert 1, the rankings of the alternative anesthesia methods are similar.

Fig. 3.

Fig. 3

Rankings of alternatives obtained by fuzzy AHP

The similar computation practice is applied to all experts’ preferences and weighting scenarios provided in the Methods section. Now, the rankings are represented through closeness coefficients which we provided a sample computational analysis in the Results section. The results are shown in Fig. 4, and the pattern is similar to Fig. 3.

Fig. 4.

Fig. 4

Rankings of alternatives obtained by fuzzy TOPSIS

Moreover, the consistency of responses and validity of the results are assessed based on the consistency ratio (CR), developed by Saaty, which enables to observe variations between the different pairwise comparisons. The CR value of all above pair-wise comparison matrix being 0.1 or below implies that the experts’ judgments are reasonable; values at 0.1 or above represent weak consistency [53]. The results indicate a good consistency with a CR of 0.01, which represents more than 90% confidence level (Table 4). Good consistency ratios infer that the responses expressed by experts are not arbitrary, and they are well thought responses.

Discussion

In this paper, the evaluation of anesthesia methods is considered as a multi-criteria decision making problem which involves multiple and conflicting attributes. The decision matrices typically consist of vagueness and uncertainty, which are handled by the fuzzy sets. The results obtained by the fuzzy AHP are compared by the fuzzy TOPSIS method. The sensitivity analysis is conducted based on different scenarios of experts’ preferences; the results indicate that the ranking of the alternatives is insensitive to the probabilities in the criteria weights.

As expected, there are variations in the preferences through the multi-criteria decision making models. It is not straightforward for pediatric surgeons to make consistent decisions when faced with unfamiliar problems involving trade-offs between the advantages and disadvantages. The multi-criteria decision making methods were designed to help them make more informed choices in a step-by-step manner. The multi-criteria decision making methods, including AHP and TOPSIS, have been proposed for medical diagnosis, evaluation and selection of medical treatments and therapies; however, no studies have been done with the participation of pediatric surgeons. Discussion of the results with the expert participants confirmed that they consider these factors in the following order: first reliability, followed by psychology, convenience and duration.

Our research indicates that general anesthesia with penile block for circumcision surgery is the preferred choice of anesthesia compared to general anesthesia without penile block, which has a greater priority compared to local anesthesia under the discussed main-criteria and sub-criteria. Moreover, the reliability has a higher priority compared to the convenience, psychology and duration. Specifically, the vital function is more important than the condition of penis, as expected. The convenience for the patient is a more significant criterion than the convenience for the doctor. In addition, the decision maker should give more importance to the psychology of the patient compared to the psychology of the parent.

In order to offer feedback to facilitate the decision-making process, clinically practical decision-support tools have to be developed. Providing the strengths and limitations of each anesthesia method option definitely affects the patients’ and their parents’ decisions. Shared-decision making approach between patient and doctor should be applied in the evaluation and selection of therapy and treatment options. Our study provides a reference for a clinical decision-support system for pediatric surgeons, assisting them in multi-criteria decision making as well as providing details of the procedure to the patients with simple computerised processes.

Limitations

This study has several limitations. Our sample was limited to few pediatric surgeons working in Turkey who had circumcision surgery experience. Future research in a more culturally diverse geographical region can be completed and compared with the results of this paper since preferences/experiences may change by country, tradition or socioeconomic level. As stated earlier, it is crucial to improve physician-patient discussions and adopt a shared-decision making approach. Therefore, preferences of patients (or their families) can also be observed similarly.

Conclusions

To our knowledge, this is the first study to measure preferences of pediatric surgeons for anesthesia method selection for circumcision surgery. Deciding among the anesthesia methods is a complex decision problem due to the fact that each option has advantages and disadvantages. We presented the results of a study on the application of fuzzy AHP and fuzzy TOPSIS methodologies. A set of criteria for anesthesia method for circumcision were identified based on the literature review and inputs from experts, and organized into a rational hierarchical framework consisting of the four main criteria and eight sub-criteria.

For future research, further fuzzy decision making methods such as VIKOR, ELECTRE, PROMETHE, and ANP can be used, and their results can be compared with the results obtained in this paper. The model proposed in this research can also be applied to other multi-criteria decision making problems in medical or health care operations.

Acknowledgments

Authors wish to thank all participating experts. Authors would also like to thank two reviewers for their insightful and helpful comments and suggestions that have led to significant improvements in the paper.

Funding

This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Availability of data and material

All data generated or analysed during this study are included in this paper.

Authors’ contributions

GH was responsible for the study conception and design, analysing the data, and drafting the manuscripts as the lead writer. OH contributed the study design, conducted the focus groups, performed the data collection, and made critical revisions to the paper. EK contributed the study design, performed the data analysis and made critical revisions to the paper. All authors approved the final version of the manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Ethical approval was issued by the Social Sciences and Human Research Ethics Committee of the Istanbul Technical University (Project Number:40). Informed consent was obtained from all participants prior to the survey.

Abbreviations

AHP

Analytic hierarchy process

MCDM

Multi-criteria decision making

NIS

Negative ideal solution

PIS

Positive ideal solution

TOPSIS

Technique for order preference by similarity to ideal solution

UTI

Urinary tract infections

Additional file

Additional file 1: (485.5KB, pdf)

Questionnaire. (PDF 485 kb)

Contributor Information

Gulsah Hancerliogullari, Email: gulsahhancerliogullari@gmail.com.

Kadir Oymen Hancerliogullari, Email: dr-oymen@hotmail.com.

Emrah Koksalmis, Email: koksalmis@itu.edu.tr.

References

  • 1.Lissauer T, Clayden G. Illustrated Textbook of Paediatrics. London: Elsevier Health Sciences; 2011.
  • 2.Rudolph C, Rudolph A, Lister G, First L, Gershon A. Rudolph’s Pediatrics, 22nd Edition. New York: McGraw-Hill Companies; 2011.
  • 3.Sawyer S. Pediatric Physical Examination & Health Assessment. Massachusetts: Jones & Bartlett Publishers; 2011.
  • 4.Circumcision policy statement. American Academy of Pediatrics. Task Force on Circumcision. Pediatrics. 1999;103(3):686–693 [PubMed]
  • 5.Neonatal Circumcision: An Audiovisual Primer. Stanford School of Medicine. Available from: URL: http://med.stanford.edu/newborns/professional-education/circumcision.html. Accessed 21 Sept 2015.
  • 6.World Health Organisation. Manual for male circumcision under local anaesthesia. 2008. Available from: http://www.who.int/hiv/pub/malecircumcision/local_anaesthesia/en/index.html. Accessed 21 Sept 2015.
  • 7.Kids Health Organization. Available from: URL: http://www.kidshealth.org/. Accessed 10 Nov 2015.
  • 8.World Health Organisation. Male circumcision: global trends and determinants of prevalence, safety and acceptability. 2007. Available from: http://who.int/hiv/pub/malecircumcision/globaltrends/en/. Accessed 21 Sept 2015.
  • 9.Loban AH, Millat E, Alauddin J, Ferdous KMN. Circumcision with Intravenous (IV) Ketamine, Thiopentone and Penile Block: A Safe and Cost-effective Anesthetic Technique. Chattagram Maa-O-Shishu Hosp Med Coll J. 2013;12(1):34–37. doi: 10.11566/cmosh.2013.1201.34. [DOI] [Google Scholar]
  • 10.Lenhart JG, Lenhart NM, Reid A, Chong BK. Local anesthesia for circumcision: which technique is most effective? J Am Board Fam Pract. 1997;10(1):13–19. [PubMed] [Google Scholar]
  • 11.Serour F, Reuben S, Ezra S, Greenfield SP. Circumcision in children with penile block alone. J Urol. 1995;153(2):474–476. doi: 10.1097/00005392-199502000-00062. [DOI] [PubMed] [Google Scholar]
  • 12.Jayanthi VR, Burns JE, Koff SA. Postneonatal circumcision with local anesthesia: a cost-effective alternative. J Urol. 1999;161(4):1301–1303. doi: 10.1016/S0022-5347(01)61674-4. [DOI] [PubMed] [Google Scholar]
  • 13.Stang HJ, Gunnar MR, Snellman L, Condon LM, Kestenbaum R. Local anesthesia for neonatal circumcision: effects on distress and cortisol response. JAMA. 1988;259(10):1507–1511. doi: 10.1001/jama.1988.03720100025033. [DOI] [PubMed] [Google Scholar]
  • 14.Marsh K, Lanitis T, Neasham D, Orfanos P, Caro J. Assessing the value of healthcare interventions using multi-criteria decision analysis: a review of the literature. Pharmacoeconomics. 2014;32(4):345–365. doi: 10.1007/s40273-014-0135-0. [DOI] [PubMed] [Google Scholar]
  • 15.Dolan JG, Isselhardt BJ, Cappuccio JD. The Analytic Hierarchy Process in Medical Decision Making A Tutorial. Med Decis Mak. 1989;9(1):40–50. doi: 10.1177/0272989X8900900108. [DOI] [PubMed] [Google Scholar]
  • 16.Sloane EB, Liberatore MJ, Nydick RL. Medical decision support using the Analytic Hierarchy Process. J Healthc Inf Manag. 2011;16(4):38–43. [PubMed] [Google Scholar]
  • 17.Liberatore MJ, Nydick RL. The analytic hierarchy process in medical and health care decision making: A literature review. Eur J Oper Res. 2008;189(1):194–207. doi: 10.1016/j.ejor.2007.05.001. [DOI] [Google Scholar]
  • 18.Padilla-Garrido N, Aguado-Correa F, Cortijo-Gallego V, López-Camacho F. Multicriteria Decision Making in Health Care Using the Analytic Hierarchy Process and Microsoft Excel. Med Decis Mak. 2014;34(7):931–935. doi: 10.1177/0272989X14534533. [DOI] [PubMed] [Google Scholar]
  • 19.Dolan JG. Medical decision making using the analytic hierarchy process choice of initial antimicrobial therapy for acute pyelonephritis. Med Decis Mak. 1989;9(1):51–56. doi: 10.1177/0272989X8900900109. [DOI] [PubMed] [Google Scholar]
  • 20.Dolan JG. Can decision analysis adequately represent clinical problems? J Clin Epidemiol. 1990;43(3):277–284. doi: 10.1016/0895-4356(90)90008-D. [DOI] [PubMed] [Google Scholar]
  • 21.Cook DR, Staschak S, Green WT. Equitable allocation of livers for orthotopic transplantation: an application of the analytic hierarchy process. Eur J Oper Res. 1990;48(1):49–56. doi: 10.1016/0377-2217(90)90060-O. [DOI] [PubMed] [Google Scholar]
  • 22.Dolan JG, Bordley DR. Using the analytic hierarchy process (AHP) to develop and disseminate guidelines. QRB Qual Rev Bull. 1992;18(12):440–447. doi: 10.1016/S0097-5990(16)30570-X. [DOI] [PubMed] [Google Scholar]
  • 23.Dolan JC, Bordley DR, Miller H. Diagnostic strategies in the management of acute upper gastrointestinal bleeding. J Gen Intern Med. 1993;8(10):525–529. doi: 10.1007/BF02599632. [DOI] [PubMed] [Google Scholar]
  • 24.Dolan JG, Bordley DR. Isoniazid Prophylaxis The Importance of Individual Values. Med Decis Mak. 1994;14(1):1–8. doi: 10.1177/0272989X9401400101. [DOI] [PubMed] [Google Scholar]
  • 25.Koch T. Normative and prescriptive criteria: the efficacy of organ transplantation allocation protocols. Theor Med. 1996;17(1):75–93. doi: 10.1007/BF00489742. [DOI] [PubMed] [Google Scholar]
  • 26.Singpurwalla N, Forman E, Zalkind D. Promoting shared health care decision making using the analytic hierarchy process. Socio Econ Plan Sci. 1999;33(4):277–299. doi: 10.1016/S0038-0121(99)00009-9. [DOI] [Google Scholar]
  • 27.Hummel MJ, Snoek GJ, Til JA, Rossum W, IJzerman MJ. A multicriteria decision analysis of augmentative treatment of upper limbs in persons with tetraplegia. J Rehabil Res Dev. 2005;42(5):635–644. doi: 10.1682/JRRD.2004.07.0088. [DOI] [PubMed] [Google Scholar]
  • 28.Richman MB, Forman EH, Bayazit Y, Einstein DB, Resnick MI, Stovsky MD. A novel computer based expert decision making model for prostate cancer disease management. J Urol. 2005;174(6):2310–2318. doi: 10.1097/01.ju.0000181829.07078.22. [DOI] [PubMed] [Google Scholar]
  • 29.Maruthur NM, Joy SM, Dolan JG, Shihab HM, Singh S. Use if the Analytical Hierarchy Process for Medication Decision-Making in Type 2 Diabetes. PLoS One. 2015;10(5):e0126625. doi: 10.1371/journal.pone.0126625. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Behzadian M, Otaghsara SK, Yazdani M, Ignatius J. A state-of the-art survey of TOPSIS applications. Expert Syst Appl. 2012;39(17):13051–13069. doi: 10.1016/j.eswa.2012.05.056. [DOI] [Google Scholar]
  • 31.Guo HQ, Guo HF, Ding HL, Qu B, Sun G. Comprehensive evaluation to the performance of health care for children from 1997 to 2009 in China with TOPSIS method. Chin J Child Health Care. 2011;1:012. [Google Scholar]
  • 32.Ferrari MD, Goadsby PJ, Lipton RB, Dodick DW, Cutrer FM, McCrory D, Williams P. The use of multiattribute decision models in evaluating triptan treatment options in migraine. J Neurol. 2015;252(9):1026–1032. doi: 10.1007/s00415-005-0769-0. [DOI] [PubMed] [Google Scholar]
  • 33.Rahimi S, Gandy L, Mogharreban N. A web‐based high‐performance multicriteria decision support system for medical diagnosis. Int J Intell Syst. 2007;22(10):1083–1099. doi: 10.1002/int.20238. [DOI] [Google Scholar]
  • 34.Yu MH, Zhu XK, Dong XY, Zhou N, Liu ZQ, Guo Y, Bai JY. TOPSIS Method for The Quality Evaluation of AIDS Control and Prevention in Tianjin City. Occup Health. 2009;3:008. [Google Scholar]
  • 35.Büyüközkan G, Çifçi G. A combined fuzzy AHP and fuzzy TOPSIS based strategic analysis of electronic service quality in healthcare industry. Expert Syst Appl. 2012;39(3):2341–2354. doi: 10.1016/j.eswa.2011.08.061. [DOI] [Google Scholar]
  • 36.Kuo RJ, Wu YH, Hsu TS. Integration of fuzzy set theory and TOPSIS into HFMEA to improve outpatient service for elderly patients in Taiwan. J Chin Med Assoc. 2012;75(7):341–348. doi: 10.1016/j.jcma.2012.05.001. [DOI] [PubMed] [Google Scholar]
  • 37.Hamidi N, Gheibdoust H, Ramezanian MR. Application of network analysis and fuzzy topsis to analyze electronic service quality of health care industry. J Health Adm. 2014;17(55):17–28. [Google Scholar]
  • 38.Ijabi E, Karimlo M, Rahgozar M, Tavakoli M. Evaluating and Prioritizing Addiction Treatment Methods through the TOPSIS Technique. J Rehabil. 2014;14(5):108–116. [Google Scholar]
  • 39.Malamed SF. Handbook of local anesthesia. Missouri: Elsevier Health Sciences; 2014.
  • 40.Mancuso T, Burns J. Ethical concerns in the management of pain in the neonate. Pediatr Anesth. 2009;19(10):953–957. doi: 10.1111/j.1460-9592.2009.03144.x. [DOI] [PubMed] [Google Scholar]
  • 41.Masciello AL. Anesthesia for neonatal circumcision: local anesthesia is better than dorsal penile nerve block. Obstet Gynecol. 1990;75(5):834–838. [PubMed] [Google Scholar]
  • 42.National Health Services. Available from: URL: http://www.nhs.uk/conditions/anaesthetic-general/pages/definition.aspx. Accessed 10 Nov 2015.
  • 43.Wiswell TE, Tencer HL, Welch CA, Chamberlain JL. Circumcision in children beyond the neonatal period. Pediatrics. 1993;92(6):791–793. [PubMed] [Google Scholar]
  • 44.Circumcision and psychological harm. Available from: http://www.circinfo.org/Psychological_harm.html. Accessed 10 Nov 2015.
  • 45.Goldman R. The psychological impact of circumcision. BJU Int. 1999;83(1):93–102. doi: 10.1046/j.1464-410x.1999.0830s1093.x. [DOI] [PubMed] [Google Scholar]
  • 46.Pollack M. Jewish feminist perspective. Paper presented at the Third International Symposium on Circumcision. College Park: National Organization of Circumcision Information Resource Centers NOCIRC; 1994.
  • 47.Warner E, Strashin E. Benefits and risks of circumcision. Can Med Assoc J. 1981;125(9):967. [PMC free article] [PubMed] [Google Scholar]
  • 48.Howard CR, Howard FM, Fortune K, Generelli P, Zolnoun D. A randomized, controlled trial of a eutectic mixture of local anesthetic cream versus penile nerve block for pain relief during circumcision. Am J Obstet Gynecol. 1999;181(6):1506–1511. doi: 10.1016/S0002-9378(99)70397-2. [DOI] [PubMed] [Google Scholar]
  • 49.Dalens B, Vanneuville G, Dechelotte P. Penile block via the subpubic space in 100 children. Anesth Analg. 1989;69(1):41–45. doi: 10.1213/00000539-198907000-00008. [DOI] [PubMed] [Google Scholar]
  • 50.Carlsson P, Svensson J. The duration of pain relief after penile block to boys undergoing circumcision. Acta Anaesthesiol Scand. 1984;28(4):432–434. doi: 10.1111/j.1399-6576.1984.tb02093.x. [DOI] [PubMed] [Google Scholar]
  • 51.Ishigooka M, Yaguchi H, Hashimoto T, Hayami S, Sasagawa I, Nakada T, Mitobe K. Penile block via subpubic space for children who underwent superficial operation of the penis. Urol Int. 1994;53(3):147–149. doi: 10.1159/000282657. [DOI] [PubMed] [Google Scholar]
  • 52.Panda A, Bajwa SJS, Sen S, Parmar SS. Penile block for paediatric urological surgery: A comparative evaluation with general anaesthesia. Indian J Urol. 2011;27(4):457. doi: 10.4103/0970-1591.91432. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Saaty TL. The analytic hierarchy process: planning, priority setting, resources allocation. New York: McGraw; 1980. [Google Scholar]
  • 54.Buckley JJ. Fuzzy hierarchical analysis. Fuzzy Sets Syst. 1985;17(3):233–247. doi: 10.1016/0165-0114(85)90090-9. [DOI] [Google Scholar]
  • 55.Cebeci U. Fuzzy AHP-based decision support system for selecting ERP systems in textile industry by using balanced scorecard. Expert Syst Appl. 2009;36(5):8900–8909. doi: 10.1016/j.eswa.2008.11.046. [DOI] [Google Scholar]
  • 56.Celik M, Kandakoglu A, Er ID. Structuring fuzzy integrated multi-stages evaluation model on academic personnel recruitment in MET institutions. Expert Syst Appl. 2009;36(3):6918–6927. doi: 10.1016/j.eswa.2008.08.057. [DOI] [Google Scholar]
  • 57.Pan NF. Selecting an appropriate excavation construction method based on qualitative assessments. Expert Syst Appl. 2009;36(3):5481–5490. doi: 10.1016/j.eswa.2008.06.097. [DOI] [Google Scholar]
  • 58.Tiryaki F, Ahlatcioglu B. Fuzzy portfolio selection using fuzzy analytic hierarchy process. Inf Sci. 2009;179(1):53–69. doi: 10.1016/j.ins.2008.07.023. [DOI] [Google Scholar]
  • 59.Kaya T, Kahraman C. An integrated fuzzy AHP–ELECTRE methodology for environmental impact assessment. Expert Syst Appl. 2011;38(7):8553–8562. doi: 10.1016/j.eswa.2011.01.057. [DOI] [Google Scholar]
  • 60.Hsieh TY, Lu ST, Tzeng GH. Fuzzy MCDM approach for planning and design tenders selection in public office buildings. Int J Proj Manag. 2004;22(7):573–584. doi: 10.1016/j.ijproman.2004.01.002. [DOI] [Google Scholar]
  • 61.Opricovic S, Tzeng GH. Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS. Eur J Oper Res. 2004;156(2):445–455. doi: 10.1016/S0377-2217(03)00020-1. [DOI] [Google Scholar]
  • 62.Yoon K, Hwang CL. TOPSIS (technique for order preference by similarity to ideal solution)–a multiple attribute decision making, w: Multiple attribute decision making–methods and applications, a state-of-the-at survey. 1981. pp. 128–140. [Google Scholar]
  • 63.Chen SJ, Hwang CL. Fuzzy Multiple Attribute Decision Making. Berlin Heidelberg: Springer; 1992. Multiple Attribute Decision Making—An Overview. [Google Scholar]
  • 64.Kim Y, Chung ES, Jun SM, Kim SU. Prioritizing the best sites for treated wastewater instream use in an urban watershed using fuzzy TOPSIS. Resour Conserv Recycl. 2013;73:23–32. doi: 10.1016/j.resconrec.2012.12.009. [DOI] [Google Scholar]
  • 65.Lee G, Jun KS, Chung ES. Robust spatial flood vulnerability assessment for Han River using fuzzy TOPSIS with α-cut level set. Expert Syst Appl. 2014;41(2):644–654. doi: 10.1016/j.eswa.2013.07.089. [DOI] [Google Scholar]
  • 66.Kannan D, de Sousa Jabbour ABL, Jabbour CJC. Selecting green suppliers based on GSCM practices: Using fuzzy TOPSIS applied to a Brazilian electronics company. Eur J Oper Res. 2014;233(2):432–447. doi: 10.1016/j.ejor.2013.07.023. [DOI] [Google Scholar]
  • 67.Suder A, Kahraman C. Minimizing environmental risks using fuzzy TOPSIS: Location selection for the ITU Faculty of Management. Hum Ecol Risk Assess Int J. 2015;21(5):1326–1340. doi: 10.1080/10807039.2014.955395. [DOI] [Google Scholar]
  • 68.Chen CT. Extensions of the TOPSIS for group decision-making under fuzzy environment. Fuzzy Sets Syst. 2000;114(1):1–9. doi: 10.1016/S0165-0114(97)00377-1. [DOI] [Google Scholar]

Articles from BMC Medical Informatics and Decision Making are provided here courtesy of BMC

RESOURCES