Skip to main content
BMC Medical Informatics and Decision Making logoLink to BMC Medical Informatics and Decision Making
. 2019 Sep 6;19:182. doi: 10.1186/s12911-019-0892-y

Identification and weighting of kidney allocation criteria: a novel multi-expert fuzzy method

Nasrin Taherkhani 1, Mohammad Mehdi Sepehri 2,, Shadi Shafaghi 3, Toktam Khatibi 2
PMCID: PMC6729045  PMID: 31492132

Abstract

Background

Kidney allocation is a multi-criteria and complex decision-making problem, which should also consider ethical issues in addition to the medical aspects. Leading countries in this field use a point scoring system to allocate kidneys. Hence, the purpose of this study is to identify and weight the kidney allocation criteria considering the balance between utility and equity.

Methods

To do this, a new fuzzy hybrid approach is proposed, which consists of two steps: In the first step, Fuzzy Delphi Method (FDM) is used to identify the effective criteria in the kidney allocation algorithm. In the second step, Intuitionistic Fuzzy Analytic Hierarchy Process (IF-AHP) is employed to determine the weight of the criteria.

Results

The results showed that the highest weight belongs to “Medical emergency” criterion and the lowest weight to “5 HLA mismatches”, which is similar to Euro-transplant kidney allocation system (ETKAS). The developed method is evaluated in two steps. First, the proposed model is implemented using a real case study from the Iranian Kidney Allocation System. It was shown that the proposed model has the potential to improve allocation outcome. Second, the proposed model’s superiority to the current model is approved by the experts using the results display in the profile matrix. Finally, sensitivity analysis is performed to check the robustness of the proposed model.

Conclusions

This paper contributes to the kidney allocation literature by doing the following: (a) developing a comprehensive framework for identification and weightings of criteria for kidney allocation, (b) using, for the first time, the IF-AHP technique to consider hesitancy of decision makers and uncertainty in organ allocation, and (c) proposing an appropriate framework for the countries that intend to improve or modify their organ allocation system.

Electronic supplementary material

The online version of this article (10.1186/s12911-019-0892-y) contains supplementary material, which is available to authorized users.

Keywords: Kidney allocation, Fuzzy Delphi method, Intuitionistic fuzzy AHP, Kidney allocation criteria

Background

In recent years, medical knowledge has paid special attention to organ transplantation so that the concerns of patients in the end stages of failure of the organ have been improved significantly. Among the organs that can be transplanted, the kidneys have the highest demand. In the United States, as of September 2018, there were about 114,000 patients on the waiting list of organ transplantation, with more than 94,000 of them requiring kidney transplantation (82.45%) [1]. In Iran, as of October 2018, 80.34% of the candidates’ waiting lists required kidney transplant [2]. Among the most important challenges in organ transplantation process are the organ allocation policies and finding the most appropriate recipient. Over time, organ allocation policies have changed and improved. Stegall et al. have explained the changes and modifications that have occurred in the kidney allocation system in the United States from 2004 to 2014, leading to the new Kidney Allocation System (KAS) [3]. The central concept is that kidney allocation should create a balance between utility (the best use of kidneys) and equity (equal access to kidneys for all wait-listed patients). Currently, many allocation policies have been developed with the aim of balancing between utility and equity.

There is a lot of fundamental debate about balancing between the utility and equity criteria. When the sub-criteria of equity such as medical urgency are used to rank patients, some decision makers may have this question in mind: “Is it ethical to differentiate between patients due to their medical conditions?” [4]. Conversely, when utility sub-criteria are considered, others may ask: “Is it ethical to distinguish between patients who will have more survival than those who survive less?” [5]. Of course, there are researches with no clear-cut resolution to this issue, and their goal is to solely find a balance between utility and equity [6].

There are many organizations in the world for organ transplantation such as United Network for Organ Sharing (UNOS) in the United States, Euro-transplant in Europe, and Organization Nacional de Transplant (ONT) in Spain. In Iran, there is currently no comprehensive and integrated system for organ transplantation. Of course, efforts have been made to create an integrated network for organ procurement and transplantation. Iranian Network for Organ Procurement and Transplantation (IRNOPT) is the result of this effort [7]; however, it has not been implemented yet.

According to the geographical extent of Iran, the different regions of the country perform locally the process of organ procurement and allocation. In the case of kidney, the country is divided into 15 regions, and each region has its own waiting list, but the same algorithm used in each of them. If an organ is available in one region, allocation is done locally. It rarely happens that the kidneys are sent from one region to another. Any patient needing kidney transplantation has to register in the waiting list of a region (a patient may register at the same time in the list of several regions). When a donation kidney is available, the allocator (an expert person who is responsible for organ allocation) tries to select the most suitable candidate by searching in the waiting list. To select the most suitable candidate, the waiting list is filtered based on the blood type and medical urgency. Then she/he sorts the list based on the waiting time, and determines six high priorities based on the two factors: 1. The distance between the patient’s place of residence and the TC (can the recipient reach the TC at the right time?) 2. Age difference between the donor and the recipient (is the age difference between the donor and the recipient appropriate?). Two high priorities are kidney recipients and four next priorities are in reservation mode. For any reason, if two high priorities cannot receive the kidney, the other four booked priorities are prepared for transplantation. In fact, the existing method is largely equity-based and does not pay much attention to the criteria that affect the graft survival. Although the age difference is one of the factors that increases utility, but in existing method it is not the key factor for allocation. Only in the final step, the expert checks that the age difference is not outside the specified range (less than 15 years). However, the allocator tries to make the best selection by taking all the criteria into consideration. Given that the waiting list is gradually reduced by filtering, and finally, the expert selects the recipients among the remained candidate in the filter list, the overall effect of all criteria is not considered. On the other hand, the likelihood of human error and emotions can affect the outcome of the allocation. Hence, there are several reasons to change and modify the current allocation algorithm. The most important reason for changing the current system is to improve the overall survival of the transplant and patients. A system that allocates kidneys based on utility criteria would reduce the number of re-transplantation or delay it, and slow down the growth of the waiting list [8]. With this view, Stegall proposed a method for allocating “The right kidney for the right recipient” [9].

Leading countries in this field use a point scoring system to allocate kidneys. In these systems, different points are considered for each criterion. The donated kidney is allocated to the patient who earns the highest score. The most important challenge in designing these systems is identifying effective factors and weighting them to get the best utility and equity outcomes. Another problem is to consider the decision makers’ hesitation and uncertainly in comparing the factors for weighting them. Therefore, the purpose of this study is to identify and weight the kidney allocation criteria considering the balance between utility and equity. It reviews current kidney allocation algorithms and proposes a new integrated two-step framework for developing kidney allocation algorithm. First, Fuzzy Delphi Method (FDM) is used to identify the criteria in the kidney allocation algorithm. Next, Intuitionistic Fuzzy Analytic Hierarchy Process (IF-AHP) is employed to determine the weight of the criteria considering the hesitation and uncertainly of decision makers in their decisions.

Research background

A lot of research has been done to improve the allocation algorithm from different aspects. David and Yechiali provided a model for allocating multiple organs to multiple recipients. The purpose of their study was to develop an allocation model, which optimizes various criteria [10]. Yuan et al. developed a kidney allocation fuzzy expert system to assist medical doctors in situations where they deal with ambiguity and complexity. They showed that the fuzzy logic-based policy is very close to an expert’s opinion [11]. Gundogar et al. developed the fuzzy organ allocation system (FORAS) for patients requiring kidney transplantation. FORAS determines which patients should receive a kidney when it becomes available. They used a simulation to show that FORAS is more useful than other kidney allocation systems [12]. Baskin & Nyberg designed a utility-based system to balance the supply and demand of kidney transplantation. They sought to maximize the total number of years of kidney allograft function using the recipient risk score and the deceased donor score [8]. In another study, Cruz-Ramirez et al. proposed a rule-based decision making system to allocate the liver [13]. Bertsimas et al. used a linear regression to determine the weight of the score elements. They focused on national allocation policies in the US. They found acceptable score weights by solving the optimization problem [14]. Tong et al. proposed a method for kidney allocation based on patient’s preference [15]. Al-Ebbini et al. developed a fuzzy lung allocation system (FLAS) to show that systems designed with fuzzy logic are closer to the expert’ opinion than other systems [16]. Ahmadvand and Pishvaee developed a model based on Data Envelopment Analysis (DEA) for kidney allocation. Their objective was to find the best patient-organ pairs to increase the fitness of kidney allocation in conditions of uncertainty [17]. Scalia et al. used Delphi method to identify and determine the importance of factors that can affect the pancreatic islet transplant outcomes. The quantitative criteria were evaluated with crisp value (crisp is used in contrast with fuzzy. A crisp number has a precise value but a fuzzy number has a possible range of values) and the qualitative criteria with linguistic scales [18]. Dongping et al. identified long-term factors influencing survival after kidney transplantation with Delphi method in three rounds [19]. Nosotti et al. used a modified Delphi technique to identify the criteria for recipient selection [20].

The application of AHP to organ transplantation was studied in the 1990s. Cook et al. used AHP to develop a ranking system for allocation of cadaver liver. The criteria considered were waiting time, logistics, tissue compatibility, financial situations and medical status [21]. Koch designed an AHP model that included the medical and social criteria. He concluded that the effect of social criteria should not be ignored [22]. Another research by Koch & Rowell considered quantitative and qualitative criteria using AHP technique to allocate an organ. The criteria included: survival, intelligence, social recognition, physical independence, compliance and activity following a successful transplant [23, 24]. Saha et al. developed a knowledge-based system to select the optimal donor-recipient by applying fuzzy techniques and AHP. They used a Mamdani Style Fuzzy Inference System (MSFIS) to select potential donor-recipient candidates. Then AHP was applied to rank the recipient for a donated kidney. The criteria included: selection, matching, location and transplant status [25]. Lin et al. proposed a multi-criterion decision-making model using AHP for liver allocation. They considered four criteria of benefit, efficiency, equity and urgency [26].

Based on the past research, it is clear that AHP is a useful tool for solving an organ allocation problem; however, for dealing with the uncertainty expressed in the expert opinions, fuzzy sets are suitable tools. Therefore, it is necessary to move the AHP model with crisp numbers to the fuzzy one [27]. Fuzzy AHP has been extensively used in recent research works, especially in the healthcare area [2831].

Research gap

Most of the existing literature discusses the allocation process and develops the system for allocation without clearly developing an integrated framework from the beginning that includes identification and weighting of the effective criteria in the organ allocation, similar to what is presented in this research. The detailed literature analysis shows that the Delphi and AHP methods are common methods in the development of organ allocation systems, but they have been used separately in the literature. To the best of our knowledge, there is no study, which integrates Delphi with AHP together in developing organ allocation system and fills the gap in the literature. On the other hand, in the traditional AHP, uncertainty of the decision maker is not formulated in the pairwise comparison of criteria. Traditional AHP uses a linguistic scale whose numerical values are between 1 and 9. A linguistic evaluation such as “very strong importance” is represented by 7 in the scale of traditional AHP. However, the decision maker’s judgment “very strong importance” may not be clear enough to assign ‘7’. His/her opinion might mean around 7. Fuzzy sets are excellent tools for dealing with such type of uncertainties. Furthermore, the intuitionistic fuzzy sets can reflect the hesitancy of decision makers whereas classical sets cannot deal with it [32]. In situations where uncertainty is high to have a reliable analysis, using intuitionistic fuzzy numbers instead of fuzzy number is better [27]. Intuitionistic Fuzzy AHP is extensively used in the current literature [27, 3235], but in the organ allocation literature, we observed no study that used the IF-AHP technique. In this study, IF-AHP technique has been used to weigh the criteria.

Methods

In this section, the proposed methodology as well as the tools used in each of the steps are explained and discussed. The purpose of this study is to identify and weight the kidney allocation criteria. In order to achieve this goal, the research was carried out in two main steps. In the first step, a questionnaire was developed based on the criteria extracted from the literature and different allocation systems, the first step questionnaire was designed, which is available as Additional file 1. The questionnaires were answered by 10 experts, who were mainly decision makers and policy makers in organ allocation in Iran. Since the questionnaires were completed face-to-face, all questionnaires were answered. There are different opinions about the size of the panel in Delphi method. According to Kardaras et al., different researchers have proposed a range of 5 to 31 experts [36]. Therefore, the panel size considered in this study is appropriate. After collecting the questionnaires, we identified the essential factors in kidney allocation using FDM. The goal of the second step was to weight the criteria identified in the first step to prioritize patients in the waiting list. IF-AHP was used to determine the weight of the criteria. For the second step, based on the identified factors, another questionnaire was designed to weigh the factors by IF-AHP method, which is available as Additional file 2. The second questionnaire was completed by the same respondents. The flowchart of the proposed methodology is shown in Fig. 1.

Fig. 1.

Fig. 1

Proposed framework for identifying and weighting the essential criteria of kidney allocation

To evaluate the proposed method, we used the kidney transplantation dataset in Tehran from October 2017 to December 2017. This dataset includes information about both the patients registered on the kidney waiting list (484 registered patients) and deceased donors (124 donors). It is notable that there was no factor that indicates the outcomes of the transplant, such as the graft survival in the dataset. Therefore, we used the Estimated Post Transplant Survival (EPTS) score to evaluate the transplantation results and compare it with the proposed model.

EPTS score is a numerical measure used in the new kidney allocation system in UNOS. This is a percentage score that ranges from 0 to 100%. Candidates with a lower EPTS score are expected to have more graft survival compared to those with higher EPTS score. We used the EPTS calculator, provided by UNOS, to calculate the EPTS score. See for more details in [37].

Step 1: identification of kidney allocation factors with FDM

The Delphi technique was developed by Dalkey and Helmer at the Rand Corporation [38]. Since then, it has been used extensively in many areas. The purpose of this method is to acquire the most reliable consensus of a group of experts’ opinion. In many real situations, expert’ judgment cannot be expressed with crisp numbers, and using linguistic scales is more commonplace and more convenient for experts [39]. To overcome these problems, this study uses FDM.

FDM is a combination of fuzzy set theory (proposed by Zadeh in 1965 [40]) and Delphi method. Ishikawa developed FDM with triangular fuzzy numbers in 1993 [41].

Here, the required information is collected in the form of linguistic scales from experts and analyzed by fuzzy method. This study uses fuzzy triangular numbers to convert linguistic scales to fuzzy numbers (Table 1). Each fuzzy triangular number is displayed with three real numbers F = (l, m, u) in which l is the minimum value of F, u is the maximum value of F, and m is the most probable value of fuzzy number [42] (see Fig. 2). Membership function of a triangular fuzzy number is as follows:

μfx=xlmllxmuxummxu0othewise 1

Table 1.

shows how to define linguistic scales in triangular fuzzy numbers [42]

Linguistic Scales Fuzzy number
Very low (0, 0, 0.1)
Low (0, 0.1, 0.3)
Medium low (0.1, 0.3, 0.5)
Medium (0.3, 0.5, 0.7)
Medium high (0.5, 0.7, 0.9)
High (0.7, 0.9, 1.0)
Very high (0.9, 1.0, 1.0)

Fig. 2.

Fig. 2

Membership functions of TFN

After the experts’ opinions are collected and fuzzified (turned into fuzzy numbers), the opinions should be aggregated. Different methods have been proposed for aggregation of experts’ opinions. This study uses a geometric mean model that has been used in many studies [4346].

Assume the fuzzy number a~ij to be the jth factor importance of the ith expert and it is given as follows: a~ij=aij.bij.cij for i = 1,2,3, …,n; j = 1,2,3, …,m. To aggregate the judgments of all experts, Eq. (2) will be used:

a~j=minaij.i=1nbij1n.maxcij 2

Finally, to determine the importance of criteria, the aggregated result is better to be transformed into a crisp value, and then compared with the threshold (a). In this study, we used a center of the gravity method to defuzzify the fuzzy values [42].

The value of threshold is calculated by determining the average of all factors’ weight:

  • If aj ≥ a , then factor j is selected.

  • If aj < a , then factor j is rejected.

Kidney allocation criteria

In this section, the most important criteria for kidney allocation are described briefly. These criteria have been extracted by reviewing the literature and different allocation systems currently implemented in other parts of the world.

Blood type compatibility

The donor and recipient blood type should be compatible. In most of the allocation algorithms, ABO blood type identical transplants are prioritized over compatible transplants. However blood type identical transplants are not prioritized, when there is an emergency patient, or there is a patient with Zero HLA mismatches. UNOS and Euro-transplant have similar rules for ABO-B donors and recipients [47].

HLA (human leukocyte antigen) matching

There are antigens in the human tissue cells that vary from person to person. The system of these antigens is called the HLA system [47]. HLA-A, B and DR are significant in kidney transplantation. Each person has up to two different alleles associated with each of the above three antigens [48]. Therefore, the range of mismatch can range from 0 to 0-0 (exact match in all three HLA pairs) to 2–2-2 (all allele pairs are different). The degree of mismatch has an impact on graft survival rates [49].

PRA (panel reactive antibodies)

The PRA value indicates the level of sensitivity of a patient to human leukocyte antigens. The probability of finding a cross-match negative for patients with high PRA values is very low, so these patients may wait a long time to receive a compatible kidney or never find a compatible kidney. To have an equitable system, these patients are prioritized above those with low PRA values [50, 51]. Based on the opinion of the experts who contributed in this research and some kidney allocation models [52], PRA > 80% were considered for the determination of patients with high sensitivity.

Age difference

Most sources point out that the kidney from an elderly donor should not be allocated to a very young patient [11]. Age difference between the donor and the recipient is one of the important factors in the graft survival.

Waiting time

One of the criteria that is considered in most of allocation algorithms for respecting equity between patients is the length of time that a patient is on a waiting list. There are two approaches to calculating the waiting time. Some of the allocation algorithms are considered when the patient registers in the waiting list and is in active state [53], but others are considered when the patient starts an alternative treatment; e.g. he/she starts dialysis [52, 54].

Medical urgency

If a patient has a very urgent condition and vascular access to dialysis is not feasible, the only treatment method is transplantation. Such patients would have high priority to transplant. In some kidney allocation models such as ETKAS are considered several levels for medical urgency [55], but in some models such as kidney allocation models in Australia [52] and Iran, the medical urgency is defined as a two-state variable (whether a patient is an urgency or not). In this research, we consider the medical urgency as a two-state variables.

Location

Distance between the transplant center (TC) and the organ procurement unit (OPU) is one of the criteria that is considered in some allocation algorithms [5255].

Transplant status (first time vs. repeat)

Some allocation algorithms make a difference between the patients requiring re-transplant and the patients to be transplanted for the first time.

A prior living donor

Some systems give bonus for transplant candidates having donated one of their own kidneys. The bonus of these patients can encourage people to donate. UNOS and Euro-transplant also give bonus for this factor [54, 55].

Recipient age

Almost in all allocation systems, special attention is given to pediatric recipients. The age range that is considered in different systems is different. For example, in UNOS, patients under 11 years old and patients aged 11–18 years receive different points [54]. In Euro-transplant, patients under 6 years old, patients aged 6–11 years, and patient aged 11–16 years receive 100, 66.6 and 33.3 points, respectively [55]. In Iran, patients under 18 years old have priority.

Predicted survival

To have an efficient allocation, in addition to the criteria listed above, many other characteristics of donor and recipient that can affect the transplant outcomes and graft survival such as a history of diabetes, blood pressure, cardiovascular diseases (CVDs), gender or even the cause of brain death should be considered [5659]. In many countries, these factors are not considered to simplify the allocation algorithm. A lot of research has been done to predict the graft survival with the characteristics of donor and recipient [6064] . In this study, the criterion of predicted survival is considered assuming that graft survival can be predicted.

Step 2: weighing the criteria with IF-AHP

AHP is a popular decision making tool, which was first introduced by Saaty [65]. It is a method for decision-making, aiming at solving complex problems. AHP helps decision makers in making a right decision and better understanding of the problem [66]. Since decision makers may be faced with doubt and uncertainty when comparing the criteria, therefore, to consider their uncertainty in formulating the problem, in this study, IF-AHP has been used. The introduction of Intuitionistic Fuzzy Sets (IFS) is presented in Additional file 3: Appendix A.

The steps of IF-AHP are as follows:

  1. Building analytical hierarchy framework

Define objective, criteria, and sub-criteria, and then build the hierarchy framework. The hierarchical framework is shown in Fig. 3.

Fig. 3.

Fig. 3

The AHP framework at all levels

Between the organ allocation experts and in the literature of this field, there are different views on the relation of the sub-criteria to the top-level criteria (utility and equity). Several of the sub-criteria do not fit neatly under either the utility or equity. For example, in the case of the recipient age, some of researchers believes that prioritizing younger recipient is related to utility, in term of maximizing the value and benefit of receiving an organ as well as increased graft longevity. Undeniably life expectancy for older transplant recipients is shorter than that for younger patients [67]. But, others believe that prioritizing younger recipient is related to equity. They argue that prioritizing younger patients is more.

equitable, not because they are likely to benefit most, rather because they have not yet had the opportunity to reach the same point in life as the older patient [68]. There are similar discussions in literature about medical urgency, PRA, and waiting time.

  • 2.

    Construct pairwise comparison matrices

Construct pairwise comparison matrices for criteria and sub-criteria, and collect the experts’ judgments using Triangular Intuitionistic Fuzzy (TIF) scale. We applied the 5-point scale used in Otay et al.’s research (Table 2, [32] to simplify the questionnaire, but a 7-point scale or 9-point scale can also be used.

Table 2.

Scale for pairwise comparisons

Importance level Corresponding intuitionistic fuzzy sets Reciprocal intuitionistic fuzzy sets
Equal Importance (EI) (1, 1, 1; 1, 1, 1) (1.1.1; 1.1.1 )
Weak Importance (WI) (2, 3, 4; 1, 3, 5) 14.13.1215.13.1
Fairly Strong Importance (FSI) (4, 5, 6; 3, 5, 7) 16.15.1417.15.13
Very Strong Importance (VSI) (6, 7, 8; 5, 7, 9) 18.17.1619.17.15
Absolute Importance (AI) (8, 9, 9; 7, 9, 9) 19.19.1819.19.17

A Triangular intuitionistic fuzzy number (TIFN) is defined with the following membership and non-membership functions, respectively:

μA~x=xaLaMaL.foraLxaMaUxaUaM.foraMxaU0.otherwise 3

and

vA~x=aMxaMaˊL.foraˊLxaMxaMaˊUaM.foraMxaˊU1.otherwise 4
whereaˊLaLaMaUaˊU.and0μA~x+vA~x1.for everyxϵX
TIFN is donatedbyA~TIFN=aL.aM.aUaˊL.aM.aˊU

The pairwise evaluation matrix of each expert is as follows:

A~TIFN=1.1.11.1.1a~12TIFNa~1tTIFN1/a~12TIFN1.1.11.1.1a~2tTIFN1/a~1tTIFN1/a~2tTIFN1.1.1,1.1.1 5
a~12TIFN=a12L.a12M.a12.iUaˊ12L.a12M.aˊ12U

and

1/a~12TIFN=1a12U.1a12M.1a12L1aˊ12U.1a12M.1aˊ12L

  • 3.

    Examine consistency of the fuzzy pairwise comparison matrices

For this purpose, the matrix is defuzzified and its consistency is checked. Using Eq. (6), we checked the consistency of matrices [34]. If CR < 0.1, then the comparisons are acceptable, otherwise, they are not acceptable and the values should be revised [28]. The random index (RI) has been taken from Saaty [69].

CR=λmaxn/n1RI 6
  • 4.

    Calculate geometric mean of each row in matrices

The goal of this step is to aggregate the expert opinions in one matrix. For this purpose, the geometric mean of each row in the matrices is calculated using Eqs. (7) and (8):

g~r=a~r1TIFNa~rnTIFN1n 7
where
g~rTIFN=j=1narjL1n.j=1narjM1n.j=1narjU1n;j=1naˊrjL1n.j=1narjM1n.j=1naˊrjU1n 8
  • 5.

    Calculate triangular intuitionistic fuzzy weights

The weight of each criterion and sub-criterion is calculated using Eq. (9):

w~rTIFN=g~rTIFNg~1TIFNg~2TIFNg~tTIFN1 9
  • 6.

    Defuzzify fuzzy weights to determine importance weights of criteria

For the final ranking, the calculated weights in step 5 should be defuzzified. We use the defuzzification function given in Otay et al. [32] (Eq. 10):

df=aiL+aiM+aiU3+aˊiL+aiM+aˊiUτ 10

Where, τ is a very large number. It is the non-membership impact factor; as it gets larger, the effect of non-membership function in defuzzification gets smaller. Its value is determined by decision makers according to the type of problem.

Results

Identification of essential factor using FDM

From the 11 factors gathered from the literature and different allocation systems, eight essential factors were identified, and three factors (location, a prior donation and transplant status) were rejected by the experts. FDM calculation is presented in Table 3. The reason for the experts to reject the location factor was that since in the current system of kidney allocation in Iran, instead of transporting the kidneys from one city to another, the patients are transported from their place of residence to the city where they are to be transplanted there, so there is no need to consider “location” as an essential factor. They believe that transporting of the recipient than the kidney leads to better results. In the case of a prior donation, since it is allowed to buy and sell kidneys in Iran, therefore, considering this factor as a point for patients is not necessary. In Iran, re-transplanted patients are treated similar to ordinary patients; hence, the transplant status was rejected. About the predicted survival factor, consensus was on considering this factor as one of the essential factors in the kidney allocation. Although this factor was accepted, there was concern that because many interfering factors are needed to predict the graft survival, and practically these factors are less well recorded and followed in Iran, therefore, we will have difficulty in calculating this factor.

Table 3.

FDM results on selection/rejection of kidney allocation factors

Factors Fuzzy weights Defuzzy weights Selected/ Rejected
Blood type compatibility (0.3,0.6642671, 1) 0.654756 Selected
HLA matching (0.3, 0.784858, 1) 0.694953 Selected
PRA (0.5, 0.904495, 1) 0.801498 Selected
Age difference (0.5, 0.814531, 1) 0.77151 Selected
Recipient Age (0.5, 0.844001, 1) 0.781334 Selected
Location (0, 0.252012, 0.9) 0.384004 Rejected
Transplant status (0, 0.405595, 0.9) 0.435198 Rejected
Waiting time (0.3, 0.903077, 1) 0.734359 Selected
Medical urgency (0.3, 0.898851, 1) 0.73295 Selected
Predicted survival (0.3, 0.779734, 1) 0.693245 Selected
A prior living donor (0, 0.424355, 1) 0.474785 Rejected
THRESHOLD (0.27272, 0.69779, 0.98181) 0.650781

Obtaining the weight of criteria and sub-criteria using IF-AHP method

The results of IF-AHP analysis are shown in Tables 4, 5, 6 and 7. Tables 4, 5 and 6 show the pairwise comparison of criteria and sub-criteria obtained from the experts’ judgments. Table 7 presents the weights obtained for criteria and sub-criteria including relative weights and global weights. The global weights were obtained by multiplying the relative weights of the criteria with the relative weights of sub-criteria [42]. The final ranking is based on the global weight values.

Table 4.

Pair-wise comparison of criteria

Equity Utility
Equity (1,1,1; 1,1,1) (0.42, 0.50,0.62; 0.37, 0.49, 0.90)
Utility (1.62, 2.03,2.39; 1.12, 2.03, 2.72) (1,1,1; 1,1,1)

Table 5.

Pair-wise comparison of sub-criteria for equity

Medical Urgency PRA Recipient Age Waiting Time
M-U (1,1,1; 1,1,1) (3.78,4.36,4.82;3.16,4.36,5.24) (2.3,2.52,2.66;2.05,2.52,2.78) (6.21,7.24,7.92;5.16,7.24,8.56)
PRA (0.21,0.23,0.26;0.19,0.23,0.32) (1,1,1; 1,1,1) (0.46,0.49,053;0.44,0.49,0.58) (2.3,2.72,3.14;1.87,2.72,3.59)
R-A (0.38,0.4044;0.36,0.4,0.49) (1.89,2.04,2.17;1.72,2.04,2.29) (1,1,1; 1,1,1) (4.7,5.72,6.73;3.68,5.72,7.74)
W-T (0.13,0.14,0.16;0.12,0.14,0.19) (0.32,0.37,0.44;0.28,0.37,0.53) (0.15,0.17,0.21;0.13,0.17,0.27) (1,1,1; 1,1,1)
CR = 0.023 < 0.1

Table 6.

Pair-wise comparison of sub-criteria for utility

HLA matching ABO Age Difference Survival Predicted
HLA (1,1,1; 1,1,1) (1.34,1.43,1.52;1.24,1.43,1.6) (3.23,3.65,4.05;2.79,3.65,4.43) (0.96,1.17,1.45;0.79,1.17,1.95)
ABO (0.66,0.7,0.75;0.62,0.7,0.81) (1,1,1; 1,1,1) (1.52,1.68,1.83;1.34,1.68,2) (0.21,0.25,0.31;0.18,0.25,0.41)
A-D (0.25,0.27,0.31;0.23,0.27,0.36) (0.55,0.6,0.66;0.5,0.6,0.74) (1,1,1;1,1,1) (0.33,0.37,0.42;0.3,0.37,0.5)
S-P (0.7,0.86,1.04;0.51,0.86,1.27) (3.2,3.94,4.7;2.43,3.94,5.52) (2.4,2.72,3.02;2.03,2.72,3.3) (1,1,1;1,1,1)
CR = 0.06272 < 0.1

Table 7.

Local and global weights of all criteria and sub-criteria using IFAHP method

Criteria Relative weights using IFAHP Sub-criteria Relative weights using IFAHP Rank Global weights using IFAHP Rank
Equity 0.33 Medical urgency 0.54 1 0.1782 1
PRA 0.14 3 0.0462 9
Recipient age 0.27 2
- < 11 years (0.54) 0.048114 8
- 11–15 years (0.29) 0.025839 10
- 15–18 years(0.16) 0.014256 16
Waiting timea 0.05 4 0.0165 14
Utility 0.67 HLA matching 0.35 2
- 0 mismatches(0.56) 0.13132 3
- 1 mismatch (0.21) 0.049245 7
- 2 mismatches (0.11) 0.025795 11
- 3 mismatches (0.06) 0.01407 17
- 4 mismatches (0.04) 0.00938 18
- 5 mismatches (0.02) 0.00469 20
Blood type compatibility 0.16 3
- Identical (0.83) 0.088976 4
- Compatible (0.17) 0.018224 12
Age difference 0.11 4
- < 5 years (0.69) 0.050853 6
- 5–15 years (0.24) 0.017688 13
- > 15 years (0.07) 0.005159 19
Predicted survival 0.38 1
- < 1 years (0.06) 0.015276 15
- 1–5 years (0.26) 0.066196 5
- > 5 years (0.68) 0.173128 2

aCalculated weight for waiting time is for one year

The results of Table 7 show that the “medical urgency” received the highest weight, and the “5 HLA mismatches” received the lowest weight. These results are similar to those of the ETKAS algorithm. In ETKAS, the highest point is assigned to high urgency patients (500 points) and the lowest point is assigned to 5 HLA mismatches (33.3 points) [55]. Table 10 shows the factors with the highest and lowest weights in different allocation algorithms.

Table 10.

Highest and lowest points in several allocation algorithms

Country (Algorithm) Highest point Lowest point Source
Euro-transplant (ETKAS) High Urgency, simultaneous liver-kidney transplant, a prior living donor (500 points) Waiting time, 5 HLA mismatches, Recipient age 11–16 years (33.3 points) [55]
Australia Zero HLA mismatches and peak PRA > 50% (60,000,000 points) Waiting time (1200 points) [52]
New Zealand DR HLA mismatches (2200 point in Rank 1, 300 points in Rank 2) Waiting time (12 points in Rank 1, 36 points in Rank 2) [52]
Turkey (TONKS) Zero HLA mismatches (7 points) 3 HLA mismatches (0 points) [12]
Proposed model Medical Urgency (global weight = 0.1782) 5 HLA mismatches (global weight = 0.0046)

US kidney allocation system (KAS) was not included since it is not based strictly on a points system, but rather is a classification-driven system with points playing a secondary role. In KAS, patients are first ordered by classification, and points are only used to further sort patients within classification. KAS awards very high priority for zero HLA mismatch, highly sensitized patients (CPRA 98–100%), prior living donors, and pediatric patients [54]

Model evaluation

The developed model was evaluated in two steps. In the first step, the model was implemented using available data, which was the kidney transplantation dataset in Tehran (one of the 15 regions that has longest waiting list) from October 2017 to December 2017. This dataset included 484 registered patients and 124 deceased donors. The proposed model was run for each donated kidney and the chosen patients of each run were recorded. Chosen patients of existing system were available. Results of the existing model and proposed one have been compared. Given that there was no factor indicating the success of transplantation in the dataset, we used EPTS score to compare the utility of the models. Considering that EPST score can only be calculated for the patients over the age of 18 years; therefore, this criterion was calculated only for adult patients. The results are shown in Table 8.

Table 8.

Comparing the results of the developed model and the current allocation model in Iran

Measures Recipient type Developed model Current model
Measures of utility
 The number of recipients with an EPTS < 20% Adult 124 of 228 (54%) 83 of 230 (36%)
 Average EPTS score of recipients(%) Adult 24.61% 41.37%
 Average age difference between donors and recipients All 5.3 years 8.1 years
 The number of allocation with the identical blood type All 243 of 248 (98%) 248 of 248 (100%)
Measures of equity
 Average waiting time of all recipients All 1.25 years 1.7 years
 Average waiting time of urgency patients Urgency 1.1 years 0.9 years
 The number of recipients< 18 y out of patients< 18 y waiting Pediatric 20 of 22 18 of 22

Based on the results presented in Table 8, the developed method is capable to improve the measures of utility. The number of recipients with an EPTS < 20% has increased from 83 to 124 (18%), and the average age difference between the donor and recipient has decreased from 8.1 years to 5.3 years. Only the number of allocations with the identical blood type in the existing system is better than that in the proposed system. This is due to the fact that in the existing system, the allocation is based on the identical blood type. Also, in the case of measures of equity, the proposed model is better than the current model. Although the most important allocation factor in the current model is waiting time, it can be seen that the proposed model has decreased the average waiting time of all recipients from 1.7 years to 1.25 years. Large waiting time reductions are only possible with a large increase in the number of available donors or a reduction in demand for organs. Maybe waiting time reduction in proposed model is caused because the limitation of the identical blood type for allocation has been considered in the existing model, while it has been eliminated in the proposed model. In the case of urgency patients, the existing system works better. It is true that medical urgency is the most important factor in the proposed model, but the allocation is based on the total score of all factors. In the existing system, emergency patients will receive the highest priority if the rest of the factors are compatible. Therefore, it is logical that the existing model has a shorter waiting time for emergency patients.

In the second step, to confirm the proposed model by experts and decision makers, a sample of 30 was selected from the dataset and the patients were prioritized for receiving a donated kidney with both models (current and proposed models). The high priorities of the proposed model were (7, 15, 1, 4, 8, 12) and the high priorities of the current model were (8, 10, 4, 12, 15, 2). The total score of the patient is equal to the sum of utility score and equity score. Patient scores are summarized in Table 9. Figure 4 shows the profile matrix in which the patient’s location is determined by the utility(X-axis) and the equity score(Y-axis). This type of display helps decision makers to more easily compare the results of the proposed and current models. The means of the utility score and equity score are subtracted from each patient’s utility score and equity score to generate the X and Y-coordinates for the plot [26].

Table 9.

Patients’ scores and the ranks in proposed model for all the 30 patients

Patient Id Patients’ factors Utility score Equity score Total score Patient Rank (proposed model)
M-U ABO WT Age
1 Yes O 23 74 0.293 0.255 0.548 3
2 No O 5 8 0.338 0.079 0.417 8
3 No O 7 38 0.135 0.055 0.190 23
4 No O 30 7 0.368 0.134 0.502 4
5 No O 44 34 0.135 0.105 0.240 21
6 No O 20 44 0.135 0.073 0.208 22
7 Yes O 46 35 0.293 0.285 0.578 1
8 No O 25 48 0.368 0.127 0.495 5
9 No O 28 24 0.293 0.083 0.376 11
10 No O 2 35 0.338 0.075 0.413 9
11 No O 17 32 0.368 0.069 0.437 7
12 No O 13 58 0.368 0.111 0.479 6
13 No O 10 9 0.293 0.059 0.352 12
14 No O 8 36 0.293 0.057 0.350 13
15 Yes O 5 15 0.293 0.257 0.550 2
16 No A 1 34 0.223 0.095 0.318 14
17 No AB 20 51 0.116 0.073 0.189 24
18 No A 20 58 0.065 0.073 0.138 29
19 No B 17 34 0.116 0.069 0.185 25
20 No B 16 14 0.223 0.067 0.290 15
21 No AB 13 6 0.223 0.063 0.286 16
22 No A 13 38 0.223 0.063 0.286 17
23 No A 11 46 0.116 0.061 0.177 26
24 No A 11 34 0.065 0.061 0.126 30
25 No B 11 56 0.223 0.061 0.284 18
26 No AB 10 55 0.223 0.059 0.282 19
27 No B 9 54 0.116 0.058 0.174 27
28 No A 9 13 0.298 0.106 0.404 10
29 No A 9 3 0.116 0.058 0.174 28
30 No AB 8 39 0.223 0.057 0.280 20

Fig. 4.

Fig. 4

Patients’ scores plot of utility versus equity

As shown in Fig. 4, all six patients selected by the developed method (7, 15, 1, 4, 8, 12) are in the high priority patients’ quadrant while only four patients selected by the current model (8, 4, 12, 15) are in this quadrant. The allocation trend of the proposed model is shown in Fig. 4. As can be seen, the patients in quadrant 1 are selected first, and then the patients in quadrants 2, 3 and 4 are selected orderly.

Model sensitivity analysis

The robustness of the proposed method can be assessed by sensitivity analysis. By sensitivity analysis, we can understand the effect of variations in the weight of criteria on patient rankings [26]. Ideally, the model results with minor variations should be stable. A series of sensitivity analysis were conducted to analyze the effect of varying the weight of the criteria on the patients’ ranking. Sensitivity analysis can be performed by changing the weight at all levels, but we only performed levels 1 and 2. The results showed that changes in the main criteria (utility and equity) up to 50% had no effect on the patients’ priority.

In the case of sub-criteria in the second level, multi-scenarios are performed. The sub-criteria were increased and decreased for up to approximately 30%. The results revealed that change in the sub-criteria up to 30% has no significant influence on the patients’ ranking. This indicates that the proposed model is stable and robust, and decision makers can be sure that the selected patients are the most suitable choices.

Discussion

Kidney transplantation is an appropriate and effective treatment for end-stage renal disease (ESRD). One of the most important challenges in kidney transplantation is the policy of kidney allocation and finding the most suitable recipient. Currently, most of kidney allocation policies are based on making balance between equity and utility so as to consider ethical issues in addition to medical criteria. Leading organizations in organ transplantation such as UNOS and Euro-transplant use a point scoring system to allocate organs. In these systems, different points are considered for each criterion. The donated kidney is allocated to the patient who earns the highest score. The most important challenge in designing these systems is identifying effective factors and weighting them to get the best utility and equity outcomes. Therefore, the main objective of this study was to provide a framework for identification of the essential criteria for the kidney allocation and weighting them. The research was carried out in two steps. In the first step, after extracting the criteria from the literature and different allocation models, FDM was used to identify the essential criteria. Of the 11 factors (10 factors extracted from the literature plus the predicted survival factor that we proposed), eight factors were confirmed.

In the second step, the hierarchical structure was drawn in four levels, and using IF-AHP method, the weighted criteria and sub-criteria were determined. In this research, triangular intuitionistic fuzzy numbers were used instead of crisp numbers or fuzzy numbers in the AHP model to consider the skeptics and uncertainty of the decision makers in pairwise comparisons of the criteria. This paper is the first to use this approach to determine the weight of the criteria in an organ allocation algorithm. The results showed that, the 5 HLA mismatches should have the lowest weight, and medical urgency should have the highest weight. These results are similar to those of the ETKAS algorithm used for kidney allocation in Euro-transplant. Table 10 shows the factors with the highest and lowest weights in different allocation algorithms.

To evaluate the developed method, firstly, it was implemented using a real case study from the Iranian Kidney Allocation System. The results showed that the proposed model has the potential to improve the allocation outcomes. Secondly, to confirm the proposed model by decision makers, the selected patients by the developed model and the current model were graphically displayed in a profile matrix in which the patient’s location is determined by the utility score (X-axis) and equity score (Y-axis). The allocation trend of the proposed model indicated that it allocates better than the current system. Finally, sensitivity analysis was applied to approve the robustness of the model by using several what-if scenarios.

Conclusions

To the best of our knowledge, this is a first study, which integrates FDM with IF_AHP together in developing organ allocation system. FDM was used to identify the essential criteria, and IF_AHP was used to determine the weight of them by considering the skeptics and uncertainty of the decision makers in pairwise comparisons of the criteria. The framework presented in this study is suitable for the countries that intend to improve their organ allocation systems.

It is suggested that future research employ the allocation model for other organs with the same approach; weighing the criteria be done with three different methods (ordinary AHP, fuzzy AHP and IF-AHP), and the results are compared. In this paper, the kidney allocation criteria were identified and weighted; however, developing a kidney allocation system was out of this work’s scope. So the authors are planning to develop an intuitionistic fuzzy expert system in order to replace allocator in the decision making in their future research works.

Additional files

Additional file 1: (18.7KB, docx)

Questionnaire 1. The questionnaire used in the research to identify the essential factors in kidney allocation by fuzzy Delphi method. (DOCX 18 kb)

Additional file 2: (22.3KB, docx)

Questionnaire 2. The questionnaire used in the research to weigh the factors by Intuitionistic Fuzzy Analytic Hierarchy Process (IF-AHP) method. (DOCX 22 kb)

Additional file 3: (65.6KB, docx)

Appendix A. The introduction of Intuitionistic Fuzzy Sets. (DOCX 65 kb)

Acknowledgments

We would like to appreciate the President and the Vice President of Iranian Society of Organ Donation (ISOD), Dr. Katayoun Najafizadeh, and Dr. Omid Ghobadi and all those who helped us in conducting the present study.

Abbreviations

EPTS

Estimated Post Transplant Survival

ETKAS

Euro-transplant kidney allocation system

FDM

Fuzzy Delphi Method

HLA

Human Leukocyte Antigen

IF_AHP

Intuitionistic Fuzzy Analytic Hierarchy Process

IFS

Intuitionistic fuzzy set

PRA

Panel Reactive Antibodies

UNOS

United Network for Organ Sharing

Authors’ contributions

NT, MMS: designed study. NT, SSH developed the questionnaires and collected data. NT, MMS and TK: statistical analysis and data interpretation. NT, MMS: wrote the paper. All contributed to the discussion of this paper. All authors have read and approved the final manuscript.

Funding

This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Availability of data and materials

The datasets used during this study are available from the corresponding author on reasonable request.

Ethics approval and consent to participate

The study was found to be in accordance to the ethical principles and the national norms and standards for conducting Medical research in Iran. It was approved by the Research Ethics Committee of Tarbiat Modares University (Approval ID: IR.MODARES.REC.1397.215).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Nasrin Taherkhani, Email: n.taherkhani@modares.ac.ir.

Mohammad Mehdi Sepehri, Email: mehdi.sepehri@modares.ac.ir.

Shadi Shafaghi, Email: shafaghishadi@sbmu.ac.ir.

Toktam Khatibi, Email: toktam.khatibi@modares.ac.ir.

References

  • 1.US HRSA/OPTN Data (Organ Procurement and Transplantation Network). [cited 2019 /04/10]; Available from: https://optn.transplant.hrsa.gov/data/.
  • 2.MOHME. (2018) Ministry of Health and Medical Education (Iran). [cited 2018; Available from: www.behdasht.gov.ir
  • 3.Stegall MD, et al. Why do we have the kidney allocation system we have today? A history of the 2014 kidney allocation system. Hum Immunol. 2017;78(1):4–8. doi: 10.1016/j.humimm.2016.08.008. [DOI] [PubMed] [Google Scholar]
  • 4.Freeman RB, et al. Moving kidney allocation forward: the ASTS perspective. Am J Transplant. 2009;9(7):1501–1506. doi: 10.1111/j.1600-6143.2009.02697.x. [DOI] [PubMed] [Google Scholar]
  • 5.Shapiro R. Kidney allocation and the perception of fairness. Am J Transplant. 2007;7(5):1041–1042. doi: 10.1111/j.1600-6143.2007.01765.x. [DOI] [PubMed] [Google Scholar]
  • 6.Stegall MD. Developing a new kidney allocation policy: the rationale for including life years from transplant. Am J Transplant. 2009;9(7):1528–1532. doi: 10.1111/j.1600-6143.2009.02712.x. [DOI] [PubMed] [Google Scholar]
  • 7.Mirhosseini SM, Najafizadeh K, Shafaghi S. Establishing standard heart allocation protocol in Iran. J Heart Lung Transplant. 2015;34(4):S157–S158. [Google Scholar]
  • 8.Baskin-Bey ES, Nyberg SL. Matching graft to recipient by predicted survival: can this be an acceptable strategy to improve utilization of deceased donor kidneys? Transplant Rev. 2008;22(3):167–170. doi: 10.1016/j.trre.2008.02.005. [DOI] [PubMed] [Google Scholar]
  • 9.Stegall Mark D. The Right Kidney for the Right Recipient: The Status of Deceased Donor Kidney Allocation Reform. Seminars in Dialysis. 2010;23(3):248–252. doi: 10.1111/j.1525-139X.2010.00723.x. [DOI] [PubMed] [Google Scholar]
  • 10.David I, Yechiali U. Sequential assignment match processes with arrivals of candidates and offers. Probability in the Engineering and Informational Sciences. 1990;4(4):413–430. [Google Scholar]
  • 11.Yuan Yufei, Feldhamer Stuart, Gafni Amiram, Fyfe Francis, Ludwin David. An internet-based fuzzy logic expert system for organ transplantation assignment. International Journal of Healthcare Technology and Management. 2001;3(5/6):386. [Google Scholar]
  • 12.Gundogar E, et al. Fuzzy Organ Allocation System for Cadaveric Kidney Transplantation. Transplantation. 2005;80:1648–1653. doi: 10.1097/01.tp.0000183287.04630.05. [DOI] [PubMed] [Google Scholar]
  • 13.Cruz-Ramírez M, et al. Predicting patient survival after liver transplantation using evolutionary multi-objective artificial neural networks. Artif Intell Med. 2013;58(1):37–49. doi: 10.1016/j.artmed.2013.02.004. [DOI] [PubMed] [Google Scholar]
  • 14.Bertsimas D, Farias VF, Trichakis N. Fairness, efficiency, and flexibility in organ allocation for kidney transplantation. Oper Res. 2013;61(1):73–87. [Google Scholar]
  • 15.Tong A, et al. Patient preferences for the allocation of deceased donor kidneys for transplantation: a mixed methods study. BMC Nephrology. 2012;13(1):18. [DOI] [PMC free article] [PubMed]
  • 16.Al-Ebbini L, Oztekin A, Chen Y. FLAS: fuzzy lung allocation system for US-based transplantations. Eur J Oper Res. 2016;248(3):1051–1065. [Google Scholar]
  • 17.Ahmadvand S, Pishvaee MS. An efficient method for kidney allocation problem: a credibility-based fuzzy common weights data envelopment analysis approach. Health Care Manag Sci. 2018;21(4):587–603. doi: 10.1007/s10729-017-9414-6. [DOI] [PubMed] [Google Scholar]
  • 18.La Scalia G, et al. Multi-criteria decision making support system for pancreatic islet transplantation. Expert Syst Appl. 2011;38(4):3091–3097. [Google Scholar]
  • 19.Dongping G, et al. Long-term factors influencing Survial after kidney transplantation. Transplant Proc. 2013;45(1):129–133. doi: 10.1016/j.transproceed.2012.08.014. [DOI] [PubMed] [Google Scholar]
  • 20.Nosotti M, et al. Selection of candidates for lung transplantation: the first Italian consensus statement. Transplant Proc. 2017;49(4):702–706. doi: 10.1016/j.transproceed.2017.02.026. [DOI] [PubMed] [Google Scholar]
  • 21.Ryan Cook D, Staschak S, Green WT. Equitable allocation of livers for orthotopic transplantation: An application of the Analytic Hierarchy process. Eur J Operation Res. 1990;48(1):49–56. doi: 10.1016/0377-2217(90)90060-o. [DOI] [PubMed] [Google Scholar]
  • 22.Koch Tom. Normative and prescriptive criteria: The efficacy of organ transplantation allocation protocols. Theoretical Medicine. 1996;17(1):75–93. doi: 10.1007/BF00489742. [DOI] [PubMed] [Google Scholar]
  • 23.Koch T, Rowell M. A pilot study on transplant eligibility criteria: valuing the stories in numbers. Pediatr Nurs. 1997;23(2):160–166. [PubMed] [Google Scholar]
  • 24.Koch T, Rowell MJTM. And bioethics, the dream of consensus: finding common ground in a bioethical context. Theor Med Bioethics. 1999;20(3):261–273. doi: 10.1023/a:1009995919835. [DOI] [PubMed] [Google Scholar]
  • 25.Saha C, et al. Selection and matching of kidney donor and recipient using fuzzy techniques and analytic hierarchy process. 2012. [Google Scholar]
  • 26.Lin CS, Harris SL. A unified framework for the prioritization of organ transplant patients: analytic hierarchy process, sensitivity and multifactor robustness study. J Multicrit Decis Anal. 2013;20(3–4):157–172. [Google Scholar]
  • 27.Tavana M, et al. An integrated intuitionistic fuzzy AHP and SWOT method for outsourcing reverse logistics. Appl Soft Comput. 2016;40:544–557. [Google Scholar]
  • 28.Büyüközkan G, Çifçi G. A combined fuzzy AHP and fuzzy TOPSIS based strategic analysis of electronic service quality in healthcare industry. Expert Syst Appl. 2012;39(3):2341–2354. [Google Scholar]
  • 29.Lupo T. A fuzzy framework to evaluate service quality in the healthcare industry: an empirical case of public hospital service evaluation in Sicily. Appl Soft Comput. 2016;40:468–478. [Google Scholar]
  • 30.Singh Ajwinder, Prasher Ajay. Measuring healthcare service quality from patients’ perspective: using Fuzzy AHP application. Total Quality Management & Business Excellence. 2017;30(3-4):284–300. [Google Scholar]
  • 31.Huang Y-P, et al. Health symptom checking system for elderly people using fuzzy analytic hierarchy process. Appl Syst Innov. 2018;1:10. [Google Scholar]
  • 32.Otay İ, et al. Multi-expert performance evaluation of healthcare institutions using an integrated intuitionistic fuzzy AHP&DEA methodology. Knowl-Based Syst. 2017;133:90–106. [Google Scholar]
  • 33.Büyüközkan G, Feyzioğlu O, Gocer F. 2016 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM) 2016. Evaluation of hospital web services using intuitionistic fuzzy AHP and intuitionistic fuzzy VIKOR. [Google Scholar]
  • 34.Abdullah L, Najib L. A new preference scale of intuitionistic fuzzy analytic hierarchy process in multi-criteria decision making problems. J Intell Fuzzy Syst. 2014;26:1039–1049. [Google Scholar]
  • 35.Sadiq, R., S.J.S.E.R. Tesfamariam, and R. Assessment, Environmental decision-making under uncertainty using intuitionistic fuzzy analytic hierarchy process (IF-AHP). 2009. 23(1): p. 75-91.
  • 36.Kardaras DK, Karakostas B, Mamakou XJ. Content presentation personalisation and media adaptation in tourism web sites using fuzzy Delphi method and fuzzy cognitive maps. Expert Syst Appl. 2013;40(6):2331–2342. [Google Scholar]
  • 37.HRSA. EPTS calculator. [cited 2018 /10/22]; Available from: https://optn.transplant.hrsa.gov/resources/allocation-calculators/epts-calculator/.
  • 38.Hsu C-C, Sandford BA. The Delphi Technique: Making Sense Of Consensus. Pract Assess Res Eval. 2007;12.
  • 39.Kannan D, de Sousa Jabbour AB, Jabbour CJ. Selecting green suppliers based on GSCM practices: using fuzzy TOPSIS applied to a Brazilian electronics company. Eur J Oper Res. 2014;233(2):432–447. [Google Scholar]
  • 40.Zadeh LA. Fuzzy sets. Inf Control. 1965;8(3):338–353. [Google Scholar]
  • 41.Ishikawa A, et al. The max-min Delphi method and fuzzy Delphi method via fuzzy integration. Fuzzy Sets Syst. 1993;55(3):241–253. [Google Scholar]
  • 42.Bouzon M, et al. Identification and analysis of reverse logistics barriers using fuzzy Delphi method and AHP. Resour Conserv Recycl. 2016;108:182–197. [Google Scholar]
  • 43.Hsu P-F, Chen BY. Developing and Implementing a Selection Model for Bedding Chain Retail Store Franchisee Using Delphi and Fuzzy AHP. Quality Quantity. 2007;41(2):275–290. [Google Scholar]
  • 44.Cheng J-H, Lee C-M, Tang C-H. An application of fuzzy Delphi and fuzzy AHP on evaluating wafer supplier in semiconductor industry. WSEAS Trans Info Sci and App. 2009;6(5):756–767. [Google Scholar]
  • 45.Wu C-H, Fang WC. Combining the Fuzzy Analytic Hierarchy Process and the fuzzy Delphi method for developing critical competences of electronic commerce professional managers. Quality Quantity. 2011;45(4):751–768. [Google Scholar]
  • 46.Ma Z, et al. Constructing road safety performance indicators using fuzzy Delphi method and Grey Delphi method. Expert Syst Appl. 2011;38(3):1509–1514. [Google Scholar]
  • 47.Bendersky M, David I. The full-information best-choice problem with uniform or gamma horizons. Optimization. 2016;65(4):765–778. [Google Scholar]
  • 48.Luscalov S, et al. Algorithm with heuristics for kidney allocation inTransplant information system. Cham: Springer International Publishing; 2017. [Google Scholar]
  • 49.Barlow AD. Kidney transplantation. Surgery (Oxford) 2017;35(7):378–384. [Google Scholar]
  • 50.Gupta Arun, Iveson Victoria, Varagunam Mira, Bodger Stephen, Sinnott Paul, Thuraisingham Raj C. Pretransplant Donor-Specific Antibodies in Cytotoxic Negative Crossmatch Kidney Transplants: Are They Relevant? Transplantation. 2008;85(8):1200–1204. doi: 10.1097/TP.0b013e31816b1c37. [DOI] [PubMed] [Google Scholar]
  • 51.Fuggle SV, Martin S. Tools for Human Leukocyte Antigen Antibody Detection and Their Application to Transplanting Sensitized Patients. Transplantation. 2008;86:384–390. doi: 10.1097/TP.0b013e31817c90f5. [DOI] [PubMed] [Google Scholar]
  • 52.TSANZ (The Transplantation Society of Australia and New Zealand). Clinical guidelines for organ transplantation from deceased donors [cited 2018 /08/23]; Available from: https://www.tsanz.com.au/organallocationguidelines/.
  • 53.NHSBT ( NHS blood and transplant) POLICY POL186/9 Kidney Transplantation: Deceased Donor Organ Allocation. [cited 2018 /07/28]; Available from: https://www.odt.nhs.uk/transplantation/tools-policies-and-guidance/policies-and-guidance/.
  • 54.US HRSA/OPTN Policies (Organ Procurement and Transplantation Network) [cited 2018 /09/02]; Available from: https://optn.transplant.hrsa.gov/media/1200/optn_policies.pdf#nameddest=Policy_08.
  • 55.Eurotransplantmanual (2014). [cited 2018/08/10; Available from: https://www.eurotransplant.org/cms/index.php?page=et_manual.
  • 56.Briceno J, et al. Use of artificial intelligence as an innovative donor-recipient matching model for liver transplantation: results from a multicenter Spanish study. J Hepatol. 2014;61(5):1020–1028. doi: 10.1016/j.jhep.2014.05.039. [DOI] [PubMed] [Google Scholar]
  • 57.Klair T, et al. Outcomes of adult dual kidney transplants by KDRI in the United States. Am J Transplant. 2013;13(9):2433–2440. doi: 10.1111/ajt.12383. [DOI] [PubMed] [Google Scholar]
  • 58.Yoo KD, et al. A machine learning approach using survival statistics to predict graft survival in kidney transplant recipients: a multicenter cohort study. Sci Rep. 2017;7(1):8904. doi: 10.1038/s41598-017-08008-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Brown TS, et al. Bayesian modeling of pretransplant variables accurately predicts kidney graft survival. Am J Nephrol. 2012;36(6):561–569. doi: 10.1159/000345552. [DOI] [PubMed] [Google Scholar]
  • 60.Shaikhina Torgyn, Lowe Dave, Daga Sunil, Briggs David, Higgins Robert, Khovanova Natasha. Decision tree and random forest models for outcome prediction in antibody incompatible kidney transplantation. Biomedical Signal Processing and Control. 2019;52:456–462. [Google Scholar]
  • 61.Hamidi O, et al. Identifying important risk factors for survival in kidney graft failure patients using random survival forests. Iran J Public Health. 2016;45(1):27–33. [PMC free article] [PubMed] [Google Scholar]
  • 62.Premaud A, et al. An adjustable predictive score of graft survival in kidney transplant patients and the levels of risk linked to de novo donor-specific anti-HLA antibodies. PLoS One. 2017;12(7):e0180236. doi: 10.1371/journal.pone.0180236. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Li B, et al. Predicting patient survival after deceased donor kidney transplantation using flexible parametric modelling. BMC Nephrol. 2016;17(1):51. doi: 10.1186/s12882-016-0264-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Foucher Y, et al. A clinical scoring system highly predictive of long-term kidney graft survival. Kidney Int. 2010;78(12):1288–1294. doi: 10.1038/ki.2010.232. [DOI] [PubMed] [Google Scholar]
  • 65.Saaty TL. The Analytic Hierarchy Process. New York: McGraw-Hill; 1980. [Google Scholar]
  • 66.Chen C-W, et al. Developing indicators for sustainable campuses in Taiwan using fuzzy Delphi method and analytic hierarchy process. J Clean Prod. 2018;193:661–671. [Google Scholar]
  • 67.Courtney AE, Maxwell AP. The challenge of doing what is right in renal transplantation: balancing equity and utility. Nephron Clin Pract. 2009;111(1):c62–c67. doi: 10.1159/000180121. [DOI] [PubMed] [Google Scholar]
  • 68.Williams Alan. Intergenerational Equity: An Exploration of the ‘Fair Innings’ Argument. Health Economics. 1997;6(2):117–132. doi: 10.1002/(sici)1099-1050(199703)6:2<117::aid-hec256>3.0.co;2-b. [DOI] [PubMed] [Google Scholar]
  • 69.Saaty TL. Fundamentals of Decision Making and Priority Theory With the Analytic Hierarchy Process. Pittsburg: RWS Publications; 2000. ISBN-10: 0962031763. ISBN-13: 978-0962031762.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Additional file 1: (18.7KB, docx)

Questionnaire 1. The questionnaire used in the research to identify the essential factors in kidney allocation by fuzzy Delphi method. (DOCX 18 kb)

Additional file 2: (22.3KB, docx)

Questionnaire 2. The questionnaire used in the research to weigh the factors by Intuitionistic Fuzzy Analytic Hierarchy Process (IF-AHP) method. (DOCX 22 kb)

Additional file 3: (65.6KB, docx)

Appendix A. The introduction of Intuitionistic Fuzzy Sets. (DOCX 65 kb)

Data Availability Statement

The datasets used during this study are available from the corresponding author on reasonable request.


Articles from BMC Medical Informatics and Decision Making are provided here courtesy of BMC

RESOURCES