Skip to main content
PLOS Computational Biology logoLink to PLOS Computational Biology
. 2021 Jul 27;17(7):e1009248. doi: 10.1371/journal.pcbi.1009248

Computational Eurotransplant kidney allocation simulations demonstrate the feasibility and benefit of T-cell epitope matching

Matthias Niemann 1,*, Nils Lachmann 2, Kirsten Geneugelijk 3, Eric Spierings 3
Editor: Roeland MH Merks4
PMCID: PMC8345832  PMID: 34314431

Abstract

The EuroTransplant Kidney Allocation System (ETKAS) aims at allocating organs to patients on the waiting list fairly whilst optimizing HLA match grades. ETKAS currently considers the number of HLA-A, -B, -DR mismatches. Evidently, epitope matching is biologically and clinically more relevant. We here executed ETKAS-based computer simulations to evaluate the impact of epitope matching on allocation and compared the strategies. A virtual population of 400,000 individuals was generated using the National Marrow Donor Program (NMDP) haplotype frequency dataset of 2011. Using this population, a waiting list of 10,400 patients was constructed and maintained during simulation, matching the 2015 Eurotransplant Annual Report characteristics. Unacceptable antigens were assigned randomly relative to their frequency using HLAMatchmaker. Over 22,600 kidneys were allocated in 10 years in triplicate using Markov Chain Monte Carlo simulations on 32-CPU-core cloud-computing instances. T-cell epitopes were calculated using the www.pirche.com portal. Waiting list effects were evaluated against ETKAS for five epitope matching scenarios. Baseline simulations of ETKAS slightly overestimated reported average HLA match grades. The best balanced scenario maintained prioritisation of HLA A-B-DR fully matched donors while replacing the HLA match grade by PIRCHE-II score and exchanging the HLA mismatch probability (MMP) by epitope MMP. This setup showed no considerable impact on kidney exchange rates and waiting time. PIRCHE-II scores improved, whereas the average HLA match grade diminishes slightly, yet leading to an improved estimated graft survival. We conclude that epitope-based matching in deceased donor kidney allocation is feasible while maintaining equal balances on the waiting list.

Author summary

Kidney transplantation is the best treatment option for patients suffering permanent loss of kidney function. High degrees of histocompatibility between patients and organ donors improve long-term function of transplanted kidneys. In order to ensure fair access to transplantation whilst maximising utility of each donor kidney, organ allocation organizations established recipient waiting lists and well-balanced algorithms to allocate donors to patients. Changing the allocation algorithms requires careful consideration of side-effects to avoid disadvantages of certain groups of patients. In this study, we evaluated the feasibility of modifying the existing Eurotransplant Kidney Allocation System (ETKAS) to incorporate indirect T-cell epitope matching, a novel technique for assessing functional histocompatibility. Using Markov chain Monte Carlo simulations, we compared the modified allocation to the current algorithm and found an overall improvement of indirect T cell epitope compatibility. Simultaneously, we observed no negative impact on allocation fairness or waiting times. Our simulation framework may serve as a basis to evaluate further adjustments to ETKAS in the future. From our results, we conclude that epitope matching can be safely incorporated into ETKAS.

Introduction

Organ transplantation represents the golden treatment standard for patients with permanent organ failure. A major complication of organ transplantation is the development of immune responses directed towards human leukocyte antigen (HLA) mismatches between donor and recipient followed by allograft rejection [13]. HLA matching and HLA antibodies are key factors in most allocation algorithms to avoid these responses [4,5]. Since previous research has shown that better HLA matching indeed resulted in a reduced need for immunosuppressive treatment as well as less allograft rejection [5], organ exchange organizations, including Eurotransplant, have implemented the HLA matching factor in their allocation strategy [6,7]. These strategies all aim for transplanting kidneys with low numbers of HLA mismatches between donors and recipients [5]. Although this approach is an effective method to reduce the risk for kidney allograft rejection, it has some limitations. First, for some patients, it may be more difficult to find donors with a low number of HLA mismatches due to the ethnic background of the patient. Second, not all HLA mismatches contribute equally to alloreactivity, as their immunogenicity may differ [8,9]. As such, kidney allocation via the Eurotransplant Kidney Allocation System (ETKAS) aims to establish an acceptable HLA match distribution and optimal overall transplant success rate, while shortening the waiting times, adjusting for infrequent HLA antigens and homozygosity thereof, and maintaining a balanced kidney exchange rate among countries [10].

ETKAS is the largest kidney allocation program of Eurotransplant with around 70% of the donors being allocated by it [11]. Currently, ETKAS considers the number of serological HLA-A, -B, -DR mismatches as a factor in their scoring system. However, in recent years, the concepts of B-cell and T-cell epitope matching in solid organ transplantation have evolved (reviewed in [12]). Epitope matching is based on structural and functional properties of the HLA proteins rather than belonging to the same serological group, which is the classical method of HLA matching. Various software tools were developed to model the epitope matching concepts for antibody epitopes [1315] and T-cell epitopes (reviewed in [16]). The enhanced understanding on the immunobiology of alloreactive responses in solid organ transplantation leading to graft rejection, formed the basis of estimating the immunogenicity of HLA mismatches [17]. As the exact amino acid sequence of HLA antigens is available, algorithms are now in place to indicate which donor-specific HLA fragments (epitopes) presented by recipient HLA may in the cellular alloreactive response after solid organ transplantation (reviewed in [18]). Therefore, one of the approaches to estimate the clinical impact of individual HLA mismatches on alloreactivity may be to quantify the total T-cell epitope load between donor and recipient [19,20]. Thus, the total T-cell epitope load may provide more information on the potential clinical consequences of HLA mismatches. These observations have led to a concept called epitope-based HLA matching (short: “epitope matching”): a matching strategy in which epitopes from HLA are matched.

The T-cell epitopes can be predicted using the PIRCHE algorithm. The PIRCHE algorithm considers peptides of donor HLA origin as being presented in the context of recipient HLA, followed by recognition by recipient T cells (reviewed in [16]). This model can predict indirect CD4+ T-cell recognition of allo-HLA derived peptides [16,17], a concept which is highly involved in graft failure after solid organ transplantation (review by Siu et al. [21]). Recent studies have shown that predicted donor-HLA derived epitopes presented on HLA class-II molecules, designated as PIRCHE-II, are related to HLA antibody formation [19,22]. Moreover, other retrospective organ transplantation studies using the PIRCHE algorithm have shown that T-cell epitope matching indeed leads to an improved transplant outcome [20,23]. Thus, these studies suggest that epitope matching may be biologically and clinically more relevant than simply counting the number of antigen matches and mismatches [21].

Since increased compatibility by applying epitope matching likely leads to a better outcome, incorporation of these techniques into the allocation systems may lead to a generally improved transplant outcome [2426]. However, given donor organs are a scarce resource, it is questionable to what cost this matching improvement is achieved. ETKAS is the result of a well-balanced scoring system that was fine-tuned over the years [6,10,27,28]. Due to this fine-tuning, the allocation system is complex and the effects of changes are difficult to predict. Thus, when modifying an allocation system, it is crucial to prospectively evaluate performance and potential side effects systematically and thoroughly to rule out unwanted side effects. The value of computer simulations has shown its value in this context [27].

In the present study, we simulated Eurotransplant’s largest kidney allocation program to evaluate the impact of including T-cell epitope matching. To this end, HLA-related factors in ETKAS were converted to PIRCHE-dependent factors. These PIRCHE-dependent factors were optimized in this study to achieve a high epitope matching result, which is expected to improve kidney graft survival of transplanted patients. The feasibility of our approach was concluded by observing a small impact on non-HLA outcome parameters, such as waiting time, waiting list size, and country balance.

Materials and methods

Creating a virtual population

Before initiation of the simulation procedures, a virtual waiting list was composed. For that purpose, we generated a virtual population of 400,000 individuals using the NMDP haplotype frequency dataset of European Caucasians (EURCAU) of 2011 [29]. Assuming random mating, haplotypes were combined according to their reported frequency. This virtual population served as a virtual donor pool and was used to populate the virtual waiting list (Fig 1).

Fig 1. Simulation schematic.

Fig 1

During the bootstrapping process, virtual patients and donors were created based on haplotype frequencies. The initial waiting list was randomly populated matching the distributions provided by Eurotransplant. During the simulation, waiting patients were randomly removed from the waiting list (e.g. unfit for transplantation, died waiting) and new patients were randomly registered to the waiting list. Virtual donors were randomly registered and allocated to the current waiting list resulting in simulated transplantations.

Populating the virtual waiting list

Initial virtual waiting lists were constructed from this virtual population by bootstrapping, matching the size and characteristics of the Eurotransplant Annual Report 2015 [11]. First, 10,400 virtual individuals and their HLA typings were randomly selected and removed from the virtual population. Subsequently, for the non-HLA typing characteristics, the parameters country, urgency, recipient age, blood group, percentage of PRA, and waiting time were extracted from the Eurotransplant Annual Report 2015 [11] and assigned to the virtual waiting list population accordingly. Country, urgency and age were considered as independent parameters and thus assigned randomly, using the reported overall frequencies. Distributions for blood group, PRA, and waiting time were considered conditional to the virtual individuals’ country and thus assigned according to country-dependent frequencies.

The publicly available data of the Eurotransplant Annual Report 2015 do not provide a distribution function of the waiting time of patients at time of registration to the waiting list. Therefore, the given intervals (0–1 years, 2–4 years, 5 years and longer) and their frequency were considered as continuous uniform distributions. The last interval was assumed to end at 9 years.

For virtual recipients with a PRA >0%, unacceptable antigens were assigned randomly relative to their population frequency. For each of those virtual recipients, unacceptable antigens were defined by taking antibody epitopes as defined by HLAMatchmaker [13] into account, designated as eplets. Initially, the frequencies of eplets present in the population’s genotypes were calculated. For each virtual recipient, a number of random eplets not present in the set of self-eplets were selected that approximately summed up to the percentage of the assigned PRA. These eplets were translated into antigens that were considered as unacceptable for the recipient. Given each eplet’s individual frequency, target PRA levels may be reached with low or high eplet counts.

Basic allocation principles

After constructing a virtual donor pool and virtual initial waiting lists, allocations were simulated using a MCMC method. This simulation was applied iterating over time, considering each day in the allocation system as a single step (Fig 1). The core of the implemented simulation was a Gibbs sampler [30] that considered the virtual population’s characteristics to create a sequence of transplantation events and waiting list snapshots. The resulting sequence allows estimating the distribution of match grades and allocation-relevant characteristics in virtual transplantations. Opposedly, the dynamics of the waiting list characteristics were observed.

For each step, we randomly selected and removed a virtual donor and its HLA typing from the virtual population. Subsequently, country of origin, donor type, blood group, and number of kidneys were assigned randomly, matching the distributions provided by the ET Annual report 2015 [11]. In this procedure, the country of origin of the donor was assigned independently, whereas the number of kidneys per donor, donor type (i.e. cardiac versus brain death), and blood group were considered being donor-country dependent. These characteristics were added to the selected donor for simulation purposes and analyses.

In total, an average of 6.2 kidneys per day were allocated within the simulated ETKAS. Patients deregistered from the waiting list without being transplanted within ETKAS (e.g. death on waiting list, recovered, transplanted by another allocation program) were selected randomly conditional on the patient country with around 10.5 events per day. Registration of patients to the waiting list followed the same procedure as the waiting list bootstrapping with around 16.7 events per day (Eurotransplant Annual Report 2015 [11]). The virtual waiting list only contained actively waiting patients. The ET urgency status “not transplantable” was not considered during simulations.

A detailed protocol of the initialization, the bootstrapping and the simulation steps is available online at https://dx.doi.org/10.17504/protocols.io.bqrtmv6n

PIRCHE-II and eplet calculations

In all simulations, PIRCHE-II were calculated as described before [19], using the PIRCHE web service (version 3.1, IMGT 3.36.0). The HLA-A, -B, -C, -DRB1 and -DQB1 loci were considered as peptide sources and virtual individuals’ DRB1 as peptide presenters. Eplet matching, which was used to assign unacceptable mismatches to the virtual recipients (see above), considered eplet definitions by HLAMatchmaker version 2.0 (http://www.epitopes.net, downloaded August 2015) and was carried out as interlocus set difference of virtual donor and virtual individual.

Computational infrastructure

The initialization and simulations were implemented in the Python programming language (Python Software Foundation, version 3.5.1). Simulation runs were executed three times for ETKAS. All PIRCHE-II based simulations were run once and the optimal PIRCHE-II based scenario (ETKASPIR-E) was repeated two more times. Each simulation was freshly initialized with a newly generated waiting list to rule out biased bootstrapping taking effect on the overall results. As the PIRCHE-II based allocation simulations were computationally intense, parallelization of PIRCHE-II calculations was implemented to reduce overall runtime. All simulations were executed on Amazon Web Services r4.8xlarge Elastic Cloud Compute instances (Amazon Web Services Inc., Seattle, US) with 32 compute cores and 244 GB of main memory. Each individual PIRCHE-II based allocation simulation took approximately 8 days of continuous computing with over 33 million PIRCHE-II score calculations.

ETKAS allocation simulation

We first performed an allocation in triplicate using the unmodified ETKAS procedure as described in the Eurotransplant ETKAS Manual (Fig 2) [28], assuming an HLA genotype-independent outflow of donors to the AM program. These ETKAS simulations were used as a baseline simulation to validate the allocation simulations and to evaluate the effects of the PIRCHE-II modified allocation scenarios. In the ETKAS simulation, the waiting list was first filtered by donor eligibility (donor type allowed in the recipient’s country) and blood group identity. Second, the waiting list was prioritized by full HLA match (A and B at serological broad level, DR at split level), homozygosity status and descending by point score. The simulated point score system strictly followed the ETKAS point score, thus including waiting time, urgency, country balance, distance between donor center and transplant center, HLA A-B-DR match grade, and MMP. Pediatric patients received an additional one-time bonus. While allocating virtual donors, unacceptable mismatches defined for the recipient were avoided.

Fig 2. ETKAS algorithm.

Fig 2

The basic ETKAS allocation consists of filtering steps and a cascade of sorting criteria. The dashed boxes refer to components involving HLA compatibility. These components were part of the altered allocation simulations. Other factors were unaltered.

The likelihood and exact reason of an organ offer being rejected by the transplant center is undocumented. Certainly, there is a strong regional effect, as center policy and local waiting list demographics differ. To diminish unfounded assumptions about this regional variation, a constant probability (p = 0.1) of denying an offer was implemented. This inclusion means there is a 10% chance a kidney is refused for an individual patient across all countries, match grades and age groups.

All of these criteria mentioned above were implemented in the applied MCMC simulations. The spatial resolution of the allocation was limited to a national basis, as center specific data were not available. As a consequence, distance between donor center and patient center always preferred national pairs and did not further distinguish regional or local equivalent pairs. All allocation rules and parameters remained unchanged during simulations.

Substituting HLA matching by PIRCHE-II based matching

In the PIRCHE-II modified allocation simulations, we evaluated the effects of replacing the HLA-based ETKAS scoring components by PIRCHE-II based equivalents, while leaving all the implemented non-HLA ETKAS parameters and scoring untouched. In these modifications, the total score and prioritization related to each individual scoring component remained unchanged and only the distribution of these points was modified (Table 1). These scores involved the full HLA match prioritization, HLA match grade, and mismatch probability. For all simulations and for the reference PROCARE dataset [20], the frequency of virtual transplantations depending on PIRCHE-II score was shown in density plots and the percentages for each of the four previously reported risk strata [19] were calculated.

Table 1. Description of the allocation simulation models.

Model HLA identical Points by match grade Mismatch probability Number of simulations
ETKAS ET, Full HLA match priority ET, based on HLA match grade ET 3
ETKASPIR-A PIRCHE < 9 ET, based on HLA match grade ET 1
ETKASPIR-B ET, Full HLA match priority PIRCHE, based on PIRCHE strata[19] ET 1
ETKASPIR-C ET, Full HLA match priority PIRCHE, relative to negative exponential PIRCHE score ET 1
ETKASPIR-D ET, Full HLA match priority PIRCHE inverse linear related to PIRCHE score, capped at 90 ET 1
ETKASPIR-E ET, Full HLA match priority PIRCHE inverse linear related to PIRCHE score, capped at 90 MMP-fitted PIRCHE RP polynomial 3
ETKASPIR-F PIRCHE < 9 PIRCHE inverse linear related to PIRCHE score, capped at 90 MMP-fitted PIRCHE RP polynomial 1

Full HLA match prioritization

ETKAS prioritizes full HLA-matched (broad antigen level) donor-recipient combinations. In the PIRCHE-II based allocation simulations this prioritization was changed to those combinations resulting in a PIRCHE-II score lower than 9. PIRCHE-II scores below 9 are considered very low [19] and should thus represent an optimal PIRCHE-II matched situation in kidney transplantation. This prioritization was executed in an identical fashion as in the current ETKAS prioritization for full HLA-A, -B, and -DRB1 matched combinations [28]. As such, donor-recipient combinations with a score below 9 were prioritized in the resulting ETKASPIR-A and -F models, regardless of the total score of the recipient on the waiting list.

HLA match grade replacements

We subsequently modified the ETKAS simulations by replacing HLA matching-based scoring parameters with PIRCHE-II based parameters. ETKAS assigns a maximum of 400 points depending on the HLA match (Fig 2). In the PIRCHE-II based allocation simulations, these 400 points were distributed depending on the PIRCHE-II score of a specific donor-recipient combination in three different ways (Fig 2 and Table 1). The first model used a categorization of each potential donor-recipient combination according to the previously defined ranges [19]. In this ETKASPIR-B model, matching scores were assigned as follows: PIRCHE-II <9: 400 points; PIRCHE-II 9–35: 266 points; PIRCHE-II 35–90: 133 points; PIRCHE-II > 90: 0 points. The second variant, implemented in the ETKASPIR-C model, applied a weighted negative exponential way, based on a continuous PIRCHE-II scoring formula, i.e. score = 400×(0.958×e−0.032×PIRCHE). The third variant, implemented in the ETKASPIR-D, ETKASPIR-E and ETKASPIR-F models, included a linear distribution of the 400 points in the range of 0 to 90, i.e. score=400×(190×(PIRCHE+1)), and zero points for all combinations with a PIRCHE-II score above 90 (Fig 3A).

Fig 3. Match point distributions.

Fig 3

(A) Graphical representation of the distribution of the 400 points for match grade in the PIRCHE-modified models ETKASPIR-B, -C, -D, -E, and -F. (B) Distribution of ETKAS points for HLA MMP on the bootstrapped waiting lists (red curve) shows a benefit for relatively few patients with rare genotypes. Unconverted, the PIRCHE-II risk profile (capped at PIRCHE-II weighted median of 200) assigns more points to average genotypes (blue curve), requiring fitting a polynomial (green curve) to match the regular ETKAS profile.

HLA mismatch probability

ETKAS implemented the HLA MMP to create a more balanced opportunity in the allocation process for patients that are usually difficult to match over those easily being well-matched. Analogous to this system, the PIRCHE-II Risk Profile (PIRCHE-II RP) considers the likelihood of a patient being well-matched from the perspective of the PIRCHE-II score. To calculate the PIRCHE-II RP, we considered the most frequent 2011 NMDP EURCAU haplotypes [29] to build a set of 1199 unique virtual genotypes with their estimated population frequencies. Each of these genotypes was PIRCHE-II-matched with each of the individuals of the virtual population, leading to a total of over 479x10^6 PIRCHE-II calculations. Subsequently, the PIRCHE-II scores of the results per virtual individual were aggregated as a weighted median considering the virtual genotype frequency forming the PIRCHE-II RP median. Thus, the score indicates that half of the donor population is expected to have a lower PIRCHE-II score and half of them to have a higher PIRCHE-II score.

The distribution of ETKAS points based on the HLA MMP indicates only a limited number of patients benefit from the points. Linear mapping of the PIRCHE-II RP median to ETKAS points revealed however a disproportionate number of patients with a high number of points allocated by the MMP component. Therefore, a fitting polynomial was applied to make sure a similar number of patients benefit from the MMP component with the same proportion (Fig 3B). As suggested by the HLA MMP formula, blood group and PRA were included resulting in following mapping function named PIRCHE-II MMP:

(1bloodgroupFrequency×relativePRA×(1min(1,PIRCHEIIRiskProfilemedian200)))20

Evaluation metrics

Validity of the bootstrapping process was evaluated by observing the distributions of patients’ blood group, PRA, waiting time, age and country. To evaluate the realism of the baseline simulations, PIRCHE-II distributions were compared to an actual transplant cohort. Additionally, HLA match grade distributions were compared to the baseline simulation.

The benefit of the modified allocation of the status quo simulation was evaluated by calculating the respective areas under the curve (AUC) in previously reported PIRCHE-II ranges knowingly correlated to outcome. PIRCHE-II distributions of simulated transplantations were aggregated by calculating the distribution-weighted mean log(PIRCHE-II) values (WML) in previously defined PIRCHE-II ranges [19]. The SWML aggregates all respective WML scores per simulation. Lower SWML scores indicate more simulated transplantations being carried out with lower PIRCHE-II scores (i.e. lower SMWL is better).

The feasibility of our suggested allocation system changes was evaluated by observing PIRCHE-II scores dependent on HLA match grades and vice versa. Also, the distributions of waiting time of patients on the waiting list and transplanted patients, kidney exchange, country balance, recipient age, waiting list size per country, number of transplantations per country, and points given by histocompatibility were taken into account.

Statistical analyses

ETKAS-specific data for the years 2013–2017 were collected from the annual Eurotransplant reports as available on the Eurotransplant website [31]. These data were compared with the bootstrapping data using Student’s t-test. The match grade distributions resulting from the simulations were compared by calculating Jensen-Shannon distances and by applying a Wilcoxon signed-rank test to identify significance levels. Evaluations of the allocation performance parameters from the ETKAS simulations and the PIRCHE-II-modified ETKAS simulations were statistically analysed with the Wilcoxon signed-rank test. PIRCHE distributions across the various simulations were compared using the Wilcoxon rank sum test. Estimation of improved graft survival considered reported univariate incidences of graft survival at 10 years post transplant in the respective PIRCHE-II groups [19,20]. PIRCHE-II group frequencies of simulations were multiplied with respective graft survival and summed across all groups. All calculations were executed in R software (R 3.6.1, R Foundation for Statistical Computing, Vienna, Austria).

Results

Baseline results after bootstrapping

First, a virtual waiting list was constructed by bootstrapping, using the Eurotransplant Annual Report 2015. The bootstrapping results were categorized according to the strata used in the Eurotransplant Annual Reports and compared to the average of the reported data over the years 2013–1017. Fig 4 shows a comparison of the basic characteristics (A) blood group distribution, (B) panel reactive antibodies (PRA), (C) waiting time since the start of dialysis, (D) age, and (E) country, as reported in the different Eurotransplant Annual reports and after bootstrapping. For the bootstrapping procedure, the waiting time showed a slight increase in number of cases with a waiting time of 0 to 1 year when compared to the ET reports (2159 cases on average in ET versus 2334 cases after bootstrapping; p<0.01). For blood group distribution, PRA, age, and country, no significant differences were observed. These data suggest that the basic characteristics of our initial virtual waiting lists were in general comparable to the basic characteristics of the different Eurotransplant Annual reports, but that the waiting time might be slightly underestimated in our simulations. Yet, the absolute differences were marginal and the individual data points were close to the 95% interval border. Moreover, since the observed differences equally affect all subsequent modified simulations, this deviation was acceptable.

Fig 4. Bootstrap validation.

Fig 4

Comparison of the bootstrapping results (blue dots) versus the data reported by ET in the years 2013–1017 (red dots). Waiting time was calculated from the start of dialysis. Significant differences (p < 0.01) are indicated with a "*".

Validation of the ETKAS simulation model

After performing the ETKAS simulations, we compared the longitudinal ETKAS simulation results with the retrospective outcome parameters as described by Eurotransplant [31]. Fig 5 depicts the longitudinal distributions of the HLA match grades of the Markov chain Monte Carlo (MCMC) simulated ETKAS for a ten-year period. The analyses showed a burn-in period of 2–3 years, after which the match grade distribution stabilized (Fig 5A). From this time point onwards, the simulated ETKAS data resembled the reported data (Fig 5B), although the results in the simulated ETKAS are more stable over the years, whereas the reported data contain more fluctuations.

Fig 5. Simulation stability evaluation.

Fig 5

(A) HLA match grade of the ETKAS simulations, year 10 compared to the 1998 observations: JSD = 0.069, p<0.001, year 10 compared to 2015 ETKAS observations: JSD = 0.135, p<0.001. (B) Observed HLA match grade reported by ET annual reports, only ETKAS. (C) Course of the distribution of the countries of origin of virtual individuals. (D) Course of country balance depending on country and simulated allocation models. (E) Number of transplants per country remained stable between the simulated allocations. (F) distribution of recipient age in the individual PIRCHE groups of different simulation allocations.

We next compared the waiting list sizes per country. To this end, the waiting list size data derived from the ETKAS simulations were calculated and plotted over time per country (Fig 5C). For most countries, a slight but constant increase or decrease in waiting list size was observed. These effects extended into all simulated years. The constant increases and decreases are the result of the data used for constructing the model, being the 2015 ET annual report. When comparing the ET report for this year with the 2014 report, the changes in waiting list size compared to the previous year were similar to the observed changes. Such modeling effects were also observed for the country balance, where positive and negative balances from the 2015 report were maintained in the simulations over time (Fig 5D). An exception to these latter observations is Slovenia, where a continuous net export was detected over time. This observation is the result of the low number of patients being registered to the waiting list (61 patients per year) and the comparatively high number of donors offered by this country (43 used kidney donors per year) in 2015. These low numbers result in highly diverse outcomes in repeated simulations, as indicated by the magnitude of the error bars for Slovenia. In the different allocation simulations, there was no impact on the transplanted recipients’ age observed considering the individual PIRCHE-II score groups (Fig 5F).

We next addressed the accurateness of the PIRCHE-II scores in the simulated allocations by comparing them with retrospective real-life allocation data from the previously analyzed kidney transplant PROCARE cohort [20]. The overlay histogram (Fig 6A) shows that the distribution of PIRCHE-II scores in the PROCARE cohort does essentially not deviate from the scores obtained from the ETKAS simulations. As the PROCARE cohort was allocated by ETKAS, our baseline analyses indicate that the primary HLA aspects from ETKAS have been implemented correctly into the ETKAS simulation model.

Fig 6. PIRCHE-II score distributions in simulations.

Fig 6

The log-transformed PIRCHE-II score distributions resulting from the different ETKAS simulation models. Density plots for the simulations were generated using a Gaussian smoothing kernel. Red lines in graphs A-C represent the PIRCHE-II scores in the ETKAS baseline simulations, the green line in graph A represents the previously reported PIRCHE-II scores as observed in the PROCARE cohort[20], blue lines in graphs B-C represent the PIRCHE-II scores in the PIRCHE-II modified ETKAS simulations for the ETKASPIR-E with priority by HLA match, assignment of points linearly descending, and inclusion of a PIRCHE-II based mismatch probability (MMP) (B), and ETKASPIR-F with priority allocation by PIRCHE-II score, assignment of points linearly descending, and inclusion of a PIRCHE-based MMP (C). Dashed lines indicate the previously reported strata by Lachmann et al. [19].

In conclusion, the validation analyses of the ETKAS simulation model indicate that the simulations are essentially comparable to the Eurotransplant reports, although there are small differences in the details. These subtle differences, however, will be present in all simulation models to the same extent. As such, the ETKAS simulations were used as a baseline for the comparisons with the modified ETKAS simulations below.

Construction of an improved allocation model (ETKASPIR-E)

The modified allocation approaches ETKASPIR-A to -D were evaluated with their individual components’ impact on allocation as demonstrated in S1 Text. Based on these findings, ETKASPIR-E was constructed. Compared to the baseline model, ETKASPIR-E increases the number of transplantations being carried out with lower PIRCHE-II scores (Fig 6B). The number of transplantations with very low PIRCHE-II scores is only slightly increased over ETKAS (17.17% vs. 15.52%; Table 2). However, due to more transplantations being carried out with intermediate-low PIRCHE-II scores (41.66% vs. 25.08%, Table 2) and a therefore decreased number of transplantations with intermediate-high and high scores, the SWML reduces significantly to 3.083 compared to 3.391 of ETKAS (p < 0.001).

Table 2. PIRCHE-II distribution per risk strata in percent.

PIRCHE-II score ranges
Group 1
0–9 (WML)
Group 2
9–35 (WML)
Group 3
35–90 (WML)
Group 4
> 90 (WML)

p value (SWML)
Allocation model PROCARE 10.87% (0.095) 21.62% (0.672) 47.71% (1.937) 19.81% (0.953) < 0.001I (3.657)
ETKAS 15.52% (0.112) 25.08% (0.784) 46.30% (1.871) 13.10% (0.624) - (3.391)
ETKASPIR-E 17.17% (0.116) 41.66% (1.308) 36.13% (1.404) 5.04% (0.256) <0.001I (3.083)
ETKASPIR-F 27.12% (0.353) 30.93% (0.993) 37.02% (1.444) 4.92% (0.244) 0.001II (3.034)

Pairwise comparisons of PIRCHE-II scores using Wilcoxon’s rank sum test considered (I) ETKAS, (II) ETKASPIR-E. Distribution-weighted mean log(PIRCHE-II) per PIRCHE-II range (WML) in parentheses. Sum of distribution-weighted mean log(PIRCHE-II) values (SWML) integrate frequency and PIRCHE-II distribution.

Construction of an optimal allocation model (ETKASPIR-F)

The PIRCHE-II-based prioritization in ETKASPIR-A led to a significant overall improvement as reflected by the proportion of allocations in the lowest risk group and a lower SWML score (S1 Text). The ETKASPIR-D and -E models showed that implementation of a PIRCHE-II-based matching score and mismatch probability can further reduce the overall PIRCHE-II load of the cohort. In the ETKASPIR-F model, we combined all three aspects and evaluated the effects of this combination.

The data in Table 2 show that this combined PIRCHE-II allocation model leads to the optimal projected reduction of risk, as reflected by the SWML score for the ETKASPIR-F model (SWML = 3.034; Table 2). When comparing the proportions and WML scores of the 4 risk groups, ETKASPIR-F benefits from the PIRCHE-II based prioritization. Moreover, this maximisation is not accompanied with an increase of the frequency of allocations into groups 3 and 4. We thus conclude that the ETKASPIR-F model is the most optimal model.

The effects of PIRCHE-based allocation on other factors

The ETKASPIR-E and -F model yielded the most optimal outcome in the applied MCMC simulations (Table 2). To evaluate the effect of the model on additional allocation outcome parameters, we analyzed these parameters in the ETKASPIR-E model in triplicate and on a single simulation for ETKASPIR-F. All primary comparisons were made between the triplicate ETKAS simulation data and the triplicate ETKASPIR-E data. ETKASPIR-F data were compared to evaluate to confirm identity to the ETKASPIR-E model for these parameters.

Waiting list characteristics

In all simulations, all kidneys could be allocated successfully. The simulations showed a burn-in period of approximately 2 years until border-crossing kidney exchange (Fig 7A) was in balance and remained stable for the duration of the simulations. Waiting time distributions of transplanted patients show some fluctuations over the years with mildly decreased waiting time in simulated transplantations with ETKASPIR-E and ETKASPIR-F compared to ETKAS in most years (Fig 7B). Waiting time distributions of patients on the waiting list increased over the years in all models and stabilized after 5 simulated years. ETKAS and ETKASPIR-E showed no statistically significant difference in waiting time, whereas waiting times were slightly increased on the ETKASPIR-F waiting lists in some years (Fig 7C). The number of transplants per country (Fig 4E), the waiting list size per country (Fig 4C) and the country balance per year (Fig 4D) in ETKASPIR-E overlapped with the ETKAS simulations.

Fig 7. Monitoring metrics.

Fig 7

(A) After the simulation stabilized, the amount of cross-border donor exchange remained similar between the simulated ETKAS and ETKASPIR-E. Outliers in the burn-in period were suppressed for readability. (B) Average waiting times of transplanted patients was slightly lower in ETKASPIR-E, (C) whereas average waiting times of patients on the waiting list increased mildly. (D) number of match points given by match compatibility in the different simulations. Boxplots depict the median (horizontal line), mean (plus) and first to third quartile (box), the highest and lowest value within 1.5x IQR (whiskers), outliers (circles).

Increased number of HLA mismatches with ETKASPIR-E

The percentage of 0 mismatch transplants reduced negligibly in ETKASPIR-E compared to ETKAS (means 21.5% versus 22.1%, respectively; Fig 8A). The ETKASPIR-A and ETKASPIR-F models significantly reduce the fraction of 0-mismatched transplants to 12.1% and 11.9% respectively. For the latter two, this is counterbalanced by an increase in the single mismatched transplant group. As the ETKASPIR-B, -C, -D and -E models maintain the ETKAS full match prioritization while the -A and -F models use the PIRCHE-based prioritization, these effects are attributed to the prioritization. These shifts in match grades (Fig 8B), however, still led to a significantly improved PIRCHE-II score for the respective groups as reflected by their SWML scores (Table 2). Thus, despite a lower match grade, the PIRCHE-II based matching improves and a better transplant outcome is anticipated for the entire transplant cohort.

Fig 8. Impact on match grade.

Fig 8

(A) In ETKASPIR-F (green), the proportion of simulated transplants with a full HLA match reduces when compared to ETKAS (red). ETKASPIR-E (blue) compensates for that by maintaining the current ETKAS priority for HLA full matches. (B) PIRCHE-II scores are reduced in every HLA match group. Boxplots depict the median (horizontal line), mean (plus) and first to third quartile (box), the highest and lowest value within 1.5x IQR (whiskers), outliers (circles).

For the PIRCHE-based ETKASPIR-B, -C, -D, -E, and -F models, the number of transplants with 2 and 3 mismatches decreased slightly when compared to the baseline ETKAS simulations. Moreover, the number of 4, 5 and 6 mismatched transplants increased when including PIRCHE-II in the allocation match grade algorithm. Again, these increases in mismatches were accompanied by significant decreases in PIRCHE-II scores. Of all factors, replacing the regular match grade scoring system by a PIRCHE-II based scoring resulted in the strongest decrease in SWML score and thus is anticipated to result in the best transplant outcome.

Inclusion of the PIRCHE-II RP in favour of the MMP—to compensate for waiting time effects—had no effect on the mismatch distributions (models ETKASPIR-D versus -E).

International exchange

For the ETKASPIR-E and ETKASPIR-F models, we evaluated the effect of these adaptations on the international exchange of kidneys. All models displayed a stabilization period of 4 to 5 years (Fig 7A). After that, the ETKAS and ETKASPIR-E models displayed a similar percentage of organs that were crossing the national borders. These percentages were significantly higher for the ETKASPIR-F model. The differences of the ETKASPIR-F model with the other two were in the range of ~2–3% (p < 0.001 for all time points in the range of 5–10 years).

Discussion

Epitope matching can significantly improve the outcome of HLA-mismatched kidney transplantation [19,20,22,23,32]. Therefore, allocation based on matching for epitope compatibility rather than matching for serological antigen may be beneficial. In contrast to the classical HLA mismatching approaches, which simply count the number of HLA mismatches between a donor and a recipient, epitope matching considers the immunological entities that underlie a potential antibody and T-cell response. These epitopes are derived from the HLA protein sequences and one HLA protein can contain many epitopes. Thus, for epitopes matching, algorithms need to compare the donor’s and the recipient’s using their amino acid sequences. Consequently, the inclusion of epitope matching factors in the allocation systems would add a novel and complex mathematical layer to the allocation systems. This level of complexity requires computer simulations and cannot be done by intuition. In this study we therefore for the first time addressed the feasibility of including T-cell epitope matching in the organ allocation procedures. Our simulations show that inclusion of PIRCHE-II-based parameters, replacing the classical HLA allocation factors, is feasible without major drawbacks and that it could lead to an improved graft survival equivalent to approximately one extra classical HLA match.

Applying computer simulations to estimate the impact of changes in organ allocation algorithms is of great value. Hence there are many reports on simulation frameworks highly tailored for the respective allocation system they were designed for [3335]. Also, the introduction of ETKAS by Eurotransplant was preceded by simulating the proposed model [27]. Although very basic to the current standards, these first simulations showed that HLA matching could be included in the allocation in order to achieve an increase of 7%-12% one-year graft survival. The results from these simulations paved the way for including HLA matching in the allocation. Follow up one year after the introduction of the changed allocation procedure showed that these simulations were pretty exact [36]. Similarly, introducing epitope matching techniques to the current allocation system requires thorough monitoring of the expected clinical impact by e.g. monitoring DSA incidence and the respective epitope scores. Considering the reported univariate graft survival rates of previous studies [19,20] and the increasing frequency of patients being transplanted with lower PIRCHE scores, our simulations of the Eurotransplant Kidney Allocation System suggest an increasing absolute incidence of a functioning graft 10 years after transplantation by 1.1% to 1.5%. This absolute increase translates into a relative improvement of 12.9% to 13.5% bearing in mind the spread in graft survival at 10 years between low and high scores being 8% to 12%. However, confounding factors outside the scope of our simulations may affect these estimates, necessitating further modeling studies.

Beyond tweaking the histocompatibility of the allocation, computer simulations are also capable of evaluating more fundamental characteristics of allocation systems. In 2004 French allocation areas switched from a local center-based allocation policy to a regional patient-centered allocation based on previous simulations showing an improved equity and efficacy [34]. In the United Network for Organ Sharing, computer simulations have a long history with the UNOS Kidney Allocation Model software (UKAM) [33], its successor UNOS Kidney-Pancreas Simulation Allocation Model (KPSAM) [37] and newly suggested models [38,39]. The KPSAM software considers patient and donor data from the Scientific Registry of Transplant Recipients (SRTR) and was instrumental in the 2014 introduction of the kidney donor profile index (KDPI) by the Organ Procurement and Transplantation Network (OPTN) into a new national deceased donor kidney allocation [40]. These simulations predicted that the new policy could potentially improve kidney transplant outcomes with an improvement of 7.0% in median patient life-years per transplant and an average of 2.8% increase in allograft years of life. After the implementation and validation of the current OPTN kidney allocation, KPSAM is still beneficial to evaluate further options to improve utility and equity of kidney allocation e.g. for highly-sensitized recipients [41]. Consequently, SRTR data and simulated allocation models are also applied in lung and liver transplantation, with each setting having its unique allocation system requirements [42,43]. These studies cumulatively show that simulations are a valuable approach to estimate the effects of changes in complex organ allocation algorithms. Although simulations can provide realistic indications regarding the effects on changes to the allocation system, it is crucial to critically evaluate, after implementing changes suggested by computer simulations, if the desired effects were achieved and if potential side-effects were not discovered by previous simulations [36,44]. Such evaluations may be helpful in correcting undesired effects that could not be deduced from the simulations.

Focusing on very specific aspects of the highly complex ETKAS, our allocation models are highly tailored to Eurotransplant’s kidney allocation. Nevertheless, basic concepts apply to other transplantation networks in other regions likewise (e.g. virtual populations, patient flow, waiting list management, etc.) and may therefore be reused and adapted accordingly. Also, our simulations may serve as a basis to evaluate more profound changes of the allocation paradigms with respect to utility and equity. Given the variability of organ allocation rules in different countries, adapting simulations or providing a general simulation framework remains however challenging.

Our simulations used the ET kidney transplant data from 2015 to establish a basic ETKAS simulation model. Results from the simulations were comparable with reported data from 2013–2017, indicating the relative exactness of the simulation model. The results show that the simulation is stable over time for HLA matches and number of transplants. These stable results are essential to conclude that the simulated allocation system delivers a long-term reliability and that the simulations do not overrate short-term positive influences. The major differences between our reported historic data from Eurotransplant and our basic ETKAS simulations are the continuous increasing or decreasing trends in the simulation model, for instance for waiting times, waiting list size, and country balance. These trends are caused by the static parameter initialization of the model; conditional probabilities as provided by the reference ET data from 2015 [11] are imbalanced within the observation periods of one year. Consequently, the specific allocation characteristics in 2015 result in a propagation of bias over the simulation period. In reality, parameters like the number of donors or the number of waiting-list registrations will change over time and result in a balance over longer observation periods. Such aspects were not included in the model to avoid adding uncertain assumptions of distributions to the models. Since these structural imbalances are identical for all simulation models, the modified ETKAS models that include PIRCHE-II-based parameters were compared with the simulated ETKAS model.

Despite the fact that simulations can reflect real-life situations, there may be additional factors that affect the realism of simulation outcomes. For instance, our simulations focused on ETKAS and excluded any interaction with competing or interfering allocation programs within ET, such as the Eurotransplant Senior Program (ESP) for patients over 65 years [45] and the Acceptable Mismatch (AM) Program, for highly sensitized patients [46]. Particularly the AM Program may take specific donors from the regular ETKAS due to prioritization for AM’s. This may for instance lead to a lower proportion of homozygous donors for ETKAS, as these donors have by definition a lower number of mismatched antigens and are thus more prone to fit an AM patient than a fully heterozygous donor. Such competing allocation schemes and their interactions are difficult to model and require real-life data of the recipients and the donors, particularly in the case of the AM Program. Similarly, the status of patients on the waiting list is dynamic between “active” (transplantable, T) and “inactive” (“not-transplantable”, NT). A substantial proportion of the patients at the waiting list has the status NT and are thus not available for allocation. Data on this dynamic aspect are not available and may affect the simulations. In our simulations we did not consider NT patients, which might underestimate average match grades as the number of distinct patients over time is higher than the number of T listed patients at any given time on the waiting list. It must be acknowledged that changing matching rules dependent on individuals’ genotypes may cause advantages/disadvantages for certain subpopulations. These advantages and/or disadvantages may lead to an increase in certain subpopulations on the waiting list. To promote more equality for such situations, Eurotransplant implemented the MMP–a correction factor that adds additional points to patients that are less likely to receive a well-matched transplant. Although we suggest the epitope-equivalent PIRCHE-II RP mechanism over the MMP to promote patients with rare genotypes, further studies are warranted to investigate a potential disadvantage for certain patient groups or populations introduced by epitope matching, e.g. by considering real-world donor and recipient typing data. Other factors that were absent or incomplete in our simulations are the increasing genetic diversity in patients and donors over time for instance due to migration, temporal aspects of immunization, specific center policies, rejected graft offers due to positive crossmatches, organ quality, accuracy of demographic parameters, deregistrations dependent on specific factors, dependency of HLA type and blood group, and the spatial resolution as now defined on country level rather than region. These inaccuracies limit comparability between simulation and real data. However, as we applied a baseline simulation to compare our modified allocation models, the error is systematic and applies similarly to all simulated instances. Such unknown factors could to some extent be included in a simulation model. It is however known that such an approach is prone to result in overfitting the model [47]. We therefore suggest that such data could only be included based upon real-life allocation data as stored by the various allocation organisations, considering the difficulties to apply Markov models to real patient histories. [4850] With sufficient real-life data of complex, highly-sensitized recipients, simulations could also be extended to estimate the impact of the AM program, which intentionally was excluded in our simulation with virtual individuals. A collaborative project was initiated with Eurotransplant to apply comparable simulations of ETKAS to their retrospective transplant cohort. This project may be extended to cover also the AM allocation.

Our data indicate that further improvements might be possible. For instance, the optimal ETKASPIR-F model shows that inclusion of the PIRCHE-II based score may reduce the assigned HLA-related scores (Fig 7D); distribution of 400 points may be improved further possibly by optimizing the distribution curve. Such improvement might be established by adding a 400-point plateau for the lower group or distributing these points on a linear basis or via an arccotangent-based function. Second, for some simulated ETKAS-PIR models, the waiting time for transplanted patients is reduced, while patients wait longer on the waiting list. This phenomenon can be explained by the average number of points given by the HLA and respectively PIRCHE match component. As the number of points reduces on average, the burden of overcoming a low histocompatibility with points derived from waiting time is lower, requiring less waiting time. Correction of these effects may be achieved by applying an adjustment factor to the HLA component, so the average number of points given matches the current ETKAS implementation.

Our simulations considered PIRCHE-II scores with HLA-A, -B, -C, -DRB1 and -DQB1 as peptide sources, with HLA-DRB1 as the only presenting locus. With multiple imputation enabled, providing HLA-A, -B and -DRB1 is sufficient to calculate reasonably accurate PIRCHE-II scores. [51] This matches the requirements of the current Eurotransplant allocation rules, potentially reducing the burden of implementing suggested changes. However, there is growing evidence of the clinical relevance of presentation of allopeptides by e.g. HLA-DQA1/-DQB1 heterodimers to CD4+ T cells. [22] After further clinical validation, implementation of corresponding typing methods in the pre-transplant diagnostic routine and upon availability of haplotype frequency datasets including HLA-DQA1 and HLA-DP, the presented workflow might be adapted to simulate enhanced PIRCHE-II scores’ impact on allocation.

The implementation of PIRCHE-II based allocation is projected to improve transplant outcome. This implementation additionally increased the international exchange of organs. International exchange within Eurotransplant has not been documented in the annual reports. As such, the validity of our simulations could not be evaluated. This exchange aspect in the context of HLA matching was, however, recognized at the time of implementation of HLA matching for kidney transplantation and is one of the key benefits of international organ allocation organizations as Eurotransplant [36]. In our simulation analyses, international exchange rates increased in those models where low PIRCHE-II scores were prioritized (ETKAS versus ETKASPIR-F), but not when prioritization was still based upon full HLA match (model ETKASPIR-E versus -F). An increasing exchange might indicate longer average cold-ischemic times, which impairs outcome. If desired, such effects could in principle be counterbalanced by changing the cutoff for prioritization or by adding more weight to the non-HLA factor for national allocation. The latter is, however, outside the scope of the current investigations.

In summary, we here for the first time executed structural and extensive MCMC simulations to evaluate the feasibility of implementing T-cell epitope matching based upon the PIRCHE-II concept in kidney allocation. Our data show that, by allowing more international exchange, such an implementation is viable. The evaluations indicate that the relative benefit in graft survival is around 13%. A better epitope matching is also expected to reduce the immunisation rate including a lower incidence of dnDSA formation [19]. The latter will reduce the number of unacceptable antigens in a potential subsequent retransplantation. Collectively, the cumulative graft years are likely to increase, patients will return to the waiting list later than in the current system and overall waiting list size will shorten or grow at a slower rate in the long run.

Supporting information

S1 Text. Evaluation of ETKASPIR-A—ETKASPIR-D.

(DOCX)

Abbreviations

AM

Acceptable Mismatch

AUC

area under the curve

DSA

donor specific HLA antibody

ESP

Eurotransplant Senior Program

ETKAS

Eurotransplant kidney allocation system

ETKASPIR

PIRCHE-modified ETKAS

HLA

human leukocyte antigen

KDPI

kidney donor profile index

KPSAM

UNOS Kidney-Pancreas Simulation Allocation Model

MCMC

Markov chain Monte Carlo

MMP

mismatch probability

NMDP

National Marrow Donor Program

NT patient

not-transplantable patient

OPTN

Organ Procurement and Transplantation Network

PIRCHE

predicted indirectly recognizable HLA epitopes

PIRCHE-II RP

PIRCHE-II Risk Profile

PRA

panel reactive antibodies

SRTR

Scientific Registry of Transplant Recipients

SWML

sum of all distribution-weighted mean log(PIRCHE-II) values

T patient

transplantable patient

UNOS

United Network for Organ Sharing

UKAM

UNOS Kidney Allocation Model

WML

distribution-weighted mean log(PIRCHE-II)

Data Availability

The results are based upon are publicly accessible datasets. The respective repositories are are referred to in the applied research protocol: dx.doi.org/10.17504/protocols.io.bqrtmv6n.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.Everly MJ, Rebellato LM, Haisch CE, Ozawa M, Parker K, Briley KP, et al. Incidence and impact of de novo donor-specific alloantibody in primary renal allografts. Transplantation. 2013. Feb 15;95(3):410–7. doi: 10.1097/TP.0b013e31827d62e3 [DOI] [PubMed] [Google Scholar]
  • 2.Terasaki PI, Cai J. Human leukocyte antigen antibodies and chronic rejection: from association to causation. Transplantation. 2008. Aug 15;86(3):377–83. doi: 10.1097/TP.0b013e31817c4cb8 [DOI] [PubMed] [Google Scholar]
  • 3.Zhang Q, Liang LW, Gjertson DW, Lassman C, Wilkinson AH, Kendrick E, et al. Development of posttransplant antidonor HLA antibodies is associated with acute humoral rejection and early graft dysfunction. Transplantation. 2005. Mar 15;79(5):591–8. doi: 10.1097/01.tp.0000155246.52249.ac [DOI] [PubMed] [Google Scholar]
  • 4.Ansari D, Bućin D, Nilsson J. Human leukocyte antigen matching in heart transplantation: systematic review and meta-analysis. Transpl Int Off J Eur Soc Organ Transplant. 2014. Aug;27(8):793–804. doi: 10.1111/tri.12335 [DOI] [PubMed] [Google Scholar]
  • 5.Süsal C, Opelz G. Current role of human leukocyte antigen matching in kidney transplantation. Curr Opin Organ Transplant. 2013. Aug;18(4):438–44. doi: 10.1097/MOT.0b013e3283636ddf [DOI] [PubMed] [Google Scholar]
  • 6.Doxiadis IIN, Smits JMA, Persijn GG, Frei U, Claas FHJ. It takes six to boogie: allocating cadaver kidneys in Eurotransplant. Transplantation. 2004. Feb 27;77(4):615–7. doi: 10.1097/01.tp.0000103725.72023.d7 [DOI] [PubMed] [Google Scholar]
  • 7.Persijn GG. Allocation of organs, particularly kidneys, within Eurotransplant. Hum Immunol. 2006. Jun;67(6):419–23. doi: 10.1016/j.humimm.2006.03.008 [DOI] [PubMed] [Google Scholar]
  • 8.Claas FHJ, Dankers MK, Oudshoorn M, van Rood JJ, Mulder A, Roelen DL, et al. Differential immunogenicity of HLA mismatches in clinical transplantation. Transpl Immunol. 2005. Aug;14(3–4):187–91. doi: 10.1016/j.trim.2005.03.007 [DOI] [PubMed] [Google Scholar]
  • 9.Doxiadis II, Smits JM, Schreuder GM, Persijn GG, van Houwelingen HC, van Rood JJ, et al. Association between specific HLA combinations and probability of kidney allograft loss: the taboo concept. Lancet Lond Engl. 1996. Sep 28;348(9031):850–3. doi: 10.1016/s0140-6736(96)02296-9 [DOI] [PubMed] [Google Scholar]
  • 10.Mayer G, Persijn GG. Eurotransplant kidney allocation system (ETKAS): rationale and implementation. Nephrol Dial Transplant Off Publ Eur Dial Transpl Assoc—Eur Ren Assoc. 2006. Jan;21(1):2–3. doi: 10.1093/ndt/gfi269 [DOI] [PubMed] [Google Scholar]
  • 11.Eurotransplant Foundation. Annual Report 2015 [Internet]. 2016 [cited 2020 Jun 17]. Available from: http://www.eurotransplant.org/wp-content/uploads/2019/12/AR2015.pdf
  • 12.Kramer CSM, Israeli M, Mulder A, Doxiadis IIN, Haasnoot GW, Heidt S, et al. The long and winding road towards epitope matching in clinical transplantation. Transpl Int Off J Eur Soc Organ Transplant. 2019;32(1):16–24. doi: 10.1111/tri.13362 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Duquesnoy RJ. A structurally based approach to determine HLA compatibility at the humoral immune level. Hum Immunol. 2006. Nov;67(11):847–62. doi: 10.1016/j.humimm.2006.08.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Kosmoliaptsis V, Chaudhry AN, Sharples LD, Halsall DJ, Dafforn TR, Bradley JA, et al. Predicting HLA class I alloantigen immunogenicity from the number and physiochemical properties of amino acid polymorphisms. Transplantation. 2009. Sep 27;88(6):791–8. doi: 10.1097/TP.0b013e3181b4a9ff [DOI] [PubMed] [Google Scholar]
  • 15.Kosmoliaptsis V, Sharples LD, Chaudhry AN, Halsall DJ, Bradley JA, Taylor CJ. Predicting HLA class II alloantigen immunogenicity from the number and physiochemical properties of amino acid polymorphisms. Transplantation. 2011. Jan 27;91(2):183–90. doi: 10.1097/TP.0b013e3181ffff99 [DOI] [PubMed] [Google Scholar]
  • 16.Geneugelijk K, Spierings E. Matching donor and recipient based on predicted indirectly recognizable human leucocyte antigen epitopes. Int J Immunogenet. 2018. Apr;45(2):41–53. doi: 10.1111/iji.12359 [DOI] [PubMed] [Google Scholar]
  • 17.Geneugelijk K, Thus KA, Spierings E. Predicting alloreactivity in transplantation. J Immunol Res. 2014;2014:159479. doi: 10.1155/2014/159479 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Geneugelijk K, Spierings E. PIRCHE-II: an algorithm to predict indirectly recognizable HLA epitopes in solid organ transplantation. Immunogenetics. 2020. Feb;72(1–2):119–29. doi: 10.1007/s00251-019-01140-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Lachmann N, Niemann M, Reinke P, Budde K, Schmidt D, Halleck F, et al. Donor-Recipient Matching Based on Predicted Indirectly Recognizable HLA Epitopes Independently Predicts the Incidence of De Novo Donor-Specific HLA Antibodies Following Renal Transplantation. Am J Transplant Off J Am Soc Transplant Am Soc Transpl Surg. 2017. Dec;17(12):3076–86. doi: 10.1111/ajt.14393 [DOI] [PubMed] [Google Scholar]
  • 20.Geneugelijk K, Niemann M, Drylewicz J, van Zuilen AD, Joosten I, Allebes WA, et al. PIRCHE-II Is Related to Graft Failure after Kidney Transplantation. Front Immunol. 2018;9:321. doi: 10.3389/fimmu.2018.00321 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Siu JHY, Surendrakumar V, Richards JA, Pettigrew GJ. T cell Allorecognition Pathways in Solid Organ Transplantation. Front Immunol. 2018. Nov 5;9:2548. doi: 10.3389/fimmu.2018.02548 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Sakamoto S, Iwasaki K, Tomosugi T, Niemann M, Spierings E, Miwa Y, et al. Analysis of T and B Cell Epitopes to Predict the Risk of de novo Donor-Specific Antibody (DSA) Production After Kidney Transplantation: A Two-Center Retrospective Cohort Study. Front Immunol. 2020. Aug 27;11:2000. doi: 10.3389/fimmu.2020.02000 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Unterrainer C, Döhler B, Niemann M, Lachmann N, Süsal C. Can PIRCHE-II Matching Outmatch Traditional HLA Matching? Front Immunol. 2021. Feb 26;12:631246. doi: 10.3389/fimmu.2021.631246 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Kausman JY, Walker AM, Cantwell LS, Quinlan C, Sypek MP, Ierino FL. Application of an epitope-based allocation system in pediatric kidney transplantation. Pediatr Transplant. 2016. Nov;20(7):931–8. doi: 10.1111/petr.12815 [DOI] [PubMed] [Google Scholar]
  • 25.Duquesnoy RJ. Should epitope-based HLA compatibility be used in the kidney allocation system? Hum Immunol. 2017. Jan;78(1):24–9. doi: 10.1016/j.humimm.2016.10.008 [DOI] [PubMed] [Google Scholar]
  • 26.Otten HG, Joosten I, Allebes WA, van der Meer A, Hilbrands LB, Baas M, et al. The PROCARE consortium: toward an improved allocation strategy for kidney allografts. Transpl Immunol. 2014. Oct;31(4):184–90. doi: 10.1016/j.trim.2014.09.008 [DOI] [PubMed] [Google Scholar]
  • 27.Wujciak T, Opelz G. Computer analysis of cadaver kidney allocation procedures. Transplantation. 1993. Mar;55(3):516–21. [PubMed] [Google Scholar]
  • 28.de Boer J, Tieken CM, Hagenaars J. Eurotransplant Manual, Chapter 4 Kidney (ETKAS and ESP), version 9.0 [Internet]. 2020. [cited 2020 Jun 17]. Available from: http://www.eurotransplant.org/wp-content/uploads/2020/01/H4-Kidney.pdf [Google Scholar]
  • 29.Gragert L, Madbouly A, Freeman J, Maiers M. Six-locus high resolution HLA haplotype frequencies derived from mixed-resolution DNA typing for the entire US donor registry. Hum Immunol. 2013. Oct;74(10):1313–20. doi: 10.1016/j.humimm.2013.06.025 [DOI] [PubMed] [Google Scholar]
  • 30.Geman S, Geman D. Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell. 1984. Jun;6(6):721–41. doi: 10.1109/tpami.1984.4767596 [DOI] [PubMed] [Google Scholar]
  • 31.Eurotransplant Foundation. Annual Reports [Internet]. 2020 [cited 2020 Jun 17]. Available from: https://www.eurotransplant.org/statistics/annual-report/
  • 32.Wiebe C, Nickerson P. Strategic Use of Epitope Matching to Improve Outcomes. Transplantation. 2016. Oct;100(10):2048–52. doi: 10.1097/TP.0000000000001284 [DOI] [PubMed] [Google Scholar]
  • 33.Taranto SE, Harper AM, Edwards EB, Rosendale JD, McBride MA, Daily OP, et al. Developing a national allocation model for cadaveric kidneys. In: 2000 Winter Simulation Conference Proceedings (Cat No00CH37165) [Internet]. Orlando, FL, USA: IEEE; 2000 [cited 2020 Nov 10]. p. 1971–7. Available from: http://ieeexplore.ieee.org/document/899194/
  • 34.Jacquelinet C, Audry B, Golbreich C, Antoine C, Rebibou J-M, Claquin J, et al. Changing kidney allocation policy in France: the value of simulation. AMIA Annu Symp Proc AMIA Symp. 2006;374–8. [PMC free article] [PubMed] [Google Scholar]
  • 35.Hudson A, Bradbury L, Johnson R, Fuggle SV, Shaw J a. M, Casey JJ, et al. The UK Pancreas Allocation Scheme for Whole Organ and Islet Transplantation. Am J Transplant. 2015;15(9):2443–55. doi: 10.1111/ajt.13284 [DOI] [PubMed] [Google Scholar]
  • 36.De Meester J, Persijn GG, Wujciak T, Opelz G, Vanrenterghem Y. The new Eurotransplant Kidney Allocation System: report one year after implementation. Eurotransplant International Foundation. Transplantation. 1998. Nov 15;66(9):1154–9. doi: 10.1097/00007890-199811150-00007 [DOI] [PubMed] [Google Scholar]
  • 37.Scientific Registry of Transplant Recipients. Kidney-Pancreas Simulated Allocation Model User’s Guide [Internet]. 2015 [cited 2020 Nov 10]. Available from: https://www.srtr.org/media/1202/kpsam.pdf
  • 38.Davis A, Mehrotra S, Friedewald J, Ladner D. Characteristics of a simulation model of the national kidney transplantation system. In: 2013 Winter Simulations Conference (WSC) [Internet]. Washington, DC, USA: IEEE; 2013 [cited 2020 Nov 10]. p. 2320–9. Available from: http://ieeexplore.ieee.org/document/6721607/
  • 39.Sandikci B, Tunc S, Tanriover B. A New Simulation Model for Kidney Transplantation in the United States. In: 2019 Winter Simulation Conference (WSC) [Internet]. National Harbor, MD, USA: IEEE; 2019 [cited 2020 Nov 10]. p. 1079–90. Available from: https://ieeexplore.ieee.org/document/9004914/
  • 40.Israni AK, Salkowski N, Gustafson S, Snyder JJ, Friedewald JJ, Formica RN, et al. New national allocation policy for deceased donor kidneys in the United States and possible effect on patient outcomes. J Am Soc Nephrol JASN. 2014. Aug;25(8):1842–8. doi: 10.1681/ASN.2013070784 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Gebel HM, Kasiske BL, Gustafson SK, Pyke J, Shteyn E, Israni AK, et al. Allocating Deceased Donor Kidneys to Candidates with High Panel–Reactive Antibodies. Clin J Am Soc Nephrol. 2016. Mar 7;11(3):505–11. doi: 10.2215/CJN.07720715 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Tsuang WM, Chan KM, Skeans MA, Pyke J, Hertz MI, Israni AJ, et al. Broader Geographic Sharing of Pediatric Donor Lungs Improves Pediatric Access to Transplant: Geographic Sharing of Pediatric Donor Lungs. Am J Transplant. 2016. Mar;16(3):930–7. doi: 10.1111/ajt.13507 [DOI] [PubMed] [Google Scholar]
  • 43.Kim S-P, Gupta D, Israni AK, Kasiske BL. Accept/decline decision module for the liver simulated allocation model. Health Care Manag Sci. 2015. Mar;18(1):35–57. doi: 10.1007/s10729-014-9295-x [DOI] [PubMed] [Google Scholar]
  • 44.De Meester J, Persijn GG, Claas FHJ, Frei U. In the queue for a cadaver donor kidney transplant: new rules and concepts in the Eurotransplant International Foundation. Nephrol Dial Transplant. 2000. Mar 1;15(3):333–8. doi: 10.1093/ndt/15.3.333 [DOI] [PubMed] [Google Scholar]
  • 45.Schachtner T, Otto NM, Reinke P. Two Decades of Eurotransplant Senior Program (ESP): Time on Dialysis Independently Impacts Patient Survival, Allograft Survival and Quality of Life After Kidney Transplantation. Transplantation. 2018. Jul;102:S34. [Google Scholar]
  • 46.Heidt S, Witvliet MD, Haasnoot GW, Claas FHJ. The 25th anniversary of the Eurotransplant Acceptable Mismatch program for highly sensitized patients. Transpl Immunol. 2015. Oct;33(2):51–7. doi: 10.1016/j.trim.2015.08.006 [DOI] [PubMed] [Google Scholar]
  • 47.Babyak MA. What you see may not be what you get: a brief, nontechnical introduction to overfitting in regression-type models. Psychosom Med. 2004. Jun;66(3):411–21. doi: 10.1097/01.psy.0000127692.23278.a9 [DOI] [PubMed] [Google Scholar]
  • 48.Sonnenberg FA, Beck JR. Markov Models in Medical Decision Making: A Practical Guide. Med Decis Making. 1993. Dec;13(4):322–38. doi: 10.1177/0272989X9301300409 [DOI] [PubMed] [Google Scholar]
  • 49.Beck JR, Pauker SG. The Markov process in medical prognosis. Med Decis Mak Int J Soc Med Decis Mak. 1983;3(4):419–58. doi: 10.1177/0272989X8300300403 [DOI] [PubMed] [Google Scholar]
  • 50.Barton P, Bryan S, Robinson S. Modelling in the economic evaluation of health care: selecting the appropriate approach. J Health Serv Res Policy. 2004. Apr;9(2):110–8. doi: 10.1258/135581904322987535 [DOI] [PubMed] [Google Scholar]
  • 51.Geneugelijk K, Wissing J, Koppenaal D, Niemann M, Spierings E. Computational Approaches to Facilitate Epitope-Based HLA Matching in Solid Organ Transplantation. J Immunol Res. 2017. Feb 12;2017:e9130879. doi: 10.1155/2017/9130879 [DOI] [PMC free article] [PubMed] [Google Scholar]
PLoS Comput Biol. doi: 10.1371/journal.pcbi.1009248.r001

Decision Letter 0

Mark Alber, Roeland MH Merks

1 Apr 2021

Dear Mr. Niemann,

Thank you very much for submitting your manuscript "Computational Eurotransplant Kidney Allocation simulations demonstrate the feasibility and benefit of T-cell epitope matching" for consideration at PLOS Computational Biology.

As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments.

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Roeland M.H. Merks, Ph.D

Associate Editor

PLOS Computational Biology

Mark Alber

Deputy Editor

PLOS Computational Biology

***********************

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: "First, a virtual waiting list was constructed by bootstrapping, using the Eurotransplant Annual Report 2015." You need to provide a great deal more information on how you performed your simulation, since all of your conclusions hinge on it. Since the Eurotransplant Annual Report provided no individual patient data, how did you 'bootstrap' a waitlist? Bootstrapping usually involves constructing random samples with replacement of a set of individual observations. How did you manufacture counterfactual patient histories? For example, suppose a patient had originally received a transplant in March, but your simulation did not give them a transplant until December (if at all). How do you know the patient is still alive? If you did not construct these histories, then it is a foregone conclusion that your approach would appear (in your simulations) to have better outcomes; patients who never received a transplant under your allocation system would be immortal. Note: please do not use Markov models to simulate patient histories, as patient medical histories completely violate the 'memoryless' assumption that Markov models depend on.

"Subsequently, for the non-HLA typing characteristics, the parameters country, urgency, recipient age, blood group,

percentage of PRA, and waiting time were extracted from the Eurotransplant Annual Report 2015 39 and assigned to the virtual waiting list population accordingly. Country, urgency and age were considered as independent parameters and thus assigned randomly, using the reported overall frequencies. Distributions for blood group, PRA, and waiting time were considered conditional to the virtual individuals’ country and thus assigned according to country-dependent frequencies. " This contradicts the above statement, and implies that you assigned random ages, blood groups, PRA percentages, and waiting times. How did you handle the inter-dependent factors? Women are more likely to be older, and they're more likely to be highly sensitized. Older patients are less likely to survive long periods of time on the waitlist. How does blood group relate to HLA? Generally speaking, it is not a good idea to consider two demographic or medical variables to be completely independent of each other.

"our simulations of the Eurotransplant Kidney Allocation System suggest an increasing absolute incidence of a functioning graft 10 years after transplantation by 1.1% to 1.5%. This absolute increase translates into a relative improvement of 12.9% to 13.5% bearing in mind the spread in graft survival at 10 years between low and high scores being 8% to 12%"

You do not describe how you estimated this survival improvement, although you imply it's based solely on matching. Kidney and patient survival is affected by a great deal more than just antigen and epitope matching. Donor and recipient demographics (especially age) comorbidities and other case mix factors all have substantial impact on patient and graft survival. Any statement that a new allocation system would improve survival needs to do more than just look at matching. Does epitope matching affect racial allocation? If so, then changing the allocation may be affecting disparities in racial access to transplantation, and thus survival. Similarly, if patients had to wait longer for kidneys, then the increased dialysis time is likely to reduce post-transplant survival.

"We first performed an allocation in triplicate using the unmodified ETKAS procedure as described in the Eurotransplant ETKAS Manual fig 7." Your statement that you used an unmodified ETKAS allocation system is incorrect. You omitted the ETKAS allocation rules for highly-sensitized candidates. Why? This is an important group that would likely be strongly impacted by changes in matching allocation rules.

Would your allocation system affect the blood-type distribution of recipients? O-type recipients are already disadvantaged; would your system exacerbate this?

Did your allocation system use all the kidneys, or were there changes in whether some of the marginal kidneys were used or discarded?

Your simulation references are fairly incomplete. There has been a fair amount of work done in the past twenty years to develop adequate organ allocation simulations. Please review more of the literature. Some of the American work done by the SRTR might be helpful.

Reviewer #2: Thank you for your very interesting and promising paper. In its current presentation, the result section is quite difficult to read and to understand. Reading the results section before the methods section make the results and their relevance very difficult to understand indeed. This make you paper falsely looking more a technical report than a scientific one.

If one consider the title, your are supposed to demonstrate the feasibility and the benefit of integrating the T-Cell epitope matching within ETKAS.

1) For this purpose, do you think it is really necessary to have results for 8 allocations models including 6 simulated ones ? What does PROCARE add to the demonstration ? Of course ETKAS is required but I suggest you to select the minimum of simulations required to the demonstration. You could explain you had a stepwise approach whose results are provided as supplementary material.

2) Gaining place, you could then explain more the evaluation metrics you are using, especially in terms of the feasibility and benefit you are supposed to demonstrate. What are metrics to challenge the realism of the simulation (data generation, process, allocation scheme). What are the metrics used to validate the feasibility and those for the benefit.

3) I suggest also you to include ETKAS, Substituting HLA matching by PIRCHE-II based matching, Full HLA match prioritization, HLA match grade replacements and HLA mismatch probability sub-sections before the presentation of the results which are quite incomprehensible without.

4) Anyway, it would be better to have the Material and Methods before the results but I guess this is possible for PLOS computational biology. This section should also separate more clearly what is related to data generation, process simulation (MCMC) and allocation scheme simulation which are the three pillars of you entire "simulation" work.

5) The introduction is clear, maybe should you end with what can be expected in terms of feasibility and benefit for ETKAS. It could also starts with the fact that we are in the context of Kidney transplantation.

6) Of note, some of bibliographical references in the text goes to strange references according to the statement in the text and the paper it refers to. Could you check this.

7) The discussion is also very interesting. I suggest you state as an underlying but very reasonable hypothesis that epitope matching is better than actual serological matching. I found pretty smart the way you generated Ab in the recipients (forbidden antigens). But for many immunologists it looks that the number of eplets related to an epitope might be misleading. What matters is the 3D conformation of HLA molecule. To avoid the apparition of de novo DSA after KTx is according to epitope mismatch is the real objective, that needs a prospective evaluation. In the introduction, you state that "recent studies have shown that predicted donor-HLA epitopes presented on HAL class-II molecules ... are related to HLA antibody formation. I suggest you add the references to theses studies and move this point in the discussion. Any future works ? What about reproducibility of in silico experimentations in other countries ?

**********

Have all data underlying the figures and results presented in the manuscript been provided?

Large-scale datasets should be made available via a public repository as described in the PLOS Computational Biology data availability policy, and numerical data that underlies graphs or summary statistics should be provided in spreadsheet form as supporting information.

Reviewer #1: Yes

Reviewer #2: Yes

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1009248.r003

Decision Letter 1

Mark Alber, Roeland MH Merks

19 Jun 2021

Dear Mr. Niemann,

Thank you very much for submitting your manuscript "Computational Eurotransplant Kidney Allocation simulations demonstrate the feasibility and benefit of T-cell epitope matching" for consideration at PLOS Computational Biology. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. The reviewers appreciated the attention to an important topic. Based on the reviews, we are likely to accept this manuscript for publication, providing that you modify the manuscript according to the review recommendations.

Please prepare and submit your revised manuscript within 30 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to all review comments, and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Thank you again for your submission to our journal. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Roeland M.H. Merks, Ph.D

Associate Editor

PLOS Computational Biology

Mark Alber

Deputy Editor

PLOS Computational Biology

***********************

A link appears below if there are any accompanying review attachments. If you believe any reviews to be missing, please contact ploscompbiol@plos.org immediately:

[LINK]

Reviewer's Responses to Questions

Comments to the Authors:

Please note here if the review is uploaded as an attachment.

Reviewer #1: Thank you for further explaining your simulation methods and addressing my previous comments.

You said that "We think it is not to be expected that epitope matching is more prone to “racial allocation”

than plain serologic matching."

Let me explain what I meant. The population on the waitlist is not necessarily racially distributed similarly to those of a marrow donor program. We know that the risk of kidney disease is not equal across races, and that race is linked with haplotype, blood group, and patient survival among kidney disease patients. While all of these may impact the validity of your simulation, what I was referring to was the idea that changes in the allocation system that are related to haplotype distribution may affect the racial distribution of the recipients. I realize you don't have the ability to describe this with your data, but you should mention it as a possibility that should be investigated, unless there's something I'm not understanding.

Reviewer #2: Thank you for the revised version which is really improved. Some minor changes could be added. (1) maybe a reference for Gibbs sampler. (2) I see that DQA is not taken into account. This might be a future work as epitopes for Ab anti DQ are often located on a common zone of alpha and beta chain. DQB matching only might no be ideal or its relevance could be challenged, even at epitaphic level. (3) PIRCHE-II RP : RP acronym = ? (4) In the evaluation metrics section, you could just state for the reader that low SWML score means better matching or not. In the discussion: iI suggest you to replace "there may be additional factors that affect the simulation outcomes" with "there may be additional factors that affect the realism of simulation results". (5) "Transplantable" and "Not Transplantable" could be replaced by "Active" and "Inactive" status.

**********

Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No: Not easily applicable but sharing simulations coding files to make in silico experimentations reproductible by other research teams could be very interesting.

**********

PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Christian Jacquelinet

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example in PLOS Biology see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

References:

Review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript.

If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1009248.r005

Decision Letter 2

Mark Alber, Roeland MH Merks

5 Jul 2021

Dear Mr. Niemann,

We are pleased to inform you that your manuscript 'Computational Eurotransplant Kidney Allocation simulations demonstrate the feasibility and benefit of T-cell epitope matching' has been provisionally accepted for publication in PLOS Computational Biology.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. 

Best regards,

Roeland M.H. Merks, Ph.D

Associate Editor

PLOS Computational Biology

Mark Alber

Deputy Editor

PLOS Computational Biology

***********************************************************

PLoS Comput Biol. doi: 10.1371/journal.pcbi.1009248.r006

Acceptance letter

Mark Alber, Roeland MH Merks

20 Jul 2021

PCOMPBIOL-D-20-02268R2

Computational Eurotransplant kidney allocation simulations demonstrate the feasibility and benefit of T-cell epitope matching

Dear Dr Niemann,

I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript.

Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work!

With kind regards,

Katalin Szabo

PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Text. Evaluation of ETKASPIR-A—ETKASPIR-D.

    (DOCX)

    Attachment

    Submitted filename: Point by point reply.docx

    Attachment

    Submitted filename: Point by point reply rev 2.docx

    Data Availability Statement

    The results are based upon are publicly accessible datasets. The respective repositories are are referred to in the applied research protocol: dx.doi.org/10.17504/protocols.io.bqrtmv6n.


    Articles from PLoS Computational Biology are provided here courtesy of PLOS

    RESOURCES