Abstract
Background
Individualized prediction of survival after liver transplantation (LT) for patients with hepatitis B virus-related acute-on-chronic liver failure (HBV-ACLF) has not been well investigated. This study aimed to develop a prognostic nomogram for patients with HBV-ACLF undergoing LT.
Methods
The nomogram was derived from a retrospective study of 290 patients who underwent LT for HBV-ACLF at the Third Affiliated Hospital of Sun Yat-sen University between January 2012 and December 2017. Concordance index and determiner calibration curve was used to ascertain the predictive accuracy and discriminative ability of the nomogram. The predictive performance of the nomogram was compared with that of Child-Pugh score, model for end-stage liver disease (MELD), MELD-Na, chronic liver failure Consortium Organ Failure score (CLIF-C OFs), and CLIF-C ACLF.
Results
The 1-year mortality rate was 23.1% (67/290). The Cox multivariate analysis showed that risk factors for 1-year survival rate included white blood cell count, alanine aminotransferase/aspartate aminotransferase ratio, and the organ failure numbers. The determiner calibration curve showed good agreement between prediction of the nomogram and actual observation. The concordance index of the nomogram for predicting 1-year survival was 0.707, which was significantly higher than that of other prognostic models: Child-Pugh score (0.626), MELD (0.627), MELD-Na (0.583), CLIF-C OF (0.674), and comparable to that of CLIF-C ACLF (0.684).
Conclusions
Our study developed a novel nomogram that could accurately predict individualized post-transplantation survival in patients with HBV-ACLF. The nomogram might be a useful tool for identifying HBV-ACLF patients who would benefit from LT.
Keywords: Acute-on-chronic liver failure (ACLF), liver transplantation (LT), hepatitis B virus (HBV), nomogram
Introduction
Acute-on-chronic liver failure (ACLF) is a complex syndrome characterized by severe jaundice, encephalopathy, and coagulative disorders. The 4-week mortality rate among patients with ACLF ranges from 29.6–73.0% depending on severity and grade (1-3). The clinical management of ACLF currently focuses on multiorgan-supportive care and treatment of complications.
For ACLF patients who do not recover spontaneously and experience worsening of the disease, liver transplantation (LT) is the only definite treatment with a good outcome. It has been reported that ACLF patients who receive LT have a 1-year survival rate of approximately 80% (2,4,5). However, most studies published to date have been retrospective with a limited sample size. Despite the significant improvements in patient and graft survival over time, the clinical application of LT in ACLF is hampered by the concern that it may be futile for patients with multiple organ failure (4,6). Thus, more practical algorithms are required to assess individual mortality risk (7).
Currently, the prognosis of patients with ACLF undergoing LT cannot be accurately predicted. Several scoring systems have been developed to predict post-transplant outcomes including the Survival Outcomes Following Liver Transplant score (SOFT) (8), Donor age × recipient Model for End-stage Liver Disease score (D-MELD) (9), and University of California Los Angeles score (UCLA) (6); however, the prognostic values of these models have not been sufficiently validated in the context of LT for hepatitis B virus (HBV)-related ACLF patients. In the prediction of waiting list mortality, conventional models such as the MELD score, MELD-Na score, and Child-Pugh score (CPS) have shown unsatisfactory predictive ability due to their neglect of the systemic inflammatory status of ACLF patients (10). Thus, it remains difficult to evaluate the individual specific prognosis of HBV-ACLF patients who undergo LT, or to offer advice to severe patients on whether they are suitable for LT.
Nomograms are graphical depictions of complex predictive statistical models for individual patients (11). With user friendly digital interface and increased accuracy, the use of nomograms aids patients and physicians in clinical decision-making. Nomograms have also been proven to be reliable prognostic tools for predicting waiting list mortality in cirrhotic LT candidates (12), as well as survival in decompensated cirrhotic patients without ACLF (13). However, nomograms for HBV-ACLF patients undergoing LT have rarely been reported. Therefore, this study aimed to develop a nomogram to investigate mortality risk in patients with HBV-ACLF undergoing LT based on preoperative baseline variables, and to compare its predictive ability with that of other prognostic models.
We present the following article in accordance with the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) Checklist (available at http://dx.doi.org/10.21037/atm-20-6180).
Methods
The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013). The study was approved by institutional ethics committee of The Third Affiliated Hospital of Sun Yat-Sen University (No. 2018-353-02), and individual consent for this retrospective analysis was waived. The study outcomes will not affect the future management of the patients. All patient data were obtained from the medical record system of The Third Affiliated Hospital of Sun Yat-Sen University and have been secured.
Study design and population
Medical records were reviewed retrospectively to identify patients with HBV-ACLF who underwent LT at the Liver Transplantation Center of the Third Affiliated Hospital of Sun Yat-Sen University from January 2012 to December 2017. The diagnosis of ACLF corresponded to the 2009 consensus recommendations of the Asian Pacific Association for the Study of the Liver (APASL) (14). All adult patients who underwent LT for the treatment of HBV-ACLF were included in the study. The patients were divided into 2 subgroups according to the European Association for the Study of the Liver (EASL)-ACLF criteria (2). Pre-transplant evaluation included chest/abdominal computed tomography (CT) scans, a cardiopulmonary evaluation, and cancer screening to assess the hepatic vasculature and exclude extrahepatic malignancies. Patients listed with non-HBV hepatitis, multiple organ transplantation, retransplantation, or cancer were excluded, as were those under the age of 18 years old. The outcomes of each patient were recorded as survival or death.
Before LT, all patients received standard-of-care treatment according to the APASL consensus recommendations (14). A similar triple immunosuppressive regimen including corticosteroids, tacrolimus, and mycophenolate mofetil was administered to all patients. Patients with pre-transplant renal failure received basiliximab as induction therapy. Prophylaxis for HBV reactivation following LT was based on a combination of hepatitis B immune globulin and antiviral therapy. No patients were lost to follow-up (15).
Data collection
Clinical characteristics, laboratory measurements [e.g., aspartate aminotransferase (AST), alanine aminotransferase (ALT), prothrombin activity (PTA), international normalized ratio (INR), total bilirubin (TB), albumin (ALB), and creatinine (Cr)], HBV-DNA levels, and other clinical information of recruited patients were collected from hospital electronic records within the week before transplantation. Organ failure (OF) was determined based on the chronic liver failure Consortium (CLIF-C) OF scoring system at the time of LT (16). Those with failure of 5 or 6 organs were combined into 1 group, as they constituted a relatively small sample size. The CPS, MELD, MELD-Na, CLIF-C OFs, and CLIF-C ACLF scores were calculated as previously described (16).
Statistical analysis
Data analyses were performed with SPSS version 23.0 for Windows (IBM Corp., Chicago, IL, USA) and R software version 3.4.4 (Institute for Statistics and Mathematics, Vienna, VIC, Austria). Survival analysis was performed using MedCalc version 17.9.7 (MedCalc Software, Ostend, Belgium). The optimal cut-off values for total points calculated with nomogram were determined using X tile software version 3.6.1 (Yale University, New Haven, CT, USA). Normally distributed variables were expressed as mean ± standard deviation and compared using the Student’s t-test; other quantitative variables were described as median [25–75% interquartile range (IQR)] and compared using the Mann-Whitney U test. Categorical variables were expressed as frequencies and percentages, and were compared using the χ2 test.
Univariate analysis and multivariate Cox proportional hazards models were performed to identify significant variables associated with 1-year survival. Hazard ratios (HR) and 95% confidence intervals (CI) were calculated. A two-tailed P value of <0.05 was considered to be statistically significant. Kaplan-Meier analysis was used to perform survival analysis among subgroups, and the differences were tested with a log-rank test.
The nomogram was established based on the results of multivariate Cox proportional hazards analysis using R software. The performance of the nomogram was evaluated by Harrell’s concordance index (C-index) and determiner calibration plots. Comparisons between nomogram-predicted and observed Kaplan-Meier estimates of survival probability were performed, and 1000 bootstrap resamples were applied. Comparisons between C-indices of the nomogram, CPS, MELD score, MELD-Na, CLIF-C OFs, and CLIF-C ACLF were performed using the R package ‘survIDINRI’ (17). Also, an online version of the nomogram was developed using the R package ‘DynNom’.
Results
Baseline characteristics of patients with HBV-ACLF undergoing LT
After the exclusion of patients who did not meet the inclusion criteria, 290 patients with HBV-ACLF who underwent LT were enrolled from 664 patients initially screened (Figure 1). The median follow-up time was 21.5 months (IQR, 8.0–42.3 months). The patients had a median pre-transplant MELD score of 35.0 (IQR, 29.0–41.0, Table 1). The cohort was predominantly male and had a high rate of ascites. Liver and coagulation failure were the most common types of organ failure among participants (74.8% and 60.7%, respectively). Patients with failure of 3 or more organs accounted for 35.5% of the cohort. The 90-day and 1-year post-LT mortality was 21.0% and 23.1%, respectively (Table S1). Most deaths occurred during the 28-day and 90-day periods following LT. On the basis of the EASL-ACLF criteria, 218 (75.2%) patients were diagnosed with ACLF. “Non-ACLF” was used to refer to patients who had ACLF according to the APASL criteria but not according to the EASL-CLIF criteria. Most patients were classified as ACLF grade 2 (100/218) or 3 (103/218). The organ failure distribution in the ACLF group was similar to that of the entire cohort, with liver and coagulation failure as the most common types of failure (91.3% and 78.0%, respectively). White blood cells (WBC), NLR, PTA, ALT, AST, TBIL, and creatinine were significantly worse in the ACLF group. Patients who met the EASL-ACLF criteria also had significantly higher MELD, MELD-Na, CPS, CLIF-C OFs, and CLIF-C ACLF scores than those who did not. The 90-day and 1-year mortality rates in the ACLF group were significantly higher than those in the non-ACLF group (24.8% vs. 9.7%, P<0.05; 27.1% vs. 11.1%, P<0.05, respectively). Patients with ACLF grade 3 also had a poorer prognosis than those with ACLF grade 1 or 2.
Table 1. Baseline characteristics of HBV-ACLF patients undergoing liver transplantation.
Variables | Total | Non-ACLF† | EASL-ACLF | P value |
---|---|---|---|---|
Male | 274 (94.5%) | 69 (95.8%) | 205 (94.0%) | 0.097 |
Age (year) | 44.88±9.90 | 46.94±10.34 | 44.19±9.68 | 0.041 |
Laboratory parameters | ||||
HGB (g/L) | 95.0 (81.0–119.0) | 90.5 (80.0–117.8) | 97.5 (81.0–120.0) | 0.233 |
WBC (109/L) | 6.1 (4.0–9.5) | 3.8 (2.4–4.9) | 7.2 (4.8–10.5) | 0.000 |
NLR | 4.4 (2.7–7.7) | 3.1 (2.1–4.8) | 5.1 (3.1–8.6) | 0.000 |
PTA (%) | 25.0 (18.00–35.3) | 46.5 (33.0–56.8) | 21.0 (17.0–28.0) | 0.000 |
PLT (109/L) | 64.0 (42.0–101.5) | 57.0 (37.0–102.3) | 64.0 (44.0–102.0) | 0.292 |
INR | 2.8 (2.0–4.0) | 1.7 (1.3–2.2) | 3.3 (2.6–4.3) | 0.000 |
ALT (IU/L) | 56.0 (26.8–129.5) | 30.0 (21.0–53.8) | 73.0 (32.0–225.5) | 0.000 |
AST (IU/L) | 91.0 (50.0–160.0) | 50.5 (34.0–76.0) | 105.5 (62.5–180.0) | 0.000 |
ALT/AST ratio | 1.6 (0.9–2.3) | 1.6 (1.3–2.2) | 1.62 (0.79–2.37) | 0.199 |
ALB (g/L) | 35.58±4.29 | 35.09±4.68 | 35.74±4.15 | 0.268 |
TBIL (μmol/L) | 463.9 (212.7–630.4) | 89.8 (36.2–221.5) | 515.0 (359.2–660.8) | 0.000 |
GGT (IU/L) | 40.5 (25.8–71.3) | 35.0 (20.0–79.8) | 43.5 (28.0–70.3) | 0.062 |
Na (mmol/L) | 137.0 (133.4–140.8) | 136.8 (133.1–141.0) | 137.0 (133.5–140.7) | 0.753 |
Creatinine (μmol/L) | 75.0 (60.0–108.5) | 70.0 (59.0–90.8) | 76.0 (61.0–125.3) | 0.028 |
BUN (mg/dL) | 5.0 (3.5–9.1) | 4.7 (3.8–7.1) | 5.4 (3.2–9.4) | 0.543 |
HBV-DNA level | 0.000 | |||
≤200 | 132 (45.5%) | 53 (73.6%) | 79 (36.2%) | |
200–2×104 | 65 (22.4%) | 9 (12.5%) | 56 (25.7%) | |
2×104–2×106 | 48 (16.6%) | 5 (6.9%) | 43 (19.7%) | |
≥2×106 | 45 (15.5%) | 5 (6.9%) | 40 (18.3%) | |
Ascites | 205 (70.7%) | 43 (59.7%) | 162 (74.3%) | 0.157 |
Prognostic scores | ||||
MELD | 35.0 (29.0–41.0) | 22.0 (15.3–29.0) | 38.0 (33.0–43.0) | 0.000 |
MELD-Na | 32.6 (21.4–41.7) | 20.4 (6.9–31.7) | 35.3 (26.6–43.6) | 0.000 |
Child-Pugh score | 11.0 (10.0–12.0) | 10.0 (9.0–11.0) | 12.0 (11.0–13.0) | 0.000 |
CLIF-C OFs | 11.0 (9.0–12.0) | 7.0 (6.0–9.0) | 12.0 (10.0–13.0) | 0.000 |
CLIF-C ACLF | 36.8 (30.8–41.5) | 24.0 (20.8–29.8) | 40.1 (34.2–44.0) | 0.000 |
Number of OF | 0.000 | |||
0 | 44 (15.2%) | 44 (61.1%) | 0 | |
1 | 43 (14.8%) | 28 (38.9%) | 15 (6.9%) | |
2 | 100 (34.5%) | 0 | 100 (45.9%) | |
3 | 56 (19.3%) | 0 | 56 (25.7%) | |
4 | 19 (6.6%) | 0 | 19 (8.7%) | |
5–6 | 28 (9.6%) | 0 | 28 (12.8%) | |
Type of OF | ||||
Liver | 217 (74.8%) | 18 (25.0%) | 199 (91.3%) | 0.000 |
Lung | 85 (29.3%) | 3 (4.2%) | 82 (37.6%) | 0.000 |
Renal | 71 (24.5%) | 0 | 71 (32.6%) | 0.000 |
Brain | 68 (23.4%) | 1 (1.4%) | 67 (30.7%) | 0.000 |
Coagulation | 176 (60.7%) | 6 (8.3%) | 170 (78.0%) | 0.000 |
Cardiovascular | 15 (5.2%) | 0 | 15 (6.9%) | 0.000 |
P values <0.05 represent statistical significance. Where applicable, data are presented as n (%), median (interquartile range) or mean ± standard deviation. †, non-ACLF indicates patients satisfying the APASL ACLF criteria but not the EASL criteria. ALT/AST ratio, ALT to AST ratio; ACLF, acute-on-chronic liver failure; ALB, albumin; ALT, alanine transaminase; AST, Aspartate transaminase; BUN, blood urea nitrogen; CLIF-C OF, chronic liver failure Consortium Organ Failure score; EASL, European Association for the Study of the Liver; GGT, gamma-glutamyl transpeptidase; HBV, hepatitis B virus; HGB, hemoglobin; INR, international normalized ratio; MELD, model for end stage liver disease; NLR, neutrophil-to-lymphocyte ratio; OF, organ failure; PTA, prothrombin activity; PLT, platelet; TBIL, total bilirubin; WBC, white blood cell.
Risk factors for predicting 1-year post-transplant mortality
Baseline clinical and laboratory parameters for the prediction of 1-year post-LT mortality was investigated using a univariate Cox analysis regression model. The univariate analysis indicated that among the 20 studied factors, WBC (HR 1.05, P<0.001), NLR (HR 1.045, P=0.008), ALT/AST ratio (HR 1.078, P=0.033), creatinine (HR 1.002, P=0.001), HBV-DNA (HR 1.318, P=0.008), liver failure (HR 2.083, P=0.032), lung failure (HR 3.237, P<0.001), renal failure (HR 2.483, P<0.001), brain failure (HR 3.134, P<0.001), cardiovascular failure (HR 4.882, P<0.001), and the organ failure numbers (HR 1.552, P<0.001) were significantly associated with 1-year mortality (Table 2). Then, the 11 significant factors above were entered into the multivariate Cox proportional hazards model, which indicated that WBC (HR 1.050, 95% CI: 1.002–1.101, P=0.041), ALT/AST ratio (HR 1.095, 95% CI: 1.031–1.163, P=0.003), and the organ failure numbers (HR 1.470, 95% CI: 1.234–1.750, P<0.001) were statistically associated with the 1-year mortality of participants. Participants were stratified by the organ failure numbers, and their post-LT survival was examined (Table S2). An ascending trend in mortality risk was observed for patients with a higher number organs with failure; those with 5–6 failing organs had the highest 1-year post-LT mortality rate (62.29%), which was approximately 2–4 times the mortality rate of other subgroups. Also, to analyze the role of OF in post-LT mortality, patients were divided by the type of OF (Figure S1, Table S3). Patients with cardiovascular (66.67%), brain (42.65%), and lung (41.18%) failure had higher 1-year mortality rates than those with other types of OF.
Table 2. Univariate and multivariate analysis of variables to predict the 1-year post-transplant survival of HBV-ACLF patients.
Variables | HR | 95% CI | P value | HR | 95% CI | P value |
---|---|---|---|---|---|---|
Age | 1.012 | 0.998–1.036 | 0.320 | |||
Sex | 1.442 | 0.580–3.586 | 0.431 | |||
HGB | 1.005 | 0.996–1.015 | 0.296 | |||
WBC | 1.091 | 1.052–1.131 | 0.000 | 1.050 | 1.002–1.101 | 0.041 |
NLR | 1.045 | 1.011–1.079 | 0.008 | 0.985 | 0.936–1.035 | 0.537 |
PTA | 0.992 | 0.979–1.006 | 0.270 | |||
PLT | 1.001 | 0.998–1.005 | 0.473 | |||
INR | 1.041 | 0.909–1.193 | 0.558 | |||
ALT | 1.000 | 0.999–1.001 | 0.946 | |||
AST | 1.000 | 0.999–1.001 | 0.490 | |||
ALT/AST ratio | 1.078 | 1.006–1.156 | 0.033 | 1.095 | 1.031–1.163 | 0.003 |
ALB | 0.980 | 0.926–1.036 | 0.471 | |||
TBIL | 1.001 | 1.000–1.002 | 0.052 | |||
GGT | 1.002 | 0.997–1.007 | 0.460 | |||
Crea | 1.002 | 1.001–1.004 | 0.001 | 1.002 | 1.000–1.005 | 0.074 |
ALB | 0.980 | 0.926–1.036 | 0.471 | |||
BUN | 1.021 | 0.995–1.047 | 0.112 | |||
HBV-DNA | 1.318 | 1.073–1.618 | 0.008 | 1.000 | 1.000–1.000 | 0.542 |
Ascites | 1.167 | 0.854–1.596 | 0.333 | |||
Number of OF | 1.552 | 1.330–1.811 | 0.000 | 1.470 | 1.234–1.750 | 0.000 |
Type of OF | ||||||
Liver | 2.083 | 1.064–4.079 | 0.032 | 1.664 | 0.494–5.585 | 0.410 |
Lung | 3.237 | 2.003–5.233 | 0.000 | 2.045 | 0.872–4.799 | 0.100 |
Renal | 2.483 | 1.528–4.037 | 0.000 | 0.866 | 0.337–2.224 | 0.766 |
Brain | 3.134 | 1.931–5.088 | 0.000 | 2.185 | 0.886–5.394 | 0.090 |
Coagulation | 1.189 | 0.721–1.958 | 0.498 | |||
Cardiovascular | 4.882 | 2.482–9.603 | 0.000 | 2.519 | 0.912–6.955 | 0.075 |
MELD† | 1.042 | 1.015–1.069 | 0.002 | |||
MELD-Na† | 1.020 | 1.003–1.038 | 0.022 | |||
Child-Pugh score† | 1.327 | 1.108–1.591 | 0.002 | |||
CLIF-C OF† | 1.313 | 1.179–1.462 | 0.000 | |||
CLIF-C ACLF† | 1.086 | 1.052–1.121 | 0.000 |
P values <0.05 represent statistical significance. †, the algorithms calculated on baseline serum parameters were not included in the multivariable Cox proportional hazard regression analysis. ACLF, acute-on-chronic liver failure; ALB, albumin; ALT, alanine transaminase; AST, aspartate transaminase; BUN, blood urea nitrogen; CI, confidence interval; CLIF-C OF, chronic liver failure Consortium Organ Failure score; EASL, European Association for the Study of the Liver; GGT, gamma-glutamyl transpeptidase; HBV, hepatitis B virus; HGB, hemoglobin; HR, hazard ratio; INR, international normalized ratio; MELD, model for end stage liver disease; NLR, neutrophil-to-lymphocyte ratio; OF, organ failure; PTA, prothrombin activity; PLT, platelet; TBIL, total bilirubin; WBC, white blood cell.
Prognostic nomogram for 28-day, 3-month, 6-month, and 1-year mortality
To predict the 28-day, 3-month, 6-month, and 1-year mortality of patients with HBV-ACLF who underwent LT, a prognostic nomogram was built based on the 3 significant independent factors derived from the multivariate Cox regression analysis (Figure 2). According to the point scale, each parameter within the nomogram was assigned a score that indicated a survival prognosis. The estimated individual probability of survival at each time point could be determined by summing up the points assigned to each variable.
Comparison of the predictive ability of our nomogram with that of other prognostic models for post-LT survival in patients satisfying the APASL criteria of HBV-ACLF
The determiner calibration curve showed an optimal agreement between prediction and actual observation in the probability of 28-day, 3-month, 6-month and 1-year survival in nomogram (Figure 3). Compared with 5 other prognostic models, the established nomogram displayed better predictive accuracy in predicting post-LT survival. The C-index of the nomogram (0.707) for predicting 1-year survival was significantly higher than those of the CPS (0.626, P=0.004), MELD score (0.627, P<0.001), MELD-Na (0.583, P<0.001), and CLIF-C OF (0.674, P=0.034). There was no significant difference regarding C-indices between the nomogram and CLIF-C ACLF (0.684, P=0.064). The C-indices of the nomogram also showed similar results in the prediction of 28-day (0.73), 3-month (0.722), and 6-month (0.708) survival compared with other models (Table 3). These results demonstrated that the nomogram had an advantage over other models as a predictor of post-LT survival in patients with HBV-ACLF.
Table 3. Comparison of predictive abilities of the nomogram, CPS, MELD, CLIF-C OFs, and CLIF-C ACLF in participants with HBV-ACLF who underwent liver transplantation.
28 days | 90 days | 6 months | 1 year | ||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
C-index (95%CI) | P value | C-index (95%CI) | P value | C-index (95%CI) | P value | C-index (95%CI) | P value | ||||
APASL-ACLF patients | |||||||||||
Nomogram | 0.73 (0.721–0.739) | 0.722 (0.715–0.729) | 0.708 (0.701–0.715) | 0.707 (0.7–0.714) | |||||||
CPS | 0.684 (0.675–0.693) | 0.048 | 0.643 (0.635–0.651) | 0.004 | 0.627 (0.619–0.635) | 0.006 | 0.626 (0.618–0.634) | 0.004 | |||
MELD | 0.66 (0.65–0.67) | 0.002 | 0.633 (0.625–0.641) | <0.001 | 0.626 (0.618–0.634) | <0.001 | 0.627 (0.619–0.635) | <0.001 | |||
MELD-Na | 0.593 (0.583–0.603) | <0.001 | 0.59 (0.581–0.599) | <0.001 | 0.58 (0.572–0.588) | <0.001 | 0.583 (0.575–0.591) | <0.001 | |||
CLIF-C OFs | 0.712 (0.703–0.721) | 0.030 | 0.684 (0.676–0.692) | 0.024 | 0.677 (0.669–0.685) | 0.044 | 0.674 (0.666–0.682) | 0.034 | |||
CLIF-C ACLF | 0.727 (0.718–0.736) | 0.062 | 0.697 (0.689–0.705) | 0.056 | 0.687 (0.679–0.695) | 0.070 | 0.684 (0.676–0.692) | 0.064 | |||
EASL-ACLF patients | |||||||||||
Nomogram | 0.712 (0.703–0.721) | 0.708 (0.7–0.716) | 0.697 (0.689–0.705) | 0.692 (0.684–0.7) | |||||||
CPS | 0.674 (0.665–0.683) | 0.162 | 0.633 (0.625–0.641) | 0.028 | 0.62 (0.612–0.628) | 0.032 | 0.617 (0.609–0.625) | 0.030 | |||
MELD | 0.63 (0.62–0.64) | 0.008 | 0.604 (0.595–0.613) | 0.002 | 0.601 (0.592–0.61) | 0.002 | 0.598 (0.589–0.607) | 0.002 | |||
MELD-Na | 0.565 (0.555–0.575) | 0.006 | 0.573 (0.564–0.582) | 0.006 | 0.565 (0.556–0.574) | 0.006 | 0.566 (0.557–0.575) | 0.006 | |||
CLIF-C OFs | 0.687 (0.677–0.697) | 0.064 | 0.67 (0.661–0.679) | 0.068 | 0.664 (0.655–0.673) | 0.080 | 0.658 (0.649–0.667) | 0.072 | |||
CLIF-C ACLF | 0.709 (0.699–0.719) | 0.100 | 0.689 (0.68–0.698) | 0.124 | 0.682 (0.673–0.691) | 0.174 | 0.674 (0.665–0.683) | 0.142 |
ACLF, acute-on-chronic liver failure; APASL, Asian Pacific Association for the Study of the Liver; CI, confidence interval; CLIF-C OF, Chronic Liver Failure Consortium Organ Failure score; CPS, Child-Pugh score; EASL, European Association for the Study of the Liver; HBV, hepatitis B virus; MELD, model for end-stage liver disease. Bold values represent statistical significance. P-value for comparison between the C-index of the nomogram and the other prognostic models from the integrated discrimination improvement (IDI) statistics test.
Validation of the nomogram in patients satisfying the EASL criteria of HBV-ACLF
Since the majority (75.2%) of the patients satisfied the EASL criteria for ACLF, these patients were used to investigate the prognostic discrimination ability of the nomogram. The C-index of the nomogram (0.692) was significantly higher than those of CPS (0.617, 95% CI: 0.680–0.739, P=0.030), MELD (0.598, 95% CI: 0.589–0.607, P=0.002), and MELD-Na (0.566, 95% CI: 0.557–0.575, P=0.006) in predicting post-LT 1-year survival (Table 3). The C-index of the nomogram was also superior to those of CLIF-C OF (0.658, P=0.072) and CLIF-C ACLF (0.674, P=0.142), albeit not significantly. Similar results were observed in the prediction of 28-day, 3-month, and 6-month survival. These results suggested that the nomogram was useful for predicting post-LT survival in patients who satisfied the EASL criteria for HBV-ACLF.
Predictive performance of the nomogram in stratifying risk among patients
In order to analyze the discriminative ability of the nomogram, participants were grouped into 3 different subgroups according to cutoff values of total points (Figure S2). The Kaplan-Meier curves for each group were plotted, representing a discrepant prognosis (Figure 4). The nomogram accurately stratified patients into 3 distinct prognostic subgroups (1-year post-LT survival rate of 64.86%, 24.81%, and 8.87%, respectively; log-rank P<0.001).
Development of an online calculator for our nomogram
To support its application in clinical practice, we developed an online version of our nomogram. Clinicians can access the nomogram (at https://hbv-aclf-nomogram.shinyapps.io/dynnomapp/) and input clinical features to obtain instant prognostic survival curves generated by the webserver.
Discussion
To the best of our knowledge, this is the first large sample study to describe the development and validation of a prognostic nomogram for predicting post-LT survival in patients with HBV-ACLF. Its C-index was greater than those of the conventional prognostic models and was comparable to that of CLIF-C ACLF. The nomogram could be implemented to assist physicians to carry out individualized survival prediction and identify patients who are potentially unsuitable for LT.
The predictive accuracy of the nomogram for post-LT survival can be explained by the factors included in the model. A high level of WBC is a simple and evident indicator of systemic inflammation (16) that is constantly neglected by traditional prognostic scores. In accordance with previous studies (2,18,19), our study found that higher a WBC count was associated with more severe complications and a higher ACLF grade. With more extrahepatic organ involvement and oxidative stress, patients with HBV-ACLF are more prone to developing systemic inflammatory response syndrome (SIRS) than those with hepatitis due to other causes (20). An increased WBC count and excessive production of proinflammatory cytokines then induce tissue damage in both the liver and remote organs (21,22), leading to a higher rate of organ failure and mortality. Thus, incorporation of WBC count into the nomogram added prognostic weight.
Interestingly, our findings revealed that the preoperative ALT/AST ratio was associated with the outcomes of patients with HBV-ACLF who underwent LT. The ALT/AST ratio is not only a marker of liver fibrosis and cirrhosis, but it also provides prognostic information (23,24). Our study found that the ALT/AST ratio was a significant risk factor for prognosis in univariate and multivariate analyses. A previous study suggested that a high ALT/AST ratio may reflect the time course of acute viral hepatitis and indicate a poor prognosis (25). The elevated ALT/AST ratio could be partly explained by increased mitochondrial release of AST during the acute phase of ACLF. However, whether the predictive value of the ALT/AST ratio depends on etiology requires more validation in independent datasets.
In spite of improvements in medical management, patients with ACLF frequently develop multi-organ failure and have poor short-term outcomes. To date, an effective method of predicting post-LT survival in patients with HBV-ACLF has not been described. The CLIF-C ACLF was derived from Western populations in which alcoholic ACLF and HCV-related ACLF are predominant; thus, it represents an accurate prognostic tool for ACLF patients. This study showed that preoperative CLIF-C ACLF also had good predictive accuracy for post-LT survival in patients with HBV-ACLF, which was similar to that of the nomogram. Consistent with previous studies (1,26), our results indicated that OF was significantly associated with the prognosis of patients with ACLF (Table S2). The organ failure numbers were found to make the greatest contribution to prognostic prediction in the nomogram, in which 15 points were gained for each organ with failure. In the subgroup of patients with failure of 4 organs, 1-year mortality did not increase accordingly, which could be explained by the inadequate sample size of this study.
It is noteworthy that for patients with failure of more than 3 organs, the CPS, MELD, and MELD-Na scores showed no significant differences, meaning these patients may not be given priority based on the current organ allocation system, even though they have a higher risk of mortality. Since patients with failure of 3 or more organs account for 18.4% of those who are listed for LT in the United Network for Organ Sharing (UNOS) (27), additional research is warranted to address the limitations of the system. Whether the MELD-based allocation policy should be aimed at the “sickest first” or at the “maximization of utility” remains controversial (10). Recent studies have indicated that under careful selection, patients with multiple organ failure or ACLF grade 3 could benefit from LT (26,27). However, the criteria for listing and ideal timing of LT for HBV-ACLF patients with multiple organ failure has not been fully elucidated (28). It would not only be medically but also ethically challenging for doctors to consider the option of LT for these patients. Meanwhile, the inclusion of the organ failure numbers in the nomogram implies that organ support and intensive monitoring are crucial for ACLF patients on the waiting list, because therapeutic strategies for bridging the patient to LT could potentially improve survival.
An increasing number of studies have suggested that the type of organ failure is also an important factor that may influence patient survival after transplantation (19). The need for mechanical ventilation, which is an indicator of respiratory failure, was found to be associated with reduced post-transplant survival (27,29). However, whether respiratory failure should be recognized as a contraindication for LT remains controversial and requires further elucidation. We found that patients with cardiovascular, brain, and lung failure had higher 1-year post-LT mortality than those with other types of organ failure, although these factors were not included in the nomogram. These results conform to previous findings and highlight the need for careful decision-making regarding transplantation for patients presenting with certain types of organ failure (30). However, analysis by Thuluvath et al. demonstrated that type of organ failure may have less bearing in determining post-transplant survival, which can be partly explained by discrepancy in the definition of respiratory failure (27).
Sundaram et al. found that patients who recovered from ACLF grade 3 at registration to ACLF 0–2 at transplantation had a significantly higher 1-year survival after transplantation than those who did not (30). Despite alterations in ACLF grade from registration to transplantation, the final ACLF grade at LT had a more decisive role in predicting survival. A longer duration of the final ACLF grade developed by the patient before transplantation may indicate poorer post-LT survival, although the relevant data did not show statistical significance. Our nomogram was derived from clinical features recorded within the 1 week before transplantation and did not include data from the time of waiting list registration. The predictive ability of the nomogram is more reflective of the final ACLF grade before LT than ACLF grade at registration. If patients with ACLF grade 3 at registration downgrade to ACLF grades 0–2 before LT, the nomogram score will be lower in line with the decreased organ failure numbers. These downgraded patients will have a better survival probability based on our nomogram.
Nomograms are regularly used pictorial tools to estimate prognosis and have been shown to be more accurate than traditional models in predicting individualized risk in ACLF and acute decompensation (13,31). This study constructed and internally validated a novel nomogram including WBC count, ALT/AST ratio, and the organ failure numbers. Our nomogram showed a better ability in predicting 3-month, 6-month, and 1-year mortality than CPS, MELD, MELD-Na, and CLIF-C OFs, with good discrimination and determiner calibration. With comparable predictive ability, the nomogram is easier-to-use than CLIF-C ACLF for the calculation of mortality risk, as it is presented as a visualized scale. The Technology Acceptance Model (TAM) score, which consists of arterial lactate level, mechanical ventilation, age, and leukocyte counts, was reported to have better predictive ability than CLIF-C ACLF in ACLF grade 3 patients’ post-LT outcomes (32). Due to the limitation of data availability, we were unable to compare this model with our nomogram in the HBV-ACLF patient cohort.
This study had several limitations. First, the patient cohort was derived from a single center. Thus, the nomogram is likely to have been influenced by clinical management and perioperative care made by that single center, and it requires multi-center validation in the future studies. Second, since ACLF is a highly dynamic disease process, data in this study were collected from a single preoperative time point instead of sequential time points because preoperative treatment may also lead to variation of related parameters. In addition, some important molecular factors (such as serum cytokine concentration) were lacking due to the retrospective nature of the study. Also, since the nomogram was derived from HBV-ACLF patients, it may not be applicable for ACLF patients with other etiologies such as hepatitis C virus (HCV) or alcoholic liver disease. Despite these limitations, our study had a large sample size with detailed information about patient characteristics and OF at the time of LT.
Conclusions
In conclusion, our study proposed a novel nomogram that could accurately predict individualized post-LT survival in patients with HBV-ACLF. The nomogram might be a useful tool for identifying HBV-ACLF patients who would benefit from LT. Additional studies are required to validate and refine the nomogram in other multi-center cohorts.
Supplementary
Acknowledgments
Funding: This work was supported by the grants from the National Key R&D Program of China (2017YFA0104304), National Natural Science Foundation of China (81770648, 81802402, 81870449, 81901943, 81900597, 81970567), National Key R&D Program of Guangdong Province (2019B020236003), Guangdong Natural Science Foundation (2017A030311034, 2018A03031032, 2018A030313043), Medical Scientific Research Foundation of Guangdong Province (A2018130), Sci-tech Research Development Program of Guangzhou City (158100076), and Academician Shusen Lanjuan Talent Foundation.
Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013). The study was approved by institutional ethics committee of The Third Affiliated Hospital of Sun Yat-Sen University (No. 2018-353-02), and individual consent for this retrospective analysis was waived. The study outcomes will not affect the future management of the patients. All patient data were obtained from the medical record system of The Third Affiliated Hospital of Sun Yat-Sen University and have been secured.
Footnotes
Reporting Checklist: The authors have completed the Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) Checklist. Available at http://dx.doi.org/10.21037/atm-20-6180
Data Sharing Statement: Available at http://dx.doi.org/10.21037/atm-20-6180
Peer Review File: Available at http://dx.doi.org/10.21037/atm-20-6180
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at http://dx.doi.org/10.21037/atm-20-6180). All authors report a pending patent “The Nomogram in Survival Prediction for Post-transplant HBV-ACLF Patients”.
References
- 1.Wu T, Li J, Shao L, et al. Development of diagnostic criteria and a prognostic score for hepatitis B virus-related acute-on-chronic liver failure. Gut 2018;67:2181-91. 10.1136/gutjnl-2017-314641 [DOI] [PubMed] [Google Scholar]
- 2.Moreau R, Jalan R, Gines P, et al. Acute-on-chronic liver failure is a distinct syndrome that develops in patients with acute decompensation of cirrhosis. Gastroenterology 2013;144:1426-37, 37.e1-9. [DOI] [PubMed]
- 3.Arroyo V, Moreau R, Jalan R, et al. Acute-on-chronic liver failure: A new syndrome that will re-classify cirrhosis. J Hepatol 2015;62:S131-43. 10.1016/j.jhep.2014.11.045 [DOI] [PubMed] [Google Scholar]
- 4.Gustot T, Fernandez J, Garcia E, et al. Clinical Course of acute-on-chronic liver failure syndrome and effects on prognosis. Hepatology 2015;62:243-52. 10.1002/hep.27849 [DOI] [PubMed] [Google Scholar]
- 5.Finkenstedt A, Nachbaur K, Zoller H, et al. Acute-on-chronic liver failure: excellent outcomes after liver transplantation but high mortality on the wait list. Liver Transpl 2013;19:879-86. 10.1002/lt.23678 [DOI] [PubMed] [Google Scholar]
- 6.Petrowsky H, Rana A, Kaldas FM, et al. Liver transplantation in highest acuity recipients: identifying factors to avoid futility. Ann Surg 2014;259:1186-94. 10.1097/SLA.0000000000000265 [DOI] [PubMed] [Google Scholar]
- 7.McPhail MJ, Auzinger G, Bernal W, et al. Decisions on futility in patients with cirrhosis and organ failure. Hepatology 2016;64:986. 10.1002/hep.28539 [DOI] [PubMed] [Google Scholar]
- 8.Rana A, Jie T, Porubsky M, et al. The survival outcomes following liver transplantation (SOFT) score: validation with contemporaneous data and stratification of high-risk cohorts. Clin Transplant 2013;27:627-32. 10.1111/ctr.12181 [DOI] [PubMed] [Google Scholar]
- 9.Halldorson JB, Bakthavatsalam R, Fix O, et al. D-MELD, a simple predictor of post liver transplant mortality for optimization of donor/recipient matching. Am J Transplant 2009;9:318-26. 10.1111/j.1600-6143.2008.02491.x [DOI] [PubMed] [Google Scholar]
- 10.Linecker M, Krones T, Berg T, et al. Potentially inappropriate liver transplantation in the era of the “sickest first” policy - A search for the upper limits. J Hepatol 2018;68:798-813. 10.1016/j.jhep.2017.11.008 [DOI] [PubMed] [Google Scholar]
- 11.Balachandran VP, Gonen M, Smith JJ, et al. Nomograms in oncology: more than meets the eye. The Lancet Oncology 2015;16:e173-80. 10.1016/S1470-2045(14)71116-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.van Vugt JLA, Alferink LJM, Buettner S, et al. A model including sarcopenia surpasses the MELD score in predicting waiting list mortality in cirrhotic liver transplant candidates: a competing risk analysis in a national cohort. J Hepatol 2018;68:707-14. 10.1016/j.jhep.2017.11.030 [DOI] [PubMed] [Google Scholar]
- 13.Cai YJ, Dong JJ, Dong JZ, et al. A nomogram for predicting prognostic value of inflammatory response biomarkers in decompensated cirrhotic patients without acute-on-chronic liver failure. Aliment Pharmacol Ther 2017;45:1413-26. 10.1111/apt.14046 [DOI] [PubMed] [Google Scholar]
- 14.Sarin SK, Kedarisetty CK, Abbas Z, et al. Acute-on-chronic liver failure: consensus recommendations of the Asian Pacific Association for the Study of the Liver (APASL) 2014. Hepatol Int 2014;8:453-71. 10.1007/s12072-014-9580-2 [DOI] [PubMed] [Google Scholar]
- 15.Carlson RV, Boyd KM, Webb DJ. The revision of the Declaration of Helsinki: past, present and future. Br J Clin Pharmacol 2004;57:695-713. 10.1111/j.1365-2125.2004.02103.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Jalan R, Saliba F, Pavesi M, et al. Development and validation of a prognostic score to predict mortality in patients with acute-on-chronic liver failure. J Hepatol 2014;61:1038-47. 10.1016/j.jhep.2014.06.012 [DOI] [PubMed] [Google Scholar]
- 17.Uno H, Tian L, Cai T, et al. A unified inference procedure for a class of measures to assess improvement in risk prediction systems with survival data. Stat Med 2013;32:2430-42. 10.1002/sim.5647 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Cordoba J, Ventura-Cots M, Simon-Talero M, et al. Characteristics, risk factors, and mortality of cirrhotic patients hospitalized for hepatic encephalopathy with and without acute-on-chronic liver failure (ACLF). J Hepatol 2014;60:275-81. 10.1016/j.jhep.2013.10.004 [DOI] [PubMed] [Google Scholar]
- 19.Shi Y, Yang Y, Hu Y, et al. Acute-on-chronic liver failure precipitated by hepatic injury is distinct from that precipitated by extrahepatic insults. Hepatology 2015;62:232-42. 10.1002/hep.27795 [DOI] [PubMed] [Google Scholar]
- 20.Choudhury A, Kumar M, Sharma BC, et al. Systemic inflammatory response syndrome in acute-on-chronic liver failure: Relevance of 'golden window': A prospective study. J Gastroenterol Hepatol 2017;32:1989-97. 10.1111/jgh.13799 [DOI] [PubMed] [Google Scholar]
- 21.Clària J, Arroyo V, Moreau R. The Acute-on-Chronic Liver Failure Syndrome, or When the Innate Immune System Goes Astray. J Immunol 2016;197:3755-61. 10.4049/jimmunol.1600818 [DOI] [PubMed] [Google Scholar]
- 22.Sarin SK, Choudhury A. Acute-on-chronic liver failure: terminology, mechanisms and management. Nat Rev Gastroenterol Hepatol 2016;13:131-49. 10.1038/nrgastro.2015.219 [DOI] [PubMed] [Google Scholar]
- 23.Angulo P, Keach JC, Batts KP, et al. Independent predictors of liver fibrosis in patients with nonalcoholic steatohepatitis. Hepatology 1999;30:1356-62. 10.1002/hep.510300604 [DOI] [PubMed] [Google Scholar]
- 24.Angulo P, Bugianesi E, Bjornsson ES, et al. Simple noninvasive systems predict long-term outcomes of patients with nonalcoholic fatty liver disease. Gastroenterology 2013;145:782-9.e4. 10.1053/j.gastro.2013.06.057 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Botros M, Sikaris KA. The de ritis ratio: the test of time. Clin Biochem Rev 2013;34:117-30. [PMC free article] [PubMed] [Google Scholar]
- 26.Artru F, Louvet A, Ruiz I, et al. Liver transplantation in the most severely ill cirrhotic patients: A multicenter study in acute-on-chronic liver failure grade 3. J Hepatol 2017;67:708-15. 10.1016/j.jhep.2017.06.009 [DOI] [PubMed] [Google Scholar]
- 27.Thuluvath PJ, Thuluvath AJ, Hanish S, et al. Liver transplantation in patients with multiple organ failures: Feasibility and outcomes. J Hepatol 2018;69:1047-56. 10.1016/j.jhep.2018.07.007 [DOI] [PubMed] [Google Scholar]
- 28.Gustot T, Moreau R. Acute-on-chronic liver failure vs. traditional acute decompensation of cirrhosis. J Hepatol 2018;69:1384-93. 10.1016/j.jhep.2018.08.024 [DOI] [PubMed] [Google Scholar]
- 29.Sundaram V, Jalan R, Wu T, et al. Factors Associated with Survival of Patients With Severe Acute-On-Chronic Liver Failure Before and After Liver Transplantation. Gastroenterology 2019;156:1381-91.e3. 10.1053/j.gastro.2018.12.007 [DOI] [PubMed] [Google Scholar]
- 30.Sundaram V, Kogachi S, Wong RJ, et al. Effect of the clinical course of acute-on-chronic liver failure prior to liver transplantation on post-transplant survival. J Hepatol 2020;72:481-8. 10.1016/j.jhep.2019.10.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Shi KQ, Cai YJ, Lin Z, et al. Development and validation of a prognostic nomogram for acute-on-chronic hepatitis B liver failure. J Gastroenterol Hepatol 2017;32:497-505. 10.1111/jgh.13502 [DOI] [PubMed] [Google Scholar]
- 32.Artzner T, Michard B, Weiss E, et al. Liver transplantation for critically ill cirrhotic patients: Stratifying utility based on pretransplant factors. Am J Transplant 2020;20:2437-48. 10.1111/ajt.15852 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.