ABSTRACT
Background
Although the kidney failure risk equation (KFRE), a well-known predictive model for predicting dialysis dependency, is useful, it remains unclear whether the addition of biomarker changes to the KFRE model in patients with an estimated glomerular filtration rate (eGFR) <30 ml/min/1.73 m2 will improve its predictive value.
Methods
We retrospectively identified adults with eGFR <30 ml/min/1.73 m2 without dialysis dependency, and available health checkup data for two successive years using a large Japanese claims database (DeSC, Tokyo, Japan). We dichotomized the entire population into a training set (50%) and a validation set (the other half). To assess the incremental value in the predictive ability for dialysis dependency by the addition of changes in eGFR and proteinuria, we calculated the difference in the C-statistics and net reclassification index (NRI).
Results
We identified 4499 individuals and observed 422 individuals (incidence of 45.2 per 1000 person-years) who developed dialysis dependency during the observation period (9343 person-years). Adding biomarker changes to the KFRE model improved C-statistics from 0.862 to 0.921, with an improvement of 0.060 (95% confidence intervals (CI) of 0.043–0.076, P < .001). The corresponding NRI was 0.773 (95% CI: 0.637–0.908), with an NRI for events of 0.544 (95% CI of 0.415–0.672) and NRI for non-events of 0.229 (95% CI of 0.186–0.272).
Conclusions
The KFRE model was improved by incorporating yearly changes in its components. The added information may help clinicians identify high-risk individuals and improve their care.
Keywords: biomarker, clinical epidemiology, dialysis dependency, kidney failure risk equation, prediction
Graphical Abstract
KEY LEARNING POINTS.
What was known:
Individuals with an estimated glomerular filtration rate of <30 ml/min/1.73 m2 are at a high risk for kidney failure with dialysis dependency, and several models have been developed to predict the transition to dialysis dependency.
The kidney failure risk equation has been useful for predicting the initiation of kidney replacement therapy.
It remains unknown whether the addition of biomarker changes to the model will improve its predictive value.
This study adds:
The addition of changes in eGFR and proteinuria improved the predictive ability of the kidney failure risk equation for the initiation of kidney replacement therapy.
Analyses using decision curve analysis suggested that the modified model potentially improved clinical utility compared with the original kidney failure risk equation.
Potential impact:
This model will help prepare adequate care, advance care planning, and follow-up among individuals at a high risk for kidney failure with dialysis dependency.
INTRODUCTION
Chronic kidney disease (CKD), a noncommunicable disease, has become a global problem as its prevalence increases due to societal aging [1]. Although the age-standardized prevalence of CKD has remained the same since 1997, the age-standardized incidence of kidney failure with dialysis dependency has increased by >40% [2]. Therefore, efforts should focus on managing individuals at imminent risk for kidney replacement therapy. Individuals with severe kidney dysfunction, namely those with an estimated glomerular filtration rate (eGFR) of <30 ml/min/1.73 m2, are among the high-risk populations [3]. Such populations should be carefully followed up because the inadequate timing of dialysis initiation may lead to increased mortality [4]. To facilitate appropriate patient care, the decision to prepare suitable patients for the development of dialysis dependency should be based on the findings of individualized risk assessment [5]. Therefore, constructing an accurate and individualized risk-predictive model for dialysis dependency may improve the prognosis of patients with severe kidney dysfunction [5].
Currently, only a few models are used to predict the progression to dialysis-dependent kidney failure in patients with kidney dysfunction [5–7]. Of these, the kidney failure risk equation (KFRE) is the most extensively used, and its predictive power has been validated in studies involving global populations [8–13]. The four-variable KFRE comprises age, sex, eGFR, and urinary albumin [9], and the simplicity of this model facilitated the incorporation in electronic medical record [14]. Furthermore, the KFRE can predict not only the progression to dialysis dependency, but also increased cost due to kidney care [15]. Therefore, KFRE was used for the selection of high-risk populations regarding clinical decision-making [16, 17]. Indeed, the use of the KFRE equation for referral to kidney specialist or decision-making in advanced CKD could improve patient care [18].
Although the KFRE model is widely used and well-validated, whether the observation of any changes in components can improve the model's ability to predict progression to kidney failure among individuals with an eGFR of <30 ml/min/1.73 m2 remains unclear. Considering that changes in urinary protein levels and eGFRs are useful in predicting CKD progression [19–23], examining whether the addition of such information will increase the predictive ability of KFRE is important. Improving the predictive ability of KFRE will contribute to the advancement of effective intervention strategies in individuals with severe kidney dysfunction.
This study aimed to assess the incremental predictive value of biomarker alterations in the KFRE model for predicting dialysis-dependent kidney failure. Moreover, we assessed whether changes in proteinuria levels, and eGFRs will enhance the predictive ability of the model.
MATERIALS AND METHODS
Study design and data source
This population-based cohort study was conducted using information retrieved from the DeSC administrative claims database (DeSC Healthcare Inc., Tokyo, Japan). The DeSC database contains claims data submitted to health insurers at clinics, hospitals, and pharmacies. It contains information on the entire Japanese population, including people across all ages, and the details of the DeSC database have been described previously [24].
For claims data, we used diagnoses recorded according to the International Classification of Diseases, 10th revision (ICD-10) codes. The DeSC database contains annual health checkup data for ∼30% of the population. The checkup data included individual demographics (e.g. height, weight, and blood pressure), results of clinical laboratory tests (e.g. serum creatinine and urinary protein semi-quantitative tests), and responses to a questionnaire-based survey on lifestyle factors (e.g. smoking and ischemic heart disease history).
Inclusion and exclusion criteria
Using the DeSC database, individuals (i) with an eGFR of <30 ml/min/1.73 m2 during the health checkup performed between 2014 and 2021, and (ii) with data on proteinuria and serum creatinine levels obtained in two successive checkups and with a look-back period of 6 months before the first checkup, were included in the study (Fig. S1). Individuals undergoing dialysis or kidney transplantation before the second checkup were excluded.
This study was approved by the Institutional Review Board of the Graduate School of Medicine at the University of Tokyo (2021010NI). The requirement for informed consent was waived owing to the use of anonymized data.
Study variables
The following data were obtained and used in the KFRE used in this study: age, sex, eGFR, and semi-quantitative proteinuria levels recorded as five levels (negative, trace, 1+, 2+, and 3+). We also calculated albuminuria predicted by the five-level proteinuria, sex, and comorbidities of diabetes and hypertension [9, 25]. The inclusion of predicted albuminuria in the KFRE model was validated, supporting its use in the calculation [9, 25]. Moreover, we obtained information on biomarkers such as low-density lipoprotein cholesterol and HbA1c, comorbid diabetes or hypertension, and smoking history. We also collected information on systolic blood pressure and history of cardiocerebrovascular disease, the addition of which to the four-variable KFRE leads to a six-variable KFRE [9]. We utilized data obtained during the first health checkup to prepare the four-variable KFRE. We also retrieved information on proteinuria levels and eGFR measured during both the first and second health checkup to monitor changes in the markers.
Study outcome
The primary outcome was the development of dialysis dependency, defined as the earliest date of hemodialysis, peritoneal dialysis, or kidney transplantation. Individuals were followed from the second checkup until the earliest date of dialysis initiation, kidney transplant, or censoring.
Statistical analyses
We summarized the background characteristics of eligible individuals based on whether the outcome was reached or not. Categorical variables were compared using the chi-square test, and continuous variables were compared using Student's t-test. We described an incidence rate per 1000 person-years for the development of dialysis dependency.
We divided the participants into two sets: a training set, comprising a randomly selected 50% of the participants, and a validation set, comprising the remaining 50%. This method was adopted to avoid overfitting [26].
To prepare the models used for predicting the development of dialysis dependency, we estimated the risk of kidney failure using flexible parametric survival models (the Royston–Parmar models) using the training set [27, 28]. We used this parametric model in the survival analysis, which is useful in evaluating the prediction for event development [27, 28], instead of a semi-parametric model (i.e. Cox regression). To assess the incremental predictive ability of biomarker changes, we constructed two models: one was the KFRE model, and the other used the KFRE model with the incorporation of changes in eGFR and proteinuria levels (modified KFRE model). In both the KFRE and modified KFRE models, age and eGFR were treated as continuous variables, sex was a binary variable (male or female), and urinary protein was a five-level categorical variable (negative, trace, 1+, 2+, and 3+). In the modified KFRE model, the annual change in eGFR was represented as a continuous variable, indicating the yearly slope of eGFR change (expressed as ml/min/1.73 m2 per year, calculated by dividing the eGFR change by the interval between the two checkups), and the change in proteinuria was represented as a binary variable, indicating whether the dipstick proteinuria results underwent no or worse change across the five proteinuria categories. We observed “no or worse” change instead of improvement in proteinuria levels to avoid potential ceiling effects because individuals with the best proteinuria category (i.e. negative) in the first checkup could not have a better proteinuria result in the second checkup. The same dataset was used for both models, which were recalibrated for our study population using coefficients derived from parametric regression within the training set. The performance of the two models was evaluated by comparing the predicted probabilities at the 2-year mark with the actual occurrence of events. This corresponds to the evaluation of the original 2-year KFRE model.
The predictive ability of these models was evaluated. To determine the predictive ability of the two different models in predicting the risk of kidney failure, two performance measures were used: (i) the C-statistics and the difference between the C-statistics of the KFRE and that of the modified KFRE model with 95% confidence intervals (CIs) calculated using the jackknife approach [29], and (ii) the net reclassification index (NRI) from the KFRE to the modified KFRE model. The NRI was further divided into NRI for events and NRI for non-events, based on the changes in sensitivity and specificity, respectively [30].
We also assessed the clinical utility of the two models in predicting individuals requiring preparation for the development of dialysis dependency within two years using decision curve analysis (DCA) [31]. The DCA evaluates the trade-offs between the advantages of true positives (preparation for the development of dialysis dependency followed by the induction of kidney replacement therapy) and the potential disadvantages associated with false positives (preparation for the development of dialysis dependency without the subsequent induction of kidney replacement therapy) for various threshold probabilities [32, 33]. Each model was compared in addition to the two default scenarios: preparing for dialysis dependency across all or no individuals (first and second scenarios, respectively). This method involves analysis of the model's discrimination and calibration abilities, thereby enabling the assessment of the model's potential impact on clinical decision-making. The first scenario assumes that physicians would anticipate dialysis dependency (i.e. requiring intensive and frequent follow-up visits) for all participants without making any specific prediction for dialysis dependency. In this scenario, while individuals who will develop dialysis dependency during a specific period, presumably constituting a small portion of the total population, would benefit, those who will not develop dialysis dependency during the period, accounting for the rest of the total population, would incur excessive cost without tangible benefit (i.e. cost-exhausting). Conversely, the second scenario presumes a case wherein physicians would not perform any interventions for dialysis dependency for anyone, which would result in no net benefit for all individuals since no preparation or cost would be incurred.
We conducted additional research to determine the cut-off value for the yearly eGFR slope to predict the development of dialysis dependency. We described the receiver operating characteristic curve showing the balance of sensitivity and specificity of the yearly eGFR slope. The cut-off was determined using the Youden index [34].
Additionally, we performed subgroup analyses stratified by age (cut-off age 75 years) and sex, and conducted three sensitivity analyses. First, we used the six-variable KFRE as the reference model, wherein the systolic blood pressure and cardiocerebrovascular disease history were added to the four-variable KFRE model (sensitivity analysis 1). This analysis assessed whether including changes in eGFR and proteinuria improved the KFRE model, even with adjustments for systolic blood pressure and cardiocerebrovascular disease history. Next, we used the predicted albuminuria levels instead of semi-quantitative results (sensitivity analysis 2). Finally, we included individuals with an eGFR of <45 ml/min/1.73 m2 instead of those with an eGFR of <30 ml/min/1.73 m2 (sensitivity analysis 3).
A two-sided P value <.05 was considered statistically significant. All statistical analyses were performed using Stata version 18 (StataCorp, College Station, TX, USA).
RESULTS
Baseline characteristics
Among the population with health checkup data in the database, 4754 satisfied the inclusion criteria. We subsequently excluded 255 individuals who developed dialysis dependency before the second checkup, thereby including 4499 individuals in the analyses (Fig. 1).
The characteristics of the included individuals stratified by outcomes are summarized in Table 1. During follow-up (N = 9343 person-years at risk), 422 individuals (45.2 per 1000 person-years) developed kidney failure with dialysis dependency. Those who developed dialysis dependency during the follow-up period were more likely to be younger, male, have a higher systolic blood pressure, have a lower eGFR, have positive proteinuria by dipstick test, or have no history of cardiocerebrovascular disease (Table 1). In relation to alterations in biomarkers within the components of the KFRE, individuals who developed dialysis dependency exhibited a more intensive decrease in yearly change in eGFR. The characteristics of the populations belonging to the training and test sets were comparable (Table S1).
Table 1:
Without dialysis dependency development | With dialysis dependency development | |||
---|---|---|---|---|
Variable | Category | N = 4077 | N = 422 | P value |
Sex (male) | 1938 (47.5%) | 277 (65.6%) | <.001 | |
Age (years) | 78 (10) | 69 (11) | <.001 | |
Body mass index (kg/m2) | 23.8 (3.7) | 24.5 (4.5) | <.001 | |
Body mass index category (kg/m2) | <18.5 | 237 (5.8%) | 23 (5.5%) | <.001 |
18.5–24.99 | 2466 (60.5%) | 231 (54.7%) | ||
25.00–29.99 | 1117 (27.4%) | 120 (28.4%) | ||
≥30.00 | 252 (6.2%) | 48 (11.4%) | ||
Missing | 5 (0.1%) | 0 (0.0%) | ||
Systolic blood pressure at initial checkup (mmHg) | 132 (18) | 138 (18) | <.001 | |
Diastolic blood pressure at initial checkup (mmHg) | 72 (12) | 76 (12) | <.001 | |
Smoking status | Non/past smoker | 3476 (85.3%) | 367 (87.0%) | <.001 |
Current smoker | 292 (7.2%) | 50 (11.8%) | ||
Missing | 309 (7.6%) | 5 (1.2%) | ||
Estimated glomerular filtration rate (ml/min/1.73 m2) | 24.1 (5.3) | 18.7 (5.9) | <.001 | |
Estimated glomerular filtration rate category (ml/min/1.73 m2) | 15–29 | 3787 (92.9%) | 288 (68.2%) | <.001 |
<15 | 290 (7.1%) | 134 (31.8%) | ||
Negative | 1774 (43.5%) | 36 (8.5%) | <.001 | |
Proteinuria by dipstick test | Trace | 528 (13.0%) | 26 (6.2%) | |
+ | 769 (18.9%) | 77 (18.2%) | ||
2+ | 651 (16.0%) | 152 (36.0%) | ||
3+ | 355 (8.7%) | 131 (31.0%) | ||
Predicted albumin-creatinine ratio (mg/gCr) | 181.8 (346.3) | 516.8 (502.0) | <.001 | |
HbA1c (%) | 5.9 (0.7) | 6.0 (1.1) | <.001 | |
<5.7 | 2100 (51.5%) | 210 (49.8%) | <.001 | |
5.7–6.4 | 1361 (33.4%) | 115 (27.3%) | ||
HbA1c category (%) | 6.5–7.9 | 500 (12.3%) | 70 (16.6%) | |
≥8.0 | 68 (1.7%) | 16 (3.8%) | ||
Missing | 48 (1.2%) | 11 (2.6%) | ||
Low-density lipoprotein cholesterol (mg/dl) | 109.1 (31.0) | 108.0 (34.3) | .50 | |
Comorbid diabetes | 1784 (43.8%) | 229 (54.3%) | <.001 | |
Comorbid hypertension | 3829 (93.9%) | 412 (97.6%) | .002 | |
History of cardiocerebrovascular disease | Without cardiocerebrovascular disease history | 2026 (49.7%) | 238 (56.4%) | .009 |
With cardiocerebrovascular disease history | 2051 (50.3%) | 184 (43.6%) | ||
Yearly change in estimated glomerular filtration rate (mL/min/1.73m2/year) | 2.1 (11.8) | −4.2 (4.2) | <.001 | |
No or worse change in proteinuria level | 1141 (28.0%) | 131 (31.0%) | .18 |
Data are presented as the means (standard deviations) for continuous measures and N (%) for categorical measures.
*Body mass index, HbA1c, and low-density lipoprotein cholesterol were summarized after excluding 5, 59, and 10 patients without the corresponding information, respectively.
Discrimination in the prediction of dialysis dependency
The hazard ratios of the KFRE and the modified KFRE models are listed in Table S2. The hazard ratios for dialysis-dependent kidney failure among the components of the KFRE model were similar. The yearly eGFR slope was associated with dialysis dependency (hazard ratio 1.30 for 1 ml/min/1.73 m2 decrease per year, 95% CI: 1.26–1.35), and no improvement in proteinuria levels was also associated with dialysis dependency (hazard ratio: 2.86, 95% CI: 2.02–4.04). Based on the regression results, we constructed 2-year recalibrated KFRE and modified KFRE models (Table S3).
Table 2 summarizes the discrimination abilities of the two models. The KFRE yielded a C-statistic of 0.862 (95% CI: 0.836–0.887), whereas that for the modified KFRE model was 0.921 (95% CI: 0.905–0.938), with a difference of 0.060 (95% CI: 0.043–0.076; P < .001).
Table 2:
Item | Point estimate | 95% confidence interval | P value | ||
---|---|---|---|---|---|
NRI | |||||
NRI for events | 0.544 | 0.415 | – | 0.672 | <.001 |
NRI for non-events | 0.229 | 0.186 | – | 0.272 | <.001 |
Total NRI | 0.773 | 0.637 | – | 0.908 | <.001 |
C-statistics | |||||
KFRE model | 0.862 | 0.836 | – | 0.887 | |
Modified KFRE model | 0.921 | 0.905 | – | 0.938 | |
ΔC-statistics | 0.060 | 0.043 | – | 0.076 | <.001 |
Net reclassification index and decision curve analysis
Compared with the KFRE, the total NRI in the modified KFRE model was 0.773 (95% CI: 0.637–0.908). The addition of biomarker changes yielded NRIs of 0.544 for events (95% CI: 0.415–0.672) and 0.229 for non-events (95% CI: 0.186–0.272).
Based on the findings of the clinical effectiveness evaluation using DCA, the modified KFRE model provided the maximum benefit in predicting patients requiring preparation for dialysis dependency (Fig. 2). In particular, the new model provided a larger benefit than the KFRE in terms of clinical utility, suggesting an improvement in predicting patients requiring preparation for dialysis dependency after adding the changes of the two biomarkers to the KFRE.
Cut-off for discrimination of development of dialysis dependency
The receiver operating characteristic curve based on the yearly eGFR slope is shown in Fig. S1. The optimal cut-off by the Youden index was −2.6 ml/min/1.73 m2/year. With this cut-off, the sensitivity was 65% and specificity was 74%.
Stratified and sensitivity analyses
When stratified by age (<75 or ≥75 years) or sex (female or male), the results of the sensitivity analyses were similar (Table S4 and Figs S2 and S3), supporting the findings of the main analysis (Table S5 and Figs S4–S6).
DISCUSSION
Using real-world data from a population-based database, we showed that the predictive ability of the KFRE model was improved by incorporating biomarker changes. The usefulness of these additional data was confirmed not only based on the NRI but also on the results of the DCA. Thus, the incorporation of biomarker changes in the KFRE is clinically useful for predicting the risk of dialysis dependency.
Although the KFRE has been used worldwide to predict kidney failure, studies aimed at improving its predictive ability, such as ours, are limited. Studies have shown conflicting results in the utility of additional information to the KFRE model in predicting dialysis dependency. For example, among patients with diabetic nephropathy and eGFR <60 ml/min/1.73 m2, the addition of the pathological information of kidney biopsy improved the risk for dialysis dependency calculated by the KFRE model, with an improvement of C-statistis by 0.0019 and NRI of 0.40 [35]. Another study revealed that among individuals with eGFR of 15–90 ml/min/1.73 m2, renal resistive index, an ultrasound maker of kidney, improved the KFRE model but the added model did not outperform the original KFRE model in the validation cohort [36]. Meanwhile, a recent study has shown that among individuals with eGFR of <60 ml/min/1.73 m2, the addition of information on an eGFR slope and cardiovascular comorbidity did not improve the KFRE model [37]. The discrepancy between the results of these studies and ours may be attributed to the different eGFR ranges of the included populations; our study included eGFR < 30 ml/min/1.73 m2; however, these studies included individuals with milder kidney dysfunction. The inclusion of this sample demographic may have led to a high baseline C-statistic (∼0.90), as shown in our sensitivity analysis 3 (Table S4), thereby making it difficult to detect a difference in C-statistics. Our inclusion criterion for eGFR (<30 ml/min/1.73 m2) could be justified because we focused on individuals at a high risk for dialysis dependency, wherein individualized decision-making is necessary. This study aimed to address the management strategies for this specific population.
The addition of changes in urinary protein levels and eGFR, both of which reportedly function as surrogate markers for CKD progression [19–23], improved the predictive ability of the KFRE in our study. The decrease in eGFR was shown to be useful in predicting kidney failure ∼10 years ago, whereas the incremental predictive value by incorporating information on the albuminuria/proteinuria change has been confirmed just recently [20–22]. A previous study also showed that incorporating the data on the ≥30% increase of albuminuria to that of the ≥30% decrease of eGFR after a multivariable adjustment resulted in the improvement in C-statistics (0.019) in the prediction of kidney failure [21]. Our study also detected the cut-off eGFR slope of −2.6 ml/min/1.73 m2 per year in predicting the development of dialysis dependency, which is consistent with a recent article showing that an eGFR slope of <−3 ml/min/1.73 m2 per year was consistently associated with increased risk for dialysis dependency while a slope of ≥−3 ml/min/1.73 m2 per year did not [37].
Beyond the KFRE models, recent studies have explored strategies for predicting dialysis dependency. For example, Tangri et al. developed a dynamic prediction model using time-varying biomarker changes, similar to our approach, achieving an integrated discrimination improvement of 0.73% by adding time-dependent covariates to baseline biomarker levels [38]. The most influential time-dependent variable was eGFR, followed by albuminuria, whereas albumin, phosphate, bicarbonate, and calcium levels were not significant determinants [38]. Additionally, recent studies have incorporated machine learning techniques to improve prediction accuracy. For example, Klamrowski et al. used a machine learning model to predict unplanned dialysis in patients at imminent risk of dialysis dependency [39]. Their random forest model incorporated age and time-varying trends in serum creatinine and albuminuria levels, achieving a C-statistic of up to 0.88 [39]. Another study, using the super learner machine learning algorithm [40], with information only on age, sex, eGFR, and albuminuria, outperformed the four-variable KFRE model in predicting dialysis dependency and death among patients with eGFR of 30–45 ml/min/1.73 m² [41]. Thus, these studies underscore the importance of time-dependent changes in serum creatinine and albuminuria as strong predictors of dialysis initiation and highlight the potential of advanced machine learning models to improve predictive accuracy.
Our study is novel in that the addition of biomarker changes may be useful in detecting individuals with subsequent kidney failure by measuring the NRI; moreover, DCA demonstrated the usefulness of the added biomarkers in several threshold probabilities. Routine follow-up, especially monitoring of changes in proteinuria levels and eGFR, should be performed in individuals with an eGFR of <30 ml/min/1.73 m2 and at a high risk predicted by the modified KFRE model. Monitoring serum creatinine and albuminuria/proteinuria routinely is recommended in guidelines [42, 43], and supported by recent studies that suggest that time-varying changes of both markers are important [38, 39].
The findings of the present study, aside from those regarding the predictive models, align with previous studies. The hazard ratios for kidney failure (Table S2) showed that younger age, male sex, decreased eGFR, and severe proteinuria were associated with progression to dialysis-dependent kidney failure in the KFRE model, which is consistent with the findings of previous studies [37, 44–46]. Other studies demonstrated that CKD progression decreased with age [44, 45], which is in line with our study reporting that advanced age had a negative association (hazard ratio of age <1 for the development of dialysis dependency) with CKD progression. Furthermore, the stratified and sensitivity analyses results revealed modification effects by sex or age, consistent with previous findings. The DCA curves in the age-stratified analysis showed that the clinical utility among individuals aged ≥75 years might be inferior to that among those aged <75 years. Although both groups had similar C-statistics, calibration among individuals aged ≥75 years may be less accurate, likely because the study did not account for the competing risk of death, as reported previously [47]. A possible effect modification by sex was also observed. Despite similar C-statistics for both sexes, the DCA curves suggested that calibration among females may be less accurate, likely due to the difference in the mean age (79.1 years in women vs 75.3 years in men). Further research on sex-based effect modification in the KFRE model is warranted.
Our study has several limitations. First, the absence of quantitative urinary protein/albumin data precluded their utilization in our analysis. However, considering that the semi-quantitative method as in our study was also shown to be useful in the KFRE model [37], the use of the semi-quantitative method may be justified. Second, this study used model development and validation cohorts in the database. Using the modified KFRE model in an external cohort may have resulted in a less pronounced effect from adding changes in eGFR and proteinuria. Therefore, the external validity, especially outside Japan, should be examined in future studies. Third, due to the retrospective nature of this study, other confounding factors, such as race, socioeconomic status, or frailty, may have been present. Moreover, the development of acute kidney injury, detailed medication history, or medication changes during the period might have affected the timing of kidney replacement therapy induction. Fourth, the original KFRE model already demonstrated high C-statistics; hence, the usefulness of the modified KFRE model for further improvement in predictive ability might be limited. Finally, we were unable to perform an analysis using the Fine and Gray model because information on death was only partially available for the population in the DeSC database.
In conclusion, this retrospective cohort study using a large-scale claims database revealed that the addition of biomarker changes was useful in increasing the predictive ability of the KFRE. Therefore, clinicians should pay attention to changes in eGFR and urinary protein to monitor CKD progression.
Supplementary Material
ACKNOWLEDGEMENTS
A.O., S.Y., K.I.K., R.I., and T.K. are members of the Department of Prevention of Diabetes and Lifestyle-Related Diseases, which is a cooperative program between the University of Tokyo and Asahi Mutual Life Insurance Company. K.I.K. was employed by the Asahi Mutual Life Insurance Company. The content is the sole responsibility of the authors and does not necessarily represent the official views of the University of Tokyo. Other authors declare no potential conflicts of interest.
Contributor Information
Akira Okada, Department of Prevention of Diabetes and Lifestyle-Related Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Shotaro Aso, Department of Real-world Evidence, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Kayo Ikeda Kurakawa, Department of Prevention of Diabetes and Lifestyle-Related Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Reiko Inoue, Department of Prevention of Diabetes and Lifestyle-Related Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Hideaki Watanabe, Department of Clinical Epidemiology and Health Economics, The University of Tokyo, Tokyo, Japan.
Yusuke Sasabuchi, Department of Real-world Evidence, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Toshimasa Yamauchi, Department of Diabetes and Metabolic Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Hideo Yasunaga, Department of Clinical Epidemiology and Health Economics, The University of Tokyo, Tokyo, Japan.
Takashi Kadowaki, Department of Prevention of Diabetes and Lifestyle-Related Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan; Department of Diabetes and Metabolic Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan; Toranomon Hospital, Tokyo, Japan.
Satoko Yamaguchi, Department of Prevention of Diabetes and Lifestyle-Related Diseases, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
Masaomi Nangaku, Division of Nephrology and Endocrinology, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan.
FUNDING
This work was supported by a grant from the Ministry of Health, Labor and Welfare, Japan (23AA2007). The funding source had no role in the study design, data collection, analysis, reporting, or the decision to submit this article.
AUTHORS’ CONTRIBUTIONS
Study design, A.O.; data acquisition, H.Y.; statistical analyses, A.O., S.A., Y.S., S.Y., and H.Y.; data interpretation, H.W., K.I.K., R.I., M.N., T.Y., H.Y., T.K., and S.Y.; supervision, S.Y., M.N., T.Y., H.Y., and T.K.; funding acquisition, H.Y. Each author contributed important intellectual content during manuscript drafting or revision, agreed to be personally accountable for the individual's own contributions, and ensured that questions pertaining to the accuracy or integrity of any portion of the work, even one in which the author was not directly involved, were appropriately investigated and resolved, including documentation in the literature, if appropriate.
DATA AVAILABILITY STATEMENT
The data underlying this article were provided by DeSC Healthcare, Inc. under license. Data will be shared on request to the corresponding author with the permission of DeSC Healthcare, Inc.
CONFLICT OF INTEREST STATEMENT
None declared.
REFERENCES
- 1. Xie Y, Bowe B, Mokdad AH et al. Analysis of the Global Burden of Disease study highlights the global, regional, and national trend of chronic kidney disease epidemiology from 1990 to 2016. Kidney Int 2018;94:567–81. 10.1016/j.kint.2018.04.011 [DOI] [PubMed] [Google Scholar]
- 2. Cockwell P, Fisher LA. The global burden of chronic kidney disease. Lancet 2020;395:662–4. 10.1016/S0140-6736(19)32977-0 [DOI] [PubMed] [Google Scholar]
- 3. Turin TC, Tonelli M, Manns BJ et al. Lifetime risk of ESRD. J Am Soc Nephrol 2012;23:1569–78. 10.1681/ASN.2012020164 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Fu EL, Evans M, Carrero J-J et al. Timing of dialysis initiation to reduce mortality and cardiovascular events in advanced chronic kidney disease: nationwide cohort study. BMJ 2021;375:e066306. 10.1136/bmj-2021-066306 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Tangri N, Stevens LA, Griffith J et al. A predictive model for progression of chronic kidney disease to kidney failure. JAMA 2016;305:1553–9. 10.1001/jama.2011.451 [DOI] [PubMed] [Google Scholar]
- 6. Grams ME, Sang Y, Ballew SH et al. Predicting timing of clinical outcomes in patients with chronic kidney disease and severely decreased glomerular filtration rate. Kidney Int 2018;93:1442–51. 10.1016/j.kint.2018.01.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Ramspek CL, Boekee R, Evans M et al. Predicting kidney failure, cardiovascular disease and death in advanced CKD patients. Kidney Int Rep 2022;7:2230–41. 10.1016/j.ekir.2022.07.165 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Gallego-Valcarce E, Shabaka A, Tato-Ribera AM et al. External validation of the KFRE and Grams prediction models for kidney failure and death in a Spanish cohort of patients with advanced chronic kidney disease. J Nephrol 2024;37:429–37. 10.1007/s40620-023-01819-1 [DOI] [PubMed] [Google Scholar]
- 9. Tangri N, Grams ME, Levey AS et al. Multinational assessment of accuracy of equations for predicting risk of kidney failure: a meta-analysis. JAMA 2016;315:164–74. 10.1001/jama.2015.18202 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Ali I, Donne RL, Kalra PA. A validation study of the kidney failure risk equation in advanced chronic kidney disease according to disease aetiology with evaluation of discrimination, calibration and clinical utility. BMC Nephrol 2021;22:194. 10.1186/s12882-021-02402-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Ali I, Kalra PA. A validation study of the 4-variable and 8-variable kidney failure risk equation in transplant recipients in the United Kingdom. BMC Nephrol 2021;22:57. 10.1186/s12882-021-02259-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Irish GL, Cuthbertson L, Kitsos A et al. The kidney failure risk equation predicts kidney failure: validation in an Australian cohort. Nephrol 2023;28:328–35. 10.1111/nep.14160 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Major RW, Shepherd D, Medcalf JF et al. The Kidney Failure Risk equation for prediction of end stage renal disease in UK primary care: an external validation and clinical impact projection cohort study. PLoS Med 2019;16:e1002955. 10.1371/journal.pmed.1002955 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Alexiuk M, Elgubtan H, Tangri N. Clinical decision support tools in the electronic medical record. Kidney Int Rep 2024;9:29–38. 10.1016/j.ekir.2023.10.019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Reaven NL, Funk SE, Mathur V et al. Association of the kidney failure risk equation with high healthcare costs. Kidney Int Rep 2023;8:1183–91. 10.1016/j.ekir.2023.03.008 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Patel DM, Churilla BM, Thiessen-Philbrook H et al. Implementation of the kidney failure risk equation in a United States nephrology clinic. Kidney Int Rep 2023;8:2665–76. 10.1016/j.ekir.2023.09.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Wang M, Peter SS, Chu CD et al. Analysis of specialty nephrology care among patients with chronic kidney disease and high risk of disease progression. JAMA Netw Open 2022;5:e2225797. 10.1001/jamanetworkopen.2022.25797 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Oliva-Damaso N, Tangri N, Delanaye P et al. Bridging the gap of referral to nephrology care. Nat Rev Nephrol 2023;19:275–6. 10.1038/s41581-023-00693-1 [DOI] [PubMed] [Google Scholar]
- 19. Kanda E, Usui T, Kashihara N et al. Importance of glomerular filtration rate change as surrogate endpoint for the future incidence of end-stage renal disease in general Japanese population: community-based cohort study. Clin Exp Nephrol 2018;22:318–27. 10.1007/s10157-017-1463-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Ohkuma T, Jun M, Chalmers J et al. Combination of changes in estimated GFR and albuminuria and the risk of major clinical outcomes. Clin J Am Soc Nephrol 2019;14:862–72. 10.2215/CJN.13391118 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21. Neuen BL, Weldegiorgis M, Herrington WG et al. Changes in GFR and albuminuria in routine clinical practice and the risk of kidney disease progression. Am J Kidney Dis 2021;78:350–60.e1. 10.1053/j.ajkd.2021.02.335 [DOI] [PubMed] [Google Scholar]
- 22. Oshima M, Toyama T, Hara A et al. Combined changes in albuminuria and kidney function and subsequent risk for kidney failure in type 2 diabetes. BMJ Open Diabetes Res Care 2021;9:e002311. 10.1136/bmjdrc-2021-002311 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Itano S, Kanda E, Nagasu H et al. eGFR slope as a surrogate endpoint for clinical study in early stage of chronic kidney disease: from The Japan Chronic Kidney Disease Database. Clin Exp Nephrol 2023;27:847–56. 10.1007/s10157-023-02376-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Okada A, Yasunaga H. Prevalence of noncommunicable diseases in Japan using a newly developed administrative claims database covering young, middle-aged, and elderly people. JMA 2022;5:190–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Sumida K, Nadkarni GN, Grams ME et al. Conversion of urine protein-creatinine ratio or urine dipstick protein to urine albumin-creatinine ratio for use in chronic kidney disease screening and prognosis: an individual participant-based meta-analysis. Ann Intern Med 2020;173:426–35. 10.7326/M20-0529 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Lever J, Krzywinski M, Altman N. Model selection and overfitting. Nat Methods 2016;13:703–4. 10.1038/nmeth.3968 [DOI] [Google Scholar]
- 27. Royston P. Flexible parametric alternatives to the Cox model, and more. Stata J 2001;1:1–28. 10.1177/1536867X0100100101 [DOI] [Google Scholar]
- 28. Lambert PC, Royston P. Further development of flexible parametric models for survival analysis. Stata J 2009;9:265–90. 10.1177/1536867X0900900206 [DOI] [Google Scholar]
- 29. Newson RB. Comparing the predictive powers of survival models using Harrell's C or Somers’ D. Stata J 2010;10:339–58. 10.1177/1536867X1001000303 [DOI] [Google Scholar]
- 30. Pencina MJ, Steyerberg EW, D'Agostino RB.Sr Net reclassification index at event rate: properties and relationships. Stat Med 2017;36:4455–67. 10.1002/sim.7041 [DOI] [PubMed] [Google Scholar]
- 31. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making 2006;26:565–74. 10.1177/0272989X06295361 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Vickers AJ, Van Calster B, Steyerberg EW. Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests. BMJ 2016;352:i6. 10.1136/bmj.i6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33. Clift AK, Dodwell D, Lord S et al. Development and internal-external validation of statistical and machine learning models for breast cancer prognostication: cohort study. BMJ 2023;381:e073800. 10.1136/bmj-2022-073800 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Youden W. Index for rating diagnostic tests. Cancer 1950;3:32–35. [DOI] [PubMed] [Google Scholar]
- 35. Yamanouchi M, Hoshino J, Ubara Y et al. Value of adding the renal pathological score to the kidney failure risk equation in advanced diabetic nephropathy. PLoS ONE 2018;13:e0190930. 10.1371/journal.pone.0190930 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. Lennartz CS, Pickering JW, Seiler-Mußler S et al. External validation of the kidney failure risk equation and re-calibration with addition of ultrasound parameters. Clin J Am Soc Nephrol 2016;11:609. 10.2215/CJN.08110715 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Grams ME, Brunskill NJ, Ballew SH et al. The Kidney Failure Risk equation: evaluation of novel input variables including eGFR estimated using the CKD-EPI 2021 equation in 59 cohorts. J Am Soc Nephrol 2023;34:482–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38. Tangri N, Inker LA, Hiebert B et al. A dynamic predictive model for progression of CKD. Am J Kidney Dis 2017;69:514–20. 10.1053/j.ajkd.2016.07.030 [DOI] [PubMed] [Google Scholar]
- 39. Klamrowski MM, Klein R, McCudden C et al. Derivation and validation of a machine learning model for the prevention of unplanned dialysis. Clin J Am Soc Nephrol 2024;19:1098–108. https://doi.org/2024:10.2215/CJN.0000000000000489 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40. Phillips RV, van der Laan MJ, Lee H et al. Practical considerations for specifying a super learner. Int J Epidemiol 2023;52:1276–85. 10.1093/ije/dyad023 [DOI] [PubMed] [Google Scholar]
- 41. Liu P, Sawhney S, Heide-Jørgensen U et al. Predicting the risks of kidney failure and death in adults with moderate to severe chronic kidney disease: multinational, longitudinal, population based, cohort study. BMJ 2024;385:e078063. 10.1136/bmj-2023-078063 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42. Stevens PE, Ahmed SB, Carrero JJ et al. KDIGO 2024 clinical practice guideline for the evaluation and management of chronic kidney disease. Kidney Int 2024;105:S117–314. 10.1016/j.kint.2023.10.018 [DOI] [PubMed] [Google Scholar]
- 43. Sarafidis P, Schmieder R, Burnier M et al. A European Renal Association (ERA) synopsis for nephrology practice of the 2023 European Society of Hypertension (ESH) Guidelines for the Management of Arterial Hypertension. Nephrol Dial Transplant 2024;39:929–43. 10.1093/ndt/gfae041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44. Hemmelgarn BR, Zhang J, Manns BJ et al. Progression of kidney dysfunction in the community-dwelling elderly. Kidney Int 2006;69:2155–61. 10.1038/sj.ki.5000270 [DOI] [PubMed] [Google Scholar]
- 45. O'Hare AM, Choi AI, Bertenthal D et al. Age affects outcomes in chronic kidney disease. J Am Soc Nephrol 2007;18:2758–65. 10.1681/ASN.2007040422 [DOI] [PubMed] [Google Scholar]
- 46. Tangri N, Stevens LA, Griffith J et al. A predictive model for progression of chronic kidney disease to kidney failure. JAMA 2011;305:1553–9. 10.1001/jama.2011.451 [DOI] [PubMed] [Google Scholar]
- 47. Hundemer GL, Tangri N, Sood MM et al. The effect of age on performance of the kidney failure risk equation in advanced CKD. Kidney Int Rep 2021;6:2993–3001. 10.1016/j.ekir.2021.09.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The data underlying this article were provided by DeSC Healthcare, Inc. under license. Data will be shared on request to the corresponding author with the permission of DeSC Healthcare, Inc.