Abstract
Objectives:
Novel biomarkers of renal injury appear inconsistent in identifying a creatinine-based diagnosis of acute kidney injury. To be clinically useful, novel acute kidney injury biomarkers should identify patients at increased risk for adverse outcomes that are a consequence of acute kidney injury earlier and with greater utility than conventional creatinine-based metrics. We sought to determine the prognostic utility of both urinary neutrophil gelatinase–associated lipocalin and varying creatinine-based metrics of renal injury at multiple time points associated with cardiac surgery.
Design:
Prospective observational study.
Setting:
Academic medical center.
Patients:
Six hundred three adults undergoing cardiac surgery.
Interventions:
Nil.
Measurements and Main Results:
Urinary neutrophil gelatinase–associated lipocalin was measured at baseline and again less than 1 hour, 3 hours, and 18–24 hours after separation from cardiopulmonary bypass. Creatinine-based metrics included a Kidney Disease: Improving Global Outcomes definition of acute kidney injury through 7 days postoperatively as well as ΔSCr-initial, defined as the incremental change in SCr from baseline to first postoperative measure. Multivariable regression determined the prognostic utility of neutrophil gelatinase–associated lipocalin and creatinine, alone and in combination, for the primary composite outcome of hospital mortality or renal replacement therapy. The primary outcome occurred in 25 patients. Adjusted for covariates ΔSCr-initial greater than or equal to 0.0 mg/dL provided early prognostic utility for the primary outcome (odds ratio, 8.9; 95% CI, 3.0–26.6), the odds ratio comparable to a creatinine-based Kidney Disease: Improving Global Outcomes definition of acute kidney injury applied over 7 days postoperatively. The upper quartile of urinary neutrophil gelatinase–associated lipocalin best predicted the primary outcome when measured 18–24 hours post–cardiopulmonary bypass (odds ratio, 18.6; 95% CI, 5.1–68.4; p = 0.001) with earlier post–cardiopulmonary bypass measures of uncertain utility. Combining both ΔSCr-initial and neutrophil gelatinase–associated lipocalin measured 3 hours after cardiopulmonary bypass provided excellent early risk stratification for the primary outcome (odds ratio, 18.3; 95% CI, 4.5–75.0).
Conclusions:
Combining urinary neutrophil gelatinase–associated lipocalin with a novel creatinine-based metric, both available soon after completion of surgery, may provide previously unavailable early and effective risk stratification for serious adverse outcomes after cardiac surgery. (Crit Care Med 2015; 43:1043–1052)
Keywords: acute kidney injury, biomarkers, creatinine, human LCN2 protein, outcome assessment, risk assessment, thoracic surgery
A cute kidney injury (AKI) after cardiac surgery represents a major healthcare burden (1–4), with no preventive or therapeutic intervention yet proven effective. One suggested factor contributing to this lack of success has been an inability to accurately detect renal injury in a timely manner, limiting the opportunity for highly targeted early intervention (5). Serum creatinine (SCr), the current diagnostic standard for AKI, is widely held to be inadequate due to limited sensitivity, specificity, and a markedly delayed response to injury (6). Despite this, small increases in SCr within 48 hours after cardiac surgery have consistently demonstrated an association with adverse outcomes (7–9). Similarly, small increases measured within just 6 hours of surgery have shown prognostic utility for a subsequent creatinine-based diagnosis of AKI. However, the prognostic utility of such early changes in SCr to predict important adverse clinical outcomes after cardiac surgery remains unknown.
Neutrophil gelatinase–associated lipocalin (NGAL) is one of the maximally amplified genes within 3 hours of renal ischemia and reperfusion, with a strong biological rationale supporting its potential role as an early indicator of AKI (10–12). However, the diagnostic performance of NGAL for a creati-nine-based diagnosis of AKI has varied dramatically in clinical studies (13–20). Nevertheless, the same limitations that make SCr a poor diagnostic tool for AKI also render it a poor surrogate against which to test the validity of new diagnostic markers (21). Importantly, for a new biomarker to change the diagnostic paradigm for AKI, it must identify patients at increased risk for adverse outcomes that are a consequence of AKI with greater accuracy than existing strategies, earlier than existing strategies, or both (22).
We sought to establish the prognostic utility of urinary NGAL, both alone and in combination with SCr measured at similarly early postoperative time points, for important adverse clinical outcomes that reflect AKI in a heterogenous cohort of adult patients undergoing cardiac surgery.
MATERIALS AND METHODS
After institutional review board approval, we enrolled adult patients undergoing cardiac surgery between January 2010 and June 2011 in a prospective observational study. In view of the minimal risk represented by collection of urine and routine perioperative data, and in keeping with New York State and U.S. Federal regulations, the institutional review board waived the need for individual patient consent. All types of cardiac surgical procedure were eligible for inclusion with patient selection based on research personnel availability and thus typically restricted to first cases in each operating room, Monday through Thursday.
Following induction of general anesthesia, 10 mL of fresh urine was collected from a urimeter attached to the patient’s Foley catheter for baseline measurement. Collected urine was centrifuged for 5–10 minutes at 2,000g removing cellular debris prior to storage at −80°C. Subsequent urine samples were typically collected within 60 minutes of separation from cardiopulmonary bypass (CPB) or completion of coronary anastomoses where off-pump coronary artery graft surgery was performed, again 3 hours after separation from CPB, and finally 18–24 hours after separation from CPB. Data collection included baseline characteristics as well as perioperative variables potentially associated with AKI or mortality.
At study completion, urinary NGAL was determined by batch analysis using commercially available enzyme-linked immunosorbent assay (ELISA) (R & D Diagnostics, Minneapolis, MN; Avidan HRP from eBioscience, San Diego, CA) by study personnel without formal blinding. Samples in which NGAL was undetectable were assigned a value of 0.5 ng/mL. Where a urine sample was missing, no attempt was made to impute biomarker values. Urinary creatinine was measured by enzymatic endpoint assay (Fisher Diagnostics, Middletown, VA). SCr was measured preoperatively and then typically daily for 4 days postoperatively by the central hospital laboratory with additional measures according to clinician judgment. The most recent SCr recorded prior to 7 AM on the morning of surgery was considered baseline. All aspects of clinical care were at the discretion of the treating physician blinded to NGAL values.
We hypothesized that perioperative urinary NGAL would identify patients at increased risk of adverse outcomes reflecting AKI, doing so earlier than varying creatinine-based metrics of renal injury. The primary outcome was the composite of hospital mortality or initiation of renal replacement therapy during the postoperative inpatient period. Secondary outcomes included individual components of the primary outcome as well as AKI defined according to recent Kidney Disease: Improving Global Outcomes (KDIGO) practice guidelines for AKI (23), omitting oliguric criteria.
Analyses were conducted using Stata 12 (Stata, College Station, TX) and R version 3.1.1 (R Foundation for Statistical Computing, Vienna, Austria). Creatinine-based metrics of renal injury included KDIGO guidelines applied over 7 days postoperatively as well as at earlier time points comparable to those at which NGAL was measured. We further defined two study-specific creatinine-based metrics available at time points comparable to urinary NGAL. ΔSCr-initial was calculated as the difference in SCr from baseline to first measure after surgery, whereas ΔSCr-peak day 1 was calculated as the difference in SCr from baseline to peak measure within 24 hours after surgery. Receiver operator characteristic (ROC) curves were generated for each of these metrics to identify the primary outcome, selecting thresholds for both ΔSCr-initial and ΔSCr-peak day 1 against which the prognostic utility of urinary NGAL at each time point could be pragmatically compared.
The study cohort was then split into quartiles according to NGAL values at each time point. This was based on a number of important facts: threshold NGAL values to best identify renal injury are not well established and may be both context-and assay-specific. Furthermore, optimal threshold values may vary with timing of measurement relative to injury while creatinine-based epidemiologic data support an AKI prevalence of around 25% that consistently portends an increased risk of adverse clinical outcomes (24, 25). Multivariable logistic regression determined the association between the upper quartile of urinary NGAL and the primary outcome, whereas both the c-statistic and integrated discrimination improvement (IDI) (26) evaluated the incremental benefit from adding urinary NGAL to existing clinical risk measures. Similar analyses were repeated for creatinine-based metrics of renal injury.
Patients were then categorized as NGAL+/−, defined by the upper quartile of NGAL at each time point, and SCr+/− defined by KDIGO AKI status within 7 days postoperatively determining the association between these two markers of renal injury when either discordant or concordant and the primary composite outcome. To better evaluate pragmatic utility, a similar analysis was repeated, again using the upper quartile of NGAL to define NGAL+/− status at each time point, but redefining SCr+/− status according to previously identified thresholds for ΔSCr-initial and ΔSCr-day 1, thereby simulating the potential value of combining these two biomarkers were they available in clinical practice at comparable times.
Based on existing data from within our institution, we assumed a 25% prevalence of AKI and 1.5% hospital mortality or RRT among patients without AKI. Using a two-tailed α error of 0.05, a sample size of 600 patients provided power of approximately 90% to detect an 8.0% prevalence of hospital mortality or RRT among patients with urinary NGAL values in the upper quartile (AKI equivalent) compared to 1.5% in patients from the combined lower three NGAL quartiles (non-AKI equivalent). Reporting of results was guided by the STrengthening the Reporting of OBservational studies in Epidemiology statement for reporting observational studies (27).
RESULTS
The study cohort comprised 603 patients for analysis (Fig. 1). The primary outcome occurred in 25 patients (4.1%), 14 of whom received postoperative RRT while 15 patients died in hospital, including 4 after RRT had been initiated. Median time to RRT initiation was 4 days (interquartile range, 2–6 d), with median time to death 12 days (interquartile range, 10–24 d). Outcome (+) patients had poorer baseline renal function, higher Euroscore, and were more likely to undergo surgery deemed nonelective and with longer duration of CPB (Table 1).
Figure 1.

Flow diagram of study participants.
Table 1.
Baseline Characteristics and Risk Factors for the Primary Composite Outcome of Hospital Mortality or Initiation of Renal Replacement Therapy
| Outcome (–) | Outcome (+) | ||
|---|---|---|---|
| Baseline Characteristics and Outcomes | n = 578 | n = 25 | P |
| Demographics | |||
| Age | 65 (16) | 67 (14) | 0.63 |
| Male gender | 367 (63.5) | 13 (52.0) | 0.24 |
| Body mass index, kg/m2 | 27.8 (5.3) | 28.4 (5.9) | 0.66 |
| Preoperative risk factors | |||
| Left ventricular ejection fraction % | 53 (12) | 44 (19) | 0.03 |
| Unstable angina or recent myocardial infarction | 143 (24.7) | 6 (24.0) | 0.9 |
| Diabetes | 129 (22.3) | 10 (40.0) | 0.04 |
| Hypertension | 419 (72.5) | 18 (72.0) | 0.9 |
| Chronic obstructive pulmonary disease | 57 (9.9) | 2 (8.0) | 0.9 |
| Hyperlipidemia | 379 (65.6) | 13 (52.0) | 0.16 |
| Statin use | 310 (53.6) | 12 (48.0) | 0.58 |
| Smoker | 44 (7.6) | 0 (0.0) | 0.25 |
| Euroscorea | 6.8 (3.5) | 10.5 (3.1) | < 0.001 |
| Preoperative hemoglobin, g/dL | 12.9 (1.9) | 10.7 (2.1) | < 0.001 |
| Preoperative serum creatinine, mg/dL | 1.0 (0.3) | 1.6 (0.7) | < 0.001 |
| Preoperative eGFRb, mL/min/1.73 m2 | 76 (22) | 49 (24) | < 0.001 |
| Preoperative eGFR < 60 mL/min/1.73 m2 | 136 (23.5) | 16 (64.0) | < 0.001 |
| Intraoperative/postoperative risk factors | |||
| Reoperation | 123 (21.3) | 11 (44.0) | 0.01 |
| Surgical procedure | |||
| On-pump CABG | 105 (18.2) | 1 (4.0) | 0.16 |
| Off-pump CABG | 23 (4.0) | 0 (0.0) | |
| Valve ± other | 321 (55.5) | 15 (60.0) | |
| Aortic root ± other | 84 (14.5) | 5 (20.0) | |
| Ventricular assist device/extracorporeal membrane oxygenation/transplant/other | 45 (7.8) | 4 (16.0) | |
| Case urgency | |||
| Elective | 445 (77.0) | 11 (44.0) | < 0.001 |
| Nonelective | 133 (23.0) | 14 (56.0) | |
| Cardiopulmonary bypass duration | 106 (48) | 173 (78) | < 0.001 |
| Nadir intraoperative hemoglobin, g/dL | 8.3 (1.4) | 7.6 (0.9) | < 0.001 |
| Peak intraoperative glucose, mg/dL | 189 (47) | 226 (65) | 0.01 |
| pRBC transfusion, n (%) | 224 (38.8) | 20 (80.0) | < 0.001 |
| Transfused volume of pRBCs (mL) | |||
| Intraoperatively | 0 (0–250) | 750 (0–1,250) | < 0.001 |
| Within 48 hr postoperatively | 0 (0–0) | 0 (0–1,300) | < 0.001 |
| Outcomes | |||
| Acute kidney injuryc | |||
| Total | 134 (23.2) | 21 (84.0) | < 0.001 |
| Stage 1 | 108 (18.7) | 6 (24.0) | |
| Stage 2 | 18 (3.1) | 2 (8.0) | |
| Stage 3 | 8 (1.4) | 13 (52.0) | |
| Length of stay (d) | |||
| ICU | 2.3 (1.3–4.3) | 10.1 (6.1–21.5) | < 0.001 |
| Hospital | 8.5 (6.6–11.6) | 19.6 (10.8–23.6) | < 0.001 |
eGFR = estimated glomerular filtration rate, CABG = coronary artery bypass graft, pRBC = packed RBC.
Euroscore calculated from modified variables defined according to data available within the medical record and institutional usage to reasonably reflect Euroscore definitions.
eGFR calculated according to the Chronic Kidney Disease Epidemiology Collaboration equation.
Acute kidney injury defined over 7 days postoperatively according to creatinine-based Kidney Disease: Improving Global Outcomes practice guidelines.
Urine collection was near complete with 2,400 of a possible 2,412 samples (99.5%) available for analysis. At all time points, urinary NGAL was higher in outcome (+) patients compared with outcome (−) patients (Fig. 2; Supplemental Table 1, Supplemental Digital Content 1, http://links.lww.com/CCM/B221). Thresholds for the upper quartile of NGAL concentration were serially identified at 14, 85, 34, and 41 ng/mL, respectively, for each of the four time points of measurement. The first postoperative SCr measurement was available at a known time in 602 patients, measured within 3 hours of ICU admission in 90% of patients. This value was greater than or equal to preoperative SCr in 201 patients (33.4%), the incremental change in SCr greater in outcome (+) compared with outcome (−) patients even at this early postoperative time point (Fig. 3). ΔSCr-initial greater than or equal to 0.0 mg/dL and ΔSCr-peak day 1 greater than or equal to 0.2 mg/dL were identified as novel thresholds against which urinary NGAL within 3 hours of CPB and urinary NGAL measured 18–24 hours after CPB, respectively, could be pragmatically compared or combined.
Figure 2.

Urinary neutrophil gelatinase–associated lipocalin (NGAL) values, absolute (ng/mL) and adjusted for urinary creatinine (Ucr; ng/mg), according to patient outcome of hospital mortality or renal replacement therapy. p ≤ 0.001 at all time points. CPB = cardiopulmonary bypass, IQR = interquartile range.
Figure 3.

Delta serum creatinine (SCr) values according to patient outcome of hospital mortality or renal replacement therapy. p ≤ 0.002 at all time points.
At all measured time points, the primary outcome occurred more frequently in patients with urinary NGAL levels in the upper quartile compared with the combined lower three quartiles (Supplemental Table 2, Supplemental Digital Content 1, http://links.lww.com/CCM/B221). Urinary NGAL provided fair-to-good discrimination for the primary composite outcome with area under the receiver operator characteristic curve (ROCAUC) greatest when measured 18–24 hours post-CPB (ROCAUC, 0.89; 95% CI, 0.81–0.97) (Supplemental Table 3, Supplemental Digital Content 1, http://links.lww.com/CCM/B221). Adjusted for Euroscore, baseline renal dysfunction (estimated glomerular filtration rate < 60 mL/min/1.73 m2), and CPB duration, NGAL provided its greatest prognostic value when measured 18–24 hours post-CPB (odds ratio [OR], 18.6; 95% CI, 5.1–68.4; p = 0.001). Adjusting for urinary creatinine concentration had an inconsistent effect on prognostic utility while likelihood testing found no interaction between NGAL and baseline renal dysfunction for predicting the primary outcome (Table 2). Adjusted for the same covariates, a KDIGO diagnosis of AKI within 7 days postoperatively was associated with a 10-fold increase in odds for hospital mortality or RRT, but this was attenuated and identified fewer patients when the same criteria were applied over shorter time periods after surgery. By contrast, ΔSCr-initial greater than or equal to 0.0 mg/dL provided good prognostic value for the primary outcome (OR, 8.9; 95% CI, 3.0–26.6). Added to established risk factors of baseline renal dysfunction, Euroscore, and duration of CPB, urinary NGAL measured 18–24 hours post-CPB raised the c-statistic of the multivariable model from 0.86 (95% CI, 0.79–0.92) to 0.93 (95% CI, 0.89–0.97; p for difference = 0.01), with IDI suggesting improved risk classification for patients in whom the primary outcome occurred (Supplemental Table 4, Supplemental Digital Content 1, http://links.lww.com/CCM/B221). Earlier postoperative NGAL measures were of less certain benefit.
TABLE 2.
Adjusteda Odds Ratios for Composite Outcome of Hospital Mortality or Initiation of Renal Replacement Therapy Using Urinary Neutrophil Gelatinase–Associated Lipocalinb and Varying Creatinine-Based Metrics of Renal Injury
| Composite Outcome | Hospital Mortality | Renal Replacement Therapy | ||||||
|---|---|---|---|---|---|---|---|---|
| Biomarker | n | OR (95% CI) | P | c-Statistic (95% CI) | OR (95% CI) | P | OR (95% CI) | P |
| NGAL: upper quartile at each time point | ||||||||
| NGALbaseline | 148 | 4.0 (1.5–10.3) | 0.005 | 0.88 (0.81–0.95) | 1.8 (0.5–6.1) | 0.36 | 6.7 (1.7–25.6)c | 0.006 |
| NGAL< 1 hr post-CPB | 150 | 2.8 (1.1–6.9) | 0.03 | 0.88 (0.82–0.94) | 1.8 (0.6–5.8) | 0.33 | 3.3 (1.0–10.7) | 0.05 |
| NGAL3hr post-CPB | 146 | 5.2 (1.8–15.7) | 0.003 | 0.88 (0.81–0.95) | 3.6 (0.9–15.1) | 0.08 | 10.6 (2.1–52.9) | 0.004 |
| NGAL18–24 hr post-CPB | 147 | 18.6 (5.1–68.4) | < 0.001 | 0.93 (0.89–0.97)d | 21.6 (3.7–125) | 0.001 | 10.9 (2.3–51.1) | 0.003 |
| NGAL (corrected for urinary creatinine): upper quartile at each time point | ||||||||
| NGALbaseline | 150 | 5.9 (2.2–16.2) | 0.001 | 0.89 (0.82–0.95) | 5.3 (1.4–19.8) | 0.01 | 12.5 (2.6–59.9) | 0.002 |
| NGAL< 1 hr post-CPB | 150 | 3.2 (1.3–8.2) | 0.02 | 0.88 (0.82–0.94) | 2.4 (0.7–7.9) | 0.16 | 3.2 (1.0–10.4) | 0.05 |
| NGAL3 hr post-CPB | 148 | 4.9 (1.6–14.6) | 0.004 | 0.88 (0.81–0.95) | 1.9 (0.5–7.4) | 0.35 | 9.8 (2.0–48.3) | 0.005 |
| NGAL18–24 hr post-CPB | 150 | 27.8 (6.0–129) | < 0.001 | 0.94 (0.90–0.97)d | 57.8 (5.3–636) | 0.001 | 22.9 (2.9–183) | 0.003 |
| Varying serum creatinine-based metrics of renal injury | ||||||||
| AKIKDIGO-ICU admite | 16 | 2.7 (0.6–13.1) | 0.21 | 0.85 (0.79–0.92) | 4.4 (0.8–24.5) | 0.09 | 1.7 (0.2–17.4) | 0.64 |
| ΔSCr-initialf ≥ 0.0 mg/dL | 201 | 8.9 (3.0–26.6) | < 0.001 | 0.90 (0.84–0.95) | 22.5 (3.8–133) | 0.001 | 5.7 (1.6–20.1) | 0.007 |
| AKI KDIGO-24 hrg | 67 | 7.5 (3.0–19.1) | < 0.001 | 0.89 (0.84–0.95) | 5.2 (1.5–17.3) | 0.008 | 9.9 (3.0–33.3) | 0.001 |
| ΔSCr-peak day 1h ≥ 0.2 mg/dL | 129 | 5.3 (2.1–13.4) | 0.001 | 0.88 (0.82–0.94) | 5.4 (1.5–19.4) | 0.009 | 7.1 (2.1–24.6) | 0.002 |
| AKIKDIGOi | 155 | 10.0 (3.2–31.2) | < 0.001 | 0.92 (0.88–0.96)d | 3.4 (0.9–12.1) | 0.06 | - | - |
OR = odds ratio, NGAL = neutrophil gelatinase–associated lipocalin, CPB = cardiopulmonary bypass, AKI = acute kidney injury, KDIGO = Kidney Disease: Improving Global Outcomes, SCr = serum creatinine.
Adjusted for Euroscore, baseline estimated glomerular filtration rate < 60 mL/min/1.73 m2, and duration of CPB. Euroscore calculated from modified variables defined according to data available within the medical record and institutional usage to reasonably reflect Euroscore definitions. c-Statistic for base model: 0.86 (95% CI, 0.79–0.92).
Upper quartile at each time point compared to lower three quartiles combined.
Hosmer-Lemeshow goodness-of-fit testing p < 0.05. For all other models tested, p > 0.05.
p < 0.05 when compared with c-statistic of multivariable base model without renal injury marker.
AKI defined by creatinine-based KDIGO guidelines using baseline and initial postoperative SCr only.
ΔSCr-initial defined as initial postoperative SCr – preoperative SCr.
AKI defined by creatinine-based KDIGO guidelines applied over 24 hr postoperatively only.
ΔSCr-peak day 1 defined as peak SCr within 24 hr postoperatively – preoperative SCr.
AKI defined by creatinine-based KDIGO guidelines over 7 days postoperatively.
Dashes indicate the data was not calculable. No patient receiving renal replacement therapy while in hospital failed to meet creatinine-based criteria for AKI within 7 days postoperatively.
Adjusted for the same covariates, patients designated NGAL+ within 3 hours of CPB but who remained SCr–through 7 postoperative days by KDIGO criteria demonstrated no increase in odds for the primary composite outcome compared with NGAL–/SCr– patients (Table 3). By contrast, patients identified as both NGAL+ and SCr+ at any time post-CPB had a consistent and dramatic increase in odds for in-hospital mortality or RRT.
TABLE 3.
Adjusteda Odds Ratios for Composite Outcome of Hospital Mortality or Initiation of Renal Replacement Therapy Associated With Neutrophil Gelatinase–Associated Lipocalin and Serum Creatinine Statusb
| OR (95% CI) | |||||
|---|---|---|---|---|---|
| Biomarker (Sampling Time) | NGAL-/SCr- | NGAL+/SCr- | NGAL-/SCr+ | NGAL+/SCr+ | c-Statistic (95% CI) |
| Uncorrected (raw) NGAL | |||||
| NGAL< 1 hr post-CPB | 1.00 (reference) | 1.9 (0.2–13.9) | 7.6 (1.5–38.8) | 24.5 (5.0–122) | 0.93 (0.90–0.97) |
| n = 344 | n = 104 | n = 107 | n = 46 | ||
| NGAL3hr post-CPB | 1.00 (reference) | 4.3 (0.4–49.4) | 12.3 (1.3–112) | 58.6 (7.0–489) | 0.94 (0.90–0.97) |
| n = 351 | n = 95 | n = 97 | n = 51 | ||
| NGAL18–24 hr post-CPB | 1.00 (reference) | 9.9 (1.0–100) | 4.7 (0.4–55.2) | 74.5 (9.4–594) | 0.95 (0.93–0.98) |
| n = 365 | n = 82 | n = 90 | n = 65 | ||
| Corrected for urinary creatinine | |||||
| NGAL< 1 hr post-CPB | 1.00 (reference) | 5.2 (0.5–51.8) | 14.4 (1.7–122) | 50.8 (6.1–424) | 0.94 (0.91–0.97) |
| n = 341 | n = 107 | n = 110 | n = 43 | ||
| NGAL3 hr post-CPB | 1.00 (reference) | 3.4 (0.3–40.6) | 10.8 (1.2–99.9) | 53.3 (6.5–440) | 0.94 (0.90–0.97) |
| n = 351 | n = 95 | n = 95 | n = 53 | ||
| NGAL18–24 hr post-CPB | 1.00 (reference) | 6.8 (0.7–69.9) | 1.7 (0.1–29.5) | 91.4 (11.3–737) | 0.96 (0.93–0.99) |
| n = 356 | n = 91 | n = 96 | n = 59 | ||
OR = odds ratio, NGAL = neutrophil gelatinase–associated lipocalin, SCr = serum creatinine, CPB = cardiopulmonary bypass.
Adjusted for Euroscore, baseline estimated glomerular filtration rate < 60 mL/min/1.73 m2, and duration of CPB. Euroscore calculated from modified variables defined according to data available within the medical record and institutional usage to reasonably reflect Euroscore definitions.
NGAL+ defined by upper quartile of urinary NGAL at each time point (NGAL > 85, > 34, and > 41 ng/mL at < 1 hr post-CPB, 3 hr post-CPB, and 18–24 hr post-CPB, respectively; corrected NGAL > 422, > 125, and > 44 ng/mg creatinine at < 1 hr post-CPB, 3 hr post-CPB, and 18–24 hr post-CPB, respectively). SCr + defined as acute kidney injury according to creatinine-based Kidney Disease: Improving Global Outcomes practice guidelines applied over 7 days postoperatively.Cr
A pragmatic analysis was then undertaken, redefining SCr+ as either ΔSCr-initial greater than or equal to 0.0 mg/dL (to combine with either NGAL< 1 hr or NGAL3 hr post-CPB) or ΔSCr-peak day 1 greater than or equal to 0.2 mg/dL (to combine with NGAL18–24 hr post-CPB) simulating what might occur if both biomarkers were readily available in the clinical environment. After adjusting for covariates and at all time points post-CPB, patients defined as NGAL+ and SCr+ demonstrated a marked increase in odds for in-hospital death or RRT, the prognostic value of the combination appearing greater than for either biomarker alone, improving the c-statistic of the base model from 0.86 to 0.90–0.94 (p for difference ≤ 0.02 at all time points) (Table 4).
TABLE 4.
Adjusteda Odds Ratios for Composite Outcome of Hospital Mortality or Initiation of Renal Replacement Therapy Associated With Neutrophil Gelatinase–Associated Lipocalin/Serum Creatinine Statusb
| OR (95% CI) | |||||
|---|---|---|---|---|---|
| Biomarker (Sampling Time) | NGAL-/SCr- | NGAL+/SCr- | NGAL-/SCr+ | NGAL+/SCr+ | c-Statistic (95% CI) |
| Uncorrected (raw) NGAL | |||||
| NGAL< 1 hr post-CPB | 1.00 (reference) | 1.0 (0.2–4.5) | 3.5 (0.7–16.5) | 13.7 (3.8–48.7) | 0.91 (0.85–0.96)c |
| n = 313 | n = 88 | n = 138 | n = 61 | ||
| NGAL3 hr post-CPB | 1.00 (reference) | 2.3 (0.5–10.9) | 2.9 (0.4–19.9) | 18.3 (4.5–75.0) | 0.90 (0.84–0.96)c |
| n = 314 | n = 86 | n = 134 | n = 59 | ||
| NGAL18–24 hr post-CPB | 1.00 (reference) | 22.6 (2.6–194) | 6.2 (0.5–73.9) | 71.6 (8.7–588) | 0.94 (0.89–0.98)c |
| n = 379 | n = 94 | n = 76 | n = 53 | ||
| Corrected for urinary creatinine | |||||
| NGAL< 1 hr post-CPB | 1.00 (reference) | 2.8 (0.6–12.9) | 7.8 (1.5–40.1) | 21.6 (4.9–94.5) | 0.91 (0.85–0.96)c |
| n = 311 | n = 90 | n = 140 | n = 59 | ||
| NGAL3 hr post-CPB | 1.00 (reference) | 3.8 (0.7–20.7) | 5.8 (0.9–39.5) | 27.1 (5.3–140) | 0.91 (0.85–0.96)c |
| n = 304 | n = 96 | n = 142 | n = 51 | ||
| NGAL18–24 hr post-CPB | 1.00 (reference) | 17.0 (1.9–148) | 2.5 (0.1–43.6) | 90.1 (10.9–743) | 0.94 (0.90–0.98)c |
| n = 369 | n = 104 | n = 83 | n = 46 | ||
OR = odds ratio, NGAL = neutrophil gelatinase–associated lipocalin, SCr = serum creatinine, CPB = cardiopulmonary bypass.
Adjusted for Euroscore, baseline estimated glomerular filtration rate < 60 mL/min/1.73 m2, and duration of CPB. Euroscore calculated from modified variables defined according to data available within the medical record and institutional usage to reasonably reflect Euroscore definitions.
NGAL+ defined by upper quartile of urinary NGAL at each time point (NGAL > 85, > 34, and > 41 ng/mL at < 1 hr post-CPB, 3 hr post-CPB, and 18–24 hr post-CPB, respectively; corrected NGAL > 422, > 125, and > 44 ng/mg creatinine at < 1 hr post-CPB, 3 hr post-CPB, and 18–24 hr post-CPB, respectively). SCr + defined according to study-specific creatinine-based definitions available at times comparable to urinary NGAL measurement (< 1 hr post-CPB and 3 hr post-CPB SCr+ defined as ΔSCr-initial ≥ 0.0 mg/dL; 18–24 hr post-CPB SCr+ defined as ΔSCr-peak day 1 ≥ 0.2 mg/dL).
p < 0.05 when compared with c-statistic of multivariable base model without renal injury marker (0.86; 95% CI, 0.79–0.92).
SCr status defined by study-specific creatinine-based definitions available at times comparable to each urinary NGAL measurement.
Defined by creatinine-based KDIGO guidelines AKI occurred in 155 patients (25.7%), 138 of whom had an absolute increase in SCr greater than or equal to 0.3 mg/dL within 48 hours postoperatively while SCr increased by greater than or equal to 50% above baseline within 7 days postoperatively in 95 patients. Post-CPB urinary NGAL demonstrated limited ability to identify patients with a creatinine-based diagnosis of AKI (ROCAUC’ 0.59–0.65). Performance did not differ according to baseline renal dysfunction. Adjusted for covariates it was only when measured 18–24 hours post-CPB that urinary NGAL provided any association with a conventional diagnosis of AKI (Supplemental Tables 5–7, Supplemental Digital Content 1 http://links.lww.com/CCM/B221). By contrast, ΔSCr-initial greater than or equal to 0.0 mg/dL provided independent prognostic utility for a subsequent KDIGO diagnosis of AKI within 7 days postoperatively (OR, 2.6; 95% CI, 1.7–4.1), the magnitude of which increased when combined with an elevated urinary NGAL measured 3 hours post-CPB (NGAL+/SCr+ OR, 3.7; 95% CI, 1.9–7.4).
DISCUSSION
Key Findings
In a heterogenous cohort of adult patients undergoing cardiac surgery, urinary NGAL measured 18–24 hours post-CPB provided independent prognostic utility for important adverse outcomes that may reflect AKI. However, used in isolation, its validity and prognostic utility prior to this time point remain uncertain, limiting its value as an early diagnostic tool. By contrast, when the first postoperative SCr measure failed to decline from baseline (ΔSCr-initial ≥ 0.0 mg/dL), the odds for hospital mortality or RRT were similar to that seen with an established creatinine-based definition of AKI applied over 7 days postoperatively. Simple combination of this early ΔSCr together with urinary NGAL, both measured around the time of postoperative ICU admission, demonstrated powerful prognostic utility for the composite outcome of hospital mortality or RRT. This may represent a previously unavailable opportunity for early identification of patients at highest risk of adverse outcomes, providing the opportunity to institute and evaluate highly targeted renoprotective strategies at a time when they may still be effective.
Relationship With Previous Studies
A small reduction in SCr commonly occurs early after cardiac surgery, reported in approximately 50% of patients (9, 28). However, despite small postoperative increases in SCr consistently associated with increased mortality (7–9), the 48-hour window typically used to assess these changes is well beyond the diagnostic time frame thought necessary for effective early intervention. More recently, small increases in SCr as early as 6 hours after cardiac surgery demonstrated prognostic utility for a creatinine-based diagnosis of AKI through 7 days postoperatively (28) although this highly selected cohort was underpowered to assess important clinical outcomes. The current study supports and extends the evidence for a low threshold ΔSCr measurement in the immediate postoperative period to enable early identification of clinically important renal injury in a heterogenous cohort of patients undergoing cardiac surgery.
The existence of an early and valid creatinine-based signal of renal injury within just a few hours of cardiac surgery challenges existing paradigms. However, any increase in SCr can only occur through a reduction in creatinine clearance (glomerular filtration rate [GFR]), an increase in creatinine production, or a reduction in apparent volume of distribution for creatinine (total body water). Sophisticated kinetic modeling suggests that the rise in SCr following an acute reduction in GFR is relatively slow (29), with any increase likely further delayed and limited by dilution of SCr occurring secondary to the increase in total body water typically associated with cardiac surgery or critical illness (30, 31). However, rate of change in SCr may also be subject to changes in creatinine production, a variable that remains largely unexplored in the context of cardiac surgery. Although speculative, an increase in creatinine production during cardiac surgery offers a plausible mechanism by which an early postoperative rise in SCr (or failure to decline) may reflect even mild reductions in GFR to provide unexpectedly early prognostic utility for AKI and associated adverse outcomes.
Despite numerous studies of NGAL as a potential early marker of AKI, few have been specifically designed and powered to assess the relationship between NGAL and clinically relevant adverse outcomes that are a consequence of AKI. In a pooled analysis of 10 studies, Haase et al (32) compared NGAL with a creatinine-based Risk, Injury, Failure, Loss and End-stage definition of AKI over 7 days and reported a 3.6-fold increase in hospital mortality or RRT for patients designated NGAL+/SCr–, suggesting that NGAL may facilitate early detection of subclinical AKI. However, lack of patient-level data together with single NGAL measurements at varied time points and on varying analytic platforms make cautious interpretation of this study essential. In a multicenter study of more than 1,200 adult patients undergoing cardiac surgery, increasing quintiles of both urinary and plasma NGAL were associated with a composite of hospital mortality or RRT (17). Nevertheless, prognostic utility of NGAL and creatinine-based measures of renal injury were not directly compared. The relationship between urinary NGAL and AKI, dialysis, and death was further explored in 591 patients within an ICU (33). However, a minority of these patients underwent cardiac surgery, and the only reported metric of biomarker performance was a c-statistic which, in isolation, does not adequately assess the relationship between a putative AKI biomarker and outcomes such as mortality or dialysis that are not expected to occur in every patient with AKI (34). More recently, Arthur et al (35) demonstrated enhanced prognostic utility for AKI progression by combining a ΔSCr term with NGAL and other novel biomarkers. However, in contrast to the current study, the ΔSCr term used by these investigators was identified only after SCr had already risen sufficiently to define the presence of AKI by conventional criteria with no analysis of the potential for early recognition of evolving injury.
Implications
Despite the typically early rise in NGAL following CPB in the current study, it was only 18–24 hours later that it provided clear and consistent prognostic utility for adverse outcomes with greater magnitude than established creatinine-based definitions of AKI. Such delayed recognition likely misses any window for effective institution of renoprotective strategies and is in stark contrast with the known rapid up-regulation of NGAL in response to injury (11, 16). Although our findings may indicate the importance of continued or additional renal insults beyond the intraoperative period, the remarkable increase in prognostic utility when combining earlier measures of both NGAL and ΔSCr may suggest an alternate explanation. NGAL is produced by multiple cell types, including inflammatory cells (10), and exists in at least three molecular formats that may vary with cellular origin (36). Current quantitative assays do not reliably differentiate these varying forms (37–39), and the typical surge in urinary NGAL soon after CPB may comprise significant amounts of extrarenal NGAL, with limited diagnostic utility for AKI. Combining these early measures of NGAL with similarly early ΔSCr may effectively select elevated NGAL that is predominantly renal in origin to better reflect true renal injury. However, although previous studies confirm potential elevation of urinary NGAL by leukocyturia (40, 41), a similar effect from the immediate post-CPB systemic inflammatory surge on “nonrenal” NGAL present in urine remains speculative. Alternatively, enhanced prognostic utility from combining NGAL with an early creatinine-based signal may simply reflect the expected improvement in predictive performance of a diagnostic test when pretest probability for the outcome of interest is increased.
Strengths and Limitations
Despite the relatively large size of our cohort, specifically addressing clinical endpoints, the limited number of outcomes and single-center setting preclude definitive conclusions and our findings should be confirmed in a larger multicenter cohort. Limited number of outcomes for analysis also precluded more detailed multivariable modeling or subgroup analyses to explore consistency of prognostic utility across a spectrum of baseline renal function. Nevertheless, covariates included in the multivariable model were selected on the basis of existing data supporting their prognostic relevance for mortality, RRT, or both after cardiac surgery while attempting to avoid model overfitting (42). Inclusion of all-cause mortality in our primary outcome may be criticized as nonspecific for renal injury. However, even mild forms of AKI are consistently associated with increased mortality for reasons that remain unclear, making this an essential endpoint for biomarker evaluation (22). Furthermore, enhanced prognostic utility for a creatinine-based diagnosis of AKI when combining urinary NGAL and ΔSCr strengthens the construct that this biomarker combination reflects true renal injury. Although the study cohort is nonconsecutive, the method of case selection is unlikely to have introduced systematic bias. Measurement of NGAL relied on a research-based ELISA technique with an inherent level of measurement error and imprecision. Nevertheless, high correlation between the commercially available ARCHITECT assay (Abbott Diagnostics, Abbot Park, IL) and other ELISA methodology has been demonstrated (17). Although the first postoperative SCr measurement occurred across a range of times not precisely matched with urinary NGAL measurement, the tested combinations represent a pragmatic assessment of typical, real-world practice likely achievable in a nonstudy context.
CONCLUSIONS
Urinary NGAL measured 18–24 hours after adult cardiac surgery provides important prognostic information for serious adverse outcomes. Limited prognostic utility prior to this time may be greatly enhanced by combining earlier NGAL measurement with a similarly early and novel ΔSCr-based metric of injury to enable highly effective early risk stratification. If confirmed, this novel biomarker combination may offer a previously unavailable early opportunity to institute and evaluate highly targeted renoprotective strategies after cardiac surgery.
Supplementary Material
ACKNOWLEDGMENTS
We gratefully acknowledge the expert assistance and input of Dr. John Pickering in conducting the analysis of integrated discrimination improvement for this article.
Supported, in part, by the Department of Anesthesiology and Department of Surgery, New York Presbyterian hospital, New York, NY.
Mr. McIlroy consulted for GE. His institution received grant support from multiple grants from the Australian and New Zealand College of Anaesthetists and Society of Cardiovascular Anaesthesiologists. Dr. Lee’s institution received support from multiple National Institute of Health grants for laboratory work (R01). The remaining authors have disclosed that they do not have any potential conflicts of interest.
Footnotes
This work was performed at New York Presbyterian Hospital, New York, NY.
Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal’s website http://journals.lww.com/ccmjournal.
REFERENCES
- 1.Dasta JF, Kane-Gill SL, Durtschi AJ, et al. : Costs and outcomes of acute kidney injury (AKI) following cardiac surgery. Nephrol Dial Transplant 2008; 23:1970–1974 [DOI] [PubMed] [Google Scholar]
- 2.Hobson CE, Yavas S, Segal MS, et al. : Acute kidney injury is associated with increased long-term mortality after cardiothoracic surgery. Circulation 2009; 119:2444–2453 [DOI] [PubMed] [Google Scholar]
- 3.Karkouti K, Wijeysundera DN, Yau TM, et al. : Acute kidney injury after cardiac surgery: Focus on modifiable risk factors. Circulation 2009; 119:495–502 [DOI] [PubMed] [Google Scholar]
- 4.Kramer RS, Quinn RD, Groom RC, et al. ; Northern New England Cardiovascular Disease Study Group: Same admission cardiac catheterization and cardiac surgery: Is there an increased incidence of acute kidney injury? Ann Thorac Surg 2010; 90:1418–1423; discussion 1423–1424 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Moore E, Bellomo R, Nichol A: Biomarkers of acute kidney injury in anesthesia, intensive care and major surgery: From the bench to clinical research to clinical practice. Minerva Anestesiol 2010; 76:425–440 [PubMed] [Google Scholar]
- 6.Bagshaw SM, Bellomo R: Early diagnosis of acute kidney injury. Curr Opin Crit Care 2007; 13:638–644 [DOI] [PubMed] [Google Scholar]
- 7.Lassnigg A, Schmid ER, Hiesmayr M, et al. : Impact of minimal increases in serum creatinine on outcome in patients after cardiothoracic surgery: Do we have to revise current definitions of acute renal failure? Crit Care Med 2008; 36:1129–1137 [DOI] [PubMed] [Google Scholar]
- 8.Lassnigg A, Schmidlin D, Mouhieddine M, et al. : Minimal changes of serum creatinine predict prognosis in patients after cardiothoracic surgery: A prospective cohort study. J Am Soc Nephrol 2004; 15:1597–1605 [DOI] [PubMed] [Google Scholar]
- 9.Tolpin DA, Collard CD, Lee VV, et al. : Subclinical changes in serum creatinine and mortality after coronary artery bypass grafting. J Thorac Cardiovasc Surg 2012; 143:682.e1–688.e1 [DOI] [PubMed] [Google Scholar]
- 10.Mori K, Nakao K: Neutrophil gelatinase-associated lipocalin as the real-time indicator of active kidney damage. Kidney Int 2007; 71:967–970 [DOI] [PubMed] [Google Scholar]
- 11.Mishra J, Ma Q, Prada A, et al. : Identification of neutrophil gelatinase-associated lipocalin as a novel early urinary biomarker for ischemic renal injury. J Am Soc Nephrol 2003; 14:2534–2543 [DOI] [PubMed] [Google Scholar]
- 12.Supavekin S, Zhang W, Kucherlapati R, et al. : Differential gene expression following early renal ischemia/reperfusion. Kidney Int 2003; 63:1714–1724 [DOI] [PubMed] [Google Scholar]
- 13.Haase M, Bellomo R, Devarajan P, et al. ; NGAL Meta-analysis Investigator Group: Accuracy of neutrophil gelatinase-associated lipocalin (NGAL) in diagnosis and prognosis in acute kidney injury: A systematic review and meta-analysis. Am J Kidney Dis 2009; 54:1012–1024 [DOI] [PubMed] [Google Scholar]
- 14.Haase-Fielitz A, Bellomo R, Devarajan P, et al. : Novel and conventional serum biomarkers predicting acute kidney injury in adult cardiac surgery—A prospective cohort study. Crit Care Med 2009; 37:553–560 [DOI] [PubMed] [Google Scholar]
- 15.Koyner JL, Bennett MR, Worcester EM, et al. : Urinary cystatin C as an early biomarker of acute kidney injury following adult cardiothoracic surgery. Kidney Int 2008; 74:1059–1069 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Mishra J, Dent C, Tarabishi R, et al. : Neutrophil gelatinase-associated lipocalin (NGAL) as a biomarker for acute renal injury after cardiac surgery. Lancet 2005; 365:1231–1238 [DOI] [PubMed] [Google Scholar]
- 17.Parikh CR, Coca SG, Thiessen-Philbrook H, et al. ; TRIBE-AKI Consortium: Postoperative biomarkers predict acute kidney injury and poor outcomes after adult cardiac surgery. J Am Soc Nephrol 2011; 22:1748–1757 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Tuladhar SM, Püntmann VO, Soni M, et al. : Rapid detection of acute kidney injury by plasma and urinary neutrophil gelatinase-associated lipocalin after cardiopulmonary bypass. J Cardiovasc Pharmacol 2009; 53:261–266 [DOI] [PubMed] [Google Scholar]
- 19.Wagener G, Gubitosa G, Wang S, et al. : Urinary neutrophil gelatinase-associated lipocalin and acute kidney injury after cardiac surgery. Am J Kidney Dis 2008; 52:425–433 [DOI] [PubMed] [Google Scholar]
- 20.Xin C, Yulong X, Yu C, et al. : Urine neutrophil gelatinase-associated lipocalin and interleukin-18 predict acute kidney injury after cardiac surgery. Ren Fail 2008; 30:904–913 [DOI] [PubMed] [Google Scholar]
- 21.Waikar SS, Betensky RA, Bonventre JV: Creatinine as the gold standard for kidney injury biomarker studies? Nephrol Dial Transplant 2009; 24:3263–3265 [DOI] [PubMed] [Google Scholar]
- 22.Parikh CR, Garg AX: Testing new biomarkers for acute kidney injury: Association, prediction, and intervention. Am J Kidney Dis 2009; 54:987–989 [DOI] [PubMed] [Google Scholar]
- 23.Kidney Disease: Improving global outcomes (KDIGO) Acute Kidney Injury Work Group: KDIGO Clinical Practice Guideline for Acute Kidney Injury. Kidney Int 2012; Suppl 2:1–138 [Google Scholar]
- 24.Englberger L, Suri RM, Li Z, et al. : Clinical accuracy of RIFLE and Acute Kidney Injury Network (AKIN) criteria for acute kidney injury in patients undergoing cardiac surgery. Crit Care 2011; 15:R16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Robert AM, Kramer RS, Dacey LJ, et al. ; Northern New England Cardiovascular Disease Study Group: Cardiac surgery-associated acute kidney injury: A comparison of two consensus criteria. Ann Thorac Surg 2010; 90:1939–1943 [DOI] [PubMed] [Google Scholar]
- 26.Pencina MJ, D’Agostino RB Sr, D’Agostino RB Jr, et al. : Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Stat Med 2008; 27:157–172 [DOI] [PubMed] [Google Scholar]
- 27.von Elm E, Altman DG, Egger M, et al. ; STROBE Initiative: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. J Clin Epidemiol 2008; 61:344–349 [DOI] [PubMed] [Google Scholar]
- 28.Ho J, Reslerova M, Gali B, et al. : Serum creatinine measurement immediately after cardiac surgery and prediction of acute kidney injury. Am J Kidney Dis 2012; 59:196–201 [DOI] [PubMed] [Google Scholar]
- 29.Waikar SS, Bonventre JV: Creatinine kinetics and the definition of acute kidney injury. J Am Soc Nephrol 2009; 20:672–679 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Macedo E, Bouchard J, Soroko SH, et al. ; Program to Improve Care in Acute Renal Disease Study: Fluid accumulation, recognition and staging of acute kidney injury in critically-ill patients. Crit Care 2010; 14:R82. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Pickering JW, Ralib AM, Endre ZH: Combining creatinine and volume kinetics identifies missed cases of acute kidney injury following cardiac arrest. Crit Care 2013; 17:R7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Haase M, Devarajan P, Haase-Fielitz A, et al. : The outcome of neutrophil gelatinase-associated lipocalin-positive subclinical acute kidney injury: A multicenter pooled analysis of prospective studies. J Am Coll Cardiol 2011; 57:1752–1761 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Endre ZH, Pickering JW, Walker RJ, et al. : Improved performance of urinary biomarkers of acute kidney injury in the critically ill by stratification for injury duration and baseline renal function. Kidney Int 2011; 79:1119–1130 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Cook NR: Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 2007; 115:928–935 [DOI] [PubMed] [Google Scholar]
- 35.Arthur JM, Hill EG, Alge JL, et al. ; SAKInet Investigators: Evaluation of 32 urine biomarkers to predict the progression of acute kidney injury after cardiac surgery. Kidney Int 2014; 85:431–438 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Cai L, Rubin J, Han W, et al. : The origin of multiple molecular forms in urine of HNL/NGAL. Clin J Am Soc Nephrol 2010; 5:2229–2235 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Cai L, Borowiec J, Xu S, et al. : Assays of urine levels of HNL/NGAL in patients undergoing cardiac surgery and the impact of antibody configuration on their clinical performances. Clin Chim Acta 2009; 403:121–125 [DOI] [PubMed] [Google Scholar]
- 38.Lippi G, Plebani M: Neutrophil gelatinase-associated lipocalin (NGAL): The laboratory perspective. Clin Chem Lab Med 2012; 50:1483–1487 [PubMed] [Google Scholar]
- 39.Mårtensson J, Xu S, Bell M, et al. : Immunoassays distinguishing between HNL/NGAL released in urine from kidney epithelial cells and neutrophils. Clin Chim Acta 2012; 413:1661–1667 [DOI] [PubMed] [Google Scholar]
- 40.Cullen MR, Murray PT, Fitzgibbon MC: Establishment of a reference interval for urinary neutrophil gelatinase-associated lipocalin. Ann Clin Biochem 2012; 49:190–193 [DOI] [PubMed] [Google Scholar]
- 41.Schinstock CA, Semret MH, Wagner SJ, et al. : Urinalysis is more specific and urinary neutrophil gelatinase-associated lipocalin is more sensitive for early detection of acute kidney injury. Nephrol Dial Transplant 2013; 28:1175–1185 [DOI] [PubMed] [Google Scholar]
- 42.Vittinghoff E, McCulloch CE: Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol 2007; 165:710–718 [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
