Abstract
Background
Acute kidney injury (AKI) often takes a complicated course if diagnosed late and undertreated. Electronic alerts that provide an early warning of AKI are intended to support treating physicians in making the diagnosis of AKI and treating it appropriately. The available evidence on the effects of such alert systems is inconsistent.
Methods
We employed the PRISMA recommendations for systematic literature reviews to identify relevant articles in the PubMed, Scopus, and Web of Science databases. All of the studies that were retrieved were independently assessed by two of the authors with respect to the methods of computer-assisted electronic alert systems and their effects on process indicators and clinical endpoints.
Results
16 studies with a total of 32 842 patients were identified. 8.5% of admitted patients had community-acquired or hospital-acquired AKI, with an in-hospital mortality of 22.8%. Fifteen electronic alert systems were in use throughout the participating hospitals. In 13 of 15 studies, alarm activation was accompanied by concrete treatment recommendations. A randomized controlled trial in which no such recommendations were given did not reveal any benefit of the alert system for the patients. In controlled but non-randomized trials, however, the provision of concrete treatment recommendations when the alert was activated led to more frequent implementation of diagnostic or therapeutic measures, less loss of renal function, lower in-hospital mortality, and lower mortality after discharge compared to control groups without an electronic alert for AKI.
Conclusion
Non-randomized controlled trials of electronic alerts for AKI that were coupled with treatment recommendations have yielded evidence of improved care processes and treatment outcomes for patients with AKI. This review is limited by the low number of randomized trials and the wide variety of endpoints used in the studies that were evaluated.
About one in 10 patients receiving inpatient treatment will develop acute kidney injury (AKI) (1, 2). Sawhney et al (1) even reported that 17.6% of patients with pre-existing chronic kidney disease developed AKI. Acute kidney injury reduces the therapeutic results for the specialist department that provides the primary treatment and is an independent risk factor for in-hospital mortality that is raised by several orders of magnitude (hazard ratio 1.4–15.4; 13–41% of cases) (1– 4). A typical and serious long-term consequence is the development or progression of chronic renal failure in 10–20% of cases (4, 5). Acute kidney injury has a greater incidence and a higher rate of complications than myocardial infarction (6).
The diagnosis is made on the basis of (7):
A defined rise in the serum creatinine concentration (>50% from the previous measurement within a maximum of 7 days, or >0.3 mg/dL [>26.4 µmol/L] within a maximum of 2 days or to >4.0 mg/dL [>354 µmol/L]);
And/or a reduction in diuresis (<0.5 mL/kg/BW/h over 6 hours);
And/or initiation of acute renal replacement therapy.
The stages of acute kidney injury are described in Table 1. The most common triggers of AKI are sepsis, complex surgical procedures, nephrotoxins, hypovolemia, cardiac decompensation, and urinary retention (8). Recommended effective countermeasures are early diagnosis and the initiation of rapid multifactorial measures (table 1), in order to identify as early as possible trigger factors and factors that support and maintain renal injury, and thereby create optimal conditions for complete or extensive renal recovery (7).
Table 1. Stages of acute kidney injury and measures (7).
Stage | Serum creatinine increase | Diuresis |
1 | >26.4 µmol/L within a maximum of 2 days or to >1.5–1.9 times the previous value | <0.5 ml/kg/h for >6 h |
2 | To >2.0–2.9 times the previous value | <0.5 ml/kg/h for >12 h |
3 | To >3.0 times the previous value or to 354 µmol/L or initiation of acute kidney replacement therapy |
<0.3 ml/kg/h for >24 h or anuria for >12 h |
Measures in acute kidney injury* | ||
|
*Further measures are at kdigo.org/clinical_practice_guidelines/pdf/KDIGO%20AKI%20Guideline.pdf (pp 8–10)
The duration of AKI crucially determines patients’ survival (AKI stage 1 for <2 days: mortality 13.7/100 person years versus AKI stage 3 for >7 days: mortality 43.8/100 person years) (9). If the diagnosis is delayed and insufficient therapeutic measures are initiated, this constitutes an independent risk factor (odds ratio 1.45; 95% confidence interval: [1.04; 2.039]) for higher in-hospital mortality (10). Optimized therapeutic care reduces the development of higher stages of AKI by some 50% and in-hospital mortality by 20% (11).
Electronic alerts or early warning systems are intended to enable earlier detection of acute kidney injury. Figure 1 shows the principle underlying an AKI early warning system. Some individual publications or narrative reviews found patient-relevant benefits (12, 13), and some others didn’t (14). What is not clear is whether consistent alert triggers were used and what the extent was to which the alarm signal targeted the recipients and provided concrete treatment recommendations.
On this background, we conducted a systematic literature search of the current level of knowledge regarding AKI early warning systems. We focused mainly on the characteristics of AKI alerting systems, including trigger, type, message, and recipient of the alerting process and on effects of AKI alerting systems on process indicators and patient-relevant endpoints.
Methods
Study design
To find answers to these questions, we summarized in the present review article the results of a systematic literature search according to the recommendations of the PRISMA statement (15). The study protocol was registered (www.crd.york.ac.uk/prospero, CRD42016041510, search term: “alert”). Two of the authors (CA/MH) independently identified studies and conducted screening, selection, and data extraction. In case of disagreement, this was resolved by discussion in a consensus decision or by the decision of a further author (A H-F).
Literature search
The Box shows a summary of the search strategy, search terms, extracted data, and endpoints (see eBoxes 1 and 2 for more detail). To identify appropriate studies we used the databases Medline, Scopus, and Web of Science, independently of the publication type and status and without any limits imposed on the time periods covered. Furthermore we regularly screened medical journals that were relevant for the subject matter of our review article, such as the New England Journal of Medicine, Lancet, Journal of the American Medical Association, (Clinical) Journal of the American Society of Nephrology, Clinical Kidney Journal, and conference abstracts; we searched study registries (clinical trials.gov, German Clinical Trials Register) for unpublished studies and took up reading recommendations from experts in the subject (effective date: 20 May 2016).
BOX. Summary of search criteria, extracted data, and endpoints*.
Databases:
PubMed, Scopus, Web of Science
(no filter, effective date: 20 May 2016)
Main search terms used:
acute kidney injury, creatinine, urine output, alert, biomarker
Extracted data:
Design, type of hospital, exclusion criteria, age of patients, sex, earlier creatinine level, funding sources, characteristis of alerting systems
-
- Endpoints:
Process indicators: medical measures to treat acute kidney injury, including renal ultrasonography, optimization of fluid status and hemodynamic status, measuring the acid–base balance, stopping nephrotoxic medication, adjusting medication to renal functioning, urinanalysis, including specialty consultant support
Patient-relevant endpoints (definitions in eTable 1b):
Stage and progression of acute kidney injury, initiation of acute kidney replacement therapy, recovery of renal function, length of inpatient stay, mortality in hospital or during follow-up
* Extensive information on the applied search terms and the way in which they were linked, on extracted data, and endpoint definitions are in eBoxes 1 and 2
eBOX 1. Literature databases, search terms, and literature search.
Search in PubMed, Scopus, and Web of Science
(no filter, search date 20 May 2016)
#1 acute kidney injury
#2 kidney injury
#3 acute renal failure
#4 renal failure
#5 kidney failure
#6 anuria
#7 oliguria
#8 urine output
#9 biomarker (u.a. creatinine, NGAL, lipocalin, cystatin C, cell cycle arrest markers, TIMP-2, IGFBP7)
#10 #1 OR #2 OR #3 OR #4 OR #5 OR #6 OR #7 OR #8 OR #9
#11 alert
#12 electronic alert
#13 recognition
#14 electronic recognition
#15 surveillance
#16 decision support
#17 #8 OR #9 OR #10 OR #11 OR #12 OR #13 OR #14 OR #15 OR #16
#18 #10 AND #17
NGAL, neutrophil gelatinase associated lipocalin;
TIMP-2, tissue inhibitor of metalloproteinases 2;
IGFBP7, insulin-like growth factor binding protein 7
eBOX 2. Extracted data and endpoints.
-
Extracted data:
Design, type of hospital, exclusion criteria, patients‘ age, sex, earlier creatinine measurement, funding sources, characteristics of alerting systems including trigger for AKI alert, recipient of alert and link to treatment recommendations, endpoints, and mode of alerting process/information transfer (fully or partly automated, or disruptive or non-disruptive [Figure 3)
-
Endpoints:
Process indicators: diagnostic or therapeutic measures for the treatment of acute kidney injury, including renal ultrasonography, optimization of fluid and hemodynamic status, determining the acid–base balance, stopping nephrotoxic medications, adjust medications according to renal function, urinalysis, including specialist consultant treatment
Patient-relevant endpoints (study-specific definitions in eTable 1b): Progression of acute kidney injury, initiation of acute kidney replacement therapy, recovery of renal function, duration of hospital inpatient stay, and—because of variable definitions —as a combined endpoint: in-hospital mortality or mortality on follow-up, as defined in the publications
Study selection
The inclusion criteria for our study were:
Patient population: Hospital inpatients
Intervention: Electronic alerting system for identifying patients with acute kidney injury (acquired on an inpatient or outpatient basis)
Reported endpoints: Characteristics of the alerting systems, including the trigger for the AKI alert, the type and targeted recipient of the alerting process, and the potential linking of the alert to treatment recommendations, as well as effects of the AKI alerting system on process indicators and patient-relevant endpoints.
Study design: (Pseudo) randomized studies, cohort studies.
We did not include studies that did not use electronic alerts for acute kidney injury.
Data extraction, endpoints, study quality, and study bias
Alert characteristics, process indicators, and patient-relevant endpoints from the studies were extracted by using a standardized study documentation sheet that had been developed a priori. For each study we extracted the dates and endpoints listed in eBox 2. Non-randomized controlled studies were assessed regarding the representativeness of the patient population, comparability of study groups, and quality of endpoint collection (Newcastle-Ottawa scale [16]), and regarding the risk of bias in the study results by using the ACROBAT-NRSi tool (A Cochrane-Risk-Of-Bias Assessment-Tool of non-randomised studies of interventions, http://methods.cochrane.org/bias/assessing-risk-bias-included-studies). We assessed randomized studies in terms of their reported approach to randomization and blinding and the description of the dropout rate (Jadad scale [17]). The current consensus is that a point value of <3 points on the Jadad scale indicates a notably reduced study quality (Two authors CA, MH) collected the scale point scores independently of one another. Where disagreement arose regarding the point score, this was resolved by discussion and consensus or by the decision of a third author (A H-F). The study quality and the risk of bias in the study results were not used as exclusion criteria. We described the results in a descriptive analysis. We designed a subgroup analysis of the effects of electronic alerts for the controlled studies, which linked the alert with concrete treatment recommendations or co-treatment by specialists.
Results
By applying the search strategy, we identified 958 potentially relevant publications, of which 16 primary publications (a list of the excluded publications is available from the authors) were included in the data extraction and analysis (11, 12, 14, 18– 30), after deduplication of the records and after screening titles, abstracts, and full text publications according to our inclusion and exclusion criteria (figure 2). Eleven of the included studies had control groups (11, 12, 14, 18, 19, 21– 23, 25, 29, 30). Nine of these studies were not randomized, two were randomized (14, 22). The remaining 5 studies were observational studies. eTable 1a lists for each of these publications the relevant data on patients, study design and quality, and the risk of bias in the reported study. None of the studies had received private funding. The included studies reported data relating to 32 842 patients with AKI (of whom 49% were women), which had been collected by means of an electronic alerting system. Patients requiring chronic dialysis were excluded.
eTable 1a. Patients, study design, study quality, and study bias.
Author |
Study design and study period |
Hospital (service mandate) |
AKI incidence/ Number of patients with AKI |
Exclusion criteria |
Age/ female sex |
Study quality *1/ Risk for bias *2 |
Rind et al. (18) |
Prospective study with crossover of control and intervention phase 01/1990–07/1991 |
Teaching hospital (504 beds) | 1573 AKI episodesin 922 patients | Creatinine >265 μmol/L, age <18 years | 66 years (mean) 46.4% |
6/9 points (Newcastle-Ottawa scale) Moderate risk of bias |
McCoy et al. (19) |
Prospective study with intervention (before-and-after design) 08/2006–05/2008 |
University medical center | 1659 patients with AKI |
|
58 years (mean) 41.7% |
7/9 points (Newcastle-Ottawa scale) Moderate risk of bias |
Thomas et al. (20) |
Prospective observational study 09/2008–12/2008 |
2 specialist hospitals (720 beds/250 beds) |
3% of all admissions 463 AKI episodes AKI stage 1: 35.6% AKI stage 2: 38.7% AKI stage 3: 25.7% |
|
75 years (median) 55.1% |
– |
Selby et al. (13, 21) |
Prospective observational study (before-and-after design) 06/2010–02/2011 |
Specialist hospital (1139 beds) |
5.4% of all admissions 3202 AKI episodes in 2619 patients AKI stage 1: 61.5% AKI stage 2: 19.9% AKI stage 3: 18.6% |
|
80 years (median) |
4/9 points (Newcastle-Ottawa scale) Moderate risk of bias |
McCoy et al. (22) |
Randomized study (parallel groups) 06/2010–08/2010 |
University medical center | 13.4% of all admissions 1488 AKI episodes |
|
60 years (mean) 47.0% |
3/5 points (Jadad scale) Low risk of bias |
Colpaert et al. (23) |
Prospective intervention study (before-during-after design) 01/2007–07/2007 |
Intensive care ward in a university medical center |
1079 patients with AKI AKI stage 1: 60% AKI stage 2: 34% AKI stage 3: 6% |
|
61 years (median) 39.1% |
5/9 points (Newcastle-Ottawa scale) Moderate risk of bias |
Ahmed et al. (24) |
Observational study (validation of methods) 01/2012–12/2012 |
Teaching hospital | 259 patients with AKI AKI stage 1: 68% AKI stage 2: 22% AKI stage 3: 10% |
|
– – |
– |
Thomas et al. (25) |
Prospective intervention study (“before and after“ design) 06/2009–07/2009 |
2 teaching hospitals (720 beds/250 beds) |
|
|
After 70.9 years 52.6% |
8/9 points (Newcastle-Ottawa scale) Moderate risk of bias |
Prendecki et al. (12) |
Observational study (intervention: emergency team versus control group) 04/2012–09/2013 |
Teaching hospital | 831 patients with AKI 994 AKI episodes |
|
72.3 years 52.6% |
4/9 points (Newcastle-Ottawa scale) High risk of bias |
Flynn, Dawnay (26) |
Prospective observational study | Teaching hospital (846 beds) |
93 patients with AKI AKI stage 1: 53.5% AKI stage 2: 21.1% AKI stage 3: 25.4% |
|
64 years (median) 45.0% |
– |
Porter et al. (27) |
Prospective observational study 04/2011–04/2013 |
University medical center (1700 beds) |
10.7% of all admissions 15 550 patients with AKI AKI stage 1: 67.3% AKI stage 2: 20.6% AKI stage 3: 12.1% |
|
74 years (median) 52.0% |
– |
Wallace et al. (28) |
Prospective observational study 12/2011–05/2012 |
Teaching hospital (657 beds) |
6.9% of all admissions 1906 AKI episodes in 1518 patients AKI stage 1: 56.3% AKI stage 2: 26.9% AKI stage 3: 16.8% |
|
78 years (median) 49.0% |
– |
Gulliford, Sloan (29) |
Prospective intervention study (“before and after“ design) 2012 |
General hospital | Before: – After: 20 patients |
– | – – |
3/9 points (Newcastle-Ottawa scale) Critical risk of bias |
Wilson et al. (14) |
Single blinded, randomized controlled study (parallel groups) 09/2013–04/2014 |
University medical center | 10.1% of all admissions 2393 patients with AKI, of which 1201 in study group with AKI alerting system |
|
60 years (mean) 44.0% |
4/5 points (Jadad scale) Low risk of bias |
Kolhe et al. (11, 30) |
Prospective observational study 02/2013–12/2013 and Prospective, propensity score–matched controlled study 08/2013–01/2015 |
In both studies: teaching hospital |
2297 patients with 2500 AKI episodes AKI stage 1: 54.1% AKI stage 2: 25.1% AKI stage 3: 20.8% 3351 patients with 3717 AKI episodes AKI stage 1: 51.3% AKI stage 2: 26.4% AKI stage 3: 22.3% |
In both studies:
|
77 years (mean) 50.0% and 76.2 years (mean) 51% |
6/9 points (Newcastle-Ottawa scale) Moderate risk of bias 8/9 points (Newcastle-Ottawa scale) Low risk of bias |
*1 Newcastle-Ottawa scale [21] for non-randomized studies; Jadad scale [22] for randomized studies;
*2 ACROBAT-NRSi tool (A Cochrane Risk Of Bias Assessment Tool of non-randomised studies of interventions [http://methods.cochrane.org/bias/assessing-risk-bias-included-studies]). AKI, acute kidney injury
Table 2 summarizes the characteristics of patients with AKI. The population included elderly patients who were subject to substantial in-hospital mortality or follow-up mortality (about 23%) (11, 12, 14, 20, 21, 23, 26– 28, 30), whereas for hospital inpatients admitted during the period under comparison, mortality was 2% (28). The incidence of AKI was about 9%; almost half of the patients had developed a moderate to severe AKI stage (11, 20, 21, 23– 28, 30). Consultant nephrologist support had been requested in the setting of routine clinical treatment in 12% of patients with AKI (11, 14, 21). Recovery of renal function was reported for three quarters of cases (20, 21, 23, 26). The severity grade of the acute kidney injury was associated with the duration of the inpatient stay (11, 14, 21, 25, 27, 28, 30). In direct analogy, the stage-related in-hospital mortality or mortality at follow-up rose in linear fashion with the AKI stage (12, 20, 21, 26– 28).
Table 2. Characteristics of patients with acute kidney injury.
Variable (number of studies) | |
Patients’ age (n = 14) | 71.6 years (61.8–75.8) |
Female (n = 13) | 49% |
AKI incidence* in hospital inpatients (n = 6) AKI days* (n = 9) days 1 days 2 – days 3 |
8.5% (5.8–10.6) 54.1% (51.3–60.0) 26.4% (21.1–34.0) 20.8% (16.8–25.4) |
Patients with progression of acute kidney injury (n = 5) | 9.9% (7.4–10.3) |
Acute kidney replacement therapy (n = 8) | 4.0% (3.3–5.1) |
Requesting nephrology consultant support in patients with AKI (n = 4) | 12.3% (9.4–14.8) |
Length of hospital inpatient stay (n = 7) – AKI stage 1* – AKI stage 2* – AKI stage 3* |
9.7 days (9.0–11.5) 8.0 days (8.0–8.5) 9.0 days (8.5–9.0) 10.0 days (9.5–10.5) |
In-hospital mortality (n = 10) – AKI stage 1* – AKI stage 2* – AKI stage 3* |
22.8% (19.6–23.9) 17.1% (13.4–18.4) 28.5% (27.4–31.9) 35.9% (32.9–40.5) |
Characteristics of electronic alerting systems for acute kidney injury
eTable 1b lists study specific results for the functionality and effects of the reported AKI early warning alerts. Results regarding functionality are summarized in Figure 3. All identified studies used a defined and mostly consensus-supported increase in serum creatinine to trigger the alarm (7, 31, 32). One study (23) recorded reductions in diuresis in addition to creatinine increases to detect AKI. Fifteen AKI electronic alerts operated hospital-wide; one was restricted to an intensive care ward (23). The alarm was triggered mostly in a fully automated way (11, 12, 14, 18, 20, 23, 25– 27, 29, 30), without interrupting the work of the treating ward physicians (non-disruptive) (12, 14, 18, 20– 22, 25, 27, 29)—for example, by inserting a text alert in the laboratory program or by email, or while linking concrete treatment recommendations or initiating specialist support (11, 12, 18, 19, 21– 23, 25– 30) (figure 3). The alarm signal was passed to the treating physicians and, in some cases, also to the hospital/ward pharmacists (14, 22) or doctors specializing in AKI treatment, such as nephrologists (25) or specially trained specialists in internal medicine (29).
eTable 1b. Functionality and effects of the reported AKI alerting systems.
Author |
Early warning system: fully or semiautomated *1/ recipient |
Algorithm triggering the alert (AKI definition) |
Relay of information on AKI (disruptive/ non-disruptive) |
Concrete treatment recommendations |
Nephrology consultant support |
Recovery of renal function |
Progress parameter | In-hospital mortality |
Rind et al. (18) |
Fully automated Treating hospital physicians |
≥ 44 μmol/L creatinine increase + administration of nephrotoxic/ renally eliminated medication ≥ 50% creatinine increase to >177 μmol/L |
Non-disruptive (by email with response/reply options) |
Yes (indication that AKI developed while nephrotoxic substance was given) | – | – | Stopping nephrotoxic medication: 21 h earlier than in control group Creatinine increase in patients on nephrotoxic drugs: 26 µmol/L lower than in control group |
|
McCoy et al. (19) |
Semiautomated Treating hospital physicians |
≥ 0.5 mg/dL creatinine increase/decrease within 48 h after admission + administration of nephrotoxic/renally eliminated medication | Combination of non-disruptive and disruptive (dose adjustment according to renal function) elements | Yes (medication check) | – | – | Medication intervention (dose adjustment/ stopping medication) within 24 h after AKI: increase from 35% to 53% | – |
Thomas et al. (20) |
Fully automated Treating hospital physicians |
≥ 75% creatinine increase from previous level |
Non-disruptive (text alert in laboratory program) | No | – | 83% (without deterioration of renal function according to CKD stage) |
Acute kidney replacement therapy: 2.8% | AKI stage 1–3: 36% AKI stage 1: 29% AKI stage 2: 38% AKI stage 3: 42% |
Selby et al. (13, 21) |
Semiautomated Treating hospital physicians |
>50% creatinine increase from previous level |
Non-disruptive (text alert in laboratory program) | Yes (link to bundled treatment recommendations) |
7.5% | AKI total: 73% AKI stage 1: 80.0% AKI stage 2: 69.9% AKI stage 3: 58.8% |
Duration: AKI stage 1: 8 days AKI stage 2: 9 days AKI stage 3: 11 days Acute kidney replacement therapy: 3.4% |
AKI stage 1–3: 23.8% AKI stage 1: 16.1% AKI stage 2: 33% AKI stage 3: 36.1% 30 day mortality: 23.7% (before AKI alert) vs 19.5% (after introduction of AKI alert + bundle of measures), RR: 1.22 (95%-CI unquantifiable) |
McCoy et al. (22) |
Semiautomated Treating hospital physicians, hospital pharmacists |
≥ 0.5 mg/dL creatinine increase/decrease within 48 h after admission + administration of nephrotoxic/renally eliminated medication | Non-disruptive (pharmacy with real-time display of medications in patients with creatinine increase) | Yes (medication check) | – | – | Adverse drug effects: control group 8.0% vs intervention group 7.1% | – |
Ahmed et al. (24) |
– Treating hospital physicians |
>50% creatinine increase from earlier level within 7 days (max) or >26 µmol/L increase from previous level in 2 days (max) | – | – | – | – | – | – |
Flynn, Dawney (26) |
Fully automated Treating hospital physicians |
>50% creatinine increase from earlier level within 7 days (max) and creatinine increase >50 µmol/L Creatinine increase to >300 µmol/L | Non-disruptive (text alert in laboratory program, if higher creatinine level >50 µmol/L), disruptive (laboratory informed ward physician if creatinine level >100 µmol/L) | Yes (link to bundled treatment recommendations) | – | 80% (up to 120 days after AKI episode: subsequent creatinine level no higher than 20% of original level) | – | AKI stage 1–3: 23.9% AKI stage 1: 11% AKI stage 2: 27% AKI stage 3: 50% |
Colpaert et al. (23) |
Fully automated Treating ITU physicians |
>50% creatinine increase from earlier level within 7 days (max) or reduction of diuresis <0.5 ml/kg/h over a minimum of 6 h | Disruptive (alert via DECT telephone call) | Yes (clinical re-evaluation, re-evaluation of findings) | – | AKI alert group vs AKI non-alert group: 66% vs 62% |
|
|
Prendecki et al. (12) |
Fully automated Treating hospital physicians |
>150% creatinine increase from earlier level | Non-disruptive (text alert in laboratory program) | Yes (if medical emergency team was requested to attend simultaneously with AKI) | – | – | 9.7% readmission to hospital with AKI
|
24.9%, of which: 47.5% vs 19.4%: >24 h vs <24 h after aki alert seen by critical care and outreach team
|
Thomas et al. (25) |
Fully automated “Before“ phase: Treating hospital physicians “After“ phase: Treating hospital physicians + nephrologist |
≥ 75% creatinine increase from earlier level | Non-disruptive (text alert in laboratory program) | Yes (nephrology consultant support in “after“ phase: fluids, medication, diagnosis, monitoring, nutrition/diet) |
|
– |
|
After 3 years:
|
Porter et al. (27) |
Fully automated Treating hospital physicians |
>50% creatinine increase from previous level within 7 days (max) or >26 µmol/L increase from previous level within 2 days (max) | Non-disruptive (text alert in laboratory program) | Yes (link to bundled treatment recommendations) | – | – | Length of hospital stay: AKI: median 9 days AKI stage 1: 9 days AKI stage 2: 9 days AK stage 3: 10 days AKI progression: 24.8% AKI stage 1 to 2: 8.2% AKI stage 1 to 3: 2.6% AKI stage 2 to 3: 14% |
AKI stage 1–3: 18.5% AKI stage 1: 12.5% AKI stage 2: 28.4% AKI stage 3: 35.7% |
Wallace et al. (28) |
Semiautomated Treating hospital physicians |
>26 µmol/L or >50% creatinine increase from previous level; creatinine increase to >300 µmol/L in non-dialysis patients |
Non-disruptive in AKI stage 1 (text alert); disruptive in AKI stage 2 with information to ward physician; AKI stage 3 with information to ward physician and nephrologist | Yes (link to bundled treatment recommendations) | – | – | Acute kidney replacement therapy: 4% Length of inpatient stay: without AKI: 2 days with AKI: 8 days (stage 1: 8 days, stage 2: 9 days, stage 3: 9 days) AKI progression: 9.9% AKI stage 1 to 2: 50% AKI stage 1 to 3 or 2 to 3: 50% |
Without AKI: 2.3% With AKI: 21.4% AKI stage 1: 18% AKI stage 2: 22% AKI stage 3: 32% |
Gulliford, Sloan (29) |
Fully automated Doctor trained for AKI treatment, with information to treating hospital physicians |
>200% creatinine increase from previous level within 7 days (max) or acute dialysis | Non-disruptive | Yes (consultant support by acute medical specialists trained in AKI) | – | – | Higher rate of renal ultrasonography, specialist treatment than in the international comparison (Medcalf J. NHS Kidney Care 2012) | After 3 months:
|
Wilson et al. (14) |
Fully automated Medical ward staff (intern, resident, nurse practitioner) and ward pharmacist |
>50% creatinine increase from previous level within 7 days (max) or >26 µmol/L increase from previous level within 2 days (max) | Non-disruptive (text page/letter/fax) | No (link to AKI-KDIGO guidelines, 273 pages) | Group with alert: 10% Group without alert: 9% |
– | Creatinine increase, length of inpatient stay (9.7 days), dialysis rate (8.7%) non-significant;no difference between groups in AKI treatment (fluids, aminoglycosides and NSAIDs, urinanalysis, ultrasonography) and AKI documentation | Group with alert: 9.8% Group without alert: 9.4%
|
Kolhe et al. (11, 30) |
In both studies: fully automated Treating hospital physicians |
In both studies: >50% creatinine increase from previous level within 7 days (max) or >26 µmol/L increase from previous level within 2 days (max) | In both studies: disruptive (regarding relaying the treatment recommendation: disruptive in one study period versus non-disruptive in the next study period) |
In both studies: yes (standardized bundle of measures, further education/training in AKI for all specialty disciplines) | 15.7% and 14.5% |
– and – |
AKI program: 6.3/7.4%,of which: group with implemented treatment recommendations in <24 h (3.9/6.0%) vs >24 h (8.1/8.0%), p = 0.01/ 0.042; Length of inpatient stay <24 h (11/10.9 days) vs >24 h (13/ 11.5 days) acute dialysis: –/2.1% non-significant |
18/20.4% (early treatment group) vs 23.1%/24.4%, (late treatment group) p = 0.046/0.017
|
*1 Fully automated: algorithm identifies defined creatinine increase and automatically triggers alarm signal to recipient; semiautomated: algorithm identifies defined creatinine increase, which is verified by a doctor—in most cases a laboratory physician—before the doctor triggers the alarm signal.
*2 RR, relative risk of dying for patients in the control group, compared with patients in the alert group. AKI, acute kidney injury; CKD stage, chronic kidney disease stage; ITU, intensive care unit; 95% CI, 95% confidence interval
Process indicators and patient-relevant effects of electronic alerts in controlled studies
Both randomized studies (14, 22) had a point score of 3.5 (3.0–4.0) out of a maximum of 5 points on the Jadad scale (17). One randomized study did not report any patient-relevant endpoints, merely process indicators, such as adjustment of medications in AKI, for which no differences between groups had been observed (22). The other randomized study did not provide treatment recommendations to ward physicians, did not affect the care status of patients with AKI, and did not find any differences for patients undergoing acute kidney replacement therapy and for in-hospital mortality or follow-up mortality, or other patient-relevant endpoints, such as the length of inpatient stay (14).
Non-randomized studies had a point score of 6 (4– 7) of a maximum of 9 points on the Newcastle-Ottawa scale (16). The risk for bias was moderate in the non-randomized studies, except in the one reported by Gulliford (critical, [29]) and Kolhe et al (low, [30]). In 10 out of 11 controlled studies, the AKI alert was linked to concrete treatment recommendations for the ward physicians or specialist co-treatment was provided (11, 12, 18, 19, 21– 23, 25, 29, 30). In 7 out of 8 controlled studies of AKI electronic alerts and linked treatment recommendations, which reported process indicators (11, 12, 18, 19, 23, 29, 30), the alert group underwent more renal ultrasonography investigations than the control group, the administration of nephrotoxic medications was stopped earlier, or patients’ fluid status was optimized (figure 4). Furthermore, AKI alerts linked to concrete treatment recommendations in the alert groups led to better renal function in all studies that reported this particular endpoint (11, 18, 23, 30), although the definition of improved renal function was subject to substantial variability and the rate of kidney replacement therapy was lower in one study only (12), whereas it remained unchanged in 3 studies (23, 25, 30). In-hospital mortality or mortality at follow-up was reduced in the AKI alert group with concrete treatment recommendations in 4 studies compared with the control group (11, 21, 29, 30)—in 3 studies this difference reached significance (11, 21, 30), in 1 study it fell from 44% to 25% without any reporting of statistical significance (30)—and in 3 studies it remained unchanged (18, 23, 25). Furthermore, one study reported lower in-hospital mortality in the alert group compared with the control group if the Critical Care and Outreach team was called to the patient’s bedside due to threatening changes to the vital parameters within a maximum of 24 hours after AKI alert (12). Of the two identified randomized studies (14, 22) only one (14) collected patient-relevant endpoints and showed—without any suggested treatment recommendations—no patient-relevant benefits for an alerting system for patients with AKI.
Discussion
We conducted a systematic literature search and identified 16 studies that investigated electronic alerts for detecting acute kidney injury. These early warning systems captured 32 842 patients with AKI. They were mostly fully automated and non-disruptive and used as the trigger for the alert a defined rise in serum creatinine. The controlled non-randomized studies were often of alerts linked to concrete treatment recommendations to the treating ward physicians or with the introduction of specialist (consultant) support. These studies provided indications of an increase in the initiation of nephroprotective measures, a milder course of the acute kidney injury, and lower in-hospital mortality or follow-up mortality compared with the control group. The reliability of the results of the non-randomized controlled studies we included was low to moderate, mainly because the reporting was of limited quality.
Patients who died during an inpatient stay with prior severe acute kidney injury received adequate care in less than 50% of cases as far as laboratory tests and imaging exams to identify the causes and the initiation of therapeutic measures are concerned (33). In another study, renal ultrasonography was undertaken in 7% of patients with AKI, and in almost all cases, medication therapy using nephrotoxins—such as non-steroidal anti-inflammatory drugs, contrast medium, or aminoglycosides—was continued (14). A cross-sectional study of more than 2 million patients showed that AKI was identified and treated in 25% of those affected; a delay in the diagnosis was found to be an independent risk factor for in-hospital mortality (10). Specialist co-treatment was described as a protective factor (10).
Thus far, early warning systems have been used in patients with kidney disorders primarily in order to detect medication problems (34); the acceptance of medication warning systems is limited if they are not linked to concrete treatment recommendations (35). Thomas et al. reported (25) that specialist recommendations for medication intervention existed in 229 out of 251 treated inpatients in whom an electronic alert system detected AKI. The benefit of a medication early warning system to avoid adverse effects was greatest when appropriate measures were concretely named (36). One measure to help avoid alert fatigue might be for the pharmacologist or pharmacist to check the causality of a certain drug in the setting of a renal event (36). The use and benefit of electronic alerting systems should be checked regularly and feedback given to all parties involved. Since 2015, British hospitals have used electronic alerts for acute kidney injury. Conclusive results of this nationwide intervention in patient care are not yet available. In principle, however, action seems urgently required in terms of counteracting the development of chronic renal failure (40% of patients with undetected acute kidney injury versus 15% of patients with known acute kidney injury [37]).
This review article summarized data on the epidemiology and care provision of hospital inpatients with acute kidney injury, primarily from the United Kingdom, but also from the United States and Belgium. It provides an overview of the current state of affairs, data, and study quality regarding AKI alert systems. The data show that the patients are older and 90% of them do not receive specialist care. The implementation of electronic alert systems is subject to great variance (trigger threshold, previous value, exceeding a minimum value, recipient, invasiveness of alert transmission, detailed reference to treatment measures) and gaps in the quality standard, bias control, and evidence levels of the reporting studies. The recommendation in a recent consensus paper of the Acute Dialysis Quality Initiative, to link AKI alerting systems to context specific treatment recommendations (38), is supported by the results of our study. Our critical evaluation of the quality of existing studies on electronic alerts and explanation of study results in terms of background, technical details, treatment recommendations, and endpoints may be useful in planning further studies and assessing generalizability and local implementation of AKI alerting systems.
Limitations
The validity of this study is limited because of small case numbers in some of the identified individual studies, the small number of randomized studies, result bias, and the wide variation in the reported endpoints. The fact that individual studies are restricted mainly to serum creatinine as the alert trigger is based on its clinical use as a diagnostic criterion for acute kidney injury, but using new renal biomarkers in the setting of an AKI alerting system seems a possibility. None of the identified studies provided instructions or recommendations for the frequency of creatinine measurements. The studies entailed investigations under real-life conditions. We have no solid information to indicate limited generalizability of the results of our review to the German situation. An individual randomized design for investigating the effects of AKI alerting systems is hampered by potential transfer effects between the intervention and control groups. “Before and after” studies with well planned characterization of patients and measures, and especially cluster randomized studies would enable robust conclusions. In planning such studies, the role of chronic renal failure as a risk factor for acute kidney injury will have to be considered.
On the basis of the data described and of our study findings, the implementation of electronic alerts for AKI is feasible and promising. Their cost–benefit effect will need to be reviewed.
Key Messages.
Acute kidney injury (AK) is a common symptom with long-term sequelae and a poor prognosis.
Electronic alerting systems detect patients with acute kidney injury and should be linked to context specific treatment recommendations.
The results of controlled, non-randomized studies show that electronic alerts seem to be of benefit in the care and treatment of patients with acute kidney injury.
The benefit of electronic alerting systems for acute kidney injury has this far not been supported by randomized studies.
Not much effort is involved in integrating an AKI alerting functionality into a piece of software.
Acknowledgments
Translated from the original German by Birte Twisselmann, PhD.
Footnotes
Conflict of interest statement
Dr. Haase-Fielitz has received third-part funding from the B. Braun Foundation. The remaining authors declare that no conflict of interest exists.
References
- 1.Sawhney S, Marks A, Fluck N, Levin A, Prescott G, Black C. Intermediate and long-term outcomes of survivors of acute kidney injury episodes: a large population-based cohort study. Am J Kidney Dis. 2016 Aug 20 doi: 10.1053/j.ajkd.2016.05.018. pii: S0272-6386(16)30256-6. doi:10.1053/j.ajkd.2016.05.018. [Epub ahead of print] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Wang HE, Muntner P, Chertow GM, Warnock DG. Acute kidney injury and mortality in hospitalized patients. Am J Nephrol. 2012;35:349–355. doi: 10.1159/000337487. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kindgen-Milles D. Epidemiologie und prognostische Relevanz des akuten Nierenversagens Akutes Nierenversagen bei Intensivpatienten: Praxis und Therapie. In: Jörres A, editor. Deutscher Ärzteverlag. Köln: 2010. pp. 1–14. [Google Scholar]
- 4.Chawla LS, Amdur RL, Amodeo S, Kimmel PL, Palant CE. The severity of acute kidney injury predicts progression to chronic kidney disease. Kidney Int. 2011;79:1361–1369. doi: 10.1038/ki.2011.42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Coca SG, Singanamala S, Parikh CR. Chronic kidney disease after acute kidney injury: a systematic review and meta-analysis. Kidney Int. 2012;81:442–448. doi: 10.1038/ki.2011.379. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Chawla LS, Amdur RL, Shaw AD, Faselis C, Palant CE, Kimmel PL. Association between AKI and long-term renal and cardiovascular outcomes in United States veterans. Clin J Am Soc Nephrol. 2014;9:448–456. doi: 10.2215/CJN.02440213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.KDIGO. Clinical practice guideline for acute kidney injury. Kidney Int Suppl. 2012;2(1):19–36. [Google Scholar]
- 8.Uchino S, Kellum JA, Bellomo R, et al. Acute renal failure in critically ill patients: a multinational, multicenter study. JAMA. 2005;294:813–818. doi: 10.1001/jama.294.7.813. [DOI] [PubMed] [Google Scholar]
- 9.Coca SG, King JT Jr, Rosenthal RA, Perkal MF, Parikh CR. The duration of postoperative acute kidney injury is an additional parameter predicting long-term survival in diabetic veterans. Kidney Int. 2010;78:926–933. doi: 10.1038/ki.2010.259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Yang L, Xing G, Wang L, et al. ISN AKF 0by25 China Consortiums Acute kidney injury in China: a cross-sectional survey. Lancet. 2015;386:1465–1471. doi: 10.1016/S0140-6736(15)00344-X. [DOI] [PubMed] [Google Scholar]
- 11.Kolhe NV, Staples D, Reilly T, et al. Impact of compliance with a care bundle on acute kidney injury outcomes: a prospective observational study. PLoS One. 2015;10 doi: 10.1371/journal.pone.0132279. e0132279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Prendecki M, Blacker E, Sadeghi-Alavijeh O, et al. Improving out-comes in patients with acute kidney injury: the impact of hospital based automated AKI alerts. Postgrad Med J. 2016;92:9–13. doi: 10.1136/postgradmedj-2015-133496. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Selby NM. Electronic alerts for acute kidney injury. Curr Opin Nephrol Hypertens. 2013;22:637–642. doi: 10.1097/MNH.0b013e328365ae84. [DOI] [PubMed] [Google Scholar]
- 14.Wilson FP, Shashaty M, Testani J, et al. Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial. Lancet. 2015;385:1966–1974. doi: 10.1016/S0140-6736(15)60266-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for sys-tematic reviews and meta-analyses: the PRISMA statement. The PRISMA Group. PLoS Med. 2009;6 e1000097. [PMC free article] [PubMed] [Google Scholar]
- 16.Wells GA, Shea B, O’Connell D, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. www.ohri.ca/programs/clinical_epidemiology/oxford.asp (last accessed on 25 June 2016) [Google Scholar]
- 17.Jadad AR, Moore RA, Dawn C, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Controlled Clinical Trials. 1996;17:1–12. doi: 10.1016/0197-2456(95)00134-4. [DOI] [PubMed] [Google Scholar]
- 18.Rind DM, Safran C, Phillips RS, et al. Effect of computer-based alerts on the treatment and outcomes of hospitalized patients. Arch Intern Med. 1994;154:1511–1517. [PubMed] [Google Scholar]
- 19.McCoy AB, Waitman LR, Gadd CS, et al. A computerized provider order entry intervention for medication safety during acute kidney injury: a quality improvement report. Am J Kidney Dis. 2010;56:832–841. doi: 10.1053/j.ajkd.2010.05.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Thomas M, Sitch A, Dowswell G. The initial development and assessment of an automatic alert warning of acute kidney injury. Nephrol Dial Transplant. 2011;26:2161–2168. doi: 10.1093/ndt/gfq710. [DOI] [PubMed] [Google Scholar]
- 21.Selby NM, Crowley L, Fluck RJ, et al. Use of electronic results reporting to diagnose and monitor AKI in hospitalized patients. Clin J Am Soc Nephrol. 2012;7:533–540. doi: 10.2215/CJN.08970911. [DOI] [PubMed] [Google Scholar]
- 22.McCoy AB, Cox ZL, Neal EB, et al. Real-time pharmacy surveillance and clinical decision support to reduce adverse drug events in acute kidney injury: a randomized, controlled trial. Appl Clin Inform. 2012;3:221–238. doi: 10.4338/ACI-2012-03-RA-0009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Colpaert K, Hoste EA, Steurbaut K, et al. Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class. Crit Care Med. 2012;40:1164–1170. doi: 10.1097/CCM.0b013e3182387a6b. [DOI] [PubMed] [Google Scholar]
- 24.Ahmed S, Curtis S, Hill C, Hine T. Population-based estimated reference creatinine values: a novel method of a robust electronic acute kidney injury alert system. Nephron Clin Pract. 2014;128:166–170. doi: 10.1159/000368236. [DOI] [PubMed] [Google Scholar]
- 25.Thomas ME, Sitch A, Baharani J, Dowswell G. Earlier intervention for acute kidney injury: evaluation of an outreach service and a long-term follow-up. Nephrol Dial Transplant. 2015;30:239–244. doi: 10.1093/ndt/gfu316. [DOI] [PubMed] [Google Scholar]
- 26.Flynn N, Dawnay A. A simple electronic alert for acute kidney injury. Ann Clin Biochem. 2015;52:206–212. doi: 10.1177/0004563214534832. [DOI] [PubMed] [Google Scholar]
- 27.Porter CJ, Juurlink I, Bisset LH, Bavakunji R, Mehta RL, Devonald MA. A real-time electronic alert to improve detection of acute kidney injury in a large teaching hospital. Nephrol Dial Transplant. 2014;29:1888–1893. doi: 10.1093/ndt/gfu082. [DOI] [PubMed] [Google Scholar]
- 28.Wallace K, Mallard AS, Stratton JD, Johnston PA, Dickinson S, Parry RG. Use of an electronic alert to identify patients with acute kidney injury. Clin Med. 2014;14:22–26. doi: 10.7861/clinmedicine.14-1-22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Gulliford S, Sloan J. Acute physicians should take the lead in developing acute kidney injury services in district general hospitals. Acute Medicine. 2014;13:48–50. [PubMed] [Google Scholar]
- 30.Kolhe NV, Reilly T, Leung J, et al. A simple care bundle for use in acute kidney injury: a propensity score matched cohort study. Nephrol Dial Transplant. 2016 Nov 31;(11) doi: 10.1093/ndt/gfw087. 1846-1854 Epub 2016 May 4. [DOI] [PubMed] [Google Scholar]
- 31.Bellomo R, Ronco C, Kellum JA, Mehta RL, Palevsky P. Acute Dialysis Quality Initiative Workgroup: acute renal failure—definition, outcome measures, animal models, fluid therapy and information technology needs: The Second International Consensus Conference of the Acute Dialysis Quality Initiative (ADQI) Group. Crit Care. 2004;8:R204–R212. doi: 10.1186/cc2872. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Mehta RL, Kellum JA, Shah SV, et al. Acute kidney injury network: report of an initiative to improve outcomes in acute kidney injury. Crit Care. 2007;11 R31 doi: 10.1186/cc5713. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Adding insult to injury a review of the care of patients who died in hospital with a primary diagnosis of acute kidney injury (acute renal failure) A report by the National Confidential Enquiry into Patient Outcome and Death 2009. www.ncepod.org.uk/2009report1/Downloads/AKI_report.pdf (last accessed on 25 November 2016) [Google Scholar]
- 34.Czock D, Konias M, Seidling HM, et al. Tailoring of alerts substantially reduces the alert burden in computerized clinical decision support for drugs that should be avoided in patients with renal disease. J Am Med Inform Assoc. 2015;22:881–887. doi: 10.1093/jamia/ocv027. [DOI] [PubMed] [Google Scholar]
- 35.Awdishu L, Coates CR, Lyddane A, et al. The impact of real-time alerting on appropriate prescribing in kidney disease: a cluster randomized controlled trial. J Am Med Inform Assoc. 2016;23:609–616. doi: 10.1093/jamia/ocv159. [DOI] [PubMed] [Google Scholar]
- 36.Leung AA, Schiff G, Keohane C, et al. Impact of vendor computerized physician order entry on patients with renal impairment in community hospitals. J Hosp Med. 2013;8:545–552. doi: 10.1002/jhm.2072. [DOI] [PubMed] [Google Scholar]
- 37.Meran S, Wonnacott A, Amphlett B, Phillips A. How good are we at managing acute kidney injury in hospital? Clin Kidney J. 2014;7:144–150. doi: 10.1093/ckj/sfu010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Hoste EA, Kashani K, Gibney N, et al. Impact of electronic-alerting of acute kidney injury: workgroup statements from the 15(th) ADQI Consensus Conference. Can J Kidney Health Dis. 2016;3 doi: 10.1186/s40697-016-0101-1. [DOI] [PMC free article] [PubMed] [Google Scholar]