Skip to main content
Wiley Open Access Collection logoLink to Wiley Open Access Collection
. 2021 Sep 7;28(11):1308–1317. doi: 10.1111/acem.14366

Accuracy of a rapid glial fibrillary acidic protein/ubiquitin carboxyl‐terminal hydrolase L1 test for the prediction of intracranial injuries on head computed tomography after mild traumatic brain injury

Jeffrey J Bazarian 1, Robert D Welch 2,3,, Krista Caudle 4, Craig A Jeffrey 5, James Y Chen 6,7, Raj Chandran 8, Tamara McCaw 5, Saul A Datwyler 8, Hongwei Zhang 5, Beth McQuiston 8
PMCID: PMC9290667  PMID: 34358399

Abstract

Objective

The objective was to determine the accuracy of a new, rapid blood test combining measurements of both glial fibrillary acidic protein (GFAP) and ubiquitin carboxyl‐terminal hydrolase L1 (UCH‐L1) for predicting acute traumatic intracranial injury (TII) on head CT scan after mild traumatic brain injury (mTBI).

Methods

Analysis of banked venous plasma samples from subjects completing the Prospective Clinical Evaluation of Biomarkers of Traumatic Brain Injury (ALERT‐TBI) trial, enrolled 2012–2014 at 22 investigational sites in the United States and Europe. All subjects were ≥18 years old, presented to an emergency department (ED) with a nonpenetrating head injury and Glasgow Coma Scale score (GCS) 9–15 (mild to moderate TBI), underwent head CT scanning as part of their clinical care, and had blood sampling within 12 h of injury. Plasma concentrations of GFAP and UCH‐L1 were measured using i‐STAT Alinity and TBI plasma cartridge and compared to acute TII on head CT scan.

Results

Of the 2011 subjects enrolled in ALERT‐TBI, 1918 had valid CT scans and plasma specimens for testing and 1901 (99.1%) had GCS 13–15 (mTBI), for which the rapid test was intended. Among these subjects, the rapid test had a sensitivity of 0.958 (95% confidence interval [CI] = 0.906 to 0.982), specificity of 0.404 (95% CI = 0.382 to 0.427), negative predictive value of 0.993 (95% CI = 0.985 to 0.997), and positive predictive value of 0.098 (95% CI = 0.082 to 0.116) for acute TII.

Conclusions

A rapid i‐STAT–based test had high sensitivity for prediction of acute TII, comparable to lab‐based platforms. The speed, portability, and high accuracy of this test may facilitate clinical adoption of brain biomarker testing as an aid to head CT decision making in EDs.

INTRODUCTION

Background

Head computed tomography (CT) remains the imaging modality of choice for the diagnosis of intracranial injury such as hemorrhage or edema for patients with mild traumatic brain injury (mTBI) treated in the emergency department (ED) during the acute postinjury period. 1 CT scan along with patient symptoms and physical findings are the main factors used to direct care of such patients. 2 It has long been suggested that CT head imaging for mTBI patients is overutilized in those patients at very low risk for acute intracranial hemorrhage. 3 This concept, in conjunction with factors such as radiation exposure, 4 excess ED resource usage, cost, 5 and others, has prompted a search for tools that can effectively and safely identify patients at very low risk for intracranial abnormalities and, therefore, not needing CT imaging.

Clinical decision rules (CDR) that utilize easily obtained patient historic and physical findings have been developed in attempt to reduce CT use in low‐risk mTBI patients. 6 , 7 Despite considerable enthusiasm for CDRs, they have been difficult to widely implement 3 , 8 , 9 and possibly are less sensitive than originally described. 10

Importance

The results of the ALERT‐TBI trial suggested that a test combining glial fibrillary acidic protein (GFAP) and ubiquitin carboxyl‐terminal hydrolase L1 (UCH‐L1; brain trauma indicator [BTI]) done within 12 h of head injury could reduce unnecessary head CT scanning by 30%, 11 and data from this trial were used to support Food and Drug Administration (FDA) clearance for this test in February 2018. The BTI, when used in patients with mTBI in whom a head CT scan is felt to be clinically indicated, can, with a high degree of certainty, identify those at low risk for acute traumatic intracranial injury (TII). The 4 h required to perform the lab‐based BTI test, however, has precluded widespread clinical adoption for ED patients given the average wait time of over 3 h for a head CT scan in the ED. 12 , 13 The recent development of a rapid GFAP/UCH‐L1 test measured on the i‐STAT Alinity platform overcomes this hurdle. 14 , 15 The i‐STAT TBI test measures both GFAP and UCH‐L1 simultaneously and received FDA clearance on January 8, 2021.

Goals of this report

Our study's main objective was to determine the predictive accuracy of a test combining both GFAP and UCH‐L1 measured using the i‐STAT Alinity and TBI plasma cartridge among those with mTBI by analyzing banked plasma samples from the prospective ALERT‐TBI trial and comparing results to the standard head CT scan. A secondary preplanned objective was to determine predictive accuracy among the following TBI subsets: those with a Glasgow Coma Scale (GCS) score of 14–15, a GCS of 15, and a GCS of 15 undergoing blood draw within 2 h of injury.

METHODS

Study design and setting

This is a secondary analysis of banked venous plasma samples from subjects successfully completing Prospective Clinical Evaluation of Biomarkers of Traumatic Brain Injury (ALERT‐TBI) trial. 11 GFAP and UCH‐L1 were measured in available plasma samples using a rapid test, which were combined into a single test result that was compared to head CT results. The study design and reporting followed the STARD guidelines for diagnostic accuracy. 16

Selection of participants

Briefly, the ALERT‐TBI study prospectively enrolled 2011 acute TBI patients between 2012 and 2014 at 22 investigational sites globally, 15 in the United States and seven in Europe. Approximately two‐thirds of subjects were enrolled at U.S. sites and one‐third at European sites. Approval from each study site's institutional ethics committee or appropriate regulatory body was obtained as was informed consent from each study subject or surrogate. Patients were eligible for inclusion if they were ≥18 years of age and presented to an ED or acute health care facility with a GCS of 9–15 (mild to moderate TBI) after a traumatically induced, nonpenetrating head injury resulting from an external force. Patients were enrolled if they underwent noncontrast head CT scan as part of their clinical care, had blood sampling done within 12 h of injury, and provided informed consent. Subjects were excluded if the time of injury could not be determined, if head CT scanning was not performed, if venipuncture was not feasible, or if informed consent was not obtainable. Details regarding patient identification, enrollment, and outcome determination can be found in the ALERT‐TBI study. 11 The study of plasma specimen testing with the i‐STAT Alinity and TBI plasma cartridge was conducted in compliance with the clinical protocol. Institutional review board (IRB) approval was obtained by each testing site's IRB.

Measurements

Blood sample handling

Serum and plasma specimens prospectively collected during the ALERT‐TBI trial were stored locally at –80°C and then shipped on dry ice to commercial biospecimen storage facilities, where they were again stored at –80°C. Serum samples were analyzed for GFAP and UCH‐L1 using the ELISA‐based BTI. Plasma samples were banked and then later shipped on dry ice to the i‐STAT Alinity and TBI plasma study clinical testing sites. These specimens had not been thawed prior to use in the i‐STAT Alinity and TBI plasma study. The stability of fresh and frozen plasma specimens was established as part of the FDA submission process. These frozen and deidentified plasma samples were tested at three clinical sites: Kentucky Clinical Trials Laboratory, Baylor Scott & White Healthcare, and Penn State Milton S. Hershey Medical Center. Each site tested 647 specimens. Specimens were thawed and tested using i‐STAT TBI plasma cartridges and i‐STAT Alinity instruments.

Rapid test

The i‐STAT TBI plasma test is a panel of in vitro diagnostic plasma quantitative measurements of GFAP and UCH‐L1 and a semiquantitative interpretation of test results derived from a combination of these measurements. The i‐STAT TBI plasma test consists of a single‐use test cartridge (i‐STAT TBI plasma test cartridge) that functions with the i‐STAT Alinity system, a portable in vitro diagnostic test system (Data S1, Figure S1, available as supporting information in the online version of this paper, which is available at http://onlinelibrary.wiley.com/doi/10.1111/acem.14366/full). The i‐STAT TBI plasma test cartridge consists of immunoassays for GFAP and UCH‐L1, which are evaluated simultaneously from a single plasma sample. In this study, each plasma specimen was thawed, aliquoted, and centrifuged at 10,000 RCF for 10 min. Approximately 20 µL was then pipetted into the sample well of the i‐STAT TBI plasma test cartridge, which was then inserted into the i‐STAT Alinity system. Sample analysis takes 15 min and concentrations of the two biomarkers are displayed on the analyzer screen. The reportable range for GFAP is 30–10,000 pg/ml and for UCH‐L1 is 200–3200 pg/ml. For the FDA cleared i‐STAT TBI test, the analyzer will not display a value for measurement beyond the reportable range. The estimated lower limit of quantification was 23 pg/ml for GFAP and 70 pg/ml for UCH‐L1. For both assays, the interrun coefficient of variation was less than 10%.

Outcomes

The primary outcome was acute TII on head CT imaging as determined by two board certified neuroradiologists and adjudicated by a third when needed. CT‐positive was defined as the presence of any of the following intracranial injuries: acute epidural hematoma, acute subdural hematoma, intraventricular hemorrhage, parenchymal hemorrhage/contusion, petechial hemorrhage/bland sheer injury, subarachnoid hemorrhage, brain edema/herniation, and ventricular compression/trapping. CT findings were also categorized as potentially in need of neurosurgical intervention (“neurosurgically manageable”), defined as an acute epidural hematoma >30 cm3; 17 acute subdural hematoma with a thickness >10 mm or a midline shift 5 mm; 18 a parenchymal contusion > 50 cm3; or a frontal/temporal contusions > 20 cm3 with midline shift of ≥5 mm or cisternal compression. 19

Data analysis

The GFAP and UCH‐L1 concentrations measured by the i‐STAT TBI plasma test were used to report a test interpretation of either “elevated” or “not elevated.” On the i‐STAT Alinity instrument, the test interpretation is displayed on the first page and the second page shows the quantitative results (Figure S1). The i‐STAT TBI plasma test reports elevated if the concentration of one or both proteins is at or above its respective cutoff. The i‐STAT TBI plasma test reports not elevated if the concentrations of both GFAP and the UCH‐L1 are below their respective cutoffs. The cutoffs were determined prior to the study and designed to maximize sensitivity and negative predictive value (NPV). The cutoff for GFAP was 30 pg/ml and for UCH‐L1 was 360 pg/ml. Additional methods describing the derivation of cutoffs are available in Data S1. Dichotomous i‐STAT TBI test interpretations (elevated/not elevated) were correlated to presence or absence of CT‐detected intracranial injury to determine the primary indicators of accuracy, sensitivity, and NPV. The following indicators of accuracy were also determined: specificity, positive predictive value (PPV), likelihood ratio positive, and likelihood ratio negative. Confidence intervals (CIs) for sensitivity, specificity, NPV, and PPV were calculated using the Wilson score method, 20 while CIs for likelihood ratios were calculated using the Miettinen‐Nurminen score method. 21 Risk ratios with Haldane's correction 22 were used to compare the proportion of CT‐positive subjects in those with protein concentrations in the upper 25th, 10th, and 5th percentiles to those below the prespecified cutoff. All analyses were performed using SAS v. 9.4 (SAS Institute).

The total sample size of this study was constrained by the number of archived specimens that met the subject and specimen eligibility requirements. Minimum sample size estimates were determined using the Wilson score test based on the allowable width of the 95% CI for a proportion. Assuming 95% clinical sensitivity with lower bound of the Wilson score 95% CI no less than 90%, the sample size was estimated to be a minimum of 110 CT‐positive subjects.

RESULTS

Characteristics of study subjects

Of the 2011 subjects enrolled in the ALERT‐TBI study, 1936 had plasma specimens available for testing on the rapid assay platform. Plasma samples from 75 subjects were unavailable because the subject withdrew, did not have blood drawn, or did not consent to future testing, as shown in Figure 1. Of the 1936 subjects with available plasma specimens, 18 had missing or unreadable head CT scans, and thus their plasma samples were not analyzed. The plasma samples from 17 subjects with a Glasgow Coma Scale (GCS) score of 9–12 were analyzed but their results were not presented because this GCS level was considered outside the intended use population (mTBI, GCS 13–15) of the rapid test. The remaining 1901 subjects with a plasma specimen, valid head CT results, and GCS 13–15 were the focus of the current study.

FIGURE 1.

FIGURE 1

STARD study flow diagram. GCS, Glasgow Coma Scale; GFAP, glial fibrillary acidic protein; UCH‐L1, ubiquitin carboxyl‐terminal hydrolase L1

Mild TBI subjects were predominantly Caucasian with a mean (±SD) age of 49.1 (±20.99) years and just over half of the cohort was male (Table 1). Subjects were most commonly injured in a fall or motor vehicle collision, with 42.2% reporting a loss of consciousness (LOC). Of the 1901 mTBI subjects, 1879 (98.8%) had a GCS of 14–15 (Table S1), and 1789 (94.1%) had a GCS of 15 (Table 1). Blood was drawn a median of 3.1 h after injury; 308 of 1789 subjects with a GCS of 15 (17.2%) had blood drawn within 2 h of injury. A total of 120 mTBI subjects (6.3%) had a TII on head CT. Five subjects (0.3%) had neurosurgically manageable lesions. Common head CT findings were subarachnoid hemorrhages (59.2%), acute subdural hematomas (47.5%), and parenchymal hematomas (20.0%). There were no deaths among the study subjects.

TABLE 1.

Demographic and presenting features of subjects

Characteristics Subjects with GCS 13–15 (n = 1901) Subjects with GCS 15 (n = 1789) Subjects with GCS 15 and blood collected within 2 h of injury (n = 308)
Age (years) 49.1 (±20.99) [18–98] 49.0 (±21.00) [18–98] 55.0 (±22.4) [18–95]
Male sex 1075 (56.5) 1005 (56.2) 184 (59.7)
Race/ethnicity
White 1343 (70.6) 1254 (70.1) 273 (88.6)
Black or African American 499 (26.2) 477 (26.7) 26 (8.4)
Other/unknown race 70 (3.7) 54 (3.0) 9 (2.9)
Hispanic 90 (4.7) 87 (4.9) 8 (2.6)
GCS score in study site
9–12
13 22 (1.2)
14 90 (4.7)
15 1789 (94.1) 1789 (100) 308 (100)
Mechanism of injury
Acceleration/deceleration 395 (20.8) 383 (21.4) 27 (8.8)
Motor vehicle collision 578 (30.4) 570 (31.9) 54 (17.5)
Pedestrian struck by vehicle 67 (3.5) 66 (3.7) 8 (2.6)
Fall 987 (51.9) 913 (51.0) 198 (64.3)
Explosion 3 (0.2) 3 (0.2) 1 (0.3)
Assault 179 (9.4) 175 (9.8) 14 (4.5)
Sports injury 47 (2.5) 44 (2.5) 12 (3.9)
Other 53 (2.8) 50 (2.8) 12 (3.9)
Unknown 7 (0.4) 5 (0.3) 2 (0.6)
LOC/PTA
LOC 803 (42.2) 742 (41.5) 115 (37.3)
PTA 627 (33.0) 566 (31.6) 114 (37.0)
Both LOC and PTA 469 (24.7) 417 (23.3) 62 (20.1)
Neither LOC nor PTA 892 (46.9) 860 (48.1) 121 (39.3)
Unknown 25 (1.3) 18 (1.0) 9 (2.9)
Intoxicated with alcohol or drugs
Yes 402 (21.2) 367 (20.5) 246 (79.9)
No 1499 (78.9) 1422 (79.5) 62 (20.1)
Head CT scan
Traumatic injury on head CT 120 (6.3) 94 (5.3) 10 (3.2)
No traumatic injury on head CT 1781 (93.7) 1695 (94.8) 298 (96.8)
Rapid test results
Hours from injury to blood draw 3.1 [0.3–11.9] (2.3–4.0) 3.2 [0.3–11.9] (2.3–4.0) 1.5 [0.3–2] (1.5–1.8)
GFAP (pg/ml) 36 [0–6856] (17–86) [n = 1898] 35 [0–5701] (16–84) [n = 1786] 36 [0–1200](19–75) [n = 308]
UCH‐L1 (pg/ml) 209 [0–6089] (112–400) [n = 1900] 204 [0–5796] (109–379) [n = 1789] 298 [11–5796] (1814–582) [n = 308]
Positive test 1176 (61.9) 1089 (60.9) 202 (65.6)

Data are reported as mean (±SD), n (%), or median [range] (IQR).

Abbreviations: GFAP, glial fibrillary acidic protein; LOC, loss of consciousness, PTA, posttraumatic amnesia; UCH‐L1, ubiquitin carboxyl‐terminal hydrolase L1.

Main results

Of 1901 mTBI subjects, 1176 (61.9%) had an elevated test and 725 had a not elevated test. Among those with an elevated test, 115 had a positive head CT scan, while among those with a not elevated test, five had a positive scan (Figure 1). The rapid test, thus, had a sensitivity of 0.958 (95% CI = 0.906 to 0.982), specificity of 0.404 (95% CI = 0.382 to 0.427) and NPV of 0.993 (95% CI = 0.985 to 0.997) for acute TII (Figure S2, Table 2). Five subjects had false‐negative test results; four had a presenting GCS of 15 and three had GFAP levels within 20% of the 30 pg/ml cutoff (Table 3). Of the five false‐negative subjects, three had small SAH, one had a small SDH, and one had a parenchymal contusion (Figure 2). None were neurosurgically manageable. Subjects with GFAP or UCH‐L1 concentrations in top 5%, 10%, and 25% of tested subjects were more likely to be CT‐positive compared to subjects with concentrations below their respective prespecified cutoffs for GFAP (30 pg/ml) and UCH‐L1 (360 pg/ml), as shown in Table 4. For both GFAP and UCH‐L1, median values were higher among CT‐positive subjects than from CT‐negative subjects (Figure 3).

TABLE 2.

Performance of rapid UCH‐L1/GFAP test for predicting acute traumatic intracranial injury on head CT scan

Performance characteristic Subjects with GCS 13–15 (N = 1901) Subjects with GCS 15 (n = 1789) Subjects with GCS 15 and blood collected within 2 h of injury (n = 308)
Sensitivity 95.8 (90.6–98.2) 95.7 (89.6–98.3) 100 (72.3–100)
Specificity 40.4 (38.2–42.7) 41.1 (38.7–43.4) 35.6 (30.4–41.2)
Positive predictive value 9.8 (8.2–11.6) 8.3 (6.8–9.8) 5.0 (2.7–8.9)
Negative predictive value 99.3 (98.4–99.7) 99.4 (98.5–99.8) 100 (96.5–100)
Positive likelihood ratio 1.61 (1.51–1.69) 1.63 (1.51–1.71) 1.52 (1.19–1.66)
Negative likelihood ratio 0.10 (0.04–0.23) 0.10 (0.04–0.26) 0.00 (0.00–0.63)

Data are reported as % (95% CI).

Abbreviations: GCS, Glasgow Coma Scale; GFAP, glial fibrillary acidic protein; UCH‐L1, ubiquitin carboxyl‐terminal hydrolase L1.

TABLE 3.

Characteristics of false‐negative subjects (n = 5)

Sex Age (years) Time from injury (h) GCS GFAP (pg/ml) UCH‐L1 (pg/ml) Head CT findings b
Male 62 8.9 15 16 84 Acute SDH
Female 49 5.9 15 24 a 94 SAH
Female 43 3.5 15 19 58 Parenchymal hematoma
Male 41 3.3 15 26 a 82 SAH
Male 44 2.9 13 28 a 184 SAH

Abbreviations: GCS, Glasgow Coma Scale; GFAP, glial fibrillary acidic protein; SAH, subarachnoid hemorrhage; SDH, subdural hematoma; UCH‐L1, ubiquitin carboxyl‐terminal hydrolase L1.

a

Value is within 20% of the 30 pg/ml cutoff.

b

No head CT findings were neurosurgically manageable injuries (see Figure 2) for CT images.

FIGURE 2.

FIGURE 2

Head CT images of false‐negative subjects. Noncontrast head CT images of five false‐negative subjects. Subject 1: (A) and (B) show focal subarachnoid hemorrhage in the anterior, paramedian frontal sulci. Subject 2: Focal area of hyperdensity in the posterior right parietal lobe, suggestive of a focal hemorrhagic cortical contusion, which was subsequently found on MRI to represent a cavernous malformation. On lower slices (not shown), there is a suggestion of some lower attenuation edema which marginates the contusion. Subject 3: Subdural hemorrhage along the left lateral hemisphere, overlying the frontal and parietal lobes with minimal local mass effect on the brain parenchyma. Subject 4: Left frontal subarachnoid hemorrhage. Subject 5: Right temporal subarachnoid hemorrhage (images for subjects 1–3 reprinted with permission from Lancet Neurology)

TABLE 4.

Risk of acute traumatic injury on head CT scan in subjects with GFAP and UCH‐L1 concentrations in the upper 25th, 10th, and 5th percentiles compared to those below cutoff

Protein Upper percentile (concentration) Risk ratio with Haldane's correction applied (95% CI)
UCH‐L1 5th (>1231.5 pg/ml) 28.2 (11.7–79.4)
10th (>758.5 pg/ml) 23.8 (10.3–65.4)
25th (>400 pg/ml) 18.4 (8.2–49.6)
GFAP 5th (>372 pg/ml) 57.1 (25.4–154.5)
10th (>202 pg/ml) 43.2 (19.3–116.0)
25th (>86 pg/ml) 26.4 (11.9–70.6)

Abbreviations: GCS, Glasgow Coma Scale; GFAP, glial fibrillary acidic protein; UCH‐L1, ubiquitin carboxyl‐terminal hydrolase L1.

FIGURE 3.

FIGURE 3

Distribution of GFAP and UCH‐L1 concentrations in subjects with GCS 13–15. GCS, Glasgow Coma Scale; GFAP, glial fibrillary acidic protein; UCH‐L1, ubiquitin carboxyl‐terminal hydrolase L1

For the subset of mild TBI subjects with a GCS of 15, the rapid test had a sensitivity of 0.957 (95% CI = 0.896 to 0.983), specificity of 0.411 (95% CI = 0.387 to 0.434) and NPV of 0.994 (95% CI = 0.985 to 0.998) for acute TII. For the subset of GCS 15 subjects having blood drawn within 2 h of injury, the rapid test had a sensitivity of 1.00 (95% CI = 0.723 to 1.00), specificity of 0.356 (95% CI = 0.304 to 0.412), and NPV of 1.00 (95% CI = 0.965 to 1.00) for acute TII (see Table 2, Figure S2, and Table S3). Subjects with GCS 13–14 had similar test performance (Table S2).

DISCUSSION

The results of this study suggest that, when applied to mTBI patients (GCS 13–15) in whom a head CT is felt to be clinically indicated, a test combining GFAP and UCH‐L1 concentrations measured on a portable, hand‐held device can detect acute TII with a high sensitivity (95.8%). This test was also highly sensitive when applied to the subgroup of patients with a presenting GCS of 15 and to those with GCS of 15 having blood drawn within 2 h of injury. Importantly, the performance characteristics of the i‐STAT TBI plasma test were similar to those for the lab‐based and FDA‐cleared BTI panel using serum and different cutoff values. 11 In that study, the sensitivity and specificity among those with a GCS 14–15 were 0.973 and 0.367, respectively. However, in contrast to the i‐STAT Alinity, which is easy to use and provides rapid results, the BTI requires labor‐intensive sample preparation, long processing times, and substantial logistical support; these characteristics limit the utility of this platform for acute evaluation of patients.

For patients seeking care for potential mild to moderate TBI in the ED, CT scan continues to be the imaging modality of choice. There is general agreement, however, that CT scans for mTBI are overutilized and many are avoidable. 3 , 5 , 8 As a result, attempts have been made to reduce head CT use without a consequential increase in missed intracranial injury. The development of a variety of clinical support tools such as CDRs, 23 , 24 , 25 , 26 published guidelines, 1 , 27 and Choosing Wisely campaigns 28 , 29 have achieved limited success in reducing CT use. Nearly two decades after the first CDRs were published, CT use continues to be overutilized in adults. 5 , 30 One possible reason for this may be that some CDRs, such as New Orleans Criteria 24 and the Canadian CT Head Rule, 23 were designed to be applied to patients with either a LOC or amnesia. Our study, however, used broader inclusion criteria, with 47% of subjects having neither LOC nor amnesia. The fact that our results were significant across a broader range of mTBI patients is a distinct advantage of the biomarker panel and suggests the usefulness of this panel extends to patients outside the limited scope of injury defined by CDR criteria. Determining the added value of biomarkers to CDRs is a fruitful avenue for future research.

When applied to mTBI patients (GCS 13–15) in whom a head CT is felt to be clinically indicated, a not elevated i‐STAT TBI plasma test would have resulted in 725 (725/1901; 38.1%) fewer CT scans while missing only five subjects with a positive head CT scan. Three of the five false‐negative subjects were the same ones missed by the BTI. For patients with a GCS score of 15, potential CT reduction would be similar (700/1789; 39.1%), with four false‐negatives. These findings suggest that this test could eliminate the need for some head CTs and potentially alter the trajectory of increased CT use in a favorable direction. Moreover, high rule‐out accuracy combined with test speed might reasonably be expected to facilitate clinical adoption of this test as an aid to head CT decision making in busy EDs where waits for imaging contribute to overcrowding and reduced patient throughput. 12 , 13 However, clinical implementation has yet to be specifically studied. Because the test had low to moderate specificity, it has potential to increase CT utilization if used in low‐risk head‐injured patients in whom a CT scan is not otherwise indicated.

While a not elevated i‐STAT TBI plasma test result can have a powerful impact on conserving ED resources and limiting unnecessary radiation exposure, the clinical utility of an elevated test result may seem less apparent. Although an elevated test result is an indication to continue the care pathway toward obtaining a head CT scan, our results show that only 9.8% of study subjects with an elevated test had an acute TII on head CT scan. However, in that 9.8%, the degree of biomarker elevation may be a predictor of unfavorable neurologic outcome in the short term. For example, Lewis et al. 31 found that GFAP and UCH‐L1 concentrations obtained within 6 h of injury were significantly higher in CT‐positive patients with neurologic deterioration and/or the need for neurosurgical intervention within 24 h of injury compared to CT‐positive patients with favorable outcome.

The relatively modest specificity of the i‐STAT TBI plasma test may be due to its ability to predict subtle TII visible only on MRI scan. Two studies examining GFAP concentrations in mild TBI patients with normal head CT scans found the highest concentrations among those with traumatic injury (usually microhemorrhage) on MRI, followed by those with normal MRIs, then by orthopedic controls, and finally by healthy controls who had the lowest values. 14 , 32 The AUCs for GFAP predicting a traumatic injury on MRI in these two studies ranged from 0.777 to 0.803, suggesting that higher concentrations of GFAP were good predictors of TII seen only on MRI. Further research with these biomarkers is under way to determine whether they can be used to predict TII only visible on MRI.

In this study, the cutoffs used to define a not elevated and elevated i‐STAT TBI plasma test result were designed to maximize the accuracy for ruling out injuries on head CT scan, not for ruling them in; the former requiring high sensitivity and NPV. This strategic decision was based on the needs of ED providers who require an accurate rule‐out test to safely discharge head‐injured patients without a head CT scan. However, our results suggest the rule‐in potential of the i‐STAT TBI plasma test among subjects with GFAP or UCH‐L1 concentrations in top quartile of tested subjects. These subjects were anywhere from 18 to 57 times more likely to have a CT‐detected acute TII compared to those with concentrations below their respective prespecified cutoffs. Although using the i‐STAT TBI plasma test to rule in the need for head CT scanning is outside the FDA indication for use, the PPV accuracy of the i‐STAT TBI plasma test is worthy of further investigation.

Limitations

This study has several limitations. Only patients in whom head CT scanning was performed for clinical reasons were included, potentially biasing the sample in terms of severity. However, our CT‐positive rate (6.3%) is consistent with prior studies suggesting the study population to be representative. 1 , 33 The predictive accuracy was based on CT findings rather than actual clinical outcomes. We categorized CT findings potentially requiring neurosurgical intervention based on guidelines recommending intervention but do not have data on which participants actually required neurosurgical intervention. Our results were produced using banked plasma samples that underwent a single freeze–thaw cycle. Fresh plasma samples were not tested in this study. We did not compare the diagnostic performance of the rapid test to its component proteins. The wide CIs around the point estimate for test sensitivity in subjects with a GCS 15 having blood drawn within 2 h likely reflect the small sample size (n = 308). Other study limitations are the same as those described in parent ALERT‐TBI study 11 and are briefly summarized here. The impact of extracranial injuries on test performance was not evaluated, and test performance was not compared to a CDR. We did not attempt to improve the test's diagnostic accuracy by adding other clinical variables. Because a methodological strength of this study was the use of prespecified marker cutoffs, we chose not to explore alternative cutoffs.

CONCLUSIONS

In conclusion, the glial fibrillary acidic protein and ubiquitin carboxyl‐terminal hydrolase L1 biomarker panel results obtained using the i‐STAT Alinity and traumatic brain injury plasma test had high sensitivity, but limited specificity, for prediction of acute traumatic intracranial injury, comparable to lab‐based platforms. When used within 12 h of injury among adult mild traumatic brain injury patients in whom a computed tomography scan is felt to be clinically indicated, this test has the potential to reduce computed tomography use. The impact of this test on actual head computed tomography utilization has yet to be determined. The speed, portability, and high accuracy of this test may facilitate clinical adoption of brain biomarker testing as an aid to head computed tomography decision making in EDs.

CONFLICT OF INTEREST

JJB is on the advisory board and has research support from Abbott, is on the Q30 advisory board, and has research support from BrainScope. RDW has been a paid presenter for Abbott sponsored programs. CAJ, RC, TM, SAD, HZ, and BM are employees of Abbott. SAD is a shareholder of Abbott.

AUTHOR CONTRIBUTIONS

Jeffrey J. Bazarian, Robert D. Welch, Krista Caudle, Raj Chandran, Tamara McCaw, Hongwei Zhang, and Beth McQuiston were responsible for study concept and study design. Jeffrey J. Bazarian and Robert D. Welch were responsible for acquisition of data. Raj Chandran was responsible for primary statistical analyses. All authors contributed to data analysis and/or interpretation. Jeffrey J. Bazarian, Robert D. Welch, and Tamara McCaw were responsible for drafting the manuscript. Craig A. Jeffrey was the technical lead for iSTAT TBI cartridge development. Krista Caudle was responsible for risk mitigation. Jeffrey J. Bazarian and Robert D. Welch were investigators and authored the manuscript for the original ALERT‐TBI trial. All authors contributed substantially to critical revisions related to important intellectual content. All authors have approved of this submission. Jeffrey J. Bazarian takes primary responsibility for the paper as a whole.

Supporting information

Figure S1

Figure S2

Data S1

ACKNOWLEDGMENTS

We thank the following for their assistance in analyzing plasma samples: Dr. Saeed A. Jortani, PhD, Kentucky Clinical Trials Laboratory (KCTL); Dr. Amin Mohammad, PhD, DABCC, FACB, Baylor Scott & White Healthcare; and Dr. Michael Creer, MD, Penn State Milton S. Hershey Medical Center. This work is supported by the U.S. Army Medical Research and Materiel Command’s U.S. Army Medical Materiel Development Activity, contract no. W81XWH‐17‐C‐0079. The views, opinions, and/or findings contained in this report are those of the author(s) and should not be construed as an official Department of the Army position, policy, or decision unless so designated by other documentation. In the conduct of research where humans are the subjects, the investigator(s) adhered to the policies regarding the protection of human subjects as prescribed by Code of Federal Regulations (CFR) Title 45, Volume 1, Part 46; Title 32, Chapter 1, Part 219; and Title 21, Chapter 1, Part 50 (Protection of Human Subjects).

Bazarian JJ, Welch RD, Caudle K, et al. Accuracy of a rapid glial fibrillary acidic protein/ubiquitin carboxyl‐terminal hydrolase L1 test for the prediction of intracranial injuries on head computed tomography after mild traumatic brain injury. Acad Emerg Med. 2021;28:1308–1317. 10.1111/acem.14366

ClinicalTrials.gov identifier: This study did not primarily enroll patients and was not a registered clinical trial. The original ALERT‐TBI trail identifier is NCT01426919.

Supervising Editor: Michael S. Runyon, MD, MPH.

Funding information

This work was supported by the U.S. Army Medical Research and Materiel Command's U.S. Army Medical Materiel Development Activity, contract no. W81XWH‐17‐C‐0079. The views, opinions and/or findings contained in this report are those of the author(s) and should not be construed as an official Department of the Army position, policy, or decision unless so designated by other documentation. In the conduct of research where humans are the subjects, the investigator(s) adhered to the policies regarding the protection of human subjects as prescribed by Code of Federal Regulations (CFR) Title 45, Volume 1, Part 46; Title 32, Chapter 1, Part 219; and Title 21, Chapter 1, Part 50 (Protection of Human Subjects).

REFERENCES

  • 1. Jagoda AS, Bazarian JJ, Bruns JJ, et al. Clinical policy: neuroimaging and decisionmaking in adult mild traumatic brain injury in the acute setting. Ann Emerg Med. 2008;52(6):714‐748. [DOI] [PubMed] [Google Scholar]
  • 2. Easter JS, Haukoos JS, Meehan WP, Novack V, Edlow JA. Will neuroimaging reveal a severe intracranial injury in this adult with minor head trauma? The rational clinical examination systematic review. JAMA. 2015;314(24):2672‐2681. [DOI] [PubMed] [Google Scholar]
  • 3. Melnick ER, Szlezak CM, Bentley SK, Dziura JD, Kotlyar S, Post LA. CT overuse for mild traumatic brain injury. Jt Comm J Qual Patient Saf. 2012;38(11):483‐489. [DOI] [PubMed] [Google Scholar]
  • 4. Brenner DJ, Hall EJ. Computed tomography–an increasing source of radiation exposure. N Engl J Med. 2007;357(22):2277‐2284. [DOI] [PubMed] [Google Scholar]
  • 5. Sharp AL, Nagaraj G, Rippberger EJ, et al. Computed tomography use for adults with head injury: describing likely avoidable emergency department imaging based on the Canadian CT Head Rule. Acad Emerg Med. 2017;24(1):22‐30. [DOI] [PubMed] [Google Scholar]
  • 6. Stein SC, Fabbri A, Servadei F, Glick HA. A critical comparison of clinical decision instruments for computed tomographic scanning in mild closed traumatic brain injury in adolescents and adults. Ann Emerg Med. 2009;53(2):180‐188. [DOI] [PubMed] [Google Scholar]
  • 7. Stiell IG, Clement CM, Grimshaw JM, et al. A prospective cluster‐randomized trial to implement the Canadian CT Head Rule in emergency departments. CMAJ. 2010;182(14):1527‐1532. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. New evidence of head CT scan overuse in the ED. Advisory Board . 2015. Accessed October 1, 2020. https://www.advisory.com/research/physician‐executive‐council/prescription‐for‐change/2015/02/head‐ct‐scan‐overuse
  • 9. Tavender EJ, Bosch M, Gruen RL, et al. Understanding practice: the factors that influence management of mild traumatic brain injury in the emergency department–a qualitative study using the Theoretical Domains Framework. Implement Sci. 2014;9:8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Foks KA, van den Brand CL, Lingsma HF, et al. External validation of computed tomography decision rules for minor head injury: prospective, multicentre cohort study in the Netherlands. BMJ. 2018;362:k3527. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Bazarian JJ, Biberthaler P, Welch RD, et al. Serum GFAP and UCH‐L1 for prediction of absence of intracranial injuries on head CT (ALERT‐TBI): a multicentre observational study. Lancet Neurol. 2018;17(9):782‐789. [DOI] [PubMed] [Google Scholar]
  • 12. Rogg JG, Huckman R, Lev M, Raja A, Chang Y, White BA. Describing wait time bottlenecks for ED patients undergoing head CT. Am J Emerg Med. 2017;35(10):1510‐1513. [DOI] [PubMed] [Google Scholar]
  • 13. Michelson E, Huff S, Loparo M, et al. Emergency department time course for mild traumatic brain injury workup. West J Emerg Med. 2018;19(4):635. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Yue JK, Yuh EL, Korley FK, et al. Association between plasma GFAP concentrations and MRI abnormalities in patients with CT‐negative traumatic brain injury in the TRACK‐TBI cohort: a prospective multicentre study. Lancet Neurol. 2019;18(10):953‐961. [DOI] [PubMed] [Google Scholar]
  • 15. Okonkwo DO, Puffer RC, Puccio AM, et al. Point‐of‐care platform blood biomarker testing of glial fibrillary acidic protein versus S100 calcium‐binding protein B for prediction of traumatic brain injuries: a transforming research and clinical knowledge in traumatic brain injury study. J Neurotrauma. 2020;37(23):2460‐2467. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Bossuyt PM, Reitsma JB, Bruns DE, et al. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Clin Chem. 2015;61(12):1446‐1452. [DOI] [PubMed] [Google Scholar]
  • 17. Bullock MR, Chesnut R, Ghajar J, et al. Surgical management of acute epidural hematomas. Neurosurgery. 2006;58(3 Suppl):S7‐S15; discussion Si‐iv. [PubMed] [Google Scholar]
  • 18. Bullock MR, Chesnut R, Ghajar J, et al. Surgical management of acute subdural hematomas. Neurosurgery. 2006;58(3 Suppl):S16‐S24; discussion Si‐iv. [PubMed] [Google Scholar]
  • 19. Bullock MR, Chesnut R, Ghajar J, et al. Surgical management of traumatic parenchymal lesions. Neurosurgery. 2006;58(3 Suppl):S25‐S46; discussion Si‐iv. [DOI] [PubMed] [Google Scholar]
  • 20. Wilson EB. Probable inference, the law of succession, and statistical inference. J Am Stat Assoc. 1927;22(158):209‐212. [Google Scholar]
  • 21. Miettinen O, Nurminen M. Comparative analysis of two rates. Stat Med. 1985;4(2):213‐226. [DOI] [PubMed] [Google Scholar]
  • 22. Haldane J. The measurement of variation. Evolution. 1955;9(4):484. [Google Scholar]
  • 23. Stiell IG, Wells GA, Vandemheen K, et al. The Canadian CT Head Rule for patients with minor head injury. Lancet. 2001;357(9266):1391‐1396. [DOI] [PubMed] [Google Scholar]
  • 24. Haydel MJ, Preston CA, Mills TJ, Luber S, Blaudeau E, DeBlieux PM. Indications for computed tomography in patients with minor head injury. N Engl J Med. 2000;343(2):100‐105. [DOI] [PubMed] [Google Scholar]
  • 25. Head injury: assessment and early management. National Institute for Health and Care Excellence. 2014. https://www.nice.org.uk/guidance/cg176
  • 26. Mower WR, Herbert M, Wolfson AB, Pollack CV Jr, Zucker MI; NEXUS II Investigators . Developing a decision instrument to guide computed tomographic imaging of blunt head injury patients. J Trauma. 2005;59(4):954‐959. [DOI] [PubMed] [Google Scholar]
  • 27. Unden J, Ingebrigtsen T, Romner B, Scandinavian guidelines for initial management of minimal, mild and moderate head injuries in adults: an evidence and consensus‐based update. BMC Med. 2013;11:50. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Raja AS, Venkatesh A, Mick N, et al. “Choosing Wisely” imaging recommendations: initial implementation in New England emergency departments. West J Emerg Med. 2017;18(3):454. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Cheng AH, Campbell S, Chartier LB, et al. Choosing Wisely Canada®: five tests, procedures and treatments to question in emergency medicine. Can J Emerg Med. 2017;19(S2):S9‐S17. [DOI] [PubMed] [Google Scholar]
  • 30. Sharp AL, Nagaraj G, Rippberger EJ, et al. Big versus small data and the generalizability of the rate of computed tomography overuse in minor head injury reply. Acad Emerg Med. 2017;24(3):393. [DOI] [PubMed] [Google Scholar]
  • 31. Lewis LM, Papa L, Bazarian J, Weber A, Howard R, Welch RD. Biomarkers may predict unfavorable neurological outcome after mild traumatic brain injury? J Neurotrauma. 2020;37(24):2624‐2631. [DOI] [PubMed] [Google Scholar]
  • 32. Gill J, Latour L, Diaz‐Arrastia R, et al. Glial fibrillary acidic protein elevations relate to neuroimaging abnormalities after mild TBI. Neurology. 2018;91(15):e1385‐e1389. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Unden J, Romner B. Can low serum levels of S100B predict normal CT findings after minor head injury in adults? An evidence‐based review and meta‐analysis. J Head Trauma Rehabil. 2010;25(4):228‐240. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Figure S1

Figure S2

Data S1


Articles from Academic Emergency Medicine are provided here courtesy of Wiley

RESOURCES