Skip to main content
JAMA Network logoLink to JAMA Network
. 2018 Feb 5;75(4):419–427. doi: 10.1001/jamaneurol.2017.4648

Quality of Care for Veterans With Transient Ischemic Attack and Minor Stroke

Dawn M Bravata 1,2,3,4,5,, Laura J Myers 1,2,3, Greg Arling 1,6, Edward J Miech 1,2,5,7, Teresa Damush 1,2,3,5, Jason J Sico 8,9,10, Michael S Phipps 11, Alan J Zillich 12, Zhangsheng Yu 13, Mathew Reeves 1,14, Linda S Williams 1,2,4,5, Jason Johanning 15,16, Seemant Chaturvedi 17,18, Fitsum Baye 13, Susan Ofner 13, Curt Austin 2,3, Jared Ferguson 2,9, Glenn D Graham 1,19,20, Rachel Rhude 21, Chad S Kessler 22,23, Donald S Higgins Jr 19,24, Eric Cheng 1,25,26
PMCID: PMC5885264  PMID: 29404578

This cohort study assesses the quality of guideline-recommended transient ischemic attack and minor stroke care across the Veterans Health Administration system nationwide.

Abstract

Importance

The timely delivery of guideline-concordant care may reduce the risk of recurrent vascular events for patients with transient ischemic attack (TIA) and minor stroke. Although many health care organizations measure stroke care quality, few evaluate performance for patients with TIA or minor stroke, and most include only a limited subset of guideline-recommended processes.

Objective

To assess the quality of guideline-recommended TIA and minor stroke care across the Veterans Health Administration (VHA) system nationwide.

Design, Setting, and Participants

This cohort study included 8201 patients with TIA or minor stroke cared for in any VHA emergency department (ED) or inpatient setting during federal fiscal year 2014 (October 1, 2013, through September 31, 2014). Patients with length of stay longer than 6 days, ventilator use, feeding tube use, coma, intensive care unit stay, inpatient rehabilitation stay before discharge, or receipt of thrombolysis were excluded. Outlier facilities for each process of care were identified by constructing 95% CIs around the facility pass rate and national pass rate sites when the 95% CIs did not overlap. Data analysis occurred from January 16, 2016, through June 30, 2017.

Main Outcomes and Measures

Ten elements of care were assessed using validated electronic quality measures.

Results

In the 8201 patients included in the study (mean [SD] age, 68.8 [11.4] years; 7877 [96.0%] male; 4856 [59.2%] white), performance varied across elements of care: brain imaging by day 2 (6720/7563 [88.9%]; 95% CI, 88.2%-89.6%), antithrombotic use by day 2 (6265/7477 [83.8%]; 95% CI, 83.0%-84.6%), hemoglobin A1c measurement by discharge or within the preceding 120 days (2859/3464 [82.5%]; 95% CI, 81.2%-83.8%), anticoagulation for atrial fibrillation by day 7 after discharge (1003/1222 [82.1%]; 95% CI, 80.0%-84.2%), deep vein thrombosis prophylaxis by day 2 (3253/4346 [74.9%]; 95% CI, 73.6%-76.2%), hypertension control by day 90 after discharge (4292/5979 [71.8%]; 95% CI, 70.7%-72.9%), neurology consultation by day 1 (5521/7823 [70.6%]; 95% CI, 69.6%-71.6%), electrocardiography by day 2 or within 1 day prior (5073/7570 [67.0%]; 95% CI, 65.9%-68.1%), carotid artery imaging by day 2 or within 6 months prior (4923/7685 [64.1%]; 95% CI, 63.0%-65.2%), and moderate- to high-potency statin prescription by day 7 after discharge (3329/7054 [47.2%]; 95% CI, 46.0%-48.4%). Performance varied substantially across facilities (eg, neurology consultation had a facility outlier rate of 53.0%). Performance was higher for admitted patients than for patients cared for only in EDs with the greatest disparity for carotid artery imaging (4478/5927 [75.6%] vs 445/1758 [25.3%]; P < .001).

Conclusions and Relevance

This national study of VHA system quality of care for patients with TIA or minor stroke identified opportunities to improve care quality, particularly for patients who were discharged from the ED. Health care systems should engage in ongoing TIA care performance assessment to complement existing stroke performance measurement.

Key Points

Question

What is the quality of care that the Veterans Health Administration—the largest health care system in the United States—is providing to patients with transient ischemic attack and minor stroke?

Findings

This cohort study of 8201 patients identified opportunities to improve care quality, particularly among patients who were discharged from the emergency department and those who did not receive early neurology consultation.

Meaning

This study provides benchmarking data for the Veterans Health Administration system for transient ischemic attack and minor stroke care quality and identifies targets for quality improvement.

Introduction

Patients with transient ischemic attack (TIA) and minor ischemic stroke are at high risk of recurrent vascular events. However, timely delivery of guideline-concordant care may reduce this risk. Several prospective studies demonstrating improvements in outcomes by delivering timely guideline-concordant care have included patients with TIA and minor stroke. Because TIA and minor stroke events share similar origins and because patients with TIA and minor stroke have similar prognoses, recommendations for care are similar for patients with TIA and minor stroke. Given that patients with transient neurologic symptoms with evidence of brain infarct by imaging are classified as (minor) stroke rather than TIA, the resemblance—in terms of prognosis and clinical needs—between patients with minor stroke and those with TIA may be greater than the resemblance between patients with minor stroke and those with major stroke.

Given these similarities, it is reasonable that patients with TIA and minor stroke should be included in quality measurement programs to ensure that patients are receiving the care they need to reduce their risk of recurrent vascular events. However, most quality assessment programs focus on stroke to the exclusion of TIA and do not distinguish between major stroke and minor stroke. For example, the Veterans Health Administration (VHA), which is the largest health care system in the United States, currently assesses the quality of care for all patients with ischemic stroke but not for patients with TIA and not for patients with minor stroke separately from those with major stroke. Therefore, our objective was to assess the quality of TIA and minor ischemic stroke care across the VHA system nationwide. We were interested in identifying guideline-concordant care components that could serve as targets for future quality improvement efforts.

Methods

Cohort Construction

Details of our methods have been described elsewhere. Briefly, we identified veteran patients with TIA or ischemic stroke (minor or major) who were cared for in any VHA emergency department (ED) or inpatient setting during federal fiscal year 2014 (October 1, 2013, through September 31, 2014) based on International Classification of Diseases, Ninth Revision (ICD-9) primary discharge codes for TIA (435.0, 435.1, 435.3, 435.8, and 435.9) or stroke (433.X1, 434.00, 434.X1, and 436). The earliest event was used as the index event. Because electronic health record data did not include a measure of stroke severity, a validated approach to identify patients with major ischemic stroke was used. Patients were classified as having major stroke and were excluded if any of the following were present: length of stay longer than 6 days, ventilator use, feeding tube use, coma, intensive care unit stay, inpatient rehabilitation stay before discharge, or receipt of thrombolysis. This approach to identifying patients with TIA and minor stroke has 99.0% agreement with medical record review. Patients cared for in observation settings were classified as inpatients. Patients cared for in an ED without an inpatient or observation unit admission were classified as ED-only patients. This study received human subjects committee approval from the Indiana University School of Medicine Institutional Review Board and from the Richard L. Roudebush VA Medical Center Research and Development Committee. A waiver of informed consent was obtained for the collection of patient-level data. Data were not deidentified.

Components of Care

Ten electronic quality measures (eQMs) previously validated against medical record review were used to assess quality of care. Briefly, the eQMs were previously compared with medical record review with regard to eligibility (whether an individual patient was included in the denominator) and pass rate (whether an individual was included in the numerator). For example, for the anticoagulation for atrial fibrillation measure, the overall accuracy (the sum of the true-positive plus true-negative results divided by the sum of true-positive, false-positive, true-negative, and false-negative results) of the eQM compared with medical record review was 93% for eligibility and 92% for passing. In the previous validation study, we considered 31 eQMs; however, only those with the best performance for eligibility and passing were included in the present analysis. In addition, only 1 eQM per clinical domain was retained. For example, being discharged with statins and the prescription of moderate- to high-potency statins are 2 processes within the clinical domain of hyperlipidemia. To arrive at a single eQM per clinical domain, we prioritized those processes with the highest validation against medical record review; in cases of similar validation results, we retained the processes with greatest alignment to most recent guidelines. In the previous validation study, no systematic differences in agreement between the electronic health record data and the medical record review data were observed on the basis of diagnosis (TIA vs stroke) or admission status (ED-only vs admitted patients).

Each of the eQMs represented guideline-concordant elements of care. However, only some of the eQMs were similar to measures included in the Joint Commission (JC) Stroke Core Measure Set or the American Heart Association (AHA)/American Stroke Association (ASA) Performance Measures Set; neither organization has an existing TIA measure set. In other words, currently existing ischemic stroke performance assessment programs include only a subset of guideline-recommended elements of care and focus only on patients with stroke (but not TIA). In contrast, we sought to evaluate a wider range of guideline-concordant processes for patients with TIA and minor stroke. eTable 1 in the Supplement provides numerator and denominator definitions. The eQMs included the following diagnostic and therapeutic components of care: (1) brain imaging, (2) carotid artery imaging, (3) electrocardiography, (4) hypertension control, (5) anticoagulation for atrial fibrillation or flutter, (6) moderate- to high-potency statin prescription, (7) hemoglobin A1c (HbA1c) measurement, (8) antithrombotic use, (9) deep vein thrombosis (DVT) prophylaxis, and (10) neurology consultation. For each eQM, patients were classified as ineligible, eligible-passed, or eligible-failed. The denominators for the eQMs varied; for example, only patients with atrial fibrillation or flutter were eligible for the anticoagulation metric.

Data Sources

A variety of data sources were used in eQM construction. The VHA Corporate Data Warehouse includes a broad range of information that is obtained from the VHA electronic medical record system known as Veterans Information Systems and Technology Architecture. Veterans Information Systems and Technology Architecture is the electronic medical record system that is used across the entire VHA system nationwide and includes clinical (eg, notes, orders, procedures, pharmacy, and prosthetics) and administrative (eg, billing, security, compensation, and pension) functionality. The Corporate Data Warehouse data that were used in the current analyses included inpatient and outpatient data files (which include information about the date of a clinical encounter and its associated diagnostic and procedure codes) in the 5 years before the event to identify medical history, health care use, and receipt of procedures (Current Procedural Terminology, Healthcare Common Procedures Coding System, and ICD-9 procedure codes). The Corporate Data Warehouse data were also used for vital signs, laboratory data, allergies, orders, and consultations. Pharmacy benefits management data were used to identify medications. Linked VHA and Centers for Medicare & Medicaid Services data were used to identify non-VHA hospitalizations. Fee-basis data (which describe health care services that were paid for by the VHA but that were obtained by veterans outside the VHA facilities) were also used to identify inpatient and outpatient use and medical history. The date of death was obtained from the VHA Vital Status File.

Statistical Analysis

Continuous patient characteristics were summarized using means (SDs) or medians (ranges). For the assessment of variation in performance across facilities, we examined the mean facility pass rates and interquartile ranges at facilities with 10 or more eligible patients per fiscal year. We used χ2 tests to compare pass rates between ED-only vs admitted patients, patients with vs without early neurology consultation, and patients with TIA vs minor stroke.

We identified the proportion of outlier facilities for each eQM by constructing unadjusted upper and lower 95% confidence limits around the facility mean pass rate. We also calculated the 95% CIs for the overall mean national rate for each eQM and examined whether the facility confidence boundaries overlapped with the national confidence boundaries. Sites where the 95% CIs did not overlap were considered outliers. SAS statistical software, version 9.2 (SAS Institute Inc) was used for data analysis, which was conducted from January 16, 2016, through June 30, 2017.

Results

The cohort included 8201 patients: 3264 (39.8%) with TIA and 4937 (60.2%) with minor stroke (mean [SD] age, 68.8 [11.4] years; 7877 [96.0%] male; 4856 [59.2%] white). The patients received index-event care at 129 VHA facilities and postevent care at 151 VHA facilities. The baseline characteristics of the patients are provided in Table 1.

Table 1. Baseline Characteristics of the Patients With TIA and Minor Stroke During Fiscal Year 2014.

Characteristic Finding (N = 8201)a
Demographics
Age, median (range), y 67 (23-100)
Age, mean (SD), y 68.8 (11.4)
Race/ethnicity
White 4856 (59.2)
Black 2627 (32.0)
Hispanic 296 (3.6)
Asian 36 (0.4)
Native American 99 (1.2)
Other or unknown 287 (3.5)
Married 3949 (48.2)
Male 7877 (96.0)
Medical history
Prior stroke 2214 (27.0)
Prior TIA 1179 (14.4)
History of amaurosis fugax 96 (1.2)
Prior carotid endarterectomy or stent 589 (7.2)
Diabetes 3570 (43.5)
Hypertension 6648 (81.1)
Hyperlipidemia 5977 (72.9)
Myocardial infarction 1019 (12.4)
Coronary artery disease, CABG, PCI, or coronary stent 2680 (32.7)
Pacemaker or AICD 139 (1.7)
Peripheral vascular disease 1913 (23.3)
Atrial fibrillation 1063 (13.0)
Congestive heart failure 1530 (18.7)
Valvular heart disease: native or mechanical 868 (10.6)
COPD or asthma 2913 (35.5)
Sleep apnea 1720 (21.0)
Seizure disorder 596 (7.3)
Migraine disorder 350 (4.3)
Dialysis dependent 135 (1.6)
Depression 3014 (36.8)
Charlson comorbidity scoreb
Median (range) 1.0 (0-18)
Mean (SD) 1.7 (2.1)
Final diagnosis
TIA 3264 (39.8)
Minor stroke 4937 (60.2)

Abbreviations: AICD, automatic implantable cardioverter-defibrillator; CABG, coronary artery bypass graft; COPD, chronic obstructive pulmonary disease; PCI, percutaneous coronary intervention; TIA, transient ischemic attack.

a

Data are presented as number (percentage) of patients unless otherwise indicated.

b

Higher scored indicate a greater burden of comorbidity.

Patient-Level Performance

Patient-level quality of care data are provided in Table 2 and sorted by performance. Overall performance varied considerably across the eQMs: brain imaging (6720/7563 [88.9%]; 95% CI, 88.2%-89.6%), antithrombotic use (6265/7477 [83.8%]; 95% CI, 83.0%-84.6%), hemoglobin A1c measurement (2859/3464 [82.5%]; 95% CI, 81.2%-83.8%), anticoagulation for atrial fibrillation (1003/1222 [82.1%]; 95% CI, 80.0%-84.2%), DVT prophylaxis (3253/4346 [74.9%]; 95% CI, 73.6%-76.2%), hypertension control (4292/5979 [71.8%]; 95% CI, 70.7%-72.9%), neurology consultation (5521/7823 [70.6%]; 95% CI, 69.6%-71.6%), electrocardiography (5073/7570 [67.0%]; 95% CI, 65.9%-68.1%), carotid artery imaging (4923/7685 [64.1%]; 95% CI, 63.0%-65.2%), and moderate- to high-potency statin prescription (3329/7054 [47.2%]; 95% CI, 46.0%-48.4%) (Table 2).

Table 2. Overall Quality of Care at the Patient and Facility Levels.

Electronic Quality Measure Patient Level Facility Level
Patients With TIA and Minor Stroke (N = 8201) Facilities With Any Eligible Patients (N = 8201 Patients; N = 128 facilities)a Facilities With ≥10 Eligible Patientsb
Eligible, No. Patient Pass Rate, No. (%) [95% CI] Eligible, No. Mean Facility Pass Rate, % (95% CI) Eligible, No. of Facilities/No. of Patients Facility Pass Rate Mean Facility Pass Rate IQR Facility Percentage Outlierc
Mean, % (95% CI) Minimum, % Maximum, %
Brain imaging by day 2 7563 6720 (88.9) [88.2-89.6] 128 86.7 (84.2-89.1) 117/7522 88.2 (86.9-89.5) 58.8 100.0 85.71-92.50 16.2
Antithrombotics by day 2 7477 6265 (83.8) [83.0-84.6] 127 83.4 (81.4-85.3) 116/7428 82.3 (80.4-84.3) 46.9 96.2 77.72- 89.47 27.6
HbA1c measurement by discharge or within prior 120 d in patients with diabetes 3464 2859 (82.5) [81.2-83.8] 123 79.3 (76.7-82.0) 100/3340 82.2 (80.3-84.0) 50.0 100.0 76.70-89.38 10.0
Anticoagulation for atrial fibrillation by day 7 after discharge 1222 1003 (82.1) [80.0-84.2] 119 80.1 (76.9-83.2) 53/902 83.1 (80.0-86.2) 58.3 100.0 75.00-91.30 5.7
DVT prophylaxis by the end of hospital day 2 4346 3253 (74.9) [73.6-76.2] 127 74.3 (70.8-77.8) 107/4266 75.8 (72.6-79.0) 30.5 100.0 66.67-90.00 32.7
Hypertension control (mean blood pressure of <140/90 mm Hg during 90 d after discharge) 5979 4292 (71.8) [70.7-72.9] 149 72.8 (70.2-75.4) 120/5854 72.1 (70.4-73.8) 37.1 100.0 66.67-78.84 9.2
Neurology consultation by day 1 7823 5521 (70.6) [69.6-71.6] 128 63.4 (58.6-68.2) 117/7777 65.4 (60.8-70.0) 0.0 96.5 50.82-86.75 53.0
Electrocardiography by day 2 or within 1 d before event 7570 5073 (67.0) [65.9-68.1] 128 67.2 (63.0-71.5) 117/7529 66.9 (62.6-71.2) 6.3 100.0 36.14-49.57 54.7
Carotid artery imaging by day 2 or within prior 6 mo 7685 4923 (64.1) [63.0-65.2] 128 60.2 (57.0-63.4) 117/7640 61.9 (59.3-64.6) 0.0 90.0 52.63-72.37 30.8
High- or moderate-potency statin by day 7 after discharge 7054 3329 (47.2) [46.0-48.4] 128 44.6 (41.3-47.9) 117/7019 45.4 (42.7-48.1) 16.1 76.8 33.33-57.14 32.5

Abbreviations: DVT, deep vein thrombosis; HbA1c, hemoglobin A1c; IQR, interquartile range; TIA, transient ischemic attack.

a

There were 128 facilities that cared for at least 10 eligible patients in the emergency department or inpatient setting for their index cerebrovascular event; those patients received their primary care at 149 facilities (ie, for hypertension control).

b

The data displayed in this column include the total number of facilities with at least 10 eligible patients for each process and the total number of eligible patients at those facilities.

c

The facility percentage outlier was calculated by comparing site 95% CIs around the eQM pass rate with the 95% CIs around the national rate; sites where the site-specific CIs did not overlap with the mean were considered outliers. The proportion of outlier sites (either with better than average or worse than average performance) was calculated among the total number of sites with at least 10 eligible patients.

A few patients (2101/8201 [25.6%]) were discharged from the ED. The proportion of ED-only patients was similar for patients with TIA (907/3264 [27.8%]) and minor stroke (1195/4937 [24.2%]). Nine eQMs were relevant to admitted and ED-only patients (because only inpatients were eligible for DVT prophylaxis). Performance was higher for admitted patients than for ED-only patients on 8 of the 9 eQMs (Table 3). The greatest difference between ED-only and admitted patients was for carotid artery imaging (445/1758 [25.3%] for ED-only vs 4478/5927 [75.6%] for admitted patients; difference, 50.3%; P < .001). In general, performance was better for patients with minor stroke than for patients with TIA (eTable 2 in the Supplement).

Table 3. Quality of Care Differences Between Admitted Patients and Patients Cared for Only in the ED.

Electronic Quality Measure ED Only (n = 2101) Admitted (n = 6100) Difference, %a P Value
Eligible, No. Pass, No. (%) [95% CI] Eligible, No. Pass, No. (%) [95% CI]
Carotid artery imaging by day 2 or within prior 6 mo 1758 445 (25.3) [23.3-27.4] 5927 4478 (75.6) [74.5-76.6] 50.3 <.001
Antithrombotic use by day 2 1709 916 (53.6) [51.2-56.0] 5768 5349 (92.7) [92.1-93.4] 39.1 <.001
Neurology consultation by day 1 1762 729 (41.4) [39.1-43.7] 6061 4792 (79.1) [78.0-80.1] 37.7 <.001
Anticoagulation for atrial fibrillation by day 7 after discharge 188 99 (52.7) [45.5-60.0] 1034 904 (87.4) [85.4-89.45] 34.7 <.001
Moderate- or high-potency statin prescription by day 7 after discharge 1622 408 (25.2) [23.0-27.3] 5432 2921 (53.8) [52.4-55.1] 28.6 <.001
HbA1c measurement by discharge or within 120 d in patients with diabetes 677 439 (64.8) [61.2-68.4] 2787 2420 (86.8) [85.6-88.1] 22.0 <.001
Electrocardiography by day 2 or within 1 d before event 1758 921 (52.4) [50.0-54.7] 5812 4152 (71.4) [70.3-72.6] 19.0 <.001
Brain imaging by day 2 1758 1326 (75.4) [73.4-77.4] 5805 5394 (92.9) [92.3-93.6] 17.5 <.001
Hypertension control (mean blood pressure <140/90 mm Hg during 90 d after discharge) 1246 904 (72.6) [70.1-75.0] 4733 3388 (71.6) [70.3-72.9] −1.0 .499

Abbreviations: ED, emergency department; HbA1c, hemoglobin A1c.

a

The difference was calculated as the rate for admitted patients minus the rate for ED-only patients. A positive difference indicates a higher rate for patients who were admitted to the hospital for their index transient ischemic attack or minor stroke (blue). Deep vein thrombosis prophylaxis was not included in this table because only patients in the hospital setting were eligible.

Most eligible patients (5521/7823 [70.6%]; 95% CI, 69.6%-71.6%) received early neurology consultation. The baseline characteristics of patients who received early neurology consultation differed from those of patients who did not receive early neurology consultation (eTable 3 in the Supplement). Patients who were admitted were more likely to receive early neurology care than patients who were discharged from the ED (Table 3). Performance was better for patients who received early neurology consultation for 8 of 9 eQMs (Table 4). For example, patients who received early neurology consultation were more likely to receive carotid artery imaging (difference, 29.7%). From these data, we cannot discern what role the neurologist played in the provision of care; we can only identify the unadjusted, observed association between the receipt of early neurology consultation and the other eQMs.

Table 4. Quality of Care Differences in Patients With and Without Early Neurology Carea.

Electronic Quality Measure Did Not Receive Neurology Care (n = 2302) Received Neurology Care (n = 5521) Difference, %b P Value
Eligible, No. Pass, No. (%) [95% CI] Eligible, No. Pass, No. (%) [95% CI]
Carotid artery imaging by day 2 or within prior 6 mo 2263 976 (43.1) [41.1-45.2] 5422 3947 (72.8) [71.6-74.0] 29.7 <.001
Brain imaging by day 2 2224 1701 (76.5) [74.7-78.2] 5339 5019 (94.0) [93.4-94.6] 17.5 <.001
HbA1c measurement by discharge or within 120 d in patients with diabetes 940 680 (72.3) [69.5-75.2] 2524 2179 (86.3) [85.0-87.7] 14.0 <.001
Antithrombotic use by day 2 2194 1630 (74.3) [72.5-76.1] 5283 4635 (87.7) [86.8-88.6] 13.4 <.001
Moderate-or high-potency statin prescription by day 7 after discharge 2067 801 (38.8) [36.6-40.8] 4987 2528 (50.7) [49.3-52.1] 11.9 <.001
Electrocardiography by day 2 or within 1 d before event 2227 1326 (59.5) [57.5-61.6] 5343 3747 (70.1) [68.9-71.4] 10.6 <.001
Anticoagulation for atrial fibrillation by day 7 after discharge 369 277 (75.1) [70.6-79.5] 853 726 (85.1) [82.7-87.5] 10.0 <.001
DVT prophylaxis by the end of hospital day 2 861 621 (72.1) [69.1-75.1] 3485 2632 (75.5) [74.1-77.0] 3.4 .034
Hypertension control (mean blood pressure <140/90 mm Hg during 90 d after discharge) 1634 1181 (72.3) [70.1-74.4] 4345 3111 (71.6) [70.3-72.9] −0.7 .60

Abbreviations: DVT, deep vein thrombosis; HbA1c, hemoglobin A1c.

a

This table includes information for 7823 patients; the 378 who were not eligible for the early neurology consultation electronic quality measure were excluded from these analyses.

b

The difference was calculated as the rate of patients who received neurology consultation within 1 day of the index event minus the rate of patients who did not receive early neurology consultation. A positive difference indicates a higher rate for patients who received early neurology care, whereas a negative difference indicates a higher rate for patients without early neurology care.

Facility-Level Performance

We observed substantial variation in performance across facilities (Table 2). The processes with the most variation were electrocardiography, with a mean facility pass rate of 66.9% (for facilities with at least 10 eligible patients) and a facility percentage outlier of 54.7%, and neurology consultation, with a mean facility pass rate of 65.4% and a facility percentage outlier of 53.0%. However, even for antithrombotic use by day 2, one of the processes with the best performance, 27.6% were statistical outliers. The eQMs thus identified facilities with extreme performance, a characteristic that may be desirable when implementing eQMs for quality improvement. Overall, no association was observed between patient volume and outlier status; smaller sites were, therefore, not more likely to be poor-quality outliers than larger sites.

Discussion

To our knowledge, this study was the first national benchmarking evaluation of TIA and minor stroke care quality for the VHA. We identified several opportunities for improvement. The processes with the lowest performance included moderate- or high-potency statin prescription, carotid artery imaging, and electrocardiography.

In general, the performance of the VHA nationwide was highest for processes that are included in the JC Stroke Core Measure Set (eg, DVT prophylaxis, antithrombotic use, and anticoagulation for atrial fibrillation and flutter). The JC measures focus on processes delivered during an inpatient stay through discharge. They do not include postdischarge processes (eg, hypertension control). For the JC measures, patients with ischemic stroke are included in the denominator for all measures. Patients with hemorrhagic stroke are included in 3 and patients with TIA in none. It may be that performance on JC measures was higher than for other measures because JC measures were familiar to clinicians and quality managers. Awareness of JC measures in the VHA may have been increased by a 2009 study of VHA stroke care quality, which focused on JC-based processes, and the 2011 VHA Acute Ischemic Stroke Directive, which mandated that every VHA hospital self-report 3 quality measures (National Institutes of Health Stroke Scale documentation, thrombolysis, and dysphagia screening). Thrombolysis is a current JC measure, and dysphagia screening is a former JC measure, potentially further enhancing awareness of JC measures.

In contrast to the well-established JC measures, some of the eQMs used in the present study were based on newer guideline recommendations. For example, although lipid management has been an established stroke quality indicator, we examined the use of moderate- to high-potency statins based on the 2013 American College of Cardiology/AHA lipid guidelines. As expected, performance on the new moderate- to high-potency statin eQM was only 47.2% among eligible patients.

A key finding was that patients who are admitted generally receive more elements of care for which they were eligible than ED-only patients. Several studies have reported similar findings. These findings support the AHA/ASA suggestion to admit patients with TIA within 72 hours of symptom onset to facilitate the delivery of diagnostic and therapeutic interventions. Certainly, the establishment of units that provide rapid outpatient assessment may offer cost-effective and patient-centered alternatives to inpatient admission. Our admission rate of 74.4% for patients with TIA was slightly higher than the 47% to 64% non-VHA admission rates from nationally representative US and Canadian samples.

Our finding that patients with TIA were less likely to receive some elements of care than patients with minor stroke is similar to a prior report. Although it is reasonable that patients with TIA may be less likely than patients with minor stroke to receive certain processes of care, for most elements of care there is no difference in the strength of the recommendation for TIA compared with minor stroke. Patients who are admitted (as opposed to ED-only patients) and those with a diagnosis of stroke (as opposed to TIA) may represent cases with greater diagnostic certainty, which may account for some of the observed differences in performance.

Our finding of relative underuse of secondary prevention medications is similar to findings from other settings. Although the VHA is the largest integrated health care system in the United States, with a robust electronic health record that facilitates communication and primary care clinical reminders related to vascular risk factor control, clinical care is still often provided within silos according to settings and medical specialties. Existing clinical boundaries will need to be spanned to provide secondary prevention care for patients with TIA and minor stroke.

The eQMs focused on guideline-concordant care; however, not all guideline-recommended processes may be of equal clinical relevance. The AHA/ASA suggested that 7 measures that were recommended for patients with ischemic stroke could be used to evaluate TIA care quality: antithrombotic use by day 2 and discharge, anticoagulation for atrial fibrillation or flutter, statin prescription at discharge, stroke education, tobacco cessation counseling, and carotid imaging. However, apart from the Centers for Disease Control and Prevention Coverdell program, few national organizations are currently tracking TIA care quality. Concern regarding ICD-9 code validity for the identification of patients with TIA and issues related to variation in workup have been cited as reasons for limited performance measurement for this population. The diagnostic uncertainty that accompanies the diagnosis of TIA complicates the coding issues and patient identification; however, establishment of quality measurement programs will incentivize improved coding. Given the robust evidence that timely delivery of post-TIA care reduces the risk of recurrent vascular events, national organizations should implement quality metrics that are applied to patients with TIA.

Strengths and Limitations

The strengths of this study included its national scope and the inclusion of 10 processes of care that had previously been validated against medical record review. The processes of care included diagnostic (eg, carotid artery imaging) and therapeutic (eg, antithrombotic use) components of care as well as both processes that are typically provided early after presentation (eg, brain imaging) and those that are provided later in the clinical course (eg, hypertension control). This study thus provides a comprehensive evaluation of care quality and data for processes that have been included in stroke performance measurement programs (eg, antithrombotic use) and components of care that have been recommended by AHA/ASA guidelines but for which few published data are available to provide benchmarking comparisons (eg, carotid artery imaging).

Several limitations of this study merit description. First, these results may differ from those in settings without consolidated electronic medical records. Second, these results may not generalize to nonveteran populations because of the male predominance in the veteran population and because veterans’ use of VHA EDs might differ from how nonveterans use non-VHA EDs. Third, these analyses are descriptive. Following the approach used by the JC, we reported the proportion of eligible patients who receive processes of care rather than constructing risk-adjusted models. For example, the observed differences in receipt of care between admitted and ED-only patients may be attributed in part to differences in patient characteristics. Similarly, we observed differences in the baseline characteristics of patients who received vs those who did not receive early neurology consultation (eTable 3 in the Supplement); therefore, differences in quality of care may have been attributable to differences in patient characteristics and not to the neurology consultation. Fourth, although we conducted stochastic testing on the differences in quality of care for admitted vs ED-only patients and for patients with vs without neurology consultation, we did not correct for multiple comparisons. Fifth, as indicated above, all the processes that were included were guideline-recommended elements of care; however, they varied in terms of their evidence grade. For example, brain imaging has an evidence grade of IA, and hypertension control has an evidence grade of IIb, C. Sixth, although most patients in this cohort (all of whom had an index TIA or minor stroke event at a VHA facility) sought primary care services after the index event at a VHA facility, some patients may have received care only at non-VHA facilities. We may have underestimated the pass rates for the few patients who received care only at non-VHA facilities. The process of care for which the issue of non-VHA care has the theoretical potential for greatest bias is hypertension control because the numerator of that measure is based on blood pressure values from the 90 days after the event. We did not have access to blood pressure data from non-VHA outpatient visits. If patients had no valid blood pressure data (eg, no VHA blood pressure measurement), they were excluded from the denominator of the hypertension control quality measure. Seventh, although we used eQMs that had been previously validated against medical record review, the use of electronic health record data may have resulted in misclassification of patients in terms of receipt of certain processes or eligibility for certain processes. In addition, specifications of numerator and denominator inclusions may be a source of misclassification (eg, as recommended by the AHA/ASA Performance Measures Set, the carotid imaging processes did not include or exclude patients on the basis of symptoms or event classification). Future research should examine whether patient characteristics account for differences in admission and differences in quality of care.

Conclusions

These results demonstrate that the VHA system is providing high-quality care for patients with TIA and minor stroke for many processes but also identified improvement opportunities. These results informed the design of a new VHA program (clinical trials.gov Identifier: NCT02769338) that focuses on timeliness of care and includes an intervention to improve acute care and secondary prevention service for patients with TIA or minor stroke and has led to new initiatives within the VHA emergency medicine service nationwide to expand the existing collaborations between ED and neurology to now focus on ensuring that all veterans with TIA receive the care they need.

Supplement.

eTable 1. Measure Specifications

eTable 2. Quality of Care Differences: TIA vs Minor Ischemic Stroke

eTable 3. Differences in Baseline Characteristics: Patients With vs Without Early Neurology Consultation

References

  • 1.Johnston KC, Connors AF Jr, Wagner DP, Knaus WA, Wang X, Haley EC Jr. A predictive risk model for outcomes of ischemic stroke. Stroke. 2000;31(2):448-455. [DOI] [PubMed] [Google Scholar]
  • 2.Wu CM, McLaughlin K, Lorenzetti DL, Hill MD, Manns BJ, Ghali WA. Early risk of stroke after transient ischemic attack: a systematic review and meta-analysis. Arch Intern Med. 2007;167(22):2417-2422. [DOI] [PubMed] [Google Scholar]
  • 3.Giles MF, Rothwell PM. Risk of stroke early after transient ischaemic attack: a systematic review and meta-analysis. Lancet Neurol. 2007;6(12):1063-1072. [DOI] [PubMed] [Google Scholar]
  • 4.Rothwell PM, Johnston SC. Transient ischemic attacks: stratifying risk. Stroke. 2006;37(2):320-322. [DOI] [PubMed] [Google Scholar]
  • 5.Ranta A, Dovey S, Weatherall M, O’Dea D, Gommans J, Tilyard M. Cluster randomized controlled trial of TIA electronic decision support in primary care. Neurology. 2015;84(15):1545-1551. [DOI] [PubMed] [Google Scholar]
  • 6.Lavallée PC, Meseguer E, Abboud H, et al. A transient ischaemic attack clinic with round-the-clock access (SOS-TIA): feasibility and effects. Lancet Neurol. 2007;6(11):953-960. [DOI] [PubMed] [Google Scholar]
  • 7.Luengo-Fernandez R, Gray AM, Rothwell PM. Effect of urgent treatment for transient ischaemic attack and minor stroke on disability and hospital costs (EXPRESS study): a prospective population-based sequential comparison. Lancet Neurol. 2009;8(3):235-243. [DOI] [PubMed] [Google Scholar]
  • 8.Rothwell PM, Giles MF, Chandratheva A, et al. ; Early use of Existing Preventive Strategies for Stroke (EXPRESS) study . Effect of urgent treatment of transient ischaemic attack and minor stroke on early recurrent stroke (EXPRESS study): a prospective population-based sequential comparison. Lancet. 2007;370(9596):1432-1442. [DOI] [PubMed] [Google Scholar]
  • 9.Kernan WN, Ovbiagele B, Black HR, et al. ; American Heart Association Stroke Council, Council on Cardiovascular and Stroke Nursing, Council on Clinical Cardiology, and Council on Peripheral Vascular Disease . Guidelines for the prevention of stroke in patients with stroke and transient ischemic attack: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45(7):2160-2236. [DOI] [PubMed] [Google Scholar]
  • 10.Kernan WN, Horwitz RI, Brass LM, Viscoli CM, Taylor KJ. A prognostic system for transient ischemia or minor stroke. Ann Intern Med. 1991;114(7):552-557. [DOI] [PubMed] [Google Scholar]
  • 11.Kernan WN, Viscoli CM, Brass LM, et al. The stroke prognosis instrument II (SPI-II): A clinical prediction instrument for patients with transient ischemia and nondisabling ischemic stroke. Stroke. 2000;31(2):456-462. [DOI] [PubMed] [Google Scholar]
  • 12.Meschia JF, Bushnell C, Boden-Albala B, et al. ; American Heart Association Stroke Council; Council on Cardiovascular and Stroke Nursing; Council on Clinical Cardiology; Council on Functional Genomics and Translational Biology; Council on Hypertension . Guidelines for the primary prevention of stroke: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45(12):3754-3832. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Easton JD, Saver JL, Albers GW, et al. ; American Heart Association; American Stroke Association Stroke Council; Council on Cardiovascular Surgery and Anesthesia; Council on Cardiovascular Radiology and Intervention; Council on Cardiovascular Nursing; Interdisciplinary Council on Peripheral Vascular Disease . Definition and evaluation of transient ischemic attack. Stroke. 2009;40(6):2276-2293. [DOI] [PubMed] [Google Scholar]
  • 14.Williams L. VA Stroke Quality Enhancement Research Initiative (QUERI) Annual Report and Strategic Plan. Indianapolis, IN: VA Health Services Research & Development Service; 2013. [Google Scholar]
  • 15.Bravata DM, Myers LJ, Cheng E, et al. Development and validation of electronic quality measures to assess care for patients with transient ischemic attack and minor stroke. Circ Cardiovasc Qual Outcomes. 2017;10(9):e003157. [DOI] [PubMed] [Google Scholar]
  • 16.Bravata D, Myers L, Cheng E, et al. Quality of care for veterans with TIA and minor stroke. Stroke. 2015;46(suppl 1):ATMP73. [Google Scholar]
  • 17.Joint Commission Stroke (STK) Core Measure Set. 2016.. http://www.jointcommission.org/assets/1/6/Stroke.pdf. Accessed December 15, 2017.
  • 18.American Heart Association/American College of Cardiology Measuring and improving quality of care: a report from the American Heart Association/American College of Cardiology First Scientific Forum on Assessment of Healthcare Quality in Cardiovascular Disease and Stroke. Circulation. 2000;101(12):1483-1493. [DOI] [PubMed] [Google Scholar]
  • 19.Smith EE, Saver JL, Alexander DN, et al. ; AHA/ASA Stroke Performance Oversight Committee . Clinical performance measures for adults hospitalized with acute ischemic stroke: performance measures for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45(11):3472-3498. [DOI] [PubMed] [Google Scholar]
  • 20.Borzecki AM, Wong AT, Hickey EC, Ash AS, Berlowitz DR. Can we use automated data to assess quality of hypertension care? Am J Manag Care. 2004;10(7, pt 2):473-479. [PubMed] [Google Scholar]
  • 21.Ross JS, Arling G, Ofner S, et al. Correlation of inpatient and outpatient measures of stroke care quality within veterans health administration hospitals. Stroke. 2011;42(8):2269-2275. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Bravata D, Ordin D, Vogel B, Williams L. The Quality of VA Inpatient Ischemic Stroke Care, FY2007: Final National and Medical Center Results of the VHA Office of Quality and Performance (OQP) Special Study. Washington, DC: US Dept of Veterans Affairs; 2009. [Google Scholar]
  • 23.Arling G, Reeves M, Ross J, et al. Estimating and reporting on the quality of inpatient stroke care by Veterans Health Administration Medical Centers. Circ Cardiovasc Qual Outcomes. 2012;5(1):44-51. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Stone NJ, Robinson J, Lichtenstein AH, et al. 2013 ACC/AHA guideline on the treatment of blood cholesterol to reduce atherosclerotic cardiovascular risk in adults: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation. 2014;129(25)(suppl 2):S1-S45. [DOI] [PubMed] [Google Scholar]
  • 25.Kehdi EE, Cordato DJ, Thomas PR, et al. Outcomes of patients with transient ischaemic attack after hospital admission or discharge from the emergency department. Med J Aust. 2008;189(1):9-12. [DOI] [PubMed] [Google Scholar]
  • 26.Scholte op Reimer WJ, Dippel DW, Franke CL, et al. Quality of hospital and outpatient care after stroke or transient ischemic attack: insights from a stroke survey in the Netherlands. Stroke. 2006;37(7):1844-1849. doi: 10.1161/01.STR.0000226463.17988.a3 [DOI] [PubMed] [Google Scholar]
  • 27.Kapral MK, Hall R, Fang J, et al. Association between hospitalization and care after transient ischemic attack or minor stroke. Neurology. 2016;86(17):1582-1589. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Chaudhry SA, Tariq N, Majidi S, et al. Rates and factors associated with admission in patients presenting to the ED with TIA in the United States-2006 to 2008. Am J Emerg Med. 2013;31(3):516-519. [DOI] [PubMed] [Google Scholar]
  • 29.Kamel H, Fahimi J, Govindarajan P, Navi BB. Nationwide patterns of hospitalization after transient ischemic attack. J Stroke Cerebrovasc Dis. 2013;22(7):e142-e145. [DOI] [PubMed] [Google Scholar]
  • 30.Chandratheva A, Lasserson DS, Geraghty OC, Rothwell PM; Oxford Vascular Study . Population-based study of behavior immediately after transient ischemic attack and minor stroke in 1000 consecutive patients: lessons for public education. Stroke. 2010;41(6):1108-1114. [DOI] [PubMed] [Google Scholar]
  • 31.Kapral MK, Laupacis A, Phillips SJ, et al. ; Investigators of the Registry of the Canadian Stroke Network . Stroke care delivery in institutions participating in the Registry of the Canadian Stroke Network. Stroke. 2004;35(7):1756-1762. [DOI] [PubMed] [Google Scholar]
  • 32.Fonarow GC, Reeves MJ, Smith EE, et al. ; GWTG-Stroke Steering Committee and Investigators . Characteristics, performance measures, and in-hospital outcomes of the first one million stroke and transient ischemic attack admissions in get with the guidelines-stroke. Circ Cardiovasc Qual Outcomes. 2010;3(3):291-302. [DOI] [PubMed] [Google Scholar]
  • 33.O’Hanlon C, Huang C, Sloss E, et al. Comparing VA and non-VA quality of care: a systematic review. J Gen Intern Med. 2017;32(1):105-121. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Center for Disease Control and Prevention History of the Coverdell Program. https://www.cdc.gov/dhdsp/programs/pcnasr_history.htm. Accessed January 9, 2017.
  • 35.Salinas J, Sprinkhuizen SM, Ackerson T, et al. An international standard set of patient-centered outcome measures after stroke. Stroke. 2016;47(1):180-186. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.clinicaltrials.gov Protocol-Guided Rapid Evaluation of Veterans Experience New Transient Neurological Symptoms (PREVENT). NCT02769338. https://clinicaltrials.gov/ct2/show/NCT02769338. Accessed December 15, 2017.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplement.

eTable 1. Measure Specifications

eTable 2. Quality of Care Differences: TIA vs Minor Ischemic Stroke

eTable 3. Differences in Baseline Characteristics: Patients With vs Without Early Neurology Consultation


Articles from JAMA Neurology are provided here courtesy of American Medical Association

RESOURCES