Abstract
Objective
The aim of this study was to measure the relationship between days spent waiting for primary care and health outcomes among patients diagnosed with diabetes, especially among the elderly population.
Data Source
Secondary data from VA administrative databases and Medicare claims.
Study Design
This is a retrospective observational study. Outcome variables include primary care utilization, mortality, heart attack, stroke, and ambulatory-care sensitive condition (ACSC) hospitalization. The main explanatory variable of interest is VA primary care wait time. Negative binomial models predict utilization and stacked logistic regression models predict the probability of experiencing each health outcome. Models are stratified by the presence of a selected health condition and age.
Principal Findings
Longer wait times were predicted to decrease utilization between 2 and 4 percent. There was no significant relationship between wait times and health outcomes for the overall sample. In stratified analyses, longer waits were associated with undesirable outcomes for those over age 70 with one of the selected health conditions or in certain narrower 5-year age groups, but the overall pattern of results does not indicate a systematic and significant effect.
Conclusions
There was a modest effect of long wait times on primary care utilization but no robust effect of longer wait times on health outcomes. Waiting for care did not significantly compromise long-term health outcomes for veterans with diabetes.
Keywords: Access to care, mortality, primary care wait times, ambulatory-caresensitive conditions, diabetes
Background
Delayed access to health care in the United States frustrates patients and concerns policy makers (U.S. GAO 1993; Van Deusen Lukas et al. 2004; Cunningham and Felland 2008). The Institute of Medicine's Committee on the Quality of Health Care in America (2001) highlighted reducing delays as one of six aims for improving the quality of America's health care system. Beyond the inconvenience to patients of not being able to access physician care when wanted, policy makers assume delayed access to health care negatively affects health outcomes through decreased or foregone health care utilization that delays diagnosis and treatment (Kenagy, Berwick, and Shore 1999; IOM 2001). Survey data support this link. In the 2007, Community Tracking Study, 35 percent of respondents with foregone or delayed health care did so because they could not get an appointment soon enough (Cunningham and Felland 2008).
Concern about waiting times is particularly timely now because major health reform that expands access to insurance coverage recently became law. The expansion of health insurance without a concomitant expansion in the supply of health care services to respond to the increased demand will result in longer waits (Buchmueller et al. 2005; Congressional Budget Office [CBO] 2008).
As a result of limited data on wait times, research testing the relationship between waiting for care and health outcomes is rare. One of the only sources of administrative data on wait times is the Veterans Health Administration (VA). Two separate studies using VA data support concerns about delayed access leading to poor health outcomes among a sample of veterans receiving geriatric clinic care. Prentice and Pizer (2007) found that elderly veterans who visited VA facilities with an average wait time of 31 days or more were significantly more likely to die compared with veterans who visited VA facilities with shorter waits. This study used random effects to account for unobservable characteristics of facilities, such as facility quality. If these characteristics were correlated with wait times, the estimated effect was confounded. Using the same sample, a subsequent study examined the relationship between waiting for outpatient care and the risk of ambulatory-care sensitive condition (ACSC) hospitalization (Prentice and Pizer 2008). ACSC hospitalizations are hospitalizations that are potentially avoidable with timely, high-quality outpatient care (Agency for Health Care Research and Quality [AHRQ] 2010). Geriatric clinic patients who visited VA facilities with wait times of 29 days or more had a significantly higher probability of having an ACSC hospitalization. This study included facility-level fixed effects, which controlled for facility quality characteristics that are constant over time. Taken together, these studies suggested that delayed access to care was problematic in an elderly population with a wide range of clinical conditions. The present study expands our understanding of the effect of wait times on health care utilization and outcomes in a clinically homogeneous population by focusing on a population diagnosed with diabetes.
Managing Diabetes in an Outpatient Setting
Diabetes is a chronic condition that relies on timely outpatient care for appropriate management. Complications from diabetes are minimized when providers focus on controlling blood glucose (HbA1c) levels and hypertension and monitor early signs of potential complications such as heart attack or foot ulcers (Diabetes Control and Complications Trial (DCCT) 1996, 2000; Mayfield et al. 1998; Stratton et al. 2000; Ross 2004; ADA 2005). Consequently, diabetes is a major focus of the ACSC hospitalizations (AHRQ 2010).
Elderly patients with diabetes may be at especially high risk of experiencing poor health outcomes if faced with delays in outpatient care. For example, as age increases, the physiological mechanisms that regulate blood sugar are impaired, increasing the risk of hypoglycemia (Chau and Edelman 2001; Hornick and Aron 2008). Geriatricians have defined frailty as a biologic syndrome of decreased physiological reserves that increase vulnerability to stressors. Among frail patients, delays in responding to small changes in health status may significantly increase the risk of more serious health outcomes (Fried et al. 2004). A higher prevalence of complex comorbid illnesses may also complicate diabetes management (Durso 2006). Finally, many elderly patients have been living with diabetes for a long period of time. This sustained metabolic imbalance increases the risk and severity of microvascular or macrovascular complications compared with newly diagnosed patients (Durso 2006; Fowler 2008).
Methods
Study Period and Study Population
Data are from VA administrative records and Medicare claims. This study measures outcomes from January 1, 2002 through December 31, 2003 with calendar year 2001 used as a baseline year for risk adjustment. We extract the sample from the VA Diabetes Epidemiology Cohorts database, a registry of all VA patients with diabetes since 1998. The criteria for identifying diabetes includes a prescription for diabetes medication in the current year and/or 2+ visits or stays with a diabetes code for inpatient and/or outpatient visits (VA and Medicare) over a 2-month period (Miller, Safford, and Pogach 2004). All veterans diagnosed with diabetes before 2001 are eligible to enter the sample. Separating the sample selection period (diabetes diagnosis before 2001) from the measurement of outcomes (2002 and 2003) minimizes potential sample selection bias (Prentice and Pizer 2007, 2008).
To maximize the completeness of utilization and diagnosis records, we further limit the sample to veterans who were also eligible for Medicare during 2002 or 2003, according to the Medicare Denominator file. We exclude individuals who were enrolled in a Medicare HMO in 2001 because claims data for these enrollees are not available.
Eligibility for Medicare increases our confidence that we can observe all utilization among our sample of veterans between the VA and Medicare data. We also want to maximize our chances of observing a relationship between waiting times and health outcomes. Veterans who rely heavily on Medicare are less likely to be affected by VA waiting times. Consequently, we further restrict the sample to veterans with no Medicare outpatient visits in 2001.
Waiting Time Data
The main explanatory variable of interest is the wait until the next available appointment at a VA facility. Services in the VA are provided at a parent station, such as a medical center, or a sub-station, such as a community-based outpatient clinic.1 Wait times are kept for each type of clinic appointment (e.g., urology) within a parent station and for all clinic appointments at a sub-station. To create a performance measure for tracking wait times, the VA aggregates wait times by appointment type to the parent station level on a monthly basis using a weighted average. The weight is the number of next available appointments at each sub-station that operate under a VA parent station (Baar 2005a,b).
The wait time measure in this study focuses on clinics that provide primary care. Primary care doctors in the VA manage diabetes and refer patients to specialty care as needed (Helmer et al. 2008). Consequently, primary care waits are a measure of the initial delays in accessing the VA system. Our wait time measure focuses on patients who are new to an appointment type (patients who have not had that type of appointment in the last 24 months). This is an overall measure of congestion at the facility. We rely on new patients because VA operations staff found that waiting time data for established patients are unreliable. For these patients, VA scheduling clerks have to distinguish between requests for follow-up appointments that are desired later (e.g., 3 months out) and urgent care appointments that are desired as soon as possible. Including follow-up appointments in a next available appointment measure may erroneously lengthen the result (Baar 2005a,b) VA managers have confirmed that nearly all new patients want the next available appointment (Veterans Health Administration [VHA] 2008), so focusing on these patients minimizes this concern about data reliability.
Exogenous Wait Time Measure
Previous studies demonstrated that wait times based on services an individual actually uses were inappropriate for studying the effect of wait times on outcomes. Unobserved individual health status affects individual wait times as well as outcomes, because sicker patients were triaged to receive care faster (Prentice and Pizer 2007, 2008). Although statistical controls for observable differences in health status will reduce the severity of this problem, it is not possible to measure health status precisely enough to eliminate it.
To properly isolate the effect of waiting on outcomes, we calculate a wait time that is exogenous to the individual. A detailed example of how this measure is constructed is presented in Appendix A. Briefly, we construct a wait time that would apply to the same “representative” patient at each VA facility. We compute the proportion of each type of primary care clinic appointment used by the entire sample in the baseline period. This proportion is multiplied by the wait in days for each type of primary care appointment at a parent station in a month and these products are summed for all primary care appointment types in the parent station. Multiplying the wait time for an appointment type by its proportion in the whole sample gives greater weight to the wait times of appointment types that are used more frequently by the entire sample. The result is a facility-level average wait time that is similar to measures used in published studies relating wait times to health outcome (Prentice and Pizer 2007, 2008).
This exogenous wait time is independent of whether a specific individual uses a specific VA facility. We take each individual's ZIP code from the Medicare denominator file in 2002 and 2003 and use it to assign them to the nearest VA facility. All individuals who are closest to the same VA facility are assigned the same exogenous facility-level monthly wait time.
Wait time is measured monthly, but it is often longer than 30 days. If a patient requests an appointment and has to wait, the impact of the delay will not typically be felt until the next month when the patient either has the appointment (short wait) or is still waiting (long wait). For this reason, we use a lagged wait time measure in our models. It is also possible that the effect of delayed access might take some time to develop into an observable health outcome. To allow for this, we average together the wait times for the previous 3 months to predict health outcomes in the current month (e.g., average wait for January–March 2002 to predict mortality in April 2002). This measure balances the need to accommodate delays in the development of the outcomes with the need to preserve the variation in wait times found in the data (longer averages smooth variation over time). The lagged 3-month average of wait time changes each month. For ease of interpretation, we scale the wait time measure by 10 days so that the unit of measure for VA wait time is an increase of 10 days.
Facility and Month Fixed Effects and Time Trend
The goal of this paper is to isolate the effect of primary care wait times on primary care utilization and health outcomes. To achieve this goal, a key aspect of our study design is the inclusion of fixed effects for each facility in the models. Including facility fixed effects has two main advantages: (1) alleviating concerns about case-mix differences across facilities and (2) controlling for time invariant differences in facility quality.
The facility fixed effect adjusts for between-facility variation in wait times (e.g., wait time differences between Boston VA and Denver VA) and focuses the analysis on the monthly variation in wait times within facilities (e.g., differences between Jan. 02 and Feb. 02 at Boston VA). As the identifying variation is within facilities and the sample is fixed in the baseline period, individual patients serve as their own controls. We are comparing individual patient outcomes in 1 month to outcomes for the same patients in other months. This design alleviates concerns about case-mix differences across facilities.
The second advantage of including facility fixed effects is that they control for all aspects of facility quality that remain constant over time. For example, facilities with managerial inefficiencies may provide poor quality of care and have longer wait times. The poorer quality of care also increases the risk of poorer health outcomes independent of wait times. Facility fixed effects eliminate any potential confounding from such permanent differences in quality across facilities.
We also include month fixed effects to control for seasonal variation in health outcomes and a time variable that counts up the number of observations for each person (e.g., time = 1 in the first uncensored month, 2 in the second uncensored month). These controls mean that any estimated relationship between wait times and health outcomes is identified exclusively by within-facility variations over time and is independent of national seasonal variations or trends. After isolating the identifying variation in wait times to within-facility variations over time, significant variation in wait times remained with 10 percent of the facility-months having a wait time of less than 36 days and 10 percent having a wait time of more than 61 days (Table 1). Thirty-five percent of the wait time variation in our sample was attributed to within-facility variations over time (163/470 = 0.35).
Table 1.
Distribution | Unadjusted Wait Time | Adjusted Wait Time* |
---|---|---|
10% | 25.79 | 35.66 |
25% | 34.40 | 41.97 |
50% | 45.44 | 48.14 |
75% | 57.67 | 53.99 |
90% | 72.96 | 61.29 |
Mean | 48.44 | 48.44 |
Variance | 470.30 | 163.13 |
Adjusted for facility-level fixed effects, month dummies, and time since entering the sample.
Risk Adjustment and Other Explanatory Variables
We risk adjust models to control for observable differences in prior individual health status. Explanatory variables include age, gender, race, comorbidities, distance to nearest VA medical center and VA community-based outpatient clinic and VA priority status. Veterans with a service connected disability (priority status 1–3) receive priority access and likely experience shorter waits. 2
We extract diagnosis codes from all inpatient and outpatient encounters financed by VA and Medicare during the 2001 baseline period. Our models include 28 comorbidity indicator variables defined by Elixhauser et al. (1998) using ICD-9-CM diagnosis codes to risk adjust the outcomes. These comorbidities include a wide variety of physical and mental conditions such as heart disease, neurological disorders, depression, and substance abuse.
We use the diabetes severity index developed by Young et al. (2008) to control for diabetes severity. This index includes measures of complications from retinopathy, nephropathy, neuropathy, cerebrovascular disease, cardiovascular disease, peripheral vascular disease, and metabolic disease. The individual is assigned a 0, 1, or 2 for each complication depending on its presence and severity (patients with neuropathy are given a 1 only; 6 × 2 = 12 + 1 = 13). ICD-9-CM codes from VA and Medicare outpatient and inpatient data for 2001 are used to determine the diabetes severity index for each individual.
Outcomes
We predict five outcomes: (1) monthly VA primary care utilization (2) mortality, (3) acute myocardial infarction (AMI), (4) stroke, and (5) ACSC hospitalization (see Appendix B for a list of ACSC hospitalizations). We ascertain mortality using the VA Vital Status File, which determines the date of death from VA, Medicare, and Social Security Administration data (Arnold et al. 2006). We use ICD-9-CM codes from VA and Medicare inpatient data to identify AMI, stroke, and ACSC hospitalization. Methodology from Petersen et al. (1999) and Kiyota et al. (2004) defines AMIs, methodology from Reker et al. (2002) defines strokes, and the AHRQ methodology (AHRQ 2010) determines ACSC hospitalizations. Following Prentice and Pizer (2008), hospitalizations are categorized as having one or more during the month versus none.
Analyses
Model Set-up
Data are analyzed using STATA 10.0. Our main explanatory variable of interest is VA primary care wait time. Patients in the hospital, nursing home, or Medicare HMO during the wait time measurement period are not affected by VA outpatient waiting times, so we censor months if the veteran is institutionalized or in a Medicare HMO for all 3 months during the wait time measurement period. For AMI, stroke, and ACSC hospitalization, we censor the outcome month if the individual was enrolled in a Medicare HMO during that month due to incomplete inpatient claims. Each individual has up to 21 observations. The outcome period is 24 months (2002 and 2003), but the lagged 3-month wait time excludes the first 3 months for each individual. The final sample size is 116,292 individuals.
We hypothesize that longer VA primary care waits will lead to less VA primary care utilization per veteran. To test this hypothesis, we use a negative binomial model to predict the number of VA primary care visits in a month (Table 2).3 Coefficients from negative binomial models are difficult to interpret. Consequently, we run a policy simulation to illustrate the effect of increasing VA primary care wait times by one standard deviation (20.7 days) on VA primary care utilization (Table 4). To examine the effect of wait times on health outcomes, we estimate logistic regression models that predict the probability of experiencing each outcome in each month of the outcome period (Table 5).4
Table 2.
<65 years old n = 36,088 | 65–69 years old n = 27,042 | 70–74 years old n = 22,790 | 75–80 years old n = 18,946 | ≥80 years old n = 11,426 | Total Sample n = 116,292 | |
---|---|---|---|---|---|---|
Male (') | 97.5 | 98.6 | 99.1 | 98.0 | 97.7 | 98.2 |
White (') | 71.6 | 76.1 | 73.1 | 74.6 | 73.2 | 73.6 |
Black (') | 23.0 | 20.4 | 21.4 | 20.0 | 21.5 | 21.5 |
Hispanic (') | 2.4 | 1.4 | 3.7 | 3.8 | 3.5 | 2.8 |
Asian (%) | 0.5 | 0.4 | 0.4 | 0.5 | 0.6 | 0.5 |
Native American (%) | 0.9 | 0.5 | 0.5 | 0.4 | 0.3 | 0.6 |
Other (%) | 1.7 | 1.2 | 0.9 | 0.6 | 0.9 | 1.2 |
Priority status 1–3 (%) | 53.6 | 28.6 | 29.9 | 35.7 | 41.1 | 39.0 |
Diabetes Severity Index (mean, SD) | 1.5 (1.7) | 1.6 (1.7) | 1.7 (1.8) | 1.8 (1.8) | 1.8 (1.8) | 1.6 (1.7) |
Congestive heart failure (%) | 9.1 | 9.5 | 11.2 | 13.3 | 15.3 | 10.9 |
Cardiac arrhythmias (%) | 5.9 | 9.0 | 10.7 | 13.8 | 16.9 | 9.9 |
Valvular disease (%) | 1.8 | 2.7 | 3.3 | 4.4 | 4.7 | 3.0 |
Pulmonary circulation disorder (%) | 0.6 | 0.5 | 0.5 | 0.6 | 0.7 | 0.6 |
Peripheral vascular disease (%) | 9.7 | 12.4 | 13.9 | 16.0 | 15.7 | 12.8 |
Hypertension (%) | 69.3 | 77.3 | 77.8 | 77.8 | 75.1 | 74.8 |
Paralysis (%) | 2.0 | 1.0 | 1.2 | 1.2 | 1.1 | 1.4 |
Other neurological disorder (%) | 3.6 | 2.3 | 2.8 | 3.5 | 3.9 | 3.1 |
Chronic pulmonary disease (%) | 15.0 | 14.9 | 16.8 | 17.9 | 16.9 | 16.0 |
Hypothyroidism (%) | 4.4 | 4.1 | 4.8 | 5.5 | 6.6 | 4.8 |
Renal failure (%) | 6.0 | 5.3 | 6.1 | 7.2 | 7.7 | 6.2 |
Liver disease (%) | 4.0 | 1.4 | 1.2 | 0.8 | 0.6 | 2.0 |
Peptic ulcer disease including bleeding (%) | 1.5 | 1.9 | 2.0 | 2.3 | 2.2 | 1.9 |
AIDS (%) | 0.7 | 0.2 | 0.1 | 0.03 | 0.04 | 0.3 |
Lymphoma (%) | 0.5 | 0.6 | 0.7 | 0.7 | 0.7 | 0.6 |
Metastatic cancer (%) | 0.4 | 0.5 | 0.7 | 0.7 | 0.8 | 0.6 |
Solid tumor without metastasis (%) | 5.5 | 11.2 | 14.5 | 17.9 | 19.8 | 12.0 |
Rheumatoid arthritis/ collagen vascular diseases (%) | 2.1 | 1.7 | 1.8 | 1.6 | 1.9 | 1.8 |
Coagulopathy (%) | 1.6 | 1.6 | 1.6 | 1.9 | 2.1 | 1.7 |
Obese (%) | 22.9 | 17.6 | 14.1 | 11.0 | 6.5 | 16.4 |
Weight loss (%) | 1.1 | 1.1 | 1.4 | 1.9 | 2.4 | 1.4 |
Fluid and electrolyte disorders (%) | 4.3 | 3.9 | 4.3 | 4.6 | 6.0 | 4.4 |
Blood loss anemia (%) | 0.2 | 0.3 | 0.5 | 0.6 | 0.5 | 3.8 |
Deficiency anemias (%) | 6.5 | 7.3 | 8.8 | 11.4 | 14.0 | 8.7 |
Alcohol abuse (%) | 6.4 | 2.4 | 1.8 | 1.2 | 0.8 | 3.2 |
Drug abuse (%) | 3.9 | 0.5 | 0.3 | 0.2 | 0.1 | 1.4 |
Psychoses (%) | 21.6 | 6.1 | 5.5 | 5.6 | 5.4 | 10.6 |
Depression (%) | 17.6 | 7.7 | 7.2 | 7.3 | 7.1 | 10.5 |
Number of comorbidities (mean, SD) | 2.3 (1.6) | 2.0 (1.5) | 2.2 (1.6) | 2.3 (1.6) | 2.4 (1.7) | 2.2 (1.6) |
Selected health condition† | 71.1 | 71.4 | 73.1 | 74.7 | 73.4 | 72.4 |
This is defined as anyone diagnosed with retinopathy, neuropathy, nephropathy, cardiovascular, cerebrovascular, peripheral vascular, or metabolic disease according to Young et al. (2008) or anyone with congestive heart failure, cardiac arrhythmias, valvular disease, peripheral vascular disease, renal failure, or obesity according to Elixhauser et al. (1998).
Table 4.
Baseline | Simulation | % Change | |
---|---|---|---|
Average wait time | 47.9 | 68.6 | 43.2 |
Stratification | |||
None (n = 116,113) | 0.349 | 0.338 | −3.2 |
No SHC (n = 32,080) | 0.296 | 0.286 | −3.4 |
At least one SHC (n = 84,033) | 0.369 | 0.359 | −2.7 |
<70 and no SHC (n = 18,137) | 0.291 | 0.280 | −3.8 |
<70 and SHC (n = 44,881) | 0.358 | 0.350 | −2.2 |
≥70 and no SHC (n = 15,463) | 0.303 | 0.293 | −3.7 |
>70 and SHC (n = 43,116) | 0.381 | 0.368 | −3.4 |
<65 years old (n = 36,016) | 0.336 | 0.328 | −2.4 |
65–69 years old (n = 33,095) | 0.341 | 0.331 | −2.9 |
70–74 years old (n = 28,236) | 0.356 | 0.343 | −3.7 |
75–79 years old (n = 22,704) | 0.365 | 0.353 | −3.3 |
≥80 years old (n = 14,313) | 0.361 | 0.347 | −3.9 |
Notes. Selected health condition is defined as anyone diagnosed with retinopathy, neuropathy, nephropathy, cardiovascular, cerebrovascular, peripheral vascular, or metabolic disease according to Young et al.(2008) or anyone with congestive heart failure, cardiac arrhythmias, valvular disease, peripheral vascular disease, renal failure, or obesity according to Elixhauser et al. (1998).
The coefficient, standard error, and p -value for the VA wait time are shown. Wait time is divided by 10 so the coefficient reflects a 10-day increase in wait time. Models also include Elixhauser comorbidities, diabetes severity index, distance to nearest VA medical center, distance to nearest VA outpatient clinic, station-level fixed effects, demographics, time since entering the sample, and month dummies. Full results are available from the authors upon request.
Table 5.
Mortality | AMI | Stroke | ACSC Hospitalization | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Stratification | N† | AOR‡ | p-value** | n | AOR | p-value** | N | AOR | p-value | N | AOR | p-value |
None | 116,292 | 1.01 | 0.52 | 116,113 | 1.02 | 0.31 | 116,113 | 1.01 | 0.47 | 116,113 | 1.00 | 0.88 |
No SHC | 32,129 | 0.99 | 0.57 | 30,640 | 0.94 | 0.14 | 31,230 | 1.00 | 0.99 | 32,080 | 1.00 | 0.85 |
At least one SHC | 84,163 | 1.01 | 0.33 | 84,033 | 1.03 | 0.10 | 83,869 | 1.02 | 0.44 | 84,033 | 1.00 | 0.78 |
<70 and SHC¶ | 44,956 | 0.99 | 0.51 | 44,881 | 1.02 | 0.51 | 44,178 | 0.95 | 0.16 | 44,881 | 0.99 | 0.40 |
≥70 and no SHC | 15,469 | 0.99 | 0.71 | 13,405 | 0.95 | 0.28 | 13,594 | 0.97 | 0.61 | 15,415 | 1.03 | 0.21 |
≥70 and SHC | 43,177 | 1.02 | 0.09 | 42,952 | 1.04 | 0.12 | 42,780 | 1.06 | 0.05 | 43,116 | 1.00 | 0.71 |
<65 years old | 36,081 | 1.01 | 0.76 | 35,112 | 1.04 | 0.28 | 33,849 | 0.96 | 0.29 | 36,016 | 1.00 | 0.81 |
65–69 years old | 33,184 | 0.98 | 0.26 | 32,848 | 0.98 | 0.52 | 31,368 | 0.98 | 0.70 | 33,095 | 0.98 | 0.20 |
70–74 years old | 28,282 | 1.00 | 0.95 | 27,777 | 0.99 | 0.85 | 27,358 | 1.09 | 0.04 | 28,164 | 0.99 | 0.43 |
75–79 years old | 22,709 | 1.01 | 0.76 | 22,330 | 1.05 | 0.08 | 21,811 | 1.01 | 0.78 | 22,704 | 1.00 | 0.77 |
≥80 years old | 14,328 | 1.04 | 0.04 | 13,823 | 1.00 | 0.95 | 13,328 | 1.03 | 0.52 | 14,313 | 1.03 | 0.04 |
Selected health condition is defined as anyone diagnosed with retinopathy, neuropathy, nephropathy, cardiovascular, cerebrovascular, peripheral vascular or metabolic disease according to Young et al. (2008), or anyone with congestive heart failure, cardiac arrhythmias, valvular disease, peripheral vascular disease, renal failure, or obesity according to Elixhauser et al. (1998).
Results with p-values less than or equal to 0.10 shown in bold.
n = number of persons in model. The sample size is different for each model due to different censoring restrictions (see Model Set Up section and note 4 for a detailed description).
The adjusted odds ratio (AOR) for the VA wait time is shown. Wait time is divided by 10 so the adjusted odds ratio reflects a 10-day increase in wait time. Models also include distance to nearest VA medical center, distance to nearest VA outpatient clinic, station-level fixed effects, demographics, time since entering the sample, and month dummies. Full results are available from the authors upon request.
The infrequency of outcomes in the <70 years old and no selected health condition group resulted in unstable models when using facility-fixed effects.
ACSC, ambulatory-care sensitive condition.
Initial models include everyone in the sample. We hypothesize that longer waits for primary care will significantly increase the risk of poor health outcomes for the elderly. To disentangle the effect of age alone versus more severe diabetes or higher comorbidity burden, we stratify the sample based on whether the patient was diagnosed during baseline with any of a set of “selected health conditions,” which we chose because they are related to increased risk of the poor health outcomes included in the study. We define “selected health condition” as being diagnosed with any diabetes complication according to Young et al. (2008) or being diagnosed with congestive heart failure, cardiac arrhythmias, valvular disease, peripheral vascular disease, renal failure, or obesity according to Elixhauser et al. (1998). We then stratify based on broad age groups and having a selected health condition at baseline. Finally, we stratify the analyses by 5-year age groups as the risk of developing diabetes complications, common geriatric conditions, and general frailty that may compromise diabetes management increases with age (Tables 3–5). As a result of small sample sizes, we could not stratify on both 5-year age groups and the presence of a selected health condition.
Table 3.
Stratification | β* | Standard Error | p-value |
---|---|---|---|
None (n = 116,113) | −0.0150 | 0.0011 | <.0001 |
No SHC (n = 32,080) | −0.0173 | 0.0022 | <.0001 |
At least one SHC (n = 84,033) | −0.0142 | 0.0013 | <.0001 |
<70 and no SHC (n = 18,137) | −0.0178 | 0.0031 | <.0001 |
< 70 and SHC (n = 44,881) | −0.0112 | 0.0019 | <.0001 |
≥70 and no SHC (n = 15,463) | −0.0164 | 0.0032 | <.0001 |
>70 and SHC (n = 43,116) | −0.0174 | 0.0018 | <.0001 |
<65 years old (n = 36,016) | −0.0110 | 0.0022 | <.0001 |
65–69 years old (n = 33,095) | −0.0149 | 0.0026 | <.0001 |
70–74 years old (n = 28,236) | −0.0173 | 0.0025 | <.0001 |
75–79 years old (n = 22,704) | −0.0159 | 0.0028 | <.0001 |
≥80 years old (n = 14,313) | −0.0189 | 0.0036 | <.0001 |
Note. Selected health condition is defined as anyone diagnosed with retinopathy, neuropathy, nephropathy, cardiovascular, cerebrovascular, peripheral vascular, or metabolic disease according to Young et al. (2008) or anyone with congestive heart failure, cardiac arrhythmias, valvular disease, peripheral vascular disease, renal failure, or obesity according to Elixhauser et al. (1998).
The coefficient, standard error, and p-value for the VA wait time are shown. Wait time is divided by 10 so the coefficient reflects a 10-day increase in wait time. Models also include Elixhauser comorbidities, diabetes severity index, distance to nearest VA medical center, distance to nearest VA outpatient clinic, station-level fixed effects, demographics, time since entering the sample, and month dummies. Full results are available from the authors upon request.
Results
Like other samples of older veterans, our sample was predominantly male and in generally poor health (Table 2). Looking across the rows in Table 2 for the health status variables, the prevalence of each comorbidity increased with age, with a few exceptions such as paralysis and mental health disorders. These conditions were more prevalent in the less than 65 group, likely reflecting a population that was eligible for Medicare because of disability. Overall, 72 percent of the sample was considered to have one of the selected health conditions during the baseline period with this percentage ranging from 73 to 75 percent for veterans aged 70 or older. The percentages of individuals who died, experienced an AMI, stroke, or ACSC hospitalization increased with the presence of a selected health condition at baseline and with age (Appendix C).
Veterans who visited VA facilities with longer primary care wait times had significantly lower primary care utilization compared with veterans who visited VA facilities with shorter primary care wait times for the entire sample and for each stratified group (Table 3).5 The size of the waiting time effect is illustrated in Table 4, which predicts how VA primary care utilization would change with a one standard deviation increase (20.7 days) in wait time. For example, our model predicts that in the overall sample veterans had 0.349 primary care visits each month. An increase in wait times of 20.7 days was predicted to decrease the number of primary care visits to 0.338 visits per month. This translated into a predicted decrease in primary care utilization of 3.2. Generally, an increase of one standard deviation in wait time is predicted to decrease primary care utilization between 2 and 4 percent.
Longer waits for primary care did not significantly increase the odds of experiencing a poor health outcome for the overall sample (Table 5).5 In analyses stratified by age or selected health conditions, wait time did not consistently increase the odds of experiencing a negative health outcome. Forty stratified models were run and wait time significantly increased the effect of experiencing a poor health outcome at p < .10 in seven of these models. Except for the likelihood of experiencing an AMI, for which waiting had a significant effect at p = .10 for veterans with a selected health condition at baseline, longer waits for primary care did not significantly predict poor health outcomes for veterans when the presence of a selected condition was considered but age was not. Longer waits for primary care significantly increased the risk of experiencing poor health outcomes for veterans aged 70 or more and diagnosed with a selected condition. A 10-day increase in facility-level primary care wait time led to a 2 percent (p = .09) increase in the adjusted odds of mortality and a 6 percent increase in the adjusted odds of stroke (p = .05) for this group. There was no significant relationship between primary care wait times and health outcomes for veterans aged less than 70 who were diagnosed with the selected conditions or veterans aged 70 or more who did not have these conditions. When stratifying by age only, the primary care wait time did not significantly increase the odds of experiencing a negative health outcome for veterans aged less than 70 years old. A 10-day increase in facility-level primary care wait time led to a 9 percent increase in the adjusted odds of stroke (p = .04) for veterans aged 70–74, and a 5 percent (p = .08) increase in the adjusted odds of AMI for veterans aged 75–79. For veterans 80 and older, the same 10-day facility-level change in wait time was associated with a 4 percent (p = .04) increase in the adjusted odds of mortality and a 3 percent (p = .04) increase in the adjusted odds of ACSC hospitalization.
Discussion
There is a strong consensus that complications from diabetes can be prevented or minimized if the disease is consistently managed in an outpatient setting (DCCT 1996, 2000; Stratton et al. 2000; Ross 2004, ADA 2005). Long waits for outpatient care are hypothesized to be problematic because decreases in utilization compromise the management of diabetes and increase the risk of poor health outcomes. In this sample of veterans with diabetes, longer waits for primary care modestly reduced primary care utilization (Tables 3 and 4). An increase in wait times of 21 days is predicted to decrease primary care utilization by only 2–4 percent.
Results from this study provide no consistent support for the hypothesis that longer wait times negatively affect health outcomes, a general finding best illustrated by the lack of a significant relationship between longer primary care wait times and health outcomes for the overall sample (Table 5). Long wait times were hypothesized to significantly increase the risk of poor health outcomes, especially among elderly patients. Stratified analyses by selected health condition and age found small significant effects on health outcomes in only a few cases (Table 5).
Two aspects of our study design may cause our results to be overestimated. First, analyses include facility-level fixed effects, month dummies, and a time trend. This design isolates the effect of wait times on health outcomes by focusing on month-to-month changes in wait times within facilities and by controlling for aspects of facility quality that remain constant over time. The principal limitation of this design is that we cannot completely rule out alternative explanations for our findings, including reverse causation and omitted variables. An example of reverse causation is an unobserved local flu epidemic at a VA facility that may increase wait times and cause poorer health outcomes that are not attributable to longer wait times. An example of omitted variable bias is a change in facility management that could simultaneously improve quality, reduce waiting times, and improve outcomes through better resource allocation. The key to these explanations is that they feature unobservable local changes that are correlated with both local waiting time variations and local outcome changes. Either of these situations would cause our estimates to be overstated. In the absence of truly random variation in waiting times, this limitation is unavoidable. Second, it is also possible that our use of the number of days until the next available appointment for new patients as our wait time measure when our study population consists of established patients could cause our estimates to be overstated. This would occur if established patients do not experience longer waits when new patients do. We chose to use the new patient wait time because of its reliability (VHA 2002) and because our own experience suggests that congestion affects both new and established patients. These limitations in combination with an inconsistent pattern in the few significant results means we cannot formally conclude that wait times had a substantial effect on long-term health outcomes.
Our exogenous measure of wait time may also cause our results to be underestimated. By construction this variable is removed from the patient and is therefore an imprecise measure of congestion faced by individual patients. Imprecision in independent variables, or measurement error, causes estimated effects to be attenuated (biased toward zero). For this reason, the true effects of wait times on utilization and health outcomes could be larger than our estimates.
The lack of a significant effect of wait times on the long-term health outcomes in this study is divergent from previous research that finds a significant effect of timely access to care on short-term health outcomes in a population with diabetes. Subramanian et al. (2009) and Prentice et al. (2011) found patients visiting clinics providing more timely access had lower HbA1c levels compared with patients visiting clinics with less timely access. Quality improvement programs that achieve the largest improvements in HbA1c levels include timely access to care components, such as pharmacists who can adjust medication without waiting for physician authorization (Shojania et al. 2006). One reason why timely access might improve short-term outcomes is that a “white coat effect” has been found on medication adherence where patients are more likely to adhere to medications right before and after doctor's appointments (Cramer, Scheyer, and Mattson 1990; Ho, Bryson, and Rumsfeld 2009). Decreased overall utilization due to long waits as found in this study may decrease medication adherence, which in turn compromises HbA1c, blood pressure, and lipid control. The discrepancy between our findings and previous research predicting short-term outcomes may be simply due to the fact that long-term outcomes take a long time to develop, whereas short-term health outcomes can respond more quickly to longer waits and decreased utilization.
Although we cannot conclude that there was any significant effect on health outcomes in this study, findings from this research highlight the need for further study of the effect of wait times on long-term outcomes, especially among the elderly. The few significant effects found in this study corresponded to those older than 70 with one of the selected conditions or in certain narrower age groups and they all point in the same direction, with longer waits associated with undesirable outcomes (Table 5). This is consistent with previous studies that found relationships between waiting for outpatient care and mortality and ACSC hospitalizations for a sample of geriatric veterans (Prentice and Pizer 2007, 2008).
Despite the need for additional research, there are ongoing policy implications to which this study is relevant. Managers and policy makers debate the most effective scheduling policies to best serve the needs of all patients (Murray and Berwick 2003; Mehrotra, Keehl-Markowitz, and Ayanian 2008). Proponents of open access (e.g., next day [OA]) scheduling argue that the process of triaging decreases supply and unnecessarily increases demand (Murray and Berwick 2003). Others argue that the cost of triaging is smaller than the health benefits of providing priority access to patients with observable medical needs (Gravelle and Siciliani 2009).
Veterans Health Administration official policy requires VA medical centers to provide care for urgent health care needs but then prioritizes patients’ access to other care by the presence and extent of a service-connected disability (VHA 2006, 2008). Our results suggest that this is a reasonable approach for patients diagnosed with diabetes. Veterans who visited VA facilities with longer waits had slightly less primary care utilization compared with veterans who visited facilities with shorter waits, but there was no significant increase in the risk of experiencing a long-term health outcome for the former group.
The lack of a significant effect of waiting for health care on health outcome among this population of patients does not preclude a negative effect of waiting for care on other patient populations. Studies have repeatedly found that longer waits for outpatient care compromise short-and long-term health outcomes on a variety of patient populations, including patients with diabetes (Subramanian et al. 2009; Prentice et al. 2011) and vulnerable geriatric clinic populations (Prentice and Pizer 2007, 2008). In contrast, Subramanian et al. (2009) found that diabetes processes of care (e.g., HbA1c testing) suffered in OA clinics versus control clinics, resulting in fears that OA scheduling increased focus on acute care management and crowded out long-term chronic disease management. If so, getting patients into outpatient care as soon as possible may not be the most effective approach and having everyone wait longer to ensure appropriate processes are followed may be better. Policy makers and clinicians should think carefully about the cost and benefits of scheduling procedures for different patient populations to ensure high-quality care and prevent poor health outcomes.
Acknowledgments
Funding for this research was provided by grant IAD-06-112 and IIR 04-233 from the Health Services Research and Development Service, Department of Veterans Affairs and grant 62967 from the Health Care Financing and Organization Initiative under the Robert Wood Johnson Foundation. The authors are indebted to Matthew Neuman and John Gardner, PhD, for programing support. The authors report no relationships or financial interests with any entity that would pose a conflict of interest.
Disclaimers: The views expressed in this article are those of the authors and do not necessarily represent the position or policy of the Department of Veteran Affairs or Boston University. This research was approved by the VA Boston Health Care System institutional review board.
An earlier version of this paper was presented at the 2010 AcademyHealth Annual Research Meeting and the 2010 American Public Health Association National Meeting.No other disclosures.
Notes
For ease of presentation, “facility” and “parent station” are used interchangeably throughout the paper to refer to a VA medical center.
Service-connected disability is a condition that the VA has determined was incurred in or aggravated by military service.
We also test the hypothesis that veterans would substitute Medicare for VA care and total utilization would not go down. We estimate negative binomial models predicting total Medicare outpatient utilization using average VA wait time and find no significant relationship.
Sample sizes for each negative binomial and logistic regression model are included in Tables 3–5. Sample sizes change for each model because different months are censored due to hospitalization, nursing home stays, and Medicare HMO enrollment. Finally, if there was no variation in outcome for all observations under a VA facility or for all individuals diagnosed with the same comorbidity, all observations from that VA facility or diagnosed with the comorbidity are dropped. This was more common in the AMI and stroke models where the outcomes are rare.
Full results from utilization and health outcome models are available from the authors upon request.
SUPPORTING INFORMATION
Additional supporting information may be found in the online version of this article:
Appendix SA1: Author Matrix.
Appendix A: Example of Exogenous Wait Time Calculation.*
Appendix B: Descriptive Statistics of ACSC Hospitalizations Stratified by Age.†
Appendix C: Descriptive Statistics of Outcomes Stratified by Age and Selected Health Condition (SHC).†
Please note: Wiley-Blackwell is not responsible for the content or functionality of any supporting materials supplied by the authors. Any queries (other than missing material) should be directed to the corresponding author for the article.
References
- Agency for Health Care Research and Quality (AHRQ) 2010. [accessed on March 30, 2010]. Available at http://www.qualityindicators.ahrq.gov/pqi_download.ht.
- American Diabetes Association(ADA) Standards of Medical Care in Diabetes. Diabetes Care. 2005;28(1):S4–36. [Google Scholar]
- Arnold N, Sohn M-W, Maynard C, Hynes DM. VA-NDI Mortality Merge Project. In: VA Information Resource Center, editor. VIReC Technical Report 2. Hines, IL: VA Information Resource Center; 2006. pp. 1–34. [Google Scholar]
- Baar B. New Patient Monitor: Data Definitions. Washington, DC: Veterans Health Administration Support Services Center; 2005a. [Google Scholar]
- Baar B. Performance Measure Clinic Data Definitions and Discussion. Washington, DC: Veterans Health Administration Support Services Center; 2005b. [Google Scholar]
- Buchmueller TC, Grumbach K, Kronick R, Kahn JG. The Effect of Health Insurance on Medical Care Utilization and Implications for Insurance Expansion: A Review of the Literature. Medical Care Research and Review. 2005;62(1):3–30. doi: 10.1177/1077558704271718. [DOI] [PubMed] [Google Scholar]
- Chau D, Edelman SV. Clinical Management of Diabetes in the Elderly. Clinical Diabetes. 2001;19(4):172–4. [Google Scholar]
- Cramer JA, Scheyer RD, Mattson RH. Compliance Declines between Clinic Visits. Archives of Internal Medicine. 1990;150:1509–10. [PubMed] [Google Scholar]
- Congressional Budget Office (CBO) Key Issues in Analyzing Major Health Insurance Proposals. Washington D.C: Congressional Budget Office; 2008. pp. 1–167. [Google Scholar]
- Cunningham PJ, Felland LE. Falling Behind: Americans’ Access to Medical Care Detoriates, 2003-2007. Washington D.C: Center for Studying Health System Change; 2008. [Google Scholar]
- Diabetes Control and Complications Trial (DCCT) Lifetime Benefits and Costs of Intensive Therapy as Practiced in the Diabetes Control and Complications Trial. Journal of the American Medical Association. 1996;276:1409–15. [PubMed] [Google Scholar]
- Diabetes Control and Complications Trial (DCCT) Retinopathy and Nephropathy in Patients with Type 1 Diabetes Four Years after a Trial of Intensive Insulin Therapy. New England Journal of Medicine. 2000;342:381–9. doi: 10.1056/NEJM200002103420603. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Durso SC. Using Clinical Guidelines Designed for Older Adults with Diabetes Mellitus and Complex Health Status. Journal of the American Medical Association. 2006;295(16):1935–40. doi: 10.1001/jama.295.16.1935. [DOI] [PubMed] [Google Scholar]
- Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity Measures for Use with Administrative Data. Medical Care. 1998;36(1):8–27. doi: 10.1097/00005650-199801000-00004. [DOI] [PubMed] [Google Scholar]
- Fried LP, Ferrucii L, Darer J, Williamson JD, Anderson G. Untangling the Concepts of Diasbilty, Frailty, and Comorbidity: Implications for Improved Targeting and Care. Journal of Gerontology. 2004;59(3):255–63. doi: 10.1093/gerona/59.3.m255. [DOI] [PubMed] [Google Scholar]
- Fowler MJ. Microvascular and Macrovascular Complications of Diabetes. Clinical Diabetes. 2008;26(2):77–82. [Google Scholar]
- Gravelle H, Siciliani L. Third Degree Waiting Time Discrimination: Optimal Allocation of a Public Sector Healthcare Treatment under Rationing by Waiting. Health Economics. 2009;18:977–86. doi: 10.1002/hec.1423. [DOI] [PubMed] [Google Scholar]
- Helmer DA, Sambamoorthi U, Rajan M, Tseng C-L, Pogach LM. Glycemic Control in Elderly Veterans with Diabetes: Individualized, Not Age-Based. Diabetes Care. 2008;31(4):728–31. doi: 10.2337/dc07-1431. [DOI] [PubMed] [Google Scholar]
- Ho PM, Bryson CL, Rumsfeld JS. Medication Adherence: Its Importance in Cardiovascular Outcomes. Circulation. 2009;119:3028–35. doi: 10.1161/CIRCULATIONAHA.108.768986. [DOI] [PubMed] [Google Scholar]
- Hornick T, Aron DC. Managing Diabetes in the Elderly: Go Easy, Individualize. Cleveland Clinic Journal of Medicine. 2008;75(1):70–8. doi: 10.3949/ccjm.75.1.70. [DOI] [PubMed] [Google Scholar]
- Institute of Medicine (IOM), The Committee on the Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington D.C: Institute of Medicine; 2001. [Google Scholar]
- Kenagy JW, Berwick DM, Shore MF. Service Quality in Health Care. Journal of the American Medical Association. 1999;281(7):661–5. doi: 10.1001/jama.281.7.661. [DOI] [PubMed] [Google Scholar]
- Kiyota Y, Schneeweiss S, Glynn RJ, Cannuscio CC, Avorn J, Solomon DH. Accuracy of Medicare Claims-Based Diagnosis of Acute Myocardial Infarction: Estimating Positive Predictive Value on the Basis of Review of Hospital Records. American Heart Journal. 2004;148(1):100–4. doi: 10.1016/j.ahj.2004.02.013. [DOI] [PubMed] [Google Scholar]
- Mayfield JA, Reiber GE, Sanders LJ, Jannisse D, Pogach LM. Preventive Foot Care in People with Diabetes. Diabetes Care. 1998;21(12):2161–77. doi: 10.2337/diacare.21.12.2161. [DOI] [PubMed] [Google Scholar]
- Mehrotra A, Keehl-Markowitz L, Ayanian JZ. Implementing Open-Access Scheduling of Visits in Primary Care Practices: A Cautionary Tale. Annals of Internal Medicine. 2008;148(12):915–22. doi: 10.7326/0003-4819-148-12-200806170-00004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller DR, Safford MM, Pogach LM. Who Has Diabetes? Best Estimates of Diabetes Prevalence in the Department of Veterans Affairs Based on Computerized Patient Data. Diabetes Care. 2004;27(Suppl 2):B10–21. doi: 10.2337/diacare.27.suppl_2.b10. [DOI] [PubMed] [Google Scholar]
- Murray M, Berwick DM. Advanced Access: Reducing Waiting and Delays in Primary Care. Journal of the American Medical Association. 2003;289:1035–40. doi: 10.1001/jama.289.8.1035. [DOI] [PubMed] [Google Scholar]
- Petersen LA, Wright S, Normand S-LT, Daley J. Positive Predictive Value of the Diagnosis of Acute Myocardial Infarction in an Administrative Database. Journal of General Internal Medicine. 1999;14:555–8. doi: 10.1046/j.1525-1497.1999.10198.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prentice JC, Fincke BG, Miller DR, Pizer SD. Outpatient Waiting Times and Diabetes Care Quality Improvement. American Journal of Managed Care. 2011;17(2):e43–54. [PubMed] [Google Scholar]
- Prentice JC, Pizer SD. Delayed Access to Health Care and Mortality. Health Services Research. 2007;42(2):644–62. doi: 10.1111/j.1475-6773.2006.00626.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prentice JC, Pizer SD. Waiting Times and Hospitalizations for Ambulatory Care Sensitive Conditions. Health Services Outcomes and Research Methodology. 2008;8:1–18. [Google Scholar]
- Reker DM, Rosen AK, Hoenig H, Berlowitz DR, Laughlin J, Anderson L, Marshall CR, Rittman M. The Hazards of Stroke Case Selection Using Administrative Data. Medical Care. 2002;40(2):96–104. doi: 10.1097/00005650-200202000-00004. [DOI] [PubMed] [Google Scholar]
- Ross SA. Controlling Diabetes: The Need for Intensive Therapy and Barriers in Clinical Management. Diabetes Research and Clinical Practice. 2004;65S:S29–34. doi: 10.1016/j.diabres.2004.07.006. [DOI] [PubMed] [Google Scholar]
- Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, Owen DK. Effects of Quality Improvement Strategies for Type 2 Diabetes on Glycemic Control: A Meta-Regression Analysis. Journal of the American Medical Association. 2006;296:427–40. doi: 10.1001/jama.296.4.427. [DOI] [PubMed] [Google Scholar]
- Stratton IM, Adler AI, Neil HAW, Matthews DR, Manley SE, Cull CA, Hadden D, Turner RC, Holman RR. Association of Glycamia With Macrovascular and Microvascular Complications of Type 2 Diabetes (UKPDS 35): Prospective Observational Study. British Medical Journal. 2000;321(7258):405–12. doi: 10.1136/bmj.321.7258.405. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Subramanian U, Ackermann RT, Brizendine EJ, Saha C, Rosenman MB, Willis DR, Marrero DG. Effect of Advanced Access Scheduling on Processes and Intermediate Outcomes of Diabetes Care and Utilization. Journal of General Internal Medicine. 2009;24(3):327–33. doi: 10.1007/s11606-008-0888-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- United States General Accounting Office (U.S. GAO) VA Health Care: Restructuring Ambulatory Care System Would Improve Services to Veterans. Washington D.C: United States General Accounting Office; 1993. [Google Scholar]
- Van Deusen Lukas C, Meterko M, Mohr D, Seibert MN. The Implementation and Effectiveness of Advanced Clinic Access. Health Services Research and Development Management Decision and Research Center, Boston: Office of Research and Development, Department of Veterans Affairs; 2004. [Google Scholar]
- Veterans Health Administration (VHA) PMO- New and Established Patients. Washington, DC: Department of Veterans Affairs; 2008. [Google Scholar]
- Veterans Health Administration (VHA) Priority for Outpatient Medical Services and Inpatient Hospital Care. Washington, DC: Department of Veterans Affairs; 2002. [Google Scholar]
- Veterans Health Administration (VHA) Process for Ensuring Timely Access to Outpatient Clinical Care. Washington, DC: Department of Veterans Affairs; 2006. [Google Scholar]
- Young BA, Lin E, Korff MV, Simon G, Ciechanowski P, Ludman EJ, Everson-Stewart S, Kinder L, Oliver M, Boyko EJ, Katon WJ. Diabetes Complications Severity Index and Risk of Mortality, Hospitalization, and Healthcare Utilization. American Journal of Managed Care. 2008;14(1):15–24. [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.