Abstract
Context
Emergency Department (ED) use among the rural elderly may present a different pattern from the urban elderly, thus requiring different policy initiatives. However, ED use among the rural elderly has seldom been studied and is little understood.
Purpose
To characterize factors associated with having any versus no ED use among the rural elderly.
Methods
A cross-sectional and observational study of 1736 Medicare beneficiaries age 65 and older who lived in non-metropolitan areas. The data are from the 2002–2005 Medical Expenditure Panel Survey (MEPS). A logistic regression model was estimated that included measures of predisposing characteristics, enabling factors, need variables, and health behavior as suggested by Anderson's behavioral model of health service utilization.
Findings
20.8% of the sample had at least one ED visit during one year period. Being widowed, more education, Medicaid enrollment, fair/poor self perceived physical health, respiratory diseases and heart disease were associated with higher likelihood of having any ED visits while residing in the Western and Southern U.S. and being enrolled in Medicaid managed care were associated with lower probability of having any ED visits. While Medicaid enrollees who reported excellent, very good, good, or fair physical health were more likely to have at least one ED visit than those not on Medicaid, Medicaid enrollees reporting poor physical health may be less likely to have any ED visits.
Conclusion
Policy makers and hospital administrators should consider these factors when managing the need for emergency care, including developing interventions to provide needed care through alternate means.
Keywords: emergency department, rural, elderly, Medicaid, self-perceived health
The U.S. Census Bureau reported that 35 million individuals age≥65 years lived in the US in 2000. It is predicted that this number will double to 70 million by 2030.1 Emergency departments (EDs) are a critical healthcare access point for the elder adult, with 16.7 million visits in 2005.2 Compared with younger persons, older adults use EDs at a higher rate, their visits have a greater level of urgency, and they have longer stays. They are more likely to be admitted to hospitals and have repeat ED visits, and they experience higher rates of adverse health outcomes after discharge.3,4 Due to the growth of the older adult population,5 the number of ED visits increased by 20% between 1995 and 20052 and is estimated will approach 11.7 million for patients ages 65 to 74 alone by 2013.4
In 2000, 55.4 million people (19.7% of the population) lived in non-metropolitan areas,6 nearly 15% of them aged 65 and older.7 Access to healthcare is a critical concern for rural residents.8–18 Important determinants of access include less health insurance coverage, increased travel time and distance, and a shortage of healthcare providers, as compared to urban areas.8,10,13,16,19 Studies have shown that healthcare use is lower for rural elderly.16, 20–23
Few studies describe ED use among the rural elderly.24–27 They demonstrate that unique barriers exist to obtaining emergency care in rural areas, such as the shortage (sometimes because of closure) of rural hospitals. Despite the similarity of the need for emergency care across urban and rural areas, the rural elderly have lower ED use than would be expected.24,26,27
The projected increase in demand for ED services poses a significant challenge to the healthcare system.5 However, most ED studies have been conducted in urban areas. Whether a similar situation applies in rural areas is not clear. Discrepancies in ED use patterns between rural and urban areas, as implied by the above mentioned studies,24,26–28 indicate that the problems the rural elderly face may be different from those faced by urban elderly. Understanding ED use among rural elderly (e.g., what factors impact their use) will help to inform the development of public policy, hopefully leading to better allocation of health resources. In this study we identify factors associated with having any ED use by community-dwelling rural older adults in comparison to those with no ED use. To our knowledge, no studies have previously systematically investigated this for the U.S. rural elderly.
Methods
Conceptual Model
Andersen's behavioral model29 is the most widely used conceptual model for explaining variation in the use of health services. According to this model, healthcare use is due to predisposing, enabling, and need factors. Predisposing factors include demographic variables (e.g., age, gender), social structure (e.g., ethnicity, education) and health beliefs. Enabling factors include personal/family resources (e.g., health insurance, travel time) and community resources (e.g., census region, community medical care organizations). Need is primarily measured by self-perceived health, professionally evaluated need, and functional limitations. Previous studies outside of emergency medicine have shown that this model accounts for up to 28% of the variation in healthcare use.30
Prior studies have used Andersen's model to explain variations in health services use among elderly adults.3,30–32 These studies have found that enabling, predisposing and need factors are all significantly associated with healthcare use, with need appearing to be the most important determinant.
Few studies have attempted to explain ED use with the Andersen model.30–32 One study found that attitude toward healthcare, previous healthcare experience, hospital admissions, and number of sources of care were associated with ED visits.32 Another concluded that there was an association of ED use with poor nutritional status, being widowed, and need factors.31 A third study found that age greater than 85 years, living alone, less education, and need were associated with ED use.30
Data Source
Data are from the 2002–2005 Household Component of Medical Expenditure Panel Survey (MEPS).33 MEPS uses a rotating panel design with 2 overlapping cohorts of the U.S. non-institutionalized civilian population combined to produce annual estimates. A new cohort of households is initiated each year and interviewed 5 times to collect 2 calendar years of data. The MEPS household component gathers information on the following from one individual household member on all household members: demographic characteristics, health status, use of medical care services, access to care, satisfaction with care, health insurance coverage, income, and employment.
Study Design
The 2002–2005 MEPS data served as a cross-sectional observational dataset for this study. We used logistic regression analysis to identify factors associated with any ED use among the rural elderly during a one-year period, specifically, the first year each person was participating in MEPS.
Study Eligibility Criteria
We included only those individuals age 65 and over with Medicare coverage who lived in rural areas. Rural was defined as residing in a Non-Metropolitan Statistical Area (NMSA) county, the definition used by the U.S. Office of Management and Budget.34
Dependent Variable
The dependent variable in our analyses is a dichotomous measure of whether or not each person had ED use during one year. MEPS also has information on frequency of individual ED use in a year. We chose to group those who had one or more ED visits into a single category (any use or not) for 2 reasons. First, the mechanisms that drive ED care-seeking and the amount of ED care sought may well be different, and the former must precede the latter. Further, the mechanisms that drive care-seeking may have policy implications independent of those that drive the amount of care. Second, ED use is self reported in MEPS. Prior research validating household reports of healthcare use in MEPS has found substantial accuracy for reporting of any ED use but significant underreporting of total ED visits.35 Because of this measurement error we feel it is not appropriate to examine frequency of ED use.
Independent Variables
Following Andersen's model, we selected the following independent variables and also explored possible interaction effects.
Predisposing characteristics – Age (65–74, 75–84, and 85+), gender, race (white and non-white), ethnicity (Hispanic and non-Hispanic), marital status (married, widowed, and other), education (less than high school graduate, high school graduate, more than high school graduate), and living alone (living alone or not). ED use would perhaps be expected to increase with age since there is a greater risk for cardiovascular and other significant health events that represent true emergencies.
Enabling factors -- Usual source of care (USC) (yes or no), health insurance, family income (poor [<100% of the Federal poverty line], near poor [100–124%], low income [125–199%], middle income [200–399%], and high income [≥400%]), and U.S. Census (Northeast, Midwest, South and West) region. All of the subjects in the study had Medicare coverage. However, previous studies have shown that additional insurance (e.g., private insurance, Medicaid coverage) is an important determinant of ED use.27,36–42 Thus, we includedvariables to indicate whether each person had private insurance and whether they were enrolled in Medicaid. It is also reasonable to assume that a managed care plan such as an HMO has an impact on an individual's ED use as has been shown in previous studies.43–46
Need factors – Perceived physical health status and perceived mental health status (excellent, very good, good, fair and poor for both), and medical conditions (diabetes, respiratory diseases [asthma and emphysema], high blood pressure, heart diseases [coronary heart disease, angina or angina pectoris, heart attack or myocardial infarction, and any other kind of heart disease], stroke, and joint pain).
In addition, we included whether a person had a medical checkup in the past year in our model. Studies using the Andersen model have suggested that health behaviors are associated with healthcare use.47 A medical checkup in the past year may reduce ED use. Finally, we include year in our model to reflect changes in the Medicare program and other changes over time.
Statistical Analysis
We first employed bivariate analysis to examine the strength of the association between each independent variable and ED use. We used the Chi-square test for the categorical variables and the t test for age (the only continuous variable) to evaluate the differences between ED use and no ED use. Variables which had an association of p<0.20 with ED use were then included in unweighted and weighted logistic regression analysis. Potentially important interaction terms between independent variables were explored. The goodness-of-fit tests used for the logistic regression model included Pregibon's linktest,48 the Hosmer-Lemeshow test,49 and the C statistic (area under the receiver area characteristics [ROC] curve).50 A significant Pregibon test will mean either that the model does not fit the S-shaped regression line well or that one or more relevant explanatory variables are omitted. The Hosmer-Lemeshow test is a widely used summary goodness-of-fit test for logistic regression that is based on the values of the estimated probabilities. The C statistic measures the model's ability to distinguish between those observations for which the dependent variable is 1 and those for which it is 0.49 Robust standard errors were calculated to correct for potential misspecification.51,52 Chi-square joint tests were used to test for the joint significance of sets of independent variables, e.g., when testing the joint significance of the four U.S. Census Regions. Because the results of the unweighted analysis are very close to those of the weighted analysis, we only report the latter. All analyses were conducted using the statistical software package SAS 9.1.
Results
We identified 1736 people as age 65 years and older, enrolled in Medicare, and residing in rural areas. Of these persons, 361 (20.8%) had at least one ED visit in the first study year comprising the study sample. The most frequent 3-digit International Classification of Diseases (ICD-9) diagnoses for ED visits among the rural elderly were diseases of the circulatory system (22.3%), injury and poisoning (19.3%), respiratory system (10.5%), digestive system (9.5%) and musculoskeletal system (7.8%) (Table 1).
Table 1.
Diagnoses for Emergency Department Use among the Rural Elderly
| Disease | Number | National Population Estimate* | Percent* |
|---|---|---|---|
| Circulatory system | 102 | 1,062,914 | 22.3% |
| Injury and poisoning | 108 | 920,939 | 19.3% |
| Respiratory system | 70 | 502,175 | 10.5% |
| Digestive system | 47 | 455,989 | 9.5% |
| Musculoskeletal system | 44 | 370,522 | 7.8% |
| Genitourinary system | 26 | 221,722 | 4.6% |
| Infectious | 18 | 154,565 | 3.2% |
| Endocrine | 25 | 146,700 | 3.1% |
| Nervous system | 15 | 122,053 | 2.6% |
| Mental disorder | 9 | 81,112 | 1.7% |
| Neoplasm | 8 | 75,899 | 1.6% |
| Skin | 7 | 41,084 | 0.9% |
| Congenital anomalies | 2 | 12,650 | 0.3% |
| Blood | 2 | 12,228 | 0.3% |
National estimation and percentage are based on the weights MEPS provides.
Descriptive characteristics
Rural Medicare beneficiaries had a mean age of 74.4 (SD=0.2) years, 56.4% were female, 7.2% were non-white, and 2.1% were Hispanic. A total of 30.6% of the sample reported not having a high school diploma and 41.0% reported poor, near poor or low income. Over half, 57.1%, of the beneficiaries were married and 33.3% lived alone. A total of 43.5% lived in the Southern U.S., 29.0% in the Midwest, 14.3% in the West, and 13.2% in the Northeast (first column of Table 2).
Table 2.
Sample Characteristics (Weighted)
| Percent of Total (N=1736) | Percent with At Least 1 Emergency Department Visit (N=361) | Percent with No Emergency Department Visits (N=1375) | P Value (χ2 Test/t Statistic) | |
|---|---|---|---|---|
| PREDISPOSING FACTORS | ||||
| Age (mean) (SD) | 74.4 (0.2) | 75.7 (0.4) | 74.1 (0.2) | <0.001 |
| Age (category) | 0.018 | |||
| 65–74 | 53.5 | 44.8 | 55.6 | |
| 75–84 | 35.9 | 41.6 | 34.5 | |
| 85 and older | 10.6 | 13.6 | 9.8 | |
| Gender | 0.370 | |||
| Male | 43.6 | 41.4 | 44.1 | |
| Female | 56.4 | 58.6 | 55.9 | |
| Marital Status | 0.002 | |||
| Married | 57.1 | 50.8 | 58.7 | |
| Widowed | 31.4 | 40.1 | 29.2 | |
| Other | 11.5 | 9.1 | 12.1 | |
| Race | 0.875 | |||
| Non-White | 7.2 | 7.0 | 7.2 | |
| White | 92.8 | 93.0 | 92.8 | |
| Ethnicity | 0.875 | |||
| Non-Hispanic | 97.9 | 98.0 | 97.9 | |
| Hispanic | 2.1 | 2.0 | 2.1 | |
| Education | 0.002 | |||
| Below High School | 30.6 | 36.5 | 29.1 | |
| High School | 50.8 | 42.5 | 52.8 | |
| Above High School | 18.6 | 20.9 | 18.1 | |
| Living Arrangement | 0.172 | |||
| Alone | 33.3 | 36.5 | 32.6 | |
| Not Alone | 66.7 | 63.5 | 67.4 | |
| ENABLING FACTORS | ||||
| Family Income | 0.061 | |||
| Poor | 10.0 | 12.6 | 9.3 | |
| Near poor | 8.9 | 9.2 | 8.8 | |
| Low income | 22.1 | 26.8 | 20.9 | |
| Middle income | 31.6 | 28.7 | 32.3 | |
| High income | 27.5 | 22.7 | 28.7 | |
| Private Health Insurance | 0.036 | |||
| Yes | 56.0 | 50.1 | 57.5 | |
| No | 44.0 | 49.9 | 42.5 | |
| Medicaid | <0.001 | |||
| Yes | 9.8 | 17.4 | 7.9 | |
| No | 90.2 | 82.6 | 92.1 | |
| Medicaid Managed Care | 0.618 | |||
| Yes | 2.1 | 1.7 | 2.2 | |
| No | 97.4 | 97.9 | 97.2 | |
| Usual Source of Care | 0.692 | |||
| Yes | 91.8 | 92.3 | 91.7 | |
| No | 7.8 | 7.1 | 8.0 | |
| U.S. Geographic Region | 0.027 | |||
| Northeast | 13.2 | 15.5 | 12.6 | |
| Midwest | 29.0 | 32.7 | 28.1 | |
| South | 43.5 | 42.3 | 43.8 | |
| West | 14.3 | 9.5 | 15.5 | |
| NEED FACTORS | ||||
| Self Perceived Physical Health Status | <0.001 | |||
| Excellent | 14.3 | 10.6 | 15.3 | |
| Very good | 27.4 | 15.2 | 30.4 | |
| Good | 30.8 | 25.3 | 32.2 | |
| Fair | 18.5 | 25.9 | 16.6 | |
| Poor | 7.8 | 19.0 | 5.0 | |
| Self Perceived Mental Health Status | <0.001 | |||
| Excellent | 26.3 | 21.8 | 27.4 | |
| Very good | 29.3 | 21.5 | 31.3 | |
| Good | 32.2 | 35.9 | 31.3 | |
| Fair | 7.9 | 11.5 | 7.0 | |
| Poor | 3.0 | 5.5 | 2.3 | |
| Diabetes | 0.078 | |||
| Yes | 17.6 | 20.8 | 16.8 | |
| No | 81.1 | 75.2 | 82.6 | |
| Respiratory Diseases | <0.001 | |||
| Yes | 12.8 | 19.2 | 11.2 | |
| No | 85.8 | 76.9 | 88.0 | |
| High Blood Pressure | 0.004 | |||
| Yes | 60.7 | 66.2 | 59.3 | |
| No | 37.8 | 29.4 | 39.9 | |
| Heart Diseases | <0.001 | |||
| Yes | 30.3 | 45.2 | 26.6 | |
| No | 68.0 | 50.5 | 72.4 | |
| Stroke | 0.005 | |||
| Yes | 10.9 | 15.0 | 9.8 | |
| No | 87.5 | 80.7 | 89.2 | |
| Joint Pain | 0.013 | |||
| Yes | 58.5 | 64.0 | 57.2 | |
| No | 40.0 | 31.8 | 42.1 | |
| HEALTH BEHAVIOR | ||||
| Preventive Services (Medical Checkup in Last Year) | 0.199 | |||
| Yes | 77.5 | 79.1 | 77.1 | |
| No | 19.7 | 15.5 | 20.8 |
Bivariate analysis
The proportion and means of a number of predisposing, enabling, and need factors differed significantly between those individuals with and without at least one ED visit at p<0.20 (Table 2 columns 2 through 4).
Multivariate analysis
In the final logistic regression model for factors associated with having at least one ED visit, two predisposing characteristics – widowed and being more than a high school graduate, one enabling factor – being enrolled in Medicaid (but not in Medicaid managed care), and three need variables – fair/poor perceived physical health status, respiratory diseases, and heart diseases -- were significantly associated with greater likelihood of having at least one ED visit. Two enabling factors – enrollment in Medicaid managed care and residing in the Western U.S. – were associated with lower probability of having any ED visits (Table 3).
Table 3.
Probability of Having Any Emergency Department Visits Logistic Regression Model Results
| Variable | Coefficient | Standard Error | P Value* | Odds Ratio | 95% Odds Ratio Confidence Interval |
|---|---|---|---|---|---|
| Marital Status | 0.005 | ||||
| Married | |||||
| Widowed | 0.559 | 0.222 | 0.012 | 1.75 | 1.13–2.70 |
| Other | −0.106 | 0.290 | 0.714 | 0.899 | 0.51–1.59 |
| Education | <0.001 | ||||
| Below High School | 0.113 | 0.162 | 0.486 | 0.82–1.54 | |
| High School | |||||
| Above High School | 0.693 | 0.177 | <.001 | 2.000 | 1.41–2.83 |
| Medicaid | 2.142 | 0.472 | <.001 | ||
| Medicaid Managed Care | −1.518 | 0.503 | 0.003 | 0.219 | 0.08–0.59 |
| Region | 0.001 | ||||
| Northeast | |||||
| Midwest | 0.048 | 0.185 | 0.796 | 1.049 | 0.73–1.51 |
| South | −0.356 | 0.212 | 0.092 | 0.700 | 0.46–1.06 |
| West | −0.704 | 0.230 | 0.002 | 0.495 | 0.32–0.78 |
| Self-perceived Physical Health | <.001 | ||||
| Excellent | |||||
| Very good | −0.476 | 0.329 | 0.148 | ||
| Good | −0.037 | 0.297 | 0.900 | ||
| Fair | 0.641 | 0.303 | 0.034 | ||
| Poor | 1.634 | 0.340 | <.001 | ||
| Asthma / Emphysema | 0.404 | 0.174 | 0.020 | 1.497 | 1.07–2.10 |
| Heart Disease | 0.603 | 0.150 | <.001 | 1.828 | 1.36–2.46 |
| Medicaid*Self Perceived Physical Health | 0.016 | ||||
| Medicaid*Excellent | |||||
| Medicaid*Very Good | −0.875 | 0.688 | 0.203 | ||
| Medicaid*Good | −0.894 | 0.507 | 0.078 | ||
| Medicaid* Fair | −1.400 | 0.597 | 0.019 | ||
| Medicaid*Poor | −2.111 | 0.614 | 0.001 |
Where p values are by themselves the p value indicates the significance of a joint test. For example, the p value of 0.005 for marital status is for the joint significance of married, widowed, and other.
Note: This analysis is weighted.
The interaction between Medicaid status and self perceived physical health status was also significantly associated with having any ED visits (p=.016). For persons reporting excellent, very good, good, and fair physical health, the predicted probability of having any ED visits was significantly higher for people on Medicaid than for those not on Medicaid (these differences are statistically significant [p=.003 for excellent physical health and p<.001 for the other 3 categories] and their 95% confidence intervals do not overlap). However, for persons reporting poor physical health, the probability of having any ED visits was lower for persons on Medicaid than for those not on Medicaid but this difference was of borderline statistical significance (p=.06) and their confidence intervals overlapped (Table 4). (These findings exclude persons enrolled in Medicaid managed care.)
Table 4.
Predicted Probability of Having Any Emergency Department Visits by Medicaid Status and Self Perceived Physical Health Status
| Self Perceived | Medicaid (95% Confidence Interval) | t-test | ||
|---|---|---|---|---|
| Physical Health Status | No | Yes | t | P Value |
| Excellent | 0.14 (0.13, 0.15) | 0.33 (0.22, 0.44) | −3.79 | 0.003 |
| Very good | 0.10 (0.09, 0.11) | 0.26 (0.22, 0.31) | −6.96 | <0.001 |
| Good | 0.15 (0.15, 0.16) | 0.30 (0.26, 0.34) | −7.43 | <0.001 |
| Fair | 0.27 (0.25, 0.28) | 0.35 (0.32, 0.39) | −4.31 | <0.001 |
| Poor | 0.48 (0.45, 0.50) | 0.42 (0.36, 0.47) | 1.91 | 0.060 |
Discussion
While research has examined ED use by rural elderly Americans in 3 rural communities,26 111 counties in one state,25 and 2 states,24,27 to our knowledge this is the first study that has investigated factors associated with ED use exclusively among the community-dwelling (non-institutionalized) rural elderly for the entire United States. We found that being a widow or widower, having more than a high school education, being enrolled in Medicaid (but not Medicaid managed care), having fair or poor self perceived physical health, and reporting respiratory diseases or heart diseases increased the likelihood of having any ED visits. Enrollment in Medicaid managed care and residence in the western U.S. were associated with lower probability of having any visits.
We found that about 20% of the community-residing rural elderly had at least one ED visit, which is approximately what Lisher and colleagues found for Medicare beneficiaries in Washington state in 1994.27 The most frequent diagnoses for ED visits in the present study were similar to those found in previous studies: circulatory system diseases, injury, and respiratory system diseases.24,27
We used the Andersen behavioral model for our conceptual framework. Although the model has been widely used, concerns about its utility have been raised.29,53 One concern is that the model may work better for some types of health services. However, few studies have attempted to modify it, particularly for ED use.3 Another concern is that the model may have different utility for different populations. Previous studies have found it to be a poor predictor of physician, hospital, and dentist utilization among the elderly with only need characteristics as significant predictors.53 However, we found that not only need factors but also predisposing (marital status and education) and enabling (Medicaid enrollment, Medicaid managed care) factors as well as an interaction between a need and an enabling variable are significant predictors of ED use among the rural elderly.
Marital status as a significant determinant of any ED use is seldom documented in previous work.41,53 Only one study53 reports a positive association between being widowed and ED use. There are several possible explanations for our finding. It may be because widowed persons have worse health status.54 Even though we have controlled for health status our variables may not be sufficient. Second, married people might have access to better information and a superior referral network.55 A third reason is the impact of marital status change on healthcare use.54 However, we do not have the detailed information necessary to determine whether this is the case.
The literature that has investigated the factors associated with having any ED visits has mixed evidence about the impact of age.3 In most studies, older age has been associated with increased ED use in bivariate analysis. However, in multivariate analysis it is statistically significant in only a few studies.3,27,30,56 Our study found a similar pattern. Age is an enabling factor primarily through its relationship to other factors such as health. Controlling for other factors could mitigate the age effect.
Both Medicaid enrollment and fair/poor self-rated physical health were found to be independently associated with increased probability of having any ED use, which is consistent with previous research.27,36,39,41,42 Further, we found an interaction between these two factors. For persons reporting excellent, very good, good, and fair self-rated physical health status, individuals on Medicaid are more likely to have at least one ED visit than those not on Medicaid. Further, while the evidence is not completely consistent, among persons reporting poor physical health Medicaid enrollees may be less likely to have any ED visits.
It should be noted that elderly Medicaid enrollees are dual eligible beneficiaries, that is, enrolled in both Medicare and Medicaid. Nearly 10% of our MEPS sample are dual eligible compared to 17% reported by Walsh and colleagues using the Medicare Current Beneficiary Survey.57 The difference may be because we excluded rural elderly living in facilities (mostly nursing homes), who are much more likely to be dual eligible beneficiaries than the community-dwelling elderly.
Dual eligible beneficiaries are a special population known to have worse health status, higher healthcare costs, less education, and an increased likelihood of using long term care.57 Because they are sicker and older, they are also more likely to have healthcare use. However, Medicaid enrollment was still significantly associated with greater likelihood of ED use after we controlled for other variables including health status. Thus, it appears that there are other pathways through which Medicaid impacts ED use among the rural elderly.
Another of our findings is that enrollment in Medicaid managed care is associated with lower probability of any ED use. This has been found in previous studies.45,46 There are several possible reasons that may explain this. First, those enrolled in Medicaid managed care might be healthier.58 Second, Medicaid managed care may limit enrollees' health services use. Access to care has been shown to be worse under for-profit than non-for-profit plans for Medicaid managed care enrollees.59 Third, Medicaid managed care may be superior to other health services (e.g. they may focus on providing continuity of primary care services to enrollees), thereby keeping people healthier and reducing the likelihood of ED use.60
Our study found regional variation in rural elderly ED use after controlling for other variables. Compared to the Northeast US, the rural elderly in the West and the South had lower probability of having any ED visits. There are several possible reasons for this. First, rural residents in different regions may face different travel distance and time. Previous studies have suggested that greater travel distance, more time spent traveling, and more difficulty for rural residents in obtaining transportation in order to receive medical care present geographic access barriers to healthcare in rural areas.8,10,13,16 Second, the geographic variation in ED use may be explained by variation in healthcare resources across different regions. Previous studies have found that in the South and West the supply of physicians and medical education capacity have not kept up with the population increase.61,62 An insufficient supply of physicians presents an access barrier and may result in worse health outcomes, thus increasing ED use. Another reason for the regional variation in ED use may be variation in access and quality of other healthcare services. For example, better primary care may lead to better health outcomes, thus lowering the likelihood of requiring any ED visits. However, this explanation seems implausible because of evidence in the literature of less supply of physicians and lower quality of care in the West and South.61–63 It should follow from this that people in the West and South should have higher ED use, which contradicts our finding.
Several of our findings are inconsistent with previous studies. First, we found that more education was associated with higher likelihood of having any ED visits. This contradicts other studies.30,40,64–66 Second, we failed to find a significant association between continuity of care (as measured by having a usual source of care) and having any ED visits, as other studies did.37,38,41,67 But those studies were mostly conducted with urban populations. The rural elderly may behave differently. For instance, one explanation for the association between education and having any ED visits might be that more highly educated people are more conscious about health, and tend to seek healthcare more often when they feel sick,68–76 but because of the lack of primary care physicians in rural areas they may have to go to an ED for their “regular” healthcare. The failure to find an association between continuity of care and ED use may have occurred because the only measure of continuity of care we included was whether a person had a USC. Such a measure is likely to miss other critical information, such as how often and how effectively individuals use their usual source of care, which has been carefully examined in other studies.37,38,41,67 Unfortunately, MEPS does not provide such information.
How do our results compare to those of the only previous study of an exclusively rural sample that included whether or not there was any ED use as the dependent variable in a logistic regression model? Neither our not the West Texas study25 found age or gender to be statistically significant. However, the West Texas study found better physical and mental health as measured by the SF-12 Physical and Mental Component Summary scores to be associated with less likelihood of having any ED visits. While our study did not include the SF-12, we did find a significant association for self perceived physical, but not mental, health, with people reporting better physical health having lower likelihood of at least one ED visit.
There are several limitations to our study. First, we did not include several factors that we would expect to influence whether people had any ED visits. For example, we did not include any “supply side” information (for instance, for a geographic area, the number of hospitals with an ED and the numbers of physicians per thousand persons). Another important consideration for rural residents is geographic distance and transportation. We did not include variables for them because of lack of information on distance, too many missing values for travel time to usual source of care, and lack of variance in transportation (e.g. the majority of people drive or are driven). Second, measurement error may be an issue. As MEPS interviews a single informant who reports for each household during each survey round, accuracy about household reported medical conditions and healthcare use may be of concern.35,77 In particular, the accuracy of this approach is questionable as it relates to specific individuals when a single informant reports on the mental health status of all members in each household. Third, our dependent variable, having any ED use (yes or no), is dichotomous. For a continuous dependent variable, frequent ED users might differ from non-frequent users. Fourth, there are different kinds of rurality. Some rural areas are more populous than others while some are more remote from urban areas. Previous studies have found that the elderly in remote rural areas are less likely than those in urban areas to have an ED visit while rural areas adjacent to a city are more likely to have an ED visit than those in urban areas.27,38 Thus, types of rurality may be important in determining ED use patterns. However, we could not differentiate between different kinds of rurality in the public use MEPS dataset. Fifth, the 43.5% of the study sample that resided in the Southern Census Region is 22% higher than the 35.6% for the entire US population for the 2000 Census (100 million of 281 million) and 20% higher than the 36.4% for 2006 (109 million of 299 million). We expect that this difference is due to the higher proportion of people in the Southern US than the other 3 Census Regions that reside in rural areas. Further, we do not expect that this higher proportion will distort our results. Finally, some may consider that we did not adequately control for Type I error as we tested 24 hypotheses, which has an expected 1.25 false rejections.78 But in a study such as ours that examines an issue for the first time, we felt it better to use the traditional significance level of 0.05 for each test as we would rather falsely accept a hypothesis than identify a significant factor as non-significant. Identification as non-significant in initial research could lead to important variables being excluded from future research.
In conclusion, for the rural elderly widowhood, post-high school education, Medicaid enrollment, fair/poor self perceived physical health, respiratory diseases, and heart disease were associated with higher probability of having any ED visits while living in the South and West and being enrolled in Medicaid managed care were associated with lower probability of any ED use. While Medicaid enrollees reporting other than poor physical health are more likely to have at least one ED visit than those not on Medicaid, persons on Medicaid reporting poor physical health may be less likely to have any ED visits. Policy makers and hospital administrators should consider these factors when addressing the demand for emergency care, including developing interventions to provide needed care through alternate means.
Figure 1.
Predicted Probability of Having Any Emergency Department Visits by Medicaid Status and Self Perceived Physical Health Status
References
- 1.Shah MN, Glushak C, Karrison TG, et al. Predictors of emergency medical services utilization by elders. Acad Emerg Med. 2003 Jan;10(1):52–58. doi: 10.1111/j.1553-2712.2003.tb01976.x. [DOI] [PubMed] [Google Scholar]
- 2.Nawar EW, Niska RW, Xu J. National Hospital Ambulatory Medical Care Survey: 2005 Emergency Department Summary. Advance Data from Vital and Health Statistics. 2007:386. [PubMed] [Google Scholar]
- 3.McCusker J, Karp I, Cardin S, Durand P, Morin J. Determinants of emergency department visits by older adults: a systematic review. Acad Emerg Med. 2003 Dec;10(12):1362–1370. doi: 10.1111/j.1553-2712.2003.tb00011.x. [DOI] [PubMed] [Google Scholar]
- 4.Roberts DC, McKay MP, Shaffer A. Increasing rates of emergency department visits for elderly patients in the United States, 1993 to 2003. Ann Emerg Med. 2008 Jun;51(6):769–774. doi: 10.1016/j.annemergmed.2007.09.011. [DOI] [PubMed] [Google Scholar]
- 5.Walsh PG, Currier G, Shah MN, Lyness JM, Friedman B. Psychiatric emergency services for the U.S. elderly: 2008 and beyond. Am J Geriatr Psychiatry. 2008 Sep;16(9):706–717. doi: 10.1097/JGP.0b013e31817e73c7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Hummer RAPJ, Wang SC, Collins C. Health insurance coverage in non-metropolitan America. Critical issues in rural health. Blackwell publishing; 2004. [Google Scholar]
- 7.Rosenthal TC, Fox C. Access to health care for the rural elderly. JAMA. 2000 Oct 25;284(16):2034–2036. doi: 10.1001/jama.284.16.2034. [DOI] [PubMed] [Google Scholar]
- 8.Arcury TA, Gesler WM, Preisser JS, Sherman J, Spencer J, Perin J. The effects of geography and spatial behavior on health care utilization among the residents of a rural region. Health Serv Res. 2005 Feb;40(1):135–155. doi: 10.1111/j.1475-6773.2005.00346.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Bible BL. Health care delivery in rural areas. JAMA. 1971 Jun 7;216(10):1635–1637. doi: 10.1001/jama.1971.03180360081014. [DOI] [PubMed] [Google Scholar]
- 10.Chan L, Hart LG, Goodman DC. Geographic access to health care for rural Medicare beneficiaries. J Rural Health. 2006;22(2):140–146. doi: 10.1111/j.1748-0361.2006.00022.x. [DOI] [PubMed] [Google Scholar]
- 11.Coward RT, Cutler SJ. Informal and formal health care systems for the rural elderly. Health Serv Res. 1989 Feb;23(6):785–806. [PMC free article] [PubMed] [Google Scholar]
- 12.DeLeon PH, Wakefield M, Schultz AJ, Williams J, VandenBos GR. Rural America. Unique opportunities for health care delivery and health services research. Am Psychol. 1989 Oct;44(10):1298–1306. doi: 10.1037//0003-066x.44.10.1298. [DOI] [PubMed] [Google Scholar]
- 13.Edelman MA, Menz BL. Selected comparisons and implications of a national rural and urban survey on health care access, demographics, and policy issues. J Rural Health. 1996;12(3):197–205. doi: 10.1111/j.1748-0361.1996.tb00794.x. [DOI] [PubMed] [Google Scholar]
- 14.Hartley D. Rural health disparities, population health, and rural culture. Am J Public Health. 2004 Oct;94(10):1675–1678. doi: 10.2105/ajph.94.10.1675. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Hartley D, Quam L, Lurie N. Urban and rural differences in health insurance and access to care. J Rural Health. 1994;10(2):98–108. doi: 10.1111/j.1748-0361.1994.tb00216.x. [DOI] [PubMed] [Google Scholar]
- 16.Larson SL, Fleishman JA. Rural-urban differences in usual source of care and ambulatory service use: analyses of national data using Urban Influence Codes. Med Care. 2003 Jul;41(7 Suppl):III65–III74. doi: 10.1097/01.MLR.0000076053.28108.F2. [DOI] [PubMed] [Google Scholar]
- 17.Patton L. Setting the rural health services research agenda: the congressional perspective. Health Serv Res. 1989 Feb;23(6):1005–1051. [PMC free article] [PubMed] [Google Scholar]
- 18.Wilson VE. Rural health care systems. JAMA. 1971 Jun 7;216(10):1623–1626. [PubMed] [Google Scholar]
- 19.Aday LAQB, Reyes-Gibby CC. Equity in rural health and health care. Handbook of rural health. Academic / Plenum publishers; 2001. [Google Scholar]
- 20.Dor A, Holahan J. Urban-rural differences in Medicare physician expenditures. Inquiry. 1990;27(4):307–318. [PubMed] [Google Scholar]
- 21.Himes CL, Rutrough TS. Differences in the use of health services by metropolitan and nonmetropolitan elderly. J Rural Health. 1994;10(2):80–88. doi: 10.1111/j.1748-0361.1994.tb00214.x. [DOI] [PubMed] [Google Scholar]
- 22.Offner RST, Clark F. Disability and rural independent living: setting an agenda for rural rehabilitation. Hum Serv Rrual Environ. 1992;15:6–8. [Google Scholar]
- 23.Piette JD, Moos RH. The influence of distance on ambulatory care use, death, and readmission following a myocardial infarction. Health Serv Res. 1996 Dec;31(5):573–591. [PMC free article] [PubMed] [Google Scholar]
- 24.Bross MH, Wiygul FM, Rushing SK. The role of the rural hospital emergency department. Fam Med. 1991 Jul;23(5):351–353. [PubMed] [Google Scholar]
- 25.Collins BK, Borders TF. Utilization of hospital services among older rural persons: a comparison of critical access hospitals and community hospitals. J Health Hum Serv Adm. 2005;28(1):135–152. [PubMed] [Google Scholar]
- 26.Hamdy RC, Forrest LJ, Moore SW, Cancellaro L. Use of emergency departments by the elderly in rural areas. South Med J. 1997 Jun;90(6):616–620. doi: 10.1097/00007611-199706000-00007. [DOI] [PubMed] [Google Scholar]
- 27.Lishner DM, Rosenblatt RA, Baldwin LM, Hart LG. Emergency department use by the rural elderly. J Emerg Med. 2000 Apr;18(3):289–297. doi: 10.1016/s0736-4679(99)00217-6. [DOI] [PubMed] [Google Scholar]
- 28.Casey MM, Wholey D, Moscovice IS. Rural Emergency Department staffing and participation in emergency certification and training programs. J Rural Health. 2008;24(3):253–262. doi: 10.1111/j.1748-0361.2008.00166.x. [DOI] [PubMed] [Google Scholar]
- 29.Andersen RM. Revisiting the behavioral model and access to medical care: does it matter? J Health Soc Behav. 1995 Mar;36(1):1–10. [PubMed] [Google Scholar]
- 30.Shah MN, Rathouz PJ, Chin MH. Emergency department utilization by noninstitutionalized elders. Acad Emerg Med. 2001 Mar;8(3):267–273. doi: 10.1111/j.1553-2712.2001.tb01303.x. [DOI] [PubMed] [Google Scholar]
- 31.Wolinsky FD, Coe RM. Physician and hospital utilization among noninstitutionalized elderly adults: an analysis of the Health Interview Survey. J Gerontol. 1984 May;39(3):334–341. doi: 10.1093/geronj/39.3.334. [DOI] [PubMed] [Google Scholar]
- 32.Parboosingh EJ, Larsen DE. Factors influencing frequency and appropriateness of utilization of the emergency room by the elderly. Med Care. 1987 Dec;25(12):1139–1147. doi: 10.1097/00005650-198712000-00003. [DOI] [PubMed] [Google Scholar]
- 33.Agency for Healthcare Research and Quality USDoHaHS [Accessed Nov. 7, 2008];Medical Expenditure Panel Survey. http://www.meps.ahrq.gov/mepsweb/ [PubMed]
- 34.Friedman B, Conwell Y, Delavan RL. Correlates of late-life major depression: a comparison of urban and rural primary care patients. Am J Geriatr Psychiatry. 2007 Jan;15(1):28–41. doi: 10.1097/01.JGP.0000224732.74767.ad. [DOI] [PubMed] [Google Scholar]
- 35.Zuvekas SH, Olin GL. Validating household reports of health care use in the medical expenditure panel survey. Health Serv Res. 2009 Oct;44(5 Pt 1):1679–1700. doi: 10.1111/j.1475-6773.2009.00995.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Baker DW, Stevens CD, Brook RH. Determinants of emergency department use: are race and ethnicity important? Ann Emerg Med. 1996 Dec;28(6):677–682. doi: 10.1016/s0196-0644(96)70093-8. [DOI] [PubMed] [Google Scholar]
- 37.Gill JM, Mainous AG, 3rd, Nsereko M. The effect of continuity of care on emergency department use. Arch Fam Med. 2000 Apr;9(4):333–338. doi: 10.1001/archfami.9.4.333. [DOI] [PubMed] [Google Scholar]
- 38.Rosenblatt RA, Wright GE, Baldwin LM, et al. The effect of the doctor-patient relationship on emergency department use among the elderly. Am J Public Health. 2000 Jan;90(1):97–102. doi: 10.2105/ajph.90.1.97. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Mandelberg JH, Kuhn RE, Kohn MA. Epidemiologic analysis of an urban, public emergency department's frequent users. Acad Emerg Med. 2000 Jun;7(6):637–646. doi: 10.1111/j.1553-2712.2000.tb02037.x. [DOI] [PubMed] [Google Scholar]
- 40.Sun BC, Burstin HR, Brennan TA. Predictors and outcomes of frequent emergency department users. Acad Emerg Med. 2003 Apr;10(4):320–328. doi: 10.1111/j.1553-2712.2003.tb01344.x. [DOI] [PubMed] [Google Scholar]
- 41.Menec VH, Sirski M, Attawar D. Does continuity of care matter in a universally insured population? Health Serv Res. 2005 Apr;40(2):389–400. doi: 10.1111/j.1475-6773.2005.00363.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.McCusker J, Healey E, Bellavance F, Connolly B. Predictors of repeat emergency department visits by elders. Acad Emerg Med. 1997 Jun;4(6):581–588. doi: 10.1111/j.1553-2712.1997.tb03582.x. [DOI] [PubMed] [Google Scholar]
- 43.Pollack HA, Wheeler JR, Cowan A, Freed GL. The impact of managed care enrollment on emergency department use among children with special health care needs. Med Care. 2007 Feb;45(2):139–145. doi: 10.1097/01.mlr.0000250257.26093.f0. [DOI] [PubMed] [Google Scholar]
- 44.Powers RD. Emergency department use by adult medicaid patients after implementation of managed care. Acad Emerg Med. 2000 Dec;7(12):1416–1420. doi: 10.1111/j.1553-2712.2000.tb00500.x. [DOI] [PubMed] [Google Scholar]
- 45.Baker LC, Afendulis C. Medicaid managed care and health care for children. Health Serv Res. 2005 Oct;40(5 Pt 1):1466–1488. doi: 10.1111/j.1475-6773.2005.00427.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Garrett B, Davidoff AJ, Yemane A. Effects of Medicaid managed care programs on health services access and use. Health Serv Res. 2003 Apr;38(2):575–594. doi: 10.1111/1475-6773.00134. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Andersen RM. National health surveys and the behavioral model of health services use. Med Care. 2008 Jul;46(7):647–653. doi: 10.1097/MLR.0b013e31817a835d. [DOI] [PubMed] [Google Scholar]
- 48.Pregibon D. Goodness of link tests for generalized linear models. Applied Statistics. 1980;29:15–24. [Google Scholar]
- 49.Hosmer DW, Lemeshow S. Applied logistic regression. Second Edition Wiley-Interscience Publication; New York: 2000. [Google Scholar]
- 50.Metz CE. Basic principles of ROC analysis. Seminars in Nuclear Medicine. 1978;8(4):283–298. doi: 10.1016/s0001-2998(78)80014-2. [DOI] [PubMed] [Google Scholar]
- 51.Huber P. The Behavior of Maximum Likelihood Estimates under Non-Standard Conditions. The Fifth Berkeley Symposium on Mathematical Statistics and Probability.1967. [Google Scholar]
- 52.White H. Maximum Likelihood Estimation of Misspecified Models. Econometrica. 1982;50(1):1–25. [Google Scholar]
- 53.Wolinsky FD, Coe RM, Miller DK, Prendergast JM, Creel MJ, Chavez MN. Health services utilization among the noninstitutionalized elderly. J Health Soc Behav. 1983 Dec;24(4):325–337. [PubMed] [Google Scholar]
- 54.Bennett KM. Does marital status and marital status change predict physical health in older adults? Psychol Med. 2006 Sep;36(9):1313–1320. doi: 10.1017/S003329170600818X. [DOI] [PubMed] [Google Scholar]
- 55.Iwashyna TJ, Christakis NA. Marriage, widowhood, and health-care use. Soc Sci Med. 2003 Dec;57(11):2137–2147. doi: 10.1016/s0277-9536(02)00546-4. [DOI] [PubMed] [Google Scholar]
- 56.Hansell S, Sherman G, Mechanic D. Body awareness and medical care utilization among older adults in an HMO. J Gerontol. 1991 May;46(3):S151–159. doi: 10.1093/geronj/46.3.s151. [DOI] [PubMed] [Google Scholar]
- 57.Walsh EG, Clark WD. Managed care and dually eligible beneficiaries: challenges in coordination. Health Care Financ Rev. 2002;24(1):63–82. [PMC free article] [PubMed] [Google Scholar]
- 58.Morgan RO, Virnig BA, DeVito CA, Persily NA. The Medicare-HMO revolving door--the healthy go in and the sick go out. N Engl J Med. 1997 Jul 17;337(3):169–175. doi: 10.1056/NEJM199707173370306. [DOI] [PubMed] [Google Scholar]
- 59.Long SK. Do for-profit health plans restrict access to care under Medicaid managed care? Med Care Res Rev. 2008 Oct;65(5):638–648. doi: 10.1177/1077558708316930. [DOI] [PubMed] [Google Scholar]
- 60.Zuckerman S, Brennan N, Yemane A. Has Medicaid managed care affected beneficiary access and use? Inquiry. 2002;39(3):221–242. doi: 10.5034/inquiryjrnl_39.3.221. [DOI] [PubMed] [Google Scholar]
- 61.Blumenthal D. New steam from an old cauldron--the physician-supply debate. N Engl J Med. 2004 Apr 22;350(17):1780–1787. doi: 10.1056/NEJMhpr033066. [DOI] [PubMed] [Google Scholar]
- 62.Kindig DA, Movassaghi H. The adequacy of physician supply in small rural counties. Health Aff (Millwood) 1989;8(2):63–76. doi: 10.1377/hlthaff.8.2.63. [DOI] [PubMed] [Google Scholar]
- 63.Jencks SF, Cuerdon T, Burwen DR, et al. Quality of medical care delivered to Medicare beneficiaries: A profile at state and national levels. JAMA. 2000 Oct 4;284(13):1670–1676. doi: 10.1001/jama.284.13.1670. [DOI] [PubMed] [Google Scholar]
- 64.Bazargan M, Johnson KH, Stein JA. Emergency department utilization among Hispanic and African-American under-served patients with type 2 diabetes. Ethn Dis. 2003;13(3):369–375. [PubMed] [Google Scholar]
- 65.Gifford AL, Collins R, Timberlake D, et al. Propensity of HIV patients to seek urgent and emergent care. HIV Cost and Services Utilization Study Consortium. J Gen Intern Med. 2000 Dec;15(12):833–840. doi: 10.1046/j.1525-1497.2000.91136.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Wolinsky FD, Liu L, Miller TR, et al. Emergency department utilization patterns among older adults. J Gerontol A Biol Sci Med Sci. 2008 Feb;63(2):204–209. doi: 10.1093/gerona/63.2.204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Ionescu-Ittu R, McCusker J, Ciampi A, et al. Continuity of primary care and emergency department utilization among elderly people. CMAJ. 2007 Nov 20;177(11):1362–1368. doi: 10.1503/cmaj.061615. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 68.Gadalla TM. Comparison of users and non-users of mental health services among depressed women: a national study. Women Health. 2008;47(1):1–19. doi: 10.1300/J013v47n01_01. [DOI] [PubMed] [Google Scholar]
- 69.Rhodes A, Liisa Jaakkimainen R, Bondy S, Fung K. Depression and mental health visits to physicians--a prospective records-based study. Soc Sci Med. 2006 Feb;62(4):828–834. doi: 10.1016/j.socscimed.2005.06.039. [DOI] [PubMed] [Google Scholar]
- 70.Shumay DM, Maskarinec G, Gotay CC, Heiby EM, Kakai H. Determinants of the degree of complementary and alternative medicine use among patients with cancer. J Altern Complement Med. 2002 Oct;8(5):661–671. doi: 10.1089/107555302320825183. [DOI] [PubMed] [Google Scholar]
- 71.Anthony MN, Gardner L, Marks G, et al. Factors associated with use of HIV primary care among persons recently diagnosed with HIV: examination of variables from the behavioural model of health-care utilization. AIDS Care. 2007 Feb;19(2):195–202. doi: 10.1080/09540120600966182. [DOI] [PubMed] [Google Scholar]
- 72.Dunlop DD, Manheim LM, Song J, Chang RW. Health care utilization among older adults with arthritis. Arthritis Rheum. 2003 Apr 15;49(2):164–171. doi: 10.1002/art.11003. [DOI] [PubMed] [Google Scholar]
- 73.Dunlop S, Coyte PC, McIsaac W. Socio-economic status and the utilisation of physicians' services: results from the Canadian National Population Health Survey. Soc Sci Med. 2000 Jul;51(1):123–133. doi: 10.1016/s0277-9536(99)00424-4. [DOI] [PubMed] [Google Scholar]
- 74.Suaya JA, Shepard DS, Normand SL, Ades PA, Prottas J, Stason WB. Use of cardiac rehabilitation by Medicare beneficiaries after myocardial infarction or coronary bypass surgery. Circulation. 2007 Oct 9;116(15):1653–1662. doi: 10.1161/CIRCULATIONAHA.107.701466. [DOI] [PubMed] [Google Scholar]
- 75.Yabroff KR, Breen N, Vernon SW, Meissner HI, Freedman AN, Ballard-Barbash R. What factors are associated with diagnostic follow-up after abnormal mammograms? Findings from a U.S. National Survey. Cancer Epidemiol Biomarkers Prev. 2004 May;13(5):723–732. [PubMed] [Google Scholar]
- 76.Astin JA. Why patients use alternative medicine: results of a national study. JAMA. 1998 May 20;279(19):1548–1553. doi: 10.1001/jama.279.19.1548. [DOI] [PubMed] [Google Scholar]
- 77.Machlin S, Cohen J, Elixhauser A, Beauregard K, Steiner C. Sensitivity of household reported medical conditions in the medical expenditure panel survey. Med Care. 2009 Jun;47(6):618–625. doi: 10.1097/MLR.0b013e318195fa79. [DOI] [PubMed] [Google Scholar]
- 78.Veazie PJ. When to combine hypotheses and adjust for multiple tests. Health Services Research. 2006 Jun;41(3):804–818. doi: 10.1111/j.1475-6773.2006.00512.x. [DOI] [PMC free article] [PubMed] [Google Scholar]

