Abstract
Objective
Recent U.S. outbreaks of Legionnaires' disease (LD) underscore the virulent nature of this infectious pneumonia. To date, only a paucity of literature has described the mortality burden of LD. This study updates LD mortality using U.S. multiple-cause-of-death data from 2000–2010.
Methods
We calculated crude and age-adjusted rates for LD mortality for age, sex, race, state, Census region, and year. We conducted Poisson regression to assess seasonal and temporal trends. We generated matched odds ratios (MORs) to describe the association between LD-related deaths and other comorbid conditions listed on the death certificates.
Results
We identified a total of 1,171 LD-related deaths during 2000–2010. The age-adjusted mortality rate remained relatively static from 2000 (0.038 per 100,000 population, 95% confidence interval [CI] 0.031, 0.046) to 2010 (0.040 per 100,000 population, 95% CI 0.033, 0.047). The absolute number increased from 107 to 135 deaths during this period, with adults ≥45 years of age having the highest caseload. Overall, LD mortality rates were 2.2 times higher in men than in women. White people accounted for nearly 83.3% of all LD-related deaths, but the age-adjusted mortality rates for black and white people were similar. Comorbid conditions such as leukemia (MOR=4.8, 95% CI 3.5, 6.6) and rheumatoid arthritis (MOR=5.6, 95% CI 3.3, 9.4) were associated with LD diagnosis on death certificates.
Conclusion
Comorbid conditions that could lead to an immunocompromised state were associated with fatal LD on U.S. death certificates. Characterization of LD mortality burden and related comorbidities has practice implications for clinical medicine and public health surveillance.
Legionnaires' disease (LD) is a severe form of pneumonia that can become fatal in vulnerable individuals.1–5 The condition is caused by the gram-negative bacterium Legionella pneumophila, a naturally occurring organism found in water.2,3 The organism is primarily transmitted to humans through inhalation of contaminated aerosolized water droplets. Typical sources of outbreaks include, but are not limited to, hot tubs, hot water tanks, large plumbing systems, decorative fountains, and cooling towers. The pneumophila species is generally not found in car or window air-conditioners.1–4 To date, no person-to-person transmission has been documented.1–4,6,7
Risk factors that increase susceptibility to LD include advanced age, smoking, chronic lung disease, and having a weak or suppressed immune system.1–4,6,7 Among individuals with a weakened immunity, those with cancer, diabetes, or kidney failure are particularly at risk. Although human immunodeficiency virus (HIV) infection has been linked to more severe infections, LD is generally not more common among people with HIV/acquired immunodeficiency syndrome (AIDS).1,8,9 More than 20% of cases in the United States reported to the Centers for Disease Control and Prevention (CDC) each year are travel-related.3 Nosocomial transmissions of LD can be problematic, as at-risk individuals are plentiful and plumbing in hospital facilities is often old.1,4 Because in-house diagnostic testing is readily available, detection of LD is more likely in the hospital setting.4 Currently, CDC recommends urinary antigen assay and a culture of respiratory secretions on selective media as the diagnostic tests of choice for confirming Legionella infection.3
Annually, CDC estimates that as many as 18,000 individuals are hospitalized with LD in the U.S.3 However, this number is considered an underestimate, as the disease is often underreported due in part to its diagnostic complexity and its resemblance to other pneumonias with similar symptom presentations.3,7 Symptoms of LD include cough, shortness of breath, fever, muscle aches, and headaches; they often start shortly after exposure to the bacteria.1–4,6
Recent LD outbreaks in the Veterans Affairs (VA) Medical Center in Pittsburgh, Pennsylvania, and in a retirement community in Ohio affirm the virulent nature of this infection and underscore the importance of the causative infectious pathogen to clinical practice and public health surveillance.10,11 Based on hospitalizations and treatment data, the annual costs for LD have been estimated at nearly $684 million.12 Few studies have recently examined LD mortality and its associated comorbid conditions. This study contributes to the closing of this gap in the literature by analyzing the national multiple-cause-of-death (MCD) data to describe the current mortality profile of LD in the U.S., for the period 2000–2010.
METHODS
We performed trend and matched case-control analyses using MCD data for the years 2000–2010 obtained from the National Vital Statistics System. The National Center for Health Statistics (NCHS), which manages this system, collects data on reported deaths filed in all 50 U.S. states, including the District of Columbia.13,14 Death occurrences are generally reported to NCHS using the U.S. Standard Certificate of Death form (i.e., death certificate). The attending physician or coroner usually completes this form, documenting decedent demographics and information about the underlying and associated causes of death as determined by the reporting party.13,14
Causes of death from 1999 to 2010 were classified in accordance with the International Classification of Diseases, 10th Revision (ICD-10).15 If more than one cause was listed on a death certificate, the sequence of conditions or causes on the form, provisions of the ICD, and relevant selection rules were applied to arrive at the underlying cause.13,14 Studies using MCD data to detect associations and causality based on conditions listed on death certificates have been previously described by Redelings et al.16
Study population and data analysis
We identified underlying and associated causes of LD using the ICD-10 code A48.1; these cases were subsequently included in the analysis. We calculated LD mortality rates per 100,000 population using the bridged-race population estimates provided by NCHS and population data from the U.S. Census Bureau.17,18 We calculated crude rates and 95% confidence intervals (CIs) for age, sex, race/ethnicity, state of residence, and Census region. We estimated age-adjusted rates, ratios, and 95% CIs using the 2000 U.S. standard population for sex and race/ethnicity. Where appropriate, we described and analyzed seasonal and temporal trends using Poisson regression procedures.19
Matched case-control analysis
To assess comorbid conditions as possible factors contributing to fatal LD, 10 controls (i.e., non-LD-related deaths) were randomly selected for each LD-related death from the other death records in the MCD dataset and matched on age at death, sex, and race/ethnicity. Comorbid conditions were selected for inclusion in the matched analysis if they met one or more of the following criteria: (1) the condition was listed on ≥20 death certificates in which LD was listed as an underlying or associated cause of death, (2) the condition has been previously found to be associated with the contraction of LD (based on a literature review), or (3) the condition likely contributed to the decedent being immunocompromised. Septicemia, adult respiratory distress syndrome, respiratory failure, and shock were considered possible sequelae of severe LD and, therefore, were excluded from the analysis. For each comorbid condition, matched odds ratios (MORs) and accompanying 95% CIs were generated and reported using previously established methods.16 We conducted all MCD analyses using SAS® version 9.3.20
RESULTS
We identified 1,171 deaths from LD during the study period 2000–2010. LD was listed as an underlying cause of death for 922 (78.7%) of the total decedents and as the associated cause for the remainder of decedents (21.3%) (data not shown).
The annual age-adjusted mortality rate for LD was relatively static during the sampled period, increasing only slightly from 0.038 per 100,000 population (95% CI 0.031, 0.046) in 2000 to 0.040 per 100,000 population (95% CI 0.033, 0.047) in 2010. The absolute number of deaths increased from 107 in 2000 to 135 in 2010 (Figure 1). The overall age-adjusted mortality rate, averaged over the entire sampled period, was 0.035 per 100,000 population (95% CI 0.033, 0.037). Time-trend analysis showed an average annual percentage change in mortality rates of –1.22% (95% CI –0.60, –3.08) (data not shown). A seasonal trend analysis revealed that nearly half (47.3%) of all deaths during the sampled period occurred from July to October (Figure 2).
Figure 1.
Number of deaths from Legionnaires' disease and age-adjusted mortality rates per 100,000 population, by year: U.S. multiple-cause-of-death data, 2000–2010 (n=1,171)
Figure 2.
Frequency distribution of deaths from Legionnaires' disease, by month: U.S. multiple-cause-of-death data, 2000–2010 (n=1,171)
The mean age at death for all LD-related deaths was 66.1 years (data not shown). The age-specific mortality rates increased consistently with each increasing age class. Those aged ≥85 years had the highest age-specific mortality rate (n=123; 0.226 per 100,000 population; 95% CI 0.186, 0.266), while those aged 75–84 years had the highest absolute number of deaths (24.2% of the total sample). Nearly two-thirds (63.4%) of the LD cases were men. In comparison analysis, men had a higher rate of LD mortality than women (age-adjusted rate ratio [RR] = 2.2, 95% CI 2.0, 2.4). Although white people accounted for nearly 83.3% of LD-related deaths, age-adjusted mortality rates between black and white people were similar (RR=1.0, 95% CI 1.0, 1.1). Corresponding age-adjusted mortality rates for Asian/Pacific Islanders (RR=0.4, 95% CI 0.4, 0.5), Native Americans (RR=0.4, 95% CI 0.3, 0.5), and Hispanic people (RR=0.4, 95% CI 0.4, 0.5) were substantially lower than for white people (Table 1).
Table 1.
Age-adjusted Legionnaires' disease mortality rates per 100,000 population and mortality rate ratios by region, sex, race/ethnicity, and age group: U.S. multiple-cause-of-death data, 2000–2010 (n=1,171)
aMortality rates for age groups are age-specific rates, not age-adjusted rates.
CI = confidence interval
Ref. = reference group
NA = not applicable
Geographically, the Census region with the highest age-adjusted mortality rate was the Northeast region (n=311; 0.047 per 100,000 population; 95% CI 0.042, 0.052). The region with the highest absolute number of deaths, however, was the South (n=378; 0.031 per 100,000 population; 95% CI 0.028, 0.034) (Table 1). The state with the highest age-adjusted mortality rate was Delaware (n=12; 0.127 per 100,000 population; 95% CI 0.055, 0.199) (Figure 3), but the state with the highest number of LD-related deaths was Ohio (n=115) (data not shown). The only state in the West region that fell into the fourth quartile of the age-adjusted rates with more than five deaths was Utah (Figure 3); however, the number of deaths was still small (n=16; 0.074 per 100,000 population; 95% CI 0.037, 0.111) (data not shown).
Figure 3.
Age-adjusted rates per 100,000 population of Legionnaires' disease mortality, by state: U.S. multiple-cause-of-death data, 2000–2010 (n=1,171)
In the matched case-control analysis, a number of comorbid conditions were found to be associated with LD-related deaths after matching on age, sex, and race/ethnicity. All cases of LD were successfully matched to 10 controls, resulting in a selection of 11,710 total controls. Using previously described selection criteria, 15 comorbid conditions were selected for analysis because they appeared on ≥20 death certificates, four conditions were selected because the literature showed a positive correlation between their presence and LD severity, and nine conditions were selected because disease progression and effects from treatments could contribute to the decedent becoming immunocompromised. At least 10 conditions met more than one of the selection criteria.
Although all cancer types (MOR=0.5, 95% CI 0.4, 0.5) had lower odds of appearing alongside LD on the death certificates, subgroup analysis revealed that this more generalized observation about cancer was not the case for leukemia (MOR=4.8, 95% CI 3.5, 6.6), multiple myeloma (MOR=2.5, 95% CI 1.4, 4.3), and non-Hodgkin's lymphoma (MOR=2.6, 95% CI 1.7, 4.0). Other comorbid conditions that were positively associated with LD-related deaths included connective tissue disorders (MOR=6.1, 95% CI 4.0, 9.3), specifically rheumatoid arthritis (MOR=5.6, 95% CI 3.3, 9.4), drug and alcohol abuse (MOR=2.8, 95% CI 2.2, 3.5), and all types of renal failure (MOR=3.2, 95% CI 2.7, 3.7) (Table 2).
Table 2.
Comorbid conditions associated with Legionnaires' disease mortality: U.S. multiple-cause-of-death data, 2000–2010
aAcute and other renal failure can occur as a result of Legionnaires' disease.
ICD-10 5 International Classification of Diseases, 10th Revision
CI 5 confidence interval
DISCUSSION
These study findings suggest that while annual age-adjusted mortality rates for LD in the United States have remained relatively static, the absolute number of cases increased slightly from 2000 to 2010. Decedent characteristics that suggest strong risk for severe disease and death were generally consistent with those described in the literature.1,3,4,6 For example, Fields et al. identified males as having a higher risk for LD than females;1 this finding is similar to our finding that men had higher LD mortality rates than women. Age-specific mortality rates likewise increased with each increasing age category, with adults aged ≥45 years representing the largest proportion of the cohort; this finding was not dissimilar to what has been described previously.1,3 This trend could increase as the U.S. population ages.21,22
Collier et al. estimated health-care expenditures for LD to be approximately $684 million annually.12 This estimate, however, did not take into consideration lost productivity due to work absenteeism and losses to society. In a supplemental analysis of the MCD data using the human capital approach,23 the cumulative productivity losses associated with premature death from LD were projected to be more than $463 million during 2000–2010.
The higher number of deaths observed from July to October was consistent with the increased incidence of LD in summer and fall months seen in prior studies.7,24 Studies have found that warm, humid, and wet weather conditions can contribute to increased growth of Legionella bacteria; thus, in places such as The Netherlands and certain parts of the U.S., LD incidence was generally higher during summer and fall.25–28 Not coincidentally, the use of cooling towers was likely higher during these seasons as well.
Although there were notable differences in mortality trends by geography, these increased rates and numbers in certain parts of the country likely reflected clustering of the demographics, seasonality, and other regional risk factors rather than the emergence of more virulent Legionella strains. The Eastern and Midwestern states, for example, have historically had a higher incidence of LD;24,29,30 this higher incidence may reflect seasonal as well as housing factors, such as humid conditions during the summer months in combination with older plumbing systems in older buildings.
Previous research has implicated a variety of chronic conditions that can impair the immune response as strong risk factors for developing more severe disease and death, independent of age, sex, and race/ethnicity.1,7,8,24 Our findings affirm these observations in the literature, demonstrating associations between -LD-related deaths and reports of hematological cancers, connective tissue disorders, and drug and alcohol abuse on the death certificates. The latter association, however, should be interpreted with caution, as a mediating factor that can affect the pathway to death is smoking status. Prior studies have shown that drug and alcohol abuse is positively correlated with cigarette smoking,31–34 and cigarette smoking, in turn, is an established risk factor of LD.3,4,6,7
Treatment of certain diseases can increase susceptibility to infection. For instance, in rheumatoid arthritis, treatments such as glucocorticoids and tumor necrosis factor inhibitors have been known to increase patient risk for bacterial infections.35,36 Standard treatments for other connective tissue disorders could carry similar risks.
Consistent with the literature, fatal LD was not more frequent among individuals with HIV/AIDS in the study sample. Although further research can provide additional insights on this finding, medical treatment advances in HIV/AIDS may have affected LD's virulence in the presence of HIV. For example, the widespread use of triple antiretroviral therapy among HIV patients (in the mid-1990s) could have played an instrumental role in reducing the number of individuals susceptible to Legionella infection or to severe manifestations of this disease.9
Limitations
Although there are several advantages to using population-level data to describe disease burden (e.g., larger sample size and greater statistical power), there were a number of limitations related to the use of death records.16 First, due to the study design, it was difficult to show causality because temporality cannot be established among the various factors that could have contributed to death. Second, user errors while completing the death certificates may have resulted in misclassification bias.37,38 Completeness for each death certificate form typically depends on the physician or coroner who files the records (i.e., the reporting party was responsible for determining the sequences of events and conditions that may have led to death). Third, information on certain risk factors, patients' medical history, the clinical course of the disease (including virulence of the organism), and social characteristics were important data that were not listed or described on the death certificates. Without such information, the MCD analyses were limited in their ability to adequately adjust for confounding. Better technology/protocols and vigilance for disease detection in subsequent years, for example, could have accounted for some of the observed increases in absolute LD numbers during the sampled period. Finally, the population data used and the mortality estimates generated by this analysis may lack a certain degree of precision due to numerous uncertainties. Among them were the high frequency in which LD is often undetected or underdiagnosed in real-world clinical settings and the paucity of definitive guidance on whether and how bias from multiple comparisons could be addressed in studies other than confirmatory clinical trials.39 Among researchers, there are different viewpoints regarding whether and how to adjust for the latter.40,41
CONCLUSION
We found that having comorbid conditions that could lead to an immunocompromised state was associated with LD-related death on the death certificates. Recent LD outbreaks observed among patients at the Pittsburgh VA and residents of the retirement community in Ohio10,11 (which collectively took more than 10 lives) affirms the importance of early diagnosis, treatment, and prevention of LD in the hospital and community settings. Based on MCD data, LD-related mortality was not trivial during 2000–2010. These study findings have practical implications for health services planning, clinical medicine, and public health surveillance. Legionella infection is a preventable and treatable disease that remains a formidable public health problem in the U.S.
Footnotes
Because multiple-cause-of-death data are part of a public-use dataset that contains no personal identifiers and involves no living human subjects, this study was considered exempt by the Los Angeles County Department of Public Health Institutional Review Board (IRB) and by IRBs of affiliated institutions/universities.
The authors thank Patricia L. Cummings, Mirna Ponce Jewell, and Sean M. Comer for their technical assistance and contributions to this article.
REFERENCES
- 1.Fields BS, Benson RF, Besser RE. Legionella and Legionnaires' disease: 25 years of investigation. Clin Microbiol Rev. 2002;15:506–26. doi: 10.1128/CMR.15.3.506-526.2002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Heymann DL, editor. Control of communicable diseases manual. 19th ed. Washington: American Public Health Association; 2008. [Google Scholar]
- 3.Centers for Disease Control and Prevention (US) Legionella: (Legionnaires' disease and Pontiac Fever) [cited 2013 Feb 8] Available from: URL: http://www.cdc.gov/legionella/index.html.
- 4.Stout JE, Yu VL. Legionellosis. N Engl J Med. 1997;337:682–7. doi: 10.1056/NEJM199709043371006. [DOI] [PubMed] [Google Scholar]
- 5.Whiley H, Bentham R. Legionella longbeachae and legionellosis. Emerg Infect Dis. 2011;17:579–83. doi: 10.3201/eid1704.100446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Bartram J, Chartier Y, Pond K, Surman-Lee S, editors. Legionella and the prevention of legionellosis. Geneva: World Health Organization; 2007. [Google Scholar]
- 7.Marston BJ, Lipman HB, Breiman RF. Surveillance for Legionnaires' disease: risk factors for morbidity and mortality. Arch Intern Med. 1994;154:2417–22. [PubMed] [Google Scholar]
- 8.Pedro-Botet ML, Sabrià M, Sopena N, García-Núñez M, Domínguez MJ, Reynaga E, et al. Legionnaires' disease and HIV infection. Chest. 2003;124:543–7. doi: 10.1378/chest.124.2.543. [DOI] [PubMed] [Google Scholar]
- 9.Pedro-Botet ML, García Cruz A, Sopena N, Domínguez MJ, Sarroca O, Rey Joly C, et al. [Legionnaires' disease and HIV infection: an opportunistic infection?] Med Clin (Barc) 2004;123:582–4. doi: 10.1016/s0025-7753(04)74604-7. [DOI] [PubMed] [Google Scholar]
- 10.Congress opens another VA hearing about Legionnaires' disease. CBS Pittsburgh 2013 Sep 9 [cited 2013 Oct 4] Available from: URL: http://pittsburgh.cbslocal.com/tag/legionnaires-disease.
- 11.Crane M, King D. Legionnaires' outbreak claims 2 more lives. The Columbus Dispatch 2013 Jul 26 [cited 2013 Oct 4] Available from: URL: http://www.dispatch.com/content/stories/local/2013/07/24/Two-more-deaths-blamed-on-Legionnaires-outbreak.html.
- 12.Collier SA, Stockman LJ, Hicks LA, Garrison LE, Zhou FJ, Beach MJ. Direct healthcare costs of selected diseases primarily or partially transmitted by water. Epidemiol Infect. 2012;140:2003–13. doi: 10.1017/S0950268811002858. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Centers for Disease Control and Prevention (US) WONDER. Multiple cause of death 1999–2012 [cited 2013 Jun 6] Available from: URL: http://wonder.cdc.gov/wonder/help/mcd.html.
- 14.National Center for Health Statistics (US) Instructions for classifying underlying cause of death part 2A. Hyattsville (MD): National Center for Health Statistics; 2010. [Google Scholar]
- 15.World Health Organization. International classification of diseases and related health problems—10th revision. 4th ed. Geneva: WHO; 2011. [Google Scholar]
- 16.Redelings MD, Wise M, Sorvillo F. Using multiple cause-of-death data to investigate associations and causality between conditions listed on the death certificate. Am J Epidemiol. 2007;166:104–8. doi: 10.1093/aje/kwm037. [DOI] [PubMed] [Google Scholar]
- 17.National Center for Health Statistics (US) U.S. Census populations with bridged race categories [cited 2013 Jun 7] Available from: URL: http://www.cdc.gov/nchs/nvss/bridged_race.htm.
- 18.National Center for Health Statistics (US) July 1, 2000–July 2009 revised bridged-race intercensal population estimates. 2011 [cited 2015 Jan 7] Available from: URL: http://www.cdc.gov/nchs/nvss/bridged_race/data_documentation.htm.
- 19.Cameron AC, Trivedi PK. Regression analysis of count data. 2nd ed. Cambridge (MA): Cambridge University Press; 2013. [Google Scholar]
- 20.SAS Institute, Inc. Cary (NC): SAS Institute, Inc.; 2011. SAS®: Version 9.3. [Google Scholar]
- 21.Goulding MR, Rogers ME, Smith SM. Public health and aging: trends in aging—United States and worldwide. MMWR Morb Mortal Wkly Rep. 2003;52(6):101–6. [PubMed] [Google Scholar]
- 22.Werner CA. 2010 Census Brief C2010BR-09: the older population: 2010. Washington: Census Bureau (US); 2011. Also available from: URL: http://www.census.gov/prod/cen2010/briefs/c2010br-09.pdf [cited 2014 Nov 25] [Google Scholar]
- 23.Grosse SD, Krueger KV, Mvundura M. Economic productivity by age and sex: 2007 estimates for the United States. Med Care. 2009;47(7 Suppl 1):S94–103. doi: 10.1097/MLR.0b013e31819c9571. [DOI] [PubMed] [Google Scholar]
- 24.Neil K, Berkelman R. Increasing incidence of legionellosis in the United States, 1990–2005: changing epidemiologic trends. Clin Infect Dis. 2008;47:591–9. doi: 10.1086/590557. [DOI] [PubMed] [Google Scholar]
- 25.Karagiannis I, Brandsema P, van der Sande M. Warm, wet weather associated with increased Legionnaires' disease incidence in The Netherlands. Epidemiol Infect. 2009;137:181–7. doi: 10.1017/S095026880800099X. [DOI] [PubMed] [Google Scholar]
- 26.Brandsema PS, Euser SM, Karagiannis I, Den Boer JW, van der Hoek W. Summer increase of Legionnaires' disease 2010 in The Netherlands associated with weather conditions and implications for source finding. Epidemiol Infect. 2014;142:2360–71. doi: 10.1017/S0950268813003476. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Hicks LA, Rose CE, Jr, Fields BS, Drees ML, Engel JP, Jenkins PR, et al. Increased rainfall is associated with increased risk for legionellosis. Epidemiol Infect. 2007;135:811–7. doi: 10.1017/S0950268806007552. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Fisman DN, Lim S, Wellenius GA, Johnson C, Britz P, Gaskins M, et al. It's not the heat, it's the humidity: wet weather increases legionellosis risk in the greater Philadelphia metropolitan area. J Infect Dis. 2005;192:2066–73. doi: 10.1086/498248. [DOI] [PubMed] [Google Scholar]
- 29.Hicks LA, Garrison LE, Nelson GE, Hampton LM. Legionellosis—United States, 2000–2009. MMWR Morb Mortal Wkly Rep. 2011;60(32):1083–6. [PubMed] [Google Scholar]
- 30.Phin N, Parry-Ford F, Harrison T, Stagg HR, Zhang N, Kumar K, et al. Epidemiology and clinical management of Legionnaires' disease. Lancet Infect Dis. 2014:1011–21. doi: 10.1016/S1473-3099(14)70713-3. [DOI] [PubMed] [Google Scholar]
- 31.DiFranza JR, Guerrera MP. Alcoholism and smoking. J Stud Alcohol. 1990;51:130–5. doi: 10.15288/jsa.1990.51.130. [DOI] [PubMed] [Google Scholar]
- 32.Lai S, Lai H, Page JB, McCoy CB. The association between cigarette smoking and drug abuse in the United States. J Addict Dis. 2000;19:11–24. doi: 10.1300/J069v19n04_02. [DOI] [PubMed] [Google Scholar]
- 33.Torabi MR, Bailey WJ, Majd-Jabbari M. Cigarette smoking as a predictor of alcohol and other drug use by children and adolescents: evidence of the “gateway drug effect.”. J Sch Health. 1993;63:302–6. doi: 10.1111/j.1746-1561.1993.tb06150.x. [DOI] [PubMed] [Google Scholar]
- 34.Henningfield JE, Clayton R, Pollin W. Involvement of tobacco in alcoholism and illicit drug use. Br J Addict. 1990;85:279–92. doi: 10.1111/j.1360-0443.1990.tb03084.x. [DOI] [PubMed] [Google Scholar]
- 35.Schur PH, Moreland LW. General principles of management of rheumatoid arthritis in adults. Waltham (MA): UpToDate; 2014. [Google Scholar]
- 36.Listing J, Gerhold K, Zink A. The risk of infections associated with rheumatoid arthritis, with its comorbidity and treatment. Rheumatology (Oxford) 2013;52:53–61. doi: 10.1093/rheumatology/kes305. [DOI] [PubMed] [Google Scholar]
- 37.Kircher T, Nelson J, Burdo H. The autopsy as a measure of accuracy of the death certificate. N Engl J Med. 1985;313:1263–9. doi: 10.1056/NEJM198511143132005. [DOI] [PubMed] [Google Scholar]
- 38.Lloyd-Jones DM, Martin DO, Larson MG, Levy D. Accuracy of death certificates for coding coronary heart disease as the cause of death. Ann Intern Med. 1998;129:1020–6. doi: 10.7326/0003-4819-129-12-199812150-00005. [DOI] [PubMed] [Google Scholar]
- 39.Bender R, Lange S. Adjusting for multiple testing—when and how? J Clin Epidemiol. 2001;54:343–9. doi: 10.1016/s0895-4356(00)00314-0. [DOI] [PubMed] [Google Scholar]
- 40.Rothman KJ. No adjustments are needed for multiple comparisons. Epidemiology. 1990;1:43–6. [PubMed] [Google Scholar]
- 41.Gelman A, Hill J, Yajima M. Why we (usually) don't have to worry about multiple comparisons. J Res Educ Effect. 2012;5:189–211. [Google Scholar]