Skip to main content
American Journal of Epidemiology logoLink to American Journal of Epidemiology
letter
. 2017 Apr 6;185(10):982–985. doi: 10.1093/aje/kww221

Ascertainment of Vital Status Among People With Criminal Justice Involvement Using Department of Corrections Records, the US National Death Index, and Social Security Master Death Files

Ingrid A Binswanger 1,2,*, Jeffrey D Morenoff 3,4, Charley A Chilcote 4,5, David J Harding 6,7
PMCID: PMC5430939  PMID: 28387782

The increase in the rate of incarceration in the United States in recent decades (1) has drawn attention to the relationship between incarceration and health. Researchers have increasingly turned to administrative records to study the consequences of incarceration for mortality rates (25). Still, little is known about the performance of different methods to ascertain vital statuses of people involved in the criminal justice system. Some studies have relied on records of deaths among people in custody from departments of corrections (DOC) (6, 7), whereas others have linked records of participants with mortality registries, such as the National Death Index (NDI) and the Social Security Death Master File (SSDMF) (811).

DOC death records are commonly used in national prison mortality surveillance (6, 7), but these records only identify deaths that occur among people in custody (e.g., prison, jail) or under supervision (e.g., parole, probation). To assess long-term mortality rates, identifiers can be linked with the NDI or records derived from the SSDMF. The NDI is a comprehensive database amassed from state death certificates that has traditionally been shown to yield more matches than other sources, but it charges users to search records, has an approval and reporting delay, and is restricted to use for medical and health research (1215). In 2015, an early release program improved the timeliness of NDI data (16). The SSDMF is more rapidly updated and available, either for a subscription fee through the National Technical Informational Service (17), or for free through secondary websites (18). However, the SSDMF only records deaths of people with social security numbers (SSNs), and since 2011, the public SSDMF no longer contains protected state death records. This means that records of more than 4 million deaths that occurred before 2011 have been removed and data on approximately 1 million fewer deaths have been added per year since 2011 (1921).

Use of data from the NDI and SSDMF may result in differential ascertainment in populations overrepresented in the criminal justice system, such as people who are young, black, or Latino (1, 14, 2226). Thus, it is important to estimate the relative utility of vital status data sources by criminal justice and demographic subgroups. We compared the completeness of vital status data obtained from the DOC, NDI, and SSDMF among individuals convicted of felonies.

Methods

We conducted a longitudinal cohort study using data from a US Midwestern state correctional system that had jurisdiction over state prisons, felony probation, and parole. The cohort included 145,718 individuals sentenced for felonies in the state from January 1, 2003, to December 31, 2006 and excluded those who were re-sentenced for probation violations or re-sentenced for prior felony convictions. Deaths through December 31, 2012, were ascertained from DOC records and by linking identifiers obtained from the DOC with the NDI (Web Appendix 1, available at http://aje.oxfordjournals.org/) and accessing publicly available SSDMF data through a secondary website (http://ssdmf.info/; see Web Appendix 2 for details) (12). In the DOC data, 1.21% of records were missing any SSN, 89.51% had a single SSN, and 9.27% had more than 1 SSN. We calculated unadjusted mortality rates from each source, using rate ratios and McNemar's test to assess differences across sources.

Because DOC records only include deaths of individuals who were under DOC custody or supervision, we restricted the length of the observation period when comparing sources. We report results from 3 observation periods: the first captures all deaths through December 31, 2012; the second is censored after the date of last DOC contact with the individual; and the third is censored after the individual's last release from prison (see Web Appendix 3 for methodology details).

Results

Table 1 shows the numbers of deaths and crude mortality rates from each data source and observation period, along with comparisons across data sources. The NDI recorded more deaths than did either the DOC or the SSDMF in all observation periods (Web Figure 1), and the discrepancies between the NDI mortality rate and those from other sources were especially pronounced among nonwhites and younger people (see Web Appendix 4 and Web Tables 1 and 2 for details of second and third observation periods). The DOC recorded fewer deaths in the first observation period than did either the NDI (for NDI vs. DOC, rate ratio (RR) = 1.70) or the SSDMF (for SSDMF vs. DOC, RR = 1.29), but the gap between DOC and NDI mortality rates narrowed when the observation period was restricted to time until last DOC contact (for NDI vs. DOC, RR = 1.17) or time until last release from prison (for NDI vs. DOC, RR = 1.06). Although the discrepancy between the NDI and DOC mortality rates was relatively small between the date of the sentence until the last release from prison, the differences were statistically significant in all time periods because of the sample size. Whereas the NDI and DOC mortality rate estimates converged as the observation period grew more restrictive, the SSDMF mortality rate diverged from the other sources in all periods (Web Table 3). The SSDMF recorded fewer deaths than did the other data sources except in the first observation period (through December 31, 2012), when the DOC rate was lowest because of its lack of coverage.

Table 1.

Characteristics of the Study Cohort With a Felony Conviction in a US State and Comparison of Number of Deaths Ascertained by Source, 2003–2012

Observation Period No. DOC NDI SSDMF Comparison Rate Ratios
No. of Deaths Crude Mortality Ratea No. of Deaths Crude Mortality Ratea No. of Deaths Crude Mortality Ratea NDI/DOC NDI/SSDMF SSDMF/DOC
Date of sentence through December 31, 2012 145,718 2,446 4.04 7,894 6.87 5,974 5.19 1.70b 1.32b 1.29b
 Race
  Black 59,735 898 3.25 3,027 6.39 2,036 4.29 1.97b 1.49b 1.32b
  White 84,650 1,539 4.74 4,826 7.26 3,913 5.88 1.53b 1.23b 1.24b
  Other 1,333 9 2.04 41 3.85 25 2.34 1.88b 1.64b 1.15b
 Sex
  Male 120,878 2,112 4.03 6,587 6.89 4,972 5.20 1.71b 1.33b 1.29b
  Female 24,840 334 4.12 1,307 6.73 1,002 5.14 1.63b 1.31b 1.25b
 Age at study entry, years
  <25 50,248 532 2.43 1,410 3.52 887 2.21 1.45b 1.59b 0.91b
  25–34 41,368 531 2.98 1,444 4.37 1,048 3.18 1.47b 1.38b 1.07b
  35–44 32,534 582 4.32 1,893 7.35 1,487 5.78 1.70b 1.27b 1.34b
  45–54 17,124 567 9.36 2,149 16.62 1,701 13.16 1.78b 1.26b 1.41b
  ≥55 4,444 234 17.63 998 31.66 851 26.66 1.80b 1.19b 1.51b
 Sentence type
  Prison 27,713 722 4.29 1,269 5.65 934 4.20 1.32b 1.35b 0.98b
  Probation 51,216 675 3.73 2,719 6.79 2,051 5.09 1.82b 1.33b 1.37b
  Jail 11,095 125 3.42 772 8.86 574 6.60 2.59b 1.34b 1.93b
  Jail with probation 55,006 921 4.22 3,096 7.16 2,387 5.50 1.70b 1.30b 1.30b
  Fines and/or community service 688 3 2.79 38 7.28 28 5.36 2.61b 1.36b 1.92c
Date of sentence through last DOC contact 145,718 2,446 4.04 2,870 4.74 2,119 3.50 1.17b 1.35b 0.87b
Date of sentence through last prison release 50,674 275 1.56 290 1.65 215 1.22 1.06d 1.35b 0.78b

Abbreviations: DOC, Department of Corrections database; NDI, National Death Index; SSDMF, Social Security Death Master File.

a Unadjusted mortality rates calculated as (no. of deaths/person-years × 1,000); not adjusted for age or other demographic characteristics.

bP < 0.001 for McNemar test for equivalence of proportions from related/paired samples.

cP < 0.01 for McNemar test for equivalence of proportions from related/paired samples.

dP < 0.05 for McNemar test for equivalence of proportions from related/paired samples.

Discussion

We compared 3 sources of death records—NDI, SSDMF, and DOC—for people convicted of felonies, a large and underrepresented population in health research. The NDI recorded more deaths than did any other source in all observation periods. During DOC custody or supervision, mortality rates derived from the SSMDF data were lower than those derived from the DOC and NDI data. In analyses in which we examined subgroups defined by race, age, sex, and sentence type, differences in vital statuses across data sources were most pronounced for nonwhites and younger people.

Discrepancies in mortality rates across data sources can arise for multiple reasons, including errors in identifiers (e.g., false aliases and SSNs) resulting in false positives and false negatives, linkage errors, and biases specific to the data source (20, 27). DOC records are not prone to the error produced by linking records across data sources, but coverage is limited to deaths that occurred when people were in DOC custody or under its supervision. Moreover, our DOC records did not contain data on cause of death, which limits their utility for research. Although errors in linkage are a concern with data from NDI, it returns information on all potential matches, including matches for multiple aliases (at no additional cost); it is also thought to have the most comprehensive collection of death records (13, 28). In addition, the NDI provides data on cause of death (at an additional cost). The main drawbacks of the NDI are its relatively high cost and the time it takes to approve user applications and perform matches.

Both the NDI and SSDMF may miss some deaths of individuals who do not have SSNs, who immigrated to the United States, or who returned to their country of origin at the end of life (15, 23, 25, 29, 30). Such issues may be of particular concern among individuals involved in the criminal justice system because they may bias death rates downwards. However, a linkage between the National Longitudinal Mortality Study and the NDI did not show an appreciable bias resulting from missing SSNs in relative rates of death across groups divided by Hispanic and non-Hispanic ethnicity (31). The SSDMF under-reports deaths of individuals who have not qualified for Social Security benefits by working for at least 10 years, which could explain why mortality rates were lower in the SSDMF for people of black race and individuals younger than 25 years of age. The SSDMF offers public subscription access and can currently be accessed through secondary public websites, but since 2011, some deaths have been redacted, making it much less useful to researchers (1921). The SSDMF also does not provide data on causes of death. Thus, we feel more confident in recommending the NDI than the SSDMF. Based on the population, setting, and observation period, investigators can select the source(s) best suited to their purpose and constraints.

Supplementary Material

Web Material

Acknowledgments

This work was supported by the Eunice Kennedy Shriver National Institute of Child Health and Human Development of the National Institutes of Health (grants R01 HD079467, R24 HD041028, and R24 HD073964).

We thank the Michigan Department of Corrections (Lansing, Michigan) for providing the data, Paulette Hatchett (Lansing, Michigan) for her advice and guidance on the use of the data, and Erica Blum-Barnett (Institute for Health Research, Kaiser Permanente Colorado, Denver, Colorado) for technical assistance in searching for relevant literature.

The funding body was not involved in the design, conduct, or reporting of the study or in the decision to submit the manuscript for publication. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or the Michigan Department of Corrections.

Conflict of interest: C.A.C. is employed by the Department of Corrections, but the Department had no input into the analysis or the decision to publish the results. The other authors report no conflicts.

References

  • 1. Carson EA, Golinelli D. Prisoners in 2012: Trends in Admissions and Releases, 1991-2012. Washington, DC: Bureau of Justice Statistics; 2013. (US Department of Justice publication no. NCJ 242467). https://www.bjs.gov/content/pub/pdf/p12tar9112.pdf. Accessed April 25, 2016. [Google Scholar]
  • 2. van Dooren K, Kinner SA, Forsyth S. Risk of death for young ex-prisoners in the year following release from adult prison. Aust NZ J Public Health. 2013;37(4):377–382. [DOI] [PubMed] [Google Scholar]
  • 3. Kariminia A, Law MG, Butler TG, et al. Factors associated with mortality in a cohort of Australian prisoners. Eur J Epidemiol. 2007;22(7):417–428. [DOI] [PubMed] [Google Scholar]
  • 4. Farrell M, Marsden J. Acute risk of drug-related death among newly released prisoners in England and Wales. Addiction. 2008;103(2):251–255. [DOI] [PubMed] [Google Scholar]
  • 5. Spaulding AC, Sharma A, Messina LC, et al. A comparison of liver disease mortality with HIV and overdose mortality among Georgia prisoners and releasees: a 2-decade cohort study of prisoners incarcerated in 1991. Am J Public Health. 2015;105(5):e51–e57. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Noonan M. Mortality in Local Jails, 2000-07. Washington, DC: Bureau of Justice Statistics; 2010. (US Department of Justice publication no. NCJ 222988). https://www.bjs.gov/content/pub/pdf/mljsp0011.pdf. Accessed May 9, 2016. [Google Scholar]
  • 7. Noonan M, Rohloff H, Ginder S. Mortality in Local Jails and State Prisons, 2000-2013 - Statistical Tables. Washington, DC: Bureau of Justice Statistics; 2015. (US Department of Justice publication no. NCJ 248756). https://www.bjs.gov/content/pub/pdf/mljsp0013st.pdf. Accessed April 28, 2016. [Google Scholar]
  • 8. Zeng Z, Binswanger I, Noonan M, et al. Assessing Inmate Cause of Death: Deaths in Custody Reporting Program and National Death Index. Bureau of Justice Statistics; 2016. (US Department of Justice publication no. NCJ 249568). https://www.bjs.gov/content/pub/pdf/aicddcrpndi.pdf. Accessed October 3, 2016. [Google Scholar]
  • 9. Kariminia A, Butler T, Corben S, et al. Mortality among prisoners: how accurate is the Australian National Death Index. Aust NZ J Public Health. 2005;29(6):572–575. [DOI] [PubMed] [Google Scholar]
  • 10. Larney S, Burns L. Evaluating health outcomes of criminal justice populations using record linkage: the importance of aliases. Eval Rev. 2011;35(2):118–128. [DOI] [PubMed] [Google Scholar]
  • 11. Binswanger IA, Blatchford PJ, Mueller SR, et al. Mortality after prison release: opioid overdose and other causes of death, risk factors, and time trends from 1999 to 2009. Ann Intern Med. 2013;159(9):592–600. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. National Center for Health Statistics National Death Index User's Manual. Hyattsville, MD: National Center for Health Statistics, Department of Health and Human Services; 2013. [Google Scholar]
  • 13. Lash TL, Silliman RA. A comparison of the National Death Index and Social Security Administration databases to ascertain vital status. Epidemiology. 2001;12(2):259–261. [DOI] [PubMed] [Google Scholar]
  • 14. Boyle CA, Decouflé P. National sources of vital status information: extent of coverage and possible selectivity in reporting. Am J Epidemiol. 1990;131(1):160–168. [DOI] [PubMed] [Google Scholar]
  • 15. Hanna DB, Pfeiffer MR, Sackoff JE, et al. Comparing the National Death Index and the Social Security Administration's Death Master File to ascertain death in HIV surveillance. Public Health Rep. 2009;124(6):850–860. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Center for Disease Control and Prevention (CDC) NDI Early Release Pilot Program 2016. http://www.cdc.gov/nchs/ndi/ndi_early_release.htm. Updated February 8, 2016. Accessed October 3, 2016.
  • 17. National Technical Information Service Limited Access Death Master File Available Through Value-Added Online Products. Alexandria, VA: National Technical Information Service; 2016. https://classic.ntis.gov/products/ssa-online/. Accessed October 3, 2016. [Google Scholar]
  • 18. Huser V, Cimino JJ. Don't take your EHR to heaven, donate it to science: legal and research policies for EHR post mortem. J Am Med Inform Assoc. 2014;21(1):8–12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. da Graca B, Filardo G, Nicewander D. Consequences for healthcare quality and research of the exclusion of records from the Death Master File. Circ Cardiovasc Qual Outcomes. 2013;6(1):124–128. [DOI] [PubMed] [Google Scholar]
  • 20. Jacobs JP, O'Brien SM, Shahian DM, et al. Successful linking of the Society of Thoracic Surgeons Database to Social Security data to examine the accuracy of Society of Thoracic Surgeons mortality data. J Thorac Cardiovasc Surg. 2013;145(4):976–983. [DOI] [PubMed] [Google Scholar]
  • 21. Blackstone EH. Demise of a vital resource. J Thorac Cardiovasc Surg. 2012;143(1):37–38. [DOI] [PubMed] [Google Scholar]
  • 22. Curb JD, Ford CE, Pressel S, et al. Ascertainment of vital status through the National Death Index and the Social Security Administration. Am J Epidemiol. 1985;121(5):754–766. [DOI] [PubMed] [Google Scholar]
  • 23. Schisterman EF, Whitcomb BW. Use of the Social Security Administration Death Master File for ascertainment of mortality status. Popul Health Metr. 2004;2(1):2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24. Carson EA. Prisoners in 2013. Washington, DC: Bureau of Justice Statistics; 2014. (US Department of Justice publication no. NCJ 247282). https://www.bjs.gov/content/pub/pdf/p13.pdf. Accessed March 4, 2016. [Google Scholar]
  • 25. Calle EE, Terrell DD. Utility of the National Death Index for ascertainment of mortality among cancer prevention study II participants. Am J Epidemiol. 1993;137(2):235–241. [DOI] [PubMed] [Google Scholar]
  • 26. Trepka MJ, Maddox LM, Lieb S, et al. Utility of the National Death Index in ascertaining mortality in acquired immunodeficiency syndrome surveillance. Am J Epidemiol. 2011;174(1):90–98. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Campbell KM, Deck D, Krupski A. Record linkage software in the public domain: a comparison of Link Plus, The Link King, and a “basic” deterministic algorithm. Health Informatics J. 2008;14(1):5–15. [DOI] [PubMed] [Google Scholar]
  • 28. Cowper DC, Kubal JD, Maynard C, et al. A primer and comparative review of major US mortality databases. Ann Epidemiol. 2002;12(7):462–468. [DOI] [PubMed] [Google Scholar]
  • 29. Holmes JS, Driscoll AK, Heron M. Mortality among US-born and immigrant Hispanics in the US: effects of nativity, duration of residence, and age at immigration. Int J Public Health. 2015;60(5):609–617. [DOI] [PubMed] [Google Scholar]
  • 30. Elo IT, Preston SH. Racial and ethnic differences in mortality at older ages In: Martin LG, Soldo BJ, eds. Racial and Ethnic Differences in the Health of Older Americans. Washington, DC: National Academies Press, 1997:10–42. [PubMed] [Google Scholar]
  • 31. Sorlie PD, Backlund E, Johnson NJ, et al. Mortality by Hispanic status in the United States. JAMA. 1993;270(20):2464–2468. [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Web Material

Articles from American Journal of Epidemiology are provided here courtesy of Oxford University Press

RESOURCES