Abstract
Objective
Higher prevalence of suicide notes could signify more conservatism in accounting and greater proneness to undercounting of suicide by method. We tested two hypotheses: (1) an evidentiary suicide note is more likely to accompany suicides by drug-intoxication and by other poisoning, as less violent and less forensically overt methods, than suicides by firearm and hanging/suffocation; and (2) performance of a forensic autopsy attenuates any observed association between overtness of method and the reported presence of a note.
Methods
This multilevel (individual/county), multivariable analysis employed a generalized linear mixed model (GLMM). Representing the 17 states participating in the United States National Violent Death Reporting System throughout 2011–2013, the study population comprised registered suicides, aged 15 years and older. Decedents totaled 32,151. The outcome measure was relative odds of an authenticated suicide note.
Results
An authenticated suicide note was documented in 31% of the suicide cases. Inspection of the full multivariable model showed a suicide note was more likely to manifest among drug intoxication (adjusted odds ratio [OR], 1.70; 95% CI, 1.56, 1.85) and other poisoning suicides (OR, 2.12; 1.85, 2.42) than firearm suicides, the referent. Respective excesses were larger when there was no autopsy or autopsy status was unknown (OR, 1.86; 95% CI, 1.61, 2.14) and (OR, 2.25; 95% CI, 1.86, 2.72) relative to the comparisons with a forensic autopsy (OR, 1.62, 95% CI, 1.45, 1.82 and OR, 2.01; 95% CI, 1.66, 2.43). Hanging/suffocation suicides did not differ from the firearm referent given an autopsy.
Conclusions
Suicide requires substantial affirmative evidence to establish manner of death, and affirmation of drug intoxication suicides appears to demand an especially high burden of proof. Findings and their implications argue for more stringent investigative standards, better training, and more resources to support comprehensive and accurate case ascertainment, as the foundation for developing evidence-based suicide prevention initiatives.
Introduction
Emerging as the leading cause of injury mortality in the United States (US) by 2009 [1], suicide is not a default manner-of-death determination for medical examiners and coroners [2–4]. A socially condemned and stigmatized phenomenon, suicides are undercounted [5], with false negativity posing a far greater threat than false positivity to valid certification [6,7]. National and international research indicates that undercounting is nonrandom across suicide methods [8,9]. The three leading methods of suicide in the US are firearm, hanging, and poisoning. Collectively, these methods accounted for 92% of total suicides in 2015 [10]. Suicides by poisoning are likely far more challenging for medical examiners and coroners to ascertain than those by shooting and hanging [4,11–14]. Gross discrepancies among these major methods in accounting for suicide would inhibit, or even preclude, accurate risk group delineation and risk factor identification, and hence impede the design, targeting, and implementation of effective clinical and population interventions.
Availability of a suicide note or an equivalent—whether written, typed, digital, or audio [15]—can serve as a pivotal piece of external forensic and psychological evidence for determining suicide as the manner of death [16]. Some countries even require a suicide note to record a death as suicide [17], as was true of some US coroners in the 1970s [18]. Thus, lack of an evidentiary note may induce suicide misclassification in the US [19]. Echoing its pivotal nature, a US study found that a suicide manner of death was associated with a far higher prevalence of notes than was undetermined intent, 32% versus 1.5% [20]. Two English studies also revealed large prevalence gaps [21,22]. Undetermined is the manner of death category most susceptible to obscuring suicides [21,23–25], in relative terms, with poisoning its predominant underlying cause-of-death sub-category in the US [14,26].
Two earlier American studies found an excess of note-leaving among suicides by poisoning relative to other methods [27,28], whereas a later one found an excess among hanging suicides [29]. A subsequent individual-level, multivariable analysis of National Violent Death Reporting System (NVDRS) data, for the period 2003–2006, showed excess note-leaving among suicides by poisoning, firearm, and hanging versus all other methods except jumping from a height and drowning, two other less forensically overt methods [30]. That study also showed note leaving was nonrandom across demographic characteristics such as age, sex, race/ethnicity, marital status, and urban residence. Finally, an Austrian study found no difference in the prevalence of note-leaving across methods of suicide or age, sex, family status, psychiatric care or motive [31]. Unlike the US, Austria is among rare countries whose suicide certification appears very accurate [32,33].
In this multilevel, multivariable study of NVDRS data for 2011–2013, we posited that a higher proportion of suicide notes in manner of death determinations involving fatal drug introxication, as compared to those involving a firearm or hanging, reflected their use as key evidence in the differential process of establishing suicide as the manner of death. This could signify stricter (i.e., more conservative) evidentiary standards when making these determinations, leading in turn to a greater potential for undercounting suicides.
We addressed two questions in our examination of the differential determination of suicide, with a view to informing and improving surveillance, etiologic understanding, and prevention of suicide and related injury mortality. Was an evidentiary note more common among suicide cases involving drug intoxication and other poisoning, less self-evident causes and manner of death, as compared to the violent methods of firearm and hanging, where apparent motivation is more overt? Did the performance of a forensic autopsy serve to mediate the association between the reporting of a note and the overtness of the suicide method? Although a forensic autopsy is not a personal window into decedent intent [34], together with toxicology it generates evidence that helps medical examiners and coroners identify injury mechanisms (i.e., causes of death) and decedent intent in suspicious or uncertain cases [35–37].
Salient to our study, forensic autopsy and toxicological testing rates vary greatly across states [38,39]. Since suicides are local events, and often socially stigmatized [40,41], we adjusted our analyses for both county-level and individual-level factors. They comprised characteristics of the medicolegal death investigations and the state-county investigation systems, decedent and areal demographics, and documented mental health antecedents and other death circumstances.
Data and methods
Individual-level data source and variables
The source for our individual-level variables was the Restricted Access Database from the NVDRS, which is administered by the Centers for Disease Control, and Prevention (CDC). This state, territory, and incident-based surveillance system employs public health informatics for making data linkages, primarily among death certificates, law enforcement records, and medical examiner and coroner records. Also variably incorporating such optional supplements as laboratory reports and hospital records, the NVDRS provides de-identified information about suicide and other violent deaths, including their geographic location, circumstances, and personal sociodemographics, in addition to investigation specifics [42–44]. Disaggregatable to county of death, the data analyzed in this study represented the 17 states that participated in the NVDRS throughout the 2011–2013 observation period. They were Alaska, Colorado, Georgia, Kentucky, Maryland, Massachusetts, New Jersey, New Mexico, North Carolina, Ohio, Oklahoma, Oregon, Rhode Island, South Carolina, Utah, Virginia, and Wisconsin. Enhancing study generalizability, these states mirrored the nation in their age and sex composition, manner-of-death distribution, and crude and age-adjusted all-cause, suicide, and undetermined intent death rates [20]. They overrepresented non-Hispanic Blacks and Whites and underrepresented Hispanics.
Our study population comprised registered suicides (ICD-10: U03, X60-X84, Y87.0), whose method and state and county of death were specified, and was further confined to decedents aged 15 years and older, since fewer than 1% of known suicides were younger. The number of decedents in our multivariable analyses totaled 32,151. As further background, our first table provides comparative data on suicide methods for the 17 NVDRS states and the US. These comparisons were based on separate counts for the selected demographic variables, not study population and corresponding national population counts. Similarity between the states and the nation would fortify the generalizability of the results. The data source was CDC WISQARS™ (Web-based Injury Statistics Query and Reporting System) [10].
The outcome variable in this study was suicide note (yes versus no or unknown). Our predictor distinguished suicide methods as follows: drug intoxication, other poisoning, jumping and drowning (combined owing to small sample size and similar corroborative challenges), hanging/suffocation, firearm (referent), and all other methods specified in the NVDRS suicide cases. Additional individual-level covariates were prior suicide attempt; primary mental diagnosis; current mental health treatment; blood alcohol concentration; number of other specified drug positives; physical health problem; number of intimate partner or legal or job or financial or school problems; crisis in past two weeks; emergency medical services at scene; region of death; age; sex; race/ethnicity; marital status; education; and military veteran status. The mediator was autopsy status (yes versus no or unknown).
County-level data sources and covariates
Linked to the individual-level data in this study, our county-level death investigation system covariates were mode of selection of the chief medical examiner or coroner for a given system (elected versus appointed) and accreditation status and type (accredited coroner, accredited medical examiner, unaccredited coroner, unaccredited medical examiner). Selection mode was identified through a CDC website [45], and accreditation status and system type through the respective websites of the relevant accrediting agencies, the National Association of Medical Examiners (NAME) [46] and the International Association of Coroners and Medical Examiners (IACME) [47]. We resolved outstanding questions by email or telephone communication with state, district, or county offices. County-level demographic covariates were urbanicity (5 categories representing the 12 ordinal categories of the 2013 Urban Influence Codes: large metropolitan/small metropolitan/metropolitan adjacent/micropolitan or adjacent/rural) and percent population below poverty as the measure of the local poverty burden. These two covariates served as proxies for external forces that potentially could inhibit or support medicolegal death investigations [48]. Their source was the County Area Health Resource File for 2014–2015 [49].
Hypotheses and statistical approach
We used a generalized linear mixed model (GLMM) to test the following two hypotheses: (1) an evidentiary suicide note is more likely to accompany suicides by drug-intoxication and by other poisoning than suicides by firearm and hanging/suffocation; and (2) performance of a forensic autopsy attenuates the observed association between overtness of method and the reported presence of a note. In testing the first hypothesis, we progressively applied four models, beginning with a univariable analysis, confined to suicide method, followed by multivariable analyses that cumulatively incorporated medicolegal system and investigation characteristics, mental health antecedents and precipitating circumstances, and decedent and areal demographics. Providing for a fifth multivariable model, we then tested our second hypothesis. The GLMM is a two-level model that is logistic at the individual level and linear at the county level. We also included a state-level random effect to incorporate the data structure of counties nested in a state and individuals nested in a county. The statistical software was SAS (Copyright(c) 2002–2010, SAS Institute Inc., Cary, NC).
Results
Table 1 describes the frequency of suicide by method across age, sex, and race/ethnicity for the NVDRS states and nationally during the observation period. Firearm, hanging, and drug intoxication were the leading methods of suicide. Generally, the states and nation showed very similar percentage distributions across age and sex, except at ages 14 years and under. The small numbers of the latter induced data instability; this age group was eliminated from our study population.
Table 1. Percent suicide by method and selected demographic characteristics: 17 National Violent Death Reporting System States and the United States, 2011–2013a.
Characteristic/ Method | Firearm | Hanging/ Suffocation | Drug Intoxication | Other Poisoning | Jumping/ Drowning | Other Methodsb |
n |
N |
||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Age (years) | NVDRS | US | NVDRS | US | NVDRS | US | NVDRS | US | NVDRS | US | NVDRS | US | NVDRS | US |
All ages | 52.3 | 51.0 | 24.4 | 24.8 | 13.2 | 13.3 | 3.1 | 3.1 | 2.6 | 3.2 | 4.2 | 4.6 | 37,909 | 121,267 |
0–14 | 18.5 | 33.7 | 53.2 | 62.2 | 0 | 2.4 | 0 | 0 | 0 | 0.8 | 28.3 | 0.8 | 314 | 993 |
15–34 | 47.0 | 45.1 | 35.1 | 35.8 | 8.6 | 8.5 | 2.0 | 2.0 | 2.3 | 3.8 | 5.0 | 4.7 | 10,809 | 33,236 |
35–54 | 47.0 | 45.3 | 25.3 | 25.9 | 16.6 | 16.8 | 3.7 | 3.8 | 2.2 | 3.2 | 5.2 | 5.0 | 14,605 | 46,249 |
55–74 | 60.2 | 58.5 | 14.0 | 14.9 | 15.1 | 15.8 | 3.3 | 3.4 | 1.5 | 2.9 | 5.9 | 4.5 | 9,422 | 30,925 |
75+ | 76.9 | 75.4 | 7.6 | 9.6 | 5.6 | 7.1 | 0.4 | 2.5 | 0 | 2.8 | 9.5 | 2.6 | 2,741 | 9,844 |
Sex | ||||||||||||||
female | 32.9 | 31.6 | 23.1 | 23.5 | 32.6 | 32.5 | 3.0 | 3.4 | 2.3 | 4.3 | 6.1 | 4.7 | 8,406 | 26,429 |
male | 57.8 | 56.4 | 24.8 | 25.2 | 7.7 | 8.0 | 3.1 | 3.0 | 2.3 | 2.9 | 4.3 | 4.5 | 29,503 | 94,838 |
Race/ethnicity | ||||||||||||||
White non-Hispanic | 53.9 | 53.6 | 22.6 | 22.2 | 13.8 | 14.1 | 3.2 | 3.2 | 2.4 | 2.7 | 4.1 | 4.2 | 32,443 | 101,011 |
Hispanic | 36.4 | 35.7 | 41.5 | 41.5 | 8.0 | 9.9 | 0 | 1.7 | 1.0 | 4.4 | 13.1 | 6.7 | 1,627 | 8,125 |
Black non-Hispanic | 49.2 | 47.8 | 26.9 | 28.4 | 7.3 | 9.2 | 1.9 | 2.3 | 0.9 | 3.6 | 13.8 | 8.7 | 2,419 | 6,951 |
Other | 34.7 | 27.6 | 40.7 | 46.0 | 5.4 | 9.8 | 0 | 3.0 | 0.8 | 6.9 | 18.4 | 6.7 | 1,332 | 4,781 |
a The data source was the Web-based Injury Statistics Query and Reporting System (WISQARS™), administered by the Centers for Disease Control and Prevention.
b Comprises both specified and unspecified suicide methods.
Bivariable frequency data on suicide notes for the study population are presented in Table 2. An authenticated suicide note was documented in 31% of the suicide cases. Consistent with our principal hypothesis, an excess prevalence of notes manifested for suicides by drug intoxication and by other poisoning, at 42% and 48%, versus 29% and 31% for firearm and hanging/suffocation suicides, respectively. Pertinent to statistical adjustments in the multivariable analyses, note prevalence reflected some marked variability by selection mode of the chief medical examiner/coroner, blood alcohol concentration, region of death, and within the sociodemographic characteristics of sex, race/ethnicity, marital status, and education.
Table 2. Prevalence of suicide notes by decedent demographics, death circumstances, and investigation system characteristics, 17 National Violent Death Reporting System States, 2011–2013.
Demographics | % | na | Circumstances | % | na | Investigation | % | na |
---|---|---|---|---|---|---|---|---|
Age (years) | Past suicide attempt | Chief medical examiner/coroner | ||||||
15–34 | 28.3 | 9,147 | yes | 34.9 | 5,858 | elected | 27.4 | 11,448 |
35–54 | 32.7 | 12,525 | no/unknown | 30.7 | 26,293 | appointed | 33.6 | 20,703 |
55–74 | 32.9 | 8,125 | Mental diagnosis | System accreditation/type | ||||
75+ | 28.3 | 2,354 | depression/dysthymia | 35.0 | 9,313 | accredited medical examiner | 34.4 | 8,479 |
Total | 31.4 | 32,151 | anxiety disorder | 38.4 | 539 | coroner | 36.6 | 1,685 |
Sex | bipolar disorder | 34.5 | 1,209 | unaccredited medical examiner | 33.2 | 12,269 | ||
male | 29.6 | 25,100 | other | 23.2 | 764 | coroner | 33.2 | 9,718 |
female | 37.8 | 7,051 | none/unknown | 29.7 | 20,326 | Method | ||
Race/ethnicity | Mental health treatment | drug intoxication | 42.2 | 4,154 | ||||
White non-Hispanic | 32.7 | 27,333 | yes | 34.2 | 9,850 | other poisoning | 48.2 | 1,014 |
Hispanic | 26.5 | 1,149 | no/unknown | 30.2 | 22,301 | firearm | 28.7 | 16,609 |
Black non-Hispanic | 19.6 | 1,691 | Physical health problem | hanging | 30.6 | 8,017 | ||
other | 26.8 | 1,978 | yes | 37.5 | 6,010 | jumping/drowning | 29.1 | 824 |
Marital status | no/unknown | 30.0 | 26,141 | all other | 25.6 | 1,533 | ||
single | 30.2 | 10,891 | Personal problems | Blood alcohol concentration | ||||
married | 29.9 | 11,344 | 0/unknown | 28.2 | 17,565 | 0.00 g/dl | 34.9 | 10,946 |
widowed/divorced/separated | 34.5 | 9,655 | 1 | 34.3 | 10,134 | 0.10–0.79 | 37.7 | 1,921 |
unknown | 31.8 | 261 | 2 | 37.8 | 3,422 | no test/unknown | 29.1 | 14,260 |
Education (years) | 3+ | 37.2 | 1,030 | > = 0.80 | 28.1 | 5,024 | ||
0–8 | 15.0 | 1,154 | Recent crisis | Other drug positive | ||||
9–12 | 25.1 | 1,704 | yes | 33.8 | 3,558 | 0 | 30.4 | 23,860 |
13+ | 33.1 | 25,216 | no/unknown | 31.1 | 28,593 | 1 | 33.7 | 4,914 |
unknown | 28.4 | 4,077 | Emergency medical services | 2 | 35.5 | 2,209 | ||
Military veteran | present at scene | 32.6 | 23,377 | 3+ | 35.8 | 1,168 | ||
yes | 31.7 | 5,795 | absent/unknown | 28.4 | 8,774 | Autopsy | ||
no/unknown | 31.4 | 26,356 | yes | 30.7 | 16,409 | |||
Region of death | no/unknown | 32.2 | 15,742 | |||||
other | 34.0 | 18,990 | ||||||
South | 27.7 | 13,161 |
a Total number of cases within each variable subcategory.
Partially affirming the principal hypothesis, the univariable analysis showed drug intoxication suicides and suicides by other poisoning were respectively 71% and 122% more likely than their referent, firearm suicides, to be associated with a note (Table 3). Neither hanging suicides, as consistent with our hypothesis, nor combined jumping and drowning suicides deviated from the referent. Findings remained robust as grouped death investigation variables (Model 2), precipitating circumstances (Model 3), and decedent and county-level demographics (Model 4) were cumulatively incorporated into the multivariable analyses. For drug intoxication suicides, percent increase in odds of a note relative to the firearm referent rose from 71% in the univariable analysis to 80% and 88%, respectively, in the multivariable analysis with application of Models 2 and 3, and diminution to 66% following addition of the demographics in Model 4. Corresponding changes were more modest for the other poisoning suicide category. However, under Models 1 and 4, percent increase in odds of a note relative to firearms was larger for other poisoning suicides than for drug intoxication suicides at 122% and 113%, respectively.
Table 3. Odds ratios and 95% confidence intervals for an evidentiary note by suicide method, cumulatively adjusted for investigation characteristics, death circumstances, and demographics, 17 National Violent Death Reporting System States, 2011–2013.
Model 1 | Model 2 | Model 3 | Model 4 | |
---|---|---|---|---|
Category/Variablea | OR (95% CI) | OR (95% CI) | OR (95% CI) | OR (95% CI) |
Suicide method | ||||
drug intoxication | 1.71 (1.60, 1.84)d | 1.80 (1.66, 1.95)d | 1.88 (1.73, 2.04)d | 1.66 (1.53, 1.81)d |
other poisoning | 2.22 (1.94, 2.52)d | 2.21 (1.94, 2.52)d | 2.25 (1.97, 2.57)d | 2.13 (1.87, 2.44)d |
jumping/drowning | 0.93 (0.79, 1.08) | 0.91 (0.78, 1.07) | 1.00 (0.86, 1.18) | 0.98 (0.83, 1.15) |
hanging | 1.04 (0.97, 1.10) | 1.04 (0.97, 1.10) | 1.05 (0.99, 1.12) | 1.07 (1.00, 1.14) |
other | 0.81 (0.72, 0.92)c | 0.81 (0.71, 0.91)c | 0.86 (0.76, 0.97)b | 0.83 (0.73, 0.94)c |
firearm | 1.00 | 1.00 | 1.00 | 1.00 |
Investigation | ||||
System accreditation/type | ||||
accredited medical examiner | 1.46 (0.90, 2.36) | 1.41 (0.90, 2.20) | 1.37 (0.93, 2.02) | |
coroner | 1.48 (1.16, 1.89)c | 1.42 (1.13, 1.78)c | 1.38 (1.12, 1.69)c | |
unaccredited medical examiner | 1.34 (0.82, 2.20) | 1.32 (0.83, 2.08) | 1.22 (0.81, 1.83) | |
coroner | 1.00 | 1.00 | 1.00 | |
Blood alcohol concentration | ||||
0.00 g dl | 1.36 (1.26, 1.46)d | 1.37 (1.27, 1.48)d | 1.39 (1.29, 1.50)d | |
0.10–0.79 | 1.50 (1.33, 1.68)d | 1.52 (1.36, 1.71)d | 1.55 (1.38, 1.74)d | |
no test/unknown | 1.20 (1.11, 1.30)d | 1.22 (1.13, 1.33)d | 1.23 (1.13, 1.33)d | |
≥ = 0.80 | 1.00 | 1.00 | 1.00 | |
Drug positives | ||||
0/no test or unknown | 1.27 (1.11, 1.46)c | 1.28 (1.12, 1.48)c | 1.33 (1.15, 1.53)d | |
1 | 1.17 (1.01, 1.34)b | 1.18 (1.02, 1.36)b | 1.21 (1.05, 1.40)c | |
2 | 1.13 (0.97, 1.31) | 1.12 (0.96, 1.30) | 1.13 (0.97, 1.32) | |
3+ | 1.00 | 1.00 | 1.00 | |
Circumstances | ||||
Mental diagnosis | ||||
depression/dysthymia | 1.09 (1.01, 1.18)b | 1.05 (0.97, 1.13) | ||
anxiety disorder | 1.21 (1.00, 1.46)b | 1.17 (0.96, 1.41) | ||
bipolar disorder | 1.04 (0.91, 1.19) | 0.99 (0.86, 1.14) | ||
other | 0.65 (0.55, 0.78)c | 0.66 (0.55, 0.79)d | ||
none/unknown | 1.00 | 1.00 | ||
Mental health treatment | ||||
yes | 1.07 (0.99, 1.15) | 1.09 (1.01, 1.18)b | ||
no/unknown | 1.00 | 1.00 | ||
Physical health problem | ||||
yes | 1.41 (1.32, 1.50)d | 1.36 (1.27, 1.46)d | ||
no/unknown | 1.00 | 1.00 | ||
Personal problems | ||||
1 | 1.34 (1.26, 1.42)d | 1.39 (1.31, 1.48)d | ||
2 | 1.51 (1.39, 1.64)d | 1.57 (1.44, 1.71)d | ||
3+ | 1.45 (1.26, 1.66)d | 1.50 (1.31, 1.48)d | ||
none/unknown | 1.00 | 1.00 | ||
Recent crisis | ||||
yes | 1.10 (1.02, 1.19)b | 1.08 (0.99, 1.17) | ||
no/unknown | 1.00 | 1.00 | ||
Demographics | ||||
Age (years) | ||||
35–54 | 1.14 (1.06, 1.22)c | |||
55–74 | 1.15 (1.06, 1.25)c | |||
75+ | 1.14 (1.00, 1.29) | |||
15–34 | 1.00 | |||
Sex | ||||
female | 1.36 (1.27, 1.45)d | |||
male | 1.00 | |||
Race/ethnicity | ||||
White non-Hispanic | 1.94 (1.71, 2.21)d | |||
Hispanic | 1.49 (1.23, 1.81)d | |||
other | 1.56 (1.32, 1.84)d | |||
Black non-Hispanic | 1.00 | |||
Marital status | ||||
single | 1.21 (1.13, 1.30)d | |||
widowed/divorced/separated | 1.21 (1.14, 1.29)d | |||
unknown | 1.28 (0.97, 1.69) | |||
married | 1.00 | |||
Education (years) | ||||
9–12 | 1.26 (1.02, 1.56)b | |||
13+ | 1.73 (1.44, 2.07)d | |||
unknown | 1.28 (0.97, 1.69) | |||
0–8 | 1.00 | |||
Military veteran | ||||
yes | 1.11 (1.03, 1.19)c | |||
no | 1.00 | |||
Region of death | ||||
other | 1.26 (1.00, 1.59) | |||
South | 1.00 | |||
County urbanicity | ||||
metropolitan large | 1.34 (1.06, 1.71) | |||
metropolitan small | 1.39 (1.11, 1.74)c | |||
metropolitan adjacent | 1.16 (0.93, 1.46) | |||
micropolitan or adjacent | 1.00 (0.73, 1.36) | |||
rural | 1.00 | |||
County poverty (%) | 0.98 (0.97, 0.99)d |
a For economy, the table excludes three variables that were incorporated in the multivariable analysis, but showed no association with the outcome variable. They were chief medical examiner/coroner selection, prior suicide attempt, and emergency medical services at death scene.
b p < 0.05
c p < 0.01
d p < 0.001
The stratified analysis supported our second hypothesis as performance of a forensic autopsy attenuated the association between suicide method and suicide note outcome (Table 4). Percent increase in odds of an evidentiary note for drug intoxication suicides, relative to firearm suicides, was 86% with no autopsy or unknown autopsy status versus 62% with autopsy. Corresponding figures for other poisoning suicides were 125% and 101%. With no autopsy or unknown autopsy status, hanging/suffocation suicides were less likely than firearm referents to be accompanied by a suicide note. Expanding Model 4 to include autopsy status showed increased percent odds of a note for drug intoxication suicides and other poisoning suicides of 70% and 112%, respectively, and a diminished effect for the residual group, all other suicide methods, compared to the firearm referent. Further inspection of the full model revealed that cases with no autopsy or with unknown autopsy status had 26% higher odds than autopsied cases of having a suicide note on record.
Table 4. Odds ratios and 95% confidence intervals for an evidentiary note by suicide method, stratified by autopsy status and unstratified, adjusted for investigation characteristics, death circumstances, and demographics, 17 National Violent Death Reporting System States, 2011–2013.
Autopsy | Full Model | ||||
---|---|---|---|---|---|
Category/Variablea | Yes | No/unknown | includes autopsy status | ||
OR (95%CI) | n | OR (95%CI) | n | OR (95%CI) | |
Suicide method | |||||
drug intoxication | 1.62 (1.45, 1.82) d | 2,866 | 1.86 (1.61, 2.14) d | 1,288 | 1.70 (1.56, 1.85) d |
other poisoning | 2.01 (1.66, 2.43) d | 512 | 2.25 (1.86, 2.72) d | 502 | 2.12 (1.85, 2.42) d |
jumping/drowning | 1.04 (0.85, 1.27) | 527 | 0.96 (0.73, 1.25) | 297 | 0.99 (0.85, 1.17) |
hanging/suffocation | 0.86 (0.73, 1.01) | 3,365 | 0.80 (0.65, 0.97) b | 4,652 | 1.04 (0.97, 1.11) |
other | 1.00 (0.91, 1.11) | 939 | 1.07 (0.98, 1.17) | 594 | 0.83 (0.74, 0.95) c |
firearm | 1.00 | 8,200 | 1.00 | 8,409 | 1.00 |
Investigation | |||||
System accreditation/type | |||||
accredited medical examiner | 1.32 (0.91, 1.90) | 5,836 | 1.80 (0.73, 4.44) | 2,643 | 1.42 (0.96, 2.10) |
accredited coroner | 1.48 (1.20, 1.82) c | 1,385 | 1.28 (0.88, 1.88) | 300 | 1.43 (1.17, 1.76) c |
unaccredited medical examiner | 1.11 (0.74, 1.65) | 3,931 | 1.79 (0.72, 4.42) | 8,338 | 1.18 (0.79, 1.77) |
unaccredited coroner | 1.00 | 5,257 | 1.00 | 4,461 | 1.00 |
Autopsy | |||||
no/unknown | 1.26 (1.18, 1.34) d | ||||
yes | 1.00 | ||||
Blood alcohol concentration | |||||
0.00 mg/dl | 1.45 (1.31, 1.61) d | 5,832 | 1.35 (1.20, 1.51) d | 5,114 | 1.39 (1.29, 1.51) d |
0.10–0.79 | 1.63 (1.41, 1.89) d | 1,236 | 1.50 (1.24, 1.80) d | 685 | 1.56 (1.39, 1.75) d |
no test/unknown | 1.28 (1.14, 1.42) d | 6481 | 1.11 (0.98, 1.26) | 7,779 | 1.20 (1.10, 1.30) d |
> = 0.80 | 1.00 | 2,860 | 1.00 | 2,164 | 1.00 |
Other drug positive | |||||
0/no test or unknown | 1.28 (1.08, 1.51) c | 10,657 | 1.24 (0.96, 1.62) | 13,203 | 1.28 (1.11, 1.47) c |
1 | 1.22 (1.03, 1.45) b | 3,328 | 1.11 (0.85, 1.46) | 1,586 | 1.19 (1.03, 1.38) b |
2 | 1.16 (0.96, 1.39) | 1,555 | 1.04 (0.77, 1.39) | 654 | 1.13 (0.96, 1.31) |
3+ | 1.00 | 869 | 1.00 | 299 | 1.00 |
Circumstances | |||||
Mental diagnosis | |||||
depression/dysthymia | 1.02 (0.92, 1.14) | 4,646 | 1.05 (0.94, 1.18) | 4,667 | 1.04 (0.96, 1.12) |
anxiety disorder | 1.12 (0.88, 1.43) | 336 | 1.22 (0.90, 1.65) | 203 | 1.17 (0.97, 1.41) |
bipolar disorder | 1.07 (0.89, 1.29) | 709 | 0.89 (0.71, 1.10) | 500 | 0.99 (0.86, 1.14) |
other | 0.68 (0.53, 0.88) c | 403 | 0.60 (0.46, 0.79) c | 361 | 0.65 (0.54, 0.78) d |
none/unknown | 1.00 | 10,315 | 1.00 | 10,011 | 1.00 |
Mental health treatment | |||||
yes | 1.08 (0.96, 1.20) | 5,095 | 1.11 (0.99, 1.24) | 4,755 | 1.09 (1.01, 1.18) b |
no/unknown | 1.00 | 1,314 | 1.00 | 10,987 | 1.00 |
Physical health problem | |||||
yes | 1.40 (1.27, 1.53) d | 3,022 | 1.31 (1.19, 1.45) d | 2,988 | 1.36 (1.27, 1.46) d |
no/unknown | 1.00 | 13,387 | 1.00 | 12,754 | 1.00 |
Personal problems | |||||
1 | 1.44 (1.33, 1.56) d | 5,338 | 1.36 (1.25, 1.48) d | 4,796 | 1.40 (1.32, 1.48) d |
2 | 1.72 (1.53, 1.94) d | 1,804 | 1.44 (1.27, 1.62) d | 1,618 | 1.58 (1.45, 1.72) d |
3+ | 1.60 (1.31, 1.94) d | 540 | 1.42 (1.16, 1.74) c | 490 | 1.51 (1.31, 1.74) d |
none/unknown | 1.00 | 8,727 | 1.00 | 8,838 | 1.00 |
Demographics | |||||
Age (years) | |||||
35–54 | 1.21 (1.09, 1.33) c | 4,780 | 1.06 (0.96, 1.18) | 4,367 | 1.13 (1.06, 1.22) c |
55–74 | 1.24 (1.10, 1.39) c | 6,540 | 1.06 (0.94, 1.20) | 5,985 | 1.15 (1.05, 1.24) c |
75+ | 1.17 (0.98, 1.41) | 4,097 | 1.07 (0.90, 1.27) | 4,028 | 1.12 (0.99, 1.27) |
15–34 | 1.00 | 992 | 1.00 | 1,362 | 1.00 |
Sex | |||||
female | 1.41 (1.29, 1.54) d | 4,035 | 1.33 (1.21, 1.46) d | 3,016 | 1.37 (1.28, 1.46) d |
male | 1.00 | 12,374 | 1.00 | 12,726 | 1.00 |
Race/ethnicity | |||||
White non-Hispanic | 2.18 (1.85, 2.59) d | 13,557 | 1.55 (1.26, 1.90) d | 13,776 | 1.92 (1.68, 2.18) d |
Hispanic | 1.67 (1.32, 2.13) d | 798 | 1.22 (0.89, 1.67) | 351 | 1.48 (1.23, 1.79) d |
other | 1.82 (1.46, 2.27) d | 943 | 1.22 (0.95, 1.56) | 1,035 | 1.53 (1.30, 1.81) d |
Black non-Hispanic | 1.00 | 1,111 | 1.00 | 580 | 1.00 |
Marital status | |||||
single | 1.25 (1.14, 1.38) d | 5,780 | 1.17 (1.05, 1.29) c | 5,111 | 1.21 (1.13, 1.30) d |
widowed/divorced/separated | 1.19 (1.09, 1.30) d | 4,864 | 1.24 (1.14, 1.35) d | 4,791 | 1.21 (1.14, 1.29) d |
unknown | 1.21 (0.84, 1.74) | 154 | 1.38 (0.89, 2.11) | 107 | 1.30 (0.99, 1.72) |
married | 1.00 | 5,611 | 1.00 | 5,733 | 1.00 |
Education (years) | |||||
9–12 | 1.24 (0.93, 1.66) | 872 | 1.32 (0.97, 1.79) | 832 | 1.26 (1.02, 1.55) b |
13+ | 1.64 (1.28, 2.11) d | 12,816 | 1.88 (1.45, 2.44) d | 12,400 | 1.72 (1.44, 2.07) d |
unknown | 1.56 (1.17, 2.08) c | 2,180 | 1.98 (1.47, 2.66) d | 1,897 | 1.75 (1.42, 2.15) d |
0–8 | 1.00 | 541 | 1.00 | 613 | 1.00 |
Military veteran | |||||
yes | 1.09 (0.98, 1.20) | 2,789 | 1.12 (1.02, 1.24) b | 13,620 | 1.11 (1.03, 1.19) c |
no/unknown | 1.00 | 3,006 | 1.00 | 12,736 | 1.00 |
Region of death | |||||
other | 1.16 (0.92, 1.47) | 10,315 | 1.29 (1.00, 1.66) b | 8,675 | 1.26 (1.01, 1.59) b |
South | 1.00 | 6,094 | 1.00 | 7,067 | 1.00 |
County urbanicity | |||||
metropolitan large | 1.47 (1.06, 2.03) b | 7,830 | 1.16 (0.83, 1.63) | 5,964 | 1.35 (1.06, 1.71) b |
metropolitan small | 1.51 (1.11, 2.07) c | 5,674 | 1.21 (0.88, 1.66) | 5,810 | 1.38 (1.10, 1.73) c |
metropolitan adjacent | 1.22 (0.89, 1.68) | 2,350 | 1.08 (0.79, 1.48) | 3,261 | 1.15 (0.92, 1.45) |
micropolitan or adjacent | 0.83 (0.52, 1.31) | 242 | 1.08 (0.71, 1.64) | 339 | 0.98 (0.72, 1.34) |
rural | 1.00 | 313 | 1.00 | 368 | 1.00 |
County poverty (%) | 0.99 (0.98, 1.00) b | 16,409 | 0.96 (0.95, 0.98) d | 15,742 | 0.98 (0.97, 0.99) d |
aFor economy, the table excludes four variables that were incorporated in the multivariable model, but showed no association with the outcome variable. They were chief medical examiner/coroner selection, prior suicide attempt, recent crisis, and emergency medical services at death scene.
b p < 0.05
c p < 0.01
d p < 0.001
Discussion
Our findings caution users against uncritically taking suicide and other official data at face value. Under-ascertainment means suicide undercounting. Indicative of differential undercounting by method, increased odds of a suicide note manifested both for cases of suicides by drug intoxication and by other poisoning relative to their referent, firearm cases, as consonant with the first hypothesis concerning the relative violence and forensic overtness of methods. Hanging suicides did not deviate from the referent, nor did the combined category of jumping and drowning suicides. The observed note excess for both drug-intoxication and other poisoning suicides persisted through application of each of the multivariable models, including the full multilevel, multivariable model that incorporated autopsy status.
The study implication of growing suicide misclassification and suicide undercounting among drug intoxication deaths assumes added importance as an impediment to prevention in the face of the burgeoning opioid mortality epidemic [50] and severely under-resourced and overburdened emergency healthcare [51,52] and death investigation systems [53,54]. Although plausibly a gross underestimate, at 1.62 per 100,000 population, the drug intoxication suicide rate was 41% higher in 2015 than in 2000 [10]. However, suicides involving such poisons as gases, vapors, metals, pesticides, and household cleaners have remained relatively less common. At 0.50 per 100,000, the rate of non-drug poisoning suicides in 2015 was 12% lower than the rate in 2000. Moreover, determination of intent in the non-drug poisoning cases often rests on the unmistakable actions required to use these suicide methods (e.g., carbon monoxide poisoning where the decedent was found in a car with a hose from the tailpipe to the passenger compartment, windows sealed with duct tape, ignition key in the on position, and the gas tank empty), which diminishes the potential ambiguity they pose for medical examiners and coroners. On the other hand, the literature provides no evidence drug intoxication suicides are more planned and less impulsive than suicides by more overtly violent methods.
As hypothesized, performance of a forensic autopsy attenuated the observed associations between overtness of suicide method and odds of an evidentiary suicide note. Although an autopsy can help investigators identify the mechanism or cause of an injury death, it does not invariably enlighten decedent intentionality [55]. Indeed, performance of an autopsy diminished but did eliminate the note-effect we found when comparing mechanisms of deaths in the manner of death determination. Presence of a suicide note, similar to the effect of an overt suicide method, may even reduce autopsy occurrence [56]. During 2007, 97% of US homicides were autopsied compared with 60% of suicides, 81% of undetermined intent deaths, and 79% of unintentional (accidental) poisoning deaths, pointing to a less rigorous approach to suicide versus homicide determination and accounting [57].
The US National Association of Medical Examiners (NAME) Forensic Autopsy Performance Standards require an autopsy when “the death is by apparent intoxication by alcohol, drugs, or poison, unless a significant interval has passed, and the medical findings and absence of trauma are well documented” [58]. NAME does not require autopsy in other suicidal deaths where the cause is externally manifest (e.g., gunshot wound or hanging) and instead leaves autopsy performance to the discretion of the pathologist, if it is “necessary to determine cause or manner of death, or document injuries/disease, or collect evidence.” While this standard is expected for medical examiners, who work in some states, it does not apply to elected coroners–the norm for many states. Other jurisdictions have both coroners and medical examiners, varying by counties [39].
By comparison with the US, Finnish medicolegal authorities conducted forensic autopsies in 99% of suicides, 98% of homicides, 98% of unintentional poisoning deaths, and 97% of undetermined deaths in the period 2000–2003 [59]. Researchers viewed a lower autopsy rate and greater use of ill-defined and unknown cause-of-death codes as especially problematic for the quality of Danish suicide and other manner-of-death statistics relative to those of Finland [60,61]. During the period 1998–2007, Finland and Denmark had annualized suicide rates of 20 and 12 per 100,000 population, respectively [62]. Corresponding combined clinical and forensic autopsy rates for total deaths were 31% and 8%. This gap—as a plausible indicator of different standards of thoroughness in medicolegal death investigations [63]—may mean there is an artifactual component in the differential in suicide rates between these two Scandinavian countries. However, substantive factors contributing to a higher rate in Finland might include variable alcohol consumption and firearm ownership between Finland and Denmark.
More generally implicating an artifactual component in suicide rates and rate variation, an ecological or correlational study of 35 Eurasian countries reported spatial and temporal associations between the respective magnitudes of the combined clinical and forensic autopsy rate and the suicide rate [62]. Spatially or cross-sectionally, a 1% difference in autopsy rates was associated with a suicide rate difference of 0.49 per 100,000 population, and temporally or longitudinally a 1% decrease in the autopsy rate with a suicide rate decrease of 0.42 per 100,000.
Our research, examining registered or known suicides, complements another multilevel (individual/county), multivariable study which used NVDRS data from the same observation period to predict differential odds that suicides pooled with deaths of undetermined intent, included as possible suicides, would be classified by medical examiners and coroners as suicide if there was documentation of a suicide note and mental health antecedents [20]. One hypothesis in the complementary study addressed the association between an evidentiary suicide note and suicide classification. Underscoring a pivotal role an authenticated note can play in separating suicide from undetermined cases, presence was associated with 34-fold increased odds of a suicide classification. In addition, combined firearm and hanging/suffocation deaths showed 42-fold increased odds of a suicide classification relative to drug intoxication deaths or, alternatively expressed, 98% lower odds of an undetermined classification. Drug intoxication cases with an evidentiary note were 45 times more likely to be classified as suicide compared to corresponding cases with no note or unknown note status, and eight times more likely in firearm and hanging cases. A relative strength of the current multilevel study, since it focused on suicides rather than suicides and undetermined deaths, was greater granularity and specificity of suicide methods or injury causes/mechanisms than in the comparative NVDRS study.
Based on medicolegal and police investigations, which often involve family and friends of the decedent, NVDRS data are vulnerable to reporter bias, especially among persons who are ashamed or embarrassed by what transpired. This deficiency also may reflect a lack of willingness of investigators to collect data about decedent background and circumstances when suicide is readily apparent as the manner of death, or when as an elected local official, coroners are reluctant to probe potentially sensitive personal issues. Our study and the complementary NVDRS investigation jointly reveal a need for qualitative as well as quantitative research on whether family and friends of the decedents variably destroy or otherwise conceal suicide notes, and withhold other potential corroborative evidence from authorities. The field now would benefit from mixed methods investigations that integrate psychological autopsies, focus groups, surveys, sociocultural autopsies, content analysis, and thematic analysis to examine values and attitudes towards suicide that may continue to influence its reporting. Although high quality data regarding suicides are essential for planning, implementing, and evaluating suicide prevention programs, few resources have been devoted to improving fundamental data quality. Without such rigor, it will be difficult to accept the validity of future efforts to reduce suicide rates.
The enriched Restricted Access Database of the NVDRS provides the only population-based data in the US appropriate for evaluating our research questions about the relationship between suicide methods, a forensic autopsy, and an evidentiary suicide note. Besides reporter bias, a limitation of this study was restriction of the geographic domain to the 17 states that contributed data to the NVDRS throughout the observation period, 2011–2013. Nevertheless, high demographic concordance between these states and the nation [20] tempers our concern about reduced generalizability of study findings, which additionally is a by-product of system protocols that emphasize uniform definitions of manner of death and consistent data collection, entry, review, and coding [44]. Moreover, the similarity in the distribution of suicides by method across age, sex, and race/ethnicity, between the NVDRS states and the nation, enhanced our confidence in study generalizability. Since our observation period, the NVDRS has expanded to 40 states, the District of Columbia, and Puerto Rico, with a goal to cover all 50 states and the territories [64]. Further study limitations included the indirect nature of our assessment of differential suicide data quality by method, confinement of our study population to suicides whose death circumstances were captured by the NVDRS and whose methods were specified, and our inability to factor in medicolegal use of a computerized tomography scan in lieu of a forensic autopsy. Other limitations and strengths of the NVDRS have been reported [20,44,65–67].
Conclusions
Suicide requires substantial affirmative evidence to establish manner of death, and affirmation of drug intoxication suicides appears to demand an especially high burden of proof. Findings and their implications argue for more stringent investigative standards, better training, and more resources to support accurate and comprehensive case ascertainment, as the foundation for developing evidence-based suicide prevention initiatives.
Data Availability
Data are available from NVDRS Science Officer, Centers for Disease Control and Prevention for researchers who meet the criteria for access to confidential data. https://www.cdc.gov/violenceprevention/nvdrs/RAD.html
Funding Statement
This research was supported by Grants R49CE002109 and R49CE002093 from the National Center for Injury Prevention and Control of the Centers for Disease Control and Prevention. They provided salary support for three authors (IRHR, EDC, HJ) and consulting fees for another (SS). The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or decision to submit the manuscript for publication.
References
- 1.Rockett IRH, Regier MD, Kapusta ND, Coben JH, Miller TR, Hanzlick RL, et al. Leading causes of unintentional and intentional injury mortality: United States, 2000–2009. Am J Public Health 2012; 102(11): e84–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Fisher DJ. Equivocal cases of teenage suicide. 2000; 9(9–10): 24–27. [Google Scholar]
- 3.Timmermans S. Suicide determination and the professional authority of medical examiners. 2005; 70(2): 311–333. [Google Scholar]
- 4.Stone DM, Holland KM, Bartholow B, Logan JE, LiKamWa McIntosh W, Trudeau A, et al. Deciphering suicide and other manners of death associated with drug intoxication: a Centers for Disease Control and Prevention consultation meeting summary. 2017; August; 107(8): 1233–1239. doi: 10.2105/AJPH.2017.303863 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Goldsmith SK, Pellmar TC, Kleinman AM, Bunney WEE. Reducing suicide: a national imperative. Washington, DC: National Academies Press, 2002. [PubMed] [Google Scholar]
- 6.O'Carroll PWA. A consideration of the validity and reliability of suicide mortality data. 1989; 19: 1–16. [DOI] [PubMed] [Google Scholar]
- 7.Rockett IRH. Counting suicides and making suicide count as a public health problem. 2010; 31(5): 227–230. http://www.iasp.info/pdf/journal/2010_rockett_counting_suicides.pdf doi: 10.1027/0227-5910/a000071 [DOI] [PubMed] [Google Scholar]
- 8.Warshauer ME, Monk M. Problems in suicide statistics for whites and blacks. 1978; 68: 383–388. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Platt S, Backett S, Kreitman N. Social construction or causal ascription: distinguishing suicide from undetermined deaths. 1988; 23: 217–221. [DOI] [PubMed] [Google Scholar]
- 10.Centers for Disease Control and Prevention. Web-based Injury Statistics Query and Reporting System, 2017. http://www.cdc.gov/ncipc/wisqars/
- 11.Ovenstone IMK. A psychiatric approach to the diagnosis of suicide and its effect upon the Edinburgh statistics. 1973; 123: 15–21. [DOI] [PubMed] [Google Scholar]
- 12.Breiding MJ, Wiersema B. Variability of undetermined manner of death classification in the US. 2006; 12 Suppl 2: ii49–ii54. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Donaldson AE, Larsen GY, Fullerton-Gleason L, Olson LM. Classifying undetermined poisoning deaths. 2006; 12: 338–343. doi: 10.1136/ip.2005.011171 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Rockett IRH, Wang S, Stack S, De Leo D, Frost JL, Ducatman AM, et al. Race/ethnicity and potential suicide misclassification: window on a minority suicide paradox? 2010; 10:35 http://www.biomedcentral.com/content/pdf/1471-244x-10-35.pdf doi: 10.1186/1471-244X-10-35 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Byard RW, Heath KJ. Suicide notes, age and the impact of suicide guides. 2007; 13: 10–11. [Google Scholar]
- 16.Parai JL, Krieger N, Tomlinson G, Adlaf EM. The validity of the certification of manner of death by Ontario coroners. 2006; 16(11): 805–811. doi: 10.1016/j.annepidem.2006.01.006 [DOI] [PubMed] [Google Scholar]
- 17.Stone DH, Chishti P, Roulston C. Final report of the European review of suicide and violence epidemiology (EUROSAVE) Project, 2002 http://ec.europa.eu/health/ph_projects/1999/injury/fp_injury_1999_frep_10_en.pdf
- 18.Nelson FL, Farberow NL, MacKinnon DR. The certification of suicide in eleven western states: an inquiry into the validity of reported suicide rates. 1978; 8(2): 75–88. [PubMed] [Google Scholar]
- 19.Centers for Disease Control and Prevention (CDC). Homicides and suicides—National Violent Death Reporting System, United States, 2003–2004. 2006; 55(26): 721–4. [PubMed] [Google Scholar]
- 20.Rockett IRH, Caine ED, Connery HS, D’Onofrio G, Gunnell DJ, Miller TR, et al. Discerning suicide in drug intoxication deaths: paucity and primacy of suicide notes and psychiatric history. 2018; January 10;13(1):e0190200 http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0190200 doi: 10.1371/journal.pone.0190200 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Linsley KR, Schapira K, Kelly TP. Open verdict v. suicide: importance to research. 2001; 178: 465–468. [DOI] [PubMed] [Google Scholar]
- 22.Palmer BS, Bennewith O, Simkin S, Cooper J, Hawton K, Kapur N, et al. Factors influencing coroners' verdicts: an analysis of verdicts given in 12 coroners' districts to researcher-defined suicides in England in 2005. 2015; 37(1): 157–165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Cooper PN, Milroy CM. The coroner’s system and underreporting of suicide. 1995; 35: 319–326. doi: 10.1177/002580249503500409 [DOI] [PubMed] [Google Scholar]
- 24.Jougla E, Pequignot F, Chappert J, Rossollin F, Le Toullec A, Pavillon G, et al. 2002; 50: 49–52 [in French]. [PubMed] [Google Scholar]
- 25.Ohberg A, Lonnqvist J. Suicides hidden among undetermined deaths. 1998; 98(3): 214–218. [DOI] [PubMed] [Google Scholar]
- 26.Huguet N, Kaplan MS, McFarland BH. Rates and correlates of undetermined deaths among African Americans: results from the National Violent Death Reporting System. 2012; 42(2): 185–96. doi: 10.1111/j.1943-278X.2012.00081.x [DOI] [PubMed] [Google Scholar]
- 27.Cohen SL, Feidler JE. Content analysis of multiple messages in suicide notes. 1974; 4: 75–95. [Google Scholar]
- 28.Tuckman J, Kleiner RJ, Lavell M. Emotional content of suicide notes. 1959; 116: 59–63. doi: 10.1176/ajp.116.1.59 [DOI] [PubMed] [Google Scholar]
- 29.Callanan VJ, Davis MS. A comparison of suicide note writers with suicides who did not leave notes. 2009; 39: 558–568. doi: 10.1521/suli.2009.39.5.558 [DOI] [PubMed] [Google Scholar]
- 30.Stack S, Rockett IRH. Are suicide note writers representative of all suicides? Analysis of the National Violent Death Reporting System. 2018; 48(1): 12–20. doi: 10.1111/sltb.12320 [DOI] [PubMed] [Google Scholar]
- 31.Eisenwort B, Berzlanovich A, Willinger U, Eisenwort G, Lindorfer S, Sonneck G, et al. Suicide notes and their importance to suicide research. The representativeness of suicide note writers. 2006; 77(11): 1355–1356, 1358–1360,1362 [in German]. doi: 10.1007/s00115-005-1965-y [DOI] [PubMed] [Google Scholar]
- 32.Rockett IRH, Thomas BM. Reliability and sensitivity of suicide certification in higher-income countries. 1999; 29: 141–149. [PubMed] [Google Scholar]
- 33.Värnik P, Sisask M, Värnik A, Arensman E, Van Audenhove C, van der Feltz-Cornelis CM, et al. Validity of suicide statistics in Europe in relation to undetermined deaths: developing the 2–20 benchmark. 2012; 18(5): 321–325. doi: 10.1136/injuryprev-2011-040070 [DOI] [PubMed] [Google Scholar]
- 34.Acinas MP, Robles JI, Peláez-Fernández MÁ. Suicide note and the psychological autopsy: associated behavioral aspects. 2015; 43(3): 69–79. [PubMed] [Google Scholar]
- 35.Croft PR, Lathrop SL, Zumwalt RE. Amended cause and manner of death certification: a six-year review of the New Mexico experience. 2006; 51(3): 651–656. doi: 10.1111/j.1556-4029.2006.00128.x [DOI] [PubMed] [Google Scholar]
- 36.Shields LBE, Hunsaker DM, Hunsaker JC, Ward MK. Toxicologic findings in suicide. A 10-year retrospective review of Kentucky medical examiner cases. 2006; 27(2): 106–112. doi: 10.1097/01.paf.0000220913.19508.99 [DOI] [PubMed] [Google Scholar]
- 37.Hoyert DL, Kung HC, Xu J. Autopsy patterns in 2003. 2007; 20(32): 1–27. [PubMed] [Google Scholar]
- 38.Karch D, Crosby A, Simon T. Toxicology testing and results for suicide victims—13 states, 2004. 2006; 55(46): 1245–1248. [PubMed] [Google Scholar]
- 39.Hanzlick R. A perspective on medicolegal death investigation in the United States: 2013. 2014; 4(1): 2–9. [Google Scholar]
- 40.Scourfield J, Fincham B, Langer S, Shiner M. Sociological autopsy: an integrated approach to the study of suicide in men. 2012; 74(4): 466–473. doi: 10.1016/j.socscimed.2010.01.054 [DOI] [PubMed] [Google Scholar]
- 41.Neuilly MA. Putting the public back in public health: an argument for the articulation of fatality reviews and coroners’ inquests. 2013; 17(4): 339–352. [Google Scholar]
- 42.Paulozzi LJ, Mercy J, Frazier L Jr, Annest JL; Centers for Disease Control and Prevention. CDC's National Violent Death Reporting System: background and methodology. 2004; 10(1): 47–52. doi: 10.1136/ip.2003.003434 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Steenkamp M, Frazier L, Lipskiy N, Deberry M, Thomas S, Barker L, et al. The National Violent Death Reporting System: an exciting new tool for public health surveillance. 2006; 12 Suppl 2: ii3–ii5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Blair JM, Fowler KA, Jack SP, Crosby AE. The National Violent Death Reporting System: overview and future directions. 2016; 65(10): 1–42. doi: 10.15585/mmwr.ss6510a1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Centers for Disease Control and Prevention, 2015. Public Health Law Program. Coroner/Medical Examiner Laws by State https://www.cdc.gov/phlp/publications/topic/coroner.html
- 46.National Association of Medical Examiners, 2017. https://netforum.avectra.com/eweb/DynamicPage.aspx?Site=NAME&WebCode=OrgSearch
- 47.International Association of Coroners & Medical Examiners, 2017. http://www.theiacme.com/accreditation.
- 48.Waldhoer T, Berzlanovich A, Vutuc C, Haidinger G. Rates of postmortem examination in Austria: the effect of distance between location of death and site of examination. 2003; 56(9): 891–895. [DOI] [PubMed] [Google Scholar]
- 49.Health Resources and Services Administration, Bureau of Health Workforce, National Center for Health Workforce Analysis. . Rockville: US Department of Health and Human Services, Health Resources and Services Administration; 2015. [Google Scholar]
- 50.Hedegaard H, Warner M, Minino AM. Drug overdose deaths in the United States, 1999–2015. 2017; 273: 1–8. [PubMed] [Google Scholar]
- 51.Institute of Medicine. Emergency medical services at the crossroads Washington, DC: The National Academies Press; 2006. [Google Scholar]
- 52.Institute of Medicine. Hospital-based emergency care: at the breaking point Washington, DC: The National Academies Press; 2006. [Google Scholar]
- 53.Institute of Medicine; Board on Health Promotion and Disease Prevention; Committee for the Workshop on the Medicolegal Death Investigation System. Medicolegal death investigation system: workshop summary. Washington, DC: The National Academies Press; 2003. [PubMed] [Google Scholar]
- 54.Committee on Identifying the Needs of the Forensic Science Community; Committee on Science, Technology, and Law Policy and Global Affairs; Committee on Applied and Theoretical Statistics; Division on Engineering and Physical Sciences. Strengthening forensic science in the United States: a path forward. Washington, DC: The National Academies Press; 2009. [Google Scholar]
- 55.Sorenson SB, Shen H, Kraus JF. Undetermined manner of death. A comparison with unintentional injury, suicide, and homicide death. 1997; 21(1): 43–57. doi: 10.1177/0193841X9702100103 [DOI] [PubMed] [Google Scholar]
- 56.Carpenter BJ, Tait G, Barnes M, Adkins G, Naylor C, Begum N. Increasing the information available to coroners: the effect on autopsy decision making. 2009; 49(2): 101–109. doi: 10.1258/rsmmsl.49.2.101 [DOI] [PubMed] [Google Scholar]
- 57.Hoyert DL. The changing profile of autopsied deaths in the United States, 1972–2007. 2011; (67): 1–8. http://www.cdc.gov/nchs/data/databriefs/db67.pdf [PubMed] [Google Scholar]
- 58.National Association of Medical Examiners. Forensic Autopsy Performance Standards, September 12, 2016. https://netforum.avectra.com/public/temp/ClientImages/NAME/684b2442-ae68-4e64-9ecc-015f8d0f849e.pdf [DOI] [PubMed]
- 59.Lunetta P, Lounamaa A, Sihvonen S. Surveillance of injury-related deaths: medicolegal autopsy rates and trends in Finland. 2007; 13(4): 282–284. doi: 10.1136/ip.2006.012922 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Ylijoki-Sørensen S, Boldsen JL, Boel LW, Bøggild H, Lalu K, Sajantila A. Autopsy rate in suicide is low among elderly in Denmark compared with Finland. 2014; 244: 158–165. doi: 10.1016/j.forsciint.2014.08.035 [DOI] [PubMed] [Google Scholar]
- 61.Ylijoki-Sørensen S, Sajantila A, Lalu K, Bøggild H, Boldsen JL, Boel LW. Coding ill-defined and unknown cause of death is 13 times more frequent in Denmark than in Finland. 2014; 244: 289–294. doi: 10.1016/j.forsciint.2014.09.016 [DOI] [PubMed] [Google Scholar]
- 62.Kapusta ND, Tran US, Rockett IRH, De Leo D, Naylor CP, Niederkrotenthaler T, et al. Declining autopsy rates and suicide misclassification: a cross-national analysis of 35 countries. 2011; 68(10): 1050–1057. http://archpsyc.jamanetwork.com/article.aspx?articleid=1107298 doi: 10.1001/archgenpsychiatry.2011.66 [DOI] [PubMed] [Google Scholar]
- 63.Shojania KG, Burton EC, McDonald KM, Goldman L. Changes in rates of autopsy-detected diagnostic errors over time: a systematic review. 2003; 289(21): 2849–2856. doi: 10.1001/jama.289.21.2849 [DOI] [PubMed] [Google Scholar]
- 64.Centers for Disease Control and Prevention. National Center for Injury Prevention and Control. National Violent Death Reporting System. www.cdc.gov/violenceprevention/nvdrs/.
- 65.Logan JR, Karch DL, Crosby AE. Reducing “unknown” data in violent death surveillance: study of death certificates, coroner/medical examiner and police reports from the National Violent Death Reporting System, 2003–2004. 2009; 13(4): 385–397. [Google Scholar]
- 66.Parks SE, Johnson LL, McDaniel DD, Gladden M; Centers for Disease Control and Prevention (CDC). Surveillance for violent deaths—National Violent Death Reporting System, 16 states, 2010. 2014; 63(1): 1–33. [PubMed] [Google Scholar]
- 67.Kaplan MS, Caetano R, Giesbrecht N, Huguet N, Kerr WC, McFarland BH, et al. The National Violent Death Reporting System: Use of the Restricted Access Database and recommendations for the system’s improvement. 2017; 52(4): 130–133. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data are available from NVDRS Science Officer, Centers for Disease Control and Prevention for researchers who meet the criteria for access to confidential data. https://www.cdc.gov/violenceprevention/nvdrs/RAD.html