Skip to main content
HHS Author Manuscripts logoLink to HHS Author Manuscripts
. Author manuscript; available in PMC: 2018 Feb 1.
Published in final edited form as: Ann Emerg Med. 2016 Dec 18;69(2):227–240. doi: 10.1016/j.annemergmed.2016.08.454

A Consensus-Driven Agenda for Emergency Medicine Firearm Injury Prevention Research

Megan L Ranney 1, Jonathan Fletcher 2, Harrison Alter 3, Christopher Barsotti 4, Vikhyat S Bebarta 5, Marian E Betz 5, Patrick M Carter 6, Magdalena Cerdá 7, Rebecca M Cunningham 8, Peter Crane 9, Jahan Fahimi 10, Matthew J Miller 11, Ali Rowhani-Rahbar 12, Jody A Vogel 13, Garen J Wintemute 7, Manish N Shah 14, Muhammad Waseem 15; ACEP Technical Advisory Group on Firearm Injury Research, a Subcommittee of the ACEP Research Committee
PMCID: PMC5272847  NIHMSID: NIHMS839661  PMID: 27998625

Abstract

Objective

To identify critical Emergency Medicine (EM)-focused firearm injury research questions and to develop an evidence-based research agenda.

Methods

National content experts were recruited to a technical advisory group for the American College of Emergency Physicians Research Committee. Nominal Group Technique (NGT) was used to identify research questions by consensus. The technical advisory group decided to focus on five widely accepted categorizations of firearm injury. Subgroups conducted literature reviews on each topic and developed preliminary lists of EM-relevant research questions. In-person meetings and conference calls were held to iteratively refine the extensive list of research questions, following NGT guidelines. Feedback from external stakeholders was reviewed and integrated.

Results

Fifty-nine final EM-relevant research questions were identified, including questions that cut across all firearm injury topics and questions specific to self-directed violence (suicide and attempted suicide); intimate partner violence; peer (non-partner) violence; mass violence; and unintentional (“accidental”) injury. Some questions could be addressed through research conducted in emergency departments (EDs); others would require work in other settings.

Conclusions

The technical advisory group identified key EM-relevant firearm injury research questions. EM-specific data is limited for most of these questions. Funders and researchers should consider increasing their attention to firearm injury prevention and control, particularly to the questions identified here and in other recently developed research agendas.

INTRODUCTION

Background

In the United States, firearms caused 114,633 injuries in 2014 alone. Of these, 81,034 were nonfatal.1 The remainder were fatal injuries: 10,945 homicides (70% of all homicides), 21,334 suicides (50% of all suicide deaths), and the remainder due to unintentional, undetermined, or legal intervention.2 Firearms are the second leading cause of death among U.S. youth (14–24), the primary cause of death among African-American youth,3 and the most common method of suicide deaths.4

Nonfatal firearm-related injuries have long-term consequences. They increase risk of future violent victimization and death, crime perpetration, and subsequent firearm violence; they are also associated with high rates of physical disability and mental illness, both among victims and bystanders.59 The costs associated with firearm violence, injury, and death are substantial: an estimated $630 million per year is spent on acute medical care alone, and significantly more on lost wages, long-term care, and legal proceedings.10

Relative to the burden of disease, there has been far too little high-quality firearm injury prevention and control research. In 2013, the Obama administration directed federal agencies to identify barriers to this research.11 Despite specific recommendations from the Institute of Medicine and the National Research Council, research to reduce the burden of firearm-related injury and death is still lacking; as of the time of writing, no funds have been appropriated to the U.S. Centers for Disease Control and Prevention for research on firearm injury prevention and control.1217

Importance

The initial evaluation and treatment of firearm injuries occurs routinely in the emergency department (ED).18 Despite the significant health effects of firearm injuries, emergency medicine’s (EM) well-established responsibility to care for patients suffering from these injuries, EM’s history of leadership in injury prevention research, and ACEP’s explicit endorsement of firearm injury prevention,19, 20 only limited rigorous, EM-focused firearm injury research exists.

In 2014, The American College of Emergency Physicians (ACEP) Board of Directors tasked the ACEP Research Committee with developing an evidence-based agenda for EM firearm injury research. Primary goals included reviewing existing firearm research, identifying gaps in the research, and using rigorous consensus techniques to develop a research agenda. Our report explicitly differs from firearm injury research agendas proposed by the Institute of Medicine,12 by focusing on pressing clinical and preventive questions relevant to emergency medicine.

Goals of this Investigation

A technical advisory group for the ACEP Research Committee used Nominal Group Technique to develop an EM-focused firearm injury prevention research agenda. The group considered both research to be done in EDs, and EM-relevant research of other types. The objective of this manuscript is to present the consensus research agenda that resulted from the Committee’s work.

METHODS

Study Design and Setting

We recruited a technical advisory group of national content experts and used Nominal Group Technique (NGT) to identify critical EM-focused firearm injury research questions.21, 22

Selection of Participants

Between November 2014 and January 2015, we identified a technical advisory group based on previously published firearm injury prevention research, association with professional societies involved with EM-related injury prevention studies, and personal recommendations from leading researchers in the field. Our goal was to assemble a group of content experts, with a consolidated focus on public health research and management of firearm-related injuries. The final group consisted of 27 members (complete list in Appendix 1).

Consensus Methods

We used the widely accepted NGT to develop actionable, consensus-based research questions. The NGT is a systematized method for collecting data and developing consensus in a small-group setting, by recruiting content experts closely associated with a topic.21, 22 NGT involves four steps: 1) idea generation, 2) round-robin presentation of ideas and further idea generation, 3) structured discussion and clarification of ideas (at which time, ideas are checked for duplication and groupings are made), 4) ranking of preferred ideas, resulting in a prioritized list.2123

NGT was chosen over other consensus approaches, such as the Delphi Technique, because the ultimate goal was a list of research questions, not necessarily a convergence of opinion.21, 24 It facilitates the generation of a greater number of ideas than traditional group discussions. It also balances the influence of individuals, so no individual can have excessive influence, limiting group process biases. Finally, the NGT results in a prioritized list, a goal of our work2426.

The group and process were specifically structured to address potential limitations to the technique.22 NGT requires an experienced team leader; both chairs had used the technique previously. 2729 It requires group members to participate in highly structured meetings over a period of time; all TAG members were consistently involved with the process. Expert bias may exist, but one of the chairs (MNS) lacked expertise in this specific topic and focused more on the process, thereby limiting this bias. Potential bias by dominant individuals was purposefully minimized through use of the round-robin technique and by purposeful solicitation of opinions from less vocal group members.

The advisory group participated in 5 conference calls and 2 consensus-generating meetings from January 2015 to January 2016. The advisory group chairs (MLR, MNS) moderated each session. Written minutes were kept by ACEP staff.

Process and Outcomes

Phase One: Structuring the Process

Our first objective was to structure the consensus process. The group elected to focus on five widely accepted categorizations of firearm injury: self-directed violence (suicide and attempted suicide); intimate partner violence; peer (non-partner) violence; mass violence; and unintentional (“accidental”) injury.30 Subgroups of up to five members were assigned to each topic. The Haddon Matrix, a common injury prevention research model, was used to structure each subgroup’s initial work.31

Phase Two: Generation, Discussion, and Iterative Refinement of Questions

Each subgroup conducted a literature review on its topic and developed a preliminary list of research questions guided by The Haddon Matrix. During the first in-person session, each subgroup delivered an initial list of research ideas; a round-robin process was then used during which all group members proposed additional research questions. Additional conference calls were then held to iteratively refine the extensive list of research questions. Throughout, input was actively solicited from those group members who missed any given session. During this phase, the group noted that certain questions were common among multiple types of injury; thus, the group separated out a category of “cross cutting” questions.

Phase Three: Finalization

We used a two-phase voting process. The first step involved an internal online rank-order system that group members used to establish priority. The mean priority values for each question set and individual questions within each set were calculated. The members established consensus by eliminating questions that met predetermined criteria, specifically those questions that fell greater than 1 standard deviation above the mean AND were not ranked as “highest priority” within that group by any voting member. We held a second in-person session following this vote to further refine the remaining questions. During the second phase of voting, we presented the topic questions to external stakeholders: members of the ACEP Research Committee and Public Health and Injury Prevention Committee. Feedback was reviewed and integrated into the actionable research questions in the final conference call.

RESULTS

In Phase One, 61 questions were developed. In Phase Two, this list was expanded to 222 questions. After refinement and separation of cross-cutting questions, a list of 63 potential questions remained. In Phase Three, 26/27 advisory group members (96%) voted; four questions were removed from the list. Further feedback on the tentative list was obtained from 21 outside experts from the ACEP Research and Public Health and Injury Prevention Committees. Fifty-nine final questions were retained (see Tables 1–7).

TABLE 1.

“Cross-cutting” EM Relevant Firearm Injury Research Questions

Directly Relevant to ED Clinical Practice
  • 1.

    In which healthcare settings (primary care, ED, psychiatry, pre-hospital, etc.) are firearm injury prevention screening and interventions feasible, acceptable, effective, and cost effective?

  • 2.

    Which screening and intervention modalities (e.g., electronic, face to face, written) are effective for each of the key domains in firearm injury research?

  • 3.

    What are the moderators of acceptability and effectiveness of screening and interventions (e.g. demographics, state-specific legislation, reasons for gun ownership, political views, specific patterns of substance use), for both clinicians and for patients?

  • 4.

    What types of tailoring increase screening and interventions’ acceptability and effectiveness? For whom?

  • 5.

    Should screening to assess the risk of (each type of) firearm injury be universal? If selective, what factors (e.g. childhood injury patterns, history of ED visits, demographics, prior violence, mental illness, specific patterns of substance use) need to be considered for a valid assessment of firearm injury risk?

  • 6.

    What is the effect of various types of interventions on both short- and long-term outcomes (e.g. PTSD, chronic pain, future injury, etc.) after a firearm injury?

  • 7.

    What are the positive and negative outcomes of firearm injury prevention screening and interventions?

  • 8.

    What are the confidentiality, legal, regulatory, and compliance issues that impact research and clinical care regarding firearm injuries?

  • 9.

    How can healthcare providers most effectively engage and collaborate with firearm owners on the topic of firearm injury?

General EM-Relevant Research
  • 10.

    To what extent is the prevention of firearm violence (compared with prevention of other types of injury or violence) unique?

  • 11.

    What is the relative effectiveness of educational, engineering, enforcement, and economic interventions to prevent firearm injury? Does the effectiveness of these programs differ for specific subgroups, e.g. perpetrators vs victims?

  • 12.

    What is the community-level effect of firearm injury and exposure (including costs, biomedical outcomes, psychological outcomes, and social/economic conditions)?

  • 13.

    What is the effect of the community on firearm injury patterns, within and across different types of injury?*

  • 14.

    What types of research approaches (e.g., enhanced data reporting systems) would improve the study of firearm injury?

  • 15.

    What are the right outcome measures for firearm injury research? (Decreased deaths? Decreased non-fatal injuries? Improved safe storage? Decreased firearm carriage? Other?)

  • 16.

    To what extent do policies and their variable enforcement affect risk of each subtype of firearm injury, on the level of both the individual and the population?*

*

maps to similar priorities as Institute of Medicine/National Research Council’s 2013 consensus report12

DISCUSSION

To reduce the immense medical and public health burden of U.S. firearm injury, high quality firearm injury prevention research is needed. Using validated approaches, our technical advisory group identified critical, EM-relevant research questions related to self-directed violence, intimate partner violence, peer violence, mass violence, and unintentional injury, as well as numerous cross-cutting questions. These questions are aimed both at improving ED care, and at facilitating EM-relevant prevention efforts in EDs and elsewhere. It is intended to serve as a guide for funders and researchers. These recommendations explicitly extend beyond, and have greater clinical relevance than, others’ firearm injury research agendas.12 Given the lack of current firearm research funding,32 increased funding for investigator-initiated grants, research networks, and collaborative multi-disciplinary research from federal research institutes (e.g., NIH, CDC, and the National Institute of Justice) and philanthropy is needed to address these EM-relevant questions.

Cross-Cutting Themes (Table 1)

Emergency physicians regularly address acute and future health concerns among their patients.33 The first step in the prevention of firearm injuries is identifying patients at increased risk.34 Just as universal suicide risk screening is currently under debate,35, 36 universal screening for risk of firearm injury may not be feasible, acceptable, valid, or effective in the ED. Although some preliminary work has described the characteristics of patients injured by firearms,9 additional work is needed to define who should be screened. Different wording and modalities may need to be considered for different populations (e.g., children versus adult).37, 38 While valid ED-based screening instruments exist for conditions which may lead to firearm injury (such as partner violence,39 alcohol,37 and suicide40), to our knowledge no literature exists on ED-based instruments that identify patients at risk of firearm injury. The creation of a predictive analytic algorithm41 may be particularly helpful to guide clinicians.

The field of injury prevention has standard approaches for intervention development, such as the “4 Es” (education, engineering, enforcement, and economics) and “SBIRT” (screening, brief intervention, and referral to treatment).30, 4244 It is unknown whether these approaches are appropriate for firearm injury prevention interventions in the ED. A few studies (discussed below) describe efficacious interventions for specific injury types, such as suicide or peer violence. Most research on firearm injury prevention interventions has been conducted outside of the ED.45 Future work should determine the theoretical basis, format, and demographic tailoring of ED-based interventions to prevent all types of firearm injury, and to reduce harm after an injury or death has occurred. Interventions must then be rigorously developed and tested for efficacy, effectiveness, and disseminability. Future work should also examine how best to prevent future consequences (e.g., PTSD) for patients, family members, and for clinicians following all types of firearm injury.

Research also needs to be completed elucidating knowledge, attitudes, and beliefs of stakeholders regarding ED-based screening and counseling for firearm injury risk. Such stakeholders may include ED clinicians, pediatricians, parents, gun owners, and others. Numerous barriers to screening and intervention likely exist, including: time constraints in busy EDs;46 limited patient receptivity to questions;47 and lack of knowledge about or training in counseling techniques.48 Other possible barriers include the potential for unintended consequences of screening and liability issues. These need to be elucidated.

On a larger scale, emergency physicians have traditionally been involved in the surveillance of injuries, ranging from overdose to child abuse. The epidemiology of firearm injury among ED patients remains largely unknown, due to limitations in existing, hospital-coding based surveillance systems.4951 Efforts to establish patterns of injury, risk factors, and firearm injuries’ relationship to and effect on the larger community are hampered at multiple levels: by restrictions on research funding; by lack of standard outcome measures; by legal and regulatory issues surrounding firearm injury research; and by lack of standardized datasets. Finally, it is unknown to what extent existing laws and policies, or the perceptions thereof, may change clinicians’ and patients’ willingness to discuss firearm injury in the clinical setting.52

Suicide (Table 2)

TABLE 2.

Suicide-Related EM-Relevant Firearm Injury Research Questions

Directly Relevant to ED Clinical Practice
  • 1.

    What are the knowledge, attitudes, and beliefs of key stakeholders (e.g. healthcare providers, families, patients) that may facilitate or impede lethal means restriction for suicidal patients?

  • 2.

    What are the consequences (if any) of firearm screening among suicidal patients? Does it dissuade them from seeking care?

  • 3.

    Is failure to screen for firearm access in a patient with suicide risk malfeasance or breach of duty by the physician?

  • 4.

    How does, and how should, knowing that a potentially suicidal patient has a gun at home influence disposition decision? (What should the standard of practice be?)

  • 5.

    What are barriers and facilitators to ED provider counseling of suicidal patients (and family members) about lethal means?

  • 6.

    What factors increase the acceptability of lethal means restriction for at-risk patients? E.g., with whom are at-risk persons most comfortable temporarily storing their firearms?

  • 7.

    To what extent do ED interactions with suicide hotlines/other community partners affect patients’ lethal means access post discharge?

General EM-Relevant Research
  • 8.

    What factors, including online and in-person social networks, affect initial suicide method choice and method substitution?

  • 9.

    What is the epidemiology of firearm suicide? Specifically: how does gun ownership, storage, gun origin, etc., vary across various demographic groups (e.g. youth, veterans, etc.)?*

  • 10.

    What is the effect of firearm access restriction on future suicide behavior?*

EDs are a key site for suicide prevention. Up to 10% of adult ED patients have had recent suicidal thoughts or behaviors,53, 54 and firearm access in the home is one of the strongest and most well established risk factors for suicide death for all household members.5558 Factors that influence method choice and the nuances in the epidemiology of firearm suicide (e.g., differences in firearm suicide plans among different demographic groups) remain largely unknown, and have clinical relevance to emergency physicians.

Knowledge gaps exist regarding emergency physicians’ screening for firearm access in those at risk for suicide. Issues specific to the realm of suicide include the following: provider attitudes;46, 59, 60 relative responsibilities of ED providers and mental health consultants; decision-making capacity regarding firearm storage; role of family members in these discussions; and legislation related to options for temporary firearm transfer or storage.61

As firearm suicide has a case fatality rate of 90%, versus 10% for all other methods combined,4, 62, 63 reducing access to firearms and other lethal means among those with suicide risk may prevent suicide deaths,64 and is part of the National Strategy for Suicide Prevention.65 Lethal means screening and counseling (i.e., counseling about reducing access to lethal means) for suicidal ED patients is recommended,66, 67 and provider training adapted for EDs exists68, but there are gaps in current research to guide ED implementation 35, 60, 61, 69 and efficacy67, 70. Barriers to address include ED providers’ unfamiliarity with options for safe firearm storage, inadequate provider training on counseling,59 and unanswered questions about the best messages and messengers for the counseling.61 Novel collaborations with firearm retailers have offered a new way to educate firearm owners about suicide prevention;71 such collaborations could address ED-specific issues (such as temporary firearm storage). For patients who present after a firearm suicide attempt, research questions relate to long-term prognosis, including factors affecting the likelihood of re-attempt and the methods used in re-attempt.72

Intimate Partner Violence (Table 3)

TABLE 3.

Intimate Partner Violence (IPV)-Related EM-Relevant Firearm Injury Research Questions

Directly Relevant to ED Clinical Practice
  • 1.

    When screening for firearm injury risk in IPV, is it more effective to start by asking about gun access and move to IPV perpetration risk, or vice-versa; or is the proper order situational?

  • 2.

    Retrospectively, what medical and legal characteristics distinguish perpetrators of firearm-related IPV from perpetrators of other crimes and/or from other ED patients?

  • 3.

    What are the feasibility, acceptability, and predictive value of the Danger Assessment for firearm-related IPV among ED patients?

  • 4.

    How does presence or threat of a firearm influence patients’ propensity to disclose IPV in the ED setting?

  • 5.

    What is the effect of IPV-related firearm legislation on patients’ and perpetrators’ disclosure of firearm ownership in the ED setting?

  • 6.

    What are the feasibility, acceptability, and effectiveness of dedicated IPV Response Teams (similar to Sexual Assault Nurse Examiner programs) for high risk IPV patients in the ED setting?

General EM-Relevant Research
  • 7.

    What are the risk factors for IPV-related firearm injury, among both victims and perpetrators?

  • 8.

    How do IPV events differ between gun owners and non-gun owners?

  • 9.

    Among gun owners, what determines whether a gun is used in an IPV event?*

  • 10.

    What is the effect of IPV-related firearm legislation, such as firearm forfeiture programs for people under an IPV restraining order, on IPV incidence and severity?*

Intimate partner violence (IPV) victims commonly present to the ED,73 and emergency providers regularly screen, identify, treat, and refer these patients.74, 75 Half of IPV deaths involve a firearm,76 victims of IPV are twice as likely as the general population to live in a household where a firearm is present,77 and the presence of a firearm in the home increases the odds for intimate partner homicide five-fold.78 While the presence of firearms seems to modify the trajectory of IPV, little is known about how it does so; this information is directly relevant to EPs attempting to counsel and refer IPV victims.79

For instance, the Danger Assessment is useful for assessing risk of IPV survival, but its applicability to ED patients needs further evaluation.80, 81 Similarly, the value of screening IPV perpetrators for risk of firearm injury perpetration in the ED setting has not been assessed.82 EM-specific research could elucidate the role of firearm ownership and access in understanding perpetration risk, and clarify the role of firearms in the trajectory of IPV after an ED visit.

Even if emergency medicine providers are able to moderate the risk of firearm-related IPV by screening, the effect of screening and reporting on patients’ willingness to disclose IPV is unclear. It is also unknown whether the likelihood of reporting IPV is influenced by perpetrators’ or victims’ firearm ownership, nor whether screening itself affects risk of intimate partner violence injury or death.

Given that both firearm injury and IPV implicate collaboration between the medical care system and law enforcement, another area with significant research opportunities for EM is “live forensics.” A best-practices approach to sexual assault, for example, involves the use of dedicated response teams, familiar with and trained in forensic concepts such as evidence collection, chain of custody, and others.83 Applying such an approach to IPV – especially high-risk IPV incidents involving firearms – might enhance secondary prevention of IPV-related injury. Finally, laws allowing forfeiture or seizure of firearms in the context of a restraining order84 may result in a 5–20% reduction in IPV deaths when enforced, but their efficacy and applicability in the context of an ED visit is unknown.85, 86

Peer Violence (Table 4)

TABLE 4.

Peer Violence-Related Firearm Injury Research Questions

Directly Relevant to ED Clinical Practice
  • 1.

    What is the role of acute ED care (e.g. staff interactions, pain medication, invasive procedures) in development of post-traumatic stress syndrome?

General EM-Relevant Research
  • 2.

    What is the relative impact of community-based violence interventions, community policing, and other community-based prevention efforts on firearm-related assaults?*

  • 3.

    What is the effect of social media use, including cyber bullying, on the incidence/likelihood of firearm assault?*

  • 4.

    What approaches are most effective in reducing racial and ethnic disparities in firearm-related assault?*

  • 5.

    To what extent do firearm injury events cluster geospatially, in relation to retaliation from prior violence as well as to place-based environmental factors (alcohol outlets, green space)?*

  • 6.

    What factors influence the likelihood of someone carrying or acquiring a firearm?*

  • 7.

    What is the relationship between violence exposure, PTSD and future firearm acquisition?*

Firearm injuries resulting from peer (non-intimate-partner) violence account for nearly 37,000 ED visits annually and disproportionately affect youth and young adult populations in low-resource and minority communities.3, 87 EDs are an important, but underutilized, setting for preventing firearm injuries due to peer violence.88

Unanswered research questions remain regarding the epidemiology of firearm assaults, the long-term sequelae of firearm assault injuries, and the efficacy of individual- and community-level interventions—especially interventions that originate in the ED. Longitudinal studies, including observational studies of at-risk ED populations, and outcome studies testing the efficacy of individual and community-level interventions are necessary to advance the science of firearm violence prevention.

Healthcare-based studies of peer violence have focused on understanding the epidemiology, health disparities, and individual-level risk factors associated with firearm-related assaults 8992,93, 9, 94 Such studies have demonstrated, for instance, that among assault-injured youth seeking ED care, 25% have a firearm, with 80% of these firearms acquired through non-legal channels.95 Few studies, however, have examined contextual factors associated with firearm acquisition and use, the factors that lead to escalation of violent conflict to lethal means, or the contextual determinants of recurrent firearm violence. These studies are directly relevant to emergency physicians caring for assault-injured patients.

While community-based studies have shown that firearm-related peer violence aggregates in certain geographic areas, and that neighborhood characteristics increase this risk,96100 little information exists on what factors determine whether youth will experience multiple acts of peer violence, particularly firearm-related peer violence. ED studies can address these issues. For instance, examining repeated versus single ED visits for firearm-related cases of violent assault may inform and focus public health and ED-initiated injury prevention efforts among high-risk populations. The long-term sequelae of firearm injury resulting from peer violence, such as mental health, chronic disease, and health-related behaviors, could also be defined through EM research.101

Interventions to prevent and reduce consequences of firearm-related peer violence also require further investigation. A collaborative care intervention focused on decreasing PTSD symptoms among traumatically injured adolescents is the only intervention to date demonstrating decreased rates of weapons carrying at follow-up.102 Increasing numbers of hospital-based violence prevention programs have been developed, which identify assault-injured youth during a hospital visit and link them to resources to reduce recurrent injury.103106 While these programs have shown promise in ED studies,88, 103111 they have not specifically focused on youth firearm injuries or firearm-specific outcomes. Single session screening and brief interventions incorporating motivational interviewing112 and cognitive behavioral therapy have also shown efficacy at reducing violence and/or drug use among at-risk adolescents.113 However, prior efficacy studies among youth at risk for violence have not led to concurrent work focused on how to prevent firearm injury among the similar populations. Further research is also needed to understand the specific impact of community-level interventions, such as improving neighborhood infrastructure114 and community-based violence interrupter programs,115118 on firearm assaults and therefore on ED visits.119

Mass Violence (Table 5)

TABLE 5.

Mass Violence-Related Firearm Injury Research Questions

Directly Relevant to ED Clinical Practice
  • 1.

    What definition of “mass violence” is clinically relevant to acute and episodic care?

  • 2.

    Are there specific signs, symptoms, or types of presentation that should trigger a clinician’s safety concern for more than one person (besides the patient him/herself)?

  • 3.

    To what degree is a patient’s firearm access relevant to clinical decision making about risk of mass violence?

  • 4.

    What are the knowledge, attitudes, and beliefs of clinicians that may facilitate or impede assessment of risk of mass violence?

  • 5.

    Does physician level of concern for mass violence correlate with actual risk of mass violence?

  • 6.

    Is the threat of violence in the ED setting a sentinel event for completed violence (i.e., the same clinical/longitudinal construct)?

  • 7.

    To what extent do active shooter plans and infrastructure changes (bulletproof glass, metal detectors, EMS protocols, etc.) affect incidence of, and morbidity/mortality from, ED mass shooting events?

General EM-Relevant Research
  • 8.

    Are there particular firearm-related characteristics (for example, firearm capacity; amount of time since firearm acquisition) that correlate with risk of mass violence?

  • 9.

    What is the epidemiology of PTSD, anxiety, depression, and other mental health disorders among communities and providers exposed to mass violence?*

Mass firearm violence is distinct from other forms of firearm injury and death. Although it lacks a standardized definition, many sources rely on a specific number of fatalities120123 (versus an “active shooter incident,” which has no victim count inherent to its definition124126). Most definitions of mass violence were developed by law enforcement to facilitate the apprehension and prosecution of offenders. As such, these existing definitions and research lack relevance for emergency physicians tasked with prospectively determining a patient’s propensity for violence against self or others.127

Classification heterogeneity, absent data standards, and the lack of medical case reports about prior assessments of individuals who go on to commit mass violence pose barriers to medical research. Small numbers particularly complicate the study of mass violence and its perpetrators.126 State and federal reports that describe the verified data for these events are often published in selective literature circles involving governmental or law enforcement entities, which do not cross into EM literature.

The epidemiology of interrupted but credible threats of mass violence is, to our knowledge, unknown. Patients posing a threat of committing firearm-related mass violence are evaluated in EDs, but the number of annual evaluations remains unknown. Retrospective studies of perpetrators of mass violence have identified behaviors and risk factors that may inform clinical estimations of risk,128 but none, to our knowledge, have been studied in the ED setting. Prospective research is necessary to determine the consistency and predictive validity of identified warning behaviors and cognitions. As firearms are the weapons of choice in most acts of mass violence (77%),126 firearm access likely augments the possibility of firearm mass violence among already at-risk individuals. Due to a variety of legal and regulatory constraints, the relative influence of pre-existing firearm access on risk of mass violence among high-risk patients, who are often evaluated in EDs, is unknown.

Advancing this area of research may create opportunities to mitigate threats and prevent acts of mass violence. Clinician attitudes and barriers – including fears about requirements for disclosure – must be explored. Future research depends on a means to identify and study patients who pose a risk of firearm violence. The study of firearm access and its role in clinical determinations of danger may require indirect or surrogate variables.

Active shooter plans and bullet-resistant installations, among other solutions, have been developed and implemented in EDs in response to the increasing frequency of acts of mass firearm violence. Many public and private shooter response plans suggest a “run, hide, or fight” component.129 Despite varying consensus recommendations from federal and state organizations, law enforcement entities, and medical professional groups,130 the efficacy of existing recommendations on threat mitigation and victim survivability is uncertain and largely unstudied. Finally, although the long-term psychological impact of episodes of mass violence on persons directly exposed131, 132 and communities as a whole are being investigated,133, 134 we know of no publications examining the mental health consequences for emergency clinicians treating victims of mass shootings.

Unintentional Firearm Injury (Table 6)

TABLE 6.

Unintentional Injury-Related Firearm Injury Research Questions

Directly Relevant to ED Clinical Practice
  • 1.

    How can emergency care providers effectively interact with parents and patients to enhance their knowledge about and increase their responsiveness to preventing unintentional firearm injury, including practicing safe gun storage?

General EM-Relevant Research
  • 2.

    What are the risk factors for unintentional firearm injury among specific demographic subgroups?*

  • 3.

    What are the knowledge, attitude, and beliefs of key stakeholders that may facilitate successful individual-level and community-level interventions to prevent unintentional firearm injury?

  • 4.

    How do safe storage methods help prevent unintentional firearm injuries?*

  • 5.

    What specific methods are most effective in reducing the risk of sustaining unintentional firearm injuries?

  • 6.

    What effect do gun technologies (i.e. smart guns, personalized guns) have on the risk of unintentional firearm injury?*

  • 7.

    How do unintentional firearm injury survivors’ psychological outcomes differ from survivors of other types of gun injuries?

Unintentional firearm injuries accounted for the death of over 64,000 Americans between 1965 and 2006.135 Approximately 16,000 individuals sustain nonfatal, unintentional firearm injuries each year in the United States.3 Emergency physicians provide counseling on a variety of unintentional injuries (e.g., child safety restraints), including unintentional firearm injury.19 Limited evidence exists to guide these efforts.

To develop successful primary and secondary interventions to reduce unintentional firearm injury, research on the causes and correlates of unintentional firearm injuries is necessary.136 As described above, existing epidemiologic data is insufficient. Such research could inform the development and implementation of targeted interventions for subgroups at highest risk of unintentional firearm injury.

Little has been done to understand the beliefs and goals of key stakeholders in EM unintentional firearm injury prevention. Rigorous research could: (1) identify interventions that would have significant stakeholder support; (2) help determine potential barriers to and mediators of successful efforts; and (3) facilitate collaborative research and primary and secondary prevention efforts based on the identified shared goals among the stakeholders in unintentional firearm injury.

Healthcare providers may effectively interact with both gun-owning and non-gun-owning patients to enhance awareness about unintentional firearm injury prevention. For example, more than half of firearm-owning households in the United States store a gun unlocked and/or loaded.137 Research shows a lower risk of unintentional firearm injuries in households that practice safe firearm storage.56, 138 Several professional societies, including ACEP, endorse safe gun storage to reduce firearm-related injuries.87, 139, 140 The effectiveness of ED-based interventions to promote safe storage practices remains limited. Rigorous research is needed to identify effective communication strategies with parents and patients about their role in reducing unintentional firearm injuries.

Advanced technologies, such as personalization of weapons or “smart” guns, may also aid in unintentional firearm injury prevention by decreasing unauthorized or unintentional discharge.141 Almost no research examines the impact of these advanced technologies on unintentional firearm injury.

Little is known about the psychological sequelae for patients or communities after unintentional firearm injury. An important distinction for future research is that an unintentional injury can be self-inflicted or other-inflicted. In other-inflicted events, the most common scenario is a child playing with a gun who unintentionally shoots another individual.136 In these events, almost half the time the shooter is male and from the same family, often a brother; in most other cases the shooter is an acquaintance.136 Many times the victim and shooter are young with many anticipated years of life ahead of them.136 In these cases, the “costs” of unintentional firearm injuries are not solely those of the victim and his or her family, but also include the shooter and his or her family.136 Investigations into the psychosocial impact and potential psychological sequelae experienced by all individuals impacted by unintentional firearm injury can guide post-injury interventions to address psychosocial needs following injury.

Limitations

Although collective expert bias is always a possibility when using consensus techniques, the nominal group technique is designed to minimize the influence of group dynamics or even a single individual on the outcome. As described in the methods section, explicit attempts were made to minimize potential sources bias during the process (such as inclusion of non-firearm-injury researchers, use of the round robin technique, and solicitation of outside opinions from non-EM researchers and from two ACEP Committees prior to finalization of the list). Moreover, it is important to remember that this technique is designed to examine qualitative, subjective components of a topic and gain consensus. It is not designed to be a problem-solving tool. Quantitative statistical methods should be applied to future studies generated from this agenda to assess the validity of any hypothesis in question.

CONCLUSION

Through our validated consensus group process, we identified key EM-relevant firearm injury prevention research questions. Critical research questions exist in multiple domains of injury, with little existing EM-specific data for most questions. Funders and researchers may consider increasing their attention to these topics.

References

  • 1.Centers for Disease Control and Prevention (CDC) What caused the injury? Firearm. Nonfatal Injury Reports, 2001–2013. 2013 [Google Scholar]
  • 2.Centers for Disease Control and Prevention (CDC), National Center for Injury Prevention and Control. Web-based Injury Statistics Query and Reporting System (WISQARS) (online) Available from URL: www.cdc.gov/ncipc/wisqars2014.
  • 3.National Center for Health Statistics (NCHS) National Vital Statistics System. Office of Statistics and Programming, National Center for Injury Prevention and Control, Center for Disease Control and Prevention WISQARS2015. [Google Scholar]
  • 4.Vyrostek SB, Annest JL, Ryan GW. Surveillance for fatal and nonfatal injuries--United States, 2001. MMWR Surveill Summ. 2004;53:1–57. [PubMed] [Google Scholar]
  • 5.Greenspan AI, Kellermann AL. Physical and psychological outcomes 8 months after serious gunshot injury. Journal of Trauma. 2002;53:709–716. doi: 10.1097/00005373-200210000-00015. [DOI] [PubMed] [Google Scholar]
  • 6.Redeker N, Smeltzer S, Kirkpatrick J, Parchment S. Risk factors of adolescent and young adult trauma victims. American Journal of Critical Care. 1995;4:370–378. [PubMed] [Google Scholar]
  • 7.Richmond TS, Kauder D. Predictors of Psychological Distress Following Serious Injury. Journal of Traumatic Stress. 13:681–692. doi: 10.1023/A:1007866318207. [DOI] [PubMed] [Google Scholar]
  • 8.Richmond TS, Thompson HJ, Deatrick JA, Kauder DR. Journey towards recovery following physical trauma. Journal of Advanced Nursing. 2000;32:1341–1347. doi: 10.1046/j.1365-2648.2000.01629.x. [DOI] [PubMed] [Google Scholar]
  • 9.Rowhani-Rahbar A, Zatzick D, Wang J, et al. Firearm-related hospitalization and risk for subsequent violent injury, death, or crime perpetration: a cohort study. Ann Intern Med. 2015;162:492–500. doi: 10.7326/M14-2362. [DOI] [PubMed] [Google Scholar]
  • 10.Howell EM, Abraham P. The Hospital Costs of Firearm Assaults. The Urban Institute; [Google Scholar]
  • 11.The Whitehouse Office of the Press Secretary. Gun Violence Reduction Executive ActionsJanuary. 2013 [Google Scholar]
  • 12.Leshner AI, Altevogt BM, Lee AF, McCoy MA, Kelley PW. Priorities for research to reduce the threat of firearm-related violence. National Academies Press; 2013. [Google Scholar]
  • 13.Anglemyer A, Horvath T, Rutherford G. The Accessibility of Firearms and Risk for Suicide and Homicide Victimization Among Household MembersA Systematic Review and Meta-analysis. Ann Intern Med. 2014;160:101–110. doi: 10.7326/M13-1301. [DOI] [PubMed] [Google Scholar]
  • 14.Hemenway D. Guns, Suicide, and Homicide: Individual-Level Versus Population-Level Studies. Ann Intern Med. 2014;160:134–135. doi: 10.7326/M13-2657. [DOI] [PubMed] [Google Scholar]
  • 15.Kellermann AL, Rivara FP. Silencing the science on gun research. JAMA. 2013;309:549–550. doi: 10.1001/jama.2012.208207. [DOI] [PubMed] [Google Scholar]
  • 16.Ladapo JA, Rodwin BA, Ryan AM, Trasande L, Blustein J. Scientific publications on firearms in youth before and after Congressional action prohibiting federal research funding. Jama. 2013;310:532–534. doi: 10.1001/jama.2013.119355. [DOI] [PubMed] [Google Scholar]
  • 17.Laine C, Taichman DB, Mulrow C, Berkwits M, Cotton D, Williams SV. A Resolution for Physicians: Time to Focus on the Public Health Threat of Gun Violence. Ann Intern Med. 2013;158:493–494. doi: 10.7326/0003-4819-158-6-201303190-00586. [DOI] [PubMed] [Google Scholar]
  • 18.Beaman V, Annest JL, Mercy JA, Kresnow M-j, Pollock DA. Lethality of firearm-related injuries in the United States population. Ann Emerg Med. 2000;35:258–266. doi: 10.1016/s0196-0644(00)70077-1. [DOI] [PubMed] [Google Scholar]
  • 19.Rogers JJ, Price C, Ostermann L, editors. ACEP Policy Compendium: Firearm Safety and Injury Prevention. Dallas, TX: American College of Emergency Physicians; 2016. p. 83. [Google Scholar]
  • 20.Weinberger SE, Hoyt DB, Lawrence HC, III, et al. Firearm-Related Injury and Death in the United States: A Call to Action From 8 Health Professional Organizations and the American Bar AssociationFirearm-Related Injury and Death in the United States. Annals of Internal Medicine. 2015;162:513–516. doi: 10.7326/M15-0337. [DOI] [PubMed] [Google Scholar]
  • 21.Jones J, Hunter D. Consensus methods for medical and health services research. BMJ : British Medical Journal. 1995;311:376–380. doi: 10.1136/bmj.311.7001.376. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Fink A, Kosecoff J, Chassin M, Brook RH. Consensus methods: characteristics and guidelines for use. Am J Public Health. 1984;74:979–983. doi: 10.2105/ajph.74.9.979. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Helmer O, Brown B, Gordon T. Social technology. New York: Basic Books; 1966. [Google Scholar]
  • 24.Brown B. The Delphi method: a methodology used for the elicitation of opinion of experts. Santa Monica, CA: The RAND Corporation; 1968. [Google Scholar]
  • 25.Van de Ven AH, Delbecq AL. The nominal group as a research instrument for exploratory health studies. American Journal of Public Health. 1972;62:337–342. doi: 10.2105/ajph.62.3.337. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Delbecq AL, Van de Ven AH. A Group Process Model for Problem Identification and Program Planning. The Journal of Applied Behavioral Science. 1971;7:466–492. [Google Scholar]
  • 27.Wasserman EB, Shah MN, Jones CM, et al. Identification of a neurologic scale that optimizes EMS detection of older adult traumatic brain injury patients who require transport to a trauma center. Prehospital emergency care : official journal of the National Association of EMS Physicians and the National Association of State EMS Directors. 2015;19:202–212. doi: 10.3109/10903127.2014.959225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Broderick KB, Ranney ML, Vaca FE, et al. Study designs and evaluation models for emergency department public health research. Acad Emerg Med. 2009;16:1124–1131. doi: 10.1111/j.1553-2712.2009.00557.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Ranney ML, Locci N, Adams EJ, et al. Gender-specific research on mental illness in the emergency department: current knowledge and future directions. Acad Emerg Med. 2014;21:1395–1402. doi: 10.1111/acem.12524. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Christoffel T, Gallagher S. Injury prevention and public health: practical knowledge, skills, and strategies. Jones & Bartlett Learning; 2006. [Google Scholar]
  • 31.Runyan CW. Using the Haddon matrix: introducing the third dimension. Injury prevention. 2015;21:126–130. doi: 10.1136/ip.4.4.302rep. [DOI] [PubMed] [Google Scholar]
  • 32.Betz ME, Ranney ML, Wintemute GJ. Frozen Funding on Firearm Research: “Doing Nothing Is No Longer an Acceptable Solution”. Western Journal of Emergency Medicine. 2016;17:91–93. doi: 10.5811/westjem.2016.1.29767. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Bernstein SL, D’Onofrio G. Public health in the emergency department: Academic Emergency Medicine consensus conference executive summary. Acad Emerg Med. 2009;16:1037–1039. doi: 10.1111/j.1553-2712.2009.00548.x. [DOI] [PubMed] [Google Scholar]
  • 34.Wintemute GJ, Betz ME, Ranney ML. Yes, You Can: Physicians, Patients, and FirearmsPhysicians, Patients, and Firearms. Annals of Internal Medicine. 2016;165:205–213. doi: 10.7326/M15-2905. [DOI] [PubMed] [Google Scholar]
  • 35.Betz ME, Arias SA, Miller M, et al. Change in Emergency Department Providers’ Beliefs and Practices After Use of New Protocols for Suicidal Patients. Psychiatric Services. 2015;66:625–631. doi: 10.1176/appi.ps.201400244. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Boudreaux ED, Camargo CA, Jr, Arias SA, et al. Improving Suicide Risk Screening and Detection in the Emergency Department. American journal of preventive medicine. 2015 doi: 10.1016/j.amepre.2015.09.029. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): An effective brief screening test for problem drinking. Archives of internal medicine. 1998;158:1789–1795. doi: 10.1001/archinte.158.16.1789. [DOI] [PubMed] [Google Scholar]
  • 38.Chung T, Colby SM, Barnett NP, Rohsenow DJ, Spirito A, Monti PM. Screening adolescents for problem drinking: Performance of brief screens against DSM-IV alcohol diagnoses. J Stud Alcohol. 2000;61:579–587. doi: 10.15288/jsa.2000.61.579. [DOI] [PubMed] [Google Scholar]
  • 39.MacMillan HL, Wathen CN, Jamieson E, et al. Approaches to screening for intimate partner violence in health care settings: A randomized trial. Jama. 2006;296:530–536. doi: 10.1001/jama.296.5.530. [DOI] [PubMed] [Google Scholar]
  • 40.Boudreaux ED, Miller I, Goldstein AB, et al. The Emergency Department Safety Assessment and Follow-up Evaluation (ED-SAFE): method and design considerations. Contemporary clinical trials. 2013;36:14–24. doi: 10.1016/j.cct.2013.05.008. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Russo J, Katon W, Zatzick D. The development of a population-based automated screening procedure for PTSD in acutely injured hospitalized trauma survivors. Gen Hosp Psychiatry. 2013;35:485–491. doi: 10.1016/j.genhosppsych.2013.04.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Garrison HG, Foltin GL, Becker LR, et al. The role of emergency medical services in primary injury prevention. Consensus workshop. Arlington, Virginia, August 25–26, 1995. Ann Emerg Med. 1997;30:84–91. doi: 10.1016/s0196-0644(97)70116-1. [DOI] [PubMed] [Google Scholar]
  • 43.Mace SE, Gerardi MJ, Dietrich AM, et al. Injury prevention and control in children. Ann Emerg Med. 2001;38:405–414. doi: 10.1067/mem.2001.115882. [DOI] [PubMed] [Google Scholar]
  • 44.Cunningham RM, Harrison SR, McKay MP, et al. National survey of emergency department alcohol screening and intervention practices. Ann Emerg Med. 2010;55:556–562. doi: 10.1016/j.annemergmed.2010.03.004. [DOI] [PubMed] [Google Scholar]
  • 45.Roszko PJ, Ameli J, Carter PM, Cunningham RM, Ranney ML. Clinician Attitudes, Screening Practices, and Interventions to Reduce Firearm-Related Injury. Epidemiol Rev. 2016;38:87–110. doi: 10.1093/epirev/mxv005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Betz ME, Sullivan AF, Manton AP, et al. Knowledge, attitudes and practices of emergency department providers in the care of suicidal patients. Depress Anxiety. 2012;30:1005–1012. doi: 10.1002/da.22071. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Price JH, Thompson A, Khubchandani J, Wiblishauser M, Dowling J, Teeple K. Perceived roles of emergency department physicians regarding anticipatory guidance on firearm safety. The Journal of emergency medicine. 2013;44:1007–1016. doi: 10.1016/j.jemermed.2012.11.010. [DOI] [PubMed] [Google Scholar]
  • 48.Dingeldein L, Sheehan K, Krcmarik M, Dowd MD. Evaluation of a firearm injury prevention web-based curriculum. Teach Learn Med. 2012;24:327–333. doi: 10.1080/10401334.2012.715254. [DOI] [PubMed] [Google Scholar]
  • 49.Winn DG, Agran PF, Anderson CL. Sensitivity of hospitals’ E-coded data in identifying causes of children’s violence-related injuries. Public Health Rep. 1995;110:277–281. [PMC free article] [PubMed] [Google Scholar]
  • 50.Ranney ML, Mello MJ. A comparison of female and male adolescent victims of violence seen in the emergency department. The Journal of emergency medicine. 2011;41:701–706. doi: 10.1016/j.jemermed.2011.03.025. [DOI] [PubMed] [Google Scholar]
  • 51.Lawrence BA, Miller TR, Weiss HB, Spicer RS. Issues in using state hospital discharge data in injury control research and surveillance. Accid Anal Prev. 2007;39:319–325. doi: 10.1016/j.aap.2006.08.001. [DOI] [PubMed] [Google Scholar]
  • 52.Britton JaB JD. Oregon’s Gun Relief Program for Adjudicated Mentally Ill Persons: The Psychiatric Security Review Board. Behavioral Sciences & the Law. 2016;33:323–333. doi: 10.1002/bsl.2167. [DOI] [PubMed] [Google Scholar]
  • 53.Ilgen MA, Walton MA, Cunningham RM, et al. Recent suicidal ideation among patients in an inner city emergency department. Suicide Life Threat Behav. 2009;39:508–517. doi: 10.1521/suli.2009.39.5.508. [DOI] [PubMed] [Google Scholar]
  • 54.Claassen CA, Larkin GL. Occult suicidality in an emergency department population. Br J Psychiatry. 2005;186:352–353. doi: 10.1192/bjp.186.4.352. [DOI] [PubMed] [Google Scholar]
  • 55.Miller M, Lippmann SJ, Azrael D, Hemenway D. Household firearm ownership and rates of suicide across the 50 United States. J Trauma. 2007;62:1029–1034. doi: 10.1097/01.ta.0000198214.24056.40. discussion 1034-1025. [DOI] [PubMed] [Google Scholar]
  • 56.Miller M, Azrael D, Hemenway D, Vriniotis M. Firearm storage practices and rates of unintentional firearm deaths in the United States. Accid Anal Prev. 2005;37:661–667. doi: 10.1016/j.aap.2005.02.003. [DOI] [PubMed] [Google Scholar]
  • 57.Miller M, Barber C, White RA, Azrael D. Firearms and Suicide in the United States: Is Risk Independent of Underlying Suicidal Behavior? Am J Epidemiol. 2013;178:946–955. doi: 10.1093/aje/kwt197. [DOI] [PubMed] [Google Scholar]
  • 58.Miller M, Azrael D, Hemenway D. Household firearm ownership and suicide rates in the United States. Epidemiology. 2002;13:517–524. doi: 10.1097/00001648-200209000-00006. [DOI] [PubMed] [Google Scholar]
  • 59.Betz ME, Miller M, Barber C, et al. Lethal means restriction for suicide prevention: beliefs and behaviors of emergency department providers. Depress Anxiety. 2013;30:1013–1020. doi: 10.1002/da.22075. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Betz ME, Barber CW, Miller M. Firearm restriction as suicide prevention: variation in belief and practice among providers in an urban emergency department. Inj Prev. 2010;16:278–281. doi: 10.1136/ip.2009.025296. [DOI] [PubMed] [Google Scholar]
  • 61.Barber CW, Miller MJ. Reducing a Suicidal Person’s Access to Lethal Means of Suicide: A Research Agenda. American journal of preventive medicine. 2014;47:S264–S272. doi: 10.1016/j.amepre.2014.05.028. [DOI] [PubMed] [Google Scholar]
  • 62.Miller M, Azrael D, Hemenway D. The epidemiology of case fatality rates for suicide in the northeast. Ann Emerg Med. 2004;43:723–730. doi: 10.1016/j.annemergmed.2004.01.018. [DOI] [PubMed] [Google Scholar]
  • 63.Spicer RS, Miller TR. Suicide acts in 8 states: incidence and case fatality rates by demographics and method. Am J Public Health. 2000;90:1885–1891. doi: 10.2105/ajph.90.12.1885. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Prevention NAAfS. A prioritized research agenda for suicide prevention: An action plan to save lives. Rockville, MD: National Institute of Mental Health and the Research Prioritization Task Force; 2014. [Google Scholar]
  • 65.Office of the Surgeon General, National Action Alliance for Suicide Prevention. 2012 National Strategy for Suicide Prevention: Goals and Objectives for Action: A Report of the US Surgeon General and of the National Action Alliance for Suicide Prevention. 2012. [PubMed] [Google Scholar]
  • 66.Capoccia L, Labre M. Caring for adult patients with suicide risk: A consensus based guide for emergency departments. Waltham, MA: Education Development Center, Inc., Suicide Resource Prevention Center; 2015. [Google Scholar]
  • 67.Kruesi MJP, Grossman J, Pennington JM, Woodward PJ, Duda D, Hirsch JG. Suicide and violence prevention: Parent education in the emergency department. J Am Acad Child Psy. 1999;38:250–255. doi: 10.1097/00004583-199903000-00010. [DOI] [PubMed] [Google Scholar]
  • 68.Johnson RM, Frank EM, Ciocca M, Barber CW. Training mental healthcare providers to reduce at-risk patients’ access to lethal means of suicide: evaluation of the CALM Project. Archives of suicide research : official journal of the International Academy for Suicide Research. 2011;15:259–264. doi: 10.1080/13811118.2011.589727. [DOI] [PubMed] [Google Scholar]
  • 69.Betz ME, Miller M, Barber C, et al. Lethal means access and assessment among suicidal emergency department patients. Depress Anxiety. 2016 doi: 10.1002/da.22486. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Brent DA, Baugher M, Birmaher B, Kolko DJ, Bridge J. Compliance with Recommendations to Remove Firearms in Families Participating in a Clinical Trial for Adolescent Depression. J Am Acad Child Adolesc Psychiatry. 2000;39:1220–1226. doi: 10.1097/00004583-200010000-00007. [DOI] [PubMed] [Google Scholar]
  • 71.Vriniotis M, Barber C, Frank E, Demicco R the New Hampshire Firearm Safety C. A Suicide Prevention Campaign for Firearm Dealers in New Hampshire. Suicide Life Threat Behav. 2015;45:157–163. doi: 10.1111/sltb.12123. [DOI] [PubMed] [Google Scholar]
  • 72.Miller M, Hempstead K, Nguyen T, Barber C, Rosenberg-Wohl S, Azrael D. Method choice in nonfatal self-harm as a predictor of subsequent episodes of self-harm and suicide: implications for clinical practice. Am J Public Health. 2013;103:e61–e68. doi: 10.2105/AJPH.2013.301326. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Ernst AA, Weiss SJ. Intimate partner violence from the emergency medicine perspective. Women & health. 2002;35:71–81. doi: 10.1300/J013v35n02_05. [DOI] [PubMed] [Google Scholar]
  • 74.Daugherty JD, Houry DE. Intimate partner violence screening in the emergency department. J Postgrad Med. 2008;54:301–305. doi: 10.4103/0022-3859.43513. [DOI] [PubMed] [Google Scholar]
  • 75.Kendall J, Pelucio MT, Casaletto J, et al. Impact of emergency department intimate partner violence intervention. J Interpers Violence. 2009;24:280–306. doi: 10.1177/0886260508316480. [DOI] [PubMed] [Google Scholar]
  • 76.Roberts DW. Intimate Partner Homicide. 2009 [Google Scholar]
  • 77.Sorenson SB. Firearm use in intimate partner violence: a brief overview. Eval Rev. 2006;30:229–236. doi: 10.1177/0193841X06287220. [DOI] [PubMed] [Google Scholar]
  • 78.Campbell JC, Webster D, Koziol-McLain J, et al. Risk factors for femicide in abusive relationships: results from a multisite case control study. Am J Public Health. 2003;93:1089–1097. doi: 10.2105/ajph.93.7.1089. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Wintemute GJ, Wright MA, Drake CM. Increased risk of intimate partner homicide among California women who purchase handguns. Ann Emerg Med. 2003;41:281–283. doi: 10.1067/mem.2003.66. [DOI] [PubMed] [Google Scholar]
  • 80.Snider C, Webster D, O’Sullivan CS, Campbell J. Intimate partner violence: Development of a brief risk assessment for the emergency department. Acad Emerg Med. 2009;16:1208–1216. doi: 10.1111/j.1553-2712.2009.00457.x. [DOI] [PubMed] [Google Scholar]
  • 81.Campbell JC, Webster DW, Glass N. The danger assessment: validation of a lethality risk assessment instrument for intimate partner femicide. J Interpers Violence. 2009;24:653–674. doi: 10.1177/0886260508317180. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 82.Ernst AA, Weiss SJ, Morgan-Edwards S, et al. Derivation and validation of a short emergency department screening tool for perpetrators of intimate partner violence: the PErpetrator RaPid Scale (PERPS) The Journal of emergency medicine. 2012;42:206–217. doi: 10.1016/j.jemermed.2011.01.032. [DOI] [PubMed] [Google Scholar]
  • 83.Greeson MR, Campbell R. Sexual assault response teams (SARTs): an empirical review of their effectiveness and challenges to successful implementation. Trauma, violence & abuse. 2013;14:83–95. doi: 10.1177/1524838012470035. [DOI] [PubMed] [Google Scholar]
  • 84.Vigdor ER, Mercy JA. Do laws restricting access to firearms by domestic violence offenders prevent intimate partner homicide? Eval Rev. 2006;30:313–346. doi: 10.1177/0193841X06287307. [DOI] [PubMed] [Google Scholar]
  • 85.Webster DW, Wintemute GJ. Effects of policies designed to keep firearms from high-risk individuals. Annu Rev Public Health. 2015;36:21–37. doi: 10.1146/annurev-publhealth-031914-122516. [DOI] [PubMed] [Google Scholar]
  • 86.Siegel MB, Rothmans EF. Firearm Ownership and the Murder of Women in the United States: Evidence That the State-Level Firearm Ownership Rate Is Associated with the Nonstranger Femicide Rate. Violence and Gender. 2016 [Google Scholar]
  • 87.Dowd M, Sege R. Council on Injury, Violence, and Poison Prevention Executive Committee; American Academy of Pediatrics. Firearm-related injuries affecting the pediatric population. Pediatrics. 2012;130:e1416–e1423. doi: 10.1542/peds.2012-2481. [DOI] [PubMed] [Google Scholar]
  • 88.Cunningham R, Knox L, Fein J, et al. Before and After the Trauma Bay: The Prevention of Violent Injury Among Youth. Ann Emerg Med. 2009;53:490–500. doi: 10.1016/j.annemergmed.2008.11.014. [DOI] [PubMed] [Google Scholar]
  • 89.Cunningham RM, Ranney M, Newton M, Woodhull W, Zimmerman M, Walton MA. Characteristics of youth seeking emergency care for assault injuries. Pediatrics. 2014;133:e96–e105. doi: 10.1542/peds.2013-1864. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Sege RD, Kharasch S, Perron C, et al. Pediatric violence-related injuries in Boston - Results of a city-wide emergency department surveillance program. Arch Pediat Adol Med. 2002;156:73–76. doi: 10.1001/archpedi.156.1.73. [DOI] [PubMed] [Google Scholar]
  • 91.Cheng TL, Wright JL, Fields CB, et al. Violent injuries among adolescents: declining morbidity and mortality in an urban population. Annals of emergency medicine. 2001;37:292–300. doi: 10.1067/mem.2001.111763. [DOI] [PubMed] [Google Scholar]
  • 92.Cunningham RM, Murray R, Walton MA, et al. Prevalence of past year assault among inner-city emergency department patients. Ann Emerg Med. 2009;53:814–823. doi: 10.1016/j.annemergmed.2009.01.016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Leventhal JM, Gaither JR, Sege R. Hospitalizations due to firearm injuries in children and adolescents. Pediatrics. 2014;133:219–225. doi: 10.1542/peds.2013-1809. [DOI] [PubMed] [Google Scholar]
  • 94.Newgard CD, Kuppermann N, Holmes JF, et al. Gunshot injuries in children served by emergency services. Pediatrics. 2013;132:862–870. doi: 10.1542/peds.2013-1350. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Carter PM, Walton MA, Newton MF, et al. Firearm possession among adolescents presenting to an urban emergency department for assault. Pediatrics. 2013;132:213–221. doi: 10.1542/peds.2013-0163. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Centers for Disease Control, National Youth Violence Prevention Resource Center. Risk and Protective Factors for Youth Violence Fact Sheet. 2015 [Google Scholar]
  • 97.Molnar BE, Cerda M, Roberts AL, Buka SL. Effects of neighborhood resources on aggressive and delinquent behaviors among urban youths. American Journal of Public Health. 2008;98:1086. doi: 10.2105/AJPH.2006.098913. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 98.Valois RF, MacDonald JM, Bretous L, Fischer MA, Drane JW. Risk factors and behaviors associated with adolescent violence and aggression. American journal of health behavior. 2002;26:454–464. doi: 10.5993/ajhb.26.6.6. [DOI] [PubMed] [Google Scholar]
  • 99.Borowsky I, Widome R, Resnick M. Young people and violence. International Encyclopedia of Public Health. 2008;6:675–684. [Google Scholar]
  • 100.Brooks-Gunn J. Neighborhood poverty, volume 1: Context and consequences for children. Russell Sage Foundation; 1997. [Google Scholar]
  • 101.Fein JA, Kassam-Adams N, Gavin M, Huang R, Blanchard D, Datner EM. Persistence of posttraumatic stress in violently injured youth seen in the emergency department. Arch Pediatr Adolesc Med. 2002;156:836–840. doi: 10.1001/archpedi.156.8.836. [DOI] [PubMed] [Google Scholar]
  • 102.Zatzick D, Russo J, Lord SP, et al. Collaborative care intervention targeting violence risk behaviors, substance use, and posttraumatic stress and depressive symptoms in injured adolescents: a randomized clinical trial. JAMA pediatrics. 2014;168:532–539. doi: 10.1001/jamapediatrics.2013.4784. [DOI] [PubMed] [Google Scholar]
  • 103.Zun LS, Downey LV, Rosen J. Violence prevention in the ED: linkage of the ED to a social service agency. Am J Emerg Med. 2003;21:454–457. doi: 10.1016/s0735-6757(03)00102-5. [DOI] [PubMed] [Google Scholar]
  • 104.Becker MG, Hall JS, Ursic CM, Jain S, Calhoun D. Caught in the Crossfire: The effects of a peer-based intervention program for violently injured youth. J Adolesc Health. 2004;34:177–183. doi: 10.1016/j.jadohealth.2003.04.001. [DOI] [PubMed] [Google Scholar]
  • 105.Cheng TL, Wright JL, Markakis D, Copeland-Linder N, Menvielle E. Randomized trial of a case management program for assault-injured youth. Ped Emerg Care. 2008;24:130–136. doi: 10.1097/PEC.0b013e3181666f72. [DOI] [PubMed] [Google Scholar]
  • 106.Cooper C, Eslinger DM, Stolley PD. Hospital-based violence intervention programs work. J Trauma. 2006;61:534–537. doi: 10.1097/01.ta.0000236576.81860.8c. discussion 537–540. [DOI] [PubMed] [Google Scholar]
  • 107.Karraker N, Cunningham RM, Becker MG, Fein JA, Knox LM. Violence is Preventable: A Best Practices Guide for Launching & Sustaining a Hospital-based Program to Break the Cycle of Violence. 2011 [Google Scholar]
  • 108.Dicker R. Violence prevention for trauma centers: A feasible start [Poster 2901] In: NCfiPaC CDC, editor. Injury and Violence In America. Denver, CO; 2005. [Google Scholar]
  • 109.Mitka M. Hospital study offers hope of changing lives prone to violence. Jama. 2002;287:576–577. [PubMed] [Google Scholar]
  • 110.Marcelle DR, Melzer-Lange MD. Project UJIMA: working together to make things right. WMJ : official publication of the State Medical Society of Wisconsin. 2001;100:22–25. [PubMed] [Google Scholar]
  • 111.Datner E, Fein J, McGrath M. Violence intervention project: Linking healthcare facilities with community-based resources. Acad Emerg Med. 1999;6:511. [Google Scholar]
  • 112.Cunningham RM, Whiteside LK, Chermack ST, et al. Dating violence: outcomes following a brief motivational interviewing intervention among at-risk adolescents in an urban emergency department. Acad Emerg Med. 2013;20:562–569. doi: 10.1111/acem.12151. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Walton MA, Resko S, Barry KL, et al. A randomized controlled trial testing the efficacy of a brief cannabis universal prevention program among adolescents in primary care. Addiction. 2014;109:786–797. doi: 10.1111/add.12469. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 114.Cerdá M, Morenoff JD, Hansen BB, et al. Reducing violence by transforming neighborhoods: a natural experiment in Medellín, Colombia. Am J Epidemiol. 2012;175:1045–1053. doi: 10.1093/aje/kwr428. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 115.Skogan WG, Hartnett SM, Bump N, Dubois J, Hollon R, Morris D. Evaluation of ceasefire-Chicago. Northwestern University Chicago; 2008. [Google Scholar]
  • 116.Webster DW, Whitehill JM, Vernick JS, Curriero FC. Effects of Baltimore’s Safe Streets Program on gun violence: A replication of Chicago’s CeaseFire Program. Journal of Urban Health. 2013;90:27–40. doi: 10.1007/s11524-012-9731-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 117.Braga AA, Kennedy DM, Waring EJ, Piehl AM. Problem-oriented policing, deterrence, and youth violence: An evaluation of Boston’s Operation Ceasefire. Journal of Research in Crime and Delinquency. 2001;38:195–225. [Google Scholar]
  • 118.Braga AA. The effects of hot spots policing on crime. The ANNALS of the American Academy of Political and Social Science. 2001;578:104–125. [Google Scholar]
  • 119.Garvin EC, Cannuscio CC, Branas CC. Greening vacant lots to reduce violent crime: a randomised controlled trial. Injury prevention. 2013;19:198–203. doi: 10.1136/injuryprev-2012-040439. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 120.Dietz PE. Mass, serial and sensational homicides. Bulletin of the New York Academy of Medicine. 1986;62:477. [PMC free article] [PubMed] [Google Scholar]
  • 121.Krouse WJ, Richardson DJ. Mass Murder with Firearms: Incidence and Victims, 1999–2013. Congressional Research Service. 2013 [Google Scholar]
  • 122.112th Congress Public Law 265. Public Law 112–265. 112th Congress, ed. Pg. 126 STAT. 2435. Washington DC: 2013. [Google Scholar]
  • 123.Office for Victims of Crime, US Dept of Justice, Office of Justice Programs, United States of America. Responding to Victims of Terrorism and Mass Violence Crimes: Coordination and Collaboration Between American Red Cross Workers and Crime Victim Service Providers. 2005 [Google Scholar]
  • 124.Mass Murder Aggrawal A. In: Encyclopedia of Forensic and Legal Medicine. Payne-James J, Byard R, Corey T, Henderson C, editors. Vol. 3. London: Elsevier Academic Press; 2005. pp. 216–223. [Google Scholar]
  • 125.Morton RJ, editor. Serial Murder - Federal Bureau of Investigation. Vol. 2016. Federal Bureau of Investigation; 2008. [Google Scholar]
  • 126.USA TODAY. USA TODAy. 2015. Behind the Bloodshed: The Untold Story of America’s Mass Killings. Online. [Google Scholar]
  • 127.Koop CE, Lundberg GD. Violence in America: a public health emergency: time to bite the bullet back. JAMA. 1992;267:3075–3076. [PubMed] [Google Scholar]
  • 128.Reid Meloy J, Hoffmann J, Guldimann A, James D. The role of warning behaviors in threat assessment: An exploration and suggested typology. Behavioral sciences & the law. 2012;30:256–279. doi: 10.1002/bsl.999. [DOI] [PubMed] [Google Scholar]
  • 129.Active Shooter: How to Respond. Vol. 2016. U.S. Department of Homeland Security; 2008. [Google Scholar]
  • 130.Jacobs L. Strategies to enhance survival in active shooter and intentional mass casualty events. Bulletin of the American College of Surgeons. 2015;100:16. [PubMed] [Google Scholar]
  • 131.Hafstad GS, Dyb G, Jensen TK, Steinberg AM, Pynoos RS. PTSD prevalence and symptom structure of DSM-5 criteria in adolescents and young adults surviving the 2011 shooting in Norway. J Affect Disord. 2014;169:40–46. doi: 10.1016/j.jad.2014.06.055. [DOI] [PubMed] [Google Scholar]
  • 132.Scrimin S, Moscardino U, Capello F, Altoe G, Steinberg AM, Pynoos RS. Trauma reminders and PTSD symptoms in children three years after a terrorist attack in Beslan. Social science & medicine (1982) 2011;72:694–700. doi: 10.1016/j.socscimed.2010.11.030. [DOI] [PubMed] [Google Scholar]
  • 133.Cukor J, Wyka K, Mello B, et al. The longitudinal course of PTSD among disaster workers deployed to the World Trade Center following the attacks of September 11th. J Trauma Stress. 2011;24:506–514. doi: 10.1002/jts.20672. [DOI] [PubMed] [Google Scholar]
  • 134.Implementing CBT for traumatized children and adolescents after september 11: lessons learned from the Child and Adolescent Trauma Treatments and Services (CATS) Project. J Clin Child Adolesc Psychol. 2007;36:581–592. doi: 10.1080/15374410701662725. [DOI] [PubMed] [Google Scholar]
  • 135.Hemenway D. Private guns, public health. University of Michigan Press; 2004. [Google Scholar]
  • 136.Hemenway D, Barber C, Miller M. Unintentional firearm deaths: a comparison of other-inflicted and self-inflicted shootings. Accident Analysis & Prevention. 2010;42:1184–1188. doi: 10.1016/j.aap.2010.01.008. [DOI] [PubMed] [Google Scholar]
  • 137.Johnson RM, Coyne-Beasley T, Runyan CW. Firearm ownership and storage practices, U.S. households, 1992–2002. A systematic review. American journal of preventive medicine. 2004;27:173–182. doi: 10.1016/j.amepre.2004.04.015. [DOI] [PubMed] [Google Scholar]
  • 138.Grossman DC, Mueller BA, Riedy C, et al. Gun storage practices and risk of youth suicide and unintentional firearm injuries. Jama. 2005;293:707–714. doi: 10.1001/jama.293.6.707. [DOI] [PubMed] [Google Scholar]
  • 139.Butkus R, Doherty R, Daniel H. Reducing firearm-related injuries and deaths in the United States: executive summary of a policy position paper from the American College of Physicians. Ann Intern Med. 2014;160:858–860. doi: 10.7326/M14-0216. [DOI] [PubMed] [Google Scholar]
  • 140.Campaign TA. ASK - Asking Saves Kids. 2015 [Google Scholar]
  • 141.Vernick JS, O’Brien M, Hepburn LM, Johnson SB, Webster DW, Hargarten SW. Unintentional and undetermined firearm related deaths: a preventable death analysis for three safety devices. Injury Prevention. 2003;9:307–311. doi: 10.1136/ip.9.4.307. [DOI] [PMC free article] [PubMed] [Google Scholar]

RESOURCES