Abstract
Background
Overdose Fatality Review (OFR) is an important public health tool for shaping overdose prevention strategies in communities. However, OFR teams review only a few cases at a time, which typically represent a small fraction of the total fatalities in their jurisdiction. Such limited review could result in a partial understanding of local overdose patterns, leading to policy recommendations that do not fully address the broader community needs.
Objective
This study explored the potential to enhance conventional OFRs with a data dashboard, incorporating visualizations of touchpoints—events that precede overdoses—to highlight prevention opportunities.
Methods
We conducted 2 focus groups and a survey of OFR experts to characterize their information needs and design a real-time dashboard that tracks and measures decedents’ past interactions with services in Indiana. Experts (N=27) were engaged, yielding insights on essential data features to incorporate and providing feedback to guide the development of visualizations.
Results
The findings highlighted the importance of showing decedents’ interactions with health services (emergency medical services) and the justice system (incarcerations). Emphasis was also placed on maintaining decedent anonymity, particularly in small communities, and the need for training OFR members in data interpretation. The developed dashboard summarizes key touchpoint metrics, including prevalence, interaction frequency, and time intervals between touchpoints and overdoses, with data viewable at the county and state levels. In an initial evaluation, the dashboard was well received for its comprehensive data coverage and its potential for enhancing OFR recommendations and case selection.
Conclusions
The Indiana touchpoints dashboard is the first to display real-time visualizations that link administrative and overdose mortality data across the state. This resource equips local health officials and OFRs with timely, quantitative, and spatiotemporal insights into overdose risk factors in their communities, facilitating data-driven interventions and policy changes. However, fully integrating the dashboard into OFR practices will likely require training teams in data interpretation and decision-making.
Keywords: overdose prevention, dashboards, fatality review, data integration, visualizations, visualization, dashboard, fatality, death, overdose, overdoses, overdosing, prevention, develop, development, design, interview, interviews, focus group, focus groups, touchpoints, touchpoint, substance abuse, drug abuse
Introduction
Background
The escalating drug overdose epidemic in the United States continues to pose a major public health challenge. Previous research has identified general risk factors that are linked to increased overdose rates [1-3], including unstable housing [4,5], recent release from incarceration [6,7], and frequent visits to the emergency department (ED) [8-11]. However, overdose risk factors exhibit considerable variation across communities and are influenced heavily by geographic and demographic disparities, particularly in access to health care and prevention services [9,12]. Moreover, the evolving nature of the epidemic has led to shifting risk profiles among different subpopulations [13]. These disparities underscore the need for timely and data-driven interventions that are tailored to the specific needs and challenges of local communities.
One mechanism for implementing targeted, community-specific interventions is through local Overdose Fatality Reviews (OFRs). Modeled after child fatality reviews [14,15], OFR teams comprise reviewers from multiple agencies who conduct collaborative, in-depth reviews of case files for individuals who have died of overdose [16,17]. Through these detailed case reviews, OFRs identify service gaps and recommend strategies to prevent future overdoses in their communities. The use of OFRs has gained momentum, with teams operating across various US localities [18]. However, current OFR practices primarily focus on reviewing only a handful of cases, typically 2 to 5 monthly or quarterly [19]. These cases typically represent a small fraction of the total fatalities occurring in their jurisdiction. While informative, the emphasis on a few individual cases could skew the review process, leading to OFRs making recommendations that do not fully address broader overdose trends.
As local governments continue to collect data on overdose events, there is an opportunity to leverage these data to enhance the OFR process. Previous research demonstrates the value of linking administrative data sets routinely collected by state governments (eg, calls to emergency services and incarceration records) with overdose mortality data [20-24]. For example, cross-referencing the records of decedents who experienced overdoses from across various data sets allows for uncovering their “touchpoints”—interactions with health and social services and other local systems they had before their overdose. When brought to light, touchpoints offer key opportunities to engage at-risk individuals and connect them with prevention services and treatments [25-27]. Analyses to identify touchpoints have so far been performed manually by researchers. However, the process is amenable to automation, enabling continuous assessment of touchpoint characteristics. The results can then be communicated in real time to local OFRs through a dashboard, providing review teams with up-to-date, quantitative information on the trajectories of decedents in their communities.
Dashboards have proven invaluable in public health settings [28,29] owing to their ability to visually summarize key metrics and statistics [30,31], thereby aiding surveillance and fostering evidence-based responses to emerging health threats [32,33]. Furthermore, dashboards are conducive to collaborative sense making among multiple individuals [34-36]. This feature makes them particularly suited to fatality review meetings, which are designed to be collaborative and deliberative in nature. Numerous dashboards have been developed to visualize drug overdose–related data [37-39]. However, existing solutions are primarily intended to surveil the level and distribution of overdoses as opposed to understanding events that precede them. Few of the earlier dashboards showcase touchpoints at the local level or update data in real time, making them less suited for understanding system-level gaps or for deriving prevention-oriented insights.
Aims
This study presents findings from human-centered research, design, development, and initial evaluation of a dashboard aimed at supporting OFR teams by visualizing overdose touchpoint statistics. The objective was to provide county-level OFR teams with timely and actionable data on events that consistently precede fatal overdoses in their communities. In doing so, we aimed to illuminate additional opportunities for interventions at the population level beyond what can be gleaned from individual fatality case reviews. The goal was to increase the chance of successful targeting and implementation of OFR recommendations. This stands to improve overdose prevention and reduce the number of preventable deaths.
Methods
Overview
To design a dashboard suitable for the needs of OFRs, we adopted a user-centered design framework [40,41] drawing on participatory methods to engage stakeholders in the process [42,43]. Specifically, we conducted focus groups with a panel of OFR experts to elicit perspectives on requirements and data needs, envision design possibilities, and document potential challenges. The elicited requirements were then used to develop exploratory visualizations of touchpoints data. The initial visualizations were further refined based on feedback from the expert panel. Subsequently, the revised visualizations were used to develop a web-based dashboard that is hosted by the Indiana state government.
Study Setting and Data Sources
We partnered with the state government of Indiana to prototype and develop the sought touchpoints dashboard. Indiana has a nationally recognized role in organizing and convening OFRs, with 28 active review teams organized at the county level and supported by the Indiana Department of Health. Similar to many other states, Indiana maintains a comprehensive and up-to-date database of fatal overdoses. This database includes all suspected accidental poisonings (coded as X40-X44), intentional poisonings (X60-X64), assaults by drug (X85), and cases of undetermined intent (Y10-Y14) that occurred among Indiana residents. In addition to overdose data, the state maintains administrative data sets from various agencies, including incarceration records, emergency and medical service use, and prescription dispensation. Importantly, these administrative data sets are linkable to the overdose mortality records. The Indiana Management Performance Hub (MPH), a state-level agency, serves as a central repository for these data sets, which are gathered from the corresponding agencies.
To identify events that precede drug-related fatalities, overdose cases are linked to administrative data sets at the individual level. This linking procedure is performed by the MPH using a probabilistic matching algorithm that considers identifiers such as the decedent’s name, date of birth, and social security number, among others. This process allows for the reconstruction of past interactions with various touchpoints for each identifiable decedent. Subsequently, deidentified statistics about these interactions are pushed to the dashboard for visualization. This linkage process is performed weekly, enabling (near) real-time updates of the visualizations.
User-Centered Design Process
To inform the design of the dashboard, we conducted 2 focus groups with a panel of OFR experts. We recruited participants via email, inviting experienced OFR practitioners and early developers from across the United States. Our goal in these focus groups was to understand OFR information needs and leverage the panel’s experience in conceptualizing, co-designing, and refining visualizations. The focus groups took place virtually using Zoom videoconferencing software (Zoom Video Communications). A virtual whiteboard was used to place and arrange “Post-it”–style notes. Participating experts were recruited from the same pool, with later focus groups involving fewer participants to allow for convergence and facilitate more in-depth feedback. The focus groups were video recorded, transcribed, and analyzed using thematic analysis techniques [44].
The first focus group sought to uncover data access barriers and needs for OFR teams. A total of 13 experts participated in the discussion. Participants were first prompted to share challenges and “pain points” regarding access to data. In a second activity, participants were divided into 2 breakout groups to identify key data attributes essential for review teams. They also gave high-level design parameters for the dashboard. Finally, participants reflected on their hopes and concerns for the dashboard’s integration into OFR processes, emphasizing potential positive outcomes and addressing apprehensions.
On the basis of the findings of the initial focus group, we created a series of 6 initial visualizations that illustrate overdose touchpoints using a static snapshot of the MPH-linked data set described previously. These initial visualizations served as the foundation for a second focus group with the participation of 6 experts. During this session, a facilitator presented each of the 6 visualizations and prompted participants for feedback. Specifically, participants were asked to evaluate the ease of understanding of these visualizations and their potential usefulness in the OFR process. We sought additional input by conducting a survey of 5 experts. The survey presented the same initial visualizations and requested open-ended comments on their intuitiveness and utility. Insights gathered from the survey along with feedback obtained during the second focus group were used to refine the visualizations and develop an interactive dashboard.
Dashboard Evaluation
To obtain feedback on the final dashboard, we conducted an initial assessment with 3 OFR experts. Participants were asked to perform a series of data extraction tasks (eg, identifying the touchpoint with the highest prevalence). In addition, they were prompted to make recommendations based on the observed touchpoint patterns, simulating the use of the dashboard within a typical OFR meeting.
Ethical Considerations
This human-centered research was reviewed and approved by the Indiana University institutional review board (approval 17809). Participants received an information sheet explaining the study goals and procedures before agreeing to take part. The analysis of state mortality and administrative data sets, while not considered human participant research, followed state legal and ethical procedures. The dashboard displays only aggregate, population-level visualizations. No individual records are released or displayed to preserve anonymity. Furthermore, special care was taken to minimize the risk of reidentification by withholding actual event counts and substituting with percentages. Participants received a US $100 gift card as compensation.
Results
Overview
Participants highlighted barriers faced by OFRs in accessing and interpreting data within the context of fatality reviews. They also provided insights on what data attributes and features would be most useful for OFRs to look at. We report these findings and discuss how we incorporated them to create a real-time dashboard for visualizing overdose touchpoints.
Barriers to Accessing and Using Data
Data Accessibility
Several participants highlighted the lack of access to data as one of the major barriers in fatality reviews. Some of these barriers stem from challenges in sharing available data due to legal restrictions, data security, and privacy concerns:
Asking our state offices for data would result in, “Sorry, we can't share on the state level.” There [needs to] be intergovernmental agreements between state police or our mental health or our human services or our health department.
P2
[Gaining access] is always an issue, and especially without laws that allow for the OFRs to get this. I know we had a lot of laws related to the child death review teams that I worked with that allowed us access to data, but it wasn't always the same for other death review teams.
P11
While recognizing existing regulatory and logistical obstacles, participants anticipated that increasing data access could empower OFRs to make more informed decisions:
We’re trying to drive positive change that could maybe be implemented statewide, and they just give us a little bit. It [data] would give us the power to make better decisions.
P2
In addition to data access, the quality and accuracy of the data were also brought up as a prominent issue for OFRs, especially because of acknowledged variations in how data are coded and measured across different organizations. For example, 1 participant cited different standards for classifying services, noting that such inconsistencies could lead to misinterpretation:
When it’s really law enforcement heavy, they’re not understanding the public health ramifications of criminal justice involvement. It affects the lens from which data’s being collected. So, when I go through the qualitative data...we’ve got people identifying jail substance use services as harm reduction, [and] you end up collecting some inaccurate data, which then misinforms the big picture.
P7
Influx of Case-Specific Data
While obtaining population-level data in certain arenas proved challenging, another concern was the vast amount of case-specific data that OFRs must already contend with. Participants noted that review teams are increasingly tasked with handling large volumes of individual reports from multiple systems, which often need to be manually and qualitatively analyzed at considerable time and effort:
OFRs collect an enormous amount of data, but you really need a whole army of researchers to be able to analyze it, especially the qualitative data. When the teams are putting forth all of these recommendations, it’s just so hard to go through all the information and make a meaningful plan of it.
P7
Extensive data on individual death circumstances (as opposed to population-level statistics) reflect a conventional OFR focus on in-depth reviews of a few strategically selected cases. However, with the sheer number of overdose fatalities, it becomes difficult for OFRs to ensure that the selected cases represent the broader overdose patterns and risk factors prevalent in their community. One participant put it as follows:
[My experience] is that they would just randomly pick cases and then do a really deep dive into those cases, but you have no way to actually ensure that those are representative...And so, my hope had been that we would have certain [data] fields that we could have someone enter, and then that would allow us to do really large-scale analysis over the course of multiple years...[This] would have allowed us to really have a good sense as it relates to a variety of factors, but there just wasn’t capacity. So, then we're just picking cases that look good or meet some theme to be able to have a more robust conversation at any given meeting. But again, they're not necessarily representative and you don't end up having the whole picture.
P18
Key Data Types and Attributes for the Dashboard
Participants identified key data attributes that they deemed essential for inclusion in a dashboard. We divided these attributes into 3 categories: touchpoints, social determinants of overdose risk, and case-specific data.
Touchpoints
Touchpoints represent interactions with systems and services before overdose. Thus, they serve as opportunities to connect people who use drugs with additional prevention services and treatments, potentially mitigating the risk of future overdoses. A frequently recurring set of touchpoints identified by experts was interaction with the justice system. For instance, the duration between a decedent’s overdose and their last incarceration or residential treatment was cited as particularly important:
Were they justice involved or not at any point, but also the average distance in time from their last incarceration...So, to see were they in that window of high risk. And same if they were in residential treatments as average number of days.
P3
Average days out from treatment and incarceration because I feel like those are solid spaces that action can be taken.
P5
Several participants pointed to interactions with justice systems broadly as key touchpoints. Agencies such as county sheriffs, local police departments, and child protective services were thought to play a crucial role in an individual’s risk of overdose both positively and negatively:
Justice systems can either be a force of treatment or a barrier to treatment. I think that involvement is really important...the extent of involvement can be really helpful to inform the justice system and the legislative changes that could help.
P4
Participants noted that data on criminal justice touchpoints might reveal new prevention opportunities or support policy recommendations, such as facilitating continued treatment for institutionalized individuals:
...keep people engaged in treatment, [such that] we’re not disrupting treatment by violating [ie, rearresting] people and incarcerating them...It’s a fruitful area for policy change. Most of our policy changes and recommendations from our OFR have been in the justice space.
P3
In addition to justice systems, participants noted interactions with health and medical facilities as crucial touchpoints. This included visits to the ED and emergency medical services (EMS):
Do we have one [attribute] here [on] the last date of medical intervention? Maybe like an ED visit or anything like that?
P4
There’s an ED and EMS interaction right at the center there.
P5
Overall, three primary touchpoint categories emerged: (1) encounters with the justice system, such as incarceration; (2) engagement with health services, including ED and EMS interactions; and (3) involvement with residential treatment services. These touchpoints were recognized by participants as crucial opportunities for understanding risk factors and implementing services to close treatment gaps. Importantly, participants emphasized the typical interval between these touchpoints and overdose events as a critical feature to emphasize in the dashboard.
Social Determinants of Health
A second set of data attributes identified pertained to the social condition of the individuals themselves, which could shed light on factors that contribute to elevated overdose risk. For example, one of these factors was demographics:
Basic demographic information like poverty level, education level, homelessness. Anything that would affect those social determinants of health.
P4
A second factor was individuals’ access to harm reduction services, as the same participant noted:
I was going to add...access to harm reduction services. So, what an environmental scan of resources or access to naloxone, treatment centers, syringe service programs, all those different community level access points.
P4
A third factor was housing, encompassing the shelter system and housing agencies:
Access to housing. Or maybe it’s access to shelter because it could be both. There’s housing policy, but then there’s also the shelter systems.
P5
A fourth factor was the availability of transportation, which, according to participants, could influence an individual’s access to treatment and harm reduction services:
Transportation between places: how easy is it for someone to get from point A to point B? Even if there’s a syringe service program down the street, can they get to it? That kind of thing.
P5
Finally, participants also identified upstream social determinants such adverse childhood experiences as potentially relevant factors in assessing overdose risk:
...and some of that I think would fall under ACEs too because even if they’re an adult, finding out if they were involved in that system as a child, trying to make some of those associations maybe.
P5
Case-Specific Data
Alongside touchpoints and social determinants of health, participants cited certain case-specific data, including toxicology reports, interviews with next of kin, and the decedent’s circumstances at the time of death (eg, their position and whether they were alone). While these attributes are relevant to reviewing individual cases, they were not considered for inclusion in the dashboard as our primary objective was to offer population-level data that complement rather than supplant the conventional OFR case review model.
Apprehensions and Foreseen Challenges
Although participants were positive about the potential of the dashboard to enhance the OFR process, there were a few apprehensions. A major concern was the risk of unintentional identification of decedents in smaller counties, where there are fewer overdose deaths:
I’ve been aware of a couple different cases in relatively small communities where all the data says one thing, and of course, as a small community, we know exactly who we’re talking about.
P15
I think one [concern] would be that the information might be too identifiable, especially for small communities.
P8
Participants discussed the ethics of displaying data that might be inaccurate or that could be misused (eg, by law enforcement) to target at-risk individuals:
...that it has inaccurate and bad data. And that it is used for evil rather than for good...That it’s not used for bad downstream consequences kind of thing.
P6
Finally, participants raised the risk of misinterpreting data, noting that, while OFRs have expertise in studying individual histories of decedents to formulate recommendations, they are less familiar with analyzing population-level statistics. Some voiced reservations about OFR teams’ data literacy and their ability to draw appropriate inferences from such quantitative data. For instance, 1 participant gave an example of how a decrease in emergency medical events could be erroneously interpreted as a reduction in overdoses when it might only reflect fewer 911 calls:
That [error] where you have a number and you think it means one thing, but it means another thing...You have measured something, but not the thing that you are taking that thing to be.
P1
Others commented on the potential downstream consequences of misinterpreting data, which could manifest as inappropriate or even detrimental recommendations:
We’ve seen this trend in our data. That probably means X, Y, Z. And you might be right. You might be very wrong, and the data might be used to justify a policy or programmatic intervention that could in fact exacerbate it.
P17
Helping users interpret data accurately was deemed by participants as a critical consideration for the dashboard. Equally important was not to inundate OFRs with even more (population-level) data that teams may lack the bandwidth or data literacy skills to act upon. These insights underscore the need to craft intuitive data visualizations that can be comprehended accurately with minimal effort. Moreover, such displays should actively guide OFR teams into making valid inferences from the data presented.
Touchpoints Selection
Our observations point to a longstanding limitation of current OFR practices, which focus on reviewing a handful of overdose cases at every meeting. OFR experts appeared to recognize the shortcomings of this model when pitted against the sheer volume of overdoses. Simultaneously, participants expressed strong interest in accessing additional data sets that would paint a broader picture of overdose risk factors and touchpoints in their community, provided that these data were consistently coded, intuitively summarized, and presented in a manner that did not overburden review teams.
Among the data emphasized by participants, touchpoints emerged as particularly actionable as they represent system interactions preceding overdose events. For instance, the proportion of decedents who used various touchpoints offers predictive power to identify the most effective points within the system for targeting at-risk individuals with prevention services. Moreover, understanding the typical time window between a touchpoint and an overdose event, along with the frequency of touchpoint use, can assist in designing interventions, including their timing and regularity.
Drawing on the insights of the expert panel and data availability in Indiana, we incorporated 5 touchpoint types into the dashboard: jail bookings, prison releases, visits to the ED, encounters with EMS, and prescriptions for controlled substances (eg, opioid analgesics). We excluded ED and EMS encounters occurring within a 24-hour window of death as those are likely to represent interactions directly related to the overdose event as opposed to potential touchpoints for prevention purposes. Interactions with both justice and medical systems were identified as key by the expert panel. Prescriptions for scheduled drugs, such as opioid analgesics, were included as touchpoints due to their established association with overdose risk [25]. We also included the dispensation of buprenorphine prescriptions as a touchpoint in the initial dashboard design. However, concerns were raised that singling medication for opioid use disorder as a separate touchpoint could cause it to be misconstrued as a causal risk factor for overdose. Consequently, buprenorphine data were merged and included among the general prescription dispensation touchpoint for scheduled drugs. Table 1 provides a summary of these touchpoints as highlighted by participants and featured in the dashboard. Although interactions with residential treatment services were identified as an important touchpoint by participants, related data are not centrally tracked by the state and, hence, were not available for inclusion in the dashboard. Moreover, social determinants of health are not currently included despite their relevance as the dashboard was intended to prioritize opportunities for immediate as opposed to upstream prevention. Case-specific attributes were also not considered for inclusion because they would be redundant to the traditional OFR case review process.
Table 1.
Data type and attribute | Identified by expert panel? | Included in dashboard? | |
Touchpoint | |||
|
Jail booking | No | Yes |
|
Release from prison | Yes | Yes |
|
Visit to the EDa | Yes | Yes |
|
Encounter with EMSb | Yes | Yes |
|
Interaction with residential treatment services | Yes | No |
|
Prescription dispensation for scheduled drugs, including opioid analgesics and MOUDc | No | Yes |
Social determinants | |||
|
Demographics | Yes | No |
|
Educational level | Yes | No |
|
Poverty | Yes | No |
|
Access to harm reduction services | Yes | No |
|
Housing | Yes | No |
|
Access to transportation | Yes | No |
|
Adverse childhood experiences | Yes | No |
Case-specific attributes | |||
|
Toxicology report | Yes | No |
|
Next-of-kin interviews | Yes | No |
|
Circumstances of death (eg, body position and presence of witnesses) | Yes | No |
aED: emergency department.
bEMS: emergency medical services.
cMOUD: medication for opioid use disorder.
Initial Visualization Attempts
Our initial visualization focused on timelines, illustrating cohorts of decedents who exhibited similar patterns of touchpoints before overdosing. For example, in Figure 1 (left), each row represents hundreds of decedents who exhibited a similar touchpoint sequence (eg, jail booking followed by one or more ED visits and then a series of prescriptions). This particular visualization was inspired by OFR teams’ use of timelines to represent the histories of individuals discussed during case reviews. However, these initial visualizations received mixed reviews from the expert panel—while they were considered appealing and “interesting,” the focus on cohorts was seen as providing excessive detail for OFRs. This feedback was used to revise the visualizations and develop a final dashboard.
Final Dashboard
The dashboard consists of 3 primary displays (Figure 2A) showing the prevalence and rates, frequency, and recency for the 5 touchpoints. The dashboard can be accessed at the MPH website [45].
Prevalence and Rates
By default, the dashboard displays touchpoint prevalence, depicting the percentage of decedents who used various touchpoints in the 12 months preceding overdose. For instance, in 2022, the highest-prevalence touchpoint was the ED, with 61% of individuals who overdosed in Indiana having visited the ED within a year before dying (Figure 2B). The user can also see the change in prevalence over time. For example, the data show that the prevalence of ED visits decreased over time, whereas the proportion of decedents who use EMS increased >2 times between 2015 and 2022 (Figure 2D). In addition to showing state levels, the dashboard can break down the data by county. For instance, the user can see the prevalence of ED visits in different counties on a map (Figure 2C). Notably, the map shows 4 counties in which practically all decedents had visited the ED a year before their overdose. The map can also be used to filter the bar or line graph displays. For example, clicking on Marion County, the most populous in Indiana, updates the display to show statistics for Marion only (Figure 3).
In addition to prevalence, the dashboard visualizes the rate of touchpoints among decedents. These rates depict the number of fatal overdose cases per 100,000 individuals who typically use services such as the ED. Unlike prevalence, which indicates the likelihood of a decedent using a touchpoint, rates reveal the probability of a fatal overdose after using 1 of the 5 legal or medical touchpoints included in the dashboard. Both measures are important for resource allocation—while prevalence helps users identify touchpoints with the broadest reach, rates can reveal more “efficient” touchpoints for targeted interventions. For example, consider jail bookings and releases from prison (Figure 3 [right]), which exhibit the highest rates among touchpoints in Marion County. This offers a high-specificity opportunity to focus on individuals at a greater risk of overdosing despite these touchpoints exhibiting relatively moderate to low prevalence at the state level (23% and 3%, respectively, as depicted in Figure 2 [left]).
Touchpoint Frequency
The second display summarizes the average number of interactions a decedent had with a touchpoint in the year preceding their overdose (Figure 4). Notably, the most frequently used touchpoint in the state is medical prescription (Rx) dispensation for controlled substances, such as an opioid analgesic (12.7 events on average at the time of writing). The user can also see how this frequency changes yearly (Figure 4 [right]). The line graph shows relatively stable use for ED, EMS, and criminal justice services, with the average number of Rx dispensations trending down slightly.
Recency
The timing of interaction with services was identified as a key factor for OFRs. Accordingly, the recency display illustrates the typical time intervals between final touchpoints and overdose events (Figure 5). The top features a “lollipop” chart depicting the number of days on average between the most recent interaction and the overdose (Figure 5 [top]). In this example, jail bookings in Jay County (selectable by the user) occur approximately 210 days on average before a fatal overdose compared to approximately 150 days for the entirety of Indiana. Conversely, releases from prison tend to happen approximately 120 days before the overdose, closer relative to the state average. The bottom visualizations show a curve for each touchpoint representing the cumulative percentage of individuals who could have been engaged at various time points relative to their time of death. In this case, approximately 27% of decedents in Jay County could have been engaged through an Rx dispensation touchpoint 30 days before an overdose.
Aiding Data Interpretation
One concern that emerged during the focus groups regarded OFR teams’ ability to interpret population-level statistics. To aid users in making sense of these data, the dashboard provides tooltips in the form of short text annotations that explain the interpretation of each visualization. For instance, in the recency chart, the text clarifies that the points depict the average number of days between a touchpoint and an overdose event (Figure 6).
Initial Evaluation Results
We invited 3 OFR experts to review and provide feedback on the dashboard. They commented on features they thought were beneficial. They also provided suggestions on how to ensure dashboard integration into OFR practices. One of the notable strengths of the dashboard was its comprehensive data coverage, a feature that was highly appreciated by all participants. They specifically praised the breakdown of touchpoints on a county basis, a level of granularity that is often lacking in existing dashboards. The inclusion of small counties, the data on which can be especially difficult to obtain, was recognized as a significant advantage. Participants also appreciated the ability to compare different counties through the map, along with the ability to juxtapose county-specific data against state averages.
Among the various visualizations, the recency chart (referred to as the “timeline”) stood out for its depiction of events leading up to overdoses. Participants thought that these temporal data, which can be difficult to obtain at the population level, can help in tailoring interventions:
It is interesting to see this [chart], and to know what can be done with data. We can check the timeline and help implement a strategy. Through these strategies, we can outline short, medium, and long-term goals.
In thinking about how the dashboard might complement existing OFR practices, participants highlighted its usefulness in guiding case selection for review and helping OFRs build a representative case profile. One participant specifically noted the potential of the dashboard in conducting “community data review” to explore “what is going on in my community.” Moreover, the dashboard’s availability on a publicly accessible URL was lauded as “a wonderful resource,” extending its value to audiences beyond OFRs. The discussion opened the door for offering some form of training or educational support to OFR members, equipping review teams with skills to interpret quantitative data. One participant suggested the addition of a “demo video to help interpret and apply the data.” Another suggested the need to specifically focus on OFR facilitators as crucial personnel for communicating data insights to review teams:
I don’t think they [members of the review teams], will be able to fully understand the data, so training the facilitator will be key.
Discussion
Principal Findings
OFR teams are proliferating in the United States, becoming an important public health tool to combat the drug overdose crisis. Traditional fatality reviews, often limited to a few cases, do not fully capture the broader overdose trends, especially in communities with numerous drug-related fatalities. This research aimed to enhance OFR data use by addressing data access barriers, identifying information needs, and creating actionable visualizations of population-level overdose data.
Our findings shed light on challenges that OFR teams face in accessing timely data, frequently impeded by legal constraints. When available, these data can often be inconsistent, for example, in the coding of events and classification of services. Despite these challenges, OFR teams seemed keen on incorporating a wider range of data into their review to better understand the factors contributing to overdose risks in their communities. Notably, the expert panel highlighted several key touchpoints, including incarcerations, interactions with substance treatment services, and visits to medical facilities such as EDs.
Some of these touchpoints have been previously recognized as opportunities for delivering prevention services [25,46,47]. For example, the time window following a prison release has been identified as a particularly critical and risky period, making this touchpoint a highly specific and valuable opportunity for administering prevention services [48-50]. However, effectively sharing these data insights with OFRs remains a challenge. Our findings suggest that a dashboard linking state administrative and mortality data could effectively provide local OFRs with insights on the timing and distribution of touchpoints. To explore this potential, we partnered with the Indiana state government and developed a dashboard that collates and visualizes data on 5 touchpoints at the county level, enabling OFR teams to see statistics and patterns on events that precede fatal overdoses in their community. To our knowledge, this is the first system to automatically analyze touchpoint characteristics and offer (near) real-time visualizations of their prevalence, frequency, and timing tailored to the local scale of OFR teams. In designing the dashboard, we specifically focused on this user group and prioritized actionable data that shed light on local prevention opportunities. The developed touchpoint dashboard stands in contrast to earlier dashboards for opioid prescription and overdose data, which are meant for the public or nonspecified stakeholders.
Our OFR expert panel suggested that one of the most crucial pieces of information is the timing of touchpoints—specifically, the average duration between an individual’s last encounter and their overdose. The dashboard prominently features these data in a lollipop chart comparing the recency of various touchpoints. In addition, we incorporated displays of touchpoint prevalence and rates, providing insights into the reach of touchpoints and the specificity they afford for targeting individuals who are at high risk of overdose. The dashboard purposely uses familiar visualizations, including bar and line graphs and choropleth maps, to appeal to review teams who may be novice visualization users [51]. Importantly, the dashboard breaks down these statistics at the county level, aligning with how OFRs are organized in Indiana. By visualizing data “close to home,” we aimed to improve the actionability of the dashboard [52]. However, users can easily compare county data to state averages or those of other similar counties.
Our initial evaluations show promise for the dashboard’s usefulness. However, successfully integrating the dashboard into OFR practices will likely require training for OFR members, many of whom lack expertise in data analysis—a point that was notably underscored by the expert panel. In particular, teams may need educational support in how to interpret population-level features, such as the difference between the prevalence and rates of touchpoints. Regular meetings with OFR users could also help uncover usability issues and gauge dashboard adoption by review teams.
While the dashboard offers detailed insights into community touchpoints, it omits data on social determinants such as race, educational level, and access to housing and harm reduction services. These factors can be important for understanding overdose risks, as per our expert panel and research findings [53,54]. Future versions of the dashboard could incorporate local statistics on these risk factors. Furthermore, it is possible to expand the current list of touchpoints to include specific events associated with social determinants, such as loss of housing or employment. These additional touchpoints could offer further intervention avenues to disrupt pathways from marginalization to overdose [55]. Another limitation is that, while the dashboard includes critical touchpoints such as ED and EMS encounters, these events currently lack classification. Adding a breakdown of these touchpoints, for example, by distinguishing between substance-related versus other EMS encounters, could enable OFR teams to further tailor their recommendations.
The experts interviewed also sought demographic breakdowns of touchpoint data, in part to ensure that diverse populations would benefit from interventions at touchpoints. Unfortunately, this feature was not included in the current dashboard due to reidentification risks, particularly in rural areas that have fewer overdoses. In the future, the dashboard could be modified to provide a demographic breakdown of touchpoints at the aggregate (eg, state) level to substantially decrease the risk of reidentification instead of withholding these data altogether. To further protect individual confidentiality, which was a key concern of our expert panel, the dashboard presents data as percentages (eg, the proportion of decedents who were released from prison within a year before their overdose) and rates. Withholding the actual counts for events helps prevent the inference of individual identity in places where those counts are low. The dashboard provides a visual warning for statistics based on <20 cases, cautioning users against drawing strong conclusions from small samples. Future work could use more advanced privacy-preserving techniques [56,57], thus allowing for the display of a wider range of attributes without jeopardizing anonymity.
Although our dashboard is specific to Indiana, we believe that the approach could be adapted for other US states and localities. This expansion requires access to overdose mortality records that can be algorithmically cross-referenced with other administrative data sets. Many states already have data infrastructure for such linked analyses [58,59]. We estimate that the development and maintenance of the dashboard over 2 years will require approximately 350 personnel hours assuming the availability of data. The prevalence of overdose dashboards [39,60] indicates both the technical feasibility of creating such tools and the interest in them from the public health community. Our research demonstrates that dashboards can go beyond surveillance to directly visualize actionable prevention opportunities.
Conclusions
OFRs can play a crucial public health role in understanding overdose cases and recommending prevention strategies. This study explored the potential for enhancing these reviews with population-level data for broader, quantitative insights into risk factors. Following a user-centered design process, we developed a dashboard that tracks and visualizes decedents’ encounters with medical and justice systems at the county level. Although initially designed for Indiana, the dashboard can be adapted to other localities, leveraging administrative and mortality data typically collected by local governments. Preliminary evaluation shows the potential utility of the dashboard for analysis and case selection but emphasizes the need for training OFR members in data interpretation and decision-making.
Acknowledgments
The authors thank the Indiana Department of Health; the Department of Homeland Security; the Indiana State Police; the Professional Licensing Agency; the Department of Correction; and the Governor’s Drug Prevention, Treatment, and Enforcement Office for providing data for use in the dashboard and for feedback. This research was supported by the Helping to End Addiction Long-term Initiative through the Data 2 Action program (award R61DA057660). The work was also supported in part by Research Jam, the Indiana Clinical and Translational Sciences Institute Patient Engagement Core through an award from the National Institutes of Health, National Center for Advancing Translational Sciences Clinical and Translational Science Award (award UM1TR004402). The authors acknowledge Michelle Tran, BS, for her contributions to this work. The contents of this publication are solely the responsibility of the authors and do not necessarily represent the official views of the National Institutes of Health or participating organizations.
Abbreviations
- ED
emergency department
- EMS
emergency medical services
- MPH
Management Performance Hub
- OFR
Overdose Fatality Review
- Rx
medical prescription
Data Availability
The video recording data sets generated during and analyzed during this study are not publicly available to protect participants’ confidentiality but are available from the corresponding author on reasonable request. The aggregate touchpoints data sets are available in the Management Performance Hub (MPH) data repository [61].
Footnotes
Authors' Contributions: AS and LAG analyzed the data and wrote the manuscript. BPC conducted the focus group and analyzed the data. SEW directed the human-centered research process and provided manuscript revisions. KC, JC, and TB developed the dashboard and the touchpoints data integration process. KS, ALD, BR, MCA, and KR edited and provided manuscript revisions. BR, MCA, and KR conceptualized the study and designed the research.
Conflicts of Interest: None declared.
References
- 1.Brady JE, Giglio R, Keyes KM, DiMaggio C, Li G. Risk markers for fatal and non-fatal prescription drug overdose: a meta-analysis. Inj Epidemiol. 2017 Dec 7;4(1):24. doi: 10.1186/s40621-017-0118-7. https://link.springer.com/article/10.1186/s40621-017-0118-7 .10.1186/s40621-017-0118-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Davoli M, Perucci CA, Forastiere F, Doyle P, Rapiti E, Zaccarelli M, Abeni DD. Risk factors for overdose mortality: a case-control study within a cohort of intravenous drug users. Int J Epidemiol. 1993 Apr;22(2):273–7. doi: 10.1093/ije/22.2.273. [DOI] [PubMed] [Google Scholar]
- 3.Webster LR. Risk factors for opioid-use disorder and overdose. Anesth Analg. 2017 Nov;125(5):1741–8. doi: 10.1213/ANE.0000000000002496.00000539-201711000-00041 [DOI] [PubMed] [Google Scholar]
- 4.Lyons RM, Yule AM, Schiff D, Bagley SM, Wilens TE. Risk factors for drug overdose in young people: a systematic review of the literature. J Child Adolesc Psychopharmacol. 2019 Aug 01;29(7):487–97. doi: 10.1089/cap.2019.0013. https://europepmc.org/abstract/MED/31246496 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Yamamoto A, Needleman J, Gelberg L, Kominski G, Shoptaw S, Tsugawa Y. Association between homelessness and opioid overdose and opioid-related hospital admissions/emergency department visits. Soc Sci Med. 2019 Dec;242:112585. doi: 10.1016/j.socscimed.2019.112585. https://europepmc.org/abstract/MED/31634808 .S0277-9536(19)30580-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Binswanger IA, Blatchford PJ, Mueller SR, Stern MF. Mortality after prison release: opioid overdose and other causes of death, risk factors, and time trends from 1999 to 2009. Ann Intern Med. 2013 Nov 05;159(9):592–600. doi: 10.7326/0003-4819-159-9-201311050-00005. https://europepmc.org/abstract/MED/24189594 .1763230 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Bukten A, Stavseth MR, Skurtveit S, Tverdal A, Strang J, Clausen T. High risk of overdose death following release from prison: variations in mortality during a 15-year observation period. Addiction. 2017 Aug 07;112(8):1432–9. doi: 10.1111/add.13803. [DOI] [PubMed] [Google Scholar]
- 8.Barboza G, Angulski K, Hines L, Brown P. Variability in opioid-related drug overdoses, social distancing, and area-level deprivation during the COVID-19 pandemic: a Bayesian spatiotemporal analysis. J Urban Health. 2022 Oct 06;99(5):873–86. doi: 10.1007/s11524-022-00675-x. https://europepmc.org/abstract/MED/36068454 .10.1007/s11524-022-00675-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Forati AM, Ghose R, Mantsch JR. Examining opioid overdose deaths across communities defined by racial composition: a multiscale geographically weighted regression approach. J Urban Health. 2021 Aug 06;98(4):551–62. doi: 10.1007/s11524-021-00554-x. https://europepmc.org/abstract/MED/34231120 .10.1007/s11524-021-00554-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ghose R, Forati AM, Mantsch JR. Impact of the COVID-19 pandemic on opioid overdose deaths: a spatiotemporal analysis. J Urban Health. 2022 Apr 18;99(2):316–27. doi: 10.1007/s11524-022-00610-0. https://europepmc.org/abstract/MED/35181834 .10.1007/s11524-022-00610-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Brady JE, DiMaggio CJ, Keyes KM, Doyle JJ, Richardson LD, Li G. Emergency department utilization and subsequent prescription drug overdose death. Ann Epidemiol. 2015 Aug;25(8):613–9.e2. doi: 10.1016/j.annepidem.2015.03.018. https://europepmc.org/abstract/MED/25935710 .S1047-2797(15)00128-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Choe K, Zinn E, Lu K, Hoang D, Yang LH. Impact of COVID-19 pandemic on chronic pain and opioid use in marginalized populations: a scoping review. Front Public Health. 2023 Apr 17;11:1046683. doi: 10.3389/fpubh.2023.1046683. https://europepmc.org/abstract/MED/37139395 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Foglia R, Kline A, Cooperman NA. New and emerging opioid overdose risk factors. Curr Addict Rep. 2021 Apr 22;8(2):319–29. doi: 10.1007/s40429-021-00368-6. https://europepmc.org/abstract/MED/33907663 .368 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Durfee M, Parra JM, Alexander R. Child fatality review teams. Pediatr Clin North Am. 2009 Apr;56(2):379–87. doi: 10.1016/j.pcl.2009.01.004.S0031-3955(09)00005-4 [DOI] [PubMed] [Google Scholar]
- 15.Rebbert-Franklin K, Haas E, Singal P, Cherico-Hsii S, Baier M, Collins K, Webner K, Sharfstein J. Development of Maryland local overdose fatality review teams: a localized, interdisciplinary approach to combat the growing problem of drug overdose deaths. Health Promot Pract. 2016 Jul 18;17(4):596–600. doi: 10.1177/1524839916632549.1524839916632549 [DOI] [PubMed] [Google Scholar]
- 16.Jones C, Bracewell K, Clegg A, Stanley N, Chantler K. Domestic homicide review committees’ recommendations and impacts: a systematic review. Homicide Stud. 2022 Apr 08;28(1):78–98. doi: 10.1177/10887679221081788. https://journals.sagepub.com/doi/10.1177/10887679221081788 . [DOI] [Google Scholar]
- 17.Parrish JW, Schnitzer PG, Lanier P, Shanahan ME, Daniels JL, Marshall SW. Classification of maltreatment-related mortality by child death review teams: how reliable are they? Child Abuse Negl. 2017 May;67:362–70. doi: 10.1016/j.chiabu.2017.03.003.S0145-2134(17)30095-9 [DOI] [PubMed] [Google Scholar]
- 18.Evaluation profile for overdose fatality reviews. Centers for Disease Control and Prevention. [2024-01-30]. https://www.cdc.gov/overdose-prevention/media/pdfs/OD2A_EvalProfile_OverdoseFatalityReviews_508.pdf .
- 19.Haas E, Truong C, Bartolomei-Hill L, Baier M, Bazron B, Rebbert-Franklin K. Local overdose fatality review team recommendations for overdose death prevention. Health Promot Pract. 2019 Jul 11;20(4):553–64. doi: 10.1177/1524839918797617. [DOI] [PubMed] [Google Scholar]
- 20.Keen C, Young JT, Borschmann R, Kinner SA. Non-fatal drug overdose after release from prison: a prospective data linkage study. Drug Alcohol Depend. 2020 Jan 01;206:107707. doi: 10.1016/j.drugalcdep.2019.107707.S0376-8716(19)30484-3 [DOI] [PubMed] [Google Scholar]
- 21.McLeod KE, Slaunwhite AK, Zhao B, Moe J, Purssell R, Gan W, Xavier C, Kuo M, Mill C, Buxton JA, Scheuermeyer FX. Comparing mortality and healthcare utilization in the year following a paramedic-attended non-fatal overdose among people who were and were not transported to hospital: a prospective cohort study using linked administrative health data. Drug Alcohol Depend. 2021 Jan 01;218:108381. doi: 10.1016/j.drugalcdep.2020.108381.S0376-8716(20)30546-9 [DOI] [PubMed] [Google Scholar]
- 22.Shefner RT, Sloan JS, Sandler KR, Anderson ED. Missed opportunities: arrest and court touchpoints for individuals who fatally overdosed in Philadelphia in 2016. Int J Drug Policy. 2020 Apr;78:102724. doi: 10.1016/j.drugpo.2020.102724.S0955-3959(20)30065-7 [DOI] [PubMed] [Google Scholar]
- 23.Stoové MA, Dietze PM, Jolley D. Overdose deaths following previous non-fatal heroin overdose: record linkage of ambulance attendance and death registry data. Drug Alcohol Rev. 2009 Jul 06;28(4):347–52. doi: 10.1111/j.1465-3362.2009.00057.x.DAR057 [DOI] [PubMed] [Google Scholar]
- 24.Tseregounis IE, Henry SG. Assessing opioid overdose risk: a review of clinical prediction models utilizing patient-level data. Transl Res. 2021 Aug;234:74–87. doi: 10.1016/j.trsl.2021.03.012. https://europepmc.org/abstract/MED/33762186 .S1931-5244(21)00075-X [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Larochelle MR, Bernstein R, Bernson D, Land T, Stopka TJ, Rose AJ, Bharel M, Liebschutz JM, Walley AY. Touchpoints - opportunities to predict and prevent opioid overdose: a cohort study. Drug Alcohol Depend. 2019 Nov 01;204:107537. doi: 10.1016/j.drugalcdep.2019.06.039. https://europepmc.org/abstract/MED/31521956 .S0376-8716(19)30296-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Ray B, Christian K, Bailey T, Alton M, Proctor A, Haggerty J, Lowder E, Aalsma MC. Antecedents of fatal overdose in an adult cohort identified through administrative record linkage in Indiana, 2015-2022. Drug Alcohol Depend. 2023 Jun 01;247:109891. doi: 10.1016/j.drugalcdep.2023.109891. https://linkinghub.elsevier.com/retrieve/pii/S0376-8716(23)00129-1 .S0376-8716(23)00129-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Krawczyk N, Schneider KE, Eisenberg MD, Richards TM, Ferris L, Mojtabai R, Stuart EA, Casey Lyons B, Jackson K, Weiner JP, Saloner B. Opioid overdose death following criminal justice involvement: linking statewide corrections and hospital databases to detect individuals at highest risk. Drug Alcohol Depend. 2020 Aug 01;213:107997. doi: 10.1016/j.drugalcdep.2020.107997.S0376-8716(20)30162-9 [DOI] [PubMed] [Google Scholar]
- 28.Dasgupta N, Kapadia F. The future of the public health data dashboard. Am J Public Health. 2022 Jun;112(6):886–8. doi: 10.2105/ajph.2022.306871. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Thorpe LE, Gourevitch MN. Data dashboards for advancing health and equity: proving their promise? Am J Public Health. 2022 Jun;112(6):889–92. doi: 10.2105/ajph.2022.306847. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Bach B, Freeman E, Abdul-Rahman A, Turkay C, Khan S, Fan Y, Chen M. Dashboard design patterns. IEEE Trans Vis Comput Graph. 2023;29(1):342–52. doi: 10.1109/tvcg.2022.3209448. [DOI] [PubMed] [Google Scholar]
- 31.Few S. Information Dashboard Design: The Effective Visual Communication of Data. Sebastopol, CA: O'Reilly Media; 2006. [Google Scholar]
- 32.Gleeson J, Kitchin R, McCarthy E. Dashboards and public health: the development, impacts, and lessons from the Irish government COVID-19 dashboards. Am J Public Health. 2022 Jun;112(6):896–9. doi: 10.2105/ajph.2022.306848. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Lechner B, Fruhling A. Towards public health dashboard design guidelines. Proceedings of the 1st International Conference, HCIB 2014, Held as Part of HCI International on HCI in Business; HCIB '14; June 22-27, 2014; Crete, Greece. 2014. pp. 49–59. https://link.springer.com/chapter/10.1007/978-3-319-07293-7_5 . [DOI] [Google Scholar]
- 34.Amarasinghe I, Hernandez-Leo D, Michos K, Vujovic M. An actionable orchestration dashboard to enhance collaboration in the classroom. IEEE Trans Learn Technol. 2020 Oct 1;13(4):662–75. doi: 10.1109/tlt.2020.3028597. [DOI] [Google Scholar]
- 35.Lock O, Bednarz T, Leao SZ, Pettit C. A review and reframing of participatory urban dashboards. City Cult Soc. 2020 Mar;20:100294. doi: 10.1016/j.ccs.2019.100294. [DOI] [Google Scholar]
- 36.Setlur V, Correll M, Satyanarayan A, Tory M. Heuristics for supporting cooperative dashboard design. IEEE Trans Vis Comput Graph. 2024 Jan;30(1):370–80. doi: 10.1109/TVCG.2023.3327158. [DOI] [PubMed] [Google Scholar]
- 37.Anderson JA, Demeter N, Pasquires M, Wirtz S. Using the CA opioid overdose surveillance dashboard to track opioid overdose deaths. Online J Public Health Inform. 2019 May 30;11(1):e449. doi: 10.5210/ojphi.v11i1.9938. https://ojphi.org/ojs/index.php/ojphi/article/view/9938/8039 . [DOI] [Google Scholar]
- 38.Safranek CW, Feitzinger L, Joyner AK, Woo N, Smith V, Souza ED, Vasilakis C, Anderson TA, Fehr J, Shin AY, Scheinker D, Wang E, Xie J. Visualizing opioid-use variation in a pediatric perioperative dashboard. Appl Clin Inform. 2022 Mar 23;13(2):370–9. doi: 10.1055/s-0042-1744387. http://www.thieme-connect.com/DOI/DOI?10.1055/s-0042-1744387 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Wu E, Villani J, Davis A, Fareed N, Harris DR, Huerta TR, LaRochelle MR, Miller CC, Oga EA. Community dashboards to support data-informed decision-making in the HEALing communities study. Drug Alcohol Depend. 2020 Dec 01;217:108331. doi: 10.1016/j.drugalcdep.2020.108331. https://linkinghub.elsevier.com/retrieve/pii/S0376-8716(20)30496-8 .S0376-8716(20)30496-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Abras C, Maloney-Krichmar D, Preece J. User-centered design. In: Ghaoui C, editor. Encyclopedia of Human Computer Interaction. Thousand Oaks, CA: Sage Publications; 2004. pp. 445–56. [Google Scholar]
- 41.Vredenburg K, Mao JY, Smith PW, Carey T. A survey of user-centered design practice. Proceedings of the 2002 SIGCHI Conference on Human Factors in Computing Systems; CHI '02; April 20-25, 2002; Minneapolis, MN. 2002. pp. 471–8. https://dl.acm.org/doi/10.1145/503376.503460 . [Google Scholar]
- 42.Muller MJ, Haslwanter JH, Dayton T. Participatory practices in the software lifecycle. In: Helander MG, Landauer TK, Prabhu PV, editors. Handbook of Human-Computer Interaction. Amsterdam, The Netherlands: North Holland; 1997. pp. 255–97. [Google Scholar]
- 43.Schuler D, Namioka A. Participatory Design: Principles and Practices. Boca Raton, FL: CRC Press; 1993. [Google Scholar]
- 44.Guest G, MacQueen KM, Namey EE. Applied Thematic Analysis. Thousand Oaks, CA: Sage Publications; 2011. [Google Scholar]
- 45.Fatal drug overdose touchpoints. Indiana Management Performance Hub. [2024-01-30]. https://www.in.gov/mph/projects/fortress/
- 46.Bennett AS, Elliott L. Naloxone's role in the national opioid crisis-past struggles, current efforts, and future opportunities. Transl Res. 2021 Aug;234:43–57. doi: 10.1016/j.trsl.2021.03.001. https://europepmc.org/abstract/MED/33684591 .S1931-5244(21)00051-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Snyder H, Kalmin MM, Moulin A, Campbell A, Goodman-Meza D, Padwa H, Clayton S, Speener M, Shoptaw S, Herring AA. Rapid adoption of low-threshold buprenorphine treatment at California emergency departments participating in the CA bridge program. Ann Emerg Med. 2021 Dec;78(6):759–72. doi: 10.1016/j.annemergmed.2021.05.024. https://linkinghub.elsevier.com/retrieve/pii/S0196-0644(21)00434-0 .S0196-0644(21)00434-0 [DOI] [PubMed] [Google Scholar]
- 48.Binswanger IA, Nowels C, Corsi KF, Glanz J, Long J, Booth RE, Steiner JF. Return to drug use and overdose after release from prison: a qualitative study of risk and protective factors. Addict Sci Clin Pract. 2012 Mar 15;7(1):3. doi: 10.1186/1940-0640-7-3. https://ascpjournal.biomedcentral.com/articles/10.1186/1940-0640-7-3 .1940-0640-7-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Cooper JA, Onyeka I, Cardwell C, Paterson E, Kirk R, O'Reilly D, Donnelly M. Record linkage studies of drug-related deaths among adults who were released from prison to the community: a scoping review. BMC Public Health. 2023 May 05;23(1):826. doi: 10.1186/s12889-023-15673-0. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-023-15673-0 .10.1186/s12889-023-15673-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Merrall EL, Kariminia A, Binswanger IA, Hobbs MS, Farrell M, Marsden J, Hutchinson SJ, Bird SM. Meta-analysis of drug-related deaths soon after release from prison. Addiction. 2010 Sep 05;105(9):1545–54. doi: 10.1111/j.1360-0443.2010.02990.x. https://europepmc.org/abstract/MED/20579009 .ADD2990 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Grammel L, Tory M, Storey MA. How information visualization novices construct visualizations. IEEE Trans Vis Comput Graph. 2010 Nov;16(6):943–52. doi: 10.1109/TVCG.2010.164. [DOI] [PubMed] [Google Scholar]
- 52.Ivanković D, Barbazza E, Bos V, Brito Fernandes Ó, Jamieson Gilmore K, Jansen T, Kara P, Larrain N, Lu S, Meza-Torres B, Mulyanto J, Poldrugovac M, Rotar A, Wang S, Willmington C, Yang Y, Yelgezekova Z, Allin S, Klazinga N, Kringos D. Features constituting actionable COVID-19 dashboards: descriptive assessment and expert appraisal of 158 public web-based COVID-19 dashboards. J Med Internet Res. 2021 Feb 24;23(2):e25682. doi: 10.2196/25682. https://www.jmir.org/2021/2/e25682/ v23i2e25682 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Kariisa M, Davis NL, Kumar S, Seth P, Mattson CL, Chowdhury F, Jones CM. Vital signs: drug overdose deaths, by selected sociodemographic and social determinants of health characteristics - 25 states and the district of Columbia, 2019-2020. MMWR Morb Mortal Wkly Rep. 2022 Jul 22;71(29):940–7. doi: 10.15585/mmwr.mm7129e2. doi: 10.15585/mmwr.mm7129e2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Park JN, Rouhani S, Beletsky L, Vincent L, Saloner B, Sherman SG. Situating the continuum of overdose risk in the social determinants of health: a new conceptual framework. Milbank Q. 2020 Sep 18;98(3):700–46. doi: 10.1111/1468-0009.12470. https://europepmc.org/abstract/MED/32808709 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.van Draanen J, Jamula R, Karamouzian M, Mitra S, Richardson L. Pathways connecting socioeconomic marginalization and overdose: a qualitative narrative synthesis. Int J Drug Policy. 2023 Mar;113:103971. doi: 10.1016/j.drugpo.2023.103971.S0955-3959(23)00020-8 [DOI] [PubMed] [Google Scholar]
- 56.Agrawal R, Srikant R. Privacy-preserving data mining. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data; SIGMOD '00; May 15-18, 2000; Dallas, TX. 2000. pp. 439–50. https://dl.acm.org/doi/10.1145/335191.335438 . [DOI] [Google Scholar]
- 57.Bhattacharjee K, Chen M, Dasgupta A. Privacy-preserving data visualization: reflections on the state of the art and research opportunities. Comput Graph Forum. 2020 Jul 18;39(3):675–92. doi: 10.1111/cgf.14032. [DOI] [Google Scholar]
- 58.Evans EA, Delorme E, Cyr K, Goldstein DM. A qualitative study of big data and the opioid epidemic: recommendations for data governance. BMC Med Ethics. 2020 Oct 21;21(1):101. doi: 10.1186/s12910-020-00544-9. https://bmcmedethics.biomedcentral.com/articles/10.1186/s12910-020-00544-9 .10.1186/s12910-020-00544-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Evans EA, Delorme E, Cyr KD, Geissler KH. The Massachusetts public health data warehouse and the opioid epidemic: a qualitative study of perceived strengths and limitations for advancing research. Prev Med Rep. 2022 Aug;28:101847. doi: 10.1016/j.pmedr.2022.101847. https://linkinghub.elsevier.com/retrieve/pii/S2211-3355(22)00154-1 .S2211-3355(22)00154-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Waye KM, Yedinak JL, Koziol J, Marshall BD. Action-focused, plain language communication for overdose prevention: a qualitative analysis of Rhode Island's overdose surveillance and information dashboard. Int J Drug Policy. 2018 Dec;62:86–93. doi: 10.1016/j.drugpo.2018.08.010.S0955-3959(18)30216-0 [DOI] [PubMed] [Google Scholar]
- 61.Fatal drug overdose touchpoints. Management Performance Hub, Indiana MPH. [2024-04-29]. https://www.in.gov/mph/projects/fortress/
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Several participants highlighted the lack of access to data as one of the major barriers in fatality reviews. Some of these barriers stem from challenges in sharing available data due to legal restrictions, data security, and privacy concerns:
Asking our state offices for data would result in, “Sorry, we can't share on the state level.” There [needs to] be intergovernmental agreements between state police or our mental health or our human services or our health department.
P2
[Gaining access] is always an issue, and especially without laws that allow for the OFRs to get this. I know we had a lot of laws related to the child death review teams that I worked with that allowed us access to data, but it wasn't always the same for other death review teams.
P11
While recognizing existing regulatory and logistical obstacles, participants anticipated that increasing data access could empower OFRs to make more informed decisions:
We’re trying to drive positive change that could maybe be implemented statewide, and they just give us a little bit. It [data] would give us the power to make better decisions.
P2
In addition to data access, the quality and accuracy of the data were also brought up as a prominent issue for OFRs, especially because of acknowledged variations in how data are coded and measured across different organizations. For example, 1 participant cited different standards for classifying services, noting that such inconsistencies could lead to misinterpretation:
When it’s really law enforcement heavy, they’re not understanding the public health ramifications of criminal justice involvement. It affects the lens from which data’s being collected. So, when I go through the qualitative data...we’ve got people identifying jail substance use services as harm reduction, [and] you end up collecting some inaccurate data, which then misinforms the big picture.
P7
The video recording data sets generated during and analyzed during this study are not publicly available to protect participants’ confidentiality but are available from the corresponding author on reasonable request. The aggregate touchpoints data sets are available in the Management Performance Hub (MPH) data repository [61].