Abstract
Background
We discuss barriers to recruitment, retention, and intervention delivery in a randomized controlled trial (RCT) of patients presenting with firearm injuries to a Level 1 trauma center. The intervention was adapted from the Critical Time Intervention and included a six-month period of support in the community after hospital discharge to address recovery goals. This study was one of the first RCTs of a hospital- and community-based intervention provided solely among patients with firearm injuries.
Main text
Barriers to recruitment included limited staffing, coupled with wide variability in length of stay and admission times, which made it difficult to predict the best time to recruit. At the same time, more acutely affected patients needed more time to stabilize in order to determine whether eligibility criteria were met. Barriers to retention included insufficient patient resources for stable housing, communication and transportation, as well as limited time for patients to meet with study staff to respond to follow-up surveys. These barriers similarly affected intervention delivery as patients who were recruited, but had fewer resources to help with recovery, had lower intervention engagement. These barriers fall within the broader context of system avoidance (e.g., avoiding institutions that keep formal records). Since the patient sample was racially diverse with the majority of patients having prior criminal justice system involvement, this may have precluded active participation from some patients, especially those from communities that have been subject to long and sustained history of trauma and racism. We discuss approaches to overcoming these barriers and the importance of such efforts to further implement and evaluate hospital-based violence intervention programs in the future.
Conclusion
Developing strategies to overcome barriers to data collection and ongoing participant contact are essential to gathering robust information to understand how well violence prevention programs work and providing the best care possible for people recovering from injuries.
Trial registration
ClinicalTrials.govNCT02630225. Registered 12/15/2015.
Keywords: Firearm, Recruitment, Retention, System avoidance
Introduction
The Helping Individuals with Firearm Injuries (HiFi) study was launched to better understand the effectiveness of hospital- and community-based programs in reducing violence and subsequent injuries during and after recovery from gunshot wounds (GSWs) (Rowhani-Rahbar et al. 2016; Lyons et al., 2021). The intervention was based on the Critical Time Intervention and included a phased intensity, with hospital and community-based interactions with the Support Specialist (Herman and Conover 2011; Tomita and Herman 2012). The study was conducted among patients presenting to Harborview Medical Center, a Level 1 trauma center in Seattle, Washington. The study is described in detail in Lyons et al. (2020), Lyons et al. (2021). The intervention goal was to support overall health and well-being, while the primary outcome was preventing arrest over two-years following hospital discharge, with a secondary outcome of preventing injury recidivism.
Intervention participants were offered six-months of support, beginning with a motivational interviewing-based goal-setting discussion, during which they met with the Support Specialist to address a broad range of recovery goals and connect to resources in the community after discharge. They were compared to people who were offered a list of referral services. Both groups had access to hospital-based social workers. The hospital did not offer a separate Hospital-Based Violence Intervention program (HVIP). Self-reported interview data were linked with Washington State administrative records documenting arrests and hospitalizations.
Several studies examined strategies for improving recruitment and retention with patients who sustain trauma. (McFarlane 2007; Clough et al. 2011; Monopoli et al. 2018). Other studies examined enrollment of people from minority racial and ethnic populations, who constituted 46% of the study sample in HiFi. Those studies point to understanding cultural context, engaging stakeholders, and being intentional in recruitment (Daunt 2003; Dancy et al. 2004; Durant et al. 2007; Heller et al. 2014). Barriers also exist more broadly in conducting RCTs, given their complexity (De Salis et al. 2008; Howard et al. 2009; Sibai et al. 2012; Thoma et al. 2010). Though considerable effort went into addressing these concerns during the study, challenges persisted.
High rates of recruitment and retention are possible in firearm injury studies, though challenges in our study were likely more systemic (Carter et al. 2015; Cunningham et al. 2015). Most participants in our sample (72.8%) had a prior arrest, pointing to a possible climate of distrust for institutions especially considering the long and sustained history of trauma and racism (Goffman 2009). At the same time, concerns regarding judgment, stigma, and loss of privacy may have dissuaded participants from help-seeking within the healthcare system (Jacoby et al. 2020). As such, participants may have engaged in “system avoidance,” avoiding institutions that keep formal records (Brayne 2014). One form of system avoidance is providing incorrect identifying and contact information to the healthcare and research staff. In our commentary we discuss the barriers we encountered during the trial and our attempts to resolve them. A summary of these barriers and our approaches to overcome them are provided in Table 1.
Table 1.
Challenge | Description | Resolution |
---|---|---|
Recruitment | ||
Maximizing patient enrollment |
• Unpredictable patient arrival times • Limited funding for full-time staff coverage |
• Use of online resources for patient tracking • Flexible staff schedules • Prompt enrollment of discharged patients |
Optimizing patient approach |
• Working with medical care providers • Visiting friends and family • Imminent discharge |
• Consultation with physicians on research staff • Consultation with medical care providers in hospital • Maintain rapport with medical care providers and visitors • Frequent check-ins • Leave brochure for patient to review |
Retention | ||
Retaining unresponsive participants |
• Housing instability • Frequently changing phone numbers • Limited cellular service or internet access • Poor communication affecting intervention delivery |
• Frequent communication attempts • Try all available methods and contacts • Attempt to meet patients at scheduled medical visits • Support Specialist independently attempt contact • Provide incentives to help with phone service/transportation • Offer visits in the community |
Retaining participants with limited time |
• Good communication but low availability • Working hours conflict with research staffing times • Poor availability affecting intervention delivery |
• Data collection via in-person, phone and online • Use text messages, email, and social media for contact • Contact outside of work hours (e.g., evenings and weekends) • Meet at scheduled medical appointments • Combine follow-up and intervention appointments |
Intervention Delivery | ||
Connecting participants with community resources |
• No limits on the areas of concern for recovery • Some needed resources unavailable (e.g., housing) |
• Use well-trained staff with social work background • Community-based advisory team to help identify resources • Build rapport by focusing first on available resources • Rapport building helps with problem solving to identify other needed resources |
Communication between research staff and Support Specialist |
• First contact with the Support Specialist ideally in-person and in-hospital. • Options needed for patients discharging quickly • Some patients may not want face-to-face contact due to nature of injuries |
• Research staff able to accurately describe intervention • Notify Support Specialist well in advance of initial approach • Flexible scheduling • Use phone-based delivery of the initial contact, if needed • Short intro video to familiarize patient with Support Specialist, if needed |
Recruitment barriers
Patients with GSWs arrived at all hours each day. Knowing when a participant was arriving did not ensure timely access to approach for enrollment. For the first 2.5 years of the study, funding only allowed for two part-time research assistants and one Support Specialist. Near the end of the study, four temporary research assistants were hired. This allowed for short-term, around the clock coverage. Initial participants may have been missed due to lack of 24/7 staff coverage. In some cases, patients were discharged while awaiting confirmation of eligibility.
Research staff made use of online records and flexible schedules to track patients prior to discharge. During enrollment, research staff consulted medical providers about possible imminent discharge in order to time recruitment. Research staff maintained good rapport with family members who may influence participation. Study brochures were provided. Patients discharged before approach were later contacted for enrollment, either using contact information from medical records, or by attempting to meet patients at scheduled outpatient appointments.
Retention barriers
The study only required one form of direct or collateral contact information. Housing instability, including homelessness, transiency, and eviction often coincided with more challenges in communication, including unstable access to internet for emails or to cellular devices. Frequent communication attempts were time-consuming, with staff regularly maximizing the allowable number of contact attempts without successful contacts. Even participants with greater stability were challenging to retain due to work schedules. Inevitably, some participants were unreachable after their baseline visit.
Where possible, intervention visits were coupled with follow-up medical appointments to maximize subject time and help boost retention. Research staff were often able to visit participants in the field, but the tradeoff was potentially missing new admissions. For follow-up visits, data collection was done either in-person, by phone or online. We utilized text messages, email, and social media for communications, and contacted participants outside of normal work hours.
Intervention delivery barriers
As a patient-centered intervention, there were no limits to the areas of concern that participants could identify for their recovery. Community-based professionals across different disciplines helped identify available community resources, yet some concerns were consistently hard to address (e.g., temporary housing or shelters). While many intervention participants requested help submitting claims for crime victim’s compensation, claims were sometimes delayed or denied due to perceived lack of cooperation with law enforcement, prior criminal history, or delays in police report filings. For participants who were unable to remain employed because of their injuries, these delays could be significant. The Support Specialist attempted to maintain rapport in all areas, even if an area of concern could not be fully addressed.
Research staff notified the Support Specialist in advance of initial approach. The Support Specialist made patient contact as quickly as possible, ideally in-person and during the index hospitalization to build a strong helping relationship and enhance retention. If an in-person option was not possible, phone-based introductory calls were conducted successfully. Video conferencing was also an available option. The Support Specialist focused on the issues which could be addressed in a timely manner. This would sometimes lead to participants discovering options to address longer-term problems (e.g., short-term housing).
Conclusion
Violence is a pervasive public health problem and leading cause of morbidity and mortality in the U.S. (Sumner et al. 2015). A violent injury treated in the emergency department often represents the only access point to the healthcare system for those most at risk for violent re-injury (Rowhani-Rahbar et al. 2015; Cunningham et al. 2012; Garth et al. 2020). Up to 50% of patients injured by violence may suffer violent re-injury within 5 years following hospital discharge (Corbin et al. 2011). At the same time, the threat of violent re-injury cannot be discussed independently from factors such as systemic and institutional racism, affecting engagement and injury outcomes (Jacoby et al. 2018). By understanding the depths of the barriers that exist, we can better gauge the efforts needed to overcome them. More studies are needed to provide evidence of effectiveness for funding of HVIPs and ensure that healthcare services sufficiently meet patient needs, making trauma-informed approaches an integral part of trauma centers (Dicker 2016; Juillard et al. 2016). Follow-up retention is critical to both the intervention delivery and assessment of study outcomes, and requires constant attention to successfully implement.
Acknowledgements
The authors wish to thank our colleagues at Harborview Medical Center, and the Harborview Injury Prevention & Research Center for generous resources that enabled us to conduct the study. We are especially grateful for the tremendous efforts made by Erin Ballsmith, Lina Benson, Emma Bent, David Cheever, Cara Currier, Tamara Dominguez, Elizabeth Griffin, Navya Gunaje, Ashley Hink, Manal Jmaileh, Alvaro Martinez, Erin McCormick, Serena Skidmore, and Alice Yan.
Abbreviations
- HIFI
Helping Individuals with Firearm Injuries
- GSW
Gunshot wound
Authors’ contributions
AF oversaw data collection, substantially contributed to the conception and design of the manuscript as well as the acquisition, analysis, and interpretation of data for the work, and drafted the manuscript. VL conducted data analyses and substantially contributed to the conception and design of the manuscript as well as the acquisition, analysis, and interpretation of data for the work, and revised the manuscript for critical intellectual content. LW substantially contributed to the conception and design of the manuscript as well as the interpretation of data for the work, and revised the manuscript for critical intellectual content. KH substantially contributed to the conception and design of the manuscript as well as the interpretation of data for the work, and revised the manuscript for critical intellectual content. FR designed the study, obtained funding for the study, substantially contributed to the conception and design of the manuscript as well as the interpretation of data for the work, and revised the manuscript for critical intellectual content. AR designed the study, oversaw the analysis, obtained funding for the study, and revised the manuscript for critical intellectual content. All authors read and approved the final manuscript.
Funding
Funding for this study was provided by City of Seattle and Arnold Ventures. The content is solely the responsibility of the authors and does not represent the official views of the funders.
Availability of data and materials
Data are not available for distribution.
Declarations
Ethics approval and consent to participate
This study was approved by the University of Washington Human Subjects Division (Institutional Review Board) STUDY00000852 and Washington State IRB #D-100616-H.
Consent for publication
Not Applicable.
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Anthony S. Floyd, Email: asfloyd@uw.edu
Vivian H. Lyons, Email: vlyons@uw.edu
Lauren K. Whiteside, Email: laurenkw@uw.edu
Kevin P. Haggerty, Email: haggerty@uw.edu
Frederick P. Rivara, Email: fpr@uw.edu
Ali Rowhani-Rahbar, Email: rowhani@uw.edu.
References
- Brayne S. Surveillance and System Avoidance: Criminal Justice Contact and Institutional Attachment. Am Sociol Rev. 2014;79(3):367–391. doi: 10.1177/0003122414530398. [DOI] [Google Scholar]
- Carter PM, Walton MA, Roehler DR, Goldstick J, Zimmerman MA, Blow FC, Cunningham RM. Firearm violence among high-risk emergency department youth after an assault injury. Pediatrics. 2015;135(5):805–815. doi: 10.1542/peds.2014-3572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Clough A, Wagman J, Rollins C, Barnes J, Connor-Smith J, Holditch-Niolon P, McDowell S, Martinez-Bell E, Bloom T, Baker C, Glass N. The share project: maximizing participant retention in a longitudinal study with victims of intimate partner violence. Field Methods. 2011;23(1):86–101. doi: 10.1177/1525822X10384446. [DOI] [Google Scholar]
- Corbin TJ, Rich JA, Bloom SL, Delgado D, Rich LJ, Wilson AS. Developing a trauma-informed, emergency department-based intervention for victims of urban violence. J Trauma Dissociation. 2011;12(5):510–525. doi: 10.1080/15299732.2011.593260. [DOI] [PubMed] [Google Scholar]
- Cunningham RM, Carter PM, Ranney M, Zimmerman MA, Blow FC, Booth BM, Goldstick J, Walton MA. Violent reinjury and mortality among youth seeking emergency department care for assault-related injury: A 2-year prospective cohort study. JAMA Pediatr. 2015;169(1):63–70. doi: 10.1001/jamapediatrics.2014.1900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cunningham RM, Chermack ST, Zimmerman MA, Shope JT, Bingham CR, Blow FC, Walton MA. Brief motivational interviewing intervention for peer violence and alcohol use in teens: one-year follow-up. Pediatrics. 2012;129(6):1083–1090. doi: 10.1542/peds.2011-3419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dancy BL, Wilbur J, Talashek M, Bonner G, Barnes-Boyd C. Community-based research: barriers to recruitment of African Americans. Nurs Outlook. 2004;52(5):234–240. doi: 10.1016/j.outlook.2004.04.012. [DOI] [PubMed] [Google Scholar]
- Daunt DJ. Ethnicity and recruitment rates in clinical research studies. Appl Nurs Res. 2003;16(3):189–195. doi: 10.1016/S0897-1897(03)00042-9. [DOI] [PubMed] [Google Scholar]
- De Salis I, Tomlin Z, Toerien M, Donovan J. Qualitative research to improve RCT recruitment : issues arising in establishing research collaborations. Contemp Clin Trials. 2008;29(5):663–670. doi: 10.1016/j.cct.2008.03.003. [DOI] [PubMed] [Google Scholar]
- Dicker RA. Hospital-based violence intervention: an emerging practice based on public health principles. Trauma Surg Acute Care Open. 2016;1(1). 10.1136/tsaco-2016-000050. [DOI] [PMC free article] [PubMed]
- Durant RW, Davis RB, Marie D, et al. Participation in research studies : factors associated with failing to meet minority recruitment goals. Ann Epidemiol. 2007;1(8):634–642. doi: 10.1016/j.annepidem.2007.02.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Garth N, Annette M, David A, Walker GN. A case for risk stratification in survivors of firearm and interpersonal violence in the urban environment. West J Emerg Med. 2020;21(6):132–140. doi: 10.5811/westjem.2020.8.45041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goffman A. On the run: wanted men in a Philadelphia ghetto. Am Sociol Rev. 2009;74(3):339–357. doi: 10.1177/000312240907400301. [DOI] [Google Scholar]
- Heller C, Balls-Berry JE, Dumbauld J, et al. Strategies addressing barriers to clinical trial enrollment of underrepresented populations : a systematic review. Contemp Clin Trials. 2014;39(2):169–182. doi: 10.1016/j.cct.2014.08.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Herman DB, Conover S. Gorroochurn, et al. randomized trial of critical time intervention to prevent homelessness after hospital discharge. Psychiatr Serv. 2011;62(7):3–9. doi: 10.1176/ps.62.7.pss6207_0713. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Howard L, de Salis I, Tomlin Z, Thornicroft G, Donovan J. Why is recruitment to trials difficult? An investigation into recruitment difficulties in an RCT of supported employment in patients with severe mental illness. Contemp Clin Trials. 2009;30(1):40–46. doi: 10.1016/j.cct.2008.07.007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacoby SF, Rich JA, Webster JL, Richmond TS. ‘Sharing things with people that I don’t even know’: help-seeking for psychological symptoms in injured black men in Philadelphia. Ethnicity Health. 2020;25(6):777–795. doi: 10.1080/13557858.2018.1455811. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jacoby SF, Richmond TS, Holena DN, Kaufman EJ. A safe haven for the injured? Urban trauma care at the intersection of healthcare, law enforcement, and race. Soc Sci Med. 2018;199:115–122. doi: 10.1016/j.socscimed.2017.05.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Juillard C, Cooperman L, Allen I, Pirracchio R, Henderson T, Marquez R, Orellana J, Texada M, Dicker RA. A decade of hospital-based violence intervention: benefits and shortcomings. J Trauma Acute Care Surg. 2016;81(6):1156–1161. doi: 10.1097/TA.0000000000001261. [DOI] [PubMed] [Google Scholar]
- Lyons VH, Benson LR, Griffin E, Floyd AS, Kiche SW, Haggerty KP, Whiteside L, Conover S, Herman DB, Rivara FP, Rowhani-Rahbar A. Fidelity assessment of a social work–led intervention among patients with firearm injuries. Res Soc Work Pract. 2020;30(6):678–687. doi: 10.1177/1049731520912002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lyons VH, Floyd AS, Griffin E, Wang J, Hajat A, Carone M, Whiteside LK, Haggerty KP, Rivara FP, Rowhani-Rahbar A. Helping individuals with firearm injuries a cluster randomized trial. J Trauma Acute Care Surg. 2021;90(4):722–730. doi: 10.1097/TA.0000000000003056. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mcfarlane J. Strategies for successful recruitment and retention of abused women for longitudinal studies. Issues Ment Health Nurs. 2007;28(8):883–897. doi: 10.1080/01612840701493527. [DOI] [PubMed] [Google Scholar]
- Monopoli WJ, Myers RK, Paskewich BS, Bevans KB, Fein JA. Generating a core set of outcomes for hospital-based violence intervention programs. J Interpers Violence. 2018. 10.1177/0886260518792988 Published online. [DOI] [PubMed]
- Rowhani-Rahbar A, Fan MD, Simonetti JA, Lyons VH, Wang J, Zatzick D, Rivara FP. Violence perpetration among patients hospitalized for unintentional and assault-related firearm injury: A case-control study and a cohort study. Ann Intern Med. 2016;165(12):841–847. doi: 10.7326/M16-1596. [DOI] [PubMed] [Google Scholar]
- Rowhani-Rahbar A, Zatzick D, Wang J, Mills BM, Simonetti JA, Fan MD, Rivara FP. Firearm-related hospitalization and risk for subsequent violent injury, death, or crime perpetration: A cohort study. Ann Intern Med. 2015;162(7):492–500. doi: 10.7326/M14-2362. [DOI] [PubMed] [Google Scholar]
- Sibai T, Carlisle H, Tornetta P. The darker side of randomized trials: recruitment challenges. J Bone Joint Surg. 2012;1(94):49–55. doi: 10.2106/JBJS.L.00240. [DOI] [PubMed] [Google Scholar]
- Sumner SA, Mercy JA, Dahlberg LL, Hillis SD, Klevens J, Houry D. Violence in the United States: status, challenges, and opportunities. JAMA. 2015;314(5):478–488. doi: 10.1001/jama.2015.8371. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Thoma A, Farrokhyar F, McKnight L, Bhandari M. Practical tips for surgical research: how to optimize patient recruitment. Can J Surg. 2010;53(3):205–210. [PMC free article] [PubMed] [Google Scholar]
- Tomita A, Herman DB. The impact of critical time intervention in reducing psychiatric rehospitalization after hospital discharge. Psychiatr Serv. 2012;63(9):935–937. doi: 10.1176/appi.ps.201100468. [DOI] [PMC free article] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data are not available for distribution.