Abstract
Background
Violent injury is the leading cause of death among urban youth. Emergency department (ED) visits represent an opportunity to deliver a brief intervention (BI) to reduce violence among youth seeking medical care in high-risk communities.
Objective
To determine the efficacy of a universally applied Brief Intervention (BI) addressing violence behaviors among youth presenting to an urban ED.
Methods
ED youth (14-to-20 years-old) seeking medical or injury- related care in a Level-1 ED (October 2011–March 2015) and screening positive for a home address within the intervention or comparison neighborhood of a larger youth violence project were enrolled in this quasi-experimental study. Based on home address, participants were assigned to receive either the 30-min therapist-delivered BI (Project Sync) or a resource brochure (enhanced usual care [EUC] condition). The Project Sync BI combined motivational interviewing and cognitive skills training, including a review of participant goals, tailored feedback, decisional balance exercises, role-playing exercises, and linkage to community resources. Participants completed validated survey measures at baseline and a 2-month follow-up assessment. Main outcome measures included self-report of physical victimization, aggression, and self-efficacy to avoid fighting. Poisson and Zero-inflated Poisson regression analyses analyzed the effects of the BI, as compared to the EUC condition on primary outcomes.
Results
409 eligible youth (82% participation) were enrolled and assigned to either receive the BI (n=263) or the EUC condition (n=146). Two-month follow-up was 91% (n=373). There were no significant baseline differences between study conditions. Among the entire sample, mean age was 17.7 y/o (SD 1.9), 60% were female, 93% were African-American, and 79% reported receipt of public assistance. Of participants, 9% presented for a violent injury, 9% reported recent firearm carriage, 20% reported recent alcohol use, and 39% reported recent marijuana use. Compared with the EUC group, participants in the therapist BI group showed self-reported reductions in frequency of violent aggression (therapist, −46.8%; EUC, −36.9%; Incident rate ratio [IRR], 0.87; 95% confidence interval [CI], [0.76–0.99]) and increased self-efficacy for avoiding fighting (therapist, +7.2%; EUC, −1.3%; IRR, 1.09; 95% CI, 1.02–1.15). No significant changes were noted for victimization.
Conclusions
Among youth seeking ED care in a high-risk community, a brief, universally applied BI shows promise in increased self-efficacy for avoiding fighting and a decrease in the frequency of violent aggression.
Trial Registration
Clinicaltrials.gov identifier – NCT02586766
Keywords: Youth Violence, Universal Injury Prevention, Emergency Medicine, Brief Intervention, Motivational Interviewing
Introduction
Youth violence is a significant public health problem. Homicide rates among U.S. youth are fourteen times higher than those among youth in other high-income countries.1 Violent injury is the leading cause of death for urban minority youth and responsible for more than 600,000 adolescent ED visits annually.2 Nationwide, 25% of high school age students report fighting in the past 12-months and 18% report carrying a weapon in the past month.3 Societal costs associated with this violence are substantial, estimated at more than $4 billion for acute medical care and $32 billion for lost wages/productivity annually.4 Developing effective prevention programs for at-risk youth is a significant focus of public health efforts,5–11 especially given data demonstrating that adolescent violence involvement is linked with negative long-term health and psychosocial outcomes, including substance abuse/dependence, anxiety/depression, post-traumatic stress disorder, incarceration, violent injury, and death.5,12–22
Urban EDs are an important, but underutilized setting for violence prevention.5 Prior data highlight that youth seeking ED care within urban settings have elevated rates of violence, as well as associated risk behaviors, including substance use, firearm possession, and weapon carriage.23–26 Urban EDs also provide an opportunity to access traditionally hard-to-reach adolescents, including uninsured/underinsured youth, as well as those without a primary care physician and those not regularly attending school.27,28 Prior studies have demonstrated the effectiveness of brief interventions (BI) for the prevention of a range of injury-related risk behaviors, most commonly alcohol use.29–35 More recently, ED-based BIs have been expanded to incorporate violence prevention.36,37 Findings from the SafERteens study, a randomized control trial (RCT) conducted among ED adolescents screening positive for alcohol and peer violence demonstrated that a therapist-delivered BI significantly reduced peer aggression, peer victimization, dating victimization, and alcohol-related consequences.36–38 While such selective interventions conducted among an at-risk population (i.e., youth with a history of alcohol use and prior violence) have been shown to be effective, researchers have not previously evaluated a BI to reduce violence behaviors among a universal population of ED youth living in neighborhoods with elevated levels of community violence. Such a universal prevention-based approach (i.e., addressing violence risk among all youth who are seeking ED care from a high-risk neighborhood) has the potential to substantially effect the public health of urban communities, especially if the BI is designed to be delivered seamlessly during an ED visit.
Similar to other urban communities with elevated rates of crime, violence and poverty, youth violence is a significant problem in Flint, MI.39 Since 2011, the Michigan Youth Violence Prevention Center has been working with community partners to implement a comprehensive youth violence prevention program.40 The present study evaluates the ED-based component of this program focused on an individual level intervention addressing youth populations. Specifically, this article examines the efficacy of a therapist-delivered universal BI (Project Sync) as compared to an enhanced usual care (EUC) condition in reducing violence behaviors among adolescents seeking ED care at a Level-1 trauma center within discrete geographical regions of Flint. It was hypothesized that youth receiving the BI would decrease self-reported violence behaviors (aggression, victimization) and increase self-efficacy for avoiding fighting compared to youth in the EUC group who did not receive the BI.
Methods
Study Design and Setting
Project Sync is a 5-year quasi-experimental trial testing the efficacy of a BI as compared to an EUC condition for a universal population of youth seeking medical or injury-related care in the Hurley Medical Center (HMC) ED in Flint, Michigan. The study was one component of a multi-faceted youth violence prevention program40 testing six interventions within a focused intervention neighborhood as compared to a comparison neighborhood. Interventions were designed so as not to overlap. The current study was the only intervention to focus on individual counseling of youth in an ED regarding their involvement in violence. Other interventions focused on improving social interactions (e.g., parent/adult mentoring relationships) or environmental factors (e.g., community policing, clean & green initiatives); only one other intervention was focused at the individual level, but utilized a school-based curriculum to focus on positive youth development among a younger adolescent population. Both neighborhoods were matched on multiple socio-demographic characteristics, including the percentages of African-American/Hispanic residents, owner-occupied housing, high-school graduates, and residents below the poverty level. The neighborhoods were also matched on adolescent population counts, median household income, and violent crime rates. The UM and HMC IRBs approved all study procedures; a CDC Certificate of Confidentiality was also obtained.
Recruitment
Recruitment (October 2011-March 2015) occurred within the HMC ED between 2:30-pm and 10:00-pm, 7-days a week, excluding holidays, with additional morning (8:30-am-4:00-pm) and mid-day (11:30-am-7pm) shifts as scheduling allowed. Of note, the intervention neighborhood was purposefully oversampled to meet the aims of the larger YVPC project (i.e., to interact with as many youth from the intervention neighborhood as possible).
Eligibility
ED patients (14–20 years-old) were identified using electronic medical records and approached in waiting rooms/treatment spaces. Participants screening positive for a home address within the intervention or comparison neighborhood were eligible for inclusion. Patients were excluded if they were unable to provide informed consent due to medical (e.g., altered mental status) or psychiatric reasons (e.g., cognitive impairment), or if they were presenting for a sexual assault and/or suicidal ideation/attempt. Patients were also excluded if they were <18 years-old and seeking care without a parent/guardian present (or they were unavailable for phone consent), in police custody, or if they were unable to self-administer the survey or participate in the BI (e.g., non-English speaking).
Study Protocol
Following written consent (or assent with parent/guardian consent), participants self-administered a ~25-minute computerized baseline survey ($20 remuneration) via touchscreen tablet. Participants were assigned to a study condition based on home address; those residing in the intervention neighborhood received the ~30-minute BI, while those in the comparison neighborhood received a resource brochure (i.e., EUC condition). Participants self-administered a computerized follow-up assessment at 2-months ($25 remuneration). Follow-up visits, which were arranged at the time of the baseline visit, were primarily conducted in-person (n=357; 95.7%) in a convenient location (e.g., ED/hospital, home visit, community location). Of in-person follow-ups, 77% occurred at the study hospital. Participants were sent a combination of reminders for follow-up appointments, including post-cards, phone calls, and texts to enhance attendance.
Measures
Socio-Demographics
Demographic and socio-economic characteristics (e.g., age, gender, race/ethnicity, marital status, living situation, public assistance) were assessed using items from the Add-Health Study,41,42 the NIH Guidelines on race/ethnicity,43 and the Drug Abuse Treatment Outcome Studies.44 Three items from the Flint Adolescent Survey45 assessed school completion (“Are you currently in school?”; “What is the highest grade you have completed?”) and average grades (“What kind of grades do you usually/did you usually get in school?”). Participants who reported that they were not currently in school and who indicated that the highest grade completed was less than a high school diploma were coded as dropouts. Education measures were collapsed to indicate whether the participant had failing grades or had dropped out of school.
Past 2-month Background Characteristics
Firearm Carriage was assessed using a single item (“How often have you carried a gun with you when you were outside your home?”) from the Tulane Youth Study.46,47 The response scale (never, 1 time, 2-times, 3–5 times, 6–10 times; 11–20 times, >20 times) was dichotomized (yes/no for firearm carriage) for analysis. This measure excludes firearm carriage for hunting/sporting activities. Gang involvement was assessed with a single item (Do you consider yourself a member of a gang?; Yes/No).26,48 Community violence exposure was assessed with the 5-item community violence scale from the “Things I Have Seen and Heard Survey”.49,50 This scale assesses the frequency of five behaviors (“heard gun shots”; “seen drug deals”; “my house has been broken into”; “seen someone get stabbed or shot”; “seen gangs in my neighborhood”) on a Likert scale ranging from 0 (“never”) to 3 (“many times”). For analysis, a summary score was created [range 0–15; α=0.72], with higher scores indicative of higher perceived levels of community violence exposure.
Alcohol (“In the past 2 months, have you had a drink of beer, wine, or liquor more than 2–3 times”; Yes/No) and marijuana use (“During the past 2 months, how many days did you use marijuana?”) were assessed using measures from the Add-Health Survey.42 For analysis, any response other than never to the marijuana item (Response scale: Never, <1 time a month, 2–3 days/month; 1–2 days/week; 3–5 days/week, Everyday) was coded as positive for recent marijuana use (Yes/No). Finally, participants were asked to indicate whether this ED visit resulted from a violent injury (Yes/No).
Primary Outcomes
The main outcomes for the study were physical aggression, victimization, and self-efficacy for non-fighting. The adapted 12-item revised conflict tactics scale (CTS-2)51,52 and the 4-item conflict in adolescent dating relationships inventory (CADRI)53 were used to measure prevalence and frequency of physical aggression and victimization for peers (e.g., friends, strangers, acquaintances, relatives, etc.) and partners (e.g., girlfriend/boyfriend, fiancée, husband/wife), respectively. Each scale measures the frequency [response scale ranging from 0 (never) to 6 (>20 times)] of moderate (e.g., pushed, shoved) and severe (e.g., hit, punched, used a knife/gun) violence behaviors and are measured separately for victimization (i.e., someone did to you) and aggression (i.e., you did to someone). Peer and partner scores were summed for a total measure of physical aggression (α=0.90) and physical victimization (α=0.92). Self-efficacy for avoiding fighting was assessed using a five item scale [How sure are you that you can “stay out of fights?”; “Understand another person’s point of view?”; “Calm down when you are mad?”; “talk out a disagreement?”; “Learn to say out of fights?”] from the Teen Conflict Survey;54,55 responses ranged from 0 (not at all) to 4 (extremely) and were summed for a total self-efficacy score (range 0–20; α=0.80).
Study Conditions
Brief Intervention
Youth in the intervention group received the ~30-min therapist-delivered BI within the ED prior to hospital admission/discharge. The study therapist was aided by a tablet computer to provide both tailored feedback to the participant and to standardize the delivery of intervention content. The BI was paused and restarted as necessary to avoid interfering with medical care. The Project SYNC BI integrated elements of motivational interviewing (MI) to enhance problem recognition (i.e., why behaviors negatively influence goals) with cognitive behavioral strategies for skill development (i.e. how to change current behaviors). MI is a person-centered counseling technique emphasizing a non-judgmental and non-confrontational approach.56,57 MI focuses on establishing a discrepancy between current behaviors and future goals to resolve ambivalence, enhance intrinsic motivation, and increase self-efficacy for change. The intervention proceeded through 5 sections: 1) reviewing personalized goals; 2) delivering tailored feedback on violence (including normative re-setting and how substance use contributes to behaviors); 3) decisional balance exercises to establish the potential benefits of avoiding fighting (e.g., preventing injury); 4) five role playing scenarios to develop cognitive skills in anger management, conflict resolution, refusal skills for substance use/weapon carriage, and skills for avoiding violent situations; and, 5) summary of goals, skills discussed, and linkage to community resources. A detailed community resource brochure was also provided.
The Project Sync BI was adapted from the previously described SafERteens BI,36–38 which was designed specifically for teens with prior alcohol use and fighting. Modifications included adapting the role-playing scenarios and intervention content to be applicable to youth regardless of their history of prior violence or prior alcohol use (i.e., relevant for a universal ED sample). If youth had not experienced fighting, the therapist focused on the prevention of future aggression and victimization and/or discussed situations that the participant’s friends, family or neighbors had experienced. In addition, intervention scenarios were updated to be reflective of more current teen issues than those used in the SafERteens study (e.g., “someone stole your cellphone” rather than “someone stole your sneakers”). As with SafERteens, intervention content was developed to be culturally relevant for urban youth.
The Project SYNC BI was delivered by study therapists trained in behavioral health fields (e.g., social work, clinical psychology). They completed a 5-day training at the beginning of the study, including training in MI techniques and intervention delivery. Prior to study initiation, therapists completed mock patient scenarios and were required to demonstrate appropriate proficiency with MI and all components of intervention delivery. In addition, study therapists were carefully monitored throughout the trial in four ways. First, they received close clinical supervision and review of audiotaped therapy sessions by a licensed therapist during the initial weeks of the study as a quality assurance check. Second, study therapists were required to complete individual regular clinical supervision twice a month and group clinical supervision once a month with a licensed therapist throughout the study to ensure adherence to all aspects of the study protocol. Third, study therapists received booster trainings throughout the study (twice/year) to maintain clinical skills and prevent drift from the study protocol. Finally, a random 5% of all therapy sessions were audiotaped and coded using the Motivational Interviewing Treatment Integrity Global Scale (MITI-3),58 a standardized instrument for measuring and ensuring that the therapist is adhering to the principles of MI and the therapy protocol in clinical trials that involve MI-based behavioral counseling. For this study, therapy sessions demonstrated acceptable fidelity (mean global spirit rating: 4.8 [SD 0.3; range: 3.7–5.0]), exceeding the recognized competency level of 4.
Enhanced Usual Care (EUC)
Participants in the EUC condition received a basic brochure listing available community resources (e.g., substance use, leisure activities).
Data Analysis
Descriptive statistics were computed for the entire sample and by assigned treatment condition. Frequencies of risk behaviors (e.g., violent victimization, aggression, self-efficacy) were computed for descriptive purposes and percent change at 2-months following the ED visit are presented. Regression analyses (i.e., Poisson based on distribution) were conducted examining the effects of the BI (compared to EUC) on the occurrence (binary variable) and frequency (continuous) of primary outcomes [i.e., aggression, victimization, self-efficacy]. For victimization and aggression, Zero-inflated Poisson (ZIP) models were utilized to account for the large proportion of zeros. Follow-up rates were high (91.2%) and attrition analyses demonstrated that baseline characteristics (i.e., age, race, gender, assigned group) were not significantly related to follow-up, suggesting missing outcome data was likely missing at random. Cohen effect sizes59 were calculated to indicate the strength of the relationship between the BI and observed outcomes to allow for future comparison. Prior prevention literature suggests that effect sizes >0.10 are clinically meaningful.60 Data were analyzed using SAS 9.4 (SAS Institute Inc.; Cary, NC).
Results
Enrollment
A total of 1,188 patients aged 14–20 years old with a home address within the intervention or comparison neighborhood presented during recruitment (Figure 1). Of 619 youth eligible for inclusion, 80.5% (n=498) were approached, with 82.1% (409; BI=263; EUC=146) enrolling in the study and 17.9% (n=89) refusing participation. Those refusing participation were more likely from the intervention rather than the comparison neighborhood (21.7%-vs.−9.9%, x2 =10.46; p<0.05) and were less likely to identify as African American when compared with other racial/ethnic categories (16.6%-vs.−32.5%, x2=6.34; p<0.05). No differences were noted with regards to age or sex. Compliance with assigned condition and follow-up rates exceeded 91.2%, with no differential follow-up by condition. Of note, only five participants (1.9%) in the intervention group reported exposure to one of the other youth violence initiatives, with four of the five reporting their exposure was to a community-level clean and greening initiative. The remaining 98% reported no direct exposure to the other YVPC community interventions.
Participant Characteristics
Table 1 characterizes the sample by study condition. No differences between groups were noted by condition with regards to background characteristics, substance use, and/or violence involvement. Among the entire sample, 59.9% of participants were female, 93.4% were African-American, and mean age was 17.7 (SD=1.9). Most participants in both groups reported receipt of some public assistance (79.0%) and 75.3% reported living with a parent/guardian. Overall, 20.1% of youth reported recent alcohol use and 38.6% reported recent marijuana use. Recent violence involvement was similar between conditions, with two-thirds of youth reporting a recent violent event; 48.2% reported being the aggressor and 58.7% reported being victimized. Among all participants, only 8.8% were seeking care for a violent injury.
Table 1.
Therapist BI Group (n=263) | EUC Group (n=146) | Total (n=409) | |
---|---|---|---|
Background Characteristics | |||
Age (mean, SD) | 17.7 (1.9) | 17.5 (2.0) | 17.7 (1.9) |
Female (n, %) | 161 (61.2%) | 84 (57.5%) | 245 (59.9%) |
African American | 243 (92.4%) | 139 (95.2%) | 382 (93.4%) |
Married/Living with Partner | 43 (16.4%) | 26 (17.8%) | 69 (16.9%) |
Live with Parent/Guardian | 191 (72.6%) | 117 (80.1%) | 308 (75.3%) |
Public Assistance (Parent or Participant) | 209 (79.5%) | 114 (78.1%) | 323 (79.0%) |
Failing Grades/Dropped out of school | 60 (22.8%) | 30 (20.6%) | 90 (22.0%) |
Gang Involvement | 17 (6.5%) | 6 (4.1%) | 23 (5.6%) |
Firearm Carriage | 23 (8.7%) | 12 (8.2%) | 35 (8.6%) |
Community Violence | 5.2 (3.4) | 5.4 (3.4) | 5.3 (3.4) |
ED Visit/Presentation | |||
Violent Injury | 19 (7.2%) | 17 (11.6%) | 36 (8.8%) |
Past 2-month Substance Use | |||
Any Alcohol Use | 51 (19.4%) | 31 (21.2%) | 82 (20.1%) |
Any Marijuana Use | 100 (38.0%) | 58 (39.7%) | 158 (38.6%) |
Past 2-month Violence Experiences | |||
Any Experiences of Violence (n, %) | 173 (65.8%) | 90 (61.6%) | 263 (64.3%) |
Any Violent Aggression (n, %) | 128 (48.7%) | 69 (47.3%) | 197 (48.2%) |
Any Violent Victimization (n, %) | 162 (61.6%) | 78 (53.4%) | 240 (58.7%) |
Self-Efficacy for avoiding fights | 12.9 (4.4) | 13.1 (4.6) | 13.0 (4.5) |
Note: Significance Levels
< 0.05,
<0.01,
<0.001
Primary Outcomes
Overall, 85.7% (n=209) of participants receiving the intervention rated the BI as very or extremely helpful (mean score=3.3; SD=0.8). Regression models computed for violence outcomes (aggression, victimization and self-efficacy for avoiding fighting) at 2-months (Table 2: Descriptive data; Table 3: Poisson/ZIP models) demonstrated that the BI significantly decreased the frequency of violent aggression (BI, −46.8%; EUC, −36.9%; IRR, 0.87; 95% CI, 0.76–0.99) and increased self-efficacy for avoiding fighting (BI, +7.2%; EUC, −1.3%; IRR, 1.09; 95% CI, 1.02–1.15) when compared to EUC. No significant changes were noted for frequency of victimization or for the prevalence of victimization or aggression. Cohen’s d effect sizes for the BI were as follows: violent aggression, 0.16; and self-efficacy, 0.24.
Table 2.
Baseline Mean (SD) |
2-Month Follow-Up Mean (SD) |
Change from Baseline to 2- months % Change | |
---|---|---|---|
Any Violent Victimization | |||
Therapist BI Group | 6.07 (11.55) | 2.93 (6.60) | −51.7%*** |
EUC Group | 4.37 (7.20) | 2.50 (5.64) | −42.8% |
Any Violent Aggression | |||
Therapist BI Group | 4.81 (9.05) | 2.56 (6.06) | −46.8%*** |
EUC Group | 3.96 (6.88) | 2.50 (6.04) | −36.9%*** |
Self-Efficacy for Avoiding fighting | |||
Therapist BI Group | 12.87 (4.39) | 13.79 (4.64) | +7.2%*** |
EUC Group | 13.10 (4.60) | 12.93 (5.22) | −1.3% |
Note: Significance Levels
< 0.05,
<0.01,
<0.001
Table 3.
IRR# (95% CI) Frequency | AOR## (95% CI) Prevalence | |
---|---|---|
Any Violent Victimization | ||
Baseline victimization | 1.02 (1.02, 1.03)*** | 0.87 (0.83, 0.91)*** |
Therapist BI | 1.02 (0.89, 1.16) | 1.06 (0.66, 1.70) |
Any Violent Aggression | ||
Baseline aggression | 1.04 (1.03, 1.04)*** | 0.91 (0.88,0.94)*** |
Therapist BI | 0.87 (0.76, 0.99)* | 0.78 (0.49, 1.24) |
Self-Efficacy for Avoiding fighting### | ||
Baseline self-efficacy | 1.05 (1.04, 1.05)*** | ---- |
Therapist BI | 1.09 (1.02, 1.15)** | ---- |
IRR = Incident Rate Ratio; IRR values >1 indicate variables associated positively with the outcome of interest and values <1.0 indicate variables associated negatively with the outcome of interest.
AOR: adjusted odds ratio.
Self-efficacy for avoiding fighting was a Poisson regression model Significance levels:
< 0.05,
<0.01,
<0.001
Discussion
Results demonstrate that a 30-minute BI was effective reducing violent aggression and increasing self-efficacy for avoiding fighting among a universal sample of youth seeking ED care in a high-risk community. Although effect sizes were modest, findings are similar to other ED-based behavioral35,61 and school-based universal violence interventions.62 Further, effect sizes are clinically significant given that violent injury is the leading cause of death among urban youth, surpassing death due to cancer, asthma, HIV/AIDS, and motor vehicle crash injury.63 In addition, these findings further validate the findings of the SafERteens study, demonstrating that a BI delivered during an ED visit can be efficacious reducing adolescent violent behaviors.37,61 Our study adds to the literature by demonstrating that components of the SafERteens BI can be successfully adapted for application among a universal sample that is not being screened for alcohol use or prior violence. We found that the universal intervention was well received by participants, with low refusal rates (<20%) and with 86% of youth rating the intervention as very or extremely helpful, reinforcing that youth in high-risk neighborhoods, even those youth without prior violence history, are willing to discuss ways to reduce their future violence risk. Taken together, these findings have important public health implications for communities with elevated levels of violence, as the ED is a critical site for reaching youth who do not attend school (22% in our sample) or receive regular primary care, and may represent a promising primary prevention tool for reducing violence in such communities.
Improved violence outcomes may have resulted from a combined focus on increasing motivation for behavior change and increasing their skills for avoiding violent situations, non-violent conflict resolution, and anger management. Alternatively, intervention effects may have resulted from the focus on social promotive factors, including linkage to available psychosocial or substance use resources and to positive community activities. Further study is needed to identify which intervention components were critical to the effectiveness of the BI among this universal sample. Understanding which components were the most effective will aid in the design and implementation of future violence interventions. It should be noted that aggression behaviors included moderate and severe behaviors (e.g., knife/firearm use). Due to the limited sample size, it is unknown whether youth with higher severity violence profiles were more motivated to change their behavior. More study with a larger adolescent sample is needed to understand the mediating and moderating factors that may have influenced outcomes.
Although additional study is needed to assess the generalizability of our findings, the combined approach of focusing on individual-level therapist-delivered behavioral counseling and cognitive skill development among a universal population of at-risk adolescents has the potential to be effective in other clinical and non-clinical settings. Universal school-based violence interventions have shown efficacy addressing a range of violence-related behaviors among school-aged populations.64 Yet, most studies to date have focused on positive youth development among younger elementary and middle school aged children. Further, among studies focused on high-school aged adolescents, most are limited to educational programs or peer-based mentoring for bullying and/or dating violence behaviors.64 Within pediatric primary care settings, several screening tools for violence risk have been developed,65–67 but few researchers have examined the best methods of intervening with adolescents who screen positive for violence risk and/or those who are at-risk as a result of living in high-risk communities.68 In addition, few researchers have examined a therapist-delivered BI to address a broader range of violence behaviors in school- or primary care settings. Such an approach may be an effective universal prevention tool for addressing violence risk among adolescent populations in these settings, although further study is needed.
We did not observe a decrease in victimization during follow-up. This finding, which differs from the SafERteens study, may have resulted from our focus on a universal sample. Less than 65% of our youth reported violent experiences (aggression or victimization) in the two months preceding their ED visit. In contrast, recent fighting and alcohol use were inclusion criteria for the SafERteens study, and more than 80% of that sample reported experiencing consequences (e.g., trouble at school) due to their violence involvement.61 Prior violence may serve to differentially enhance the salience of intervention components related to victimization, including such cognitive elements as developing skills for avoiding violence. Alternatively, the shorter follow-up period for our study may have limited participant exposure to violence situations, reducing the opportunity to observe changes in victimization. Further study and a longer follow-up period are needed to fully understand the effects of the Project Sync BI on victimization.
While a computerized workbook was used to guide the BI and increase fidelity, it is important to note that an on-site, in-person therapist was required. This approach has implications for translating and disseminating the Project Sync BI into busy, understaffed urban EDs, as well as for the cost-effectiveness of this BI as a universal prevention tool. Prior evaluations testing a fully computerized version of the SafERteens BI did not demonstrate efficacy for violence, but did reduce alcohol-related consequences.61,69 Similarly, a recent study demonstrated that a fully automated stand-alone computer BI was effective in reducing alcohol consumption and alcohol related consequences (e.g., DUI) among underage risky drinkers.35 It may be that key components of violence BIs, including empathy or complex therapist reflections concerning youth involvement in violence, may not be easily transferred to a computerized platform. Alternatively, recently tested BIs with efficacy reducing substance use may have benefited from advancements in automated tailoring technology. In addition, the marked increase in adolescent utilization of interactive technologies such as social media may serve to enhance the effectiveness of newer technology-based therapeutic interventions. Regardless, further study is needed to develop the most seamless and cost-effective delivery method for a universal violence BI. One potential alternative is the use of centralized call centers with access to remote therapists that can deliver the intervention, especially among low-resource urban EDs. This approach has recently gained acceptance in medical and research communities, as well as among large insurance agencies for other disease management and behavioral interventions70–74 and may offer a more cost-efficient delivery method for underserved low resource settings.
Limitations
Study limitations should be acknowledged; including the quasi-experimental rather than RCT design. This concern is partly mitigated by the absence of baseline differences among study conditions and the focus of the study on replicating the positive SafERteens effects among a universal sample. However, it must be acknowledged that we cannot fully account for the full range of potential unmeasured confounding variables with this design. Findings may not generalize to youth not included in the study, including those in Flint who do not reside in the intervention or comparison neighborhoods, as well as those who were excluded (e.g., youth seeking care for suicidal ideation/sexual assault). While the sample reflected the racial and ethnic composition of the study site, further testing among youth with other racial and ethnic characteristics (e.g., Hispanic) is required. The use of self-report data is a potential limitation; however prior studies confirm the reliability and validity of self-report data when privacy and confidentiality are assured.75 Although attrition is a potential limitation, follow-up rates exceeded 90%. Further study with a longer follow-up period is required to assess the effects of the BI on long-term outcomes. Finally, as this was one component of a larger youth violence prevention program, there may have been spill over effects from the other interventions; however, less than 2% of the intervention group reported exposure to one of the other youth violence initiatives.
Conclusion
Our evaluation suggests that a universal BI for violence, delivered by a therapist in the ED setting, can be effective in reducing aggression and increasing self-efficacy for avoiding fighting among a universal sample of youth in a high-risk community. These findings have important implications for community-based violence prevention programs addressing this complex public health problem. Future research should focus on investigating alternative cost-efficient delivery mechanisms that can improve the likelihood of translating this universal BI into the routine clinical care that is provided to ED youth in high-risk communities to decrease the leading cause of morbidity and mortality among urban youth.
Acknowledgments
Funding Sources/Disclosures: This work was funded by CDC# 5-U01-CE-001957-03, and in part by CDCP 1R49CE002099 and NIH/NIDA K23DA039341. The views in the manuscript do not necessarily reflect those of the funding agency. Dr. Carter authored the first draft of this manuscript. No honoraria, grants or other form of payment were received from any of the coauthors for producing this manuscript.
The authors wish to acknowledge project staff including Aaron Cheek, LLBSW, and Sandra Evans, LLMSW, for their work on this project, Wendi Mohl, BS, for her assistance in manuscript preparation and Linping Duan, MS, for her assistance with statistical analysis. Finally, special thanks are owed to the patients and medical staff of the Hurley Medical Center (HMC) and the Michigan Youth Violence Prevention Center (YVPC) Steering Committee for their support of this project.
Abbreviations
- BI
Brief Intervention
- ED
Emergency Department
- US
United States
- RCT
Randomized Control Trial
- HMC
Hurley Medical Center
- UM
University of Michigan
- IRB
Institutional Review Board
- CDC
Centers for Disease Control
- CTS
Conflicts tactics scale
- CADRI
Conflict in adolescent dating relationships inventory
- MI
Motivational Interviewing
- DUI
Driving under the Influence
- IRR
Incident Rate Ratio
- CI
Confidence Interval
- YVPC
Youth Violence Prevention Center
- SD
standard deviation
- NIH
National Institutes of Health
Footnotes
Prior Presentations: Society for Academic Emergency Medicine (Spring 2016)
References
- 1.Grinshteyn E, Hemenway D. Violent Death Rates: The United States Compared to Other High-Income OECD Countries, 2010. The American Journal of Medicine. 2015 doi: 10.1016/j.amjmed.2015.10.025. [DOI] [PubMed] [Google Scholar]
- 2.Centers for Disease Control and Prevention. [Accessed 10/29/15, 2015];Web-based Injury Statistics Query and Reporting System. 2014 http://www.cdc.gov/injury/wisqars/
- 3.Kann L, Kinchen S, Shanklin SL, Flint KH, Kawkins J, Harris WA, Lowry R, Olsen E, McManus T, Chyen D. Youth risk behavior surveillance—United States, 2013. MMWR Surveill Summ. 2014;63(Suppl 4):1–168. [PubMed] [Google Scholar]
- 4.Corso PS, Mercy JA, Simon TR, Finkelstein EA, Miller TR. Medical costs and productivity losses due to interpersonal and self-directed violence in the United States. Am J Prev Med. 2007;32(6):474–482. doi: 10.1016/j.amepre.2007.02.010. [DOI] [PubMed] [Google Scholar]
- 5.Cunningham R, Knox L, Fein J, Harrison S, Frisch K, Walton M, Dicker R, Calhoun D, Becker M, Hargarten SW. Before and After the Trauma Bay: The Prevention of Violent Injury Among Youth. Ann Emerg Med. 2009;53(4):490–500. doi: 10.1016/j.annemergmed.2008.11.014. [DOI] [PubMed] [Google Scholar]
- 6.National Institutes of Health. NIH State-of-the-Science Statement on Preventing Violence and Related Health-Risking Social Behaviors in Adolescents. 2004. [Google Scholar]
- 7.Committee on Injury Violence. Policy statement--Role of the pediatrician in youth violence prevention. Pediatrics. 2009;124(1):393. doi: 10.1542/peds.2009-0943. [DOI] [PubMed] [Google Scholar]
- 8.Muelleman RL, Reuwer J, Sanson TG, Gerson L, Woolard B, Yancy AH, 2nd, Bernstein E. An emergency medicine approach to violence throughout the life cycle. SAEM Public Health and Education Committee. Acad Emerg Med. 1996;3(7):708–715. doi: 10.1111/j.1553-2712.1996.tb03496.x. [DOI] [PubMed] [Google Scholar]
- 9.Fein JA, Ginsburg KR, McGrath ME, Shofer FS, Flamma JC, Datner EM. Violence Prevention in the Emergency Department. Arch Pediatr Adolesc Med. 2000;154(5):495. doi: 10.1001/archpedi.154.5.495. [DOI] [PubMed] [Google Scholar]
- 10.National Research Council and Institute of Medicine. Injury in America: A Continuing Health Problem. Washington D.C: National Academy Press; 1985. [Google Scholar]
- 11.National Prvention Council. National Prevention Strategy: Injury and Violence Free Living. Office of the Surgeon General; 2011. [Google Scholar]
- 12.Gorman-Smith D, Henry DB, Tolan PH. Exposure to community violence and violence perpetration: The protective effects of family functioning. Journal of Clinical Child and Adolescent Psychology. 2004;33(3):439–449. doi: 10.1207/s15374424jccp3303_2. [DOI] [PubMed] [Google Scholar]
- 13.Walton MA, Cunningham RM, Chermack ST, Maio R, Blow FC, Weber J. Correlates of violence history among injured patients in an urban emergency department: gender, substance use, and depression. J Addict Dis. 2007;26(3):61–75. doi: 10.1300/J069v26n03_07. [DOI] [PubMed] [Google Scholar]
- 14.Cunningham RM, Ranney M, Newton M, Woodhull W, Zimmerman M, Walton MA. Characteristics of youth seeking emergency care for assault injuries. Pediatrics. 2014;133(1):e96–e105. doi: 10.1542/peds.2013-1864. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Zatzick D, Jurkovich G, Rivara FP, Russo J, Wagner A, Wang J, Dunn C, Lord SP, Petrie M, O’Connor SS, Katon W. A Randomized Stepped Care Intervention Trial Targeting Posttraumatic Stress Disorder for Surgically Hospitalized Injury Survivors. Annals of Surgery. 2013;257(3):390–399. doi: 10.1097/SLA.0b013e31826bc313. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Margolin G, Vickerman KA, Oliver PH, Gordis EB. Violence exposure in multiple interpersonal domains: Cumulative and differential effects. Journal of Adolescent Health. 2010;47(2):198–205. doi: 10.1016/j.jadohealth.2010.01.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Boynton-Jarrett R, Ryan LM, Berkman LF, Wright RJ. Cumulative violence exposure and self-rated health: longitudinal study of adolescents in the United States. Pediatrics. 2008;122(5):961–970. doi: 10.1542/peds.2007-3063. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Taylor TJ, Freng A, Esbensen FA, Peterson D. Youth Gang Membership and Serious Violent Victimization: The Importance of Lifestyles and Routine Activities. J Interpers Violence. 2008;23(10):1441–1464. doi: 10.1177/0886260508314306. [DOI] [PubMed] [Google Scholar]
- 19.Cunningham RM, Carter PM, Ranney M, Zimmerman MA, Blow FC, Booth BM, Goldstick J, Walton MA. Violent Reinjury and Mortality Among Youth Seeking Emergency Department Care for Assault-Related Injury. JAMA Pediatrics. 2015;169(1):63. doi: 10.1001/jamapediatrics.2014.1900. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Carter PM, Walton MA, Roehler DR, Goldstick J, Zimmerman MA, Blow FC, Cunningham RM. Firearm violence among high-risk emergency department youth after an assault injury. Pediatrics. 2015;135(5):805–815. doi: 10.1542/peds.2014-3572. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Stoddard SA, Whiteside L, Zimmerman MA, Cunningham RM, Chermack ST, Walton MA. The Relationship Between Cumulative Risk and Promotive Factors and Violent Behavior Among Urban Adolescents. American Journal of Community Psychology. 2012;51(1–2):57–65. doi: 10.1007/s10464-012-9541-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Pailler ME, Kassam-Adams N, Datner EM, Fein JA. Depression, acute stress and behavioral risk factors in violently injured adolescents. Gen Hosp Psychiatry. 2007;29(4):357–363. doi: 10.1016/j.genhosppsych.2007.04.003. [DOI] [PubMed] [Google Scholar]
- 23.Cunningham R, Walton M, Trowbridge M, Weber J, Outman R, Benway A, Maio R. Correlates of violent behavior among adolescents presenting to an urban emergency department. J Pediatr. 2006;149(6):770–776. doi: 10.1016/j.jpeds.2006.08.073. [DOI] [PubMed] [Google Scholar]
- 24.Walton MA, Cunningham RM, Goldstein AL, Chermack ST, Zimmerman MA, Bingham CR, Shope JT, Stanley R, Blow FC. Rates and correlates of violent behaviors among adolescents treated in an urban emergency department. J Adolesc Health. 2009;45(1):77–83. doi: 10.1016/j.jadohealth.2008.12.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Carter PM, Walton MA, Newton MF, Clery M, Whiteside LK, Zimmerman MA, Cunningham RM. Firearm Possession Among Adolescents Presenting to an Urban Emergency Department for Assault. Pediatrics. 2013;132(2):213–221. doi: 10.1542/peds.2013-0163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Zun LS, Downey L, Rosen J. Who are the young victims of violence? Pediatr Emerg Care. 2005;21(9):568–573. doi: 10.1097/01.pec.0000177195.45537.95. [DOI] [PubMed] [Google Scholar]
- 27.Ramirez M, Wu Y, Kataoka S, Wong M, Yang J, Peek-Asa C, Stein B. Youth Violence across Multiple Dimensions: A Study of Violence, Absenteeism, and Suspensions among Middle School Children. J Pediatr. 2012;161(3):542–546. e542. doi: 10.1016/j.jpeds.2012.03.014. [DOI] [PubMed] [Google Scholar]
- 28.Grove DD, Lazebnik R, Petrack EM. Urban emergency department utilization by adolescents. Clin Pediatr (Phila) 2000;39(8):479–483. doi: 10.1177/000992280003900806. [DOI] [PubMed] [Google Scholar]
- 29.Johnston BD, Rivara FP, Droesch RM, Dunn C, Copass MK. Behavior change counseling in the emergency department to reduce injury risk: a randomized, controlled trial. Pediatrics. 2002;110(2 Pt 1):267–274. doi: 10.1542/peds.110.2.267. [DOI] [PubMed] [Google Scholar]
- 30.Monti PM, Colby SM, Barnett NP, Spirito A, Rohsenow DJ, Myers M, Woolard R, Lewander W. Brief intervention for harm reduction with alcohol-positive older adolescents in a hospital emergency department. J Consult Clin Psychol. 1999;67(6):989–994. doi: 10.1037//0022-006x.67.6.989. [DOI] [PubMed] [Google Scholar]
- 31.Gregor MA, Shope JT, Blow FC, Maio RF, Weber JE, Nypaver MM. Feasibility of using an interactive laptop program in the emergency department to prevent alcohol misuse among adolescents. Ann Emerg Med. 2003;42(2):276–284. doi: 10.1067/mem.2003.265. [DOI] [PubMed] [Google Scholar]
- 32.Spirito A, Monti PM, Barnett NP, Colby SM, Sindelar H, Rohsenow DJ, Lewander W, Myers M. A randomized clinical trial of a brief motivational intervention for alcohol-positive adolescents treated in an emergency department. J Pediatr. 2004;145(3):396–402. doi: 10.1016/j.jpeds.2004.04.057. [DOI] [PubMed] [Google Scholar]
- 33.Strecher V, Wang C, Derry H, Wildenhaus K, Johnson C. Tailored interventions for multiple risk behaviors. Health Educ Res. 2002;17(5):619–626. doi: 10.1093/her/17.5.619. [DOI] [PubMed] [Google Scholar]
- 34.Bernstein E, Bernstein J, Levenson S. Project ASSERT: an ED-based intervention to increase access to primary care, preventive services, and the substance abuse treatment system. Ann Emerg Med. 1997;30(2):181–189. doi: 10.1016/s0196-0644(97)70140-9. [DOI] [PubMed] [Google Scholar]
- 35.Cunningham RM, Chermack ST, Ehrlich PF, Carter PM, Booth BM, Blow FC, Barry KL, Walton MA. Alcohol Interventions among Underage Drinkers in the ED: A Randomized Controlled Trial. Pediatrics. 2015 doi: 10.1542/peds.2015-1260. [ePub ahead of print] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Walton MA, Chermack ST, Shope JT, Bingham CR, Zimmerman MA, Blow FC, Cunningham RM. Effects of a brief intervention for reducing violence and alcohol misuse among adolescents: a randomized controlled trial. JAMA. 2010;304(5):527–535. doi: 10.1001/jama.2010.1066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Cunningham RM, Chermack S, Zimmerman MA, Shope JT, Bingham CR, Blow FC, Walton MA. Brief Motivational Interviewing Intervention for Peer Violence and Alcohol Use in Teens: One Year Follow-up. Pediatrics. 2012;129(6):1083–1090. doi: 10.1542/peds.2011-3419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Cunningham RM, Whiteside LK, Chermack ST, Zimmerman MA, Shope JT, Raymond Bingham C, Blow FC, Walton MA. Dating Violence: Outcomes Following a Brief Motivational Interviewing Intervention Among At–risk Adolescents in an Urban Emergency Department. Acad Emerg Med. 2013;20(6):562–569. doi: 10.1111/acem.12151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Federal Bureau of Investigation. Uniform Crime Reports: Table 8 - Offenses Known to Law Enforcement by State by City. 2013. [Google Scholar]
- 40.Heinze JE, Reischl TM, Bai M, Roche JS, Morrel-Samuels S, Cunningham RM, Zimmerman MA. A Comprehensive Prevention Approach to Reducing Assault Offenses and Assault Injuries among Youth. Prevention Science. 2015 doi: 10.1007/s11121-015-0616-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Harris K, Florey F, Tabor J, Bearman P, Jones J, Udry J. [Accessed 2008, May 21];The national longitudinal study of adolescent health: Research design [WWW document] 2003 http://www.cpc.unc.edu/projects/addhealth/design.
- 42.Bearman PS, Jones J, Udry JR. The National Longitudinal Study of Adolescent Health: Research Design. 2005 1997; http://www.cpc.unc.edu/projects/addhealth.
- 43.National Institues of Health. NIH Policy on Reporting Race and Ethnicity Data: Subjects in Clinical Research. 2001. [Google Scholar]
- 44.U.S. National Institute on Drug Abuse; Department of Health and Human Services, editor. Drug Abuse Treatment Outcome Study (DATOS) 1991–1995. [Google Scholar]
- 45.Zimmerman M. Flint [Michigan] Adolescent Study (FAS): A Longitudinal Study of School Dropout and Substance Use, 1994–1997. 2014. [Google Scholar]
- 46.Sheley JF, Wright JD. Tulane University National Youth Study. New Orleans: Tulane University; 1995. [Google Scholar]
- 47.Sheley JF, Wright JD. PsycEXTRA Dataset. American Psychological Association (APA); 1998. High School Youth, Weapons, and Violence: A National Survey of Weapon-Related Experiences, Behaviors, and Concerns. [Google Scholar]
- 48.Henry DB, Tolan PH, Gorman-Smith D. Longitudinal family and peer group effects on violence and nonviolent delinquency. J Clin Child Psychol. 2001;30(2):172–186. doi: 10.1207/S15374424JCCP3002_5. [DOI] [PubMed] [Google Scholar]
- 49.Richters JE, Saltzman W. Survey of exposure to community violence: Self-report version. JE Richters; 2008. [Google Scholar]
- 50.Richters JE, Martinez P. Things I have seen and heard: A structured interview for assessing young children’s violence exposure. Rockville, MD: National Institute of Mental Health; 1990. [Google Scholar]
- 51.Straus MA. Conflict Tactics Scales. In: Jackson NA, editor. Encyclopedia of Domestic Violence. New York: Routledge: Taylor & Francis Group; 2007. p. 824. [Google Scholar]
- 52.Straus MA, Hamby SL, Boney-McCoy S, Sugarman DB. The Revised Conflict Tactics Scales (CTS2) Development and Preliminary Psychometric Data. Journal of Family Issues. 1996;17(3):283–316. [Google Scholar]
- 53.Wolfe DA, Scott K, Reitzel-Jaffe D, Wekerle C, Grasley C, Straatman AL. Development and validation of the Conflict in Adolescent Dating Relationships Inventory. Psychol Assess. 2001;13(2):277–293. [PubMed] [Google Scholar]
- 54.Bosworth K, Espelage D. Teen Conflict Survey. Bloomington, IN: Center for Adolescent Studies, Indiana University; 1995. [Google Scholar]
- 55.Dahlberg LL, Toal SB, Behrens CB. Measuring violence-related attitudes, beliefs, and behaviors among youths: a compendium of assessment tools. Division of Violence Prevention, National Center for Injury Prevention and Control, Centers for Disease Control and Prevention; 1998. [Google Scholar]
- 56.Rollnick S, Miller W, Butler C. Motivational interviewing in health care: Helping patients change behavior. New York: Guilford; 2007. [Google Scholar]
- 57.Resnicow K, Rollnick S. Handbook of Motivational Counseling: Goal-based Approaches to Assessment and Intervention with Addiction and Other Problems. Hoboken, NJ: John Wiley & Sons, Ltd; 2004. Motivational Interviewing in Health Promotion and Behavioral Medicine. [Google Scholar]
- 58.Moyers T, Martin T, Manuel J, Miller W, Ernst D. Revised global scales: Motivational interviewing treatment integrity 3.0 (MITI 3.0) University of New Mexico, Center on Alcoholism, Substance Abuse and Addictions (CASAA); Albuquerque, NM: 2007. p. 28. [Google Scholar]
- 59.Hedges LV, Olkin I. Statistical Methods for Meta-Analysis. San Diego, CA: Academic Press; 1985. [Google Scholar]
- 60.Gottfredson DC, Wilson DB. Characteristics of effective school-based substance abuse prevention. Prev Sci. 2003;4(1):27–38. doi: 10.1023/a:1021782710278. [DOI] [PubMed] [Google Scholar]
- 61.Walton MA, Chermack ST, Shope JT, Bingham CR, Zimmerman MA, Blow FC, Cunningham RM. Effects of a Brief Intervention for Reducing Violence and Alcohol Misuse Among Adolescents. JAMA. 2010;304(5):527. doi: 10.1001/jama.2010.1066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62.Wilson SJ, Lipsey MW. School-based interventions for aggressive and disruptive behavior: Update of a meta-analysis. Am J Prev Med. 2007;33(2):S130–S143. doi: 10.1016/j.amepre.2007.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.WISQARS (Web-based injury Statistics Query and Reporting System) Query W. 2010 http://www.cdc.gov/injury/wisqars/index.html.
- 64.Hahn R, Fuqua-Whitley D, Wethington H, Lowy J, Crosby A, Fullilove M, Johnson R, Liberman A, Moscicki E, Price L, Snyder S, Tuma F, Cory S, Stone G, Mukhopadhaya K, Chattopadhyay S, Dahlberg L. Effectiveness of universal school-based programs to prevent violent and aggressive behavior: a systematic review. Am J Prev Med. 2007;33(2 Suppl):S114–129. doi: 10.1016/j.amepre.2007.04.012. [DOI] [PubMed] [Google Scholar]
- 65.Sigel E. 66. Violence Risk Screening: Predicting Cyber Violence Perpetration and Victimization. Journal of Adolescent Health. 2013;2(52):S53. [Google Scholar]
- 66.Sigel E, Hart J, Hoffenberg A, Dodge M. Development and psychometric properties of a violence screening tool for primary care. Journal of Adolescent Health. 2011;48(4):358–365. doi: 10.1016/j.jadohealth.2010.07.024. [DOI] [PubMed] [Google Scholar]
- 67.Hayes DN, Sege R. FiGHTS: a preliminary screening tool for adolescent firearms-carrying. Ann Emerg Med. 2003;42(6):798–807. doi: 10.1016/S0196064403007224. [DOI] [PubMed] [Google Scholar]
- 68.Borowsky IW, Mozayeny S, Stuenkel K, Ireland M. Effects of a primary care-based intervention on violent behavior and injury in children. Pediatrics. 2004;114(4):e392–399. doi: 10.1542/peds.2004-0693. [DOI] [PubMed] [Google Scholar]
- 69.Cunningham RM, Chermack ST, Zimmerman MA, Shope JT, Bingham CR, Blow FC, Walton MA. Brief Motivational Interviewing Intervention for Peer Violence and Alcohol Use in Teens: One-Year Follow-up. PEDIATRICS. 2012;129(6):1083–1090. doi: 10.1542/peds.2011-3419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70.Alexander GL, McClure JB, Calvi JH, Divine GW, Stopponi MA, Rolnick SJ, Heimendinger J, Tolsma DD, Resnicow K, Campbell MK. A randomized clinical trial evaluating online interventions to improve fruit and vegetable consumption. Am J Public Health. 2010;100(2):319. doi: 10.2105/AJPH.2008.154468. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.McKay JR, Lynch KG, Shepard DS, Ratichek S, Morrison R, Koppenhaver J, Pettinati HM. The effectiveness of telephone-based continuing care in the clinical management of alcohol and cocaine use disorders: 12-month outcomes. Journal of Consulting and Clinical Psychology. 2004;72(6):967. doi: 10.1037/0022-006X.72.6.967. [DOI] [PubMed] [Google Scholar]
- 72.Damschroder LJ, Lutes LD, Goodrich DE, Gillon L, Lowery JC. A small-change approach delivered via telephone promotes weight loss in veterans: results from the ASPIRE-VA pilot study. Patient education and counseling. 2010;79(2):262–266. doi: 10.1016/j.pec.2009.09.025. [DOI] [PubMed] [Google Scholar]
- 73.Moczygemba LR, Barner JC, Gabrillo ER, Godley PJ. Development and implementation of a telephone medication therapy management program for Medicare beneficiaries. American Journal of Health-System Pharmacy. 2008;65(17):1655–1660. doi: 10.2146/ajhp070639. [DOI] [PubMed] [Google Scholar]
- 74.Ranney ML, Choo EK, Cunningham RM, Spirito A, Thorsen M, Mello MJ, Morrow K. Acceptability, language, and structure of text message-based behavioral interventions for high-risk adolescent females: A qualitative study. Journal of Adolescent Health. 2014;55(1):33–40. doi: 10.1016/j.jadohealth.2013.12.017. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Brener ND, Billy JO, Grady WR. Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: evidence from the scientific literature. J Adolesc Health. 2003;33(6):436–457. doi: 10.1016/s1054-139x(03)00052-1. [DOI] [PubMed] [Google Scholar]