Abstract
Purpose of Review
Computer-based programs for substance use prevention and intervention among youth are on the ascendancy. Whether delivered by computer per se or by electronic tablet or smartphone, technology-driven programs are harmonious with how young people access information and interact with their worlds. This review examines recent evidence on computer-based programs aimed at substance use among youth, with particular attention to results from randomized trials.
Recent Findings
Outcome studies of computer-based, substance use-related programs published over the past 5 years reveal mixed results amidst diverse intervention approaches and delivery settings. Many studies are marred by high attrition. Notable in the recent literature is the international nature of technology-driven substance use prevention and intervention programs. With some exceptions, most programs appear to not have been customized for their recipient populations. Though few in number, the highest-quality studies of computer-based programs show positive outcomes in reduced substance use rates.
Summary
Based on recent findings, considerable work needs to happen before computer-delivered approaches are a proven means for reducing substance use among youth. Original programs, expressly developed for subgroups of youth, are in short supply. Though controlled designs are becoming commonplace, too many studies of computer-based programs suffer from flaws—including high rates of attrition—that limit the discovery of positive outcomes.
Keywords: Computer-based prevention and intervention, Substance use, Adolescents, Children
Introduction
Technological advances are changing how most goods and services are delivered. Unsurprisingly, the delivery of substance use prevention and intervention services efforts for youth is also employing new technologies in the form of computer-based programs. Computer-based programs offer promise to improve prevention and intervention efficacy, cost structure, logistics, responsiveness, and availability [1**]. Still, challenges remain before computer-based prevention and intervention programs realize their potential. Driving much of the research on computer-based prevention and intervention programs to reduce youthful substance use is an implied belief that technology will exert the same influence it has had on the way youth talk to their friends, do their homework, listen to music, and conduct the bulk of their quotidian affairs.
Investigators and practitioners, policy makers and program planners, and all who are concerned about substance use among children and adolescents cannot fail to see the ubiquity of technology in youths’ lives. Young people live by and on their smartphones, laptops, desktops, electronic tablets, and the myriad other devices categorized as computers. Adding impetus to the exploration of computer approaches are findings that heavy use of the internet among youth, including exposure to negative role modeling, is associated with alcohol and drug use [2–6]. If computer use is linked to youthful substance use, perhaps computer technology offers a means for reducing substance use.
The Promise of Computer-Based Programs
Computer-based prevention and intervention programs to reduce substance use among youth offer hope for several reasons. Unlike classroom-based or other live delivery approaches, computer-based programs do not of necessity rely on in-person teachers, health educators, or other instructors. These intervention agents must be screened, trained, paid, and monitored. Live intervention agents can idiosyncratically interpret a prevention or intervention protocol. By misinterpreting a protocol, intervention agents can vitiate substance use reduction messages, confuse youth, and possibly cause harm. Even when delivered with fidelity, in-person programs are costly. The logistics associated with in-person programs are encountered when intervention agents attempt to bring youth together at the same time and place for their receipt of a prevention or intervention program. Moreover, in-person programs are burdensome to implement with fidelity [7, 8]. That computer-based programs address some or all of the logistical, idiosyncratic, fidelity, and other flaws that plague in-person programs partially explains the growth of computer-based prevention and intervention programs to reduce substance use among youth.
Beyond obviating the limitations of in-person programs, computer-based programs bring benefits inherent to technological innovations. Delivering prevention and intervention programs through computer-based devices is relatively inexpensive. Once a program has been developed and tested, its online dissemination costs little. Computer programs are invariably interactive. Youth can access programs through keyboards, navigational mice, and touchscreens. These features let youth respond to questions, make choices, and advance the programs as they would when playing computer games or accessing school materials. Interactivity can foster engagement, which may antecede cognitive and behavioral changes. Computer-based programs are portable, an essential advantage to exploit the omnipresence of smartphones among youth. Computer-based programs lend themselves to customization. Customizable programs can meet a youth’s demographic profile and individual preferences, advantages that will only expand as programs undergo development and testing [9]. When computer-based programs are ready for dissemination, they can be embedded into a website, downloaded, or accessed through cloud services quickly and cheaply.
Computer-based programs bring advantages for investigators and for teachers, health educators, and other professionals invested in delivering evidence-based programs to youth at risk for substance use. For all of these constituencies, the high fidelity of computer-based programs is attractive. To complete a substance use reduction program, a youth may be required to correctly answer sequenced questions about the consequences of drug use, about peer pressure and refusal skills, and about steps in a cognitive problem-solving model. As the youth answers the questions, the program can record her responses, giving investigators quantified fidelity data. When the program moves to scale, those involved in its implementation can similarly monitor fidelity [1**]. Implementation integrity can be enhanced in computer-based programs when provisions are in place to limit inattention, intentionally skipped content, and overlooked material. Once a youth completes a program, those involved with it can be relatively confident that the program delivered was the program received.
Obstacles to Successful Computer-Based Programs
For the advantages of computer programs to be realized, obstacles must be overcome in developing, testing, implementing, and disseminating computer approaches to reduce adolescent substance use. Foremost is that computer-based programs are accessible only to users who possess the requisite equipment— computer, smartphone, electronic tablet, or other internet-connected device. Though most young people possess one or more of these devices, not all youths have access to the WiFi strength, hardwired connectivity, or data plans to allow the seamless transmissions that programs may require. Youths’ concerns about privacy and security are impediments to computer program delivery. Understandably, youths worry that their responses to electronic surveys with questions about underage drinking, illegal drug use, and related risk-taking behaviors could fall into the wrong hands. For their part, program developers have yet to discover a foolproof means of confirming the identity of whomever is downloading their prevention and intervention content.
Other obstacles to successful computer-delivered programs arise if their implementation conditions are less than ideal. Like any interactive computer experience, computer-based prevention and intervention programs aimed at substance use rely on end users to focus on and comply with programmatic materials. If youths quickly scroll through the material, are distracted during program delivery, or fail to seriously respond to prompts, polls, and other activities in a program, they can complete a program without profiting from it. As noted, computer-based prevention and intervention programs can contain fidelity checks that let delivery agents confirm that youths completed a program. But unless these checks are sophisticated, they cannot reveal whether a youth completed a program on her own or was aided by someone else—a friend, classmate, or even a parent.
The success and viability of computer-based programs are also threatened by rapid technological changes. Like the smartphone apps that youths download, computer-based substance use prevention and intervention programs have a limited shelf life. No matter how carefully crafted, any program is captive to the technology available to developers during its construction. As soon as a program is complete, it begins its path to obsolescence. The program’s clever features, engaging sights and sounds, and innovative graphics cannot long remain fresh. When the program is tested in a clinical trial with longitudinal follow-up data, the program will be further dated before it is disseminated. Youths who interact with the tested and disseminated program may find it wanting in the latest technological features. If youths compare the program to commercial products intended for their demographic, their disappointment may deepen.
State of the Science
Despite the relative newness of computer-based prevention and intervention to reduce substance use by adolescents, reviews and meta-analyses are available on the efficacy of these programs. Appearing in 2013, a report by Champion and her associates [10] examined 12 trials of 10 school-based programs delivered online and by CD-ROM. The programs engaged students aged 10 through 16 years (total N = 21,813) from the US, Canada, the Netherlands, Australia, and the UK, and targeted alcohol, marijuana, and tobacco use. Limiting their analysis to seven programs that permitted the computation of effect sizes and odds ratios, Champion et al. found that six of the seven programs showed reductions in alcohol, marijuana, and tobacco use at post-intervention or follow-up. Also published in 2013, a review by Tait and colleagues [11] reviewed 10 studies involving 4,125 participants who ranged from early adolescents to young adults. The interventions were delivered online and through CD-ROM and largely focused on drug use. Across the studies, the investigators found small but significant effect sizes.
A 2014 review from Rodriguez and his associates [12] examined eight studies of computer games aimed at reducing alcohol and other drug use among youth. The studies included 3,698 adolescents aged 10 through 18 years, and employed online, CD-ROM, and other technologies. Across the studies, Rodriguez et al. found positive knowledge outcomes for six studies, improved anti-drug attitudes for two studies, and decreased drug use frequency for one study. Also appearing in 2014, a report by Wood and her colleagues [13] examined 10 studies of computer-delivered prevention and intervention programs that engaged 1,502 adolescents and 2,606 adults and that were directed at reducing illicit recreational drug use. Among other findings, Wood et al. discovered that universal prevention programs reduced the frequency of recreational drug use when measured at 12-months or longer, but not necessary at post-intervention. Other reviews of computer-based programs add support to the potential of technological approaches for preventing substance use, for intervening with substance use problems, and for promoting health among youth and adults [14–23].
Text messaging through smartphones has also been subjected to meta-analyses. Two analyses report differing conclusions. Reviewing text messaging interventions for adolescent and adult substance use, Mason and his colleagues [24] found largely positive effects from text messaging. Contrariwise, a meta-analysis by Badawy and Kuhns [25*] of text messaging and mobile phone app interventions to improve adherence to preventive behavior among adolescents reported modest results. Growing reliance on smartphones to deliver prevention and intervention programs will doubtless witness a commensurate jump in research on this technology.
Recent Studies
A compilation of recent outcome studies on computer-based substance use prevention and intervention programs for youth appears in Table 1. Included are 26 studies that: 1) reported on computer-based programs to either prevent or intervene with substance use or substance use problems, 2) focused on youth aged under 20 years (excluding college students), 3) employed randomized designs to isolate program effects, and 4) were published or accepted for publication in peer-reviewed scholarly journals between 2012 and 2017. The studies in Table 1 are organized by programs that delivered: prevention programming to youth in school (n = 17), intervention programming to youth in school (n = 1), prevention programming to youth in a non-traditional setting (n = 1), intervention programming to youths in non-traditional settings (n = 4), and prevention programming to youth in their homes (n = 3).
Table 1.
Sample (N) | Program Description | Comparison | Outcomes and Attrition | |
---|---|---|---|---|
School-Based Prevention Programs | ||||
Prevent smoking. Bowen et al. [26] |
American Indian youth in South Dakota schools (113); M age 14.6 yrs. |
Online, culturally relevant modules that youth were encouraged to visit during 1-hr. daily access periods for 6 wks.; modules asked about smoking status and provided responsive content on smoking prevention and cessation. | Online module access vs. wait-list control. | At 1 mo., intentions to try cigarettes declined; youth were more likely to help others quit smoking, and had less positive attitudes about the drug effects of smoking. Roughly one-half of youth (52%) signed into the modules at least once during intervention period. Attrition was 9%. |
Reduce substance abuse and energy imbalance. Velicer et al. [27**] |
Adolescents in Rhode Island schools (4,158); M age 11.4 yrs. |
Five, 30-min. computer sessions; one in 6th grade, three in 7th grade, and one in 8th grade; one-half of youth received energy balance sessions and one-half received substance use prevention sessions; intervention was tailored to youths’ baseline health behaviors. | Energy balance arm vs. substance use prevention arm. | At 36 mos., energy balance intervention increased physical activity and healthy diets and reduced TV time, smoking, and alcohol use. The substance use prevention program was less effective in preventing smoking and alcohol use. Attrition at 36 mos. was 28.3%. |
Prevent tobacco use. Andrews et al. [28] |
Oregonelementary and middle schools (2,322). | Computer program delivered in classroom; eight sessions in 5th grade and two boosters in 6th grade, encompassing videos, games, role-plays, and social networking activities. | Computer-based program vs. usual curriculum. | At 1 and 2 yrs., lower intentions and willingness to smoke, and positive changes in mediator variables. Attrition at 1 and 2 yrs. was 28.4% and 32.8%, respectively. |
Promote health. Bannink et al. [29] |
Adolescents in Dutch high schools (1,702); M age 15.9 yrs. |
1. Internet program of a questionnaire with tailoring of messages, norms, and links to websites for information about alcohol, drugs, sex, bullying, mental health, and suicide; duration 45 mins. 2. Internet program plus consultation with nurse who applied motivational interviewing on risk factors identified by questionnaire. |
Both interventions vs. control. | At 4 mos., internet intervention-alone increased condom use and quality of life ratings. Internet plus consultation improved mental health status. Attrition was 26.2%. |
Reduce drinking. Doumas et al. [30, 31] |
Adolescents in Northwestern U.S. schools (538); M age 14.2 yrs. |
Online assessment and personalized normative feedback modules covering caloric and financial costs of drinking; individual drinking patterns compared to U.S. norms and local peers; risk status for negative consequences of drinking; risk avoidance strategies; information about alcohol; and referral information; average duration 30 mins. | Online program vs. usual drug and alcohol education. | At 3 mos., reduced positive alcohol expectancies and beliefs, drinking frequency, and alcohol-related consequences. No differences at 6 mos. Attrition at 3 and 6 mos. was 21% and 31%, respectively. |
Prevent smoking. de Josselin de Jong et al. [32] |
Adolescents in Dutch high schools (6,078); M age 14 yrs. |
Web-based program of text, graphics, and animated videos covering awareness, motivational, and action factors, accessed through a home page and providing tailored feedback. | Web-based program vs. control. | At 6 mos., lower rates of smoking initiation for youth aged 14 to 16 yrs., but not for the total sample of youth aged 10 to 20 yrs. Attrition was 18%. |
Prevent tobacco, alcohol, and cannabis use. Malmberg et al. [33] |
Adolescents in Dutch high schools (3,784); M age 14 yrs. |
1. Computer arm: Modules on tobacco, alcohol, and marijuana delivered over 4-mos., covering knowledge, risks, coping with peer pressure, and refusal skills delivered through films, animation, interactive tasks, and discussions in chatrooms and forums. 2. Integral arm: Same computer program plus parental participation, regulation (school standards), monitoring and counseling of training for school staff. |
Both intervention arms vs. control. | No effects for either arm on tobacco, alcohol, or cannabis consumption. Attrition at 8, 20, and 32 mos. was 9.2%, 17.7%, and 33.9%, respectively. |
Reduce truancy, psychological distress, and moral disengagement Newton et al. [34] |
Adolescents in Australian high schools (764); M age 13.1 yrs. |
Internet program of two sets of six 40-min. sessions to decrease alcohol misuse and cannabis use, followed by booster sessions 6 mos. of 15- to 20-min. cartoons showing teenagers experiencing problems with alcohol and cannabis and a compatible teacher-led activity. | Internet program vs. usual health classes. | At 12 mos., reduced truancy, psychological distress, and moral disengagement. Attrition at 12 mos. was 20.7%. |
Prevent psychostimulant and cannabis use. Vogl et al. [35] |
Adolescents in Australian high schools (1,734); M age 15.4 yrs. |
Computer- and teacher-delivered program of six, 40-min., lessons, divided into 15- to 20 min. segments; involving cartoon depictions of high-risk situations. Classroom segment delivered by teachers involved role-plays, discussion, and skill rehearsals. | Computer- and teacher-delivered program vs. usual health curriculum control. | At post-intervention, improved psychostimulant knowledge, lower ever use and frequency of use of ecstasy, lower intentions to use psychostimulants; at 5 and 10 mos., improved cannabis knowledge; at 10-mos., less favorable attitudes toward cannabis; at post-intervention and 10-mos., less favorable attitudes toward psychostimulants. Females showed more positive changes than males. Attrition at post-intervention and 5 and 10 mos. was 15.6%, 24.6%, 28.8%, respectively. |
Prevent smoking. Cremers et al. [36] |
Preadolescents in Dutch elementary schools (3,213); M age 10.4 yrs. |
1. Prompt arm received questionnaires and tailored feedback messages sent on 3 consecutive days plus six prompt messages via email and SMS each year encouraging use of intervention website. 2. No-prompt arm received same questionnaires and tailored feedback, but did not receive the additional six messages. |
Both intervention arms vs. control. | No effects for either intervention at 12 or 25 mos. Attrition was 33.2% and 53.8% at 12 and 25 mos., respectively. |
Prevent substance use. Arnaud et al. [37] |
Adolescents in Swedish, German, Belgian, and Czech high schools (1,449); M age 16.8 yrs. |
Computer program of six-motivational interviewing components presented in text and graphics; median duration 15 mins., ranging from 5 to 30 mins. | Program vs. control. | At 3 mos., reduced past-month drinking (findings not substantiated by imputed analyses). Attrition was 85.5%. |
Reduce alcohol and cannabis use. Champion et al. [38] |
Adolescents in Australian high schools (1,103); M age 13.3 yrs. |
Twelve, 20-min. cartoon components accessed online, followed by teacher-led discussions, role-plays, and worksheet completions. | Online plus teacher intervention vs. control. | At post-intervention, increased alcohol and cannabis knowledge and decreased alcohol use and intentions to use alcohol. Attrition was 20%. |
Reduce ecstasy and psychoactive substance use. Champion et al. [39] |
Adolescents in Australian high schools (1,126); M age 14.9 yrs. |
Four, 20-min. cartoon components accessed online, followed by optional online and teacher-delivered discussions and online worksheets. | Online plus teacher intervention vs. control. | At post-intervention, altered knowledge about psychoactive drugs and ecstasy. At 12 mos., reduced likelihood to use psychoactive substances. Attrition was 35.3% and 36.3% at post-intervention and 12-mos., respectively. |
Reduce binge drinking. Jander et al. [40] Drost et al. [41] |
Adolescents in Dutch high schools (2,649). | Computer game of five sessions in which youth are presented with drinking situations, asked to respond, and receive tailored feedback on their drinking behavior and plans; duration varied by youth. | Computer game vs. control. | At 4 mos., reduced binge drinking for 15- and 16-yr- olds, but not for older youth. Computer intervention was cost-effective for subgroups of adolescents. Attrition was 68.9%. |
Prevent tobacco and alcohol use. Kiewik et al. [42] |
Adolescents with developmental disabilities in Dutch special-needs high schools (254); M age 13.6 yrs. |
Computer program of games, videos, quizzes, and examples of refusal skills; avatar provided explanations, tips, feedback, and support; youth completed program at own pace. | Computer program vs. control. | At post-intervention, improved knowledge of smoking and drinking and lower peer use of tobacco. Attrition was 17.4%. |
Prevent smoking. Nădășan et al. [43] |
Adolescents in Romanian high schools (1,369); M age 15.9 yrs. |
Web delivery of five weekly, 45- to 50-min. sessions, covering determinants of smoking, nicotine addiction, strategies to quit and resist smoking, and dealing with stress, peer pressure, temptations, and mood changes. | Web program vs. control. | At 6 mos., reduced likelihood of smoking initiation among never-smoked youth. Lower initiation rates most pronounced for youth exposed to at least 75% of the program. Attrition was 30.7% for web arm and 20.9% for control arm. |
Reduce alcohol risk factors. Doumas et al. [44] |
Adolescents in Northwestern U.S. high schools (346); M age 17.2 yrs. |
Online assessment and personalized normative feedback modules, including graphic depictions of the consequences of drinking in caloric content, physical performance, myths, peer drinking norms, beliefs, expectancies, risk factors, and potential for problems; duration 30 mins. | Web program vs. alcohol and drug education delivered by school counselor. | At 4 to 6 wks., reduced perceptions of peer drinking, beliefs about alcohol, and positive alcohol expectancies for females. Attrition was 23.4%. |
| ||||
School-Based Intervention Program | ||||
Reduce heavy drinking. Voogt et al. [45] |
Adolescents in Dutch preparatory and vocational schools who reported recent heavy drinking (609); M 17.3 yrs. |
Web-based motivational interviewing program covering knowledge, social norms, and self-efficacy; single session of roughly 20 mins. | Web program vs. control. | At 1 mo., lowered binge drinking (in completers-only analyses; intent-to-treat analyses revealed no differences). Attrition was 35.5% and 54% at 1 and 6 mos., respectively. |
| ||||
Non-Traditional Setting Prevention Programs | ||||
Prevent cannabis use. Walton et al. [46] |
Adolescent patients at Midwestern U.S. urban primary care clinics (714); M 14.9 yrs. |
Animated interactive program with virtual therapist; role-play scenarios; average duration 33 mins. over 2 wks. | Computer therapist vs. same program delivered by live therapist vs. control | At 3 mos., computer program lowered other drug use; at 3, 6, and 12 mos., lowered cannabis use. Live therapist intervention did not affect cannabis use, but lowered other drug use at 6 mos. and delinquency rates at 3 mos. Attrition at 3, 6, and 12 mos. was 11%, 12%, and 12%, respectively. |
| ||||
Non-Traditional Setting Intervention Programs | ||||
Prevent HIV disease. Marsch et al. [47] |
Adolescents in outpatient treatment in New York City (141); M age 16.4 yrs. |
Web program of 26 modules on drug- and sex-related risk factors for HIV, skills for coping with HIV, and maintaining a healthy lifestyle, including a customized plan; duration 10 to 30 mins. per module. | Web-based program vs. same program delivered by prevention specialist. | At 2 weeks, web program showed increases comparable to prevention specialist in HIV/disease-related knowledge, condom use self-efficacy, condom use skills, and decreases in HIV risk behavior. Web program rated as easier to understand than prevention specialist. No attrition. |
Reduce tobacco use. Mason et al. [48] |
Adolescents in community substance abuse clinic in Virginia (72); M age 15.8 yrs. |
Motivational interviewing (MI) of rapport building, tobacco use feedback, social network information and feedback, and plans for change, delivered by text messages to smartphones. | MI texts vs. health-related texts sent to attention control arm. | At 6 mos., MI arm decreased cigarettes smoked in past 30 days, increased intentions to not smoke, and increased peer social support. Attrition not reported. |
Reduce violence and alcohol misuse. Cunningham et al. [49] |
Adolescents at an emergency department who screened positive for violence and alcohol use in Michigan (726); M 16.8 yrs. |
1. Computer program alone: interactive cartoons and tailored feedback. 2. Therapist-assisted: same computer program plus assistance from in-person therapist. |
Computer program vs. therapist-assisted program vs. control. | At 12 mos., therapist-assisted arm reduced peer aggression and peer victimization. No differences for computer-only arm. Attrition was 16.4%. |
Reduce risky drinking. Walton et al. [50] Cunningham et al. [51] |
Adolescents at an emergency department who screened positive for risky drinking in Michigan (836); M 18.6 yrs. |
1. Computer program of three sections covering normative feedback, personal strengths, and alternatives to drinking; M duration 34.7 mins. 2. Therapists who led youth through the same computer program; M duration 45.5 mins. |
Computer program vs. therapist program aided by computer vs. control. | Computer and therapist arms lowered rates of alcohol consumption at 3 mos., alcohol consequences at 3 and 12 mos., and prescription drug use at 12 mos. Computer arm lowered DUI rate at 12 mos. Therapist arm reduced frequency of alcohol-related injuries at 12 mos. Attrition was 13.2% and 12% at 3 and 6 mos., respectively. |
| ||||
Home-Based Prevention Programs | ||||
Prevent substance use. Fang et al. [52] |
Adolescent Asian-American girls and their mothers from across the U.S. (108 dyads, 216 total participants); M 13.1 yrs. |
Interactive online program of nine 35- to 45-min. sessions of audio, graphics activities to engage mothers and daughters in skills demonstrations and guided rehearsals with feedback; duration M = 175 days. | Online program vs. control. | At 2 yrs., daughters and mothers increased closeness and communication, maternal monitoring, and imposition of family rules against substance use. Daughters increased self-efficacy and refusal skills, lowered their intentions to use harmful substances, and reported less alcohol, marijuana, and prescription drug use. Attrition was 13.9%. |
Reduce illicit drug use. Schwinn et al. [53] |
Adolescents who identify as LGBTQ from across the U.S. (236); M age 16.1 yrs. |
Three online sessions of interactive games, role-playing, writing activities, stress management skills, decision making, and drug refusal skills; duration of each session 14 mins. Youth took an average of 4 mos. to complete. | Online intervention vs. control. | Lower 3 mos. rates of stress, peer drug use, and 30-day other drug use, and higher coping, problem-solving, and drug refusal skills. Attrition was 15%. |
Reduce drug use. Schwinn et al. [54] |
Adolescent girls from across the U.S. (788); M age 13.7 yrs. |
Web program of nine sessions, each requiring 15 to 20 mins. to complete, covering goal setting, body image, coping, drug knowledge, and refusal skills, and involving virtual role-playing in response to stimulus scenarios. | Web program vs. control. | At posttest, fewer cigarettes smoked and higher self-esteem, goal setting, media literacy, and self-efficacy scores. At 1 yr., less binge drinking and smoking and better marijuana refusal skills, coping skills, and media literacy and lower peer drug use. Attrition was a 2.5% and 3% at posttest and 1-yr. follow-up, respectively. |
Reported Aims and Outcomes
Most (n = 20) of the 26 studies in Table 1 aimed to reduce substance use per se; three studies aimed at either risk factors associated with substance use (n = 1) [44] or at substance use plus a related behavior (n = 2), including energy imbalance [27] and violence [49]. Three studies aimed at either health promotion (n = 1) [29] or at non-substance use topics of HIV disease (n = 1) [47] or truancy, psychological disorders, and moral disengagement (n = 1) [34], with both of the latter studies employing substance use interventions to bring about change in their targeted non-substance use topics. Owing to their substance use reduction aims or their substance use interventions, most of the 26 studies engaged youth in the middle adolescent years (M = 14.8 years; SD = 2.05).
Outcomes reported by the studies in Table 1 encompass a range of behavioral and cognitive improvements. Behavioral outcomes included: reduced use of alcohol, cigarettes, marijuana, and prescription, psychoactive, and other drugs; lowered rates of driving under the influence, alcohol-related injuries, delinquency, truancy, HIV risk behaviors, and television viewing; increased condom use and physical activity; decreased psychological distress and moral disengagement, intentions to use drugs, peer drug use, and peer aggressiveness and victimization; and increased coping and drug use refusal skills, knowledge of substances and HIV disease, self-efficacy, peer support, problem-solving, media literacy, and self-esteem. One study [52] involved a family member in the intervention. That program increased mother-daughter closeness and communication, maternal monitoring of girls’ behavior, and setting of family rules around adolescent substance use.
Computer-Based Program Delivery and Venues
Apparent in Table 1 is the diversity of computer-based programs. Whereas some programs have multiple sessions, others attempted to change youths’ knowledge, attitudes, and behavior with a single session. One study [26] gave youth access to a website and encouraged them to view the modules it hosted. Ten of the programs evaluated in the 26 studies engaged adults to a lesser or greater extent to deliver computer-based programming. Those adults were professionals, including nurses (n = 1) [29], school staff and parents (n = 1) [33], teachers (n = 4) [34, 35, 38, 39], therapists (n = 3) [46, 49, 50, 51], and mothers (n = 1) [52]. A range of formats are extant in the field of computer-based programs to reduce substance use among youth.
The studies in Table 1 demonstrate how various technologies are employed in the service of substance use prevention and intervention for youth. Web-based programs completed on personal computers remain the technology of choice. Among these, the modal means for intervention delivery involves youths interacting with the program sitting at keyboards and following self-instructional prompts. In two studies [46, 49], self-instruction was compared with aided instruction in which therapists guided youths through the programmed material. Whereas Cunningham and her associates [49] found a therapist-assisted arm superior to computer-intervention alone, Walton and her colleagues [46] showed comparable results for the two modalities. The respective investigators of the studies speculate that computer interventions alone may be preferable for universal programs, and that therapist-assisted programs may be preferable for selected and indicated programs in which emotional engagement is integral. In one study in Table 1, smartphones were the preferred technology. Relative to reducing tobacco use, Mason and his colleagues [48] found that motivational interviewing messages sent to youths via smartphones were superior to health-related texts.
Though much research with adolescents occurs in schools, some of the reviewed studies were less conventionally sited. Three studies happened in hospital emergency departments [49–51] or in primary care units [46]. In these busy settings, youths could access computer programs while awaiting other services. Two studies [47, 48] took place in substance use treatment facilities or clinics, also capturing youths’ attention between their receipt of clinical services. The three studies [52–54] that let youths complete their computer-based prevention programs at home engaged national U.S. samples. In these investigations, the portability advantages of computer-based approaches are manifest. Intervening with youths who are geographically dispersed is not feasible with person-delivered programs. Likewise, not restricting program delivery to such a physically defined place as a school or clinic permits flexibility that may lead to the enrollment of participants who otherwise could not join a substance use prevention or intervention program.
Another feature of the studies summarized in Table 1 is the international nature of technological advances in the delivery of prevention and intervention programs for substance use among youth. The studies are nearly evenly divided between programs located in the U.S. and those located elsewhere. Just under one-quarter of the studies were of programs located in the Netherlands. Australia accounts for three studies. Two studies occurred in Sweden, Germany, Belgium, the Czech Republic, and Romania.
Methodological Issues in Computer-Based Programs
Evident in Table 1 are disquietingly high rates of attrition (i.e., > 30%) in nine of the 26 studies [28, 31, 33, 36, 37, 39, 40, 41, 43, 45]. Small wonder that between-arm differences elude investigators when a good portion of the sample is not available for data collection. Indeed, findings summarized in Table 1 suggest that low rates of attrition are associated with outcome differences. Another feature of several studies are their large samples. Computer-based programs clearly offer a means for concurrently reaching and intervening with great numbers of youth. The mean sample size of the total 37,040 youths represented in the 26 studies in Table 1 is 1,425. That studies with large samples appear to have suffered larger rates of attrition is probably not a coincidence.
Variations in overall quality are obvious in the corpus of recent studies of computer-based programs for substance use prevention and intervention among youth. These variations starkly emerge when methodological and substantive screening criteria are applied to the 26 studies in Table 1. Eliminating studies with attrition rates greater than 35%, for example, leaves 21 studies. Of these, eliminating studies that lack a follow-up measurement of 1 year or more leaves eight studies. Of those eight studies, seven reported behavior changes that favored youths who received prevention or intervention programming. One study [49] did not report substance use outcomes. Another study [34] did not focus on substance use outcomes—despite its testing of a substance abuse prevention program. As a consequence, five studies [27, 46, 51, 52, 54] remain that experienced attrition of 35% or less, that reported at least 1-year behavioral outcomes in substance use, and that favored youths who received the tested computer-based intervention. If the 26 studies considered for this review typify current work, research on computer-based approaches to substance use prevention and intervention among youth will advance slowly.
Conclusions
As unearthed in studies published over the last 5 years, computer-based prevention and intervention programs for substance use among youth are in their nascence. The rather leisurely pace of research advancements on computer programs for substance use problems is puzzling in light of considerable prior work on technological approaches as seen in the reviews and meta-analyses of computer programs summarized earlier. With exceptions, programs tested in recent years are underwhelming in their effects. In some instances, even modest program results on mediator and prodromal variables do not stand the test of time.
Notwithstanding their modest impact to date, recently tested computer-based approaches to substance use prevention and intervention among youth are disclosing their potential. Innovative programs are reaching youths in places that have historically not witnessed manualized substance use prevention and intervention efforts. These include hospital emergency departments, pediatric medical clinics, and youths’ homes. Computer programs are engaging national samples in cost-efficient ways. Arguably, delivering interventions to national samples in any other manner than through the internet would encounter fatal logistical, cost, and quality-control barriers. Intervention fidelity is a distinct advantage of computer programs. Training protocols and implementation monitoring are similarly eased when programs are delivered by computer. When examining the recent empirical record, the promise of computer programs for substance use prevention and intervention among youth is clear, despite the absence of consistently positive outcomes.
The present review shows gaps in the development of computer-based substance use prevention and intervention programs for youth. Most recent studies evaluated programs already tested with and developed for other populations, including college students. The absence of a guiding theoretical rationale for many computer-based substance use interventions is a weakness [55]. Though some programs have appropriately engaged special populations, greater inclusion is needed. New efforts are warranted to reach children and adolescents traditionally overlooked by computer and non-computer programs alike. These include youth outside the majority culture, whether by dint of their ethnicity or race, sexual orientation, physical abilities, or other minority group status. A characteristic of online programs is their ability to reach heretofore neglected or hidden populations who, despite their relatively small numbers, are no less deserving of expressly tailored substance use prevention and intervention programs.
Most computer-based programs summarized in this paper were brief, possibly to the detriment of their ability to affect refractory substance use behavior. Worse yet, few programs exploit the power of technology to engage adolescents in ways that youths are engaged with commercial products and educational content. Notable by their near absence are approaches that reach youths through gamification, smartphone apps, social media, and programs customized to youths’ individual demography, risk factors, and vulnerabilities. Moreover, the preponderance of school-based studies in recent years suggests that computers are regarded as substitutes for teachers and health educators rather than as powerful, interactive platforms. Mobile computing in particular can expand the horizons of intervention delivery to reach youths anywhere they and their smartphones find themselves. Similarly, more programs that involve youths’ parents, teachers, and other sources of guidance and social support are needed. The ease of messaging and otherwise sharing prevention and intervention content on youths’ social networks would seem to invite the development of responsive programs. Simply put, the technological potential of computer-based approaches has yet to be mined.
Improvements are also warranted in the way computer-based programs for substance use prevention and intervention among youth are tested. Lacking reasonable rates of retention, investigations of computer-based programs cannot find substance use outcomes even when programs are successful. Retaining youth in clinical trials requires significant investments of human capital. The ease with which computer-based programs are delivered may result in overextended investigations that lack sufficient resources to track youths. Profitably, the large samples and small retention rates seen in a number of recent studies could be replaced by small samples and large retention rates. Indeed, roughly one-quarter (5 in 26) of recent studies that constrained attrition showed substance use behavior differences.
As computer-based approaches become more common, studies of them will expectedly become more sophisticated. Illustrative are the comparisons of efficiencies between computers and professionals as done by Cunningham et al. [49], Walton et al. [46, 50], Marsch et al. [47], Harris et al. [56], and Doumas et al. [44]. Albeit the gatekeepers of science—funding bodies, grant reviewers, journal editors and referees, as well as the consumers of science must continue to impose high standards of rigor on computer-based research, new and possibly risky initiatives must be launched and supported. These are illustrated by Mason et al.’s [48] successful test of text messaging for smoking prevention and cessation. The steady evolution of mobile computing technology is opening new venues for prevention and intervention programming.
Research on computer-based substance use prevention and intervention programs among youth will doubtless thrive and expand. As uncovered in the present review, some doubt remains about whether those programs will be responsive and efficacious. Ultimately, the only measure of programmatic success in this field is whether youth realize decreased substance use. When computer programs achieve that end, they will be hailed and embraced.
Acknowledgments
This work was supported in part by the National Institute on Drug Abuse, grant award R01DA031782 (to TMS) and grant award R01DA031477 (to SS).
Human and Animal Rights and Informed Consent All studies described in this paper that were performed by the authors were approved by Columbia University’s Morningside Institutional Review Committee.
Footnotes
Compliance with Ethical Standards
Conflict of Interest Steven Schinke and Traci Marie Schwinn declare that they have no conflicts of interest.
References
Papers of particular interest are highlighted as:
*Of importance
**Of major importance
- 1**.Marsch LA, Borodovsky JT. Technology-based interventions for preventing and treating substance use among youth. Child Adolesc Psychiatr Clin N Am. 2016;25:755–68. doi: 10.1016/j.chc.2016.06.005. Providing an excellent review of technology-based substance use prevention and treatment interventions for youth, this paper considers programs that have been tested in a variety of settings and focused on commonly differentiated stages of substance use risk. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Fisoun V, Floros G, Siomos K, Geroukalis D, Navridis K. Internet addiction as an important predictor in early detection of adolescent drug use experience-implications for research and practice. J Addict Med. 2012;6:77–84. doi: 10.1097/ADM.0b013e318233d637. [DOI] [PubMed] [Google Scholar]
- 3.Golpe S, Gómez P, Braña T, Varela J, Rial A. The relationship between consumption of alcohol and other drugs and problematic internet use among adolescents. Adicciones. 2017 doi: 10.20882/adicciones.959. [DOI] [PubMed] [Google Scholar]
- 4.Gupta H, Pettigrew S, Lam T, Tait RJ. A systematic review of the impact of exposure to internet-based alcohol-related content on young peoples alcohol use behaviours. Alcohol Alcohol. 2016;51:763–71. doi: 10.1093/alcalc/agw050. [DOI] [PubMed] [Google Scholar]
- 5.Morioka H, Itani O, Osaki Y, Higuchi S, Jike M, Kaneita Y, Kanda H, Nakagome S, Ohida The association between alcohol use and problematic internet use: A large-scale nationwide cross-sectional study of adolescents in Japan. J Epidemiol. 2017;27:107–11. doi: 10.1016/j.je.2016.10.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Sung J, Lee J, Noh H-M, Park YS, Ahn EJ. Associations between the risk of internet addiction and problem behaviors among Korean adolescents. Korean J Fam Med. 2013;34:115–22. doi: 10.4082/kjfm.2013.34.2.115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Perrino T, Estrada Y, Huang S, St George S, Pantin H, Cano MA, Lee TK, Prado G. Predictors of participation in an eHealth, family-based preventive intervention for Hispanic youth. Prev Sci. 2016;17:1–12. doi: 10.1007/s11121-016-0711-y. [DOI] [PubMed] [Google Scholar]
- 8.Estrada Y, Molleda L, Murray A, Drumhiller K, Tapia M, et al. eHealth Familias Unidas: Pilot study of an internet adaptation of an evidence-based family intervention to reduce drug use and sexual risk behaviors among Hispanic adolescents. Int J Environ Res Public Health. 2017;14:264. doi: 10.3390/ijerph14030264. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Doumas DM. Web-based personalized feedback: Is this an appropriate approach for reducing drinking among high school students? J Subst Abuse Treat. 2015;50:76–80. doi: 10.1016/j.jsat.2014.09.005. [DOI] [PubMed] [Google Scholar]
- 10.Champion KE, Newton NC, Barrett EL, Teesson M. A systematic review of school-based alcohol and other drug prevention programs facilitated by computers or the internet. Drug Alcohol Rev. 2013;32:115–23. doi: 10.1111/j.1465-3362.2012.00517.x. [DOI] [PubMed] [Google Scholar]
- 11.Tait RJ, Spijkerman R, Riper H. Internet and computer based interventions for cannabis use: A meta-analysis. Drug Alcohol Depend. 2013;133:295–304. doi: 10.1016/j.drugalcdep.2013.05.012. [DOI] [PubMed] [Google Scholar]
- 12.Rodriguez DM, Teesson M, Newton NC. A systematic review of computerised serious educational games about alcohol and other drugs for adolescents. Drug Alcohol Rev. 2013;33:129–35. doi: 10.1111/dar.12102. [DOI] [PubMed] [Google Scholar]
- 13.Wood SK, Eckley L, Hughes K, Hardcastle KA, Bellis MA, Schrooten J, Demetrovics Z, Voorham L. Computer-based programmes for the prevention and management of illicit recreational drug use: A systematic review. Addict Behav. 2014;39:30–8. doi: 10.1016/j.addbeh.2013.09.010. [DOI] [PubMed] [Google Scholar]
- 14*.Geckle J. Use of multimedia or mobile devices by adolescents for health promotion and disease prevention: A literature review. Pediatr Nurs. 2016;42:163–7. Covering the years 2009 through 2014, this paper carefully reviews multi-media, mobile technology, texting, and social networking approaches to health promotion and disease prevention among adolescents. [PubMed] [Google Scholar]
- 15*.Hoch E, Preuss UW, Ferri M, Simon R. Digital interventions for problematic cannabis users in non-clinical settings: Findings from a systematic review and meta-analysis. Eur Addict Res. 2016;22:233–42. doi: 10.1159/000445716. This well executed meta-analysis of randomized clinical trials examines the effects of internet- and computer-based interventions of cannabis treatment programs implemented outside of the health care system. [DOI] [PubMed] [Google Scholar]
- 16.Krebs P, Prochaska JO, Rossi JS. A meta-analysis of computer-tailored interventions for health behavior change. Prev Med. 2010;51:214–21. doi: 10.1016/j.ypmed.2010.06.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Lustria MLA, Noar SM, Cortese J, Van Stee SK, Glueckauf RL, Lee J. A meta-analysis of web-delivered tailored health behavior change interventions. J Health Commun. 2013;18:1039–69. doi: 10.1080/10810730.2013.768727. [DOI] [PubMed] [Google Scholar]
- 18.Rooke S, Thorsteinsson E, Karpin A, Copeland J, Allsop D. Computer-delivered interventions for alcohol and tobacco use: A meta-analysis. Addiction. 2010;105:1381–90. doi: 10.1111/j.1360-0443.2010.02975.x. [DOI] [PubMed] [Google Scholar]
- 19*.MacDonell KW, Prinz R. A review of technology-based youth and family-focused interventions. Clin Child Fam Psychol Rev. 2017;20:185–200. doi: 10.1007/s10567-016-0218-x. This thorough review covers a range of technology-oriented interventions for behavioral and mental health problems among children and adolescents, with particular attention to youth- and family focused programs. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Moore BA, Fazzino T, Garnet B, Cutter CJ, Barry DT. Computer-based interventions for drug use disorders: A systematic review. J Subst Abuse Treat. 2011;40:215–23. doi: 10.1016/j.jsat.2010.11.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Park E, Drake E. Systematic review: Internet-based program for youth smoking prevention and cessation. J Nurs Scholarsh. 2014;47:43–50. doi: 10.1111/jnu.12104. [DOI] [PubMed] [Google Scholar]
- 22.Portnoy DB, Scott-Sheldon LA, Johnson BT, Carey MP. Computer-delivered interventions for health promotion and behavioral risk reduction: A meta-analysis of 75 randomized controlled trials, 1988–2007. Prev Med. 2008;47:3–16. doi: 10.1016/j.ypmed.2008.02.014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. JMIR. 2010;12:e4. doi: 10.2196/jmir.1376. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Mason M, Ola B, Zaharakis N, Zhang J. Text messaging interventions for adolescent and young adult substance use: A meta-analysis. Prev Sci. 2014;16:181–8. doi: 10.1007/s11121-014-0498-7. [DOI] [PubMed] [Google Scholar]
- 25*.Badawy SM, Kuhns LM. Texting and mobile phone app interventions for improving adherence to preventive behavior in adolescents: A systematic review. JMIR Mhealth Uhealth. 2017;5:e50. doi: 10.2196/mhealth.6837. Reviewing recent studies of text messaging and mobile phone apps, the authors critique the programs on their theoretical frameworks, acceptability and satisfaction, outcomes, and overall quality. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Bowen DJ, Henderson PN, Harvill J, Buchwald D. Short-term effects of a smoking prevention website in American Indian youth. JMIR. 2012;14:185–92. doi: 10.2196/jmir.1682. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27**.Velicer WF, Redding CA, Paiva AL, Mauriello LM, Blissmer B, Oatley K, Meier KS, Babbain SF, McGee H, Prochaska JO, Burditt C, Fernandez AC. Multiple behavior interventions to prevent substance abuse and increase energy balance behaviors in middle school students. Transl Behav Med. 2013;3:82–93. doi: 10.1007/s13142-013-0197-0. This study involved a very large sample and a notably long follow-up to isolate the effects of two computer-based interventions for middle-school students. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Andrews JA, Gordon JS, Hampson SH, Gunn B, Christiansen SM, Slovic P. Long-term efficacy of Click City® tobacco: A school-based tobacco prevention program. Nicotine Tob Res. 2014;16:33–41. doi: 10.1093/ntr/ntt106. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Bannink R, Broeren S, Joosten-van Zwanenburg E, van As E, van de Looij-Jansen P, Raat H. Effectiveness of a web-based tailored intervention (E-health4Uth) and consultation to promote adolescents’ health: Randomized controlled trial. JMIR. 2014;16:e143. doi: 10.2196/jmir.3163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Doumas DM, Esp S, Turrisi R, Hausheer R, Cuffee C. A test of the efficacy of a brief, web-based personalized feedback intervention to reduce drinking among 9th grade students. Addict Behav. 2014;39:231–8. doi: 10.1016/j.addbeh.2013.10.011. [DOI] [PubMed] [Google Scholar]
- 31.Doumas DM, Hausheer R, Esp S, Cuffee C. Reducing alcohol use among 9th grade students: 6 month outcomes of a brief, web-based intervention. J Subst Abuse Treat. 2014;47:102–5. doi: 10.1016/j.jsat.2014.02.006. [DOI] [PubMed] [Google Scholar]
- 32.de Josselin de Jong S, Candel M, Segaar D, Cremers HP, de Vries H. Efficacy of a web-based computer-tailored smoking prevention intervention for Dutch adolescents: randomized controlled trial. JMIR. 2014;16:e82. doi: 10.2196/jmir.2469. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Malmberg M, Kleinjan M, Overbeek G, Vermulst A, Monshouwer K, Lammers J, Vollebergh WA, Engels RC. Effectiveness of the ‘Healthy School and Drugs’ prevention programme on adolescents’ substance use: A randomized clustered trial. Addiction. 2014;109:1031–40. doi: 10.1111/add.12526. Epub 2014 Mar 25. [DOI] [PubMed] [Google Scholar]
- 34.Newton NC, Andrews G, Champion KE, Teesson M. Universal Internet-based prevention for alcohol and cannabis use reduces truancy, psychological distress and moral disengagement: A cluster randomised controlled trial. Prev Med. 2014;65:109–15. doi: 10.1016/j.ypmed.2014.05.003. [DOI] [PubMed] [Google Scholar]
- 35.Vogl L, Newton N, Champion K, Teesson M. A universal harm-minimisation approach to preventing psychostimulant and cannabis use in adolescents: A cluster randomised controlled trial. Subst Abuse Treat Prev Policy. 2014;9:24. doi: 10.1186/1747-597X-9-24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Cremers H-P, Mercken L, Candel M, de Vries H, Oenema A. A web-based, computer-tailored smoking prevention program to prevent children from starting to smoke after transferring to secondary school: Randomized controlled trial. JMIR. 2015;17:e59. doi: 10.2196/jmir.3794. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Arnaud N, Baldus C, Elgán TH, De Paepe N, Tønnesen H, Csémy L, Thomasius R. Effectiveness of a web-based screening and fully automated brief motivational intervention for adolescent substance use: A randomized controlled trial. JMIR. 2016;18:e103. doi: 10.2196/jmir.4643. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Champion KE, Newton NC, Stapinski L, Slade T, Barrett EL, Teesson M. A cross-validation trial of an internet-based prevention program for alcohol and cannabis: Preliminary results from a cluster randomised controlled trial. Aust N Z J Psychiatry. 2015;50:64–73. doi: 10.1177/0004867415577435. [DOI] [PubMed] [Google Scholar]
- 39.Champion KE, Newton NC, Stapinski LA, Teesson M. Effectiveness of a universal internet-based prevention program for ecstasy and new psychoactive substances: A cluster randomized controlled trial. Addiction. 2016;111:1396–405. doi: 10.1111/add.13345. [DOI] [PubMed] [Google Scholar]
- 40.Jander A, Crutzen R, Mercken L, Candel M, de Vries H. Effects of a web-based computer-tailored game to reduce binge drinking among Dutch adolescents: A cluster randomized controlled trial. JMIR. 2016;18:e29. doi: 10.2196/jmir.4708. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Drost RMWA, Paulus ATG, Jander AF, Mercken L, de Vries H, Ruwaard D, Evers SM. A web-based computer-tailored alcohol prevention program for adolescents: Cost-effectiveness and intersectoral costs and benefits. JMIR. 2016;18:e93. doi: 10.2196/jmir.5223. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Kiewik M, VanDerNagel JE, Kemna LE, Engels RC, DeJong CA. Substance use prevention program for adolescents with intellectual disabilities on special education schools: A cluster randomised control trial. J Intellect Disabil Res. 2016;60:191–200. doi: 10.1111/jir.12235. Epub 2015 Dec 2. [DOI] [PubMed] [Google Scholar]
- 43.Nădășan V, Foley KL, Pénzes M, Paulik E, Mihăicuță Ș, Ábrám Z, Bálint J, Csibi M, Urbán R. The short-term effects of ASPIRA: A web-based, multimedia smoking prevention program for adolescents in Romania: a cluster randomized trial. Nicotine Tob Res. 2016;19:908–15. doi: 10.1093/ntr/ntw308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Doumas DM, Esp S, Johnson J, Trull R, Shearer K. The eCHECKUP TO GO for high school: Impact on risk factors and protective behavioral strategies for alcohol use. Addict Behav. 2017;64:93–100. doi: 10.1016/j.addbeh.2016.08.030. [DOI] [PubMed] [Google Scholar]
- 45.Voogt CV, Kleinjan M, Poelen EAP, Lemmers LACJ, Engels RCME. The effectiveness of a web-based brief alcohol intervention in reducing heavy drinking among adolescents aged 15–20 years with a low educational background: A two-arm parallel group cluster randomized controlled trial. BMC Public Health. 2013;13:694. doi: 10.1186/1471-2458-13-694. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Walton MA, Resko S, Barry KL, Chermack ST, Zucker RA, Zimmerman MA, Booth BM, Blow FC. A randomized controlled trial testing the efficacy of a brief cannabis universal prevention program among adolescents in primary care. Addiction. 2014;109:786–97. doi: 10.1111/add.12469. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Marsch LA, Guarino H, Grabinski MJ, Syckes C, Dillingham ET, Xie H, Crosier BS. Comparative effectiveness of web-based vs. educator-delivered HIV prevention for adolescent substance users: a randomized, controlled trial. J Subst Abuse Treat. 2015;59:30–7. doi: 10.1016/j.jsat.2015.07.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Mason MJ, Campbell L, Way T, Keyser-Marcus L, Benotsch E, Mennis J, Zhang J, King L, May J, Stembridge DR. Development and outcomes of a text messaging tobacco cessation intervention with urban adolescents. Subst Abus. 2015;36:500–6. doi: 10.1080/08897077.2014.987946. [DOI] [PubMed] [Google Scholar]
- 49.Cunningham RM, Chermack ST, Zimmerman MA, Shope JT, Bingham CR, Blow FC, Walton MA. Brief motivational interviewing intervention for peer violence and alcohol use in teens: One-year follow-up. Pediatrics. 2012;129:1083–90. doi: 10.1542/peds.2011-3419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Walton MA, Chermack ST, Blow FC, Ehrlich PF, Barry KL, Booth BM, Cunningham RM. Components of brief alcohol interventions for youth in the emergency department. Subst Abus. 2015;36:339–49. doi: 10.1080/08897077.2014.958607. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Cunningham RM, Chermack ST, Ehrlich PF, Carter PM, Booth BM, Blow FC, Barry KL, Walton MA. Alcohol interventions among underage drinkers in the ED: A randomized controlled trial. Pediatrics. 2015;136:783–93. doi: 10.1542/peds.2015-1260. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Fang L, Schinke SP. Two-year outcomes of a randomized, family-based substance use prevention trial for Asian American adolescent girls. Psychol Addict Behav. 2013;27:788–98. doi: 10.1037/a0030925. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Schwinn TM, Schinke SP, Hopkins JE, Keller B, Liu X. An online drug abuse prevention program for adolescent girls: Posttest and 1-year outcomes. J Youth Adolesc. 2017 doi: 10.1007/s10964-017-0714-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Schwinn TM, Thom B, Schinke SP, Hopkins J. Preventing drug use among sexual-minority youths: Findings from a tailored, web-based intervention. J Adolesc Health. 2015;56:571–3. doi: 10.1016/j.jadohealth.2014.12.015. [DOI] [PubMed] [Google Scholar]
- 55*.Tebb KP, Erenrich RK, Jasik CB, Berna MS, Lester JC, Ozer EM. Use of theory in computer-based interventions to reduce alcohol use among adolescents and young adults: a systematic review. BMC Public Health. 2016;16 doi: 10.1186/s12889-016-3183-x. Examining published work on computer-based interventions through 2014, the authors critique studies on the neglect of theory to inform programs aimed at reducing alcohol use among adolescents and young adults. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Harris SK, Knight JJR, Hook SV, Sherritt L, Brooks TL, Kulig JW, Nordt CA, Saitz R. Adolescent substance use screening in primary care: Validity of computer self-administered versus clinician-administered screening. Subst Abus. 2015;37:197–203. doi: 10.1080/08897077.2015.1014615. [DOI] [PMC free article] [PubMed] [Google Scholar]