Abstract
Objective:
Risky substance use among college students is widespread, and associated with numerous adverse consequences. Current interventions focus primarily on students’ current substance use; we hypothesize that shifting focus from current use to underlying risk factors is a complementary approach that may improve effectiveness of prevention/intervention programming. This approach aligns with the personalized medicine movement, which aims to harness knowledge about underlying etiological factors to provide individuals with specific information about their unique risk profiles and personalized recommendations, to motivate and enable individuals to better self-regulate their health.
Method:
Our group is building and evaluating an on-line Personalized Feedback Program (PFP) for college students that provides feedback about the individual’s underlying genetically-influenced externalizing and internalizing risk factors for substance use, along with personalized recommendations/resources. The project capitalizes on work from a university-wide research project (Spit for Science; S4S), in which >12,000 students (~70% of five years of incoming freshmen) are being followed longitudinally to assess substance use and related factors across the college years. In this paper, we describe our foundational work to develop the PFP.
Results:
From the S4S data we have identified risk factors across four domains (Sensation-Seeking, Impulsivity, Extraversion, and Neuroticism) that are correlated with college students’ substance use. We developed an on-line self-guided PFP, in collaboration with professionals from student affairs, and using feedback from students, with the ultimate goal of conducting a randomized clinical trial.
Conclusion:
The provision of personalized risk information represents a novel approach to complement and extend existing college substance use programming.
Keywords: personality, externalizing, internalizing, genetics, precision medicine
Risky substance use among college students is widespread. Data from the 2018 Monitoring the Future report indicate that 28% of college students report binge drinking, and marijuana use among college students has reached a historic high (Schulenberg et al., 2019). One of the most intensive longitudinal studies conducted with college students found that nearly half (47%) of all students meet criteria for an alcohol or marijuana use disorder at least once in the first three years of college (Caldeira et al., 2009). College students use alcohol at higher rates than their non-college-attending peers (Schulenberg et al., 2019). Importantly, problematic substance use is associated with serious consequences, including unwanted sexual encounters, legal consequences, assault, injury, and suicide (Arria et al., 2013; Hingson, Zha, & Weitzman, 2009).
College represents a unique opportunity for interventions to have positive life-course altering health benefits for a significant, rapidly growing (Dick et al., 2018), and increasingly diverse portion of the population (Dick, 2018; Dick & Hancock, 2015). Post-secondary enrollment is expected to grow to >24 million individuals by 2024, and college is now considered a “pervasive” American experience (Dick, 2018). College students are entering a critical developmental period for the establishment of health behaviors that persist into adulthood (Dick et al., 2018; Dick & Hancock, 2015), and college represents one of the few times in an individual’s life where all primary activities – social, career, health, and safety – are concentrated and controlled within a single setting. Accordingly, effective programs to address substance use in college have the potential for long-lasting positive impact.
The current “gold standard” for reducing risky substance use among college students is the use of brief motivational interventions (BMIs) (Larimer & Cronce, 2002; Lee, Neighbors, Kilmer, & Larimer, 2010). BMIs are widely used on college campuses, with one national study finding that 62% of schools report utilizing empirically supported alcohol prevention BMI programming (Nelson, Toomey, Lenk, Erickson, & Winters, 2010). BMIs have been adopted for both universal prevention programming intended for all college students, and targeted programming for mandated students (Barnett et al., 2004; Borsari & Carey, 2005; Hustad, Barnett, Borsari, & Jackson, 2010; A. M. White, Kraus, & Swartzwelder, 2006). They aim to reduce harmful drinking practices by providing students with information about how their drinking compares to others, recognizing possible consequences associated with excessive alcohol use, and encouraging students to undertake new strategies to monitor their drinking, set limits, and reduce risk. Delivered in-person and through web-based platforms, these interventions consistently yield significant, albeit small, effects for alcohol use outcomes (for reviews, see Carey, Scott-Sheldon, Carey, & DeMartini, 2007; Carey, Scott-Sheldon, Elliott, Garey, & Carey, 2012; Cronce & Larimer, 2011).
Despite their widespread use and current status as the most effective available resource, small effect sizes have led researchers to highlight the “need for the development of more effective intervention strategies” (Huh et al., 2015). A review of interventions for college student drinking noted that “significant enhancement of personalized feedback intervention efficacy has not been observed in over 15 years of study” (Miller, Meier, Lombardi, & Leffingwell, 2015). Newer directions of study include the application of behavioral economic theory to addressing college substance use (Murphy et al., 2019, 2012, 2015), as well as the use of pharmacotherapy (DeMartini et al., 2016; O’Malley et al., 2015), both of which have been demonstrated to enhance reductions in substance use associated with BMIs. However, these strategies have yet to be widely adopted on college campuses. Clearly, additional tools to address risky substance use among college students are needed.
Another limitation is that prevention and intervention programs for college students have historically focused exclusively on alcohol. As noted above, there have been significant changes in substance use patterns among college students, with illicit drug use rising in popularity (Schulenberg et al., 2019). Data from the Monitoring the Future study indicate that 52% of college students report lifetime use of marijuana, 42% report past year use, and 25% report past-month use (Schulenberg et al., 2019). Further, data indicate that most risky alcohol use among college students now occurs in the context of other drug use, most commonly marijuana (Cho et al., 2015). Although BMIs have been expanded to include items focused on marijuana use, there have been limited effects for marijuana use (Elliott, Carey, & Vanable, 2014; Lee et al., 2010; H. R. White et al., 2015).
What is striking about the literature on substance prevention/intervention is that it focuses almost entirely on current substance use behavior, and, for the most part, does not make use of the large body of etiological research on developmental pathways of risk for alcohol and other drug problems. Some BMIs include a brief section about family history of alcohol problems, which reflects both genetic and environmental risk; however, this is generally the only mention of the importance of underlying risk factors. We believe this represents an untapped opportunity.
We propose a new, complementary approach for expanding substance use programming options for emerging adults: the development of personalized feedback based on known underlying genetically-influenced risk factors. This approach capitalizes on the element of current prevention programming that appears to be most critical to effectiveness: the delivery of personalized feedback to stimulate change (Cronce, Bittinger, Liu, & Kilmer, 2014). However, rather than focusing feedback on current patterns of alcohol use, we propose providing personalized feedback on underlying risk factors known to contribute to patterns of substance use, along with personalized recommendations and resource information tailored to the individual’s risk profile(s). In this way, we utilize findings from the basic epidemiological literature about the key pathways of risk for substance use problems to create a personalized risk assessment for each student. Our intervention shifts the focus from the provision of information about relative levels of substance use (what is currently provided), and provides information about risk across major risk pathways that contribute to patterns of substance use.
The development of alcohol problems is often discussed in the context of two broad pathways of genetically-influenced risk: externalizing characteristics and internalizing characteristics; accordingly, these are the focus areas targeted by our Personalized Feedback Program (PFP). The externalizing pathway is characterized by a predisposition to behavioral undercontrol, poor response inhibition (Dick et al., 2010), and increased sensitivity to reward (Gatzke-Kopp et al., 2009; Robert F Krueger, Markon, Patrick, Benning, & Kramer, 2007; Zucker, Heitzeg, & Nigg, 2011; Zuckerman & Kuhlman, 2000). An extensive literature documents the role of externalizing characteristics in the development of substance use problems (Farmer et al., 2016; Meque, Dachew, Maravilla, Salom, & Alati, 2019; Steele, Forehand, Armistead, & Brody, 1995; Zucker et al., 2011). A number of personality traits that capture the various facets of externalizing have been associated with increased likelihood of harmful substance use, including extraversion/sociability, impulsivity, and sensation-seeking (Kendler et al., 2003).
The second widely established pathway of risk is through problems with emotion regulation as associated with internalizing symptomatology (Hussong, Jones, Stein, Baucom, & Boeding, 2011). Although the evidence for internalizing risk factors is not as robust as that for externalizing, multiple studies indicate that internalizing symptoms in childhood and adolescence predict subsequent substance use (Hussong et al., 2011; Kushner et al., 2012; Steele et al., 1995). Further, there is a consistent subset of drinkers who report drinking to reduce negative affect (Carpenter & Hasin, 1999; R. Tarter, Kirisci, Hegedus, Mezzich, & Vanyukov, 1994). These individuals have higher levels of depression, anxiety, and neuroticism (LaBrie, Kenney, Napper, & Miller, 2014).
These pathways also map onto decades of research on patterns of heterogeneity among individuals with alcohol use disorder, with studies consistently finding a dichotomous etiology, with Type A (Babor et al., 1992) / Type I (Cloninger, Sigvardsson, & Bohman, 1996), characterized by negative-affect-related drinking and elevated rates of depression/anxiety, and Type B (Babor et al., 1992) / Type II (Cloninger et al., 1996), characterized by impulsive and antisocial behaviors. These distinct etiological pathways have been shown to be invariant across cultures, gender, and age (Carragher et al., 2016). These literatures all indicate that individuals who misuse alcohol are a heterogeneous group.
Another advantage of focusing on underlying externalizing and internalizing risk factors, rather than current substance use per se, is that twin studies robustly demonstrate that different forms of substance use have a common genetic etiology, with the majority of the underlying risk for alcohol and other illicit drugs being shared (Kendler, Prescott, Myers, & Neale, 2003; Krueger et al., 2009), which likely contributes to their frequent co-occurrence (Williams, Liccardo Pacula, Chaloupka, & Wechsler, 2004). Because the underlying risk pathways appear to be shared across drugs of abuse, by shifting the focus to these underlying etiological factors, it is possible that a personalized risk assessment will be effective at reducing other drug use in addition to alcohol without the need to individually target multiple substances.
The provision of personalized feedback is in line with the current movement toward personalized medicine, moving beyond a “one-size fits all” approach to preventing and treating deleterious health outcomes (Chouchane, Mamtani, Dallol, & Sheikh, 2011). This movement has gained momentum in recent years with the 2015 White House launch of the Precision Medicine Initiative (Collins & Varmus, 2015). Although much attention surrounding precision medicine focuses on the incorporation of genomics into personalized medicine, it is also possible to use information about the known intermediary phenotypes by which genetic risk unfolds across development to provide personalized risk information, even absent specific genotypic information (Dick et al., 2018; Dick & Hancock, 2015).
Multiple papers have addressed the promise of personalized medicine as applied to alcohol use disorder (AUD) (Krystal & O’Malley, 2015; Litten et al., 2015; Sher, 2015). The heterogeneous nature of AUD (Babor et al., 1992; Cloninger, Bohman, & Sigvardsson, 1981) suggests that focusing on etiological mechanisms, rather than diagnoses, may provide novel, more effective targets for prevention and intervention. The Addictions Neuroclinical Assessment (ANA) framework (Kwako, Momenan, Litten, Koob, & Goldman, 2016) is one such effort to address the heterogeneity inherent in substance use problems and focus on core etiological processes. The domains indicated by the ANA, incentive salience, negative emotionality, and executive function, map onto personality and clinical features related to externalizing and internalizing characteristics (Kwako et al., 2019). The Research Domain Criteria (RdoC) program at the National Institute of Mental Health represents another effort aimed at focusing on underlying mechanisms of risk (Cuthbert, 2014; Cuthbert & Insel, 2013).
Although the field of personalized medicine as applied to complex behavioral outcomes is in its infancy, a literature is emerging that focuses on prevention programming tailored to individual risk profiles. Initial studies suggest that this personalized approach is likely to enhance the effectiveness of substance use intervention. Conrod et al. developed a school-based alcohol prevention program geared toward adolescents in their early to mid-teenage years that targets externalizing (impulsivity, sensation-seeking), and internalizing (anxiety sensitivity, hopelessness/depression) personality characteristics (Conrod et al., 2013; O’Leary-Barrett et al., 2013). In a cluster randomized controlled trial of >2600 students from secondary schools (9th grade) in London, United Kingdom, the personality targeted prevention intervention program focused on underlying risk dimensions rather than use, per se, was associated with a 29% reduced odds of drinking, 43% reduced odds of binge drinking, and 29% reduced odds of problem drinking relative to students in control schools (Conrod et al., 2013). Effects were maintained up to 24 months post intervention. The effectiveness of the personality-targeted prevention intervention on alcohol use among adolescents has been demonstrated across multiple studies and cultures at this point (Conrod, Castellanos-Ryan, & Mackie, 2011), though it requires an in-person format, limiting scalability, and has not yet been integrated into approaches to address substance use in college students.
Here we describe the development of a new on-line approach to college student substance use prevention that provides personalized feedback on underlying etiological risk factors and how they can contribute to substance use problems, rather than on current substance use. This approach builds upon basic etiological research on externalizing and internalizing pathways of risk to create an on-line, self-guided personalized feedback program, intended as a universal prevention. This work is on-going; below we review work done to date to build the program, as well as other design considerations that we believe have broad relevance for prevention programming in young adults. Finally, we discuss our work in the context of other on-going efforts to expand existing prevention and intervention programs by incorporating information about basic underlying etiological risk factors. Our goal in writing this paper is to stimulate discussion of creative ways that we can expand substance use prevention and intervention efforts by working across silos that traditionally exist between substance use researchers who work on basic etiological processes and those who work on prevention and intervention.
Methods
The Spit for Science Sample
Our work builds upon a unique, established registry for large-scale transdisciplinary research on substance use problems in college students, the Spit for Science project (Dick et al., 2014) (S4S; spit4science.vcu.edu). S4S is the largest genetically informative study of the factors that contribute to substance use outcomes among college students. S4S is a university-wide research registry with the goal of understanding pathways of risk (both genetic and environmental) for substance use and related mental health outcomes across the college years. For five incoming freshman cohorts (enrolled in 2011–2014 and 2017), all incoming freshmen age 18 or older were invited to participate in an on-line survey at the beginning of the fall semester of their first year, provide a saliva DNA sample, and complete follow-up surveys each spring semester thereafter. A total of 12,365 students were enrolled through this pipeline. We achieved consistent participation rates of 67–68% across all freshman classes, which compares quite favorably to cooperation rates of 22–40% reported in other web-based college surveys (Cook, Heath, & Thompson, 2000; Jans & Roman, 2007; National Survey of Student Engagement, 2011; Sax, Gilmartin, & Bryant, 2003). All data are entered in a registry, available broadly to all investigators with relevant research interests related to substance use and related behavioral health outcomes. Through the registry, participants can be selected for additional spin-off studies. Information on accessing S4S registry data is available on the website (spit4science.vcu.edu), and we encourage all investigators who have interest in working with this rich dataset to contact the corresponding author.
The large, diverse undergraduate population at VCU makes it an ideal environment to pilot the effectiveness of prevention intervention. The ability to successfully implement effective tailored interventions will depend on studying etiological pathways, prevention/intervention, and underlying mechanisms specific to individual groups. VCU has nearly 50% minority students, and 40% first generation college students. Sample demographics for the S4S participants do not differ significantly from the overall university study population: 17% identify as Asian; 17% identify as African American, 6% identify as Hispanic, 51% identify as Caucasian, 6% identify as more than 1 race, and 3% report other/unknown; 60% are female and 40% male. Analyses of the Spit for Science data formed the foundation for the development of our personalized feedback program, and the registry eventually will be used to recruit subjects for a randomized clinical trial to evaluate the effectiveness of personalized feedback programs as compared to standard BMIs.
Substance use in the S4S sample is considerable, and consistent with other national surveys of college students (Cho et al., 2015; Schulenberg et al., 2019; Substance Abuse and Mental Health Services Administration, 2016): 75.3% of incoming freshmen have tried alcohol on at least one occasion (and virtually all of those individuals report drinking on 5+ occasions). This proportion rises steadily across the college years. By spring of participants’ freshman year, 83% of participants report lifetime alcohol use, 87% by sophomore year, 92% by junior year and 94% by senior year. However, quantity and frequency of substance use show significant variability: among freshmen, 29% report drinking monthly or less, but 20% of drinkers report consuming alcohol more than 2x/week, and 5+ drinks/occasion; 53% of drinkers have blacked out; 30.2% of freshmen display no alcohol dependence symptoms, while 20.3% display 1 symptom, and 26%, 13%, and 10.2% meet criteria for mild, moderate, and severe alcohol dependence (AD), respectively. Marijuana use is also considerable and rises steadily with 45% of freshmen reporting lifetime cannabis use, 50% of sophomores, 56% of juniors and 59% of seniors.
Selection of underlying risk dimensions
We focused the initial personalized feedback on four domains. This choice was both practical and theoretical. For the initial development and testing phase, we wanted to get the program launched by building out a manageable number of domains for which we would provide feedback and resources. We also felt that a more limited number of domains would be more digestible and memorable for students. For these reasons, we settled on four initial domains, three of which reflect externalizing risk (Sensation-Seeking, Impulsivity, and Extraversion), and one of which reflects internalizing risk (Neuroticism). The disproportionate focus on externalizing risk factors is based on the literature suggesting that risky substance use in college students is more strongly influenced by externalizing characteristics than internalizing characteristics at this developmental stage (Dick et al., 2014). In the Spit for Science sample, Sensation-Seeking and other facets of impulsivity were measured using the UPPS (Lynam, Smith, Whiteside, & Cyders, 2006). This measure was developed via exploratory factor analyses of the Big Five factor model and additional commonly used measures of impulsivity. The resulting UPPS scale has four primary subscales which were administered in short form in S4S: urgency (alpha=.722, which was subsequently subdivided into positive and negative urgency; Cyders et al., 2007), (lack of) premeditation (alpha=.759), (lack of) perseverance (alpha=.683), and sensation seeking (alpha=.628). Each subscale consists of 3 items with 4 response categories ranging from “Disagree strongly” to “Agree strongly”. We collapsed three of the primary UPPS scales (urgency, lack of premeditation, lack of perseverance) into one Impulsivity domain, based on the decision that dividing impulsivity into many sub-facets would become too complicated and introduce confusion for the students. All of these impulsivity sub-facets (positive and negative urgency, lack of premeditation, lack of perseverance) loaded onto the same ANA factor, along with multiple other measures of impulsivity, with factor loadings >.5 on the impaired executive control ANA domain (Kwako et al., 2019). Conscientiousness was inversely correlated with this domain, and sensation-seeking did not load on the factor; accordingly, there is some theoretical rationale for this choice as well. We also note that we will assess students’ beliefs as to how well each of their assigned profiles “fits” them, so we will be able to empirically evaluate whether collapsing these impulsivity facets leads to reductions in perceived fit as compared to the other domains. We chose to provide feedback on Sensation-Seeking separately, due to the robust literature associating this facet of impulsivity with risky substance use (Earleywine & Finn, 1991; Quinn & Harden, 2013; Zuckerman, 2007). Sensation-seeking is also more strongly related to the incentive salience ANA domain. Extraversion (α = .84) was measured in S4S using the Big Five Inventory (BFI) (John & Srivastava, 1999). We chose to include this domain in our personalized risk feedback because data from S4S and other studies (Acton, 2003; Kendler, Myers, & Dick, 2015; Knyazev, 2004; R. E. Tarter, 1988) indicate that extraversion is associated with substance use in emerging adults. Neuroticism was also measured using the BFI (John & Srivastava, 1999) (α = .81), and reflects a disposition toward internalizing, also referred to as negative emotionality in the ANA.
Item Selection for Personalized Feedback Program (PFP).
Because we recognized that the PFP must be brief to be engaging to students, we conducted factor analyses with the items of each scale described above (UPPS scales, BFI Extraversion and Neuroticism scales), and selected the two item(s) with the highest factor loading for each subscale. For each selected item, we ran descriptive statistics with the corresponding scale scores in the Spit for Science sample, to ensure that the selected single response items adequately captured overall scores. All representative items selected for corresponding subscales had factor loadings >.75. We then computed descriptive statistics for alcohol and cannabis outcomes, including AD symptom counts, grams of ethanol, drinking endorsement rates, and heavy episodic drinking (HED) (4+ or 5+ drinks per sitting for females and males, respectively) to ensure that the reduced items also meaningfully predicted varying degrees of substance/alcohol (mis)use. For example, for the sensation seeking dimension of the UPPS, the item “I quite enjoy taking risks” had the highest factor loading (.94) on the sensation seeking factor. Responses on this item were positively associated with various alcohol and marijuana outcomes (Table 1).
Table 1.
Relationship between a sensation-seeking item selected for the PFP “I quite enjoy taking risks” with alcohol and cannabis outcomes
| I quite enjoy taking risks | % Ever had a drink | Mean alcohol dependence symptom counts (SD) | Mean grams of ETOH (SD) | % Ever used Cannabis | % Used Cannabis 6+ times | Mean cannabis use disorder symptom counts (SD) | % Use cannabis at least 2–3 per week |
|---|---|---|---|---|---|---|---|
| 1. Disagree strongly | 76.80% | 1.03(1.40) | 104(390) | 27.89% | 16.50% | 0.6 (1.53) | 5.15% |
| 2. Disagree a little | 80.30% | 1.16(1.43) | 140(337) | 35.95% | 18.99% | 0.57 (1.53) | 5.90% |
| 3. Agree a little | 84.30% | 1.40(1.52) | 227(467) | 47.15% | 27.56% | 0.93 (2.04) | 9.97% |
| 4. Agree Strongly | 89.50% | 1.83(1.70) | 376(674) | 60.99% | 41.05% | 1.52 (2.6) | 17.64% |
Once the subset of initial items had been selected, we worked with a programmer to create a personalized feedback platform, very similar to that used to provide personalized feedback surrounding alcohol use in current BMIs, except that the questions/feedback focus on the underlying risk domains and how these traits relate to substance use, rather than on current alcohol use patterns.
We recruited students from the psychology undergraduate research pool, comprised of students enrolled in psychology courses for which there are research participation requirements, for semi-structured focus groups to solicit feedback on the initial PFP prototype. Six focus groups were conducted on-line via Zoom, due to restrictions imposed by the COVID-19 pandemic, in groups of 2–4 students. Initial feedback from the 20 students who participated in the focus groups was overall very positive; participants thought that the program was engaging and graphically pleasing, liked that the content felt personalized to them based on the quiz and avatar builder, and expressed optimism at the opportunity to engage with the many resources offered. A majority of participants noted that they wished the quiz included more questions as well as a neutral response option.
Based on this feedback, we expanded the number of items included in the PFP from 10 to 20 by selecting additional items with the highest correlations with total scale scores for each domain. Two additional items were included for each of the extraversion, neuroticism, and sensation seeking scales; and one additional item was included for each of the four impulsivity sub-scales (negative and positive urgency, lack of premeditation, and lack of perseverance). Table 2 shows the final items selected for inclusion in the PFP. We used the response options “strongly disagree”, “disagree”, “neither agree nor disagree”, agree”, and “strongly agree” for all items. These response options are parallel to the BFI which includes the neutral response option (compared to the UPPS scale which excludes this option) in order to maintain continuity across response options for all items, and in response to the feedback from initial focus groups.
Table 2.
Final items selected for inclusion in the PFP
| Dimension | Item |
|---|---|
| Sensation seeking | I quite enjoy taking risks. |
| I would enjoy the sensation of skiing fast down a high mountain slope. | |
| I welcome new and exciting experiences and sensations, even if they are a little frightening and unconventional. | |
| I would like to learn to fly an airplane. | |
|
| |
| Extraversion | I see myself as someone who is outgoing, sociable. |
| I am someone who tends to be quiet. (reverse-coded) | |
| I am someone who is talkative. | |
| I see myself as someone who generates a lot of enthusiasm. | |
|
| |
| Neuroticism | I see myself as someone who is relaxed, handles stress well. (reverse-coded) |
| I worry a lot. | |
| I see myself as someone who is depressed, blue. | |
| I see myself as someone who is emotionally stable, not easily upset. (reverse-coded) | |
|
| |
| Impulsivity | When I am upset I often act without thinking. |
| Sometimes when I feel bad, I can’t seem to stop what I am doing even though it is making me feel worse. | |
| I usually think carefully before doing anything. (reverse-coded) | |
| I like to stop and think things over before I do them. (reverse-coded) | |
| I finish what I start. (reverse-coded) | |
| Once I get going on something I hate to stop. (reverse-coded) | |
| I tend to act without thinking when I am really excited. | |
| I tend to lose control when I am in a great mood. | |
Results
Beta version of the Personalized Feedback Program (PFP)
Together with our colleagues at the university health and wellness center, we created text introducing the PFP, explaining that virtually all health behaviors are influenced by genetic predispositions and environments, and that by knowing about their own predispositions, students can use that information to understand their own risk and make better choices to impact their own health and happiness. Students answer the questions for the 20 selected items tapping into the four domains described above. After answering all items, and before receiving their feedback, students create personalized graphical avatars that then accompany the presentation of their risk profiles (Figure 1). These personalized avatars are an effort to have the material further resonate with the students and feel personalized. Hair styles and skin tones representing multiple racial/ethnic identities were included, and expanded after initial student focus group feedback, to facilitate personalization for diverse students. Students’ profiles can be shared via social media, which generates a link for individuals receiving the material to go through the program themselves and receive their own profile and associated feedback/resources. In this way, we aim for the program to have the potential for “organic spread”, meaning that students will willingly share the program and additional students can be exposed to the material.
Figure 1.
Example personalized graphical avatar accompanied by risk profile across the four domains
To generate the profiles, the PFP sums the students’ responses to the items for each domain and compares the students’ score to a pre-calculated cut-off score determined by the median score based on our administration of the survey previously in the undergraduate sample. Students are then classified in a binary fashion on each domain according to their response profile (Sensation Seeker/Playin’ it Safe; Extravert/Introvert; Spontaneous/Conscientious; Worrier/Cool as a Cucumber). We note that the labels do not directly correspond to the dimensions as labeled in the research literature, for example labeling high impulsivity as “Spontaneous”, and high neuroticism as “Worrier”. These changes were made in consultation with colleagues at our health and wellness center to use nomenclature that would not be stigmatizing to the students in order to conform to the motivational spirit of personalized feedback programs. Individuals who have a score equal to or greater than the median score are assigned the riskier categorization, and individuals who have a score below the median score are assigned to the less risky categorization.
We also provide dimensional feedback in addition to the binary assignments, by presenting a bar for each domain, anchored with the domain labels at each end (see Figure 2). The bar reflects which quartile the student’s score places them into, based on cut-offs from the undergraduate sample. In this way we aim to provide students with a rough indication of how high or low they are on each dimension in addition to their binary assignment.
Figure 2.
Example dimensional presentation of risk profiles for the four domains
The decision to assign binary labels in addition to the dimensional feedback was based on the extensive literature suggesting that individuals resonate with labels. This phenomenon is evident in everyday life from the prevalence of BuzzFeed personality quiz results shared on young adults’ Facebook feeds (Berberick & McAllister, 2016), to the popularity of astrological signs and horoscopes in newspapers and other media (Allum, 2010; Bader, Baker, & Mencken, 2017), to the widespread utilization of the Myers-Briggs Type Indicator (MBTI) in the workplace (Rideout & Richardson, 1989; Varvel, Adams, Pridie, & Ruiz Ulloa, 2004). The ubiquity of such label-producing systems may be a result of their ability to satisfy two basic human motivations: the need to belong to a group and the need to feel like a unique individual (Hornsey & Jetten, 2004). When analyzing the popularity of on-line identity quizzes, Berberick & McAllister (2016) postulated that these quizzes “appear to serve the needs of users through giving them shareable, simple, prepackaged content that allows them to easily represent their self-brand to friends...in a highly accessible, fun, and playful way.” We aimed to mimic the structure of such quizzes with our program by providing students with approachable personality types that empower them to both better understand their unique traits and share their types with friends to see what commonalities may exist.
After receiving their profile, students can access nonjudgmental feedback about each of their temperamental patterns, about how these patterns might put them at elevated risk for alcohol or other substance use/mental health challenges, and about available resources to support them. Information is provided for each of the four domains by clicking on the assigned domain label. Figure 3 provides sample feedback for the Sensation Seeker profile. Students also have the ability to explore the other personality types not assigned to them.
Figure 3.
Personalized feedback for the Sensation Seeker profile
Once students fully examine their unique profile, they are directed to a section that prompts them to explore their goals. Students are given the opportunity to articulate their personal short- and long-term goals, and asked to identify the behaviors, based on their unique personality profiles, that can either help or hinder progress toward those goals. Students are once again given the specific institutional resources which are available and asked to identify which resources they plan to use to help them reach their goals. This approach capitalizes on the evidence-based practice of goal exploration and setting as a facilitator of behavior change (Bailey, 2017; King, 2001), and uses goal and action planning constructs from BMIs which engage students in reinforcing commitment to change (Center for Substance Abuse Treatment, 1999). Students’ results are collated in “Your Personalized Strategy for Success”, a section that summarizes their personalized profile, goals, and university resources, that can be downloaded/emailed to themselves. The PFP takes approximately 15–20 minutes for students to complete (with total time obviously dependent on how much time they spend writing out goals and reviewing their results).
Finally, there is a “Choose Your Own Adventure” section that is designed to help students weigh the outcomes of their decisions and how their choices align with their internal values and stated goals. Fashioned to incorporate these basic principles of Motivational Interviewing (Miller & Rollnick, 2013), this section encourages students to reflect on how their day-to-day actions are connected to their long-term goals, and what discrepancies might arise between the two. Students are presented with various scenarios (e.g., a friend shows up at your door and wants you to go to a party; you are studying for an exam) and response choices (e.g., go to the party, stay home and study, go to the party for just a little bit). Each response leads to a different outcome, either moving them towards or away from their stated goals. These outcomes prompt students to reflect on the pros/cons of each decision and whether other choices would have been more in line with their goals. Graphics are personalized to the student’s avatar, and a path visually reinforces how different choices move them closer or further from their prepopulated personalized goals. This section is intended to empower students to connect their patterns of behavior or decision making with goal attainment, in the context of their natural personality styles.
We are currently in the process of launching the next phase of evaluating the PFP, an open trial which will involve administering the PFP to a large group of undergraduate students, with an accompanying survey to assess initial responses to the PFP, including future intentions regarding alcohol and drug use and campus resource use, as well as satisfaction with the PFP. A subset of the students will complete a 30 day follow-up to assess changes in substance use, mental health, and campus utilization, followed by a second round of focus groups. As is standard practice by our team, all planned analyses will be pre-registered in the Open Science Framework (OSF). Following the open trial, we plan to make a second round of revisions to the PFP, and launch a randomized clinical trial (RCT). The RCT will evaluate the effectiveness of the PFP as compared to a waitlist control and a computer-delivered intervention based on BMI content/principles. Additionally, we plan to test a combined condition in which students will receive the Personalized Feedback Program, in conjunction with the computer-delivered intervention. This trial will be registered through ClinicalTrials.gov and on OSF.
Discussion
In this paper, we describe the development of a new approach to substance use prevention among college students that shifts focus away from current substance use, attending instead to etiological predisposing risk factors. We view this approach as complementary to existing BMI strategies, which provide more detailed information about current substance use and associated risks and harm reduction strategies. In fact, we hypothesize that receiving information that one is at elevated risk (through the PFP) may enhance students’ interest in, and application of, the substance use material routinely included in BMIs. Further, by focusing on underlying risk factors, many of which impact multiple forms of substance use, we hypothesize that personalized risk assessments provide an approach for addressing alcohol and other drug use, which is increasingly common, particularly among young adults. An additional benefit of focusing on underlying risk factors is that risk information can be provided for students who have not yet initiated drinking, or for those who are early in their drinking careers.
The on-line nature of the personalized feedback platform will allow for easy adoption, dissemination, and modification. We anticipate that this program will be most useful as a universal or selective prevention program, and/or as an adjunct to in-person, clinician-assisted BMIs for indicated students. We hope that enhanced graphic design and gamification, as well as the personalization of feedback, designed to parallel popular social media “quizzes” will appeal to emerging adults. Although we are initially developing the platform for college students, upon demonstration of efficacy, modifications to make the PFP appropriate and available to other groups (younger students, non-college students) would be straightforward.
Our personalized feedback program aims to address a central challenge in the prevention field: how do you get large numbers of young people to willingly (and dare we add, enthusiastically) engage with prevention materials designed to provide helpful information for improving health outcomes. In our experience, completing alcohol programming is not something that most students willingly want to do. We found that, even when incentivized to complete a voluntary alcohol education module online, only a very small number of students (n<40 out of our incoming class of several thousand) chose to participate. Universities have various ways of addressing student’s reluctance, to include making training mandatory for course registration, or mandatory for students with conduct infractions as a condition of continued enrollment at the university. We propose another, more radical idea: that by making the material more personalized and engaging we may be able to get students to want to participate, and, beyond that, by making use of sharing and social media, students can also actively recruit other students into prevention programming. Human beings have great interest in learning about themselves, as evidenced by the tremendous popularity of mainstream personality tests, such as the Myers-Briggs, and more recently, countless social media quizzes that purport to do everything from tell you what Marvel superhero or dog breed you most closely resemble, to providing wine recommendations specific to your personality! There has been exponential growth in individuals’ participation in on-line direct to consumer genetic testing over the past several years (Janssens, 2019), with many of the most widely accessed “genetic risk scores” available through free on-line websites relating to substance use and mental health outcomes (Folkersen et al., 2019). Accordingly, we believe that there is tremendous potential for expanding prevention programming to incorporate the delivery of personalized risk information that extends beyond current substance use, and indexes other known risk dimensions that predict future problematic substance use.
In addition to assessing whether expanded personalized feedback is an effective means of preventing or reducing risky substance use, as this literature grows it will also be important to assess how personalized feedback programs impact behavior change. Despite the prevalence of brief alcohol interventions, the mechanisms by which these programs lead to behavior change remains largely unknown, with many theoretical frameworks specified, and measurement of intermediary mechanisms in college intervention studies often inconsistent or absent (Miller et al., 2015). The emerging literature on personalized prevention has also thus far largely failed to specify mechanisms of change (Conrod et al., 2011, 2013). We propose that personalized feedback programs may create behavior change via mechanisms described in the Health Belief Model, which posits that an individual’s understanding of their susceptibility to particular health problems influences one’s motivation for preventive behaviors (Rosenstock, 1974). We hypothesize that increased knowledge of one’s underlying risk for substance use problems will enhance motivation to engage in healthier behaviors and increase readiness to change behavior among those already engaging in risky drinking. Readiness to change is believed to be a central target for BMI effectiveness (Miller et al., 2015).
Another primary goal of our intervention is to increase participants’ awareness and use of campus supports and other resources to help them deal with their risks more effectively. To determine if this type of change has taken place, and to address the impact that previous and existing support services may have on outcome, we plan to obtain university records about service utilization, and to assess any community-based services students might have received that would not be in college records.
We have chosen to build out the initial version of our personalized feedback program to focus on a subset of personality dimensions (1) that have been robustly associated with substance use across countless studies with varying population-characteristics (Dennhardt & Murphy, 2013; Jessor, 1991; Kendler, Gardner, & Dick, 2011; Li et al., 2017; Shadur & Lejuez, 2015; Slutske et al., 2002), (2) that index underlying etiological risk and map onto the developmental genetics literature and underlying neurobiological mechanisms involved in substance use outcomes, and (3) that we believe will be of interest to students, toward our goal of creating natural engagement and spread. We are actively engaging students in the creation of the personalized feedback program, soliciting feedback via small focus groups of students recruited based upon differing personality profiles to ensure broad representation of feedback across the dimensions.
We note that personalized feedback could be expanded to incorporate many other dimensions of relevance. For example, personalized feedback modules could target neurobehavioral and neurobiological risk factors associated with externalizing and internalizing pathways, such as those described in Kwako et al. (2016; 2019). A well-established neurobehavioral risk factor is impulsive decision-making (Vassileva & Conrod, 2019). Studies reveal that simply providing personalized feedback on tasks of decision-making is associated with improved neurobehavioral performance (Brand, 2008; Brand, Laier, Pawlikowski, & Markowitsch, 2009). Recently, novel neurocognitive remediation strategies based on behavioral economic and neuro-economic approaches that target delay discounting, a key impulsivity dimension associated with constricted temporal horizons and excessive valuation of immediate rewards despite long-term negative consequences, have demonstrated promising results (Bickel, Johnson, Koffarnus, MacKillop, & Murphy, 2014; Bickel et al., 2016; Gray & MacKillop, 2015). Though no existing neurocognitive intervention programs to date incorporate personalized feedback, there is evidence that providing direct feedback to patients from their results on clinical neuropsychological testing improves quality of life and social adjustment (Rosado et al., 2018). Similarly, neurofeedback, one of the earliest personalized feedback interventions which uses real-time displays of brain activity (fMRI) to teach self-regulation of brain function (Watanabe, Sasaki, Shibata, & Kawato, 2017), holds promise for relapse prevention to control predisposing risk factors such as stress and craving (Pandria, Athanasiou, Konstantara, Karagianni, & Bamidis, 2020).
Mapping the externalizing and internalizing personality risk profiles onto integrative neuroscience-based RDoC frameworks (Kwako et al., 2016, 2019), promises to identify novel targets for prevention and intervention that may supplement existing programs and inform the development of new programs (Krystal & O’Malley, 2015; Litten et al., 2015; Sher, 2015). There is an unexplored therapeutic potential of integrating personality with neurocognitive and other intervention modules, based on individual risk factors, which may optimize the precision and efficacy of targeted intervention approaches for addictions. The development and evaluation of personalized feedback interventions will also set the stage for the incorporation of genetic information into personalized prevention intervention programming. There has been an exponential increase in the number of individuals participating in direct to consumer genetic testing (Regalado, 2019), and uploading their genetic data to publicly available websites to calculate genetic risk scores (Folkersen et al., 2019). In one of the most popular of these websites, substance use and mental health outcomes make up half of the top twelve most requested genetic risk scores (Folkersen et al., 2019), with alcohol use disorder being third. We have found that a high percentage of emerging adults (~80–90%) report being interested in receiving their genetic risk information for substance use and mental health disorders (Driver, Kuo, Dick, & Spit for Science Working Group, 2020). It has been suggested that this information can be used to motivate individuals to practice healthier lifestyle behaviors (McBride, Koehly, Sanderson, & Kaphingst, 2010); thus, providing genetic risk information alongside other personalized information may further prevent or reduce risky drinking behaviors. We believe the delivery of personalized genetic risk information will be increasingly commonplace in the future (Ashley, 2015), and our platform naturally lends itself to these future developments.
Although we believe personalized feedback programs have great potential, ultimately, the proof will be in the proverbial pudding. Through this paper, we hope to encourage more researchers to experiment with making pudding.
Public Health Significance:
College represents a unique opportunity to intervene and have positive life-course altering health benefits for a significant, and increasingly diverse portion of the population. Identifying innovative new programs to curtail risky substance use is a public health imperative. Integrating findings from basic genetic epidemiological research about pathways of risk represents one such novel approach.
Acknowledgments
This project is supported by R34AA027347 (DMD, JML) from the National Institute on Alcohol Abuse and Alcoholism (NIAAA). Additional investigator effort was supported by F31AA027130 (ZN) from NIAAA and R01DA021421 (JV) from National Institute on Drug Abuse (NIDA) and Fogarty International Center (FIC). The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIAAA, NIDA, or FIC. This research was further made possible by Spit for Science. Spit for Science has been supported by Virginia Commonwealth University, P20 AA017828, R37AA011408, K02AA018755, P50 AA022537, and K01AA024152 from the National Institute on Alcohol Abuse and Alcoholism, and UL1RR031990 from the National Center for Research Resources and National Institutes of Health Roadmap for Medical Research. Spit for Science was also supported by the National Institute on Drug Abuse of the National Institutes of Health under Award Number U54DA036105 and the Center for Tobacco Products of the U.S. Food and Drug Administration. The content is solely the responsibility of the authors and does not necessarily represent the views of the NIH or the FDA. Data from this study are available to qualified researchers via spit4science.vcu.edu and dbGaP (phs001754.v2.p1). We would like to thank the Spit for Science participants for making this study a success, as well as the many University faculty, students, and staff who contributed to the design and implementation of the project.
Footnotes
This paper is not the copy of record and may not exactly replicate the final, authoritative version of the article. Please do not copy or cite without authors’ permission. The final article will be available, upon publication, via its DOI: 10.1037/adb0000759.
References
- Acton GS (2003). Measurement of Impulsivity in a Hierarchical Model of Personality Traits: Implications for Substance Use. Substance Use & Misuse, 38(1), 67–83. 10.1081/JA-120016566 [DOI] [PubMed] [Google Scholar]
- Allum N (2010). What Makes Some People Think Astrology Is Scientific? Science Communication, 33(3), 341–366. 10.1177/1075547010389819 [DOI] [Google Scholar]
- Arria AM, Garnier-Dykstra LM, Caldeira KM, Vincent KB, Winick ER, & O’Grady KE (2013). Drug use patterns and continuous enrollment in college: Results from a longitudinal study. Journal of Studies on Alcohol and Drugs, 74(1), 71–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ashley EA (2015). The precision medicine initiative: a new national effort. Jama, 313(21), 2119–2120. 10.1001/jama.2015.3595 [DOI] [PubMed] [Google Scholar]
- Babor TF, Hofmann M, DelBoca FK, Hesselbrock V, Meyer RE, Dolinsky ZS, & Rounsaville B (1992). Types of alcoholics, I: Evidence for an empirically derived typology based on indicators of vulnerability and severity. Archives of General Psychiatry, 49(8), 599–608. [DOI] [PubMed] [Google Scholar]
- Bader CD, Baker JO, & Mencken FC (2017). Paranormal America: Ghost encounters, UFO sightings, bigfoot hunts, and other curiosities in religion and culture. NYU Press. [Google Scholar]
- Bailey RR (2017). Goal Setting and Action Planning for Health Behavior Change. American Journal of Lifestyle Medicine, 13(6), 615–618. 10.1177/1559827617729634 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barnett NP, Tevyaw TO, Fromme K, Borsari B, Carey KB, Corbin WR, … Monti PM (2004). Brief alcohol interventions with mandated or adjudicated college students. Alcoholism: Clinical and Experimental Research, 28(6), 966–975. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Berberick SN, & McAllister MP (2016). Online quizzes as viral, consumption-based identities. International Journal of Communication, 10, 19. [Google Scholar]
- Bickel WK, Johnson MW, Koffarnus MN, MacKillop J, & Murphy JG (2014). The behavioral economics of substance use disorders: reinforcement pathologies and their repair. Annual Review of Clinical Psychology, 10, 641–677. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bickel WK, Mellis AM, Snider SE, Moody L, Stein JS, & Quisenberry AJ (2016). Novel therapeutics for addiction: Behavioral economic and neuroeconomic approaches. Current Treatment Options in Psychiatry, 3(3), 277–292. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Borsari B, & Carey KB (2005). Two brief alcohol interventions for mandated college students. Psychology of Addictive Behaviors, 19(3), 296. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Brand M (2008). Does the feedback from previous trials influence current decisions? A study on the role of feedback processing in making decisions under explicit risk conditions. Journal of Neuropsychology, 2(2), 431–443. [DOI] [PubMed] [Google Scholar]
- Brand M, Laier C, Pawlikowski M, & Markowitsch HJ (2009). Decision making with and without feedback: The role of intelligence, strategies, executive functions, and cognitive styles. Journal of Clinical and Experimental Neuropsychology, 31(8), 984–998. [DOI] [PubMed] [Google Scholar]
- Caldeira KM, Kasperski SJ, Sharma E, Vincent KB, O’Grady KE, Wish ED, & Arria AM (2009). College students rarely seek help despite serious substance use problems. Journal of Substance Abuse Treatment, 37(4), 368–378. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carey KB, Scott-Sheldon LAJ, Carey MP, & DeMartini KS (2007). Individual-level interventions to reduce college student drinking: A meta-analytic review. Addictive Behaviors, 32(11), 2469–2494. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carey KB, Scott-Sheldon LAJ, Elliott JC, Garey L, & Carey MP (2012). Face-to-face versus computer-delivered alcohol interventions for college drinkers: A meta-analytic review, 1998 to 2010. Clinical Psychology Review, 32(8), 690–703. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Carpenter KM, & Hasin DS (1999). Drinking to cope with negative affect and DSM-IV alcohol use disorders: a test of three alternative explanations. Journal of Studies on Alcohol, 60(5), 694–704. 10.15288/jsa.1999.60.694 [DOI] [PubMed] [Google Scholar]
- Carragher N, Teesson M, Sunderland M, Newton NC, Krueger RF, Conrod PJ, … Slade T (2016). The structure of adolescent psychopathology: a symptom-level analysis. Psychological Medicine, 46(5), 981. [DOI] [PubMed] [Google Scholar]
- Center for Substance Abuse Treatment. (1999). Enhancing Motivation for Change in Substance Abuse Treatment, (Treatment. [PubMed]
- Cho S. Bin, Llaneza DC, Adkins AE, Cooke M, Kendler KS, Clark SL, & Dick DM (2015). Patterns of substance use across the first year of college and associated risk factors. Frontiers in Psychiatry, 6, 152. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Chouchane L, Mamtani R, Dallol A, & Sheikh JI (2011). Personalized medicine: a patient-centered paradigm. BioMed Central. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cloninger CR, Bohman M, & Sigvardsson S (1981). Inheritance of alcohol abuse: Cross-fostering analysis of adopted men. Archives of General Psychiatry, 38(8), 861–868. [DOI] [PubMed] [Google Scholar]
- Cloninger CR, Sigvardsson S, & Bohman M (1996). Type I and type II alcoholism: An update. Alcohol Health and Research World, 20(1), 18. [PMC free article] [PubMed] [Google Scholar]
- Collins FS, & Varmus H (2015). A new initiative on precision medicine. New England Journal of Medicine, 372(9), 793–795. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Conrod PJ, Castellanos-Ryan N, & Mackie C (2011). Long-term effects of a personality-targeted intervention to reduce alcohol use in adolescents. Journal of Consulting and Clinical Psychology, 79(3), 296. [DOI] [PubMed] [Google Scholar]
- Conrod PJ, O’Leary-Barrett M, Newton N, Topper L, Castellanos-Ryan N, Mackie C, & Girard A (2013). Effectiveness of a selective, personality-targeted prevention program for adolescent alcohol use and misuse: a cluster randomized controlled trial. JAMA Psychiatry, 70(3), 334–342. [DOI] [PubMed] [Google Scholar]
- Cook C, Heath F, & Thompson RL (2000). A meta-analysis of response rates in web-or internet-based surveys. Educational and Psychological Measurement, 60(6), 821–836. [Google Scholar]
- Cronce JM, Bittinger JN, Liu J, & Kilmer JR (2014). Electronic feedback in college student drinking prevention and intervention. Alcohol Research: Current Reviews, 36(1), 47. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cronce JM, & Larimer ME (2011). Individual-focused approaches to the prevention of college student drinking. Alcohol Research & Health, 34(2), 210. [PMC free article] [PubMed] [Google Scholar]
- Cuthbert BN (2014). The RDoC framework: facilitating transition from ICD/DSM to dimensional approaches that integrate neuroscience and psychopathology. World Psychiatry, 13(1), 28–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cuthbert BN, & Insel TR (2013). Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC Medicine, 11(1), 1–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cyders MA, Smith GT, Spillane NS, Fischer S, Annus AM, & Peterson C (2007). Integration of impulsivity and positive mood to predict risky behavior: Development and validation of a measure of positive urgency. Psychological Assessment. Cyders, Melissa A.: Department of Psychology, University of Kentucky, Lexington, KY, US, 40506–0044, melissa.cyders@uky.edu: American Psychological Association. 10.1037/1040-3590.19.1.107 [DOI] [PubMed] [Google Scholar]
- DeMartini KS, Gueorguieva R, Leeman RF, Corbin WR, Fucito LM, Kranzler HR, & O’Malley SS (2016). Longitudinal findings from a randomized clinical trial of naltrexone for young adult heavy drinkers. Journal of Consulting and Clinical Psychology, 84(2), 185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dennhardt AA, & Murphy JG (2013). Prevention and treatment of college student drug use: A review of the literature. Addictive Behaviors, 38(10), 2607–2618. [DOI] [PubMed] [Google Scholar]
- Dick DM, Nasim A, Edwards AC, Salvatore JE, Cho SB, Adkins A, … Kendler KS (2014). Spit for Science: launching a longitudinal study of genetic and environmental influences on substance use and emotional health at a large US university. Front Genet, 5, 47. 10.3389/fgene.2014.00047 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dick Danielle M. (2018). Commentary for special issue of prevention science “using genetics in prevention: Science fiction or science fact?” Prevention Science, 19(1), 101–108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dick Danielle M, Barr PB, Cho S. Bin, Cooke ME, Kuo SI, Lewis TJ, … Su J (2018). Post‐GWAS in psychiatric genetics: a developmental perspective on the “other” next steps. Genes, Brain and Behavior, 17(3), e12447. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dick Danielle M, & Hancock LC (2015). Integrating basic research with prevention/intervention to reduce risky substance use among college students. Frontiers in Psychology, 6, 544. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dick Danielle M, Smith G, Olausson P, Mitchell SH, Leeman RF, O’Malley SS, & Sher K (2010). Understanding the construct of impulsivity and its relationship to alcohol use disorders. Addiction Biology, 15(2), 217–226. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Driver MN, Kuo SI, Dick DM, & Spit for Science Working Group. (2020). Interest in Genetic Feedback for Alcohol Use Disorder and Related Substance Use and Psychiatric Outcomes among Young Adults. Brain Sciences, 10(12), 1007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Earleywine M, & Finn PR (1991). Sensation seeking explains the relation between behavioral disinhibition and alcohol consumption. Addictive Behaviors, 16(3–4), 123–128. [DOI] [PubMed] [Google Scholar]
- Elliott JC, Carey KB, & Vanable PA (2014). A preliminary evaluation of a web-based intervention for college marijuana use. Psychology of Addictive Behaviors, 28(1), 288. [DOI] [PubMed] [Google Scholar]
- Farmer RF, Gau JM, Seeley JR, Kosty DB, Sher KJ, & Lewinsohn PM (2016). Internalizing and externalizing disorders as predictors of alcohol use disorder onset during three developmental periods. Drug and Alcohol Dependence, 164, 38–46. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Folkersen L, Pain O, Ingason A, Werge T, Lewis CM, & Austin J (2019). Impute. me: an open source non-profit tool for using data from DTC genetic testing to calculate and interpret polygenic risk scores. BioRxiv, 861831. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gatzke-Kopp LM, Beauchaine TP, Shannon KE, Chipman J, Fleming AP, Crowell SE, … Aylward E (2009). Neurological correlates of reward responding in adolescents with and without externalizing behavior disorders. Journal of Abnormal Psychology, 118(1), 203. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gray JC, & MacKillop J (2015). Impulsive delayed reward discounting as a genetically-influenced target for drug abuse prevention: a critical evaluation. Frontiers in Psychology, 6, 1104. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hingson RW, Zha W, & Weitzman ER (2009). Magnitude of and trends in alcohol-related mortality and morbidity among US college students ages 18–24, 1998–2005. Journal of Studies on Alcohol and Drugs, Supplement, (16), 12–20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hornsey MJ, & Jetten J (2004). The individual within the group: Balancing the need to belong with the need to be different. Personality and Social Psychology Review, 8(3), 248–264. [DOI] [PubMed] [Google Scholar]
- Huh D, Mun E, Larimer ME, White HR, Ray AE, Rhew IC, … Atkins DC (2015). Brief motivational interventions for college student drinking may not be as powerful as we think: An individual participant‐level data meta‐analysis. Alcoholism: Clinical and Experimental Research, 39(5), 919–931. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hussong AM, Jones DJ, Stein GL, Baucom DH, & Boeding S (2011). An internalizing pathway to alcohol use and disorder. Psychol Addict Behav, 25(3), 390–404. 10.1037/a0024519 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hustad JTP, Barnett NP, Borsari B, & Jackson KM (2010). Web-based alcohol prevention for incoming college students: A randomized controlled trial. Addictive Behaviors, 35(3), 183–189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jans M, & Roman A (2007). National response rates for surveys of college students: Institutional, regional, and design factors. Ann Arbor, MI: Michigan Programing Survey Methodology, University of Michigan, Institute for Social Research, Section on Survey Research Methods. [Google Scholar]
- Janssens A (2019). Proprietary algorithms for polygenic risk: protecting scientific innovation or hiding the lack of it? Genes, 10(6), 448. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Jessor R (1991). Risk behavior in adolescence: a psychosocial framework for understanding and action. Journal of Adolescent Health. [DOI] [PubMed] [Google Scholar]
- John OP, & Srivastava S (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. In Handbook of personality: Theory and research (2nd ed., pp. 102–138). [Google Scholar]
- Kendler KS, Gardner C, & Dick DM (2011). Predicting alcohol consumption in adolescence from alcohol-specific and general externalizing genetic risk factors, key environmental exposures and their interaction. Psychological Medicine, 41(7), 1507. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kendler KS, Prescott CA, Myers J, & Neale MC (2003). The structure of genetic and environmental risk factors for common psychiatric and substance use disorders in men and women. Arch Gen Psychiatry, 60(9), 929–937. 10.1001/archpsyc.60.9.929 [DOI] [PubMed] [Google Scholar]
- Kendler Kenneth S, Myers J, & Dick D (2015). The stability and predictors of peer group deviance in university students. Social Psychiatry and Psychiatric Epidemiology, 50(9), 1463–1470. 10.1007/s00127-015-1031-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- King LA (2001). The health benefits of writing about life goals. Personality and Social Psychology Bulletin, 27(7), 798–807. [Google Scholar]
- Knyazev GG (2004). Behavioural activation as predictor of substance use: mediating and moderating role of attitudes and social relationships. Drug and Alcohol Dependence, 75(3), 309–321. 10.1016/j.drugalcdep.2004.03.007 [DOI] [PubMed] [Google Scholar]
- Krueger RF, Hicks BM, Patrick CJ, Carlson SR, Iacono WG, & McGue M (2009). Etiologic connections among substance dependence, antisocial behavior, and personality: Modeling the externalizing spectrum. American Psychological Association. 10.1037/11855-003] [DOI] [PubMed] [Google Scholar]
- Krueger Robert F, Markon KE, Patrick CJ, Benning SD, & Kramer MD (2007). Linking antisocial behavior, substance use, and personality: an integrative quantitative model of the adult externalizing spectrum. Journal of Abnormal Psychology, 116(4), 645. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Krystal JH, & O’Malley SS (2015). From Translational Neuroscience to Personalized Medicine. Alcoholism, Clinical and Experimental Research, 39(4), 585–586. [DOI] [PubMed] [Google Scholar]
- Kushner MG, Wall MM, Krueger RF, Sher KJ, Maurer E, Thuras P, & Lee S (2012). Alcohol dependence is related to overall internalizing psychopathology load rather than to particular internalizing disorders: evidence from a national sample. Alcoholism: Clinical and Experimental Research, 36(2), 325–331. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kwako LE, Momenan R, Litten RZ, Koob GF, & Goldman D (2016). Addictions neuroclinical assessment: a neuroscience-based framework for addictive disorders. Biological Psychiatry, 80(3), 179–189. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kwako LE, Schwandt ML, Ramchandani VA, Diazgranados N, Koob GF, Volkow ND, … Goldman D (2019). Neurofunctional domains derived from deep behavioral phenotyping in alcohol use disorder. American Journal of Psychiatry, 176(9), 744–753. [DOI] [PMC free article] [PubMed] [Google Scholar]
- LaBrie JW, Kenney SR, Napper LE, & Miller K (2014). Impulsivity and alcohol-related risk among college students: Examining urgency, sensation seeking and the moderating influence of beliefs about alcohol’s role in the college experience. Addictive Behaviors, 39(1), 159–164. 10.1016/j.addbeh.2013.09.018 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Larimer ME, & Cronce JM (2002). Identification, prevention and treatment: a review of individual-focused strategies to reduce problematic alcohol consumption by college students. Journal of Studies on Alcohol, Supplement, (14), 148–163. [DOI] [PubMed] [Google Scholar]
- Lee CM, Neighbors C, Kilmer JR, & Larimer ME (2010). A brief, web-based personalized feedback selective intervention for college student marijuana use: a randomized clinical trial. Psychology of Addictive Behaviors, 24(2), 265. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Li JJ, Savage JE, Kendler KS, Hickman M, Mahedy L, Macleod J, … Dick DM (2017). Polygenic risk, personality dimensions, and adolescent alcohol use problems: a longitudinal study. Journal of Studies on Alcohol and Drugs, 78(3), 442–451. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Litten RZ, Ryan ML, Falk DE, Reilly M, Fertig JB, & Koob GF (2015). Heterogeneity of alcohol use disorder: understanding mechanisms to advance personalized treatment. Alcoholism: Clinical and Experimental Research. [DOI] [PubMed] [Google Scholar]
- Lynam DR, Smith GT, Whiteside SP, & Cyders MA (2006). The UPPS-P: Assessing five personality pathways to impulsive behavior. West Lafayette, IN: Purdue University. [Google Scholar]
- McBride CM, Koehly LM, Sanderson SC, & Kaphingst KA (2010). The behavioral response to personalized genetic information: will genetic risk profiles motivate individuals and families to choose more healthful behaviors? Annu Rev Public Health, 31, 89–103. 10.1146/annurev.publhealth.012809.103532 [DOI] [PubMed] [Google Scholar]
- Meque I, Dachew BA, Maravilla JC, Salom C, & Alati R (2019). Externalizing and internalizing symptoms in childhood and adolescence and the risk of alcohol use disorders in young adulthood: a meta-analysis of longitudinal studies. Australian & New Zealand Journal of Psychiatry, 53(10), 965–975. [DOI] [PubMed] [Google Scholar]
- Miller MB, Meier E, Lombardi N, & Leffingwell TR (2015). Theories of behaviour change and personalised feedback interventions for college student drinking. Addiction Research & Theory, 23(4), 322–335. [Google Scholar]
- Miller WR, & Rollnick S (2013). Motivational interviewing: Helping people change (applications of motivational interviewing) (3rd editio). Guilford Press. [Google Scholar]
- Murphy JG, Dennhardt AA, Martens MP, Borsari B, Witkiewitz K, & Meshesha LZ (2019). A randomized clinical trial evaluating the efficacy of a brief alcohol intervention supplemented with a substance-free activity session or relaxation training. Journal of Consulting and Clinical Psychology, 87(7), 657. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murphy JG, Dennhardt AA, Skidmore JR, Borsari B, Barnett NP, Colby SM, & Martens MP (2012). A randomized controlled trial of a behavioral economic supplement to brief motivational interventions for college drinking. Journal of Consulting and Clinical Psychology, 80(5), 876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murphy JG, Dennhardt AA, Yurasek AM, Skidmore JR, Martens MP, MacKillop J, & McDevitt-Murphy ME (2015). Behavioral economic predictors of brief alcohol intervention outcomes. Journal of Consulting and Clinical Psychology, 83(6), 1033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- National Survey of Student Engagement. (2011). Response rate information by key institutional characteristics.
- Nelson TF, Toomey TL, Lenk KM, Erickson DJ, & Winters KC (2010). Implementation of NIAAA college drinking task force recommendations: how are colleges doing 6 years later? Alcoholism: Clinical and Experimental Research, 34(10), 1687–1693. [DOI] [PubMed] [Google Scholar]
- O’Leary-Barrett M, Topper L, Al-Khudhairy N, Pihl RO, Castellanos-Ryan N, Mackie CJ, & Conrod PJ (2013). Two-year impact of personality-targeted, teacher-delivered interventions on youth internalizing and externalizing problems: a cluster-randomized trial. Journal of the American Academy of Child & Adolescent Psychiatry, 52(9), 911–920. [DOI] [PubMed] [Google Scholar]
- O’Malley SS, Corbin WR, Leeman RF, DeMartini KS, Fucito LM, Ikomi J, … Sher KJ (2015). Reduction of alcohol drinking in young adults by naltrexone: a double-blind, placebo-controlled, randomized clinical trial of efficacy and safety. The Journal of Clinical Psychiatry, 76(2), 207–213. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pandria N, Athanasiou A, Konstantara L, Karagianni M, & Bamidis PD (2020). Advances in biofeedback and neurofeedback studies on smoking. NeuroImage: Clinical, 28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Quinn PD, & Harden KP (2013). Differential changes in impulsivity and sensation seeking and the escalation of substance use from adolescence to early adulthood. Development and Psychopathology, 25(1), 223. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Regalado A (2019). More than 26 million people have taken an at-home ancestry test. MIT Technology Review. [Google Scholar]
- Rideout CA, & Richardson SA (1989). A Teambuilding Model: Appreciating Differences Using the Myers‐Briggs Type Indicator with Developmental Theory. Journal of Counseling & Development, 67(9), 529–533. [Google Scholar]
- Rosado DL, Buehler S, Botbol-Berman E, Feigon M, León A, Luu H, … Greif T (2018). Neuropsychological feedback services improve quality of life and social adjustment. The Clinical Neuropsychologist, 32(3), 422–435. [DOI] [PubMed] [Google Scholar]
- Rosenstock IM (1974). The health belief model and preventive health behavior. Health Education Monographs, 2(4), 354–386. [DOI] [PubMed] [Google Scholar]
- Sax LJ, Gilmartin SK, & Bryant AN (2003). Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education, 44(4), 409–432. [Google Scholar]
- Schulenberg J, Johnston L, O’Malley P, Bachman J, Miech R, & Patrick M (2019). Monitoring the Future national survey results on drug use, 1975–2018: Volume II, college students and adults ages 19–60. [Google Scholar]
- Shadur JM, & Lejuez CW (2015). Adolescent substance use and comorbid psychopathology: Emotion regulation deficits as a transdiagnostic risk factor. Current Addiction Reports, 2(4), 354–363. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Sher KJ (2015). Moving the alcohol addiction RDoC forward. [DOI] [PMC free article] [PubMed]
- Slutske WS, Heath AC, Madden PAF, Bucholz KK, Statham DJ, & Martin NG (2002). Personality and the genetic risk for alcohol dependence. Journal of Abnormal Psychology, 111(1), 124. [PubMed] [Google Scholar]
- Steele RG, Forehand R, Armistead L, & Brody G (1995). Predicting alcohol and drug use in early adulthood: the role of internalizing and externalizing behavior problems in early adolescence. American Journal of Orthopsychiatry, 65(3), 380–388. [DOI] [PubMed] [Google Scholar]
- Substance Abuse and Mental Health Services Administration. (2016). 2015 National Survey on Drug Use and Health. [PubMed]
- Tarter RE (1988). Are there inherited behavioral traits that predispose to substance abuse? Journal of Consulting and Clinical Psychology, 56(2), 189–196. [DOI] [PubMed] [Google Scholar]
- Tarter R, Kirisci L, Hegedus A, Mezzich A, & Vanyukov MM (1994). Heterogeneity of adolescent alcoholism. In Types of alcoholics: Evidence from clinical, experimental, and genetic research. (pp. 172–180). New York, NY, US: New York Academy of Sciences. [DOI] [PubMed] [Google Scholar]
- Varvel T, Adams SG, Pridie SJ, & Ruiz Ulloa BC (2004). Team effectiveness and individual Myers-Briggs personality dimensions. Journal of Management in Engineering, 20(4), 141–146. [Google Scholar]
- Vassileva J, & Conrod PJ (2019). Impulsivities and addictions: a multidimensional integrative framework informing assessment and interventions for substance use disorders. Philosophical Transactions of the Royal Society B, 374(1766), 20180137. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Watanabe T, Sasaki Y, Shibata K, & Kawato M (2017). Advances in fMRI real-time neurofeedback. Trends in Cognitive Sciences, 21(12), 997–1010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- White AM, Kraus CL, & Swartzwelder HS (2006). Many college freshmen drink at levels far beyond the binge threshold. Alcoholism: Clinical and Experimental Research, 30(6), 1006–1010. [DOI] [PubMed] [Google Scholar]
- White HR, Jiao Y, Ray AE, Huh D, Atkins DC, Larimer ME, … LaBrie JW (2015). Are there secondary effects on marijuana use from brief alcohol interventions for college students? Journal of Studies on Alcohol and Drugs, 76(3), 367–377. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Williams J, Liccardo Pacula R, Chaloupka FJ, & Wechsler H (2004). Alcohol and marijuana use among college students: economic complements or substitutes? Health Economics, 13(9), 825–843. [DOI] [PubMed] [Google Scholar]
- Zucker RA, Heitzeg MM, & Nigg JT (2011). Parsing the undercontrol–disinhibition pathway to substance use disorders: A multilevel developmental problem. Child Development Perspectives, 5(4), 248–255. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zuckerman M (2007). Sensation seeking and risky behavior. American Psychological Association. [Google Scholar]
- Zuckerman M, & Kuhlman DM (2000). Personality and risk‐taking: common bisocial factors. Journal of Personality, 68(6), 999–1029. [DOI] [PubMed] [Google Scholar]



