Abstract
Background. Normative feedback (NF), or receiving information about one’s drinking compared to peer drinking norms, is one of the most widely used brief interventions for prevention and intervention for hazardous alcohol use. NF has demonstrated predominantly small but significant effect sizes for intention to change and other drinking related outcomes. Identifying mechanisms of action may improve the effectiveness of NF; however, few studies have examined NF’s mechanisms of action, particularly among adults.
Objective. This study is an exploratory analysis of two theorized mechanisms of NF: discrepancy (specifically personal dissonance—the affective response to feedback) and belief in the accuracy of feedback.
Method. Using Amazon’s Mechanical Turk, 87 men (n = 56) and women (n = 31) completed an online survey during which they were asked about their perceptions about their drinking and actual drinking behaviors. Then participants were provided tailored NF and evaluated for their reactions. Severity of discrepancy was measured by the difference between one’s estimated percentile ranking of drinking compared to peers and actual percentile ranking. Surprise and worry reported due to the discrepancy were proxies for personal dissonance. Participants were also asked if they believed the feedback and if they had any plans to change their drinking. Mediation analyses were implemented, exploring whether surprise, worry, or belief in the accuracy of feedback mediated severity of discrepancy’s impact on plan for change.
Results. Among this sample of adult drinkers, severity of discrepancy did not predict plan for change, and personal dissonance did not mediate severity of discrepancy. Severity of discrepancy was mediated by belief in the accuracy of feedback. In addition, viewing one’s drinking as a problem prior to feedback and post-NF worry both predicted plan for change independently.
Conclusions. Results revealed that NF may not work to create personal dissonance through discrepancy, but belief in the accuracy of feedback may be important. It appears the more one believes the feedback, the more one makes a plan for change, suggesting practitioners should be mindful of how information within feedback is presented. Findings also indicate NF may work by validating a preexisting perception that drinking is a problem instead of creating concern related to discrepancy where none existed. Limitations regarding generalizability are discussed.
Keywords: Mediation, Decision dilemma theory, Alcohol, Discrepancy, Normative feedback
Introduction
Hazardous and/or harmful use of alcohol, such as drinking to excess or in the context of comorbid medical or mental health conditions, is a public health problem that causes economic and social burden across the globe (World Health Organization., 2014). In the United States in 2013, just under a quarter (24.7%) of adults aged 18 and older reported binge drinking (consuming five or more drinks on one occasion), and 6.8% reported heavy drinking (drinking beyond the recommended guidelines for safe alcohol use given by the National Institute for Alcohol Abuse and Alcoholism (National Institute on Alcohol Abuse and Alcoholism, 2013)) in the past month (Substance Abuse and Mental Health Services Administration, 2014). Many hazardous drinkers will be at risk for serious health consequences but do not perceive their drinking as requiring formal treatment (Cunningham et al., 2001; Hester & Delaney, 1997; Rosenberg, 1993). Due to the prevalence rates of hazardous drinking, the avoidance of formal treatment, and the recent call for expanded prevention services within health care reform (Arvantes, 2010), there is an increasing need for effective brief interventions that address harmful alcohol use at both the individual and population levels (McCambridge & Cunningham, 2014; Dotson, Dunn & Bowers, 2015) outside of specialty health care settings.
Several brief interventions have been developed (McCambridge & Cunningham, 2014) to prevent alcohol use disorder (AUD) and to reduce alcohol related consequences. Brief interventions tend to be less than an hour long, or sometimes as short as a few minutes, and are usually implemented by a non-specialist, such as a primary care physician, or, in some cases, on a computer. One such brief intervention is normative feedback (NF), a widely used intervention for prevention of and early intervention for hazardous alcohol use (Cunningham, Murphy & Hendershot, 2015). During NF, individuals are assessed and then provided with information about how their drinking patterns compare to drinking norms of their peers of the same gender and age. The purpose of NF is to provide a drinker with a tool for understanding their own, potentially excessive, drinking and ultimately motivate them to reduce their drinking to safe levels.
There are a variety of forms of NF, and it is implemented in a myriad of ways. For example, NF can be implemented as a standalone intervention; as part of more detailed feedback that includes information on health consequences, referred to as personalized feedback (Walters & Neighbors, 2005); or alongside or within another therapeutic intervention, such as Motivational Enhancement Therapy (MET) (Walters & Neighbors, 2005; Murphy et al., 2004). NF is often provided in community-based settings, such as primary care (Maisto et al., 2001; Collins, Carey & Sliwinski, 2002), via multiple modalities (e.g., web-based, mailed, in-person) (Walters & Neighbors, 2005; White, 2006; Walters & Woodhall, 2003; Cunningham et al., 2012; Cunningham et al., 2009). Given its relative simplicity, it is somewhat surprising that NF demonstrates consistent effectiveness in helping individuals reduce drinking at statistically significant levels across all modalities, contexts (e.g., within therapy or alone), and structures (e.g., a single item or detailed feedback about multiple health indicators) (Cunningham et al., 2001; Dotson, Dunn & Bowers, 2015; Walters & Neighbors, 2005; Murphy et al., 2004; White, 2006; Cunningham et al., 2012; Miller, Benefield & Tonigan, 1993; White et al., 2007; Doumas & Hannah, 2008; Walters et al., 2009; Kuerbis et al., 2014; Riper et al., 2009; Cadigan et al., 2015; Zimmerman & Fischhoff, 2014; Cunningham et al., 2010).
It is important to note that the preponderance of the above described research on NF has primarily focused on college students and/or their non-college same-age counterparts (Walters & Neighbors, 2005; Reid & Carey, 2015; Miller et al., 2013). This is in part because of the well documented prevalence of high risk drinking on college campuses and among individuals at this stage of late adolescence (Substance Abuse and Mental Health Services Administration, 2014). Only a few studies have examined the impact of NF among adult drinkers beyond the college age years (e.g., Cunningham et al., 2001; Cunningham, Murphy & Hendershot, 2015; Maisto et al., 2001; Cunningham et al., 2012; Cunningham et al., 2009; Kuerbis et al., 2014; Cunningham et al., 2010). Within those few studies, NF again demonstrates preliminary effectiveness among adults at a spectrum of ages; however, this effectiveness is less well established, especially long term (Cunningham et al., 2010), than for college-aged individuals.
While NF is considered an effective intervention, particularly for individuals in late adolescence, it can potentially be improved to better facilitate both individual and population health (McCambridge & Cunningham, 2014). While some studies demonstrate impressive effect sizes of NF, most studies demonstrate small effect sizes (Dotson, Dunn & Bowers, 2015; Cunningham et al., 2012; Cadigan et al., 2015). There is also evidence that NF does not impact drinking outcomes as much as has been previously suggested (Foxcroft et al., 2015; Gaume et al., 2014), particularly outside the context of primary care or for more than six months (Cunningham et al., 2010).
One way to improve an intervention is to understand its mechanisms of action. If one identifies and understands how an intervention works, one can hone the intervention—improving its efficacy and cost-effectiveness. Although some studies have examined the mechanisms of action of personalized feedback (McCambridge & Cunningham, 2014) and NF (Neighbors et al., 2016), mechanisms remain relatively unexplored (Gaume et al., 2014).
Proposed mechanisms of action of NF
Two potential mechanisms of action of NF explored in the literature are (1) discrepancy, including both external discrepancy (Neal & Carey, 2004), the difference between one’s perceived norm and the actual norm, and internal discrepancy (Neal & Carey, 2004), the dissonance between an individual’s drinking and an internal standard of comparison, such as one’s “ideal” drinking behavior; and (2) perceived accuracy of feedback.
Discrepancy has been explored in a number of ways due to its different forms and definitions. Social Norms Theory (Perkins, 2003) is used to explain the effect of NF—such that once the perception of how much others drink is reduced, then the individual’s drinking will be reduced in kind. Some studies support this theory, demonstrating change in perceived norms as a significant mediator of NF in reducing drinking among college students (Walters et al., 2009; Neighbors et al., 2016; Borsari & Carey, 2000; Neighbors, Larimer & Lewis, 2004; Walters, Vader & Harris, 2007). Other studies show that while change in perceived norms relates to intentions to change alcohol use among college students, it does not necessarily lead to actual reduced drinking (Neal & Carey, 2004; Larimer et al., 2007; Murphy et al., 2010). Notably, young adults may react to discrepancy differently from older adults due to their particular life stage (Erikson, 1968). For example, a heightened need for peer approval during late adolescence may cause a more potent effect of NF (Kuerbis et al., 2014). As such, mechanisms of action of NF may differ across age groups.
Within the context of MET (Miller et al., 1999), NF is thought to develop internal, self-ideal discrepancy (Murphy et al., 2010; Miller & Rollnick, 2002). In MET, a heightened awareness of discrepancy between one’s image of oneself and one’s actual behavior is thought to create conflict for the individual, resulting in discomfort with the status quo (McNally, Palfai & Kahler, 2005) and thus enhancing motivation to change. This conflict is described many ways—including affectively (McNally, Palfai & Kahler, 2005)—such as fear, worry, or a neutral uneasiness with the difference between perception and behavior. This conflict is conceptualized here as an affective response to discrepancy and is termed personal dissonance. Only two studies thus far directly examined the affective response related to NF and drinking with any population (Kuerbis et al., 2014; McNally, Palfai & Kahler, 2005). Results of one study demonstrated that among adult problem drinking men-who-have-sex-with-men (MSM), NF within MET elicited concern and worry, but these responses were not related to reduction in post-NF drinking (Kuerbis et al., 2014). The second study (McNally, Palfai & Kahler, 2005) also found no relationship between developed affective dissonance and drinking outcomes among heavy drinking college students. Given that only one study has examined this process among an adult population beyond college age and only in the context of MET, further research is needed to explore affective responses to NF and their role in behavior change among adults, at a range of ages.
Perceived accuracy of NF (e.g., belief that norms used for drinking comparisons and the results of the evaluation are true or valid) may also mediate NF’s efficacy. Decision dilemma theory (DDT) is a behavioral economic theory that posits that poor decision making (e.g., continued hazardous drinking) results from receiving “equivocal” feedback (Hantula & DeNicolis Bragger, 1999; Bowen, 1987) or “feedback for which multiple (positive or negative) interpretations can be constructed” (Bowen, 1987). An individual who perceives NF as highly equivocal might view the information as inaccurate or not applicable to their personal situation. As a result, the individual would dismiss the information, nullifying the effects of NF. In their study of adult drug users who received NF, Amrhein and colleagues (Amrhein et al., 2003) noted a subgroup of participants who disagreed with the feedback they received (thus viewed it as “highly equivocal”). This subgroup demonstrated more stable or increased drug use post-NF. Were this the mechanism of action of NF, it would be important to modify NF to present information in a “believable way” to maximize its effect. A study of 90 adult problem drinking MSM who received NF specifically tested this and found no support for DDT as an explanatory mechanism for NF (Kuerbis et al., 2014). A primary problem with this study was that perceived accuracy of feedback was measured by a third party observer. By viewing video-taped psychotherapy sessions in which NF was provided, observers coded statements clients made in session to measure the client’s perceived accuracy of the feedback (e.g., “Your data is wrong.”). In-session statements made about this perception were not explicitly solicited by therapists and thus were made inconsistently across participants. Participants were also not directly asked whether they believed the feedback outside of session.
The current study aimed to expand the limited knowledge about the potential mechanisms of action within NF, specifically affective responses to NF and belief in the accuracy of the feedback, by implementing a feasibility and exploratory pilot study of NF on adult drinkers. Given that many individuals with varied drinking patterns are receiving feedback via online mechanisms, such as alcoholscreening.org, we explored whether it was possible to gather data about personal reactions to feedback and test the mechanisms of action of web-based NF with a heterogeneous sample of drinkers. In this feasibility study, personal dissonance, as defined by level of surprise and worry, and belief in the accuracy of feedback were tested as mediators of severity of discrepancy (the magnitude of the difference between one’s drinking and peer norms) on a drinker’s plan to reduce drinking. It was hypothesized that both personal dissonance and belief in feedback would emerge as mediators of severity of discrepancy predicting planning for behavior change.
Method
Recruitment
Participants were recruited through Amazon Mechanical Turk (MTurk), an online labor market. MTurk is a online platform through which “workers” are contracted to complete tasks, called “human intelligence tasks” (HITs), such as beta testing software or providing consumer opinions. For completing a HIT, workers are compensated by the publisher of the task, called “requesters.” Compensation is generally low—often times below $1—and commensurate with the task intensity. Increasingly, MTurk is being used for social sciences research with comparable results to more traditional sampling methods, when validity checks are included in the design (Mason & Suri, 2012; Muench et al., 2014).
Eligibility
Participants were workers registered on MTurk. To participate in this HIT, they had to have received a HIT approval rating of 95% out of at least 500 completed HITs by other requesters. This limited the sample to workers deemed acceptable by other requesters and with adequate literacy in computer and internet use—thus providing increased assurance that participants could optimally understand this computer based intervention. Eligibility was limited to those residing in the United States.
Procedures
Eligible workers viewed the advertisement for the HIT Answer questions about a health behavior and receive feedback. Within the HIT, participants were directed to a link to an external web-based survey, hosted by SurveyMonkey.com. The initial page of the web-based survey provided information about the study, and only those who consented to participate clicked through to the actual survey. Within the survey, participants answered the question: “Do you drink alcohol?” Participants who answered no (N = 38) were directed to a survey related to exercise and were excluded from this analysis. Those who responded yes were directed to a survey about alcohol, which included NF about their own use (described further below). At the end of the survey, participants were provided with the reference information for the data used in the feedback. The survey took about 6 min to complete. Once completed, participants were provided with a code for their MTurk account, signaling the requester to review the responses and approve compensation. Participants were compensated 50 cents for survey participation, an average rate of compensation for comparable tasks. Workers were barred from retaking the survey.
Measures
Demographics
Participants were asked their age and gender.
Perceptions of participants’ drinking
Participants were asked a number of questions about their perception of their drinking prior to NF. On a scale of 1 (Not at all) to 8 (Extremely), participants were asked if the amount that they drank was excessive (excessive) and whether their current drinking is a problem for them or others (problem for others) in their lives. Finally, drinkers were asked “When you have not planned to drink, how much effort does it take for you not to drink alcohol when it is presented to you?” (effort). The effort question attempted to capture level of control over drinking.
Self-reported quantity and frequency of drinking
Participants were asked to report on their actual drinking through a series of questions based on the Form 90 QFV-30 (Miller & Del Boca, 1994). Responses were used to provide NF, described below.
Personal dissonance
Immediately after feedback was provided, participants were asked to rate, again on a scale of 1 (Not at all) to 8 (Extremely), (1) how surprised are you by the feedback? (surprise) and (2) how much does the feedback worry you? (worry). These were used as proxies for personal dissonance resulting from NF.
Expectation
Participants were asked “Is this feedback, ..?” and then provided with three options: better than expected, as expected and worse than expected.
Newness of information
Participants were asked if the information provided in the NF was new. They could respond yes or no.
Plan to change
In the last section of the survey, participants were asked about their plan related to drinking for the next 30 days. This question was categorical and responses ranged from (0) no change in drinking to (3) quitting drinking. Participants were also asked to rate on a scale of 1 (Not at all) to 8 (Extremely) their commitment to and confidence in their ability to achieve their plan.
Belief in the accuracy of NF
To avoid biasing item responses earlier in the survey, the last question was “how accurate does the information you received about your drinking seem to you?” A 5-point Likert response scale included anchors –2 Not at all accurate to 2 Definitely accurate. Zero was “Not sure.”
Severity of discrepancy
Participants were asked to rank themselves as to how much they drink compared to their same gendered peers in the form of a percentile rank. Severity of discrepancy was calculated as the difference between the participant’s initial reported percentile rank and actual percentile rank (calculated based on reported standard drinks per week)—a measure similar to those used in other studies (Walters et al., 2009; Walters, Vader & Harris, 2007). Higher numbers indicated greater discrepancy. Positive severity of discrepancy indicated that participants drank more compared to their peers than they estimated.
Normative feedback
Normative comparisons were based on the 2009 National Survey on Drug Use and Health (Substance Abuse and Mental Health Services Administration, 2010). Based on participants’ reported average number of standard drinks per week, they were directed to one of 18 different possible statements of feedback, each with a unique percentile rank based on gender and quantity of standard drinks per week. Feedback contained two sentences; for example: “You reported drinking 1 standard drink per week. You drink more than 27% of men.” While we asked about binge drinking, binge drinking was not a factor in determining feedback, nor were participants educated about binge drinking.
Analytic plan
Descriptive analyses were performed to evaluate overall participant perceptions of health behaviors, their reactions to NF, and their plans for change. Correlations between the perceptions of drinking pre-NF and post-NF reactions were calculated. Mediation analyses were performed using the PROCESS procedure (Hayes, 2013) in SPSS 22.0 (IBM Corp., 2013). Mediation was formally tested using the product of coefficients and bias-corrected bootstrap confidence intervals (Hayes, 2013), with 10,000 samples specified. Mediators were first tested independently, and effect sizes of the indirect effects were calculated using Preacher and Kelley’s kappa-squared (Preacher & Kelley, 2011), where appropriate. In this context, Kappa-squared provides information about the size of the indirect effect relative to its maximum possible value, given the natural constraints imposed by variances and correlations between variables (Hayes, 2013). If more than one independent mediator was significant, then multiple mediation was tested. Procedures were reviewed and granted approval by the Institutional Review Board at the New York State Psychiatric Institute.
Results
Sample description
Participants (N = 87) ranged in age from 18 to 64 (M = 33, SD = 11). Sixty-four percent were male.
Descriptives
Table 1 shows the reported drinking levels for the sample. Mean number of standard drinks per week for the entire sample was 8.1 (SD = 13.1), with a range from 1 standard drink to as high as 105 for men and 60 to women. While the majority of participants were light to moderate drinkers, many participants reported drinking all of their drinks on only one or two days.
Table 1. Pre-feedback descriptives of participants.
M (SD) or % | |
---|---|
Males (N = 56) | |
Alcohol use is excessivea | 1.9 (1.5) |
Drinking is a problema | 1.6 (1.3) |
My drinking is a problem for othersa | 1.9 (1.6) |
Effort needed to refuse a drinka | 2.6 (1.7) |
Number of days drink per week | 2.2 (2.0) |
Drinks per drinking day | 2.9 (2.5) |
Binge drank in the last 30 daysb | 62% |
Mean standard drinks per week | 8.2 (14.2) |
Females (N = 31) | |
Alcohol use is excessivea | 2.0 (1.9) |
Drinking is a problema | 1.8 (1.8) |
My drinking is a problem for othersa | 1.8 (1.5) |
Effort needed to refuse a drinka | 2.8 (2.4) |
Number of days drink per week | 1.8 (1.5) |
Drinks per drinking day | 2.8 (2.4) |
Binge drank in the last 30 daysb | 60% |
Mean standard drinks per week | 7.9 (12.3) |
Severity of discrepancyc (N = 87) | 42.9 (21.7) |
Notes.
Range is 1 Not at all to 8 Extremely.
Defined as drinking more than 5 standard drinks for men and 4 standard drinks for women.
The actual percentile minus the estimated percentile.
Based only on number of standard drinks per week, 14.9% reported drinking beyond safety guidelines set by the National Institute of Alcohol Abuse and Alcoholism for drinks per week among both men (>14 standard drinks per week) and women (>7 standard drinks per week).
Perceptions of drinking pre-NF
There were no gender differences on any of the perception variables. Table 1 demonstrates how participants viewed their drinking. Overall, drinkers did not view their drinking as excessive, a problem, or a problem for others. Refusing a drink required little effort. Drinkers also tended to largely underestimate their drinking compared to US adults, as demonstrated by a high mean severity of discrepancy score.
Reactions to NF
Reactions to NF are shown in Table 2. While participants were generally surprised by feedback, they were not particularly worried by it. Only 12.6% of participants viewed feedback as better than expected or as expected. A preponderance of drinkers (87.4%) reported feedback was worse than expected. A majority of drinkers (88%) reported this information was new. On average, drinkers reported that the feedback was somewhat inaccurate.
Table 2. Post-feedback descriptives: mediators and outcome.
(N = 87) M (SD) or % | |
---|---|
Personal dissonance variables | |
Surprise | 6.1 (2.2) |
Worry | 2.6 (2.1) |
Expectation. This information was: | |
Better than expected | 2.3 |
As expected | 10.3 |
Worse than expected | 87.4 |
Yes, this information was new. | 88.5 |
Belief the feedback was accuratea | –.54 (1.1) |
Planning for change | |
I have no plan to change my drinking. | 73.6 |
I plan to cut back on my drinking a little bit. | 14.9 |
I plan to greatly cut back my drinking. | 9.2 |
I plan to quit drinking. | 2.3 |
Confidence to change drinking (n = 23)b | 6.3 (1.3) |
Commitment to change drinking (n = 23)b | 5.8 (1.7) |
Notes.
Range was from –2 (not at all accurate) to 0 (not sure) to 2 (definitely accurate).
Range was from 1 Not at all to 8 Extremely.
Plan, confidence, and commitment to change
Table 2 also shows the outcome of NF. Among this sample of drinkers, 26.4% planned to quit or reduce their drinking. Confidence and commitment to change drinking were high.
Correlations between perception of drinking pre-NF and post-NF reactions
Correlation coefficients between pre-NF perceptions of drinking and the mediators were generated (see Table 3). Drinking is a problem was significantly negatively correlated with surprise and significantly positively correlated with worry, belief in the accuracy of feedback, and effort. Drinking is a problem was also significantly negatively correlated with severity of discrepancy. Findings suggest when an individual viewed his or her alcohol use as problematic, there was higher accuracy in his or her estimate of how his or her drinking compared to the norm. As a result, feedback was believable and not a surprise.
Table 3. Correlations between pre- and post-NF variables.
1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | |
---|---|---|---|---|---|---|---|---|
Pre-NF variables | ||||||||
1. Drinking is excessive | – | |||||||
2. Drinking is a problem | .92*** | – | ||||||
3. Drinking is a problem for others | .47*** | .51*** | – | |||||
4. Effort | .49*** | .46*** | .33*** | – | ||||
5. Severity of discrepancy | –.26* | –.29** | –.18 | –.16 | – | |||
Post-NF Variables | ||||||||
6. Surprise | –.15 | –.39*** | –.15 | –.14 | .55*** | – | ||
7. Worry | .28** | .47*** | –.15 | .28** | .03 | –.07 | – | |
8. Belief in the accuracy of NF | .20 | .34** | –.15 | –.20 | –.37*** | –.60*** | .18 | – |
9. Plan for changea | .42*** | .47*** | .26* | .21 | –.10 | –.21 | .58*** | .32** |
Notes.
p < .05.
p < .01.
p < .001.
Ranged from 0 to 3, with 0 indicating no plan for change and 3 indicating quitting drinking.
- NF
- normative feedback
Drinking is a problem prior to NF was significantly and strongly correlated with plan for change (Table 3), such that the greater the participant ranked drinking is a problem, the more ambitious the plan for reduced drinking.
Total effect of severity of discrepancy on plan for change
There was no total effect of severity of discrepancy on plan for change (b = .003, SE = .01, p = .79).
Mediation models for personal dissonance (worry and surprise)
Table 4 displays the relationships of the mediation models. There were no significant indirect effects for either worry or surprise on plan for change. For this sample, personal dissonance did not mediate the effect of severity of discrepancy on making a plan for change.
Table 4. Mediation models for worry, surprise, and perceived accuracy of feedback predicting plan to change drinking.
Outcome variable | ||||||||
---|---|---|---|---|---|---|---|---|
Mediator | Plan to change drinking | |||||||
Coeff | SE | P | Coeff | SE | P | |||
Model 1 | ||||||||
X (Severity of discrepancy) | a | .003 | .01 | .79 | c′ | .004 | .003 | .19 |
M (Worry) | – | – | – | b | .21 | .03 | <.001 | |
R2 = .001F(1, 85) = 0.07, p = .79 | R2 = 0.35F(2, 84) = 22.8, p < .001 | |||||||
Model 2 | ||||||||
X (Severity of discrepancy) | a | .06 | .01 | <.001 | c′ | –.001 | .01 | .82 |
M (surprise) | – | – | – | b | .08 | .05 | .09 | |
R2 = .30F(1, 84) = 35.9, p < .001 | R2 = 0.04F(2, 83) = 1.9, p = .16 | |||||||
Model 3 | ||||||||
X (Severity of discrepancy) | a | –.02 | .01 | <.001 | c′ | –.001 | .004 | .84 |
M (Perceived accuracy) | – | – | – | b | –.22 | .07 | <.01 | |
R2 = .13F(1, 85) = 13.0, p < .001 | R2 = 0.11F(2, 84) = 4.9, p < .001 |
Mediation models for belief in the accuracy of NF
Table 4 also shows the results from the mediation model for belief in the accuracy of feedback. Severity of discrepancy was significantly negatively associated with belief in the accuracy of feedback. There was a significant indirect effect for belief in the accuracy of feedback (.004, 95% CI [.001–.01]). The kappa-squared statistic revealed that the indirect effect is 11.6% of its maximum possible value (K2 = .116, SE = .06, 95% CI [.03–.25]).
Post hoc analyses
Since this was a sample of mostly light to moderate drinkers, rather than predominantly hazardous drinkers, it was surprising to discover such a large proportion of them (26.4%) reported planning at least some change in their drinking. Due to the absence of a relationship between plan for change and severity of discrepancy, it is possible that other baseline variables impact plan for change. Given the relationship between pre-NF drinking is a problem to post-NF plan for change, post hoc analyses were implemented to further explore this relationship. Drinking is a problem was independently tested as a predictor of plan for change using stepwise linear regression.
Pre-NF drinking is a problem significantly predicted plan to change (b = .24, SE = .05, p < .001). When post-NF worry was entered as a second step in the model, both remained significant (drinking is a problem: b = .24, SE = .05, p < .001; worry: b = .24, SE = .05, p < .001; adjusted R2 = .38; F(2, 84) = 26.8, p < .001), suggesting that both baseline perception that drinking is a problem and post-NF worry predict plan for change. Tolerance statistics demonstrated no multicollinear effect.
Discussion
This is the first study to test both personal dissonance and perceived accuracy of feedback as mechanisms of action within NF among adult drinkers outside the context of MET. Hypotheses that severity of discrepancy would be mediated by personal dissonance and belief in the accuracy of feedback were only partially supported. While the participants in this study were primarily light to moderate drinkers, a number of them greatly under-estimated their level of drinking compared to their same gendered peers, demonstrating a wide range of discrepancy. Still, severity of discrepancy was not associated with plan to change, which is inconsistent with previous studies on college students (Walters et al., 2009; Walters, Vader & Harris, 2007). Interestingly, findings were consistent with previous research on a sample of hazardous drinkers from the general population (Cunningham, Murphy & Hendershot, 2015). This recent study found that norm comparisons, provided in the context of more detailed personalized feedback, did not appear to be the active mechanism for change among a sample of adult hazardous drinkers (Cunningham, Murphy & Hendershot, 2015). It is possible that peer comparisons work especially well for individuals in their late adolescence and emerging adulthood because it leverages their particular need for conforming with peers’ behaviors. Given the lack of association between severity of discrepancy and plan for change, it also suggests that among a sample of mostly light to moderate drinkers, factual normative discrepancy does not act alone to instigate thoughts about change.
While there were few heavy drinkers in this sample, lack of findings regarding personal dissonance was consistent with previous studies on affective responses (Kuerbis et al., 2014; McNally, Palfai & Kahler, 2005) of heavy drinkers. According to evidence thus far, it appears that affective responses are not associated with outcomes of feedback among both college-age and an age-inclusive sample of adults with a spectrum of drinking patterns.
Perceived accuracy of feedback was demonstrated to be a potential mediator of severity of discrepancy, providing initial support for decision dilemma theory. Results suggest that the more an individual is aware of how much he or she drinks compared to others, the more likely he or she will perceive the feedback to be accurate and thus more likely to set a plan for change. Among this sample, this was true regardless of intensity of drinking. It is important to note that the mediation effect of belief in the accuracy of NF was quite small—only 11.6% of its possible maximum value. More research is needed to further understand this potential mediator of change.
Post hoc analyses support the possibility that feedback for drinkers may not operate to create concern about or awareness of excessive drinking where none existed. Instead, it seems to potentially capitalize on a pre-existing perception that drinking is a problem, particularly among those who may drink more heavily. Some studies demonstrate NF works best for those with the most severe drinking patterns (Murphy et al., 2001; Doumas & Andersen, 2009). It is therefore possible that feedback works within a framework of consonance rather than dissonance. This may explain why a “boomerang effect,” an effect in which light drinkers who receive feedback about their drinking increase instead of decrease their drinking (Prince et al., 2014), has yet to be found within the empirical literature. Furthermore, given the correlational relationships, perceiving alcohol is a problem may also indicate an awareness of one’s drinking and already how it compares to existing norms.
Given that NF is one of the most widely used interventions to prevent and/or reduce hazardous drinking, the above findings have potentially important implications for application to clinical practice. When implementing NF to an adult sample, providers should be aware of both the existing concerns and perceptions a drinker may have, as well as how believable the information imparted is for the recipient. Inquiring about a patient’s drinking and their perception of its role in his or her life a priori may help providers navigate providing feedback in an optimal way. For example, there may be little need to offer much additional feedback when one already perceives their drinking as problematic. Instead, offering an opportunity to explore goal planning and/or treatment may be the best use of a clinician’s time. For those who do not perceive their drinking as problematic, feedback interventions may be best improved by increasing the credibility of the feedback for the individual. By being selective in how one provides feedback, providers may enhance its effectiveness.
Limitations
There are several limitations to this study, and findings should be interpreted in the context of an exploratory pilot study. While this study demonstrated the feasibility of measuring affective responses and belief in the accuracy of feedback post-NF, generalizability is extremely limited. These participants were recruited from an online labor market, not the general population. The measurement of belief in the accuracy of feedback was simple in that it was a single item, self-report measure; however, it had face validity in that it captured the participant’s perception rather than behavior, which was the specific construct of interest. A major limitation of this study is that there were few individuals who were heavy or hazardous drinkers, in terms of quantity of standard drinks per week, and thus results cannot be generalized to hazardous drinkers. More research on understanding this relationship with hazardous drinkers is needed; however, the greater variability in the sample allowed us to understand feedback in a heterogeneous drinking sample, such as those found in primary care or other opportunistic settings, in which NF is often used preventively.
Drinking was entirely self-report and could not be corroborated by other sources. Outcomes were based on intention to change health behaviors, not actual behavior change. While other studies have used a similar outcome, it is not equivalent to behavior. Finally, it is not known whether personal dissonance is experienced only in a proximal fashion. For example, a person who receives feedback may not initially experience worry but may find his or her concern grows over a period of time. This potential sleeper effect of NF could in turn potentially affect the timing of making a plan for change. Longitudinal research is needed to better understand the timing of potential mediators and subsequent behavioral outcomes.
Future research
Future research could include experimental manipulation with better operationalization of normative feedback, self-ideal feedback and emotional responses in order to unpack the active ingredients of NF. Expanding the population upon which NF is tested to heavy drinkers and other undesirable health behaviors will be crucial to confirming these preliminary findings. Additionally, both actual behavioral outcomes and longer term, prospective perceptions of feedback must be explored to understand the mechanisms of maintenance of behavior change.
Conclusions
Despite the limitations, findings have the potential for immediate clinical application, and thus implications for individual and population level health. For individuals with a skewed perception of how much they drink compared to their peers, helping them to understand NF in context and making it believable (e.g., supported by empirical data) may be critical for maximum effectiveness of NF among adults. In addition, exploring with drinkers how much they are already perceive their drinking to be a problem may help to potentiate the effects of the simplest form of NF. These are relatively minor and feasible changes to NF that may in fact help to increase its efficacy rate, potentially helping to reduce the prevalence rate of hazardous alcohol use or prevent the development of AUD across a wide group of drinkers.
Supplemental Information
Funding Statement
This work was funded by the National Institute on Alcohol Abuse and Alcoholism, in the United States, Grant R34 AA 021502A (PI: Muench). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Additional Information and Declarations
Competing Interests
Frederick J. Muench is an Academic Editor for PeerJ.
Author Contributions
Alexis Kuerbis conceived and designed the experiments, performed the experiments, analyzed the data, contributed reagents/materials/analysis tools, wrote the paper, prepared figures and/or tables, reviewed drafts of the paper.
Frederick J. Muench conceived and designed the experiments, performed the experiments, analyzed the data, contributed reagents/materials/analysis tools, wrote the paper, reviewed drafts of the paper.
Rufina Lee and Juan Pena analyzed the data, wrote the paper, reviewed drafts of the paper.
Lisa Hail performed the experiments, wrote the paper, reviewed drafts of the paper.
Human Ethics
The following information was supplied relating to ethical approvals (i.e., approving body and any reference numbers):
Hunter College IRB reviewed this project. It was deemed exempt for human subjects research because no identifying information was collected about our subjects.
Data Availability
The following information was supplied regarding data availability:
The raw data has been supplied as a Supplemental Dataset.
References
- Amrhein et al. (2003).Amrhein PC, Miller WR, Yahne CE, Palmer M, Fulcher L. Client commitment language during motivational interviewing predicts drug use outcomes. Journal of Consulting and Clinical Psychology. 2003;71(5):862–878. doi: 10.1037/0022-006X.71.5.862. [DOI] [PubMed] [Google Scholar]
- Arvantes (2010).Arvantes J. Health care reform law will increase demand for preventive services, say experts AAFP News. 2010. Available at http://www.aafp.org/news/government-medicine/20100728hcreformprevent.html (accessed 13 April 2016)
- Borsari & Carey (2000).Borsari B, Carey KB. Effects of a brief motivational intervention with college student drinkers. Journal of Consulting and Clinical Psychology. 2000;68(4):728–733. doi: 10.1037/0022-006X.68.4.728. [DOI] [PubMed] [Google Scholar]
- Bowen (1987).Bowen MG. The escalation phenomenon reconsidered: decision dilemmas or decision errors? Academy of Management Review. 1987;12:52–66. doi: 10.5465/AMR.1987.4306470. [DOI] [Google Scholar]
- Cadigan et al. (2015).Cadigan JM, Haeny AM, Martens MP, Weaver CC, Takamatsu SK, Arterberry BJ. Personalized drinking feedback: a meta-analysis of in-person versus computer-delivered interventions. Journal of Consulting and Clinical Psychology. 2015;83(2):430–437. doi: 10.1037/a0038394. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Collins, Carey & Sliwinski (2002).Collins SE, Carey KB, Sliwinski MJ. Mailed personalized normative feedback as a brief intervention for at-risk college drinkers. Journal of Studies on Alcohol. 2002;63:559–567. doi: 10.15288/jsa.2002.63.559. [DOI] [PubMed] [Google Scholar]
- Cunningham, Murphy & Hendershot (2015).Cunningham J, Murphy M, Hendershot CS. Treatment dismantling pilot study to identify the active ingredients in personalized feedback interventions for hazardous alcohol use: randomized controlled trial. Addiction Science & Clinical Practice. 2015;10:1–5. doi: 10.1186/s13722-014-0022-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cunningham et al. (2012).Cunningham JA, Neighbors C, Wild C, Humphreys K. Ultra-brief intervention for problem drinkers: results from a randomized controlled trial. PLoS ONE. 2012;7(10):e2114. doi: 10.1371/journal.pone.0048003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cunningham et al. (2001).Cunningham J, Wild TC, Bondy SJ, Lin E. Impact of normative feedback on problem drinkers: a small-area population study. Journal of Studies in Alcohol. 2001;62:228–233. doi: 10.15288/jsa.2001.62.228. [DOI] [PubMed] [Google Scholar]
- Cunningham et al. (2009).Cunningham JA, Wild TC, Cordingley J, Van Mierlo T, Humphreys K. A randomized controlled trial of an internet-based intervention for alcohol abusers. Addiction. 2009;104(12):2023–2032. doi: 10.1111/j.1360-0443.2009.02726.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cunningham et al. (2010).Cunningham J, Wild TC, Cordingley J, Van Mierlo T, Humphreys K. Twelve-month follow up results from a randomized controlled trial of a brief personalized feedback intervention for problem drinkers. Alcohol and Alcoholism. 2010;45:258–262. doi: 10.1093/alcalc/agq009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dotson, Dunn & Bowers (2015).Dotson KB, Dunn ME, Bowers CA. Stand-alone personalized normative feedback for college student drinkers: a meta-analytic review, 2004 to 2014. PLoS ONE. 2015;10(10):e2114. doi: 10.1371/journal.pone.0139518. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Doumas & Andersen (2009).Doumas DM, Andersen LL. Reducing alcohol use in first-year university students: evaluation of a web-based personalized feedback program. Journal of College Counseling. 2009;12(1):18–32. doi: 10.1002/j.2161-1882.2009.tb00037.x. [DOI] [Google Scholar]
- Doumas & Hannah (2008).Doumas DM, Hannah E. Preventing high-risk drinking in youth in the workplace: a web-based normative feedback program. Journal of Substance Abuse Treatment. 2008;34:263–271. doi: 10.1016/j.jsat.2007.04.006. [DOI] [PubMed] [Google Scholar]
- Erikson (1968).Erikson EH. Identity: youth and crisis. Norton; New York: 1968. [Google Scholar]
- Foxcroft et al. (2015).Foxcroft DR, Moreira MT, Almeida Santimano NM, Smith LA. Social norms information for alcohol misuse in university and college students. The Cochrane Database of Systematic Reviews. 2015;1:CD006748. doi: 10.1002/14651858.CD006748.pub3. [DOI] [PubMed] [Google Scholar]
- Gaume et al. (2014).Gaume J, McCambridge J, Bertholet N, Daeppen JB. Mechanisms of action of brief alcohol interventions remain largely unknown—a narrative review. Frontiers in Psychiatry. 2014;5:1–9. doi: 10.3389/fpsyt.2014.00108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hantula & DeNicolis Bragger (1999).Hantula DA, DeNicolis Bragger JL. The effects of feedback equivocality on escalation of commitment: an empirical investigation of decision dilemma theory. Journal of Applied Social Psychology. 1999;29(2):424–444. doi: 10.1111/j.1559-1816.1999.tb01395.x. [DOI] [Google Scholar]
- Hayes (2013).Hayes AF. Introduction to mediation, moderation, and conditional process analysis: a regression based approach. The Guilford Press; New York: 2013. [Google Scholar]
- Hester & Delaney (1997).Hester R, Delaney HD. Behavioral self control program for windows: results of a controlled clinical trial. Journal of Consulting and Clinical Psychology. 1997;65(4):686–693. doi: 10.1037/0022-006X.65.4.686. [DOI] [PubMed] [Google Scholar]
- IBM Corp. (2013).IBM Corp . IBM SPSS statistics for windows. IBM Corp; Armonk: 2013. [Google Scholar]
- Kuerbis et al. (2014).Kuerbis A, Schaumberg K, Davis CM, Hail L, Morgenstern J. Unpacking personalized feedback: an exploratory study of the impact of its components and the reactions it elicits among problem drinking men who have sex with men. Substance Use and Misuse. 2014;49(4):383–394. doi: 10.3109/10826084.2013.841247. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Larimer et al. (2007).Larimer ME, Lee CM, Kilmer JR, Fabiano PM, Stark CB, Geisner IM, Mallett KA, Lostutter TW, Cronce JM, Feeney M, Neighbors C. Personalized mailed feedback for college drinking prevention: a randomized clinical trial. Journal of Consulting and Clinical Psychology. 2007;75(2):285–293. doi: 10.1037/0022-006X.75.2.285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Maisto et al. (2001).Maisto SA, Conigliaro J, McNeil M, Kraemer K, Conigliaro RL, Kelley ME. Effects of two types of brief intervention and readiness to change on alcohol use in hazardous drinkers. Journal of Studies on Alcohol. 2001;62(5):605–614. doi: 10.15288/jsa.2001.62.605. [DOI] [PubMed] [Google Scholar]
- Mason & Suri (2012).Mason W, Suri S. Conducting behavioral research on Amazon’s mechanical turk. Behavior Research Methods. 2012;44(1):1–23. doi: 10.3758/s13428-011-0124-6. [DOI] [PubMed] [Google Scholar]
- McCambridge & Cunningham (2014).McCambridge J, Cunningham JA. The early history of ideas on brief interventions for alcohol. Addiction. 2014;109(4):538–546. doi: 10.1111/add.12458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McNally, Palfai & Kahler (2005).McNally AM, Palfai TP, Kahler CW. Motivational intervenitons for heavy drinking college students: examining the role of discrepancy-related psychological processes. Psychology of Addictive Behaviors. 2005;19(1):79–87. doi: 10.1037/0893-164X.19.1.79. [DOI] [PubMed] [Google Scholar]
- Miller, Benefield & Tonigan (1993).Miller WR, Benefield R, Tonigan JS. Enhancing motivation for change in problem drinking: a controlled comparison of two therapist styles. Journal of Consulting and Clinical Psychology. 1993;61(3):455–461. doi: 10.1037/0022-006X.61.3.455. [DOI] [PubMed] [Google Scholar]
- Miller & Del Boca (1994).Miller WR, Del Boca FK. Measurement of drinking behavior using the Form 90 family of instruments. Journal of Studies on Alcohol. 1994;Suppl. 12:112–118. doi: 10.15288/jsas.1994.s12.112. [DOI] [PubMed] [Google Scholar]
- Miller et al. (2013).Miller MB, Leffingwell T, Claborn K, Meier E, Walters S, Neighbors C. Personalized feedback interventions for college alcohol misuse: an update of Walters & Neighbors (2005) Psychology of Addictive Behaviors. 2013;27(4):909–920. doi: 10.1037/a0031174. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Miller & Rollnick (2002).Miller WR, Rollnick S. Motivational interviewing: preparing people for change. 2nd edition The Guilford Press; New York: 2002. [Google Scholar]
- Miller et al. (1999).Miller WR, Zweben A, DiClemente CC, Rychtarik RG. Motivational enhancement therapy manual: a clinical research guide for therapists treating individuals with alcohol abuse and dependence. National Institute for Alcohol Abuse and Alcoholism; Rockville: 1999. [Google Scholar]
- Muench et al. (2014).Muench F, Van Stolk-Cooke K, Morgenstern J, Kuerbis A, Markle K. Understanding messaging preferences to inform development of mobile goal-directed behavioral interventions. Journal of Medical Internet Research. 2014;16(1):e2114. doi: 10.2196/jmir.2945. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murphy et al. (2004).Murphy JG, Benson TA, Vuchinich RE, Deskins MM, Eakin D, Flood AM, McDevitt-Murphy ME, Torrealday O. A comparison of personalized feedback for college student drinkers delivered with and without a motivational interview. Journal of Studies in Alcohol. 2004;65:200–203. doi: 10.15288/jsa.2004.65.200. [DOI] [PubMed] [Google Scholar]
- Murphy et al. (2010).Murphy JG, Dennhardt AA, Skidmore JR, Martens MP, McDevitt-Murphy ME. Computerized versus motivational interviewing alcohol interventions: impact on discrepancy, motivation, and drinking. Psychology of Addictive Behaviors. 2010;24(4):628–639. doi: 10.1037/a0021347. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murphy et al. (2001).Murphy JG, Duchnick JJ, Vuchinich RE, Davison JW, Karg RS, Olson AM, Smith AF, Coffey TT. Relative efficacy of a brief motivational intervention for college student drinkers. Psychology of Addictive Behaviors. 2001;15(4):373–379. doi: 10.1037/0893-164X.15.4.373. [DOI] [PubMed] [Google Scholar]
- National Institute on Alcohol Abuse and Alcoholism (2013).National Institute on Alcohol Abuse and Alcoholism Rethinking drinking. Author; Bethesda: 2013. [Google Scholar]
- Neal & Carey (2004).Neal DJ, Carey KB. Developing discrepancy within self-regulation theory: use of personalized normative feedback and personal strivings with heavy-drinking college students. Addictive Behaviors. 2004;29:281–297. doi: 10.1016/j.addbeh.2003.08.004. [DOI] [PubMed] [Google Scholar]
- Neighbors, Larimer & Lewis (2004).Neighbors CJ, Larimer ME, Lewis MA. Targeting misperceptions of descriptive drinking norms: efficacy of a computer-delivered personalized normative feedback intervention. Journal of Consulting and Clinical Psychology. 2004;72(3):434–447. doi: 10.1037/0022-006X.72.3.434. [DOI] [PubMed] [Google Scholar]
- Neighbors et al. (2016).Neighbors C, Lewis MA, LaBrie J, DiBello AM, Young CM, Rinker DV, Litt D, Rodriguez LM, Knee CR, Hamor E, Jerabeck JM, Larimer ME. A multisite randomized trial of normative feedback for heavy drinking: social comparison versus social comparison plus correction of normative misperceptions. Journal of Consulting and Clinical Psychology. 2016;84(3):238–247. doi: 10.1037/ccp0000067. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Perkins (2003).Perkins HW. The emergence and evolution of the social norms approach to substance abuse prevention. In: Perkins HW, editor. The social norms approach to preventing school and college age substance abuse: a handbook for educators, counselors and clinicians. Jossey-Bass; San Francisco: 2003. [Google Scholar]
- Preacher & Kelley (2011).Preacher KJ, Kelley K. Effect size measures for mediation models: quantitative strategies for communicating indirect effects. Psychological Methods. 2011;16(2):93–115. doi: 10.1037/a0022658. [DOI] [PubMed] [Google Scholar]
- Prince et al. (2014).Prince MA, Reid A, Carey KB, Neighbors C. Effects of normative feedback for drinkers who consume less than the norm: dodging the boomerang. Psychology of Addictive Behaviors. 2014;28(2):538–544. doi: 10.1037/a0036402. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Reid & Carey (2015).Reid AE, Carey KB. Interventions to reduce college student drinking: state of the evidence for mechanisms of behavior change. Clinical Psychology Review. 2015;40:213–224. doi: 10.1016/j.cpr.2015.06.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Riper et al. (2009).Riper H, Van Straten A, Keuken M, Smit F, Schippers G, Cuijpers P. Curbing problem drinking with personalized-feedback interventions: a meta-analysis. American Journal of Preventive Medicine. 2009;36(3):247–255. doi: 10.1016/j.amepre.2008.10.016. [DOI] [PubMed] [Google Scholar]
- Rosenberg (1993).Rosenberg H. Prediction of controlled drinking by alcoholics and problem drinkers. Psychological Bulletin. 1993;113(1):129–139. doi: 10.1037/0033-2909.113.1.129. [DOI] [PubMed] [Google Scholar]
- Substance Abuse and Mental Health Services Administration (2010).Substance Abuse and Mental Health Services Administration Results from the 2009 national survey on drug use and health: summary of national findings, NSDUH series H-38A, HHS publication no. (SMA) 10-4856. Substance Abuse and Mental Health Services Administration; Rockville: 2010. [Google Scholar]
- Substance Abuse and Mental Health Services Administration (2014).Substance Abuse and Mental Health Services Administration Results from the 2013 national survey on drug use and health: summary of national findings, NSDUH series H-48, HHS publication no. (SMA) 14-4863. Substance Abuse and Mental Health Services Administration; Rockville: 2014. [Google Scholar]
- Walters & Neighbors (2005).Walters ST, Neighbors C. Feedback interventions for college alcohol misuse: what, why, and for whom? Addictive Behaviors. 2005;30:1168–1182. doi: 10.1016/j.addbeh.2004.12.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walters, Vader & Harris (2007).Walters ST, Vader AM, Harris TR. A controlled trial of web-based feedback for heavy drinking college students. Prevention Science. 2007;8(1):83–88. doi: 10.1007/s11121-006-0059-9. [DOI] [PubMed] [Google Scholar]
- Walters et al. (2009).Walters ST, Vader AM, Harris TR, Field C, Jouriles EN. Dismantling motivational interviewing and feedback for college drinkers: a randomized clinical trial. Journal of Consulting and Clinical Psychology. 2009;77(1):64–77. doi: 10.1037/a0014472. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Walters & Woodhall (2003).Walters ST, Woodhall WG. Mailed feedback reduces consumption among moderate drinkers who are employed. Prevention Science. 2003;4(4):287–294. doi: 10.1023/A:1026024400450. [DOI] [PubMed] [Google Scholar]
- White (2006).White HR. Reduction of alcohol-related harm on United States college campuses: the use of personal feedback interventions. International Journal of Drug Policy. 2006;17:310–319. doi: 10.1016/j.drugpo.2006.02.006. [DOI] [Google Scholar]
- White et al. (2007).White HR, Mun EY, Pugh L, Morgan T. Long-term effects of brief substance use interventions for mandated college students: sleeper effects of an in-person personal feedback intervention. Alcoholism: Clinical and Experimental Research. 2007;31(8):1380–1391. doi: 10.1111/j.1530-0277.2007.00435.x. [DOI] [PubMed] [Google Scholar]
- World Health Organization. (2014).World Health Organization Global status report on alcohol and health 2014. World Health Organization; Geneva: 2014. [Google Scholar]
- Zimmerman & Fischhoff (2014).Zimmerman D, Fischhoff B. Thesis. 2014. A corrective meta-analysis of personalized normative feedback. http://repository.cmu.edu/hsshonors/226/ [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The following information was supplied regarding data availability:
The raw data has been supplied as a Supplemental Dataset.