Abstract
Background
Alcohol is responsible for a large and growing proportion of the global burden of disease, as well as being the cause of social problems. Brief interventions are one component of comprehensive policy measures necessary to reduce these harms. Brief interventions increasingly take advantage of the Internet to reach large numbers of high risk groups such as students. The research literature on the efficacy and effectiveness of online interventions is developing rapidly. Although many studies show benefits in the form of reduced consumption, other intervention studies show no effects, for reasons that are unclear. Sweden became the first country in the world to implement a national system in which all university students are offered a brief online intervention via an e-mail.
Methods/Design
This randomized controlled trial (RCT) aims to evaluate the effectiveness of this national system comprising a brief online intervention among university students who are hazardous and harmful drinkers. This study employs a conventional RCT design in which screening to determine eligibility precedes random allocation to immediate or delayed access to online intervention. The online intervention evaluated comprises three main components; assessment, normative feedback and advice on reducing drinking. Screening is confined to a single question in order to minimise assessment reactivity and to prevent contamination. Outcomes will be evaluated after 2 months, with total weekly alcohol consumption being the primary outcome measure. Invitations to participate are provided by e-mail to approximately 55,000 students in 9 Swedish universities.
Discussion
This RCT evaluates routine service provision in Swedish universities via a delay in offer of intervention to the control group. It evaluates effects in the key population for whom this intervention has been designed. Study findings will inform the further development of the national service provision.
Trial registration
Background
Alcohol is responsible for a large and growing proportion of the global burden of disease, as well as being the cause of social problems. In 2010 it was estimated to cause 5.5% of the total burden and approximately 5 million deaths globally in that year, an increase of approximately one third since 1990 [1]. Existing evidence suggests the optimal strategy for reducing societal alcohol problems is to combine population-level interventions that seek to influence the price, availability and cultural acceptability of hazardous and harmful drinking in concert with individual-level brief interventions delivered in health systems and elsewhere [2,3]. This combination should be expected to produce multi-level benefits, and the dissemination of brief interventions has a key role to play in enhancing public understanding of the nature of alcohol problems, which is very weak. Face-to-face brief interventions are typically offered opportunistically by non-specialists in routine contacts with patients attending health care services and take only a few minutes to deliver [2,4].
Evidence for the efficacy of brief interventions is based on randomized controlled trials and systematic reviews, which have consistently identified small effects on drinking behaviour [5-8]. National programmes have been slow to be implemented as there have been persistent doubts about the strength of this evidence, and the potential contribution to public health. Not unrelatedly, there have been longstanding difficulties in persuading generic health and welfare practitioners to embrace this work in routine practice [9,10]. In the era of the internet there are now other ways to reach large numbers of hazardous and harmful drinkers which overcome implementation problems due to practitioner reluctance to discuss drinking [9].
Online interventions may be more cost-effective than face-to-face interventions. The expectation is that they are both less costly and less effective than face-to face interventions [11]. It also seems likely that face-to-face interventions may be necessary for those with more severe problems and difficulties in changing behaviours and that it will be necessary to develop intervention programmes that combine both elements. Internet interventions may also be more acceptable to those targeted, though this will not be important to public health unless they can also be demonstrated to be effective and cost-effective [12,13].
The research literature on the efficacy and effectiveness of online interventions is developing rapidly. Systematic reviews provide preliminary evidence of efficacy for a range of computerised interventions [11,14,15], though there are also examples of apparently well designed interventions (e.g. [16]) not being found to be effective [17]. So, although many studies show benefits in the form of reduced consumption, other intervention studies show no effects, for reasons that are unclear [18,19].
Many existing computerised brief intervention studies target university student populations [15]. Heavy drinking among university students is a global phenomenon [20-22], and is particularly well established in countries with cultures and traditions of heavy drinking. There are now effectiveness reviews of normative feedback and similar interventions delivered face to face and online among students [11,23,24]. Many previous studies have, however, evaluated computerised rather than online interventions, requiring participants to attend laboratories or similar settings [14,15,19].
Kypri and colleagues randomised 2,435 hazardous and harmful drinkers in one Australian university in the THRIVE trial evaluating an online intervention [25]. This intervention achieved a 17% reduction in alcohol consumption in an online assessment and feedback group compared to a non-intervention assessment-only group, which subsequently attenuated to an 11% difference after 6 months [25]. Kypri and colleagues also undertook the eSBINZ trials in 7 universities in New Zealand among Maori and non-Maori students respectively [12]. Similar effects to that seen in THRIVE were obtained among Maori students [26], though effects among non-Maori students were smaller.
Swedish students drink alcohol heavily [21,27] and Swedish universities accept a duty of care in relation to drinking among their students, which has obvious consequences for the fulfilment of their educational function within society. An online intervention originally developed by the Lifestyle Intervention Research group at Linköping University [28] has now been adopted as the basis for a national system. This made Sweden the first country in the world to implement any national system devoted to addressing student drinking. This intervention is based upon an initial e-mail to students from the student healthcare service, providing a link to a website for assessment and feedback. The core content involves assessment, feedback on recommended limits of alcohol consumption and normative comparisons of drinking with Swedish students of the same age and sex and tailored advice.
The first trial of this intervention found no differences between brief and more extensive normative feedback content though attrition problematically reduced available sample size in a feasibility study [29]. We then undertook a further trial as a large pilot study with outcome data provided by 2,400 students [30]. This pilot study successfully employed incentives to enhance follow-up rates on the previous trial, though attrition was highly differential between-groups, with the non-intervention control group approximately 10% more likely to participate, not having previously received an e-mail relating to alcohol in contrast to two other randomised groups [30]. These data informed the design of the AMADEUS-1 trial, a study with a range of unconventional characteristics intended to a address various methodological weaknesses and unresolved design questions in this field [31].
A key issue which has presented difficulties is the determination of the most appropriate control groups, due largely to overlap and similarities between content integral to interventions based on assessment and feedback and research assessments [32,33]. Content similarities and overlap entail contamination, as the control group is exposed to the intervention content whose effects are being evaluated [34], and this applies to relatively brief screening tools, such as the 10-item AUDIT (Alcohol Use Disorders Identification Test) alcohol screening questionnaire [35], as well as lengthier assessments [36]. Brief intervention researchers have long been interested in the possibility that assessment of alcohol consumption per se can reduce drinking [5,33,37]. Observed mean reductions in drinking in non-intervention control groups in brief intervention trials are approximately 20% at later follow-ups [38,39]. A systematic review of randomized evaluations of assessment reactivity in brief intervention studies found evidence of small effects [40]. When attention was restricted to university student populations, however, somewhat more consistent and stronger effects were apparent [40]. If simply by answering questions on one’s drinking, however, does subsequently lead to reduced drinking, large-scale implementation of simple screening surveys as interventions among university students might have a considerable public health potential [28,33].
These considerations led to the AMADEUS-1 trial. This study randomised e-mail addresses and employed a no contact control group, without any screening or selection of participants according to alcohol risk status. All participants were blind to trial participation at all stages of the study. Outcome evaluation was via a seemingly unrelated 15- item cross-sectional lifestyle survey containing trial outcomes derived from 3 items [31]. The use of deception in this study requires justification and we offer this elsewhere [41]. In a universal prevention approach, some evidence of benefit was found for an assessment only group, with no additional benefit of feedback (though there was some per protocol evidence for this) [42]. This study adds to existing evidence of problems with screening and assessing control groups in conventional trial designs in this area. With this design the AMADEUS-1 trial was unable to provide an intention-to-treat evaluation of possible effects among hazardous and harmful drinkers, the key target group, and was reliant on a per-protocol analysis for determination of effects in this group. AMADEUS-2 thus aims to provide an evaluation of online assessment and feedback intervention effects among hazardous and harmful drinkers among the Swedish university student population.
Methods/Design
This is a two-arm parallel groups trial in which routine provision of online assessment and feedback intervention (Group 1) is compared with non-intervention (Group 2) by delaying online access to intervention. In routine practice the timing of intervention delivery varies across Sweden and we take advantage of this lack of standardisation of timing to implement random allocation in this effectiveness evaluation study. This conventional trial design is informed by previous reactivity findings and identifies hazardous and harmful drinkers by means of a single screening question. Unlike the AMADEUS-1 trial, there is no blinding in this study. The study was approved by the Regional Ethical Committee in Linköping, Sweden (Number: 2013/46-31).
Participants & setting
The study is undertaken in 9 of the 26 student health care centres, each providing services to one university or college in Sweden. These institutions have been selected on the basis that they have not previously been involved in randomised controlled trials in our research programme. All students at the 9 colleges during the spring term (i.e. in terms 2, 4 and 6) were sent an e-mail inviting them to answer a single question about their drinking, and if eligible for trial participation, were provided with information permitting informed consent. The single question is the third item of the AUDIT questionnaire on the frequency of heavy episodic drinking [43]. Standalone single alcohol screening questions have been validated as identifying hazardous and harmful drinkers in different settings [44,45] and this type of drinking is particularly important in this population [21]. Students who were drinking more frequently than once per month 5 drinks [of 12 grams of alcohol] or more for men or 4 drinks or more for women are deemed eligible for trial participation. This approach was also used by Walters and colleagues [46] who were similarly concerned to avoid reactivity to screening.
Recruitment, randomisation and other study procedures
The initial e-mail is sent from the participating student health care services as usual, to approximately 54,000 e-mail addresses in total. The usual introductory text is altered so as to invite study participation. After screening positive and receiving study information, participants clicked on a button to provide informed consent and are immediately randomised to intervention or control conditions. The former group gain immediate access to the intervention and the latter group are advised that they will be able to access the intervention in two months. Two months later both groups are sent an identical e-mail by us. This reminds participants of the study and invites them to undertake the study follow-up to access the intervention. There are a total of four reminders (making five opportunities to respond in all), initially at weekly intervals, then at shorter intervals, with the final e-mail making clear that this is the last opportunity to respond, and allowing 2 days to do so. There are no incentives used to encourage study participation or retention.
Each participant is allocated numbers 1 or 2 following a uniform distribution. This is done using Java’s built in random number generator (java.util.Random). Randomisation is thus fully computerized, does not employ any strata or blocks, and is not possible to subvert, as this and all subsequent study processes are fully automated.
Intervention content
The intervention group receives feedback immediately upon completion of the assessment consisting of three statements summarizing their weekly consumption, their frequency of heavy episodic drinking and their highest blood alcohol concentration during the last four weeks, comparing drinking patterns against the safe drinking limits established by the Swedish Institute for Public Health [29]. After this follows comprehensive normative feedback with information describing participants’ alcohol use compared to their peers in Swedish universities, and, if applicable, personalized advice concerning the importance of reducing any unhealthy levels or pattern of consumption. The feedback can be printed out by the student. A demonstration version of the assessment and feedback intervention can be viewed at http://demo.livsstilstest.nu.
Sample size
The marginal costs involved in delivering online interventions to large numbers of participants in both routine practice and in R & D studies are low, and much lower than other brief interventions, after the developmental costs are met [47,48]. Therefore even very small effects are likely also to be highly cost effective above the basic threshold cost involved in providing the service. These observations lead us to believe that the sample should be as large as possible, in order to detect very small effects.
To assist study planning we undertook an illustrative power calculation. To detect an effect size of 0.1 standard deviations between the two groups with 5% significance level and 80% power, we required 1,600 individuals analysed per group. Assuming a follow-up rate of 50%, we should aim to recruit 3,200 individuals per group i.e. 6,400 in total. We had no data on the number of screen positives who may be willing to participate in this trial and assumed approxiamtely 70% would do so, meaning that we would need to identify approximately 8,000 hazardous and harmful drinkers. In order to identify these number of participants, e-mails could need be sent to approximately 40,000 students with an average response rate of 40% (i.e. n = 16,000) and a prevalence rate of 60% among responders (giving n = 9,600). We could not be confident of these estimates as, for example, patterns of e-mail address use vary considerably between colleges, being compulsory in some institutions and rarely used in others. We therefore decided to undertake the study in 9 colleges with a total student enrolment of approximately 54,000 students.
Outcome evaluation
This study uses a single 2 month follow-up interval, after which the control group will gain access to the intervention. The study thus provides information only on the short term effects of the intervention. If we find no short term effects, we will conclude the intervention will not have any long term effects.
The primary outcome is total weekly alcohol consumption. This is computed as the sum of alcohol consumption for each of the 7 days in a typical week. Secondary outcomes are the proportions still drinking above national guidelines [49], frequency of drinking (number of days per week), quantity of drinks per drinking day, frequency of heavy episodic drinking as defined in the screening question, highest estimated blood alcohol concentration (eBAC) and stage of change.
Statistical methods
As there is no research assessment at study entry, information on the sample at this point is restricted to university, term, time from sending of invitation email to consent, and (from the screening question) the frequency of heavy episodic drinking. At follow-up, we will have available additional information that is not possible, or not likely, to have been altered or altered differentially during the study period and which will therefore be treated as baseline information: age, gender, faculty, marital status and language used (Swedish or English). We also use measures of engagement with the study (mode of data collection, number of follow-up emails sent and elapsed time before follow-up was completed).
All outcomes will be compared between randomised groups under the intention-to-treat principle (that is, including all randomised individuals in their originally randomised groups). Continuous outcome measures will be assessed for skewness. If not skewed, they will be analysed by linear regression with results reported as a mean reduction. If skewed, they will either be log-transformed and analysed by linear regression [17], or analysed by negative binomial regression [25], and results will be reported as% reduction. Drinking above national guidelines will be analysed by logistic regression and reported as a% reduction in odds. Frequency of HED occasions will be analysed by ordered logistic regression and reported as a% reduction in odds for exceeding any level. All regression analyses will be first unadjusted and then adjusted for frequency of heavy episodic drinking at baseline, age, university, and gender, using the first two as continuous variables; the adjusted analysis will be primary.
Missing outcome data will be initially handled by a complete-cases analysis, which assumes that the data are missing at random. The plausibility of this analysis will be assessed by exploring the trend in outcomes across increasing numbers of follow-up emails, and a sensitivity analysis will use the repeated attempts model [50] which allows data to be missing not at random on the alternative assumption that the association between outcome and response is the same across follow-up emails.
Effect modification tests for frequency of heavy episodic drinking at baseline, age, university, and gender will be undertaken for the primary outcome only, using the first two as continuous variables.
Discussion
This RCT evaluates routine service provision in Swedish universities via a delay in offer of intervention to the control group, in common with other studies in the AMADEUS research programme. This delay raises ethical issues, though in this study there is no deception used as there was in the AMADEUS-1 trial [41], and the ethical issues associated with the delay are not viewed as challenging. This study evaluates effects in the key population for whom this intervention has been designed. Study findings will inform the further development of the national service provision. There are many well known reasons to identify and seize opportunities to undertake randomised studies as they provide more rigorous estimates of intervention effects than non-randomised studies. We suggest that they may be under-utilised in evaluations of existing services for which they can be useful in guiding further developments.
Abbreviations
AUDIT: Alcohol use disorders identification test.
Competing interests
PB and MB own a company that has developed the online intervention evaluated in this study and that develops and distributes computerised lifestyle interventions. Other authors have no relationships with any companies that might have an interest in the submitted work; our spouses, partners, or children have no financial relationships that may be relevant to the submitted work; and we have no non-financial interests that may be relevant to the submitted work.
Authors’ contributions
JM and PB had the original idea for the study, obtained funding and led on its design. PB has overall responsibility for study implementation. MB does all computer programming associated both with interventions delivery and study data collection. IR led on statistical aspects of this study, with inputs from NK and JM. JM wrote the first draft of the study protocol to which all authors contributed. All authors read and approved the final manuscript.
Pre-publication history
The pre-publication history for this paper can be accessed here:
Contributor Information
Jim McCambridge, Email: Jim.McCambridge@lshtm.ac.uk.
Marcus Bendtsen, Email: marcus.bendtsen@liu.se.
Nadine Karlsson, Email: nadine.karlsson@liu.se.
Ian R White, Email: ian.white@mrc-bsu.cam.ac.uk.
Preben Bendtsen, Email: preben.bendtsen@liu.se.
Acknowledgements
The study was funded by the Swedish Council for Working Life and Social Research (FAS, in Swedish; Grant number 2010-0024) and by a Wellcome Trust Research Career Development fellowship in Basic Biomedical Science (WT086516MA) to JM.
References
- Lim SS. et al. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;13(9859):2224–2260. doi: 10.1016/S0140-6736(12)61766-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Room R, Babor T, Rehm J. Alcohol and public health. Lancet. 2005;13:519–530. doi: 10.1016/S0140-6736(05)17870-2. [DOI] [PubMed] [Google Scholar]
- Babor T, Caetano R, Casswell S, Alcohol, No Ordinary Commodity: Research & Public Policy. Oxford: Oxford University Press; 2010. [Google Scholar]
- Nilsen P. et al. Brief interventions in routine health care: a population-based study of conversations about alcohol in Sweden. Addiction. 2011;13:1748–1756. doi: 10.1111/j.1360-0443.2011.03476.x. [DOI] [PubMed] [Google Scholar]
- Bien TH, Miller WR, Tonigan SJ. Brief interventions for alcohol problems: a review. Addiction. 1993;13:315–336. doi: 10.1111/j.1360-0443.1993.tb00820.x. [DOI] [PubMed] [Google Scholar]
- Bertholet N. et al. Reduction of alcohol consumption by brief alcohol intervention in primary care: systematic review and meta-analysis. Arch Intern Med. 2005;13(9):986–995. doi: 10.1001/archinte.165.9.986. [DOI] [PubMed] [Google Scholar]
- Kaner EF. et al. The effectiveness of brief alcohol interventions in primary care settings: a systematic review. Drug Alcohol Rev. 2009;13(3):301–323. doi: 10.1111/j.1465-3362.2009.00071.x. [DOI] [PubMed] [Google Scholar]
- Moyer A. et al. Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment-seeking and non-treatment-seeking populations. Addiction. 2002;13:279–292. doi: 10.1046/j.1360-0443.2002.00018.x. [DOI] [PubMed] [Google Scholar]
- Nilsen P. Brief alcohol intervention–where to from here? Challenges remain for research and practice. Addiction. 2010;13(6):954–959. doi: 10.1111/j.1360-0443.2009.02779.x. [DOI] [PubMed] [Google Scholar]
- Heather N. The public health and brief interventions for excessive alcohol consumption: the British experience. Addict Behav. 1996;13(6):857–868. doi: 10.1016/0306-4603(96)00040-8. [DOI] [PubMed] [Google Scholar]
- Carey KB. et al. Face-to-face versus computer-delivered alcohol interventions for college drinkers: a meta-analytic review, 1998 to 2010. Clin Psychol Rev. 2012;13(8):690–703. doi: 10.1016/j.cpr.2012.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kypri K. et al. Web-based alcohol screening and brief intervention for Maori and non-Maori: the New Zealand e-SBINZ trials. BMC Public Health. 2010;13:781. doi: 10.1186/1471-2458-10-781. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murray E. et al. The DYD-RCT protocol: an on-line randomised controlled trial of an interactive computer-based intervention compared with a standard information website to reduce alcohol consumption among hazardous drinkers. BMC Public Health. 2007;13(1):306. doi: 10.1186/1471-2458-7-306. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rooke S. et al. Computer-delivered interventions for alcohol and tobacco use: a meta-analysis. Addiction. 2010;13(8):1381–90. doi: 10.1111/j.1360-0443.2010.02975.x. [DOI] [PubMed] [Google Scholar]
- Khadjesari Z. et al. Can stand-alone computer-based interventions reduce alcohol consumption? A systematic review. Addiction. 2011;13(2):267–82. doi: 10.1111/j.1360-0443.2010.03214.x. [DOI] [PubMed] [Google Scholar]
- Linke S. et al. Development of a psychologically enhanced interactive online intervention for hazardous drinking. Alcohol Alcohol. 2008;13(6):669–74. doi: 10.1093/alcalc/agn066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wallace P. et al. On-line randomized controlled trial of an internet based psychologically enhanced intervention for people with hazardous alcohol consumption. PLoS One. 2011;13(3):e14740. doi: 10.1371/journal.pone.0014740. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Murray E. et al. Methodological challenges in online trials. J Med Internet Res. 2009;13(1):e9. doi: 10.2196/jmir.1052. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cunningham JA, Kypri K, McCambridge J. The use of emerging technologies in alcohol treatment. Alcohol Res Health. 2011;13:320–326. [PMC free article] [PubMed] [Google Scholar]
- Dantzer C. et al. International study of heavy drinking: attitudes and sociodemographic factors in university students. J Am Coll Health. 2006;13(2):83–9. doi: 10.3200/JACH.55.2.83-90. [DOI] [PubMed] [Google Scholar]
- Wicki M, Kuntsche E, Gmel G. Drinking at European universities? A review of students’ alcohol use. Addict Behav. 2010;13(11):913–24. doi: 10.1016/j.addbeh.2010.06.015. [DOI] [PubMed] [Google Scholar]
- Ceballos NA, Czyzewska M, Croyle K. College drinking among Latinos(as) in the United States and Mexico. Am J Addict. 2012;13(6):544–9. doi: 10.1111/j.1521-0391.2012.00269.x. [DOI] [PubMed] [Google Scholar]
- Moreira MT, Smith LA, Foxcroft D. Social norms interventions to reduce alcohol misuse in university or college students. Cochrane Database Syst Rev. 2009;13:CD006748. doi: 10.1002/14651858.CD006748.pub2. [DOI] [PubMed] [Google Scholar]
- Carey KB. et al. Computer-delivered interventions to reduce college student drinking: a meta-analysis. Addiction. 2009;13(11):1807–19. doi: 10.1111/j.1360-0443.2009.02691.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kypri K. et al. Randomized controlled trial of proactive web-based alcohol screening and brief intervention for university students. Arch Intern Med. 2009;13(16):1508–14. doi: 10.1001/archinternmed.2009.249. [DOI] [PubMed] [Google Scholar]
- Kypri K. et al. Web-based alcohol intervention for Maori university students: double-blind, multi-site randomised controlled trial. Addiction. 2013;13:331–338. doi: 10.1111/j.1360-0443.2012.04067.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Andersson A. et al. Alcohol use among university students in Sweden measured by an electronic screening instrument. BMC Public Health. 2009;13:229. doi: 10.1186/1471-2458-9-229. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bendtsen P, Johansson K, Akerlind I. Feasibility of an email-based electronic screening and brief intervention (e-SBI) to college students in Sweden. Addict Behav. 2006;13(5):777–87. doi: 10.1016/j.addbeh.2005.06.002. [DOI] [PubMed] [Google Scholar]
- Ekman DS. et al. Electronic screening and brief intervention for risky drinking in Swedish university students–a randomized controlled trial. Addict Behav. 2011;13(6):654–9. doi: 10.1016/j.addbeh.2011.01.015. [DOI] [PubMed] [Google Scholar]
- Bendtsen P, McCambridge J, Bendtsen M, Karlsson N, Nilsen P. RCT of the effectiveness of proactive mail based alcohol Internet intervention with university students: dismantling the assessment and feedback components. J Med Internet Res. 2012;13(5):e142. doi: 10.2196/jmir.2062. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCambridge J. et al. Alcohol email assessment and feedback study dismantling effectiveness for university students (AMADEUS-1): study protocol for a randomized controlled trial. Trials. 2012;13(1):49. doi: 10.1186/1745-6215-13-49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bernstein JA, Bernstein E, Heeren TC. Mechanisms of change in control group drinking in clinical trials of brief alcohol intervention: implications for bias toward the null. Drug Alcohol Rev. 2010;13(5):498–507. doi: 10.1111/j.1465-3362.2010.00174.x. [DOI] [PubMed] [Google Scholar]
- McCambridge J. Research assessments: instruments of bias and brief interventions of the future? Addiction. 2009;13(8):1311–2. doi: 10.1111/j.1360-0443.2009.02684.x. [DOI] [PubMed] [Google Scholar]
- Kypri K. et al. Assessment may conceal therapeutic benefit: findings from a randomized controlled trial for hazardous drinking. Addiction. 2007;13(1):62–70. doi: 10.1111/j.1360-0443.2006.01632.x. [DOI] [PubMed] [Google Scholar]
- McCambridge J, Day M. Randomized controlled trial of the effects of completing the Alcohol Use Disorders Identification Test questionnaire on self-reported hazardous drinking. Addiction. 2008;13(2):241–248. doi: 10.1111/j.1360-0443.2007.02080.x. [DOI] [PubMed] [Google Scholar]
- Saunders JB. et al. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption - II. Addiction. 1993;13(6):791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x. [DOI] [PubMed] [Google Scholar]
- Clifford PR, Maisto SA. Subject reactivity effects and alcohol treatment outcome research. J Stud Alcohol. 2000;13(6):787–93. doi: 10.15288/jsa.2000.61.787. [DOI] [PubMed] [Google Scholar]
- Jenkins RJ, McAlaney J, McCambridge J. Change over time in alcohol consumption in control groups in brief intervention studies: systematic review and meta-regression study. Drug Alcohol Depend. 2009;13(1–2):107–14. doi: 10.1016/j.drugalcdep.2008.09.016. [DOI] [PubMed] [Google Scholar]
- Jenkins RJ, McAlaney J, McCambridge J. Change over time in alcohol consumption in control groups in brief intervention studies: Systematic review and meta-regression study (vol 100, pg 107, 2009) Drug Alcohol Depend. 2010;13(1–2):151–151. doi: 10.1016/j.drugalcdep.2008.09.016. [DOI] [PubMed] [Google Scholar]
- McCambridge J, Kypri K. Can simply answering research questions change behaviour? Systematic review and meta analyses of brief alcohol intervention trials. PLoS ONE. 2011;13(10):e23748. doi: 10.1371/journal.pone.0023748. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCambridge JK, Bendtsen P, Porter J. The use of deception in public health behavioural intervention trials: a case study of three online alcohol trials. Am J Bioeth. 2013;13(11):35–49. doi: 10.1080/15265161.2013.839751. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCambridge JBM, Karlsson N, White IR, Nilsen P, Bendtsen P. Alcohol assessment and feedback by e-mail for university students: main findings from the AMADEUS-1 randomised controlled trial. Br J Psychiatry. 2013. doi: 10.1192/bjp.bp.113.128660 PubMed PMID: 24072758. [DOI] [PMC free article] [PubMed]
- Babor TF, AUDIT - Alcohol Use Disorders Identification Test: Guidelines for Use in Primary Care. Geneva: World Health Organization; 2001. [Google Scholar]
- Canagasaby A, Vinson DC. Screening for hazardous or harmful drinking using one or two quantity-frequency questions. Alcohol & Alcoholism. 2005;13:208–213. doi: 10.1093/alcalc/agh156. [DOI] [PubMed] [Google Scholar]
- Johnson JA. et al. Use of AUDIT-based measures to identify unhealthy alcohol use and alcohol dependence in primary care: a validation study. Alcohol Clin Exp Res. 2013;13(Suppl 1):E253–9. doi: 10.1111/j.1530-0277.2012.01898.x. [DOI] [PubMed] [Google Scholar]
- Walters ST. et al. Reactivity to alcohol assessment measures: an experimental test. Addiction. 2009;13(8):1305–10. doi: 10.1111/j.1360-0443.2009.02632.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- McCambridge J. et al. How big is the elephant in the room?Estimated and actual IT costs in an online behaviour change trial. BMC Res Notes. 2010;13:172. doi: 10.1186/1756-0500-3-172. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bray JW. et al. Costs of alcohol screening and brief intervention in medical settings: a review of the literature. J Stud Alcohol Drugs. 2012;13(6):911–9. doi: 10.15288/jsad.2012.73.911. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Andréasson S, Allebeck P. Alcohol and Health Alkohol och Hälsa. Stockholm, Sweden: The Swedish National Institute of Public Health; 2005. ISBN; 91-7257337-6. [Google Scholar]
- Jackson D, White IR, Leese M. How much can we learn about missing data? An exploration of a clinical trial in psychiatry. J R Stat Soc. 2010;13:593–612. doi: 10.1111/j.1467-985X.2009.00627.x. [DOI] [PMC free article] [PubMed] [Google Scholar]