Abstract
Background
Brief interventions have well-established small effects on alcohol consumption among hazardous and harmful drinkers in primary care, and national large-scale programmes are being implemented in many countries for public health reasons.
Methods
This paper examines data from reviews and draws upon older brief intervention studies and recent developments in the literature on motivational interviewing to consider the capacity of brief interventions to benefit those with problems, including those with severe problems.
Results
Effects on alcohol problems have been shown much less consistently, and evidence cannot be claimed to be strong for any outcomes other than reduced consumption. Combinations of advice and motivational interviewing are a promising target for evaluation in trials, and more detailed studies of the conduct of brief interventions are needed.
Conclusions
We propose that brief interventions in primary care may be more effective if they offer appropriate content in a person-centred manner, addressing patient concerns more directly.
Keywords: Alcohol, brief intervention, motivational interviewing, primary care
Introduction
Primary care was the key setting for the major World Health Organization (WHO) collaborative project that developed the Alcohol Use Disorders Identification Test (AUDIT) screening instrument [1] and undertook the first cross-national brief intervention trial [2]. After approximately 30 years of study [3,4], the effects of brief interventions in primary care are, to some extent, now well established [5], while evidence has been much slower to accumulate in other health and non-health settings [6]. Hazardous (i.e. risky drinkers without problems) and harmful drinkers (i.e. those with problems) are consistently helped to drink a little less on average by brief interventions for up to a year, although impacts on alcohol problems are less clear [5]. Brief alcohol interventions have little or no effect on health service utilization [7] and do not appear to impact upon other health-compromising behaviours [8]. The paucity of consistently established wider benefits may partly explain the slow pace of implementation of large-scale programmes based upon the existing evidence base [9,10]. National programmes are now in place across health settings in the United Kingdom, Sweden, Finland and elsewhere, due in part to the need to intervene to reduce alcohol problems at a population level with politically acceptable measures [10]. While this is a considerable achievement in the translation of research into policy and practice, it is also humbling how little is known about key issues [11].
‘Brief intervention’ is a useful umbrella term for two main types of heterogeneous content: brief advice or adaptations of motivational interviewing (MI) [6]. Brief advice appears to be simpler and to lend itself to wide implementation [12], and usually involves trying to persuade the person to drink less [13]. For example, the brief advice evaluated in the recent Screening and Intervention Programme for Sensible drinking (SIPS) trial [14], which has its origins in the advice evaluated in the WHO cross-national trial conducted more than 20 years ago [2], provided information on alcohol and national guidelines, and the benefits of cutting down (or stopping in the case of dependent drinkers) and practical tips. This type of content, focused on the risk behaviour itself, does not enquire about, and thus does not address directly, any problems that someone may be having with their drinking [15]. This approach contrasts sharply with that of MI [16], where asking the person about their situation, and listening carefully to what they have to say, places their concerns or problems at the heart of the conversation. In the face of this contrast, the discussion below will consider the brief intervention evidence base and ask whether we can help those with alcohol problems more effectively.
Evidence on Problems, Problems with Evidence …
The relative effectiveness of brief advice and adaptations of MI in comparison to each other is largely unknown for any of the three possible target populations of hazardous, harmful and dependent drinkers. We are aware of only one meta-analytic finding suggesting added benefit with MI over advice for alcohol outcomes [17], and further studies are clearly needed. One limitation of many systematic reviews of brief interventions is that they do not evaluate outcomes in relation to intervention content. While some existing reviews identify brief intervention effects on alcohol problems or composite outcome measures, they also suggest diminished effectiveness among those with more severe problems, as effect sizes are lower if dependent drinkers are not excluded [18]. Meta-analytic estimates of effects on alcohol problems assessed with validated instruments are often lacking (e.g. [5]). One review finds that evidence is absent for those who are dependent [19], and a common view is that brief interventions are probably not effective for dependent drinkers [6].
This situation is curious is a number of ways. First, the original studies that pioneered this field, two trials undertaken by Morris Chafetz and colleagues in a Boston emergency room approximately 50 years ago, both found important effects in alcohol-dependent populations [20,21]. Across both studies, approximately 70% of those receiving a referral to out-patient treatment subsequently attended versus approximately 5% who received usual care. Secondly, in the contemporary alcohol treatment literature, motivational enhancement therapy (MET; a multiple session adaptation of MI based on the two-session Drinker's Check-Up, offered to people who are concerned about their drinking [22]), is unsurpassed as a psychosocial treatment, being usually found equivalent in effectiveness to other treatments while also being briefer [23]. It has been established consistently across meta-analytic reviews that MI is no less effective among those with severe problems, including dependence [24].
Brief intervention trials in primary care targeting problem drinkers are very rare. There is no reason why brief psychosocial treatments such as MET, in addition to or as well as pharmacological treatments, should not be delivered in primary care [25,26]. Indeed, it is odd that they have not, as there is obvious unexplored potential. Mike Russell and colleagues' general practitioners (GPs) advice trial [27] was seminal for the alcohol field as well as for the smoking cessation field [6]. While brief advice in primary care is similarly established as modestly effective in both fields [28], the smoking cessation literature is more advanced in the evaluation of brief feedback and counselling interventions for dependent smokers that do not need to be delivered only in specialist services [29,30], and which may be combined effectively with pharmacological treatments [31]. In the alcohol field, the need to rethink the role of specialist services within the health-care system is well recognized [32,33].
It is suggested that there is a prima-facie case that the literature in primary care has been slow to address the needs of problem drinkers. It is also true that existing evidence suggests that harmful drinkers may benefit as much as hazardous drinkers from reductions in consumption following brief interventions, by virtue of the absence of data showing effect modification by severity. It is possible that by including hazardous drinkers who have few or no problems, we inadvertently obscure impacts on problems among those who do have them. It may be necessary to target harmful drinkers directly and/or to design evaluation studies to identify possible impacts on problems only among those who have them.
Alcohol in Primary Care
Apart from in emergency contexts, hazardous or harmful drinking is rarely the primary reason for attendance in primary care, and sensitive engagement on this subject is necessary if people are to become willing to discuss it in depth. Box 1 provides two brief pen-portraits of possible presentations. We suggest that Jill and John may be best helped by supporting their exploration of their situation, rather than having an initial or sole focus on trying to get them to drink less. Brief advice is simply not designed for careful engagement in discussion, although it may stimulate some useful thinking. A more sophisticated approach to advice-giving may be called for that is not very distinct from counselling. More than two decades ago, this was the direction pointed to by the FRAMES (Feedback, Responsibility, Advice, Menu, Empathy, Self-efficacy) acronym [34–36], although this did not lead successfully to process studies as was originally hoped, and as a result we still know little about the content of effective alcohol advice [37]. We cannot go on like this.
Box 1: How should we talk to Jill and John about alcohol?
Jill is a 20-year-old student who goes out with friends to pubs and clubs most weekends. She enjoys drinking heavily or getting drunk most Friday and Saturday evenings, as do most people she knows. She's done a few things she'd prefer to forget, and really doesn't like her hangovers, which sometimes completely wipe out the next day. She is well aware of the recommended limits and is happy to talk about her drinking because it's no big deal. She visits the practice to get her contraceptive prescription renewed.
John is a middle-aged man who sometimes gets mild panic attacks when around traffic. As well as sharing a bottle of wine with his wife over dinner a couple of times a week, he drinks in the evening and at weekends. He also sometimes drinks to calm his nerves to make the bus journey home from work easier, and when he does so, ends up drinking for the rest of the evening. He doesn't know what he thinks about his drinking and would probably prefer to avoid discussing it. He visits the practice to have his prescription renewed.
More is known about what helps in MI where process studies have been developed successfully based on validated instruments, which reveal the complexities of these discussions [38–41]. We are at an early stage in understanding effective content [42], and the need to develop understanding of mechanisms of behaviour change extends far beyond both MI and alcohol. What might appear to be little things, such as conveying willingness to help, reflecting back what you have heard, being curious to know more, paying very careful attention to language, asking permission to offer views, the timing of key utterances and following-up on responses, all appear to be helpful [16]. Together, these are characteristic but far from unique elements of the style of MI, and they also provide guidance for ways in which advice may be given when influenced by this approach. This would also avoid assuming that decisions to change have been made or that goals for behaviour change, whether abstinence for dependent drinkers or nationally recommended risk thresholds for non-dependent drinkers, are the right ones for every person. It is assumed that this approach takes longer to implement than advice. There have been different models of brief MI for more than 20 years (e.g. [22,43,44]), and there has also been concern that it is too complex for practitioners to learn and deliver well. MI itself has become simpler, identifying four processes of engagement, focusing, evoking and planning [16] in ways that provide content for a new generation of models of how to conduct MI when time is short, as is often the case in primary care. Even where time is short there is scope for, and potential benefit in, being person-centred.
Future Research
It is suggested here that brief interventions could encourage people with alcohol problems to tell us what their problems are, so that help can be provided to think these through in so doing, in order to help initiate or better support efforts at change. While this proposal is congruent with the highly person-centred nature of MI and lends itself to evaluation in trials, there are also other ways in which this type of intervention content can be delivered and evaluated, and there is a particular need for detailed study of how discussions about alcohol in primary care actually take place. This means using validated instruments such as Motivational Interviewing Treatment Integrity (MITI) [45]. Where adaptations of MI are only loosely based on this well-specified approach, or where MI fidelity is not high, we would expect any effects to be indistinguishable from advice [46].
It is also important to acknowledge how limited is the science of helping practitioners prepare for behaviour change discussions, which are unavoidably complex whichever intervention approach is being used. One hour of training was provided to deliver advice in the SIPS primary care trial, which may be insufficient to be effective [47]. The Phase III REsearch Evaluating Migraine Prophylaxis Therapy 1 (PREEMPT) trial of training primary care practitioners also found no effects on alcohol outcomes, and it remains unclear which skills practitioners really need to possess, and how they may best acquire this learning [48]. There is obvious merit in eliciting the experiences and the views of practitioners themselves [49]. Apparently simple interventions may be deceptively alluring on cost and implementation grounds, although they will not be worth implementing if they are not effective [42]. Quick fixes will sometimes be in accord with the needs of the client, but often may not be. Arguably, they are optimally designed when the complexities inherent in these discussions [50] are better understood than they are now.
Alcohol problems do not occur in isolation from other difficulties. Many people drink excessively, smoke and have other life-style difficulties. There is little current evidence on where and how multiple problems can be addressed by brief interventions [51]. On-line trials indicate that large numbers of people are prepared to seek help with alcohol [52], and it remains to be established what role primary care has in delivering these interventions in the era of the internet. As screening and simple feedback can be delivered widely on-line, we suggest here that primary care may provide the key setting in which widely available face-to-face discussions can be offered. One final research question well worth answering is how demand for brief interventions may be nurtured [53], so that those who may wish to consider their drinking by discussing it will actually seek them out. We should ask them.
Acknowledgments
Jim McCambridge's work on this paper is supported by a Wellcome Trust Research Career Development fellowship in Basic Biomedical Science (WT086516MA). He is President of the International Network on Brief Interventions for Alcohol and Drugs (INEBRIA), and this paper is based in part on a plenary presentation at the 9th Annual Conference on INEBRIA in Barcelona, 26–28 September 2012; he is grateful to INEBRIA colleagues for helpful discussions, and especially to Toni Gual for comments on a draft of this paper. The authors have worked together on these issues for approximately 10 years.
Declaration of interests
The authors have no sources of funding, direct or indirect, nor any other connection with the tobacco, alcohol, pharmaceutical or gaming industries nor any body substantially funded by one of these organizations.
References
- 1.Saunders JB, Aasland OG, Amundsen A, Grant M. Alcohol consumption and related problems among primary health care patients: WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption: I. Addiction. 1993;88:249–362. doi: 10.1111/j.1360-0443.1993.tb00822.x. [DOI] [PubMed] [Google Scholar]
- 2.World Health Organization (WHO) Brief Intervention Study Group. A cross-national trial of brief interventions with heavy drinkers. Am J Public Health. 1996;86:948–955. doi: 10.2105/ajph.86.7.948. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Babor TF, Ritson EB, Hodgson RJ. Alcohol related problems in the primary health care setting: a review of early intervention strategies. Br J Addict. 1986;81:23–46. doi: 10.1111/j.1360-0443.1986.tb00291.x. [DOI] [PubMed] [Google Scholar]
- 4.Heather N. Developing, evaluating and implementing alcohol brief interventions in Europe. Drug Alcohol Rev. 2011;30:138–147. doi: 10.1111/j.1465-3362.2010.00267.x. [DOI] [PubMed] [Google Scholar]
- 5.Kaner EF, Beyer F, Dickinson HO, Pienaar E, Campbell F, Schlesinger C, et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database Syst Rev. 2007;2:CD004148. doi: 10.1002/14651858.CD004148.pub3. doi: 10.1002/14651858.CD004148.pub3. [DOI] [PubMed] [Google Scholar]
- 6.Heather N. Breaking new ground in the study and practice of alcohol brief interventions. Drug Alcohol Rev. 2010;29:584–588. doi: 10.1111/j.1465-3362.2010.00204.x. [DOI] [PubMed] [Google Scholar]
- 7.Bray JW, Cowell AJ, Hinde JM. A systematic review and meta-analysis of health care utilization outcomes in alcohol screening and brief intervention trials. Med Care. 2011;49:287–294. doi: 10.1097/MLR.0b013e318203624f. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.McCambridge J, Jenkins RJ. Do brief interventions which target alcohol consumption also reduce cigarette smoking? Systematic review and meta-analysis. Drug Alcohol Depend. 2008;96:263–270. doi: 10.1016/j.drugalcdep.2008.03.011. [DOI] [PubMed] [Google Scholar]
- 9.Nilsen P. Brief alcohol intervention—where to from here? Challenges remain for research and practice. Addiction. 2010;105:954–959. doi: 10.1111/j.1360-0443.2009.02779.x. [DOI] [PubMed] [Google Scholar]
- 10.Heather N. Can screening and brief intervention lead to population-level reductions in alcohol-related harm? Addict Sci Clin Pract. 2012;7:15. doi: 10.1186/1940-0640-7-15. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.McCambridge J. Fifty years of brief intervention effectiveness trials for heavy drinkers. Drug Alcohol Rev. 2011;30:567–568. doi: 10.1111/j.1465-3362.2011.00379.x. [DOI] [PubMed] [Google Scholar]
- 12.Public Health England Alcohol Learning Centre. 2013. Identification and Brief Advice. Available at: http://www.alcohollearningcentre.org.uk/Topics/Browse/BriefAdvice/ (accessed 5 November 2013) (Archived at http://www.webcitation.org/6Ku9k4PSM on 5 November 2013)
- 13.Rollnick S. Early intervention among excessive drinkers: how early and in what context? Aust Drug Alcohol Rev. 1987;6:341–346. [Google Scholar]
- 14.SIPS Programme Reseach Group. 2008. Screening and Intervention Programme for Sensible drinking (SIPS) website. Available at: http://www.sips.iop.kcl.ac.uk/index.php (accessed 5 November 2013) (Archived at http://www.webcitation.org/6Ku9bwrwX on 5 November 2013)
- 15.Rollnick S, Butler CC, Stott N. Brief alcohol intervention in medical settings: concerns from the consulting room. Addict Res. 1997;5:331–342. [Google Scholar]
- 16.Miller WR, Rollnick S. Motivational Interviewing, 3rd edn. London: Guilford Press; 2012. Helping People Change. [Google Scholar]
- 17.Rubak SLM, Sandbaek A, Lauritzen T, Christenses B. Motivational interviewing: a systematic review and meta-analysis. Br J Gen Pract. 2005;55:305–312. [PMC free article] [PubMed] [Google Scholar]
- 18.Moyer A, Finney JW, Swearingen CE, Vergun P. Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment-seeking and non-treatment-seeking populations. Addiction. 2002;97:279–292. doi: 10.1046/j.1360-0443.2002.00018.x. [DOI] [PubMed] [Google Scholar]
- 19.Saitz R. Alcohol screening and brief intervention in primary care: absence of evidence for efficacy in people with dependence or very heavy drinking. Drug Alcohol Rev. 2010;29:631–640. doi: 10.1111/j.1465-3362.2010.00217.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Chafetz M, Blane H, Abram H, Golner J, Lacy E, McCourt W, et al. Establishing treatment relations with alcoholics. J Nerv Ment Dis. 1962;134:395–409. doi: 10.1097/00005053-196205000-00001. [DOI] [PubMed] [Google Scholar]
- 21.Chafetz ME, Blane HT, Abrams HS, Clark E, Golner JH, Hastie EL, et al. Establishing treatment relations with alcoholics: a supplementary report. J Nerv Ment Dis. 1964;138:390–393. doi: 10.1097/00005053-196404000-00010. [DOI] [PubMed] [Google Scholar]
- 22.Miller WR, Sovereign RG, Krege B. Motivational interviewing with problem drinkers: II. The Drinker's Check-up as preventive intervention. Behav Psychother. 1988;16:251–268. [Google Scholar]
- 23.Project Match Research Group. Matching alcoholism treatment to client heterogeneity: project MATCH three-year drinking outcomes. Alcohol Clin Exp Res. 1997;22:1300–1311. doi: 10.1111/j.1530-0277.1998.tb03912.x. [DOI] [PubMed] [Google Scholar]
- 24.Lundahl B, Burke BL. The effectiveness and applicability of motivational interviewing: a practice-friendly review of four meta-analyses. J Clin Psychol. 2009;65:1232–1245. doi: 10.1002/jclp.20638. [DOI] [PubMed] [Google Scholar]
- 25.Drummond DC, Thom B, Brown C, Edwards G, Mullan MJ. Specialist versus general practitioners treatment of problem drinkers. Lancet. 1990;336:915–918. doi: 10.1016/0140-6736(90)92279-q. [DOI] [PubMed] [Google Scholar]
- 26.Bradley KA, et al. 2011. Considering Healthier Drinking Options in Collaborative Care (CHOICE). Available at: http://www.clinicaltrials.gov/ct2/show/NCT01400581?term=Considering+Healthier+Drinking+Options+In+Collaborative+Care+%28CHOICE%29+Trial&rank=1 (accessed 5 November 2013). Archived at http://www.webcitation.org/6Ku9qKcNg on 5 November 2013.
- 27.Russell MA, Wilson C, Taylor C, Baker CD. Effect of general practitioners’ advice against smoking. BMJ. 1979;2:231–235. doi: 10.1136/bmj.2.6184.231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Stead LF, Buitrago D, Preciado N, Sanchez G, Hartmann-Boyce J, Lancaster T. Physician advice for smoking cessation. Cochrane Database Syst Rev. 2013;5:CD000165. doi: 10.1002/14651858.CD000165.pub4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Cahill K, Lancaster T, Green N. Stage-based interventions for smoking cessation. Cochrane Database Syst Rev. 2010;11 doi: 10.1002/14651858.CD004492.pub4. CD004492. [DOI] [PubMed] [Google Scholar]
- 30.Bize R, Burnand B, Mueller Y, Rege-Walther M, Camain JY, Cornuz J. Biomedical risk assessment as an aid for smoking cessation. Cochrane Database Syst Rev. 2012;12:CD004705. doi: 10.1002/14651858.CD004705.pub4. [DOI] [PubMed] [Google Scholar]
- 31.Cahill K, Stevens S, Perera R, Lancaster T. Pharmacological interventions for smoking cessation: an overview and network meta-analysis. Cochrane Database Syst Rev. 2013;5:CD009329. doi: 10.1002/14651858.CD009329.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Babor TF, Stenius K, Romelsjo A. Alcohol and drug treatment systems in public health perspective: mediators and moderators of population effects. Int J Methods Psychiatr Res. 2008;17:S50–59. doi: 10.1002/mpr.249. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Miller WR, Carroll KM, editors. Rethinking Substance Abuse: What the Science Shows, and What We Should Do about It. New York: Guilford Press; 2006. [Google Scholar]
- 34.Miller WR, Rollnick S. Motivational Interviewing: Preparing People to Change Addictive Behavior. New York: Guilford Press; 1991. [Google Scholar]
- 35.Bien TH, Miller WR, Tonigan SJ. Brief interventions for alcohol problems: a review. Addiction. 1993;88:315–336. doi: 10.1111/j.1360-0443.1993.tb00820.x. [DOI] [PubMed] [Google Scholar]
- 36.Miller WR, Sanchez VC, Howard GS, Nathan PE. Motivating Young Adults for Treatment and Lifestyle Change, in Alcohol Use and Misuse by Young Adults. Notre Dame: University of Notre Dame; 1994. [Google Scholar]
- 37.Michie S, Whittington C, Hamoudi Z, Zarnani F, Tober G, West R. Identification of behaviour change techniques to reduce excessive alcohol consumption. Addiction. 2012;107:1431–1440. doi: 10.1111/j.1360-0443.2012.03845.x. [DOI] [PubMed] [Google Scholar]
- 38.Moyers TB, Miller WR, Hendrickson SM. How does motivational interviewing work? Therapist interpersonal skill predicts client involvement within motivational interviewing sessions. J Consult Clin Psychol. 2005;73:590–598. doi: 10.1037/0022-006X.73.4.590. [DOI] [PubMed] [Google Scholar]
- 39.Moyers TB, Martin T. Therapist influence on client language during motivational interviewing sessions. J Subst Abuse Treat. 2006;30:245–251. doi: 10.1016/j.jsat.2005.12.003. [DOI] [PubMed] [Google Scholar]
- 40.Daeppen JB, Bertholet N, Gaume J. What process research tells us about brief intervention efficacy. Drug Alcohol Rev. 2010;29:612–616. doi: 10.1111/j.1465-3362.2010.00235.x. [DOI] [PubMed] [Google Scholar]
- 41.Gaume J, Bertholet N, Faouzi M, Gmel G, Daeppen JB. Does change talk during brief motivational interventions with young men predict change in alcohol use? J Subst Abuse Treat. 2013;44:177–185. doi: 10.1016/j.jsat.2012.04.005. [DOI] [PubMed] [Google Scholar]
- 42.McCambridge J. Brief intervention content matters. Drug Alcohol Rev. 2013;32:339–341. doi: 10.1111/dar.12044. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Rollnick S, Heather N, Bell A. Negotiating behaviour change in medical settings: the development of brief motivational interviewing. J Ment Health. 1992;1:25–37. [Google Scholar]
- 44.McCambridge J, Strang J. Development of a structured generic drug intervention model for public health purposes: a brief application of motivational interviewing with young people. Drug Alcohol Rev. 2003;22:391–399. doi: 10.1080/09595230310001613903. [DOI] [PubMed] [Google Scholar]
- 45.Moyers T, Martin T, Manuel JK, Hendrickson SM, Miller WR. Assessing competence in the use of motivational interviewing. J Subst Abuse Treat. 2005;28:19–26. doi: 10.1016/j.jsat.2004.11.001. [DOI] [PubMed] [Google Scholar]
- 46.McCambridge J, Slym RL, Strang J. Randomized controlled trial of motivational interviewing compared with drug information and advice for early intervention among young cannabis users. Addiction. 2008;103:1809–1818. doi: 10.1111/j.1360-0443.2008.02331.x. [DOI] [PubMed] [Google Scholar]
- 47.Kaner E, Bland M, Cassidy P, Coulton S, Dale V, Deluca P, et al. Effectiveness of screening and brief alcohol intervention in primary care (SIPS trial): pragmatic cluster randomised controlled trial. BMJ. 2013;346:e8501. doi: 10.1136/bmj.e8501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Butler CC, Simpson SA, Hood K, Cohen D, Pickles T, Spanou C, et al. Training practitioners to deliver opportunistic multiple behaviour change counselling in primary care: a cluster randomised trial. BMJ. 2013;346:f1191. doi: 10.1136/bmj.f1191. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.McCambridge J, Keaney F, Strang J, Rollnick S. General practitioner screening for excessive alcohol use—general practitioners’ experiences are important. BMJ. 2003;326:336–336. [PubMed] [Google Scholar]
- 50.Medical Research Council. London: MRC Health Services and Public Health Research Board; 2000. A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. [Google Scholar]
- 51.Goldstein M, Whitlock E, De Pue J. Multiple behavioural risk factor interventions in primary care: summary of research evidence. Am J Prev Med. 2004;27:61–79. doi: 10.1016/j.amepre.2004.04.023. [DOI] [PubMed] [Google Scholar]
- 52.Wallace P, Murray E, McCambridge J, Khadjesari Z, White IR, Thompson SG, et al. On-line randomized controlled trial of an internet based psychologically enhanced intervention for people with hazardous alcohol consumption. PLOS ONE. 2011;6:e14740. doi: 10.1371/journal.pone.0014740. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Nilsen P, Bendtsen P, McCambridge J, Karlsson N, Dalal K. When is it appropriate to address patients’ alcohol consumption in health care-national survey of views of the general population in Sweden. Addict Behav. 2012;37:1211–1216. doi: 10.1016/j.addbeh.2012.05.024. [DOI] [PubMed] [Google Scholar]