Abstract
Background and Aim:
Distance learning techniques are gaining popularity as the internet today is a faster and more convenient source of spreading exhaustive information. We aim at conducting a scoping review on the utility of internet-based learning in addiction psychiatry.
Methods:
We performed a systematic search of databases such as Google Scholar, PubMed, and Cochrane using the following keywords: Distance education, substance related disorder, teaching, internet, along with the MeSH terms (“Internet” AND “Teaching” AND “Substance Related Disorders”) OR (“Distance Education” AND “Substance Related Disorders”). The reference lists of articles were searched for other relevant literature.
Results:
A total of 34 studies were included. Most of the courses offered online were on specific therapies, for example, training on motivational interviewing, twelve-step facilitation, cognitive behavioral therapy, alcohol screening, and brief intervention. They were based on various aspects of distance learning such as the acquisition of knowledge or skills, feasibility, level of satisfaction of the trainees/students, the cost-effectiveness of the techniques, and the type of trainees who have access to the course. The majority of the studies showed positive findings in terms of the parameter being studied. However, the level of satisfaction among the students is questionable.
Conclusion:
Internet-based teaching programs provide a good alternative to traditional educational methods in terms of effectiveness, feasibility, and acquisition of knowledge and skills. We emphasize the use of internet-based training in addiction psychiatry reinforced by actual practical experiences.
Keywords: Addiction psychiatry, Distance learning, Internet-based learning, Web-based learning
Distance learning techniques have evolved since the 1840s when a system of teaching via postcards was used for the first time. This was followed by the introduction of correspondence courses in universities. Subsequently, the use of radio and television to disperse information provided access to remote education. 1 In the present day, the internet provides a convenient and exhaustive source of taking learning opportunities closer to a wider section of the population and has been applied in medical education over the past few decades.1, 2
The impact of the use of psychoactive substances (e.g., alcohol, tobacco, and other drugs) is enormous, with tobacco being the most prevalent (consumed by 23% of the world’s population).3, 4 Services for substance use disorder (SUD) have, traditionally, been delivered separately from psychiatric and other general health care services. 5 The growth in numbers of trained human resources has lagged behind the increase in demand for services for the management of SUD. This is because of a lack of resources, insufficient training, and workforce shortages. 6 The World Health Organization Atlas on Substance Use (WHO ATLAS-SU) survey on resources for the prevention and treatment of SUD, conducted in 162 countries, highlighted the deficiencies in training programs for management of SUD worldwide. Around 30% of the nations, including the majority of low-income countries, reported that no training programs for any workforce for the management of SUD existed in their country. 7
The integration of substance use training in medical schools is limited by lack of curricular time, interdepartmental coordination, and experienced and interested faculty. 8 The availability of fellowship in addiction medicine is scarce in low resource settings, despite having a higher burden of SUD. 9 The online platform may turn out to be a boon in such settings. Surveys have found that 80% of the students of the current generation use social media on a daily basis, 20% of whom use it for studying, sharing online material and information, and organizing meetings/peer classes.10, 11 Since 2010, there have been rising publications on the use of social media for medical education. 12
Various branches of medicine, such as infectious diseases, cardiology, diabetes, critical care, etc., offer online courses and certifications. 13 Various organizations offer such online courses.14, 15 Many online training programs have proven successful, such as an online program on social prescribing 16 and the incorporation of social media for dermatological education. 17 The reason behind the success of such online programs is minimal requirement of physical examination, with the possibility of doing a video examination. For example, carrying out a mental status examination and looking at the blood investigations and other metabolic parameters in a case of diabetes are feasible. Similarly, training courses on medical management with minimal or no invasive procedures can be conveniently taught online. At present, internet-based teaching is accepted as an important modality across many fields of medicine.18, 19 In psychiatry, particularly addiction psychiatry, such courses may be beneficial as the primary basis of diagnosis is a detailed history and mental status examination.
Although the existing curricula emphasize the need to integrate addiction psychiatry into other specialties, this has not yet been accomplished because of the inability to accommodate on-site training in addiction psychiatry on a large scale. 9 Furthermore, there is a limited number of trained professionals in addiction psychiatry to impart training and match the exponential rise in substance-related disorders across the globe, particularly in low-resource settings.6, 7 Hence, there is a need to consider alternatives, such as internet-based learning, to address the dearth of human resources. However, subtle differences in psychiatry and addiction psychiatry from other branches of medicine should also be kept in mind while planning and imparting online courses, for eample, the need to have a command over the language and cultural background of a particular region while practicing there. The expression and interpretation of symptoms may vary greatly from region to region and thus affect the diagnosis entertained by the trainee and eventually the success/outcome of a training course. In India, various institutions provide training in addiction, such as the Centre for Addiction Medicine, National Institute of Mental Health and Neurosciences, Bengaluru (https://nimhans.ac.in/cam/?q=node%2F3); All India Institute of Medical Sciences, New Delhi in collaboration with the Government of India (https://naat.co.in/); Mahatma Gandhi Labour Institute, Gujarat that offers a short-term course (https://mgli.gujarat.gov.in/de-addiction.htm); National Institute of Social Defence (http://www.nisd.gov.in/drug_abuse_training.html), etc. However, no data is available on the efficacy, acceptability, or cost-effectiveness of most courses.
With the current review, we intend to give an overview of the existing scenario of internet-based training in addiction psychiatry. We also aim to address some pertinent questions, for instance, how internet-based training can be applied in addiction psychiatry, who forms the target population of these courses, what is being taught through these courses, their effectiveness vis-a-vis in-live teaching in terms of increasing knowledge and skills of the trainees, accessibility, acceptability by the trainers as well as trainees, cost, feasibility of such training programs, and so on.
Methodology
The PRISMA guidelines for systematic reviews and meta-analysis were employed for conducting the literature search, using a systematic and structured approach. 20 PubMed, Cochrane, and Google Scholar were searched until May 2021 using the following keywords: distance education, substance-related disorders, teaching, internet along with the MeSH terms ([“Internet” AND “Teaching” AND “Substance Related Disorders”] OR [“Distance Education” AND “Substance Related Disorders”]). Observational, interventional, ecological, and exploratory studies that had full-texts available in the English language were included. Studies with a focus on the effectiveness of web-based training in SUD and those imparting training on addiction psychiatry (psychological or pharmacological interventions) to individuals in the field of addiction psychiatry (medical/nursing students, residents, paramedical staff, etc.) were included. Studies on imparting web-based interventions to patients of SUD, online surveys assessing substance use knowledge/attitude/practice, studies on the feasibility of online courses from the perspective of a patient/individuals who use substances, and studies on distance learning through offline mode were excluded.
After assessing the titles and abstracts, full texts of the articles deemed suitable were retrieved. The contents of the studies were further examined to determine their final inclusion in the review. Furthermore, the reference lists of the selected articles were examined to search for additional suitable publications that might have been overlooked in the previous search. Data extraction was carried out by three authors (PS, NC, and SG) independently. Parameters explored by each author included the year and place of study, type of study, study participants, type of online course with its duration, mode of teaching, criteria for effectiveness, and the results of each study. Compilations by all authors were compared and discrepancies were resolved by mutual consensus.
Results
The initial search yielded a total of 75 articles. Thirty articles from PubMed were eligible. Because of the unavailability of full-text, two articles were excluded. No additional articles were found on the Cochrane database. Search on Google Scholar yielded six additional articles (Figure 1). Thus, a total of 34 articles were included in this review (Table S1).
Figure 1. Flow Diagram for Methodology.
The majority of studies used quantitative methods, a few used purely qualitative design, 31 while six used mixed methods.21–26 These included surveys with short-answer questions or interviews along with quantitative measures and studies that compared a web-based curriculum with controls.21, 23, 27, 28 Pretest/posttest design was a common mode of the study of the effectiveness of online teaching. Other studies included randomized controlled trials and prospective observational and descriptive studies.
The studies were set in higher educational institutions and small community settings ranging from veteran administration addiction treatment programs 29 to community-based substance use treatment centers. 30 Sample size ranged from 21 to 1,386. Participants ranged from first to final year medical students, residents in psychiatry, and internal and family medicine, clinicians, counsellors, nurses, physician educators, schoolteachers, and predoctoral and dental students. The purpose statements across studies stated a wide range of focus. These included the acceptability of the online course to the participants, the feasibility of online courses, the extent of improvement in the participants’ skills or knowledge, and its incorporation in daily clinical practice.
Most of the studies included training on psychotherapeutic intervention techniques. These interventions included motivational interviewing (MI), brief intervention, cognitive behavioral therapy (CBT), and other behavioral changes intended to establish incongruence in drug-seeking behavior. Other prominent content of the courses involved learning about screening for substance use and its pharmacological interventions. Some courses focused on the extent of the substance use problem and its impact on a global scale. Multiple themes were studied in a single paper as well. The substance type targeted by the courses commonly involved alcohol and tobacco. Other less commonly covered substances included opioid poisoning and cocaine abuse.
The primary and secondary outcomes were acquisition in knowledge and skills, feasibility, cost-effectiveness, differences in patient outcome, and participants’ acceptance of the online teaching interventions.
Acquisition of Knowledge and Skills
The results of studies on knowledge and skills have been presented under the following subheadings: (a) MI, CBT, and pharmacological intervention, (b) screening and brief interventions, and (c) drug epidemiology, use, and treatment.
MI, CBT, and Pharmacological Intervention
An overall gain in knowledge and skills in MI, pharmacological interventions, and assessment of tobacco use was observed after completing an online expert-facilitated course on tobacco dependence treatment. 31 Similarly, positive outcomes were seen in different studies comparing intervention by online training with no intervention (e.g., acquiring CBT skills following a 20-h web course [vs. manual only], 30 acquiring counselling skills and a positive attitude toward treatment efficacy after using an internet-based module).25, 26 A three-step approach (distance learning web course, followed by a skill-building workshop, followed by competence-based supervision) MI found that clinicians who came up with adequate performance after step 1 continued working at the same level after the next two steps. 29 It is interesting to note that some studies had contrasting findings where acquisition or use of counselling or CBT skills were poorer or comparable in online intervention viz-a-viz in vivo intervention.24, 32, 33 A study involving staff at a substance abuse treatment organization found statistically significant improvements in self-perceived knowledge and skills, but a clinically insignificant increase in knowledge, after 15 h of video workshop on MI. 34
Screening and Brief Interventions
Upon assessment of change in attitude, knowledge, and confidence in screening and providing interventions in SUD or in imparting teaching for SUD management, web-based modules showed positive results in various groups of participants in different studies (some of which were comparative).22, 24, 26, 35–37 A nonrandomized study compared learning outcomes in terms of knowledge, attitudes, and skills between on-site (n = 45) and distance learning (n = 18) nursing students receiving training on screening, brief intervention, and referral to treatment. It found a significant increase in the skills required for patient interaction but not in confidence or knowledge in the distance learning group. 28 Another controlled trial on first-year medical students that compared an interactive web module group with offline lecture group found no significant differences in improving competency in screening and interventions for hazardous drinking. 29
Knowledge About Drug Use and Treatment
Improvement was noted in the knowledge about substance abuse and drug diversion amongst medical students along with increased confidence in application of that knowledge after delivery of a web-based module. 38 Another web-based educational smoking cessation program was delivered to nurses and significant improvement was noted in knowledge, skills, about tobacco control. 39 A significant improvement in attitudes about tobacco control was also found. After an online course with didactic modules, a significant increase was seen in knowledge of smoking epidemiology, health effects of smoking and benefits of smoking cessation, and effectiveness of smoking cessation treatments. 40 An internet-based teaching module on management of simulated opioid poisoning/overdose was found to be effective in teaching the basic principles of management of such cases, evident by the high knowledge scores on testing.41, 42
Finally, other than the acquisition of knowledge in the areas mentioned above, studies have demonstrated changes in patient parameters post distance learning by care providers, which could indirectly reflect the increase in skills of the individuals. For example, a study found that after a distance-learning course by the service providers, the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) scores of their patients significantly reduced for alcohol and cocaine. 43 However, a randomized trial did not find any change in drug use on patient feedback survey or any change in the therapeutic alliance after taking of the course by service providers. 44
Cost Effectiveness
A study on 143 addiction clinicians demonstrated that the cost of the in vivo approach was twice that of the distance learning approach and ten times that of the manual-based approach. 33 Another study on medical and nursing students also showed that web-based training was cost-effective and accessible to the participants. 24
Feasibility
A study to evaluate visitors’ use of an internet course on Alcoholics Anonymous found that out of 414 participants, 294 (71%) completed the course. 45 Some surveys have shown higher completion or response rates for online modules than offline.23, 37 Another study found overall ease in delivery of education through the online platform and a majority of the participants, primarily physician instructors, preferred to use web-based enhancements. 46 However, the findings on feasibility are not ubiquitous. For instance, a web-based CBT course for substance abuse counsellors (n = 22) found that 41% of the participants were not engaged in previous online course work, 33% had difficulty downloading audio, and 54% required more than 45 min to complete. 47 In fact, the completion rate was only modest in these studies, with participants facing challenges ranging from motivation to technical problems. 46
Participant Satisfaction and Acceptability
In a comparative study, the intervention group who attended a workshop on alcohol screening and brief intervention via web-based curriculum experienced more confidence in teaching than the control group who did not attend. A significantly higher number of individuals in the intervention group reported using any part of the curriculum than the control subjects. 22 Another study showed that 91% of counsellors (n = 22) were immediately and positively affected by a web-based course on CBT for substance abuse counsellors. 47 After attending the Alcohol Abuse Management in Primary Care e-learning course, students reported it to be an appreciated learning tool that provided effective knowledge transmission and retention. 48 Furthermore, the staff of a project in which computer-centered technology was used to deliver clinical risk assessment training in a specialist addictions unit through case vignette, slides, audios, and videos found the resource easy to use, convenient, and appropriate for their role. 49 Another study found that after a distance learning course, 55% of professionals (n = 2,420) were highly motivated and confident to apply screening and brief interventions in practice. 43
Interestingly, whereas many studies highlight the high acceptability of web-based training, several studies also highlight its problems. In a study, merely 22.6% of participants (n = 277) were satisfied with the overall quality of the online training (The Training Enhancement in Applied Cessation Counselling and Health Project). 21 Some studies have shown a higher level of satisfaction among those who attend live lectures viz-a-viz web-streamed lecture. 25 A survey on an online course that was followed by an in-person training on office-based buprenorphine therapy found that even though the online course received reasonable ratings, it was considered significantly less favorable than in-person training. 23 These conflicting results in satisfaction and acceptability of web-based modules may be attributed to variation in the course content and the user-friendly nature of some courses.
Discussion
Studies in this review have used different methodologies, including qualitative, quantitative, and mixed methods. To ascertain the effectiveness of the distance learning courses, pretest/posttest methods have been applied. A few randomized controlled trials have also been conducted. While randomized trials have provided a robust experimental design, prospective cohort designs have been able to highlight the long-term change in skills and knowledge post course. Another point reflected in the review is the diversity in educational settings and participants in the various studies included, thus making the findings more generalizable. This also highlights the benefit of incorporating online courses among a variety of participants and educational settings. However, the review also suffers from a lack of comparability among these studies because of the tremendous heterogeneity. The lack of uniformity across the studies also extends to the type of substance use studied, the target population of the courses, and the characteristics of the courses, such as the type, content, and duration. Furthermore, the primary and secondary outcomes have not been uniform across the included studies. This has resulted in an inability to perform a meta-analysis and an inability to draw definitive conclusions about the effectiveness of these courses.
Nevertheless, the effectiveness of the distant courses in disseminating skills and knowledge to the users appears promising. Web-based lectures, solely or after supplementing with manuals, have shown an increase in the participants’ skills.31, 33, 38 Web-based lectures are also noted to have a higher adherence rate than live lectures. 50 However, this observation is not uniform across all studies and the literature presents conflicting results. For instance, better acquisition of skills through in-person training rather than web-based training has been seen in a study, which can be attributed to better feedback, clarifications of doubts, and discipline followed during in-live training. Furthermore, the skills have been seen to progressively grow with in-live learning in contrast to online courses where stagnation, or even deterioration of skills, is noted with time. 33 Another study showed that some level of supervision improves the level of acquired knowledge or skills. 30 However, the point of contention here is that many studies have made comparisons of online training with no training or manual-based training, which might overestimate the positive outcomes with an online module.
The other noteworthy issue seen with distance learning is the application of the learned skills in a practical setting. It has been seen that even though the gain in knowledge in certain CBT skills through web-based platforms might be at par with in-live classes, the frequency of use of CBT skills was much higher by the physicians who received in-live training. 33 This might, however, reflect the nature of the complexity of the psychological intervention and the suitability of learning in the presence of an in-live supervisor.
The review underlines the fact that it is not possible to define web-based learning as either good or bad. Owing to the immense variation in technology, it is not justified to make generalized statements or treat the online platform of learning as a single entity. A more useful approach is to analyze the settings and conditions in which this platform can be used effectively and study how to tap the potential of this mode of imparting knowledge and learning in order to optimize its use. 51
There is no denying the fact that web-based learning and distance education are cost-effective, easily accessible, and conveniently deliverable. However, issues with the usability, taking more time than intended to complete the course, and technical problems lead to a modest completion rate and undermine the overall potential impact this platform can have.46, 47 Although the acceptability of these courses is good and they have shown a favorable outcome in patient-related measures such as the Alcohol, Smoking and Substance Involvement Screening Test scores,43, 44 the search for a valid instrument for evaluating educational outcomes in distance learning is still ongoing.52, 53 In the case of distance learning, the strategies of time management, metacognition, effort regulation, and critical thinking have been found to correlate positively with academic outcomes. 54 However, it is difficult to ensure and assess all of these qualities in the participants of an internet-based training program.
A prerequisite, especially for third-world countries, is the feasibility and availability of this platform. It has been observed that the ease of implementation of a program correlates well with the program’s intended outcome. Hence, if the implementation is difficult, programs may not be implemented as planned, thereby affecting the overall outcome. 46 Furthermore, some courses may need alteration; for instance, they may need to be more interactive, with the inclusion of knowledge-based quizzes, videos, live webinars, and so on, depending on the population they are catering to. For example, it is anticipated that undergraduate and postgraduate students may be more interested in or motivated by quizzes or competitive platforms. Established consultants/faculty/researchers may not be interested in a high-scoring quiz competition but in an interactive session with experts or live webinars. On the other hand, busy clinicians may not be able to match timings for live sessions and might express comfort in watching prerecorded videos. Better website navigation and flexibility in accessing the course content for back-to-back study are sometimes lacking in various courses. 21 Moreover, with distant courses, it is difficult to assess the level of participation and the changes in students’ attitudes, knowledge, skills, and behaviors. 43 Finally, the results of the studies on web-based learning need to be assessed carefully, as each of these courses differs in its rationale, content, duration, and navigation techniques. A review of all online courses on tobacco dependence treatment found that even though some of the included studies were good at providing effective navigation, course rationale, and content, 17 of the 24 courses evaluated failed to meet minimal quality standards. 55
The practical application of knowledge/skills acquired through internet-based courses into clinical settings has been studied only by a few researchers. Even lesser literature compares the skills obtained from web-based courses with those acquired through live lectures or under supervision. There is a need to study imparting of complete training on substance-related problems, with adequate sample sizes, and carrying out assessments that are feasible.
Some limitations of the present review should be considered while drawing inferences from the findings. The review has not conducted a meta-analysis of the study findings, and hence summary analysis was not possible. In addition to PubMed, only Cochrane and Google Scholar were the databases used in searching the articles. Thus, some of the studies might have been missed, although we attempted to gather all relevant literature. Despite the above lacunae, our review reflects that internet/web-based learning is an invaluable tool for providing knowledge and skills at a relatively low cost, warranting a more widespread implementation to gain further insight into its utility and potential issues.
Conclusion
There has been a significant rise in SUD in the past two decades, without a corresponding increase in trained human resources for its management. Internet-based training remains a largely unexploited area capable of producing a workforce trained to tackle SUD. The results of this review might help plan and progress to evidence-based dissemination of specific internet-based training in addiction psychiatry. We emphasize the use of internet-based training in addiction psychiatry, reinforced by actual practical experiences, to supplement the deficiency of trained human resources in this field. However, further studies are required to determine the characteristics of health professionals best suited for internet-based training and the content that could be delivered using this platform.
Supplemental Material
The Supplemental material for this article is available online.
Supplementary Material
Footnotes
Declaration of Conflicting Interests: The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The authors received no financial support for the research, authorship, and/or publication of this article.
References
- 1.Tanaś M. Distance education as an object of study and reflection of pedagogy in Poland. Int J Electron Telecommun, 2015; 61: 237–243. [Google Scholar]
- 2.Peng Y and Yan W. Effect of internet-based learning in public health training: An exploratory meta-analysis. Int Assoc Dev Inf Soc, 2017. [Google Scholar]
- 3.Degenhardt L, Charlson F, Ferrari A, et al. The global burden of disease attributable to alcohol and drug use in 195 countries and territories, 1990–2016: A systematic analysis for the Global Burden of Disease Study 2016. Lancet Psychiatry, 2018; 5: 987–1012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.West R. Tobacco smoking: Health impact, prevalence, correlates and interventions. Psychol Health, 2017; 32: 1018–1036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Nelson J, Bundoc-Baronia R, Comiskey G, et al. Facing addiction in America: The surgeon general’s report on alcohol, drugs, and health: A commentary. Alcohol Treat Q, 2017; 35: 445–454. [Google Scholar]
- 6.Rieckmann T, Kovas AE, and Rutkowski BA. Adoption of medications in substance abuse treatment: Priorities and strategies of single state authorities. J Psychoactive Drugs, 2010; Suppl 6: 227–238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.WHO. ATLAS on substance use 2017: Resources for the prevention and treatment of substance use disorders. WHO Forum on Alcohol, Drugs and Addictive Behaviours, 2017.
- 8.Miller N, Sheppard L, Colenda C, et al. Why physicians are unprepared to treat patients who have alcohol- and drug-related disorders. Acad Med, 2001; 76: 410–418. [DOI] [PubMed] [Google Scholar]
- 9.Arya S, Delic M, Ruiz BII, et al. Closing the gap between training needs and training provision in addiction medicine. BJPsych Int, 2020; 17: 37–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Guraya SY. The usage of social networking sites by medical students for educational purposes: A meta-analysis and systematic review. N Am J Med Sci, 2016; 8: 268–278. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Pander T, Pinilla S, Dimitriadis K, et al. The use of Facebook in medical education–A literature review. GMS Z Med Ausbild, 2014; 31(3): Doc 33. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Vogelsang M, Rockenbauch K, Wrigge H, et al. Medical education for “Generation Z”: everything online?!–An analysis of internet-based media use by teachers in medicine. GMS J Med Educ, 2018; 35(2): Doc 21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Medvarsity. https://www.medvarsity.com/all-courses/. (accessed September 09, 2021).
- 14.Harvard online courses. https://online-learning.harvard.edu/online-courses-harvard-university. (accessed September 09, 2021).
- 15.ACEE-India.org. Fellowship (FACEE). https://acee-india.org/home/fellowship. (accessed September 09, 2021).
- 16.Giurca BC. Social prescribing student champion scheme: A novel peer- assisted-learning approach to teaching social prescribing and social determinants of health. Educ Prim Care, 2018; 29: 307–309. [DOI] [PubMed] [Google Scholar]
- 17.Ko LN, Rana J, and Burgin S. Incorporating social media into dermatologic education. Dermatol Online J, 2017; 23(10): 13030. [PubMed] [Google Scholar]
- 18.Bello G, Pennisi MA, Maviglia R, et al. Online vs live methods for teaching difficult airway management to anesthesiology residents. Intensive Care Med, 2005; 31: 547–552. [DOI] [PubMed] [Google Scholar]
- 19.Schimming LM. Measuring medical student preference: A comparison of classroom versus online instruction for teaching pubmed. J Med Libr Assoc, 2008; 96: 217–222. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev, 2015; 4: 1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Alford DP, Richardson JM, Chapman SE, et al. A web-based alcohol clinical training (ACT) curriculum: Is in-person faculty development necessary to affect teaching?. BMC Med Educ, 2008; 8: 11. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Gunderson EW, Fiellin DA, Levin FR, et al. Evaluation of a combined online and in person training in the use of buprenorphine. Subst Abuse, 2006; 27: 39–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Hayes-Roth B, Saker R, and Amano K. Automating individualized coaching and authentic role-play practice for brief intervention training. Methods Inf Med, 2010; 49: 406–411. [DOI] [PubMed] [Google Scholar]
- 24.Karam-Hage M, Maher K-H, Brower KJ, et al. Web-streamed didactic instruction on substance use disorders compares favorably with live-lecture format. Acad Psychiatry, 2013; 37: 165–170. [DOI] [PubMed] [Google Scholar]
- 25.Lanken PN, Novack DH, Daetwyler C, et al. Efficacy of an internet-based learning module and small-group debriefing on trainees’ attitudes and communication skills toward patients with substance use disorders: Results of a cluster randomized controlled trial. Acad Med, 2015; 90: 345–354. [DOI] [PubMed] [Google Scholar]
- 26.Weingardt KR, Cucciare MA, Bellotti C, et al. A randomized trial comparing two models of web-based training in cognitive-behavioral therapy for substance abuse counselors. J Subst Abuse Treat, 2009; 37: 219–227. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Kelly P, Gotham HJ, Knopf-Amelung S, et al. Distance versus on-site educational strategies for competency-based screening, brief intervention, and referral to treatment education. J Addict Nurs, 2018; 29: E1–E8. [DOI] [PubMed] [Google Scholar]
- 28.Lee JD, Triola M, Gillespie C, et al. Working with patients with alcohol problems: A controlled trial of the impact of a rich media web module on medical student performance. J Gen Intern Med, 2008; 23: 1006–1009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Martino S, Canning-Ball M, Carroll KM, et al. A criterion-based stepwise approach for training counselors in motivational interviewing. J Subst Abuse Treat, 2011; 40: 357–365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Sholomskas DE, Syracuse-Siewert G, Rounsaville BJ, et al. We don’t train in vain: A dissemination trial of three strategies of training clinicians in cognitive-behavioral therapy. J Consult Clin Psychol, 2005; 73: 106–115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Ebn Ahmady A, Barker M, Dragonetti R, et al. A qualitative evaluation of an online expert-facilitated course on tobacco dependence treatment. Inq J Med Care Organ Provis Financ., 2017; 54: 46958017732967. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Harris JM and Sun H. A randomized trial of two e-learning strategies for teaching substance abuse management skills to physicians. Acad Med, 2013; 88: 1357–1362. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Rawson RA, Rataemane S, Rataemane L, et al. Dissemination and implementation of cognitive behavioral therapy for stimulant dependence: a randomized trial comparison of 3 approaches. Subst Abuse, 2013; 34: 108–117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Shafer MS, Rhode R, and Chong J. Using distance education to promote the transfer of motivational interviewing skills among behavioral health professionals. J Subst Abuse Treat, 2004; 26: 141–148. [DOI] [PubMed] [Google Scholar]
- 35.Koetting C and Freed P. Educating undergraduate psychiatric mental health nursing students in screening, brief intervention, referral to treatment (SBIRT) using an online, interactive simulation. Arch Psychiatr Nurs, 2017; 31: 241–247. [DOI] [PubMed] [Google Scholar]
- 36.Miller P, Heideman PW, Ravenel MC, et al. Preliminary development and evaluation of online tobacco and alcohol modules for dental students. J Dent Educ, 2011; 75: 791–796. [PubMed] [Google Scholar]
- 37.Truncali A, Lee JD, Ark TK, et al. Teaching physicians to address unhealthy alcohol use: A randomized controlled trial assessing the effect of a web-based module on medical student performance. J Subst Abuse Treat, 2011; 40: 203–213. [DOI] [PubMed] [Google Scholar]
- 38.Reinhold J, Pontiggia L, Angeles M, et al. Web-based instruction on substance abuse and drug diversion. Am J Pharm Educ, 2010; 74: 57. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Sarna L, Bialous SA, Zou XN, et al. Evaluation of a web-based educational programme on changes in frequency of nurses’ interventions to help smokers quit and reduce second-hand smoke exposure in China. J Adv Nurs, 2016; 72: 118–126. [DOI] [PubMed] [Google Scholar]
- 40.Grassi MC, Sansone A, Basili S, et al. Knowledge of nicotine dependence and treatment in clinical practice improved after an e-learning course among medical students. Clin Ter, 2019; 170: e252–e257. [DOI] [PubMed] [Google Scholar]
- 41.Kim H, Heverling H, Cordeiro M, et al. Internet training resulted in improved trainee performance in a simulated opioid-poisoned patient as measured by checklist. J Med Toxicol, 2016; 12: 289–294. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Roe SS and Banta-Green CJ. An initial evaluation of web-based opioid overdose education. Subst Use Misuse, 2016; 51: 268–275. [DOI] [PubMed] [Google Scholar]
- 43.Carneiro APL and Souza-Formigoni MLO. Country-wide distance training for delivery of screening and brief intervention for problematic substance use: A pilot evaluation of participant experiences and patient outcomes. Subst Abuse, 2018; 39: 102–109. [DOI] [PubMed] [Google Scholar]
- 44.Crits-Christoph P, Ring-Kurtz S, McClure B, et al. A randomized controlled study of a web-based performance improvement system for substance abuse treatment providers. J Subst Abuse Treat, 2010; 38: 251–262. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Sellers B, Galanter M, Dermatis H, et al. Enhancing physicians’ use of Alcoholics Anonymous: Internet-based training. J Addict Dis, 2005; 24: 77–86. [DOI] [PubMed] [Google Scholar]
- 46.Bishop D, Bryant KS, Giles SM, et al. Simplifying the delivery of a prevention program with web-based enhancements. J Prim Prev, 2006; 27: 433–444. [DOI] [PubMed] [Google Scholar]
- 47.Larson MJ, Amodeo M, Storti SA, et al. A novel CBT web course for the substance abuse workforce: Community counselors’ perceptions. Subst Abuse, 2009; 30: 26–39. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Pereira CA, Wen CL, and Tavares H. Alcohol abuse management in primary care: An e-learning course. Telemed J E-Health Off J Am Telemed Assoc, 2015; 21: 200–206. [DOI] [PubMed] [Google Scholar]
- 49.Saunder L. Developing an e-learning resource in clinical risk assessment. Nurs Manag (Harrow), 2012; 19: 26–29. [DOI] [PubMed] [Google Scholar]
- 50.Truncali A, Kalet AL, Gillespie C, et al. Engaging health professional students in substance abuse research: development and early evaluation of the SARET program. J Addict Med, 2012; 6: 196–204. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Cook DA, Garside S, Levinson AJ, et al. What do we mean by web-based learning? A systematic review of the variability of interventions. Med Educ, 2010; 44: 765–774. [DOI] [PubMed] [Google Scholar]
- 52.Beaunoyer E, Arsenault M, Lomanowska AM, et al. Understanding online health information: Evaluation, tools, and strategies. Patient Educ Couns, 2017; 100: 183–189. [DOI] [PubMed] [Google Scholar]
- 53.Traxler J. Distance learning— predictions and possibilities. Educ Sci, 2018; 8: 35. [Google Scholar]
- 54.Broadbent J and Poon WL. Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. Internet Higher Educ, 2015; 27: 1–13. [Google Scholar]
- 55.Selby P, Goncharenko K, Barker M, et al. Review and evaluation of online tobacco dependence treatment training programs for health care practitioners. J Med Internet Res, 2015; 17: e97. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Amole J, Heath J, Joshua TV, et al. Online tobacco cessation education to optimize standards of practice for psychiatric mental health nurses. Nurs Clin North Am, 2011; 47: 71–79. [DOI] [PubMed] [Google Scholar]
- 57.Marcus MT, Brown RL, Straussner SLA, et al. Creating change agents: A national substance abuse education project. Subst Abuse, 2006; 26: 5–15. [DOI] [PubMed] [Google Scholar]
- 58.Miller P, Ravenel M, Mauldin M, et al. An online alcohol and oral health curriculum for dental students. J Dent Educ, 2014; 78: 16–23. [PubMed] [Google Scholar]
- 59.Weingardt KR, Villafranca SW, and Levin C. Technology-based training in cognitive behavioral therapy for substance abuse counselors. Subst Abuse, 2006; 27: 19–25. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.

