Skip to main content
Internet Interventions logoLink to Internet Interventions
. 2020 Jun 2;21:100331. doi: 10.1016/j.invent.2020.100331

Consensus statement on the problem of terminology in psychological interventions using the internet or digital components

Ewelina Smoktunowicz a,b, Azy Barak c, Gerhard Andersson d,e, Rosa M Banos f,g, Thomas Berger h, Cristina Botella g,i, Blake F Dear j, Tara Donker k, David D Ebert l, Heather Hadjistavropoulos m, David C Hodgins n, Viktor Kaldo o,p, David C Mohr q, Tine Nordgreen r, Mark B Powers s, Heleen Riper k, Lee M Ritterband t, Alexander Rozental e,u, Stephen M Schueller v, Nickolai Titov j, Cornelia Weise w, Per Carlbring b,
PMCID: PMC7305336  PMID: 32577404

Abstract

Since the emergence of psychological interventions delivered via the Internet they have differed in numerous ways. The wealth of formats, methods, and technological solutions has led to increased availability and cost-effectiveness of clinical care, however, it has simultaneously generated a multitude of terms. With this paper, we first aim to establish whether a terminology issue exists in the field of Internet-delivered psychological interventions. If so, we aim to determine its implications for research, education, and practice. Furthermore, we intend to discuss solutions to mitigate the problem; in particular, we propose the concept of a common glossary. We invited 23 experts in the field of Internet-delivered interventions to respond to four questions, and employed the Delphi method to facilitate a discussion. We found that experts overwhelmingly agreed that there were terminological challenges, and that it had significant consequences for conducting research, treating patients, educating students, and informing the general public about Internet-delivered interventions. A cautious agreement has been reached that formulating a common glossary would be beneficial for the field to address the terminology issue. We end with recommendations for the possible formats of the glossary and means to disseminate it in a way that maximizes the probability of broad acceptance for a variety of stakeholders.

Keywords: Internet-delivered interventions, Digital health, Terminology, Internet, Psychotherapy, Consensus statement

Highlights

  • The field of Internet-delivered interventions faces inconsistent terminology issue.

  • Inconsistent terminology results in miscommunication between stakeholders.

  • A common glossary is a potential solution to remedy inconsistent terminology issue.

  • A diverse taskforce needs to called upon to propose a common glossary.


“Language is the source of misunderstandings.”

(The Little Prince, Antoine de Saint Exupéry)

1. Introduction

The emergence of Internet-delivered interventions in the mid-1990s has led to the continuous introduction of an abundance of approaches, methods, and techniques into the area of psychological and behavioral therapeutic and self-help interventions (Andersson et al., 2019b). As is typical of the richness and multifaceted structure of the Internet, these interventions are heterogeneous (Barak et al., 2009), and they differ from each other in numerous ways, including the technological platforms, use of technical features, level of textuality, degree of inclusion of online and offline factors, extent of human versus automatic involvement, professional qualifications of therapists, and other important aspects. On the one hand, this heterogeneity has generated much research and clinical implementations. On the other, as the field is moving to maturity, consideration needs to be given to rationalising the terminology that is used, to ensure consistency and common understanding. To demonstrate the scope of the heterogeneity in wording, we present the results of our review of terms in PubMed. Table 1 contains a list of terms used in scientific publications to designate Internet-delivered intervention procedures. From rarely used terms, such as chat treatment (1 title in PubMed), computer intervention (10) or online counseling (17), to much more prevalent ones, such as Internet-delivered therapy (175), web-based intervention (250), digital health (546), and teletherapy (785), this list provides an insight into the extent of the issue. Numerous terms imply that many different procedures are possible, each perhaps qualified by its distinctive characteristics. In fact, however, reality shows that there is no direct, or even indirect, connection between a term used and its representation, including the type of computer technology, platform or infrastructure, modality, clinical approach, or the type of intervention applied. Moreover, a review of the literature shows that there is no consistency in use of these terms over time and across publication outlets (Andersson et al., 2019a, Andersson et al., 2019b). Adding to the complexity are the differences in journal preferences and explicit instructions to change terms during the review process.

Table 1.

Examples of title terms used to delineate internet-delivered psychological interventions, including the number of occurrences in titles in PubMed in November 2019.

Term used Titles in PubMed Publication title Citation
Avatar-assisted therapy 3 Avatar-assisted therapy: a proof-of-concept pilot study of a novel technology-based intervention to treat substance use disorders. Gordon et al. (2017)
Chat treatment 1 Effectiveness of a web-based solution-focused brief chat treatment for depressed adolescents and young adults: randomized controlled trial. Kramer et al. (2014)
Computer-assisted therapy 15 Computer-assisted therapy for medication-resistant auditory hallucinations: proof-of-concept study. Leff et al. (2013)
Computer intervention 10 Development and preliminary pilot evaluation of a brief tablet computer intervention to motivate tobacco quitline use among smokers in substance use treatment. Brown et al. (2017)
Computerized therapy 6 Attitudes towards the use of computerized Cognitive Behavior Therapy (cCBT) with children and adolescents: a survey among Swedish mental health professionals. Vigerland et al. (2014)
Computer-mediated psychotherapy 1 Psychotherapy in cyberspace: A 5-dimensional model of online and computer-mediated psychotherapy. Suler (2000)
Computer therapy 11 My care manager, my computer therapy and me: The relationship triangle in computerized cognitive behavioral therapy. Cavanagh et al. (2018)
Cybertherapy 17 Cybertherapy meets Facebook, blogger, and second life: an Italian experience. Graffeo and La Barbera (2009)
Digital health 546 Accelerating digital mental health research from early design and creation to successful implementation and sustainment Mohr et al. (2017)
Digital service 3 Evaluation of the practitioner online referral and treatment service (PORTS): the first 18 months of a state-wide digital service for adults with anxiety, depression, or substance use problems Titov et al. (2019)
Distance counseling 1 The effectiveness of physical activity monitoring and distance counseling in an occupational setting - results from a randomized controlled trial (CoAct). Reijonsaari et al. (2012)
Distance therapy 1 Distance therapy to improve symptoms and quality of life: complementing office-based care with telehealth. Kroenke (2014)
E-aid 1 Effects of e-aid cognitive behavioral therapy for insomnia (eCBTI) to prevent the transition from episodic insomnia to persistent insomnia: study protocol for a randomized controlled trial. Yang et al. (2019)
E-counseling 7 Effects of self-guided e-counseling on health behaviors and blood pressure: Results of a randomized trial. Liu et al. (2019)
E-health program 2 Study protocol of a Dutch smoking cessation e-health program. Stanczyk et al. (2011)
E-mental health 87 User-centered app adaptation of a low-intensity E-mental health intervention for Syrian refugees Burchert et al. (2019)
Etherapy 4 Evaluating the role of digital intervention design in treatment outcomes and adherence to eTherapy programs for eating disorders: A systematic review and meta-analysis. Barakat et al. (2019)
E-therapy 27 e-Therapy in primary care mental health. Orman and O'Dea (2018)
E-mail therapy 3 Internet administered guided self-help versus individualized e-mail therapy: a randomized trial of two versions of CBT for major depression. Vernmark et al. (2010)
Guided self-help 187 Do nonsuicidal severely depressed individuals with diabetes profit from internet-based guided self-help? Secondary analyses of a pragmatic randomized trial. Schlicker et al. (2019)
Internet-administered treatment 4 The effects on depression of Internet-administered behavioral activation and physical exercise with treatment rationale and relapse prevention: study protocol for a randomized controlled trial. Carlbring et al. (2013)
Internet-based treatment 50 Combining attention training with Internet-based cognitive-behavioral self-help for social anxiety: a randomized controlled trial. Boettcher et al. (2014)
Internet-delivered therapy 175 Evaluating the efficacy of internet-delivered cognitive behavioral therapy blended with synchronous chat sessions to treat adolescent depression: randomized controlled trial. Topooco et al. (2019)
Internet intervention 81 The internet intervention patient adherence scale for guided internet-delivered behavioral interventions: development and psychometric evaluation. Lenhard et al. (2019)
Internet-supported therapy 2 Internet-supported versus face-to-face cognitive behavior therapy for depression. Andersson et al. (2016)
Internet therapy 11 What makes internet therapy work? Andersson et al. (2009)
Internet treatment 25 Three-year follow-up of insomnia and hypnotics after controlled internet treatment for insomnia. Blom et al. (2016)
Interapy 4 Efficacy and effectiveness of online cognitive behavioral treatment: a decade of interapy research. Ruwaard et al. (2011)
Medicine 2.0 20 Transforming patient experience: health web science meets medicine 2.0. McHattie et al. (2014)
Minimal-contact intervention(s) 7 The efficacy of minimal contact interventions for acute tinnitus: a randomized controlled study. Nyenhuis et al. (2013)
Online clinical work 1 Myths and realities of online clinical work. Fenichel et al. (2002)
Online counseling 17 Exploring young people's perceptions of the effectiveness of text-based online counseling: mixed methods pilot study. Navarro et al. (2019)
Online intervention 129 Online intervention to reduce pediatric anxiety: an evidence-based review. Santilhano (2019)
Online program 60 Baby steps - an online program promoting the well-being of new mothers and fathers: a study protocol. Hamilton et al. (2016)
Online psychotherapy 3 Does the quality of the working alliance predict treatment outcome in online psychotherapy for traumatized patients? Knaevelsrud and Maercker (2006)
Online therapy 13 Delivering solid treatments on shaky ground: feasibility study of an online therapy for child anxiety in the aftermath of a natural disaster. Stasiak et al. (2018)
Online treatment 29 Psychodynamic online treatment following supportive expressive therapy (SET): therapeutic rationale, interventions and treatment process. Beutel et al. (2018)
Self-help through the internet 2 Psychodynamic guided self-help for adult depression through the Internet: A randomized controlled trial. Johansson et al. (2012)
Telecounseling 2 Telecounseling in rural areas for alcohol problems. Baca et al. (2007)
Telepsychiatry 349 Telepsychiatry use in U.S. mental health facilities, 2010–2017. Spivak et al. (2019)
Telepsychology 18 Rationale and design: telepsychology service delivery for depressed elderly veterans. Egede et al. (2009)
Teletherapy 785 Comparison of functional outcomes and treatment cost between a computer-based cognitive rehabilitation teletherapy program and a face-to-face rehabilitation program. Schoenberg et al. (2008)
Treatment administered through a smartphone application 2 Behavioral activation vs. mindfulness-based guided self-help treatment administered through a smartphone application: a randomized controlled trial. Ly et al. (2014)
Virtual reality therapy 50 Attitudes towards and familiarity with virtual reality therapy among practicing cognitive behavior therapists: a cross-sectional survey study in the era of consumer VR platforms. Lindner et al. (2019)
Web-based intervention 250 Efficacy of a web-based intervention to increase uptake of maternal vaccines: an RCT. O'Leary et al. (2019)

Note. The table contains arbitrarily selected scientific publications in order to provide examples; there is no intention to comment on particular authors or publication outlets.

It is important to note that for numerous reasons, including the interdisciplinary nature of the field, this extensive vocabulary has not been a result of a consensus reached by representatives of the discipline in the course of a structured debate, but rather has been determined individually or at best locally. These determinations could have been influenced by well-established models or approaches, decisions by funding bodies, preferences of consumers and other stakeholders, cultural differences, as well as for arbitrary or biased reasons. As a consequence, the newness of computers, mobile devices, and the Internet alongside the lack of a long history and established tradition have contributed to local and personal lingual inventions. Terms that name interventions such as “e-mental health,” “Internet therapy,” or “online treatment” have been introduced periodically by individual researchers, but have become adopted more broadly as they resonate with others. The lack of consistency in regard to naming Internet-delivered interventions leads to situations in which terms are used in contexts that depart from their original meanings. For instance, “therapy online” was introduced and named by Colón (1996)—one of the pioneers in this area—to refer to a group chat led by a clinical social worker in which several women took part for two or more hours per day (sessions were named “conferences”), seven days per week, over the course of three months, to work on personal issues. While Colón's term has not been repeated letter-for-letter, the alternate term “online therapy” has been frequently and repeatedly used by many (e.g., Stasiak et al., 2018).

This brings us to the language itself. Although the consideration of all the functions that language serves is beyond the scope of this paper, its two purposes need to be emphasized. First, language is used for individual thinking processes, as it actually reflects ways and contents of thinking (Sfard, 2008). That is, unclear, inconsistent, or even inaccurate wording might reflect one's incoherent or perplexed understanding as well as affect one's intellectual processes, eventually affecting one's understanding, decision-making, or planning. Second, language is a means of interpersonal communication. Broad and unguided uses of terms—technological and psychological alike—can produce problematic scientific discourse, influence what might be reported and how, and lead to erroneous communication and conflicts. Furthermore, and perhaps even more troublesome, unclear and inconsistent discourse seems to be able to affect the narrative of the still-developing field of Internet-delivered interventions. There is a risk that continuing to use ambiguous and incongruous terms might impede the status and the image of the field.

To fulfill their role in facilitating communication, terminology conventions must be broad and agreed upon. The pervasive and accepted terms make discourse understood, accurate, and effective. Defective and incongruous discourse could not only undermine communication due to unclarity but also slow down the conceptualization and development of any given field. Steps to organize the communication in the field of Internet-delivered interventions had been made before. In Ritterband et al., 2003, Ritterband and colleagues proposed a definition of the term “Internet interventions”. A few years later the International Society for Research on Internet Interventions was formed to facilitate collaboration and communication among researchers and stakeholders (Ritterband et al., 2006). This was followed by a direct attempt to introduce lingual order in the area when Barak et al. (2009) suggested preliminary definitions for some forms of Internet-delivered psychological interventions. This initiative, however, has seemed to have had limited impact, as the incongruence in terminology persists. Possible explanations for this may lie in the process of creating the proposition of typology on the one hand, and in its dissemination on the other. For example, although the number of terms currently in operation can objectively be called excessive, the question remains of whether the relevant community perceives it as such. If not, this could mean that the momentum for change is simply not there yet. However, if many share the view that terminology is an issue, it would be necessary to first establish what its implications are specifically and for whom, and then act accordingly. We stand by the position that the answers to these questions and subsequent recommendations for how to proceed should not be provided by a few individuals, but rather should become a product of a structured exchange among people with vast knowledge of the subject (Borgo et al., 2018). Thus, the purpose of this paper was to provide a platform for such debate.

Specifically, we aimed to investigate the following. First, we sought to determine whether there was a consensus among the experts that the field of Internet-delivered psychological interventions indeed recognized the need to move towards more consistent terminology. Second, should there be an agreement, we wanted to establish what the consequences were for all stakeholders, from creators to consumers to policymakers. Finally, we explored possible solutions to mitigate this issue. In particular, we revisited the idea of formulating a common glossary, but strived to identify the barriers that could be encountered in the process and factors that could determine successful implementation.

2. Material and methods

Twenty three experts—clinicians and researchers in the field of mental health—were invited to discuss the issue of terminology in Internet-delivered psychological interventions based on their previously expressed interest in the topic during conferences and other exchanges. One person declined participation, not wanting to take a stand on the terminology issue at this time. The remaining 22 experts were in different stages of their careers—from postdoc to professor—and represented multiple countries: Australia, Austria, Canada, Germany, Israel, Norway, Poland, Spain, Sweden, Switzerland, the Netherlands, and the United States. They are all listed under Authors in this paper. To collect comments, facilitate a discussion, and reach a consensus, the Delphi method was used (Dalkey and Helmer, 1963; Danial-Saad et al., 2013). At its core, the technique is based on an iterative process of distributing questions and subsequent responses to experts in at least three rounds (Danial-Saad et al., 2013). These iterations allow the respondents to revise or elaborate on their own statements, as well as comment on those of others. In the final step, the responses are usually statistically aggregated. However, due to the qualitative character of the data in this project, we followed the approach of Rozental et al. (2014) and extracted common themes instead. Specifically, the following steps were completed. First, an initial survey with four open-ended questions was distributed online among the experts. It contained four questions: 1) In your opinion, is there a problem of unclear and/or inconsistent wording in communication regarding Internet-supported psychotherapeutic interventions? 2) If there is, what issues may arise from this problem (e.g., for professionals, students, and the general public)? 3) Would a proposed glossary for designating Internet-supported psychotherapeutic interventions remedy these issues? 4) Is there anything you would like to add regarding this issue? Do you have another proposed solution? Next, we compiled obtained replies and made them available to all experts, asking them to comment on both their own and others' responses. Based on the answers from these two rounds, a consensus statement was drafted which constitutes the Results section of this paper. Subsequently a manuscript was sent out to each participant. Comments on the draft were incorporated and the revised version was distributed for final comments and approval. Eighteen experts responded to the first and seventeen to the second round of questions, and all 22 revised a draft of the paper. The entire process was anonymous except for the final approval of the manuscript.

3. Results

3.1. Terminology issue

Due to the lack of shared and accepted definitions, Internet-delivered psychological interventions cover the spectrum from unguided self-help interventions to treatments in which patients receive ongoing feedback from a clinician. Currently, a range of terms are used interchangeably: Internet-interventions, e-therapy, online interventions, Internet-delivered interventions, and digital therapy, to name only a few. Inconsistent use goes both ways: different names are used to describe the same procedures, and similar names refer to different formats.

Differences in terminology are also noticeable on a more granular level than the treatment format: in particular, in describing the type (human vs technology-assisted) and amount of support. Currently, we operate with expressions such as guided, unguided, self-guided, or assisted to convey the extent to which a human is involved in the treatment; however, these terms can and do mean different things to both authors and recipients. They do not clearly reflect the nature of a specialist's involvement, which can be comprised of resolving technical problems, answering non-clinical questions, building rapport, supporting clients in gaining a deeper understanding of material, prompting completion, providing clinically informed feedback, and more (Andersson, 2014). Moreover, it is often not clear how much or how often any assistance is provided. Further contributing to the confusion is that interventions are often referred on the basis of the way they are delivered, which results in the introduction of a multitude of terms, such as app-based, virtual reality, and smartphone interventions (cf., Linardon et al., 2019).

3.1.1. Summary

There was a consensus among the experts that terminology used by the field should, where possible, be more consistent. Presently, the nature of the intervention could not be determined based on the name itself.

3.2. Consequences of the terminology issue

Terminology inconsistency leads to miscommunication. Operating with a multitude of terms affects the exchanges among researchers and between practitioners and their patients; it also complicates interactions with students, policy makers, the media, and the general public.

3.2.1. Researchers

In the academia, inconsistent terminology in publications is an obstacle when conducting systematic literature reviews and meta-analyses. Comprehensive reviews are contingent upon using the appropriate keywords, but more recently, those are virtually impossible to narrow down (cf., Andersson et al., 2019a). For instance, a review of guided interventions would require using combinations of words such as assisted, guided, and supported without a guarantee of identifying all relevant studies. Thus, the fact that research findings differ so significantly might partially be caused by this inconsistency in wording. Finding proper and—where possible—distinguishable terms for different forms of intervention would allow researchers to adequately assess the efficacy of Internet-delivered psychological interventions. The lack of consistent terminology also impacts communication among researchers in other ways. For example, it slows down the information flow, as it is necessary to read the intervention's description in detail to fully appreciate the specifics of the program. Furthermore, it makes it harder to build professional consortia and apply for funding together, which, in turn, hinders scientific development.

3.2.2. Students

The problem remains significant down the dissemination line. Students—who are the proximal recipients of information in academia—to an even greater extent than researchers face a problem of searching for relevant literature using keywords. Without distinctive definitions—and without the benefit of knowledge that the definitions are not distinctive—they might wrongly assume that there is only one type of intervention delivered via the Internet, make erroneous comparisons among the formats and procedures, and be unable to differentiate between therapy and self-help materials. Moreover, should they want to design and implement Internet-delivered interventions themselves, they might struggle without having clear guidelines on what constitutes their various aspects, such as the level and type of human support. Finally, through their publications, they also contribute to propagating inconsistent terminology.

3.2.3. Clinicians

In therapeutic context, for health professionals, inconsistent terminology impedes recognition of what each format actually involves if they appear under similar terms. This can lead to making inadequate decisions regarding the level of care. If the possible outcomes for patients in Internet-delivered treatments are exaggerated (e.g., by assuming that they are comparable to face-to-face therapy for all conditions), it might result in insufficient care. Alternatively, the effects of these treatments could be underestimated if clinicians perceive them as self-help materials only, or if they see the technology solely as a mode of communication. However, even therapists who are familiar with the general formats might struggle with more specific issues, such as whether they can interact with the program and incorporate it into their treatments, or whether their patients will continue working with them after initiating program use. For example, therapy via video conferencing is still traditional therapy, only delivered via a different channel (although significant and relevant communication factors make videoconferencing to some degree different from traditional face-to-face therapy; e.g., Drago et al., 2016). Yet, using other media, such as chat programs and apps, changes the way the therapy is delivered. Moreover, there are many differences in the methods of providing synchronous versus asynchronous therapy. Similarly, degree of care is very different when it is a self-guided or blended intervention (Vernmark et al., 2019). Each of these options has advantages and disadvantages, and there is respective evidence for each in terms of their usefulness, clinical-, and cost-effectiveness (Topooco et al., 2017). This multitude of intervention options translates into even more labels, and that might generate resistance among the treatment providers. Using Internet-delivered interventions can be challenging, at least initially, as it requires that professionals be trained in different capacities and methods, but having common and clearly defined terminology would undoubtedly help them navigate this new field.

3.2.4. General public

In the same vein, the general public—including patients—might have the wrong idea about what it means to include technology as part of a therapeutic or clinical process. One problem was already mentioned: assuming incorrectly that communication tools, such as Skype, constitute Internet-delivered therapy. Yet, even the word “Internet” can limit the understanding of available options, as it seems to imply the need to sit in front of a computer and does not account for other forms of delivery, such as mobile apps or virtual reality. The multitude of terms makes it difficult to immediately recognize if a given option involves meeting a therapist face-to-face or “just” via the Internet-supported device. This, in turn, might cause reluctance to initiate such interventions or, at the very least, prevent people from making an informed decision regarding their own healthcare. Furthermore, when the terms are not clearly defined, patients might come to have expectations regarding the procedure that are subsequently not met. Finally, the lack of consistently used terminology across the field prevents users from easily distinguishing empirically validated interventions—both therapy with digital components and self-help interventions—from non-evidence-based ones.

3.2.5. Media

An important intermediary between the world of research and therapeutic practice and the general public is the media. Journalists face additional problems when the terminology is unclear: not only do they need to comprehend the terms as they are constructed by academics, but they also must translate them into a language understood by a broad audience. Hence, if there is no consensus on the terminology among researchers, it is hardly possible for the media to report and interpret research findings correctly and communicate an accurate message to the public.

3.2.6. Decision makers

A major group of stakeholders in the field of Internet-delivered interventions constitutes policy makers, funding agencies, and health organizations. As with representatives of other groups, the main problem here is a lack of awareness of what Internet interventions actually involve and in what way their formats and procedures differ. However, in this case, confusion impacts the full circle of a given intervention's lifecycle, from securing funds to development to the dissemination of its results. If decision makers cannot easily differentiate between the more-effective and less-effective treatments, or in what kind of context an intervention is suitable to deliver, they might find it difficult to make informed decisions regarding funding. At the other end of the process, limited or misguided dissemination impacts the uptake among patients.

3.2.7. Summary

There was a consensus among experts that inconsistent terminology in the field of Internet-delivered psychological interventions resulted in disrupted communication among interested parties. This affected funding, research, education, and clinical practice.

3.3. Glossary: a potential solution?

The consensus among researchers—as clearly found in our Delphi Study— that there was a problem of terminology, and that it carried significant consequences for numerous stakeholders, raised the question of whether introducing a common glossary could be a useful solution. The short answer is “maybe”. This hesitation seems to be partly generated by foreseen obstacles to first agreeing on common terms, and then ensuring that they are actually used. There are questions regarding the glossary's size, the scope of the terms, and of course the fundamental one: who should stand behind these decisions and subsequently enforce them. The experience, knowledge, and influence of decision makers would undoubtedly be factors in subsequent implementation processes. Therefore, there seems to be an agreement that the glossary should not be a product of a discussion among researchers only. Ideally, it would be a result of consensus among a special “task force” comprised of representatives of all relevant parties, that could include scientists, journal editors, users/patients, policy makers, health care providers, and technical experts such as programmers and user-experience specialists.

Regardless of the specific terms that would eventually comprise the glossary, a shared vision of its structure is that it should allow for distinguishing between interventions on both the general and specific levels, and highlight the similarities and differences between them. For instance, the broader umbrella terms that describe wide-ranging approaches to using digital technologies in therapy would be followed by the lower-level specifiers that refer to the treatment components (e.g., degree of human guidance). Alternatively, the structure could take the form of a continuum that takes into account “how much” technology and therapist support there is in a given treatment. Yet another option is a checklist format (e.g., similar to CONSORT; Grant et al., 2018) containing questions developed to describe the intervention (e.g., Is this a self-help intervention?) and that prompt short, mostly yes/no responses.

For the glossary to succeed, at least partly, in solving the terminology issue, it needs to be followed by a proper and wide-scale dissemination. The first challenge in the implementation process is that—in a manner typical of all taxonomies—older definitions tend to prevail for quite some time. Thus, the process of introducing the new terminology (or perhaps eliminating the old one) might be slow. This issue is potentially exacerbated by the reality of rapid technological development, which makes some terms obsolete relatively soon after their introduction. Thus, systematic updates of the glossary would be necessary. Its survival depends on promotion across disciplines and national contexts. An example of how the latter can pose a challenge is a current tendency to call similar procedures Internet interventions in continental Europe, computerized cognitive behavioral therapy (CBT) in the United Kingdom, digital health in the United States, and digital/virtual health services in Australia. The dissemination even faces a time-related dilemma, as it remains an open question what to do with the past publications. As inconsistent terminology could have hindered or misdirected developments in the past, in both practice and research, is there a need (and if so, a way) to apply a common terminology to what has already been published?

A few factors could facilitate the successful dissemination. First, it is important that frontrunners across the fields endorse the common terminology. It could start with them forming the above-mentioned task force. Their consistent use of the common glossary in official communication—within and outside of academia—would inspire others to follow. Second, using the glossary should be strongly recommended by publication outlets and incorporated into their guidelines for authors. This could lead to a wider adoption of the terms: if they are used in research reports, they would later become part of systematic reviews and meta-analyses, which would subsequently validate their usefulness by mapping them to empirical data, and probably also spur a few updates. Third, a related solution is to create a glossary website that could be linked to by the journals, professional organizations, licensing authorities, government agencies, ethical codes, and academic institutions. The advantage of this solution is that only a single information source would need to be updated when necessary. Fourth, the consensus on the terminology, along with its rationale, could be presented at key professional conferences. This would have an additional benefit of being useful for addressing comments and answering questions from the community. Furthermore, organizations behind these conferences could endorse the proposed glossary. Finally, wide usage could be modelled by researchers and practitioners consistently applying these terms in all contexts (e.g., scientific and non-scientific publications, education, appearances in the media, and communication with policymakers).

3.3.1. Summary

The idea of creating a common glossary received moderate support among the experts. While there was a consensus that an attempt to develop a glossary should be made, its success was perceived as contingent upon three factors. First, members of the “task force” called upon to propose a typology need to represent diverse environments in terms of culture and occupation. Second, the structure of the typology would need to be easy to update and allow for both general concepts and their more specific components: Network of concepts is preferable over static dictionary. Finally, the implementation process would have to encourage wide-scale use of the common glossary.

4. Discussion

Since its origin, the field of Internet-delivered interventions has generated plenty of terms to describe the treatment formats and their components. Over time, this has progressed to a situation that experts in the discipline agree needs attention. This state of affairs is perhaps understandable, given the relatively recent emergence of the technologies that enabled the discipline and the variability across their applications. It is possible that over time some specific terms will eventually dominate the field and the number of operating terms will shrink. On the other hand, it is likely that the opposite will happen or that the terms will simply change (Eysenbach, 2019). It is our position that the consequences of inconsistent terminology, as they were presented in this paper, more than justify calling for action now.

We had three aims with this project. The first was to establish whether the experts in the field of Internet-delivered interventions agree that we face a pressing issue with inconsistent terminology. The answer to that was a resounding “yes.” The second aim was to investigate the implications of this issue. While we could predict that they would be predominantly related to communication, we wanted to be able to specify what consequences exist for which party. In the process of having a structured discussion, we were able to extract the difficulties caused by the inconsistent terminology. Some of these difficulties were typical for research (e.g., conducting a literature review using adequate keywords), and some were relevant for more than one group of stakeholders (e.g., differentiating between using technology as a part of intervention versus only as a mode of delivery). It is worth noting that the areas for which we identified implications of inconsistent terminology were determined through responses to the open-ended questions posed to the experts, and were not pre-determined. Specific areas (i.e., research, education, practice, media and policy making bodies) emerged only during the subsequent structured discussion. Moreover, the consequences listed in this paper are not exhaustive; In order to fully review all potential implications for each of these areas a thorough and directed examination would have to be conducted. Similarly, probably not all issues stemming from inconsistent terminology were raised. For example, we found that experts emphasized the degree of human support in Internet-delivered interventions, which might indicate that this is a particularly pressing problem, however other aspects in this field—such as descriptions of interventions in terms of how gamified or persuasive their designs are—also seem to suffer from ambiguity in terminology. Finally, the third goal was to investigate whether introducing a common glossary would constitute a solution to the problem. The answer to this question turned out to be complex and dependent upon whether a set of conditions can be met, including finding an adequate format for the glossary and taking steps to encourage its use on a large scale.

Based on these findings, we propose that the next step should be to form a team of experts—a “task force”—comprised of representatives of areas across the field and from different cultural contexts. The need for such a group could be communicated via this very paper, editorials in leading journals in the field, at conferences such as the International Society for Research on Internet Interventions (ISRII), and through informal channels. Diversity in terms of expertise, nationality, and career stage seems to be the key to gaining a vote of confidence. Results of the proceedings of this group, including the glossary's proposal and implementation plan, could be disseminated in the form of a follow-up consensus statement.

It is inevitable that whatever set of terms is agreed upon, it will not be accepted by all relevant actors. This is understandable, as it is hardly possible to create a glossary that would account for the heterogeneity throughout the field. For example, terminology will most probably prevail to differ to some extent by region and across domains. In fact, one limitation of this study is that responders were predominantly researchers in clinical psychology and came from global North. In the process of proposing the glossary, greater diversity will be needed. Yet, the benefit of better communication between representatives of various groups likely outweighs the cost of an imperfect initial glossary. Creating the first typology opens up a possibility of perfecting it over time, or, alternatively, agreeing that a finite vocabulary is not a goal, and instead, that it is important to have an efficient updating procedure in place. At the same time, a common glossary has not been universally valued as a solution to all the issues that we listed in this paper, and as a professional community, we should remain open to other ideas.

Because the challenges related to inconsistent language reflect the emerging maturity of the field, we appreciate that there is already enough research to even warrant a discussion of terminology. Despite the arguments laid out above to demonstrate how heterogeneous the vocabulary is and what impact it has on the development of the discipline, the discipline seems to move forward nevertheless, producing research, organizing societies, and attracting new adepts among both academics and practitioners. On the one hand, this suggests that there is no telling how far we can go when we start speaking the same language. On the other, perhaps, not having a common terminology for Internet-delivered psychological interventions constitutes a problem not only because of all the negative consequences listed in this article, but because of the positive aspects of having one. Having common terms would facilitate the dissemination of Internet-delivered interventions. An analogy can be drawn to the terminology used for CBT. The term CBT is widely accepted by clinicians and researchers despite the fact that CBT actually is an umbrella term and the specific therapeutic techniques used can be different. In fact, several similar terms could be used instead without hindering the communication between interested parties. However, having a label recognized by everyone helps to include all research and knowledge within that umbrella, accumulate evidence, better disseminate this type of intervention, better identify this field of work, and give greater visibility to a field. It creates a “brand,” which makes it easier to recognize a product, and is even perceived of as a seal of approval. Having a common term for psychological interventions conducted with the aid of technology could help to achieve the same goals.

Acknowledgments

Acknowledgments

The current project was inspired by a conference paper presentation: Barak, A. (2013, May). Concepts, definitions, and applications: The terminology chaos of Internet-supported psychotherapeutic interventions. Paper presented at the 6th International Society for Research on Internet Interventions (ISRII) meeting, Chicago, IL, USA. We thank Martin Oscarsson for his assistance.

Funding

This research was in part supported by scholarship granted to Ewelina Smoktunowicz by Polish National Agency for Academic Exchange within the Bekker programme.

Declaration of competing interest

The authors declare no conflict of interests.

References

  1. Andersson G. CRC Press; 2014. The Internet and CBT: A Clinical Guide; p. 2014. [DOI] [Google Scholar]
  2. Andersson G., Carlbring P., Berger T., Almlöv J., Cuijpers P. What makes internet therapy work? Cogn. Behav. Ther. 2009;38(Suppl. 1):55–60. doi: 10.1080/16506070902916400. [DOI] [PubMed] [Google Scholar]
  3. Andersson G., Topooco N., Havik O., Nordgreen T. Internet-supported versus face-to-face cognitive behavior therapy for depression. Expert. Rev. Neurother. 2016;16(1):55–60. doi: 10.1586/14737175.2015.1125783. [DOI] [PubMed] [Google Scholar]
  4. Andersson G., Carlbring P., Titov N., Lindefors N. Internet interventions for adults with anxiety and mood disorders: a narrative umbrella review of recent meta–analyses. Can. J. Psychiatr. 2019;64(7):465–470. doi: 10.1177/0706743719839381. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Andersson G., Titov N., Dear B.F., Rozental A., Carlbring P. Internet–delivered psychological treatments: from innovation to implementation. World Psychiatry. 2019;18(1):20–28. doi: 10.1002/wps.20610. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Baca C.T., Alverson D.C., Manuel J.K., Blackwell G.L. Telecounseling in rural areas for alcohol problems. Alcohol. Treat. Q. 2007;25(4):31–45. doi: 10.1300/J020v25n04_03. [DOI] [Google Scholar]
  7. Barak A., Klein B., Proudfoot J.G. Defining internet–supported therapeutic interventions. Ann. Behav. Med. 2009;38(1):4–17. doi: 10.1007/s12160–009–9130–7. [DOI] [PubMed] [Google Scholar]
  8. Barakat S., Maguire S., Smith K.E., Mason T.B., Crosby R.D., Touyz S. Evaluating the role of digital intervention design in treatment outcomes and adherence to eTherapy programs for eating disorders: a systematic review and meta–analysis. The International Journal of Eating Disorders. 2019;52(10):1077–1094. doi: 10.1002/eat.23131. [DOI] [PubMed] [Google Scholar]
  9. Beutel M.E., Böhme K., Banerjee M., Zwerenz R. Psychodynamic online treatment following supportive expressive therapy (SET): therapeutic rationale, interventions and treatment process. Zeitschrift Fur Psychosomatische Medizin Und Psychotherapie. 2018;64(2):186–197. doi: 10.13109/zptm.2018.64.2.186. [DOI] [PubMed] [Google Scholar]
  10. Blom K., Jernelöv S., Rück C., Lindefors N., Kaldo V. Three–year follow–up of insomnia and hypnotics after controlled internet treatment for insomnia. Sleep. 2016;39(6):1267–1274. doi: 10.5665/sleep.5850. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Boettcher J., Hasselrot J., Sund E., Andersson G., Carlbring P. Combining attention training with internet–based cognitive–behavioural self–help for social anxiety: a randomised controlled trial. Cogn. Behav. Ther. 2014;43(1):34–48. doi: 10.1080/16506073.2013.809141. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Borgo S., Marks I., Sibilia L. The common language for psychotherapy. The first 101. 2018. https://www.commonlanguagepsychotherapy.org/ Retrieved from.
  13. Brown R.A., Hecht J., Bloom E.L., Minami H., Kahler C.W., Abrantes A.M.…Ondersma S.J. Development and preliminary pilot evaluation of a brief tablet computer intervention to motivate tobacco quitline use among smokers in substance use treatment. The American Journal on Addictions. 2017;26(6):587–594. doi: 10.1111/ajad.12559. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Burchert S., Alkneme M.S., Bird M., Carswell K., Cuijpers P., Hansen P., Knaevelsrud C. User-centered app adaptation of a low-intensity e-mental health intervention for Syrian refugees. Frontiers in Psychiatry. 2019;9 doi: 10.3389/fpsyt.2018.00663. [DOI] [PMC free article] [PubMed] [Google Scholar]
  15. Carlbring P., Lindner P., Martell C., Hassmén P., Forsberg L., Ström L., Andersson G. The effects on depression of internet–administered behavioural activation and physical exercise with treatment rationale and relapse prevention: study protocol for a randomised controlled trial. Trials. 2013;14:35. doi: 10.1186/1745–6215–14–35. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Cavanagh K., Herbeck Belnap B., Rothenberger S.D., Abebe K.Z., Rollman B.L. My care manager, my computer therapy and me: the relationship triangle in computerized cognitive behavioural therapy. Internet Interv. 2018;11:11–19. doi: 10.1016/j.invent.2017.10.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Colón Y. Chatt(er)ing through the fingertips: doing group therapy online. Women & Performance: A Journal of Feminist Theory. 1996;9(1):205–215. doi: 10.1080/07407709608571259. [DOI] [Google Scholar]
  18. Dalkey N., Helmer O. An experimental application of the DELPHI method to the use of experts. Manag. Sci. 1963;9(3):458–467. doi: 10.1287/mnsc.9.3.458. [DOI] [Google Scholar]
  19. Danial-Saad A., Kuflik T., Tamar Weiss P.L.T., Schreuer N. Building an ontology for assistive technology using the Delphi method. Disability and Rehabilitation. Assistive Technology. 2013;8(4):275–286. doi: 10.3109/17483107.2012.723238. [DOI] [PubMed] [Google Scholar]
  20. Drago A., Winding T.N., Antipa N. Videoconferencing in psychiatry, a meta-analysis of assessment and treatment. European Psychiatry. 2016;36:29–37. doi: 10.1016/j.eurpsy.2016.03.007. [DOI] [PubMed] [Google Scholar]
  21. Egede L.E., Frueh C.B., Richardson L.K., Acierno R., Mauldin P.D., Knapp R.G., Lejuez C. Rationale and design: Telepsychology service delivery for depressed elderly veterans. Trials. 2009;10:22. doi: 10.1186/1745–6215–10–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Eysenbach G. Celebrating 20 years of open access and innovation at JMIR publications. J. Med. Internet Res. 2019;21(12) doi: 10.2196/17578. [DOI] [PMC free article] [PubMed] [Google Scholar]
  23. Fenichel M., Suler J., Barak A., Zelvin E., Jones G., Munro K.…Walker–Schmucker W. Myths and realities of online clinical work. Cyberpsychology & Behavior. 2002;5(5):481–497. doi: 10.1089/109493102761022904. [DOI] [PubMed] [Google Scholar]
  24. Gordon M.S., Carswell S.B., Schadegg M., Mangen K., Merkel K., Tangires S., Vocci F.J. Avatar–assisted therapy: a proof–of–concept pilot study of a novel technology–based intervention to treat substance use disorders. The American Journal of Drug and Alcohol Abuse. 2017;43(5):518–524. doi: 10.1080/00952990.2017.1280816. [DOI] [PubMed] [Google Scholar]
  25. Graffeo I., La Barbera D. Cybertherapy meets Facebook, blogger, and second life: an Italian experience. Studies in Health Technology and Informatics. 2009;144:108–112. doi: 10.3389/conf.neuro.14.2009.06.039. [DOI] [PubMed] [Google Scholar]
  26. Grant S., Mayo-Wilson E., Montgomery P., Macdonald G., Michie S., Hopewell S., Moher D. CONSORT–SPI 2018 explanation and elaboration: guidance for reporting social and psychological intervention trials. Trials. 2018:19. doi: 10.1186/s13063–018–2735–z. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Hamilton K., Kavanagh D., Connolly J., Davis L., Fisher J., Halford K.…Wittkowski A. Baby Steps – an online program promoting the well–being of new mothers and fathers: A study protocol. JMIR Research Protocols. 2016;5(3):e140. doi: 10.2196/resprot.5706. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Johansson R., Ekbladh S., Hebert A., Lindström M., Möller S., Petitt E.…Andersson G. Psychodynamic guided self–help for adult depression through the internet: A randomised controlled trial. PloS One. 2012;7(5) doi: 10.1371/journal.pone.0038021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Knaevelsrud C., Maercker A. Does the quality of the working alliance predict treatment outcome in online psychotherapy for traumatized patients? J. Med. Internet Res. 2006;8(4):e31. doi: 10.2196/jmir.8.4.e31. [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Kramer J., Conijn B., Oijevaar P., Riper H. Effectiveness of a web–based solution–focused brief chat treatment for depressed adolescents and young adults: randomized controlled trial. J. Med. Internet Res. 2014;16(5):e141. doi: 10.2196/jmir.3261. [DOI] [PMC free article] [PubMed] [Google Scholar]
  31. Kroenke K. Distance therapy to improve symptoms and quality of life: complementing office–based care with telehealth. Psychosom. Med. 2014;76(8):578–580. doi: 10.1097/PSY.0000000000000111. [DOI] [PubMed] [Google Scholar]
  32. Leff J., Williams G., Huckvale M.A., Arbuthnot M., Leff A.P. Computer–assisted therapy for medication–resistant auditory hallucinations: proof–of–concept study. Br. J. Psychiatry J. Ment. Sci. 2013;202:428–433. doi: 10.1192/bjp.bp.112.124883. [DOI] [PubMed] [Google Scholar]
  33. Lenhard F., Mitsell K., Jolstedt M., Vigerland S., Wahlund T., Nord M.…Högström J. The internet intervention patient adherence scale for guided internet–delivered behavioral interventions: Development and psychometric evaluation. Journal of Medical Internet Research. 2019;21(10) doi: 10.2196/13602. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Linardon J., Cuijpers P., Carlbring P., Messer M., Fuller–Tyszkiewicz M. The efficacy of app–supported smartphone interventions for mental health problems: a meta–analysis of randomized controlled trials. World Psychiatry. 2019;18(3):325–336. doi: 10.1002/wps.20673. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Lindner P., Miloff A., Zetterlund E., Reuterskiöld L., Andersson G., Carlbring P. Attitudes toward and familiarity with virtual reality therapy among practicing cognitive behavior therapists: a cross–sectional survey study in the era of consumer VR platforms. Front. Psychol. 2019;10:176. doi: 10.3389/fpsyg.2019.00176. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Liu S., Tanaka R., Barr S., Nolan R.P. Effects of self–guided e–counseling on health behaviors and blood pressure: results of a randomized trial. Patient Educ. Couns. 2019 doi: 10.1016/j.pec.2019.10.007. [DOI] [PubMed] [Google Scholar]
  37. Ly K.H., Trüschel A., Jarl L., Magnusson S., Windahl T., Johansson R.…Andersson G. Behavioural activation versus mindfulness–based guided self–help treatment administered through a smartphone application: A randomised controlled trial. BMJ Open. 2014;4(1) doi: 10.1136/bmjopen–2013–003440. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. McHattie L.–.S., Cumming G., French T. Transforming patient experience: health web science meets medicine 2.0. Medicine 2.0. 2014;3(1):e2. doi: 10.2196/med20.3128. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Mohr D.C., Lyon A.R., Lattie E.G., Reddy M., Schueller S.M. Accelerating digital mental health research from early design and creation to successful implementation and sustainment. J. Med. Internet Res. 2017;19(5) doi: 10.2196/jmir.7725. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Navarro P., Bambling M., Sheffield J., Edirippulige S. Exploring young people’s perceptions of the effectiveness of text–based online counseling: mixed methods pilot study. JMIR Mental Health. 2019;6(7) doi: 10.2196/13152. [DOI] [PMC free article] [PubMed] [Google Scholar]
  41. Nyenhuis N., Zastrutzki S., Weise C., Jäger B., Kröner–Herwig B. The efficacy of minimal contact interventions for acute tinnitus: a randomised controlled study. Cogn. Behav. Ther. 2013;42(2):127–138. doi: 10.1080/16506073.2012.655305. [DOI] [PubMed] [Google Scholar]
  42. O’Leary S.T., Narwaney K.J., Wagner N.M., Kraus C.R., Omer S.B., Glanz J.M. Efficacy of a web–based intervention to increase uptake of maternal vaccines: an RCT. Am. J. Prev. Med. 2019;57(4):e125–e133. doi: 10.1016/j.amepre.2019.05.018. [DOI] [PubMed] [Google Scholar]
  43. Orman J., O’Dea B. E–therapy in primary care mental health. Australian Journal of General Practice. 2018;47(4):168–172. doi: 10.31128/ajgp-11-17-4410. [DOI] [PubMed] [Google Scholar]
  44. Reijonsaari K., Vehtari A., Kahilakoski O.P., van Mechelen W., Aro T., Taimela S. The effectiveness of physical activity monitoring and distance counseling in an occupational setting—Results from a randomized controlled trial (CoAct) BMC Public Health. 2012;12:344. doi: 10.1186/1471–2458–12–344. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Ritterband L.M., Gonder-Frederick L.A., Cox D.J., Clifton A.D., West R.W., Borowitz S.M. Internet interventions: in review, in use, and into the future. Prof. Psychol. Res. Pract. 2003;34(5):527–534. doi: 10.1037/0735-7028.34.5.527. [DOI] [Google Scholar]
  46. Ritterband L.M., Andersson G., Christensen H.M., Carlbring P., Cuijpers P. Directions for the International Society for Research on internet interventions (ISRII) J. Med. Internet Res. 2006;8(3):e23. doi: 10.2196/jmir.8.3.e23. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Rozental A., Andersson G., Boettcher J., Ebert D.D., Cuijpers P., Knaevelsrud C., Carlbring P. Consensus statement on defining and measuring negative effects of internet interventions. Internet Interv. 2014;1(1):12–19. doi: 10.1016/j.invent.2014.02.001. [DOI] [Google Scholar]
  48. Ruwaard J., Lange A., Schrieken B., Emmelkamp P. Efficacy and effectiveness of online cognitive behavioral treatment: a decade of interapy research. Studies in Health Technology and Informatics. 2011;167:9–14. [PubMed] [Google Scholar]
  49. Santilhano M. Online intervention to reduce pediatric anxiety: an evidence–based review. Journal of Child and Adolescent Psychiatric Nursing. 2019;32(4):197–209. doi: 10.1111/jcap.12256. [DOI] [PubMed] [Google Scholar]
  50. Schlicker S., Weisel K.K., Buntrock C., Berking M., Nobis S., Lehr D.…Ebert D.D. Do nonsuicidal severely depressed individuals with diabetes profit from Internet–based guided self–help? Secondary analyses of a pragmatic randomized trial. Journal of Diabetes Research. 2019;2019 doi: 10.1155/2019/2634094. [DOI] [PMC free article] [PubMed] [Google Scholar]
  51. Schoenberg M.R., Ruwe W.D., Dawson K., McDonald N.B., Houston B., Forducey P.G. Comparison of functional outcomes and treatment cost between a computer–based cognitive rehabilitation teletherapy program and a face–to–face rehabilitation program. Prof. Psychol. Res. Pract. 2008;39(2):169–175. doi: 10.1037/0735–7028.39.2.169. [DOI] [Google Scholar]
  52. Sfard A. Cambridge University Press; Cambridge: 2008. Thinking as Communicating: Human Development, Development of Discourses, and Mathematizing. [Google Scholar]
  53. Spivak S., Spivak A., Cullen B., Meuchel J., Johnston D., Chernow R.…Mojtabai R. Telepsychiatry use in U.S. mental health facilities, 2010–2017. Psychiatric Services. 2019 doi: 10.1176/appi.ps.201900261. [DOI] [PubMed] [Google Scholar]
  54. Stanczyk N.E., Bolman C., Muris J.W.M., de Vries H. Study protocol of a Dutch smoking cessation e–health program. BMC Public Health. 2011;11:847. doi: 10.1186/1471–2458–11–847. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Stasiak K., Merry S.N., Frampton C., Moor S. Delivering solid treatments on shaky ground: feasibility study of an online therapy for child anxiety in the aftermath of a natural disaster. Psychother. Res. 2018;28(4):643–653. doi: 10.1080/10503307.2016.1244617. [DOI] [PubMed] [Google Scholar]
  56. Suler J.R. Psychotherapy in cyberspace: a 5–dimensional model of online and computer–mediated psychotherapy. CyberPsychology & Behavior. 2000;3(2):151–159. doi: 10.1089/109493100315996. [DOI] [Google Scholar]
  57. Titov N., Rock D., Bezuidenhout G., Webb N., Kayrouz R., Nielssen O., Staples L.G. Evaluation of the practitioner online referral and treatment service (PORTS): the first 18 months of a state–wide digital service for adults with anxiety, depression, or substance use problems. Cogn. Behav. Ther. 2019:1–20. doi: 10.1080/16506073.2019.1666162. [DOI] [PubMed] [Google Scholar]
  58. Topooco N., Riper H., Araya R., Berking M., Brunn M., Chevreul K., Andersson G. Attitudes towards digital treatment for depression: a European stakeholder survey. Internet Interv. 2017;8:1–9. doi: 10.1016/j.invent.2017.01.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Topooco N., Byléhn S., Dahlström Nysäter E., Holmlund J., Lindegaard J., Johansson S.…Andersson G. Evaluating the efficacy of Internet–delivered cognitive behavioral therapy blended with synchronous chat sessions to treat adolescent depression: Randomized controlled trial. Journal of Medical Internet Research. 2019;21(11) doi: 10.2196/13393. [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Vernmark K., Lenndin J., Bjärehed J., Carlsson M., Karlsson J., Oberg J.…Andersson G. Internet administered guided self–help versus individualized e–mail therapy: A randomized trial of two versions of CBT for major depression. Behaviour Research and Therapy. 2010;48(5):368–376. doi: 10.1016/j.brat.2010.01.005. [DOI] [PubMed] [Google Scholar]
  61. Vernmark K., Hesser H., Topooco N., Berger T., Riper H., Luuk L.…Andersson G. Working alliance as a predictor of change in depression during blended cognitive behaviour therapy. Cognitive Behaviour Therapy. 2019;48(4):285–299. doi: 10.1080/16506073.2018.1533577. [DOI] [PubMed] [Google Scholar]
  62. Vigerland S., Ljótsson B., Bergdahl Gustafsson F., Hagert S., Thulin U., Andersson G., Serlachius E. Attitudes towards the use of computerized cognitive behavior therapy (cCBT) with children and adolescents: a survey among Swedish mental health professionals. Internet Interv. 2014;1(3):111–117. doi: 10.1016/j.invent.2014.06.002. [DOI] [Google Scholar]
  63. Yang Y., Luo X., Paudel D., Zhang J., Li S.X., Zhang B. Effects of e–aid cognitive behavioural therapy for insomnia (eCBTI) to prevent the transition from episodic insomnia to persistent insomnia: study protocol for a randomised controlled trial. BMJ Open. 2019;9(11):e033457. doi: 10.1136/bmjopen–2019–033457. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Internet Interventions are provided here courtesy of Elsevier

RESOURCES